Projects

Selected Work

Competition · Oct 2026 – Nov 2026

Vision-Based Bin-Picking Assembly on a Rainbow RB10

Placed 2nd and received the Excellence Award at KETI’s 2026 robot manufacturing-process competition with a three-person lab team, where I was the only undergraduate alongside two master’s students. A Rainbow Robotics RB10 picks three kinds of parts out of a bin and inserts them into matching guides. After a GR00T VLA design proved too slow, we built a modular pipeline: YOLO26 instance segmentation fine-tuned on real RealSense D415 images, calibrated geometric pose estimation, and SDK-driven motion.

2nd Final ranking · Excellence Award

Read more

All Projects

Oct 2026 – Nov 20262nd place · Excellence AwardCompetition

Vision-Based Bin-Picking Assembly on a Rainbow RB10

Team Member · Perception, Data & Field Integration · Team WIC, Hanyang University

Placed 2nd and received the Excellence Award at KETI’s 2026 robot manufacturing-process competition with a three-person lab team, where I was the only undergraduate alongside two master’s students. A Rainbow Robotics RB10 picks three kinds of parts out of a bin and inserts them into matching guides. After a GR00T VLA design proved too slow, we built a modular pipeline: YOLO26 instance segmentation fine-tuned on real RealSense D415 images, calibrated geometric pose estimation, and SDK-driven motion.

Details
  • Proposed the initial GR00T vision-language-action (VLA) teacher–student design; the team moved to a faster modular pipeline when speed became the constraint.
  • Trained the YOLO26 segmentation model and collected real D415 data; on held-out real viewpoints it found all 144 targets with no false positives, where the synthetic-only model had missed every guide.
  • Before the competition, added the containerized SDK runtime, TCP position control, lens and yaw calibration, force-controlled gripping, shorter motion routes, and operator-console updates.
  • Responsible for model training, code verification, and data collection.

Technologies: YOLO26 (instance segmentation) · Intel RealSense D415 · Rainbow Robotics RB10 · Zimmer GEH6060IL Gripper · MuJoCo · Python · Docker · NVIDIA GR00T (initial design)

Launched Sep 2026LivePersonal

EIGENROOM: Interactive Control Engineering Lab

Individual Project · Design, Development & Operation

A browser-based control engineering lab where learners change a controller and immediately see the physical and plotted response of a DC motor or an inverted cart-pole.

Details
  • Launched on September 25, 2026 with 18 guided experiments across PID, lead/lag, LQR, Kalman filtering, and LQG, plus an 18-chapter bilingual Lecture Room.
  • Runs a deterministic nonlinear simulation in a Web Worker and checks the motor model against an exact sampled linear-system reference computed with SciPy.
  • Lets learners pin runs for comparison, save them locally, and share reproducible experiments as versioned URLs, JSON, or CSV.

Technologies: TypeScript · React · Next.js · Web Workers · ECharts · Cloudflare Workers

Summer 2026CourseworkAI-based 3D Autonomous Driving: 3D From NeRF to World ModelsSummer 2026

3D Gaussian Splatting Reconstruction

Team Project

Built an end-to-end COLMAP-to-3D Gaussian Splatting pipeline from captured indoor video, studying the practical relationship between camera-pose estimation, sparse geometry, initialization, and reconstruction quality.

Details
  • Extracted frames from 720p video, estimated camera poses and sparse geometry with COLMAP, undistorted images, and trained 3DGS reconstructions.
  • Compared reconstructions for a doll-on-table, table-only, and room scene; the best doll-on-table result reached PSNR 32.14.
  • Showed that camera poses were essential to reconstruction quality, while sparse points served as initialization rather than ground-truth labels; random-point initialization reduced PSNR from 32.14 to 24.54.
  • Identified COLMAP as the primary pipeline bottleneck: the 6 fps doll scene took about 51 minutes for COLMAP versus about 16 minutes for 30k 3DGS iterations.

Technologies: COLMAP · 3D Gaussian Splatting · CUDA · Conda · FFmpeg

Summer 2026CourseworkData Labeling and Model Building for Physical AISummer 2026

Data Labeling and Model Building for Physical AI

Coursework Project

Followed the full data-to-driving workflow by collecting camera data, curating and annotating a dataset, training a model, and designing an autonomous-driving algorithm.

Details
  • Collected and organized camera data directly, then annotated the dataset for model training.
  • Trained a perception model from the labeled data and used the resulting pipeline to design an autonomous-driving algorithm.
  • Learned how label balance, data coverage, and overall data quality can determine model behavior throughout the training process.
  • Approached annotation as a model-aware task, including bounding boxes for small objects when they matter to the intended driving behavior.

Technologies: Computer Vision · Data Annotation · Object Detection · Python · OpenCV

May 2026 – Jun 2026CourseworkECL4022Introduction to OptimizationSpring 2026

Reinforcement Learning for MiniGrid Maze Navigation

Team Project

Designed a deterministic MiniGrid maze and compared tabular reinforcement learning with a CNN-based Deep Q-Network for local-observation navigation.

Details
  • Formulated the maze as a Markov decision process and implemented Q-Learning and SARSA baselines, both of which reached the 15-step optimal path.
  • Built a DQN with a three-layer CNN, experience replay, target network, RMSprop optimization, and epsilon-greedy exploration for 64 × 64 local RGB and grayscale observations.
  • Showed that grayscale input retained the optimal 15-step path while training about 15% faster than RGB; the best tested configuration reached the target in 761 episodes with epsilon decay 0.95.
  • Analyzed an RGB early-stopping model that appeared to converge by training reward but failed deterministic testing, highlighting the need for policy-level evaluation.

Technologies: Python · PyTorch · MiniGrid · Reinforcement Learning

Mar 2026 – Aug 2026Competition

MACS: Magnetic AGV Contactless-charging System

Team Project · Hardware Lead

Proposed and validated waypoint-based dynamic wireless charging for indoor logistics AGVs using commercial 82–85 kHz WPT modules.

Details
  • Awarded 2nd place at the Energy Up! 2026 New Energy Industry Idea Lab Competition, ranking 2nd among 13 teams.
  • Received the President of Korea Electrical Engineers Association Award at the 2026 KIPE IE Competition, ranking 4th among 35 teams.
  • Integrated transmitter and receiver modules into a ROBOTIS TurtleBot and redesigned its battery and electrical system.
  • Proposed waypoint charging instead of a fully embedded track and designed the corresponding driving logic.

Technologies: WPT · Raspberry Pi · ROS · Arduino · Fusion 360 · Isaac Sim

Mar 2026 – Jun 2026CourseworkECL4015Applied Power ConversionSpring 2026 · Senior year, Semester 1

LLC Resonant DC-DC Converter for an EV On-Board Charger

Design & Validation

Designed and verified an LLC resonant DC-DC converter for an electric-vehicle on-board charger, from resonant-network design and component selection through switching-level simulation.

Details
  • Designed for an 800 Vdc input, 400/500/600 V outputs, and 25–100% load conditions while maintaining zero-voltage switching across the specified range.
  • Derived resonant-network parameters and voltage-gain curves, then estimated MOSFET and diode losses and converter efficiency for each load condition.
  • Built a PSIM switching model and verified operating waveforms, ZVS, output ripple, load-dependent efficiency, and weighted efficiency.
  • Compared a MATLAB parameter sweep with PSIM results, traced the discrepancy to harmonic content omitted by the analytical approximation, and selected the final parameters from waveform-based simulation.
  • Verified dead time and adjusted resonant frequency and capacitor values under switching-frequency and commercially available component constraints.

Technologies: PSIM · MATLAB

Mar 2026 – Jun 2026CourseworkECL4007Renewable Distributed GenerationSpring 2026 · Senior year, Semester 1

PV & Wind Power System Modeling

Team Leader

Modeled the power-conversion and control structures of photovoltaic charging and wind generation systems in MATLAB/Simulink.

Details
  • Implemented a PV array, boost converter, and P&O and Incremental Conductance MPPT control.
  • Modeled a wind turbine, PMSM, rectifier, buck converter, and optimal-current control.
  • Analyzed low-wind limitations and tested a buck-boost topology to improve tracking.

Technologies: MATLAB · Simulink

Feb 2026 – Aug 2026Research

Visuo-Tactile Imitation Learning for Autonomous Manipulation and Grasping

Undergraduate Researcher

Generated expert demonstrations and reviewed reward behavior for a KETI Allegro dual-arm cashier manipulation policy, using Apple Vision Pro teleoperation and MuJoCo simulation.

Details
  • Used the VisionProTeleop project with Apple Vision Pro and MuJoCo to support teleoperation-based expert-data generation.
  • Generated expert demonstrations for the KETI Allegro dual-arm cashier task.
  • Reviewed reward behavior during policy experiments to check alignment with the intended manipulation and grasping task.

Technologies: Apple Vision Pro · VisionProTeleop · MuJoCo · Imitation Learning · Allegro Hand

Jan 2026Competition

Manufacturing Defect Analysis AI Agent

Team Leader

Built a multimodal LLM agent that classifies semiconductor device images and explains abnormality decisions.

Details
  • Implemented explainable defect analysis with a vision LLM, providing the basis for each classification decision.
  • Designed prompt-editing controls so users could iteratively improve performance without changing the application code.
  • Combined OpenCV edge detection with a vision LLM to detect fine defects and contextual anomalies.
  • Built a FastAPI/React interface with prompt editing, real-time monitoring, and F1 score visualization.
  • Used AI-assisted development to iterate quickly on the FastAPI/React interface and application features within the hackathon timeframe.

Technologies: LangChain · OpenCV · FastAPI · React · GPT-4o-mini · Python

Jan 2026Research

Efficient Learning for Quadruped Fault Recovery

Individual Project

Developed a DDPG controller with curriculum learning to recover from actuator signal attenuation in quadruped locomotion.

Details
  • Implemented real-time fault-injection scenarios in Simulink.
  • Reduced convergence from 3,900 to 850 episodes, a 4.6× improvement in training efficiency.
  • Submitted the work to the Simulink Student Challenge 2025 under the fault-tolerant control theme.

Technologies: MATLAB · Simulink · Reinforcement Learning Toolbox · Simscape Multibody

Jan 2026 – PresentIn progressPersonal

HOYA LAB: Robot Learning Research Blog

Writer & Operator

Operate a technical blog that connects robot-learning theory with practical research notes and implementation-oriented study.

Details
  • Write structured learning notes on diffusion models and Diffusion Policy, from core concepts to their use in robot learning.
  • Cover World Model research topics alongside reinforcement learning, imitation learning, and robotics papers.
  • Document practical study and research context so theoretical material remains connected to experiments and implementation.

Technologies: Tistory · Robot Learning · Diffusion Policy · World Model

2026Research

World-Model-Conditioned Diffusion Policy for Visuomotor Manipulation

Undergraduate Researcher · COLAB, Hanyang University

Conditioned Diffusion Policy on a latent feature from a lightweight GRU world model and raised real-robot pick-and-place success from 45.0% to 72.5% without additional training data.

Details
  • Designed the world-model-conditioned Diffusion Policy architecture, experiment plan, and implementation while learning from a senior coauthor.
  • Evaluated the policy on real Franka Emika Panda pick-and-place tasks, including a deformable object whose graspable regions change with orientation.
  • Kept added inference latency to approximately 70 ms; presented the paper orally at ICCAS 2026 on Oct 28, 2026.

Technologies: Diffusion Policy · GRU World Model · FiLM Conditioning · Imitation Learning · Franka Emika Panda

2026 – PresentIn progressCoursework

MediGrip: Autonomous Surgical Instrument Delivery Cart

Team Leader

Developing a non-clinical proof-of-concept cart that combines voice commands, visual recognition, and robot manipulation to move dummy surgical instruments from a tray to a designated delivery zone.

Details
  • Designed a three-layer pipeline for wake-word-triggered command recognition, tray-level instrument and inventory recognition, and imitation-learning-based pick-and-place.
  • Defined a closed-vocabulary voice workflow that activates STT only after the “Hey Mary” wake word and extracts an instrument name from the subsequent utterance.
  • Selected placement in a designated delivery zone instead of direct robot-to-human handover to reduce contact paths and keep the manipulation task feasible.
  • Planning the SO-ARM101 cart layout around its effective reach, with an overhead tray camera and a wrist camera for instrument recognition and manipulation.
  • The manipulation-policy architecture remains under evaluation; this project does not claim readiness for real operating rooms, patients, or clinical instruments.

Technologies: SO-ARM101 · LeRobot · Whisper · VAD · Computer Vision · Imitation Learning

Dec 2025 – PresentPersonal

Small Web Tools: EXIF Framer & MEOW PDF Merger

Individual Project

Built and deployed small AI-assisted web tools for everyday photo and document workflows.

Details
  • EXIF Framer displays digital-camera capture metadata, including ISO, aperture, and shutter speed, in a photo frame.
  • MEOW PDF Merger, first developed in December 2025, interleaves documents scanned with a single-sided feeder into a duplex-ordered PDF.

Technologies: TypeScript · Python · Vercel

Nov 2025 – PresentPersonalECL3013Principles of Artificial IntelligenceFall 2025

AI-assisted Productivity Tools & Micro-services

Individual Project

Built and operate Notion2Blogger, applying the AI theory and hands-on AI-assisted development practice from Principles of Artificial Intelligence to a deployed service.

Details
  • Built, deployed, and continue to operate Notion2Blogger with an AI-assisted development workflow; it converts Notion content for Blogger, including formulas and code blocks.

Technologies: Next.js · Python · TypeScript · Vercel · Supabase · Figma

Summer 2025CourseworkGEN5026Techno-BusinessSummer 2025

Prototype Styler: ESP32-Controlled Garment-care Device

Team Leader

Led a five-person team to complete an ESP32-controlled prototype styler in three days, combining mobile control, relay-switched functions, and a 12 V power system.

Details
  • Designed the electrical power path around a 12 V, 30 A SMPS and DC-DC buck converters to supply the prototype subsystems.
  • Built an ESP32-based mobile control page and used relay modules to switch the device functions from the web interface.
  • Integrated prototype functions including PTC heating, ultrasonic humidification, UV lighting, and vibration, with fusing and supporting passive components in the electrical design.
  • Coordinated rapid mechanical enclosure fabrication using acrylic panels, hinges, handles, and assembly materials during the three-day build.

Technologies: ESP32 · HTML/CSS/JavaScript · Relay Module · SMPS · DC-DC Converter

Jun 2025 – Jul 2025Competition

Magnetic Active Crash Avoidance Concept

Team Leader

Proposed and evaluated a magnetic-repulsion vehicle component for active crash avoidance under the EURO NCAP 2030 direction.

Details
  • Authored a Korean technical paper and modeled changes in crash scenarios with MATLAB.

Technologies: MATLAB

May 2025 – Jun 2025CourseworkMAT3008Numerical AnalysisSpring 2025 · Junior year, Semester 1

GPS/IMU-based Velocity & Trajectory Estimation

Team Leader

Compared numerical differentiation, integration, and Kalman-filter sensor fusion methods to estimate vehicle velocity and reconstruct its trajectory from real GPS and IMU measurements.

Details
  • Preprocessed acceleration, yaw-rate, GPS Speed2D, wheel-speed, and position data at 100 Hz; applied a high-pass Butterworth filter and converted between geographic and local ENU coordinates.
  • Implemented and compared ten velocity-estimation approaches: four GPS differentiation methods, five IMU integration methods, and KF-RK4 sensor fusion.
  • Found the 3-point central difference to be the most reliable GPS differentiation method, while the 5-point method was degraded by edge effects and noise sensitivity.
  • Reduced IMU integration drift by fusing RK4 predictions with reference measurements through a Kalman Filter, achieving a velocity RMSE as low as 0.04 and the lowest path RMSE among the tested methods.
  • Reconstructed the vehicle path using estimated velocity and integrated yaw rate, and analyzed late-trajectory divergence caused by accumulated heading drift; selected as an outstanding project team.

Technologies: MATLAB