Portrait of Zhengdong Hong

Zhengdong Hong洪郑栋

/ I work on full-stack robotics — from hardware to policy.

Final-year Ph.D. student, State Key Lab of CAD&CG, Zhejiang University (expected 2026)
Research Scientist Intern, Amazon Frontier AI & Robotics · San Francisco

I am a final-year Ph.D. student in Computer Science at the State Key Laboratory of CAD&CG, Zhejiang University, advised by Prof. Guofeng Zhang. I am currently a Research Scientist Intern at Amazon Frontier AI & Robotics in San Francisco. In 2023–2024, I worked in Prof. Hao Su's lab at UC San Diego.

My research sits at the intersection of robot manipulation learning and 3D computer vision. Drawing on my early years in 3D vision, I strengthen a robot's ability to perceive, understand, and interact with the 3D world — through geometry, object-centric motion priors, and particle-based world models learned from humans. I was fortunate to work closely with Yuzhe Qin and Jiayuan Gu on reinforcement learning and sim-to-real for dexterous manipulation.

I work full-stack, in the spirit of hardware–algorithm co-design: starting from what a robot task fundamentally demands, I think about how to define — and correctly use — better data for improving robot policies. I have a B.Sc. in Electrical Engineering (rank 1/48) and won the national championship of the Texas Instruments (TI) Cup electronic design competition (1/1847), with solid skills in analog circuits, power electronics, motors, and embedded systems. I have built complete robot systems end-to-end — mechanics, power, PCBs, firmware, drivers, calibration, teleoperation, and data-collection pipelines — so a brand-new robot can be learning-ready in days, and I can debug systematically using full-stack details.

Robotics is where everything I love — algorithms, motors, and mechanisms — has to work together.

01Experience & Education

Research Scientist Intern May 2026 – present
Amazon Frontier AI & Robotics · San Francisco, CA — advisors: Guanya Shi, Haozhi Qi & Rocky Duan
Built and deployed an end-to-end autonomous mobile-manipulation stack on the Dexmate Vega Pro wheeled humanoid — mapping, object-goal navigation, whole-body control, autonomous grasping — fully onboard.
Research Scholar Aug 2023 – Dec 2024
Su Lab, UC San Diego — advisor: Prof. Hao Su
Led the particle-based world model project; built 3 complete robot systems; lab hardware lead from Nov 2023.
Ph.D., Computer Science Sep 2021 – 2026 (exp.)
State Key Lab of CAD&CG, Zhejiang University — advisor: Prof. Guofeng Zhang
3D vision (dynamic scene reconstruction) → 3D-prior-guided robot manipulation learning.
B.Sc., Electrical & Electronics Engineering Sep 2017 – Jun 2021
Zhejiang University — rank 1/48
EE Excellence Program: six days a week in the hardware design & debugging laboratory — open 24 hours — building embedded systems from scratch.

Awards

  • TI Cup (highest award) — Championship, 8th Texas Instruments (TI) National Undergraduate Electronic Design Competition · rank 1/18472020
  • First Prize — 26th Zhejiang University "TP-LINK Cup" Undergraduate Electronic Design Competition2020

02News

  • 2026.05Joined Amazon Frontier AI & Robotics in San Francisco as a Research Scientist Intern.
  • 2026.04R3D and LAMP released on arXiv.
  • 2026.01Presented Object-Centric Motion Priors as an Oral at AAAI 2026.
  • 2025.10AdaDexGrasp presented as an Oral at IROS 2025, Hangzhou.
  • 2025.06Particle-based world model paper: Oral at the RSS 2025 Dexterous Manipulation workshop.
  • 2024.10EasyHeC++ presented as an Oral at IROS 2024.
  • 2024.07Paper on free-viewpoint video of outdoor sports accepted to ECCV 2024.

03Publications

* equal contribution

R3D pipeline: point-cloud ViT encoder with segmentation pretraining feeding a diffusion transformer that outputs joint and end-effector action sequences

R3D: Revisiting 3D Policy Learning

Zhengdong Hong*, Shenrui Wu*, Haozhe Cui*, Boyi Zhao, Ran Ji, Yiyang He, Hangxing Zhang, Zundong Ke, Jun Wang, Guofeng Zhang, Jiayuan Gu

arXiv 2026
TL;DR

Why does 3D policy learning fail to scale? We trace it to two root causes — BatchNorm and missing 3D data augmentation — and fix both with a scalable transformer 3D encoder plus a diffusion-transformer action decoder, outperforming SOTA across manipulation benchmarks.

LAMP teaser: long-horizon manipulation, assembly and articulated manipulation, monocular RGB-D execution, and promptable manipulation

LAMP: Lift Image-Editing as General 3D Priors for Open-world Manipulation

Jingjing Wang, Zhengdong Hong, Chong Bao, Yuke Zhu, Junhan Sun, Guofeng Zhang

arXiv 2026
TL;DR

Image-editing models carry implicit spatial knowledge. LAMP lifts these 2D editing cues into 3D inter-object transformations, yielding general 3D priors that enable fine-grained, open-world robotic manipulation.

Real-robot dexterous manipulation results: grasping, articulated objects, obstacle avoidance, and cross-embodiment across two robot hands

Learning Object-Centric Motion Priors from Human for Robotic Dexterous Manipulation

Zhengdong Hong, Guofeng Zhang

AAAI 2026Oral
TL;DR

Learns object-centric motion priors from human hand-object interaction data by predicting future hand-object states; the priors serve as reward signals for RL — removing manual task-specific reward engineering and transferring across different robot hands, in sim and real.

Two dexterous platforms — xArm7 with Ability Hand and with XHand — and time-lapse manipulation rollouts

Learning Particle-based World Model from Human for Dexterous Manipulation

Zhengdong Hong*, Yulin Liu*, Haowen Hou, Bo Ai, Jun Wang, Tongzhou Mu, Yuzhe Qin, Jiayuan Gu, Hao Su

RSS 2025 · Dexterous Manipulation WSOral
TL;DR

First to learn a particle-based 3D world model from human hand-object interaction; MPC generates high-level trajectories that guide RL in simulation for sample-efficient, sim-to-real-transferable dexterous manipulation.

AdaDexGrasp Figure 3: pre-grasp and final grasp states under different rewards, plus fingertip distance and object height curves over episode steps

Learning Adaptive Dexterous Grasping from Single Demonstrations

Liangzhi Shi, Yulin Liu, Lingqi Zeng, Bo Ai, Zhengdong Hong, Hao Su

IROS 2025Oral
TL;DR

AdaDexGrasp learns a library of dexterous grasping skills from a single human demonstration each — trajectory-following RL rewards plus a pose curriculum — and a VLM selects the right skill from user instructions at deployment.

EasyHeC++ pipeline: sampling and feature-matching pose initialization, then differentiable-rendering pose optimization with AutoSAM, maintaining an image-pose database across calibrations

EasyHeC++: Fully Automatic Hand-Eye Calibration with Pretrained Image Models

Zhengdong Hong*, Kangfu Zheng*, Linghao Chen

IROS 2024Oral
TL;DR

Marker-free, training-free, fully automatic hand-eye calibration for any robot arm: pretrained-image-model feature matching initializes the camera pose, and differentiable rendering refines it.

A flying camera spiraling around a sprinting athlete on a track, with camera frusta marking captured viewpoints

Free-Viewpoint Video of Outdoor Sports Using a Flying Camera

Zhengdong Hong — sole author

ECCV 2024
TL;DR

A drone with a single RGB camera reconstructs the 4D dynamic athlete together with the unbounded 360° scene, enabling free-viewpoint replay of real outdoor sports — plus the new AerialRecon dataset. Conceived, built, and written solo.

04Robot Systems

I don't just use robots — I build infrastructure and deploy them. Most recently at Amazon FAR I took a wheeled humanoid from bring-up to an end-to-end autonomous system; before that, at Su Lab (UCSD), I designed and assembled the lab's manipulation platforms from bare aluminum up: mechanics, power, electronics, firmware, drivers, calibration, teleoperation, and the data-collection stack. Photos on the left rail ◀

2026 · amazon frontier ai & robotics

Autonomous Mobile Manipulation on Vega, a Wheeled Humanoid

At Amazon FAR I built and deployed a complete open-world agentic mobile-manipulation stack on the Dexmate Vega Pro: LiDAR–camera fused mapping with open-vocabulary object-goal navigation, whole-body IK and compliance control, and autonomous grasping — every motion verified collision-free in simulation before it touches the robot, and the full pipeline running onboard. From bare-metal bring-up (grippers, wrist camera, power & comms) to the end-to-end system.

Dexmate Vega Pro wheeled humanoid leaning over a small white table with its wrist camera and gripper extended, a second Vega and camera rig in the background
Mobile Manipulator
Su Lab's first mobile manipulator: xArm + Ability Hand on a mobile base with fully onboard power — no external lines, engineered within a strict battery budget.
  • base · arm · dexterous hand
  • onboard 24 V power system
⏱ built in 3 days
Dual-Arm Dexterous Cell
2× xArm7 + 2× Ability Hands for articulated-object manipulation; multi-camera array, calibrated end-to-end (EasyHeC++ grew out of this).
  • aluminum cell + camera array
  • teleop + data collection ready
⏱ frame up in 2 days
Dual-Gripper Cell
Twin xArm7 with parallel grippers over a calibrated workspace — the lab's workhorse for bimanual data collection and policy evaluation.
  • bimanual manipulation
  • multi-view cameras, ArUco-boarded
⏱ frame up in 2 days
  • Robot infrastructure, per model. For every robot I work with, I write the full stack it needs for learning research: drivers, calibration, teleoperation, data collection, and deployment.
  • Lab hardware lead (Su Lab, since Nov 2023). Fixed two broken xArm control boxes and a broken xArm7; corrected a factory misalignment with a steel ruler and patience; ran hardware training and the rental/maintenance workflow.
  • Power & signal debugging. Worked out the Ability Hand power budget (7.4 V/14 A hand vs. a shared 24 V/16.5 A supply — clenching while lifting browns out), and traced its RS-485 dropouts to interference from the external supply. Fixed in the analog domain.
  • Wrote the manuals. Authored the lab's Electronic Fabrication User Guidance & debugging field notes used to onboard new members.

fleet — hardware I've built infrastructure for

Dexmate Vega Pro xArm7 Ability Hand XHand parallel grippers custom mobile bases RealSense Jetson C2000 DSP STM32 / MSP430 FPGA (MAX10)

Full build log with photos: robot systems deck ↗

05Hardware

Before robots, there was electrical design. Four years of the EE Excellence Program — six days a week in the hardware lab — left me with an analog-deep understanding of circuits, power, and motors that I now aim at sim-to-real. Photos on the right rail ▶

highest award · national championship

TI Cup — 8th Texas Instruments National Undergraduate Electronic Design Competition

We designed, built, and validated an Amplifier Nonlinear Harmonic Distortion Analysis System in 4 days and 3 nights — and took the TI Cup, the competition's single highest award. I led the team through the full design and evaluation.

1 / 1847 national rank · Nov 2020 4 days · 3 nights idea → working instrument
2020
Dual-Loop 12 V/5 A DC-DC Buck Converter

8×5 cm custom PCB, DSP-controlled (C2000). Schematic → layout → bring-up → scope validation, all mine.

powerPCBDSP
2020
Multifunctional CNC DC Power Supply

PSpice-simulated analog control, hand-soldered build. First Prize, 26th ZJU "TP-LINK Cup" EDC.

analogPSpice
2020
Harmonic Distortion Analyzer

The TI Cup build: precision analog front end + DSP analysis for amplifier nonlinearity measurement.

analogmeasurement
2019
Conveyor-Belt Inspection + 4-DoF Manipulator

Visual defect inspection (RPi + OV5647), IR temperature and ToF thickness sensing, STM32 control, PWM belt drive, electromagnetic pick-and-place.

embeddedvision
2020
GPU-Accelerated VIO Front End

FAST + LK optical flow on CUDA, running on a Jetson TX2 for drone visual-inertial odometry.

CUDASLAMJetson
2020–21
600 V/1 MHz Vertical GaN Device Study

Dynamic on-resistance measurement of vertical GaN power devices, with Prof. Shu Yang — trapped-charge and p-GaN hole-injection mechanisms.

power devicesGaN
2019
FPGA Multifunctional Digital Clock

Digital system design from scratch on an Intel MAX10 (MAX10M08SCM153C8G).

FPGAdigital
2020
PV Grid-Tied Inverter, Anti-Harmonic Loop

DC-AC switching design and closed-loop anti-harmonic control, designed and simulated in MATLAB/Simulink (THD 3.34%).

power electronicscontrol
99% of hardware debugging is problem positioning. Hardware bugs are not as visible as software's — signal is the clue. This is not metaphysics: every "sometimes it works" has a reason. — from my hardware debugging field notes

Deep dives: hardware project deck ↗ · debugging field notes & fabrication guide ↗

06Contact

The fastest way to reach me is email: hzddltql@gmail.com

WeChat QR code wechat

Robots are my passion — and always have been. Since childhood I have been drawn to machines that move in the physical world, and to building things with my own hands. That instinct took me first through electrical engineering, where I built a solid hardware foundation; studying 3D vision then brought me into AI; and in 2022 the two threads met at their natural junction — embodied AI — which I have been working on ever since.

handcrafted with vanilla HTML/CSS/JS, no frameworks.
/uptime → building things with signals since 2017 · source