Publications

ParticleFormer: A 3D Point Cloud World Model for Multi-Object, Multi-Material Robotic Manipulation

Suning Huang, Qianzhong Chen, Xiaohan Zhang, Jiankai Sun, Mac Schwager

CoRL 2025 [Project]

A state-of-the-art 3D world model trained directly from point clouds, which enables accurate dynamics prediction across multi-object, multi-material scenarios and empowers model-based visuomotor control in robotic manipulation tasks.

MENTOR: Mixture-of-Experts Network with Task-Oriented Perturbation for Visual Reinforcement Learning

Suning Huang*, Zheyu Zhang*, Tianhai Liang, Yihan Xu, Zhehao Kou, Chenhao Lu, Guowei Xu, Zhengrong Xue, Huazhe Xu

ICML 2025 [Project]

A leading model-free visual RL algorithm which achieves state-of-the-art performances in learning efficiency and performance on various tasks. We can even directly train it on the real robot!

DittoGym: Learning to Control Soft Shape-Shifting Robots

Suning Huang, Boyuan Chen, Huazhe Xu, Vincent Sitzmann

ICLR 2024 [Project]

A pioneered formulation and modeling of the highly-reconfigurable robot within a MPM-powered simulator, along with effective coarse-to-fine curriculum for high-dimensional policy training and comprehensive benchmark.