( * indicates equally leading, + indicates equally advising)
Changyi Lin, Han Zhang, Jikai Xu, Lei Wu, Huazhe Xu
9DTact: A Compact Vision-Based Tactile Sensor for Accurate 3D Shape Reconstruction and Generalizable 6D Force Estimation
IEEE Robotics and Automation Letters (RA-L) with a presentation at ICRA'24.
Haochen Shi*, Huazhe Xu*, Zhiao Huang, Yunzhu Li, Jiajun Wu.
RoboCraft: Learning to See, Simulate, and Shape Elasto-Plastic Objects in 3D with Graph Networks
International Journal of Robotics Research (IJRR).
Kun Lei, Zhengmao He*, Chenhao Lu*, Kaizhe Hu, Yang Gao, Huazhe Xu
Uni-O4: Unifying Online and Offline Deep Reinforcement Learning with Multi-Step Policy Optimization
arXiv preprint.
Guowei Xu*, Ruijie Zheng*, Yongyuan Liang*, Xiyao Wang, Zhecheng Yuan, Tianying Ji, Yu Luo, Xiaoyu Liu, Jiaxin Yuan, Pu Hua, Shuzhen Li, Yanjie Ze, Hal Daumé III, Furong Huang, Huazhe Xu
DrM: Mastering Visual Reinforcement Learning through Dormant Ratio Minimization
arXiv preprint.
Ruizhe Shi*, Yuyao Liu*, Yanjie Ze, Simon S. Du, Huazhe Xu
Unleashing the Power of Pre-trained Language Models for Offline Reinforcement Learning
arXiv preprint.
Dehao Wei, Huazhe Xu
A Wearable Robotic Hand for Hand-over-Hand Imitation Learning
arXiv preprint.
Lirui Wang, Yiyang Ling*, Zhecheng Yuan*, Mohit Shridhar, Chen Bao, Yuzhe Qin, Bailin Wang, Huazhe Xu, Xiaolong Wang
GenSim: Generating Robotic Simulation Tasks via Large Language Models
arXiv preprint.
Abridged version in LangRob Workshop@CoRL'23 (outstanding paper award).
Xiyao Wang, Ruijie Zheng, Yanchao Sun, Ruonan Jia, Wichayaporn Wongkamjan, Huazhe Xu, Furong Huang
COPlanner: Plan to Roll Out Conservatively but to Explore Optimistically for Model-Based RL
arXiv preprint.
Zhecheng Yuan*, Sizhe Yang*, Pu Hua, Can Chang, Kaizhe Hu, Huazhe Xu
RL-ViGen: A Reinforcement Learning Benchmark for Visual Generalization
Conference on Neural Information Processing Systems Datasets & Benchmarks Track (NeurIPS), 2023.
Ruijie Zheng, Xiyao Wang, Yanchao Sun, Shuang Ma, Jieyu Zhao, Huazhe Xu+, Hal Daumé III+, Furong Huang+
TACO: Temporal Latent Action-Driven Contrastive Loss for Visual Reinforcement Learning
Conference on Neural Information Processing Systems (NeurIPS), 2023.
Jialu Gao*, Kaizhe Hu*, Guowei Xu, Huazhe Xu
Can Pre-Trained Text-to-Image Models Generate
Visual Goals for Reinforcement Learning?
Conference on Neural Information Processing Systems (NeurIPS), 2023.
Sizhe Yang*, Yanjie Ze*, Huazhe Xu
MoVie: Visual Model-Based Policy Adaptation
for View Generalization
Conference on Neural Information Processing Systems (NeurIPS), 2023.
Yanjie Ze, Yuyao Liu*, Ruizhe Shi*, Jiaxin Qin, Zhecheng Yuan, Jiashun Wang, Huazhe Xu
H-InDex: Visual Reinforcement Learning with Hand-Informed Representations for Dexterous Manipulation
Conference on Neural Information Processing Systems (NeurIPS), 2023.
Haochen Shi*, Huazhe Xu*, Samuel Clarke, Yunzhu Li, Jiajun Wu
RoboCook: Long-Horizon Elasto-Plastic Object Manipulation with Diverse Tools
Conference on Robot Learning (CoRL), 2023. (best system paper award, oral)
Zhengrong Xue*, Han Zhang*, Jingwen Cheng, Zhengmao He, Yuanchen Ju, Changyi Lin, Gu Zhang, Huazhe Xu
ArrayBot: Reinforcement Learning for Generalizable Distributed Manipulation through Touch
arXiv preprint, 2023.
Tianying Ji, Yu Luo, Fuchun Sun, Xianyuan Zhan, Jianwei Zhang, Huazhe Xu.
Seizing Serendipity: Exploiting the Value of Past Success in Off-Policy Actor-Critic
arXiv preprint, 2023.
Zhengrong Xue, Zhecheng Yuan, Jiashun Wang, Xueqian Wang, Yang Gao, Huazhe Xu.
USEEK: Unsupervised SE(3)-Equivariant 3D Keypoints for Generalizable Manipulation
International Conference on Robot Automation (ICRA), 2023.
Changyi Lin, Ziqi Lin, Shaoxiong Wang, Huazhe Xu.
DTact: A Vision-Based Tactile Sensor that Measures High-Resolution 3D Geometry Directly from Darkness
International Conference on Robot Automation (ICRA), 2023.
Ray Chen Zheng*, Kaizhe Hu*, Zhecheng Yuan, Boyuan Chen, Huazhe Xu.
Extraneousness-Aware Imitation Learning
International Conference on Robot Automation (ICRA), 2023.
Yunfei Li*, Chaoyi Pan*, Huazhe Xu, Xiaolong Wang, Yi Wu.
Efficient Bimanual Handover and Rearrangement via Symmetry-Aware Actor-Critic Learning
International Conference on Robot Automation (ICRA), 2023.
Pu Hua, Yubei Chen+, Huazhe Xu+.
Simple Emergent Action Representations
from Multi-Task Policy Training
International Conference on Learning Representation (ICLR), 2023.
Ruijie Zheng*, Xiyao Wang*, Huazhe Xu, Furong Huang.
Is Model Ensemble Necessary? Model-based RL via a Single Model with Lipschitz Regularized Value Function
International Conference on Learning Representation (ICLR), 2023.
Abridged in NeurIPS 2022 DRL workshop (spotlight).
[arXiv] [project page] [code coming soon]
Zhecheng Yuan, Zhengrong Xue, Bo Yuan, Xueqian Wang, Yi Wu, Yang Gao, Huazhe Xu.
Pre-Trained Image Encoder for Generalizable Visual Reinforcement Learning
Conference on Neural Information Processing Systems (NeurIPS), 2022. (spotlight)
Can Chang, Ni Mu, Jiajun Wu, Ling Pan, Huazhe Xu.
E-MAPP: Efficient Multi-Agent Reinforcement Learning with Parallel Program Guidance
Conference on Neural Information Processing Systems (NeurIPS), 2022. (spotlight)
Haoyu Xiong, Haoyuan Fu, Jieyi Zhang, Chen Bao, Qiang Zhang, Yongxi Huang, Wenqiang Xu, Animesh Garg, Huazhe Xu, Cewu Lu
RoboTube: Learning Household Manipulation from Human Videos with Simulated Twin Environments
RSS Workshop, 2022.
Hao Li, Yizhi Zhang, Junzhe Zhu, Shaoxiong Wang, Michelle A Lee, Huazhe Xu, Edward Adelson, Li Fei-Fei, Ruohan Gao, Jiajun Wu.
See, Hear, and Feel: Smart Sensory Fusion for Robotic Manipulation
International Conference on Robots Learning (CORL), 2022.
Yixing Wang*, Sifan Ye*, Jiaman Li, Dennis Lee, Karen Liu, Huazhe Xu+, Jiajun Wu+.
Scene Synthesis from Human Motion
Siggraph Asia, 2022.
Huazhe Xu, Yuping Luo, Shaoxiong Wang, Trevor Darrell, Roberto Calandra.
Towards Learning to Play Piano with Dexterous Hands and Touch
International Conference on Intelligent Robots and Systems (IROS), 2022.
Ling Pan, Longbo Huang, Tengyu Ma, Huazhe Xu.
Plan Better amid Conservatism: Offline Multi-agent Reinforcement Learning with Actor Rectification
International Conference on Machine Learning (ICML), 2022.
Yunfei Li, Tian Gao, Jiaqi Yang, Huazhe Xu, Yi Wu.
Phasic Self-Imitative Reduction for Sparse-Reward Goal-Conditioned Reinforcement Learning
International Conference on Machine Learning (ICML), 2022.
Haochen Shi*, Huazhe Xu*, Zhiao Huang, Yunzhu Li, Jiajun Wu.
RoboCraft: Learning to See, Simulate, and Shape Elasto-Plastic Objects with Graph Networks
Robotics: Science and Systems (RSS), 2022.
Zhecheng Yuan, Guozheng Ma, Yao Mu, Bo Xia, Bo Yuan, Xueqian Wang, Ping Luo, Huazhe Xu.
Don't Touch What Matters: Task-Aware Lipschitz Data Augmentation for Visual Reinforcement Learning
International Joint Conference on Artificial Intelligence (IJCAI), 2022.
Ruihan Yang*, Minghao Zhang*, Nicklas Hansen, Huazhe Xu, Xiaolong Wang.
Learning Vision-Guided Quadrupedal Locomotion End-to-End with Cross-Modal Transformers
International Conference on Learning Representation (ICLR), 2022. (spotlight)
Jiashun Wang, Huazhe Xu, Medhini Narasimhan, Xiaolong Wang.
Multi-Person 3D Motion Prediction with Multi-Range Transformers.
Conference on Neural Information Processing Systems (NeurIPS), 2021.
Minghao Zhang*, Pingcheng Jian*, Yi Wu, Huazhe Xu, Xiaolong Wang.
Disentangled Attention as Intrinsic Regularization for Bimanual Multi-Object Manipulation
Arxiv Preprints.
Huazhe Xu*, Boyuan Chen*, Yang Gao, Trevor Darrell.
Zero-shot Policy Learning with Spatial Temporal Reward Decomposition on Contingency-aware Observation
International Conference on Robot Automation (ICRA), 2021.
Jiashun Wang, Huazhe Xu, Jingwei Xu, Sifei Liu, Xiaolong Wang.
Synthesizing Long-Term 3D Human Motion and Interaction in 3D Scenes.
Conference on Computer Vision and Pattern Recognition (CVPR), 2021.
Yunfei Li, Huazhe Xu, Yilin Wu, Xiaolong Wang, Yi Wu.
Solving Compositional Reinforcement Learning Problems via Task Reduction.
International Conference on Learning Representations (ICLR), 2021.
Zhenggang Tang, Chao Yu, Boyuan Chen, Huazhe Xu, Xiaolong Wang, Fei Fang, Simon Shaolei Du, Yu Wang, Yi Wu.
Discovering Diverse Multi-Agent Strategic Behavior via Reward Randomization.
International Conference on Learning Representations (ICLR), 2021.
Ruihan Yang, Huazhe Xu, Yi Wu, Xiaolong Wang.
Multi-Task Reinforcement Learning with Soft Modularization.
Conference on Neural Information Processing Systems (NeurIPS), 2020.
Jingwei Xu*, Huazhe Xu*, Bingbing Ni, Xiaokang Yang, Xiaolong Wang, Trevor Darrell.
Hierarchical Style-based Networks for Motion Synthesis.
European Conference on Computer Vision (ECCV), 2020.
Jingwei Xu*, Huazhe Xu*, Bingbing Ni, Xiaokang Yang, Trevor Darrell.
Video Prediction via Demonstration Guidance
International Conference on Machine Learning (ICML), 2020. (oral)
Yuping Luo, Huazhe Xu, Tengyu Ma.
Learning Self-Correctable Policies and Value Functions from Demonstrations with Negative Sampling,
International Conference on Learning Representation (ICLR), 2020.
Jierui Lin*, Yifei Xing*, Huazhe Xu, Yang Gao.
Learning a Perception-Logic Network for Unsupervised Scene Conditioned Driving Behavior,
Robotics: Science and Systems IDA workshop (RSS workshop), 2020.
Hang Gao*, Huazhe Xu*, Qi-zhi Cai, Ruth Wang, Fisher Yu, Trevor Darrell.
Disentangling Propagationand Generation for Video Prediction,
International Conference on Computer Vision (ICCV), 2019.
Yang Gao*,Huazhe Xu*, Fisher Yu, Sergey Levine, Trevor Darrell.
Reinforcement Learning from Imperfect Demonstrations,
Neurips 2018 Deep RL Symposium (Neurips Symposium), 2018.
Haoran Tang*, Dennis Lee*, Jeffrey O Zhang, Huazhe Xu, Trevor Darrell, Pieter Abbeel.
Modular Architecture for StarCraft II with Deep Reinforcement Learning,
he 14th AAAI Conference on Artificial Intelligenceand Interactive Digital Entertainmen (AIIDE), 2018.
