Huazhe Xu

[Google Scholar] [CV]
Home Publication Group Contact Misc

( * indicates equally leading, + indicates equally advising)

Zhecheng Yuan, Zhengrong Xue, Bo Yuan, Xueqian Wang, Yi Wu, Yang Gao, Huazhe Xu.
Pre-Trained Image Encoder for Generalizable Visual Reinforcement Learning
Conference on Neural Information Processing Systems (NeurIPS), 2022.

[openreview] [code coming soon]

Can Chang, Ni Mu, Jiajun Wu, Ling Pan, Huazhe Xu.
E-MAPP: Efficient Multi-Agent Reinforcement Learning with Parallel Program Guidance
Conference on Neural Information Processing Systems (NeurIPS), 2022.

[openreview] [code coming soon]

Haoyu Xiong, Haoyuan Fu, Jieyi Zhang, Chen Bao, Qiang Zhang, Yongxi Huang, Wenqiang Xu, Animesh Garg, Huazhe Xu, Cewu Lu
RoboTube: Learning Household Manipulation from Human Videos with Simulated Twin Environments
RSS Workshop, 2022.

[openreview] [video] [code coming soon]

Hao Li, Yizhi Zhang, Junzhe Zhu, Shaoxiong Wang, Michelle A Lee, Huazhe Xu, Edward Adelson, Li Fei-Fei, Ruohan Gao, Jiajun Wu.
See, Hear, and Feel: Smart Sensory Fusion for Robotic Manipulation
International Conference on Robots Learning (CORL), 2022.

[openreview] [code coming soon]

Yixing Wang*, Sifan Ye*, Jiaman Li, Dennis Lee, Karen Liu, Huazhe Xu+, Jiajun Wu+.
Scene Synthesis from Human Motion
conditionally accepted to Siggraph Asia, 2022.

[arXiv coming soon] [code coming soon]

Huazhe Xu, Yuping Luo, Shaoxiong Wang, Trevor Darrell, Roberto Calandra.
Towards Learning to Play Piano with Dexterous Hands and Touch
International Conference on Intelligent Robots and Systems (IROS), 2022.

[arXiv] [code coming soon]

Ling Pan, Longbo Huang, Tengyu Ma, Huazhe Xu.
Plan Better amid Conservatism: Offline Multi-agent Reinforcement Learning with Actor Rectification
International Conference on Machine Learning (ICML), 2022.

[arXiv] [project page] [code coming soon]

Yunfei Li, Tian Gao, Jiaqi Yang, Huazhe Xu, Yi Wu.
Phasic Self-Imitative Reduction for Sparse-Reward Goal-Conditioned Reinforcement Learning
International Conference on Machine Learning (ICML), 2022.

[arXiv]

Haochen Shi*, Huazhe Xu*, Zhiao Huang, Yunzhu Li, Jiajun Wu.
RoboCraft: Learning to See, Simulate, and Shape Elasto-Plastic Objects with Graph Networks
Robotics: Science and Systems (RSS), 2022.

[arXiv] [project page] [code] [media MIT Tech Review] [media HAI]

Zhecheng Yuan, Guozheng Ma, Yao Mu, Bo Xia, Bo Yuan, Xueqian Wang, Ping Luo, Huazhe Xu.
Don't Touch What Matters: Task-Aware Lipschitz Data Augmentation for Visual Reinforcement Learning
International Joint Conference on Artificial Intelligence (IJCAI), 2022.

[arXiv] [project page]

Ruihan Yang*, Minghao Zhang*, Nicklas Hansen, Huazhe Xu, Xiaolong Wang.
Learning Vision-Guided Quadrupedal Locomotion End-to-End with Cross-Modal Transformers
International Conference on Learning Representation (ICLR), 2022. (Spotlight)

[arXiv] [project page] [video] [code]

Jiashun Wang, Huazhe Xu, Medhini Narasimhan, Xiaolong Wang.
Multi-Person 3D Motion Prediction with Multi-Range Transformers.
Conference on Neural Information Processing Systems (NeurIPS), 2021.

[arXiv] [project page] [code]

Tianjun Zhang, Huazhe Xu, Xiaolong Wang, Yi Wu, Kurt Keutzer, Joseph E. Gonzalez, Yuandong Tian.
NovelD: A Simple yet Effective Exploration Criterion
Conference on Neural Information Processing Systems (NeurIPS), 2021.

[arXiv] [code] [talk]

Minghao Zhang*, Pingcheng Jian*, Yi Wu, Huazhe Xu, Xiaolong Wang.
Disentangled Attention as Intrinsic Regularization for Bimanual Multi-Object Manipulation
Arxiv Preprints.

[arXiv] [project page] [code coming soon]

Huazhe Xu*, Boyuan Chen*, Yang Gao, Trevor Darrell.
Zero-shot Policy Learning with Spatial Temporal Reward Decomposition on Contingency-aware Observation
International Conference on Robot Automation (ICRA), 2021.

[arXiv] [code] [project page]

Mike Lambeta, Huazhe Xu, Jingwei Xu, Po-Wei Chou, Shaoxiong Wang,Trevor Darrell, and Roberto Calandra
PyTouch: A Machine Learning Library for Touch Processing
International Conference on Robot Automation (ICRA), 2021.

[arXiv] [code]

Jiashun Wang, Huazhe Xu, Jingwei Xu, Sifei Liu, Xiaolong Wang.
Synthesizing Long-Term 3D Human Motion and Interaction in 3D Scenes.
Conference on Computer Vision and Pattern Recognition (CVPR), 2021.

[arXiv] [project page]

Yunfei Li, Huazhe Xu, Yilin Wu, Xiaolong Wang, Yi Wu.
Solving Compositional Reinforcement Learning Problems via Task Reduction.
International Conference on Learning Representations (ICLR), 2021.

[openreview] [arxiv] [code] [project page]

Zhenggang Tang, Chao Yu, Boyuan Chen, Huazhe Xu, Xiaolong Wang, Fei Fang, Simon Shaolei Du, Yu Wang, Yi Wu.
Discovering Diverse Multi-Agent Strategic Behavior via Reward Randomization.
International Conference on Learning Representations (ICLR), 2021.

[openreview] [project page]

Tianjun Zhang, Huazhe Xu, Xiaolong Wang, Yi Wu, Kurt Keutzer, Joseph E. Gonzalez, Yuandong Tian.
Multi-Agent Collaboration via Reward Attribution Decomposition
Arxiv preprints, 2020.

[arXiv] [code]

Ruihan Yang, Huazhe Xu, Yi Wu, Xiaolong Wang.
Multi-Task Reinforcement Learning with Soft Modularization.
Conference on Neural Information Processing Systems (NeurIPS), 2020.

[pdf] [code] [project page] [Talk]

Jingwei Xu*, Huazhe Xu*, Bingbing Ni, Xiaokang Yang, Xiaolong Wang, Trevor Darrell.
Hierarchical Style-based Networks for Motion Synthesis.
European Conference on Computer Vision (ECCV), 2020.

[arXiv] [project page] [BibTeX]

Jingwei Xu*, Huazhe Xu*, Bingbing Ni, Xiaokang Yang, Trevor Darrell.
Video Prediction via Demonstration Guidance
International Conference on Machine Learning (ICML), 2020. (oral)

[arXiv] [project page] [code]

Yuping Luo, Huazhe Xu, Tengyu Ma.
Learning Self-Correctable Policies and Value Functions from Demonstrations with Negative Sampling,
International Conference on Learning Representation (ICLR), 2020.

[arXiv]

Jierui Lin*, Yifei Xing*, Huazhe Xu, Yang Gao.
Learning a Perception-Logic Network for Unsupervised Scene Conditioned Driving Behavior,
Robotics: Science and Systems IDA workshop (RSS workshop), 2020.

[manuscript] [code coming soon] [talk] [demo]

Yuping Luo*, Huazhe Xu*, Yuanzhi Li, Yuandong Tian, Tengyu Ma.
Algorithmic Framework for Model-based Reinforcement Learning with Theoretical Guarantees,
International Conference on Learning Representation (ICLR), 2019.

[arXiv] [code]

Hang Gao*, Huazhe Xu*, Qi-zhi Cai, Ruth Wang, Fisher Yu, Trevor Darrell.
Disentangling Propagationand Generation for Video Prediction,
International Conference on Computer Vision (ICCV), 2019.

[arXiv] [code coming soon]

Yang Gao*,Huazhe Xu*, Fisher Yu, Sergey Levine, Trevor Darrell.
Reinforcement Learning from Imperfect Demonstrations,
Neurips 2018 Deep RL Symposium (Neurips Symposium), 2018.

[arXiv]

Haoran Tang*, Dennis Lee*, Jeffrey O Zhang, Huazhe Xu, Trevor Darrell, Pieter Abbeel.
Modular Architecture for StarCraft II with Deep Reinforcement Learning,
he 14th AAAI Conference on Artificial Intelligenceand Interactive Digital Entertainmen (AIIDE), 2018.

[arXiv]

Huazhe Xu*, Yang Gao*, Fisher Yu, Trevor Darrell.
End-to-end Learning of Driving Models from Large-scale Video Datasets,
Conference on Computer Vision and Pattern Recognition (CVPR), 2017. (oral)

[arXiv] [code]

Ronghang Hu, Huazhe Xu, Marcus Rohrbach, Jiashi Feng, Kate Saeko, Trevor Darrell.
atural Language Object Retrieval,
Conference on Computer Vision and Pattern Recognition (CVPR), 2016. (oral)

[arXiv] [code]