Zhecheng Yuan

PhD student, Tsinghua University IIIS

I am a first-year PhD student at Institute for Interdisciplinary Information Sciences (IIIS), Tsinghua University, advised by Prof. Huazhe Xu. Now, I am also a research intern at UCSD, where I am fortunate to advised by Prof. Xiaolong Wang. I received my Master's degrees from the Tsinghua University, Shenzhen Institute Graduate School, Big Data Engineering Track. I acheived the Outstanding Thesis Award of Tsinghua University, and Outstanding Graduate of Beijing.

Feel free to contact me via email yuanzc23@mails.tsinghua.edu.cn.

Research interest

I am broadly interested in research on the generalization, representation learning for RL agents, robotics, and Embodied AI. My dream is to empower AI with the capacity to adapt and generalize in the complex real-world environments.

News

2023.04 Our paper "On Pre-Training for Visuo-Motor Control: Revisiting a Learning-from-Scratch Baseline" is accepted to ICML 2023.

2023.01 Our paper "USEEK: Unsupervised SE(3)-Equivariant 3D Keypoints for Generalizable Manipulation" is accepted to ICRA 2023.

2023.01 Our paper "Extraneousness-Aware Imitation Learning" is accepted to ICRA 2023.

2022.09 Our paper "Pre-Trained Image Encoder for Generalizable Visual Reinforcement Learning" is accepted to NeurIPS 2022.

2022.04 Our paper "Don't Touch What Matters: Task-Aware Lipschitz Data Augmentation for Visual Reinforcement Learning" is accepted to IJCAI 2022.

Selected Publication

Papers sorted by recency. Representative papers are highlighted.

Generalizable Visual Reinforcement Learning with Segment Anything Model
Ziyu Wang*, Yanjie Ze*, Yifei Sun, Zhecheng Yuan, Huazhe Xu
Arxiv
project page / paper / code
DrM: Mastering Visual Reinforcement Learning through Dormant Ratio Minimization
Guowei Xu*, Ruijie Zheng*, Yongyuan Liang*, Xiyao Wang, Zhecheng Yuan, Tianying Ji, Yu Luo, Xiaoyu Liu, Jiaxin Yuan, Pu Hua, Shuzhen Li, Yanjie Ze, Hal Daumé III, Furong Huang, Huazhe Xu
ICLR 2024(Spotlight)
project page / paper / code coming soon
GenSim: Generating Robotic Simulation Tasks via Large Language Models
Lirui Wang Yiyang Ling* Zhecheng Yuan*, Mohit Shridhar, Chen Bao, Yuzhe Qin, Bailin Wang, Huazhe Xu, Xiaolong Wang
ICLR 2024(Spotlight)
project page / paper / code / media
RL-ViGen: A Reinforcement Learning Benchmark for Visual Generalization
Zhecheng Yuan*, Sizhe Yang*, Pu Hua, Can Chang, Kaizhe Hu, Huazhe Xu
Conference on Neural Information Processing Systems D&B Track(NeurIPS), 2023
project page / paper / code
H-InDex: Visual Reinforcement Learning with Hand-Informed Representations for Dexterous Manipulation
Yanjie Ze, Yuyao Liu*, Ruizhe Shi*, Jiaxin Qin, Zhecheng Yuan, Jiashun Wang, Huazhe Xu
Conference on Neural Information Processing Systems(NeurIPS), 2023
project page / paper / code
On Pre-Training for Visuo-Motor Control: Revisiting a Learning-from-Scratch Baseline
Nicklas Hansen*, Zhecheng Yuan*, Yanjie Ze*, Tongzhou Mu*, Aravind Rajeswaran+, Hao Su+, Huazhe Xu+, Xiaolong Wang+
International Conference on Machine Learning (ICML), 2023
paper / code
Pre-Trained Image Encoder for Generalizable Visual Reinforcement Learning
Zhecheng Yuan, Zhengrong Xue, Bo Yuan, Xueqian Wang, Yi Wu, Yang Gao, Huazhe Xu
Conference on Neural Information Processing Systems (NeurIPS), 2022 (Spotlight)
project page / paper / code
Other publications
USEEK: Unsupervised SE(3)-Equivariant 3D Keypoints for Generalizable Manipulation
Zhengrong Xue, Zhecheng Yuan, Jiashun Wang, Xueqian Wang, Huazhe Xu
International Conference on Robotics and Automation (ICRA), 2023
project page / paper / code
Extraneousness-Aware Imitation Learning
Ray C. Zheng*, Kaizhe Hu*, Zhecheng Yuan, , Boyuan Chen, Huazhe Xu
International Conference on Robotics and Automation (ICRA), 2023
project page / paper / code
A Comprehensive Survey of Data Augmentation in Visual Reinforcement Learning
Guozheng Ma, Zhen Wang, Zhecheng Yuan, Xueqian Wang, Bo Yuan*, Dacheng Tao*
Arxiv
project page / paper
Don't Touch What Matters: Task-Aware Lipschitz Data Augmentation for Visual Reinforcement Learning
Zhecheng Yuan, Guozheng Ma, Yao Mu, Bo Xia, Bo Yuan, Xueqian Wang, Ping Luo, Huazhe Xu
International Joint Conference on Artificial Intelligence (IJCAI), 2022
project page / paper / code