Robot Learning Project
Jan 1, 2018
Robot Learning project is focused on training a robot with VR or MR approaches.
Research Scientist of AI
My research interests include wearable computing, machine learning, Cognitive Reasoning, and mixed/virtual reality.
We present a reconfigurable data glove design to capture different modes of human hand-object interactions, which are critical in training embodied artificial intelligence (AI) agents for fine manipulation tasks.
Hangxin Liu, Zeyu Zhang, Ziyuan Jiao, Zhenliang Zhang, Mingchen Li, Chenfanfu Jiang, Yixin Zhu, Song-Chun Zhu
[IROS 2020] Graph-based hierarchical knowledge representation for robot task transfer from virtual to physical world
We study the hierarchical knowledge transfer problem using a cloth-folding task, wherein the agent is first given a set of human demonstrations in the virtual world using an Oculus Headset, and later transferred and validated on a physical Baxter robot.
Zhenliang Zhang, Yixin Zhu, Song-Chun Zhu
We study the knowledge transfer problem by training the task of folding clothes in the virtual world using an Oculus Headset and …
Zhenliang Zhang, Jie Guo, Dongdong Weng, Yue Liu, Yongtian Wang
This paper presents a design that jointly provides hand pose sensing, hand localization, and haptic feedback to facilitate real-time …
Hangxin Liu, Zhenliang Zhang, Xu Xie, Yixin Zhu, Yue Liu, Yongtian Wang, Song-Chun Zhu
We propose VRGym, a virtual reality testbed for realistic human-robot interaction. Different from existing toolkits and virtual reality environments, the VRGym emphasizes on building and training both physical and interactive agents for robotics, machine learning, and cognitive science.
Xu Xie, Hangxin Liu, Zhenliang Zhang, Yuxing Qiu, Feng Gao, Siyuan Qi, Yixin Zhu, Song-Chun Zhu