Robot Learning Project

Jan 1, 2018
Follow

Robot Learning project is focused on training a robot with VR or MR approaches.

Robot Machine Learning
Zhenliang Zhang
Zhenliang Zhang
Research Scientist of AI

My research interests include wearable computing, machine learning, Cognitive Reasoning, and mixed/virtual reality.

Publications

[Engineering 2023] A reconfigurable data glove for reconstructing physical and virtual grasps
We present a reconfigurable data glove design to capture different modes of human hand-object interactions, which are critical in training embodied artificial intelligence (AI) agents for fine manipulation tasks.
Hangxin Liu, Zeyu Zhang, Ziyuan Jiao, Zhenliang Zhang, Mingchen Li, Chenfanfu Jiang, Yixin Zhu, Song-Chun Zhu
Cite Project
[Engineering 2023] A reconfigurable data glove for reconstructing physical and virtual grasps
[IROS 2020] Graph-based hierarchical knowledge representation for robot task transfer from virtual to physical world
We study the hierarchical knowledge transfer problem using a cloth-folding task, wherein the agent is first given a set of human demonstrations in the virtual world using an Oculus Headset, and later transferred and validated on a physical Baxter robot.
Zhenliang Zhang, Yixin Zhu, Song-Chun Zhu
Cite Project
[IROS 2020] Graph-based hierarchical knowledge representation for robot task transfer from virtual to physical world
[VR 2020] Extracting and transferring hierarchical knowledge to robots using virtual reality
We study the knowledge transfer problem by training the task of folding clothes in the virtual world using an Oculus Headset and …
Zhenliang Zhang, Jie Guo, Dongdong Weng, Yue Liu, Yongtian Wang
Cite Project
[VR 2020] Extracting and transferring hierarchical knowledge to robots using virtual reality
[ICRA 2019] High-fidelity grasping in virtual reality using a glove-based system
This paper presents a design that jointly provides hand pose sensing, hand localization, and haptic feedback to facilitate real-time …
Hangxin Liu, Zhenliang Zhang, Xu Xie, Yixin Zhu, Yue Liu, Yongtian Wang, Song-Chun Zhu
Cite Code Project
[ICRA 2019] High-fidelity grasping in virtual reality using a glove-based system
[TURC 2019] VRGym: A virtual testbed for physical and interactive AI
We propose VRGym, a virtual reality testbed for realistic human-robot interaction. Different from existing toolkits and virtual reality environments, the VRGym emphasizes on building and training both physical and interactive agents for robotics, machine learning, and cognitive science.
Xu Xie, Hangxin Liu, Zhenliang Zhang, Yuxing Qiu, Feng Gao, Siyuan Qi, Yixin Zhu, Song-Chun Zhu
Cite Project
[TURC 2019] VRGym: A virtual testbed for physical and interactive AI