Biography

Dr. Zhang is a full-time research scientist at Beijing Institute for General Artificial Intelligence (BIGAI). He received his Ph.D. degree (‘19) from Beijing Institute of Technology advised by Prof. Yongtian Wang and Prof. Yue Liu. His research work was mainly about the information fusion of physical and virtual worlds, as well as the application of VR/AR/MR for robot learning. During his doctorate study, he worked as a visiting Ph.D. student advised by Prof. Song-Chun Zhu at the Center for Vision, Cognition, Learning, and Autonomy (VCLA) of UCLA from 2017 to 2019, engaging in research related to autonomous robots. His research interest is currently focused on cognitive reasoning, multi-agent reinforcement learning, and mixed reality for artificial intelligence.

Interests

  • Cognitive Reasoning
  • Reinforcement Learning
  • Machine Learning
  • Mixed/Virtual Reality

Education

  • PhD in Optical Engineering, 2019

    Beijing Institute of Technology

  • BS in Electronic Science&Technology, 2013

    Beijing Institute of Technology

Popular Topics

Concept Head-Mounted Display Human-Computer Interaction Long-Term Immersion Machine Learning Mixed Reality Remote Collaboration Robot Symmetrical Reality Text Entry Virtual Reality

Featured Publications

Zhenliang Zhang, Yixin Zhu, Song-Chun Zhu
October 2020 In IROS
[IROS 2020] Graph-based hierarchical knowledge representation for robot task transfer from virtual to physical world

[IROS 2020] Graph-based hierarchical knowledge representation for robot task transfer from virtual to physical world

We study the hierarchical knowledge transfer problem using a cloth-folding task, wherein the agent is first given a set of human demonstrations in the virtual world using an Oculus Headset, and later transferred and validated on a physical Baxter robot.
Project

Recent Publications

Discover relevant content by filtering publications.

[VR 2021] Symmetrical cognition between physical humans and virtual agents

In this paper, we discuss the cognition problem from some perspectives, i.e., attention, perception, pattern recognition, and communication.
Project
[VR 2021] Symmetrical cognition between physical humans and virtual agents

[ISMAR 2020] Machine intelligence matters: Rethink human-robot collaboration based on symmetrical reality

We introduce the contents of the symmetrical reality-based human-robot collaboration and interpret the humanrobot collaboration from the perspective of equivalent interaction.
Zhenliang Zhang, Xuejiao Wang
Project
[ISMAR 2020] Machine intelligence matters: Rethink human-robot collaboration based on symmetrical reality

[ISMAR 2020] Understanding physical common sense in symmetrical reality

We emphasize the bi-directional mechanical control within the symmetrical reality framework and why free wills of machines can break the common sense.
Project
[ISMAR 2020] Understanding physical common sense in symmetrical reality

[IROS 2020] Graph-based hierarchical knowledge representation for robot task transfer from virtual to physical world

We study the hierarchical knowledge transfer problem using a cloth-folding task, wherein the agent is first given a set of human demonstrations in the virtual world using an Oculus Headset, and later transferred and validated on a physical Baxter robot.
Zhenliang Zhang, Yixin Zhu, Song-Chun Zhu
Project
[IROS 2020] Graph-based hierarchical knowledge representation for robot task transfer from virtual to physical world

[VR 2020] Exploring the differences of visual discomfort caused by long-term immersion between virtual environments and physical environments

To investigate the effects of visual discomfort caused by long-term immersing in virtual environments (VEs), we conducted a comparative …
Jie Guo, Dongdong Weng, Hui Fang, Zhenliang Zhang, Jiaming Ping, Yue Liu, Yongtian Wang
[VR 2020] Exploring the differences of visual discomfort caused by long-term immersion between virtual environments and physical environments

[VR 2020] Extracting and transferring hierarchical knowledge to robots using virtual reality

We study the knowledge transfer problem by training the task of folding clothes in the virtual world using an Oculus Headset and …
Zhenliang Zhang, Jie Guo, Dongdong Weng, Yue Liu, Yongtian Wang
Project
[VR 2020] Extracting and transferring hierarchical knowledge to robots using virtual reality

[IROS 2019] Toward an efficient hybrid interaction paradigm for object manipulation in optical see-through mixed reality

Human-computer interaction (HCI) plays an important role in the near-field mixed reality, in which the hand-based interaction is one of …
Zhenliang Zhang, Dongdong Weng, Jie Guo, Yue Liu, Yongtian Wang
Project
[IROS 2019] Toward an efficient hybrid interaction paradigm for object manipulation in optical see-through mixed reality

[ISMAR 2019] Mixed reality office system based on maslow’s hierarchy of needs: Towards the long-term immersion in virtual environments

In a mixed reality (MR) environment that combines the physical objects with the virtual environments, users’ feelings are …
Jie Guo, Dongdong Weng, Zhenliang Zhang, Haiyan Jiang, Yue Liu, Yongtian Wang, Henry Been-Lirn Duh
Project
[ISMAR 2019] Mixed reality office system based on maslow’s hierarchy of needs: Towards the long-term immersion in virtual environments

[Sensors 2019] HiFinger: One-handed text entry technique for virtual environments based on touches between fingers

We present a text entry technique called HiFinger, which is an eyes-free, one-handed wearable text entry technique for immersive …
Haiyan Jiang, Dongdong Weng, Zhenliang Zhang, Feng Chen
[Sensors 2019] HiFinger: One-handed text entry technique for virtual environments based on touches between fingers

[ICRA 2019] High-fidelity grasping in virtual reality using a glove-based system

This paper presents a design that jointly provides hand pose sensing, hand localization, and haptic feedback to facilitate real-time …
Hangxin Liu, Zhenliang Zhang, Xu Xie, Yixin Zhu, Yue Liu, Yongtian Wang, Song-Chun Zhu
Code Project
[ICRA 2019] High-fidelity grasping in virtual reality using a glove-based system

[TURC 2019] VRGym: A virtual testbed for physical and interactive AI

We propose VRGym, a virtual reality testbed for realistic human-robot interaction. Different from existing toolkits and virtual reality environments, the VRGym emphasizes on building and training both physical and interactive agents for robotics, machine learning, and cognitive science.
Xu Xie, Hangxin Liu, Zhenliang Zhang, Yuxing Qiu, Feng Gao, Siyuan Qi, Yixin Zhu, Song-Chun Zhu
Project
[TURC 2019] VRGym: A virtual testbed for physical and interactive AI

[VR 2019] Evaluation of maslows hierarchy of needs on long-term use of HMDs - A case study of office environment

Long-term exposure to VR will become more and more important, but what we need for long term immersion to meet users fundamental needs …
Jie Guo, Dongdong Weng, Zhenliang Zhang, Yue Liu, Yongtian Wang
[VR 2019] Evaluation of maslows hierarchy of needs on long-term use of HMDs - A case study of office environment
See all publications

Projects

*
All Symmetrical Reality Mixed Reality Machine Learning Robot Human-Computer Interaction Virtual Reality Other

Symmetrical Reality Project

A Project of Symmetrical Reality.

Robot Learning Project

A Project of Robot Leraning.

Mixed Reality Project

A Project of Mixed Reality.

Gallery

Contact

  • zzlyw10@gmail.com
  • 2 Summer Palace Road, Beijing, 100080
  • Feel free to contact me on weekdays