![\"\"](\"https:\/\/www.revoscience.com\/en\/wp-content\/uploads\/2022\/02\/Professor_Final-Edited-675x450.jpg\" "\\"\\"")
<\/figure>\n\n\n\nDr. Yu Xinge, Associate Professor in the Department of Biomedical Engineering (BME) at CityU, is one of the corresponding authors of the study. The research study was published in\u00a0Science Advances<\/em>\u00a0under the title \u201cElectronic Skin as Wireless Human Machine Interfaces for Robotic VR<\/em>\u201d.<\/p>\n\n\n\n The HMI system links users to robotics or computers and plays a significant role in teleoperating robotics. However, conventional HMIs are based on bulky, rigid, and expensive machines, and the lack of adequate feedback to users limits their application for conducting complicated tasks.<\/p>\n\n\n\n Enables visual and haptic feedback in one go<\/strong><\/p>\n\n\n\n In their latest research, the team presented a closed-loop HMI system based on soft, skin-integrated electronics, which enable wireless motion capture and haptic feedback via Bluetooth, Wi-Fi, and the internet.<\/p>\n\n\n\n The advanced HMI system, named Robotic VR, is an integration of visual, auditory, and haptic virtual reality (VR) via skin-integrated electronics. It uses a layout of multilayer stacking, where the bottom layer of skin-tone elastomeric silicon serves as a soft adhesive interface, which can be mounted on the skin and joints of the user. The layers are interconnected with a collection of chip-scale integrated circuits and sensing components, including resistors, capacitors, a Bluetooth module, a microcontroller\u00a0unit (MCU), and soft sensors and actuators developed by the team.<\/p>\n\n\n\n From motion sensing to action imitation<\/strong><\/p>\n\n\n\n The sensors of the Robotic VR system can accurately detect and convert subtle human motion into electrical signals, which are processed by the MCU and wirelessly transmitted to the target robot. In this way, the user can teleoperate with the robot to imitate his motion to accomplish tasks remotely. The pressure sensors on the robot can send feedback signals to control the vibration intensity of the haptic actuators through the Bluetooth module, thus providing haptic feedback to the user. The user can then precisely control and adjust the motion of the robot\u2019s arm according to the intensity of the feedback.<\/p>\n\n\n\n The HMI system supports three wireless transmission methods \u2013 Bluetooth (up to tens of meters), WiFi (up to about 100 meters), and the Internet (worldwide) \u2013 which can be adjusted according to practical applications.<\/p>\n\n\n\n \u201cThis new-generation flexible human-machine interface system enables teleoperating robotics for conducting complicated tasks,\u201d said Dr. Yu. He pointed out that the new system is stretchable and can be tightly mounted on human skin and even the whole human body for a long time. In addition, the interface provides both haptic and visual feedback systems, providing an immersive experience for users.<\/p>\n\n\n\n The human-machine interfaces could teleoperate various machines. With the advanced circuit design and outstanding mechanical characteristics, Dr. Yu believes this newly invented HMI system has great potential for applications in commercial and biomedical fields. For example, it can be used to remotely drive\u00a0unmanned cars. A user with a hand disability\u00a0can remotely manipulate a robot to carry heavy goods using the HMI system. The sensors attached to the user can monitor and transmit muscle signals to control the robot.<\/p>\n\n\n\n Potential for teleoperating robots for complicated tasks<\/strong><\/p>\n\n\n\n On the biomedical engineering side, doctors can remotely control robots to conduct the surgery by wearing the HMI system with VR glasses. And medical workers can remotely manipulate the robot to look after infectious patients or collect bio-samples, thus greatly decreasing the infection risk. <\/p>\n\n\n\n The team conducted experiments to demonstrate the system\u2019s potential applications, such as remotely controlling the robotic hand to collect throat swab samples for Covid-19 tests and teleoperating humanoid robots to clean a room and even provide patient care. The team is developing a next-generation system to provide the robotic collection of swab tests.<\/p>\n\n\n\n Dr. Yu expects this new-generation HMI system to help provide a new approach in wirelessly connecting people to a robot or virtual character in the metaverse.<\/p>\n\n\n\n The first authors of the research are\u00a0Mr. Liu Yiming,\u00a0Mr. Yiu Chun-ki,\u00a0Dr. Huan Ya\u00a0from the BME, and\u00a0Ms. Song Zhen\u00a0from Dalian University of Technology (DUT). The corresponding authors are Dr. Yu and\u00a0Professor Xie Zhaoqian\u00a0from DUT. The key funding sources for the research include CityU, the Hong Kong Research Grant Council, and the Shenzhen Science and Technology Innovation Commission.<\/p>\n","protected":false},"excerpt":{"rendered":" The coronavirus pandemic has accelerated the use of robots and an urgent need for an advanced human-machine interface (HMI) system that can seamlessly connect users and robots. <\/p>\n","protected":false},"author":2,"featured_media":22243,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[17],"tags":[],"class_list":["post-22242","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-research"],"featured_image_urls":{"full":["https:\/\/www.revoscience.com\/en\/wp-content\/uploads\/2022\/02\/Professor_Final-Edited.jpg",1100,733,false],"thumbnail":["https:\/\/www.revoscience.com\/en\/wp-content\/uploads\/2022\/02\/Professor_Final-Edited-200x200.jpg",200,200,true],"medium":["https:\/\/www.revoscience.com\/en\/wp-content\/uploads\/2022\/02\/Professor_Final-Edited-600x400.jpg",600,400,true],"medium_large":["https:\/\/www.revoscience.com\/en\/wp-content\/uploads\/2022\/02\/Professor_Final-Edited-768x512.jpg",750,500,true],"large":["https:\/\/www.revoscience.com\/en\/wp-content\/uploads\/2022\/02\/Professor_Final-Edited-675x450.jpg",675,450,true],"1536x1536":["https:\/\/www.revoscience.com\/en\/wp-content\/uploads\/2022\/02\/Professor_Final-Edited.jpg",1100,733,false],"2048x2048":["https:\/\/www.revoscience.com\/en\/wp-content\/uploads\/2022\/02\/Professor_Final-Edited.jpg",1100,733,false],"ultp_layout_landscape_large":["https:\/\/www.revoscience.com\/en\/wp-content\/uploads\/2022\/02\/Professor_Final-Edited.jpg",1100,733,false],"ultp_layout_landscape":["https:\/\/www.revoscience.com\/en\/wp-content\/uploads\/2022\/02\/Professor_Final-Edited.jpg",855,570,false],"ultp_layout_portrait":["https:\/\/www.revoscience.com\/en\/wp-content\/uploads\/2022\/02\/Professor_Final-Edited.jpg",600,400,false],"ultp_layout_square":["https:\/\/www.revoscience.com\/en\/wp-content\/uploads\/2022\/02\/Professor_Final-Edited.jpg",600,400,false],"newspaper-x-single-post":["https:\/\/www.revoscience.com\/en\/wp-content\/uploads\/2022\/02\/Professor_Final-Edited-760x490.jpg",760,490,true],"newspaper-x-recent-post-big":["https:\/\/www.revoscience.com\/en\/wp-content\/uploads\/2022\/02\/Professor_Final-Edited-550x360.jpg",550,360,true],"newspaper-x-recent-post-list-image":["https:\/\/www.revoscience.com\/en\/wp-content\/uploads\/2022\/02\/Professor_Final-Edited-95x65.jpg",95,65,true],"web-stories-poster-portrait":["https:\/\/www.revoscience.com\/en\/wp-content\/uploads\/2022\/02\/Professor_Final-Edited.jpg",640,426,false],"web-stories-publisher-logo":["https:\/\/www.revoscience.com\/en\/wp-content\/uploads\/2022\/02\/Professor_Final-Edited.jpg",96,64,false],"web-stories-thumbnail":["https:\/\/www.revoscience.com\/en\/wp-content\/uploads\/2022\/02\/Professor_Final-Edited.jpg",150,100,false]},"author_info":{"info":["RevoScience"]},"category_info":"Research<\/a>","tag_info":"Research","comment_count":"0","_links":{"self":[{"href":"https:\/\/www.revoscience.com\/en\/wp-json\/wp\/v2\/posts\/22242","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.revoscience.com\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.revoscience.com\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.revoscience.com\/en\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.revoscience.com\/en\/wp-json\/wp\/v2\/comments?post=22242"}],"version-history":[{"count":0,"href":"https:\/\/www.revoscience.com\/en\/wp-json\/wp\/v2\/posts\/22242\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.revoscience.com\/en\/wp-json\/wp\/v2\/media\/22243"}],"wp:attachment":[{"href":"https:\/\/www.revoscience.com\/en\/wp-json\/wp\/v2\/media?parent=22242"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.revoscience.com\/en\/wp-json\/wp\/v2\/categories?post=22242"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.revoscience.com\/en\/wp-json\/wp\/v2\/tags?post=22242"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}