He, Qiang
(Key Laboratory of Optoelectronic Technology & Systems (Ministry of Education), Department of Optoelectronic Engineering, Chongqing University)
,
Wu, Yufen
(College of Physics and Electronic Engineering, Chongqing Normal University)
,
Feng, Zhiping
(Chongqing Key Laboratory of Chemical Process for Clean Energy and Resource Utilization, School of Chemistry and Chemical Engineering, Chongqing University)
,
Sun, Chenchen
(Key Laboratory of Optoelectronic Technology & Systems (Ministry of Education), Department of Optoelectronic Engineering, Chongqing University)
,
Fan, Wenjing
(Key Laboratory of Optoelectronic Technology & Systems (Ministry of Education), Department of Optoelectronic Engineering, Chongqing University)
,
Zhou, Zhihao
(Key Laboratory of Optoelectronic Technology & Systems (Ministry of Education), Department of Optoelectronic Engineering, Chongqing University)
,
Meng, Keyu
(Key Laboratory of Optoelectronic Technol)
,
Fan, Endong
,
Yang, Jin
Abstract Human-machine interfaces enable the exchange of information between people and machines, which plays a crucial role in artificial intelligence. In this field, sensors based on magnetism, electricity, mechanics, and optics are used to construct interactive interfaces and have an important r...
Abstract Human-machine interfaces enable the exchange of information between people and machines, which plays a crucial role in artificial intelligence. In this field, sensors based on magnetism, electricity, mechanics, and optics are used to construct interactive interfaces and have an important role in sensing human behavior. Here, we present a vibration sensor based human-machine interface (HMI) with an unlimited sensing area on a ubiquitous surface by detecting and positioning an external vibration source. To accurately perceive an external minute vibration, we proposed triboelectric vibration sensors (TVS) designed by mimicking the ampulla in the lateral line of a fish. Imitating the cilia wrapped in the ampulla structure, the tribo-pair of TVS were designed as nanowire arrays and hemispherical pore structures. It achieved a high force sensitivity of 0.97 V/N when the force is less than 1 N and a broad frequency range from 1 to 3 kHz. Given the excellent performance of the TVS, an in-plane vibration source detection and location system was developed, which utilizes the time difference in the arrival estimation method based on correlation analysis. As a demonstration, a TVS-based intelligent virtual digital keyboard was developed by sensing and locating the position of the keystroke for interactive input and importer authentication according to the bionic features. Furthermore, a customized multifunctional desktop interactive system was established by functionalizing an ordinary table for convenient electrical appliance control. In this way, ordinary surfaces such as tables, walls, and doors have the potential to be converted into multifunctional interactive interfaces. The proposed TVS-based HMI in this work can be immediately and extensively adopted in a variety of applications for portable computer peripherals, cyber security, and intelligent home systems. Highlights Attribute to the elegant hierarchical structure of the TVS mimicked the ampulla in lateral line of a fish, a high pressure sensitivity of 0.97 V/N, a broad frequency range from 1 to 3 kHz, and a minimum detection of 0.01 N had been achieved. Enable it to perceive minute vibration caused by tapping/knocking. •By locating/positioning the tapping/knocking point on TVS mounted surface, ubiquitous daily surfaces can be converted to an intelligent sensing interface. A vibration-based human-machine interface can be established by properly placing TVS on daily surfaces such as desktop and wall. Compared with the traditional touch screen which can only be in the area of sensors, the sensing area in this work is vastly expanded. •A TVS-based intelligent virtual digital keyboard and a customized multifunctional desktop interactive system were developed for interactive input and smart home. Specially, the identities of the importers using the intelligent digital keyboard can be authenticated by the bionic features extracted from the vibration signals. Graphical abstract Human-machine interfaces enable the exchange of information between people and machines, which plays a crucial role in artificial intelligence. In this study, a triboelectric vibration sensor (TVS) based human-machine interface with an unlimited sensing area was developed on a ubiquitous surface. Imitating the cilia wrapped in the ampulla structure in the lateral line of a fish, the TVS was designed as hierarchical structure with nanowire arrayed and hemispherical porous tribo-pair and achieved a high vibration sensing performance. Moreover, by locating/positioning the tapping/knocking point on TVS mounted surface, a TVS-based intelligent digital keyboard and a customized multifunctional desktop interactive system were developed for interactive input and smart home. [DISPLAY OMISSION]
Abstract Human-machine interfaces enable the exchange of information between people and machines, which plays a crucial role in artificial intelligence. In this field, sensors based on magnetism, electricity, mechanics, and optics are used to construct interactive interfaces and have an important role in sensing human behavior. Here, we present a vibration sensor based human-machine interface (HMI) with an unlimited sensing area on a ubiquitous surface by detecting and positioning an external vibration source. To accurately perceive an external minute vibration, we proposed triboelectric vibration sensors (TVS) designed by mimicking the ampulla in the lateral line of a fish. Imitating the cilia wrapped in the ampulla structure, the tribo-pair of TVS were designed as nanowire arrays and hemispherical pore structures. It achieved a high force sensitivity of 0.97 V/N when the force is less than 1 N and a broad frequency range from 1 to 3 kHz. Given the excellent performance of the TVS, an in-plane vibration source detection and location system was developed, which utilizes the time difference in the arrival estimation method based on correlation analysis. As a demonstration, a TVS-based intelligent virtual digital keyboard was developed by sensing and locating the position of the keystroke for interactive input and importer authentication according to the bionic features. Furthermore, a customized multifunctional desktop interactive system was established by functionalizing an ordinary table for convenient electrical appliance control. In this way, ordinary surfaces such as tables, walls, and doors have the potential to be converted into multifunctional interactive interfaces. The proposed TVS-based HMI in this work can be immediately and extensively adopted in a variety of applications for portable computer peripherals, cyber security, and intelligent home systems. Highlights Attribute to the elegant hierarchical structure of the TVS mimicked the ampulla in lateral line of a fish, a high pressure sensitivity of 0.97 V/N, a broad frequency range from 1 to 3 kHz, and a minimum detection of 0.01 N had been achieved. Enable it to perceive minute vibration caused by tapping/knocking. •By locating/positioning the tapping/knocking point on TVS mounted surface, ubiquitous daily surfaces can be converted to an intelligent sensing interface. A vibration-based human-machine interface can be established by properly placing TVS on daily surfaces such as desktop and wall. Compared with the traditional touch screen which can only be in the area of sensors, the sensing area in this work is vastly expanded. •A TVS-based intelligent virtual digital keyboard and a customized multifunctional desktop interactive system were developed for interactive input and smart home. Specially, the identities of the importers using the intelligent digital keyboard can be authenticated by the bionic features extracted from the vibration signals. Graphical abstract Human-machine interfaces enable the exchange of information between people and machines, which plays a crucial role in artificial intelligence. In this study, a triboelectric vibration sensor (TVS) based human-machine interface with an unlimited sensing area was developed on a ubiquitous surface. Imitating the cilia wrapped in the ampulla structure in the lateral line of a fish, the TVS was designed as hierarchical structure with nanowire arrayed and hemispherical porous tribo-pair and achieved a high vibration sensing performance. Moreover, by locating/positioning the tapping/knocking point on TVS mounted surface, a TVS-based intelligent digital keyboard and a customized multifunctional desktop interactive system were developed for interactive input and smart home. [DISPLAY OMISSION]
Weiss 2010 Proc. 23nd Annu. ACM Symp. User Interface Softw. Technol. - UIST’10 Madgets: actuating widgets on interactive tabletops
Weiss 2011 UIST’11 Proc. 24th Annu. ACM Symp. User Interface Softw. Technol. FingerFlux : near-surface haptic feedback on tabletops
Sci. Adv. Pu 3 1 2017 10.1126/sciadv.1700694 Eye motion triggered self-powered mechnosensational communication system using triboelectric nanogenerator
Nano Energy Deng 2019 10.1016/j.nanoen.2018.10.049 Cowpea-structured PVDF/ZnO nanofibers based flexible self-powered piezoelectric bending motion sensor towards remote control of gestures
Wang 2016 Proc. 2016 ACM Interact. Surfaces Spaces EV-pen: leveraging electrovibration haptic feedback in pen interaction
Cho 2016 Proc. 29th Annu. Symp. User Interface Softw. Technol. - UIST’16 RealPen: providing realism in handwriting tasks on touch surfaces using auditory-tactile feedback
Adv. Energy Mater. Yang 2014 10.1002/aenm.201301322 Broadband vibrational energy harvesting based on a triboelectric nanogenerator
Despinoy 2014 Lect. Notes Comput. Sci. (Including Subser. Lect. Notes Artif. Intell. Lect. Notes Bioinformatics) Comparative assessment of a novel optical human-machine interface for laparoscopic telesurgery
Nissler 2015 IEEE Int. Conf. Rehabil. Robot. OMG: Introducing optical myography as a new human machine interface for hand amputees
ACS Nano Roh 2015 10.1021/acsnano.5b01613 Stretchable, transparent, ultrasensitive, and patchable strain sensor for human-machine interfaces comprising a nanohybrid of carbon nanotubes and conductive elastomers
Han 2017 Proc. 30th Annu. ACM Symp. User Interface Softw. Technol. - UIST’17 SoundCraft: enabling spatial interactions on smartwatches using hand generated acoustics
Wang 2014 Ubiquitous Keyboard for Small Mobile Devices: Harnessing Multipath Fading for Fine-Grained Keystroke Localization, MobiSys
Zhang 2018 Proc. 2018 CHI Conf. Hum. Factors Comput. Syst. - CHI’18 A. Sample, Wall++: room-scale interactive and context-aware sensing yang
Adv. Mater. Technol. Luo 2018 10.1002/admt.201700222 Textile-Enabled highly reproducible flexible pressure sensors for cardiovascular monitoring
Adv. Funct. Mater. Lin 2018 Large-scale and washable smart textiles based on triboelectric nanogenerator arrays for self-powered sleeping monitoring
Nano Energy Zhou 2018 10.1016/j.nanoen.2018.08.055 Wireless self-powered sensor networks driven by triboelectric nanogenerator for in-situ real time survey of environmental monitoring
Nat. Commun. Lee 2018 Transparent and attachable ionic communicators based on self-cleanable triboelectric nanogenerators
Adv. Mater. Technol. Lin 2018 10.1002/admt.201800144 Flexible timbo-like triboelectric nanogenerator as self-powered force and bend sensor for wireless and distributed landslide monitoring
ACS Nano Yang 2014 Triboelectrification-based organic film nanogenerator for acoustic energy harvesting and self-powered active acoustic sensing
Adv. Mater. Yang 2015 Eardrum-inspired active sensors for self-powered cardiovascular system characterization and throat-attached anti-interference voice recognition
Liu 2017 2017 14th annu. IEEE int. Conf. Sensing, commun. Networking, SECON 2017 VibSense: sensing touches on ubiquitous surfaces through vibration
Mater. Today Wu 2018 10.1016/j.mattod.2018.01.006 Keystroke dynamics enabled authentication and identification using triboelectric nanogenerator array
Sci. Robot. Boutry 2018 10.1126/scirobotics.aau6914 A hierarchically patterned, bioinspired e-skin able to detect the direction of applied pressure for robotics
J. Exp. Biol. Liao 2006 10.1242/jeb.02487 The role of the lateral line and vision on body kinematics and hydrodynamic preference of rainbow trout in turbulent flow
AI-Helper
※ AI-Helper는 부적절한 답변을 할 수 있습니다.