[논문]Development of electric vehicle maintenance education ability using digital twin technology and VR

Lee, Sang-Hyun; Jung, Byeong-Soo

doi:10.17703/ijact.2020.8.2.58

Development of electric vehicle maintenance education ability using digital twin technology and VR 원문보기

The International journal of advanced culture technology, v.8 no.2, 2020년, pp.58 - 67

Lee, Sang-Hyun (Dept. of Computer Engineering, Honam University) , Jung, Byeong-Soo (Dept. of Information Technology Engineering, Nambu University)

Abstract ▼ AI-Helper

In this paper, the maintenance training manual of EV vehicle was produced by utilizing digital twin technology and various sensors such as IR-based light house tracking and head tracker. In addition, through digital twin technology and VR to provide high immersiveness to users, sensory content creation technology was secured through animation and effect realization suitable for EV vehicle maintenance situation. EV vehicle maintenance training manual is 3D engine programming and real-time creation of 3D objects and minimization of screen obstacles and selection of specific menus in virtual space in the form of training simulation. In addition, automatic output from the Head Mount Display (HUD), EV vehicle maintenance and inspection, etc., user can easily operate content was produced. This technology development can enhance immersion to users through implementation of detailed scenarios for maintenance / inspection of EV vehicles" and 3D parts display by procedure, realization of animations and effects for maintenance situations. Through this study, familiarity with improving the quality of education and safety accidents and correct maintenance process and the experienced person was very helpful in learning how to use equipment naturally and how to maintain EV vehicles.

주제어

표/그림 (13)

그림 Figure 1. Diagram of VR interactive system using HMD and controller
그림 Figure 2. Content development process
그림 Figure 3. Steam VR Plug-In for Unity Asset Store and Camera Rig Prefabs
그림 Figure 4. Coordination of center point of transform and head movement, center coordinate of motion image and position in scenario
그림 Figure 5. Screen for real vehicle and part scanning using handheld scanning.
그림 Figure 6. Process of completing 3D reverse engineering after 3D scanning of vehicle parts
그림 Figure 7. Software configuration of VR maintenance training production
그림 Figure 8. VR Controller-style maintenance tool UX
그림 Figure 7. Non-rigid body and flexible unit material and PIPE physical realization
그림 Figure 9. Command system type according to lift movement, maintenance instruction content order change through voice recognition
그림 Figure 10. Types of 360-degree automatic recording that can share VR training video and Heat map for analyzing the viewer's gaze
그림 Figure 11. Lamp lighting when maintenance is completed by interlocking VR contents with embedded system with digital twin technology
그림 Figure 12. Maintenance procedure manual and LMS (learning management system) establishment

AI 본문요약
AI-Helper

* AI 자동 식별 결과로 적합하지 않은 문장이 있을 수 있으니, 이용에 유의하시기 바랍니다.

가설 설정

In this study, Unity 3D engine was used in consideration of the convenience of hardware connection and development and distribution. The unity engine supports various platforms and integrated asset systems through steady upgrades after the first version (1.

제안 방법

As shown in Figure 4, synchronization is minimized using time synchronization and screen synchronization according to rotation angle. 360˚ degree free view according to front, left / right rotation, left / right tilt, head movement wearing HMD such as up / down rotation realize virtual reality through realistic screen expression and optimize it to HMD to implement it so that it can work with determine whether the center coordinate calculated from the eye image obtained from the inertial sensor is stare at the position on the monitor and set the geometric positional relationship between the center of the pupil of the eye and the monitor plane.
According to the progress of the scenario developed for the maintenance training of electric vehicles in virtual reality, the vehicle diagnosis process is performed, the status of the vehicle is determined, and the maintenance direction is determined accordingly. The tools and equipment used for maintenance can be directly used through the VR controller in the virtual space to allow maintenance.
Figure 7 is a schematic diagram of the VR electric car maintenance training manual. Based on the maintenance manual, each maintenance part was systematically separated for each module, and then a car maintenance algorithm was applied, and real-world parts and optimized GUI were implemented through 3D scanning technology.
Three-dimensional scanning of vehicle configuration system of electric vehicles integrated power controller (EPCU) battery, etc. First, in order to apply the actual modeling to the VR content, the target part is scanned in real time, and then 3D modeling is performed with reference to the position of each module by overall volume, proportion, size and proportion alignment, registration, and correction through a post-processing program of 3D scanning and converting for VR contents. Here, the place where black and diffuse reflections are severe during 3D scanning is supplemented through 3D modeling.
The acquired data is modeled through a topology process in a 3D modeling program. For materials and shades, maps such as Albedo Map, Normal Map, Height Map, Occlusion Map, Detail Mask, etc. of the main map were applied, and four or more textures were applied to improve the material. Since the 3D engine has a limited number of materials that can be expressed compared to the passive rendering method, the real-time 3D engine uses passive rendering to apply a render to texture method that burns multiple materials into a single image to maximize the texture.
For this various problem solving, gathering data using big data of the 4th Industrial Revolution" and applying models of various intelligent analysis methods (pattern recognition, data mining, deep learning etc.) and a new concept of a model-based digital twin that can provide a suitable result centered on the consumer.
Through 3D engine programming, real-time creation of 3D objects and selection of specific menus in virtual space and minimization of on-screen obstacles were configured to perform training simulations. The content developed in this paper is to improve the quality of education, safety accidents, and correct maintenance through the process as shown in Fig. 12, and the experienced person will naturally learn how to use the equipment and how to maintain the EV vehicle.
The content to be developed is intended to produce an electric vehicle maintenance training manual and set to allow access to electric vehicles and checklists required for maintenance, configuration and driving principle, safety check according to high voltage, safety create content on matters related to, and set the direction required for development and design the content structure.
The data was optimized to less than 50,000 mesh per module in consideration of the performance of 3D engine programming and conducted data concisely and parts that generated events were implemented separately through modeling. The texture was image-based texturing as shown in Figure 5 and imaged from the handheld scanner and textured, and textured modeling through resize and de-etching.
This paper used DTS and 3D virtual environment development required for 3D video output display and IR-based light house tracking, various sensors such as head trackers, etc. Research and production of EV maintenance manuals.

이론/모형

The HTC VIVE, a Head Mount Display device, was used as a manufacturing tool for the VR interactive system used in this study. The existing HMD showed only the screen in front of the eyes.

성능/효과

Through this study, the quality of education, safety accidents, and correct maintenance procedures were familiarized, and the experiencers were very helpful in learning how to use equipment and how to maintain EV vehicles.

후속연구

This paper intends to research and develop content that can repair education of EV vehicles using digital twin technology and VR. For development, use HTC VIVE, a Head Mount Display device.

참고문헌 (11)

J. Y. Kim, H-. J. Kim, and S. J. Kang., "Development of a Real-time Simulation Technique for Cyber-physical System", Journal of the Korea Society for Simulation, Vol. 23, No. 4, pp. 181-188. 2014. DOI: 10.9709/JKSS.2014.23.4.181

원문보기 상세보기
O. H. Jo, N. Kim, G. J. Lee, and W. Lee., "Machined Shape Error Prediction Based on Digital Twin", Korean Society for Precision Engineering, pp. 364-364. 2018.
R. Rosen, G. V. Wicher, G. Lo, and K. D. Bettenhausen., "About the Importance of Autonomy and Digital Twins for the Future of Manufacturing", IFAC Papers On Line, Vol. 48, No. 3, pp. 567-572. 2017. DOI: 10.1016/j.ifacol.2015.06.141

상세보기
E. H. Glaessgen, and D. S. Stargel., "The Digital Twin Paradigm for Future NASA and U.S. Air Force Vehicles," The 53rd Structural Dynamics, and Materials Conference: Special Session on the Digital Twin pp. 1-14, 2012.
Deloitte, A Deloitte series on Industry 4.0, digital manufacturing enterprises, and digital supply networks, Industry 4.0 and the digital twin, Deloitte University Press. 2017.
Deloitte, 3D opportunity and the digital thread-Additive manufacturing ties it all together. Deloitte University Press. 2016.
https://www.gartner.com/smarterwithgartner/gartner-top-10-strategic-technology-trends-for-2018.
G. Y. Lee & S. H. Lee., "Virtual Reality Based Cultural Tourist Attractions converging with Souvenir." Journal of Convergence for Information Technology, Vol. 7, No. 3, pp. 111-116, 2017. DOI : 10.22156/CS4SMB.2017.7.3.11
H. J. Kim, J. W. hong and Y. W. You., "A Study on the Optimization of Manufacturing Process through Motion Analysis and Virtual Reality." Journal of the Korea Convergence Society, Vol. 8, No. 7, pp. 23-28, 2017. DOI : 10.15207/JKCS.2017.8.7.023

원문보기 상세보기
Unity3D Asset Store [Online]. Available: https://assetstore.unity.com/
K-. H. Kim, S-. H. Lee., "Development of Structured Light 3D Scanner Based on Image Processing," The International Journal of Internet, Broadcasting and Communication, Vol.11, No.4, pp. pp. 43-48, 2019. https://doi.org/10.7236/IJIBC.2019.11.4.49

표제어: PCR

동의어: Packet Collision Rate

용어 설명 출처 목록 (6)

용어 설명: PCR은 세균 특이성이 있는 primer를 이용하여 적은 수의 세균이 있을지라도 쉽게 검출할 수 있는 유용한 방법이며, 이를 이용하여 구강 내 치면세균막이나 타액에서 직접 세균을 검출할 수 있게 되었다[8].

내보내기 구분	파일저장 인쇄 메일전송
구성항목	기본정보 상세정보 관리번호, 논문명, 저널/프로시딩명, 저자 , 발행년, 권, 호, 시작페이지, 끝페이지, 발행기관 관리번호, 논문명, 대등논문명, 저자 , 저널/프로시딩명, 발행기관, 발행년, 발행언어, 권, 호, 시작페이지, 끝페이지, ISBN, ISSN, 주제분야, 키워드, 초록(한글), 초록(영문), 저자(소속기관)
저장형식	Text(ASCII format) Excel format RefWorks Direct Export RIS format (for Reference Manager, ProCite, EndNote), Scholar's Aids, Mendeley
메일정보	받는사람 (필수) @ 보내는사람 (선택) @ 제목 내용 KISTI 검색결과 이메일 서비스
안내	총 건의 자료가 검색되었습니다. 다운받으실 자료의 인덱스를 입력하세요. (1-10,000) 검색결과의 순서대로 최대 10,000건 까지 다운로드가 가능합니다. 데이타가 많을 경우 속도가 느려질 수 있습니다.(최대 2~3분 소요) 다운로드 파일은 UTF-8 형태로 저장됩니다. 파일의 내용이 제대로 보이지 않을실 때는 웹브라우저 상단의 보기 -> 인코딩 -> 자동선택 여부를 확인하십시오. ~ Text(ASCII format) Excel format

연합인증