Importing and analyzing external data using a virtual reality welding system
원문보기
IPC분류정보
국가/구분
United States(US) Patent
등록
국제특허분류(IPC7판)
G09B-019/24
G09B-005/02
A42B-003/04
A42B-003/30
G09B-005/00
B23K-009/00
G09B-005/06
B23K-009/09
H04L-029/06
B23K-009/095
B23K-009/10
출원번호
US-0821018
(2015-08-07)
등록번호
US-9818311
(2017-11-14)
발명자
/ 주소
Zboray, David Anthony
Bennett, Matthew Alan
Wallace, Matthew Wayne
Hennessey, Jeremiah
Dudac, Yvette Christine
Lenker, Zachary Steven
Lundell, Andrew Paul
Dana, Paul
Preisz, Eric A.
출원인 / 주소
Lincoln Global, Inc.
대리인 / 주소
Perkins Coie, LLP.
인용정보
피인용 횟수 :
0인용 특허 :
196
초록▼
A real-time virtual reality welding system including a programmable processor-based subsystem, a spatial tracker operatively connected to the programmable processor-based subsystem, at least one mock welding tool capable of being spatially tracked by the spatial tracker, and at least one display dev
A real-time virtual reality welding system including a programmable processor-based subsystem, a spatial tracker operatively connected to the programmable processor-based subsystem, at least one mock welding tool capable of being spatially tracked by the spatial tracker, and at least one display device operatively connected to the programmable processor-based subsystem. The system is capable of simulating, in virtual reality space, a weld puddle having real-time molten metal fluidity and heat dissipation characteristics. The system is further capable of importing data into the virtual reality welding system and analyzing the data to characterize a student welder's progress and to provide training.
대표청구항▼
1. A system for simulating welding activity; said system comprising: a welding tool for a simulated welding operation;a spatial tracker which tracks a movement and orientation of said welding tool;a welding coupon;a helmet comprising a first display device to display said simulating welding operatio
1. A system for simulating welding activity; said system comprising: a welding tool for a simulated welding operation;a spatial tracker which tracks a movement and orientation of said welding tool;a welding coupon;a helmet comprising a first display device to display said simulating welding operation to a user;a simulated welding console having a user input system and a second display device to display said simulated welding operation; anda processor based subsystem located within said simulated welding console which is operatively coupled to said spatial tracker and receives information from said spatial tracker related to said movement and orientation of said welding tool;wherein during said simulated welding operation, said processor based subsystem models a simulated welding surface for said welding coupon and displays said simulated welding surface on each of said first and second display devices;wherein during said simulated welding operation, said processor based subsystem creates a simulated welding arc between an emitting end of said welding tool and said simulated welding surface and simulates a creation of a weld puddle have real-time molten metal fluidity and real-time heat dissipation characteristics during said simulated welding operation;wherein said simulated weld puddle has a plurality of voxels, where each of said voxels has a first value representative of displacement and a second value representative of heat, where each of said first and second values change dynamically during said simulated welding operation to display on each of said first and second display devices a simulated deposition of material into said simulated weld puddle, and where said dynamic changes are based on said movement and orientation of said welding tool; andwherein said processor based subsystem displays a simulated completed weld bead on said first and second display devices which is based on said movement and orientation of said welding tool, and based on a cooling threshold value for a transition of said voxels from a molten state to a solid state. 2. The simulated welding system of claim 1, wherein said welding tool is an actual welding tool that can be used for a real world welding operation. 3. The simulated welding system of claim 1, wherein said spatial tracker includes an optical sensor mounted on said helmet. 4. The simulated welding system of claim 1, wherein said helmet further comprises an audio speaker which provides simulated welding sounds in real-time with the simulated welding operation. 5. The simulated welding system of claim 1, wherein said second display device displays a plurality of simulated welding parameters, in real-time, during said simulated welding operation, where said simulated welding parameters are generated by said processor based subsystem using said movement and orientation of said welding tool. 6. The simulated welding system of claim 5, wherein at least one of said simulated welding parameters is displayed in graphical form, in real time, during said simulated welding operation. 7. The simulated welding system of claim 5, wherein said simulated welding parameters include weld angle, travel angle, and travel speed. 8. The simulated welding system of claim 1, wherein said processor based subsystem generates at least one simulated welding parameter using said movement and orientation of said welding tool and compares said at least one simulated welding parameter to a stored value, and wherein said processor based subsystem displays said comparison on said second display device. 9. The simulated welding system of claim 8, wherein said comparison is displayed in graphical form. 10. The simulated welding system of claim 1, wherein said processor based subsystem generates at least one simulated welding parameter using said movement and orientation of said welding tool and compares said at least one simulated welding parameter to a tolerance window defined by limits around a setpoint for said at least one simulated welding parameter, and wherein said processor based subsystem displays said comparison on said second display device. 11. The simulated welding system of claim 10, wherein said comparison is displayed in graphical form. 12. The simulated welding system of claim 1, wherein said processor based subsystem generates at least one simulated welding parameter using said movement and orientation of said welding tool and provides a score for said at least one simulated welding parameter based on a comparison between said at least one simulated welding parameter and a desired value for said simulated welding parameter. 13. The simulated welding system of claim 12, wherein said score is a numerical score. 14. The simulated welding system of claim 1, wherein said processor based subsystem determines a presence of a discontinuity within said simulated completed weld bead, and where said discontinuity is a presence of at least one of spatter and porosity. 15. The simulated welding system of claim 14, wherein said first display device displays said discontinuity during said simulated welding operation, in real time, and in said simulated completed weld bead. 16. The simulated welding system of claim 1, wherein said first display device displays a plurality of visual cues during said simulated welding operation, where each of said plurality of visual cues is for a distinct one of simulated welding parameters, and where said visual cues are displayed based on a deviation of said simulated welding parameters during said simulated welding operation from a desired value for each of said simulated welding parameters, respectively. 17. The simulated welding system of claim 1, wherein said processor based subsystem generates and displays on said first display device at least one welding effect, which can be any one of simulated welding sparks, simulated welding spatter, simulated arc glow and simulated porosity during said simulated welding operation, and where said at least one welding effect is displayed, in real time, based on said movement and orientation of said welding tool. 18. The simulated welding system of claim 1, wherein at least one of said displacement and heat values are changed dynamically based a distance between said voxels and said emitting end of said welding tool. 19. The simulated welding system of claim 1, wherein when said heat value is higher than said cooling threshold value said first and second display devices display said voxels in a simulated fluid state and when said heat value is lower than said cooling threshold value said first and second display devices display said voxels in a solid state. 20. The simulated welding system of claim 1, wherein said processor based subsystem changes displacement values of at least some voxels of said simulated completed weld bead when said welding tool is used to make a second simulated weld bead over said simulated completed weld bead, and where each of said simulated completed weld bead and said second simulated weld bead are displayed on said first and second display devices at the same time. 21. The simulated welding system of claim 1, wherein said real-time molten metal fluidity and said real-time heat dissipation characteristics are generated by a physics model operating on at least one GPU. 22. The simulated welding system of claim 1, wherein said first display device displays a weld bead wake characteristic during creation of said simulated completed weld bead, where said weld bead wake characteristic is generated based on a real time fluidity-to-solidification transition of said simulated completed weld puddle as said simulated weld puddle is moved. 23. A system for simulating welding activity; said system comprising: a welding tool for a simulated welding operation;a spatial tracker which tracks a movement and orientation of said welding tool using an optical sensor;a welding coupon;a helmet comprising a first display device to display a simulating welding operation to a user, and which has said optical sensor mounted thereto;a simulated welding console having a user input system and a second display device to display said simulated welding operation; anda processor based subsystem located within said simulated welding console which is operatively coupled to said spatial tracker and receives information from said spatial tracker related to said movement and orientation of said welding tool, and where said second display device displays a plurality of simulated welding parameters, in real-time, during said simulated welding operation, where said simulated welding parameters are generated by said processor based subsystem using said movement and orientation of said welding tool;wherein during said simulated welding operation, said processor based subsystem models a simulated welding surface for said welding coupon and displays said simulated welding surface on each of said first and second display devices;wherein during said simulated welding operation, said processor based subsystem creates a simulated welding arc between an emitting end of said welding tool and said simulated welding surface and simulates a creation of a weld puddle have real-time molten metal fluidity and real-time heat dissipation characteristics during said simulated welding operation;wherein said simulated weld puddle has a plurality of voxels, where each of said voxels has a first value representative of displacement and a second value representative of heat, where each of said first and second values change dynamically during said simulated welding operation to display on each of said first and second display devices a simulated deposition of material into said simulated weld puddle, and where said dynamic changes are based on said movement and orientation of said welding tool; andwherein said processor based subsystem displays a simulated completed weld bead on said first and second display devices which is based on said movement and orientation of said welding tool, and based on a cooling threshold value for a transition of said voxels from a molten state to a solid state. 24. The simulated welding system of claim 23, wherein said welding tool is an actual welding tool that can be used for a real world welding operation. 25. The simulated welding system of claim 23, wherein said helmet further comprises an audio speaker which provides simulated welding sounds in real-time with the simulated welding operation. 26. The simulated welding system of claim 23, wherein at least one of said simulated welding parameters is displayed in graphical form, in real time, during said simulated welding operation. 27. The simulated welding system of claim 23, wherein said simulated welding parameters include weld angle, travel angle, and travel speed. 28. The simulated welding system of claim 23, wherein said processor based subsystem compares at least one of said simulated welding parameters to a stored value, and wherein said processor based subsystem displays said comparison on said second display device. 29. The simulated welding system of claim 28, wherein said comparison is displayed in graphical form. 30. The simulated welding system of claim 23, wherein said processor based subsystem compares at least one of said simulated welding parameters to a tolerance window defined by limits around a setpoint for said at least one simulated welding parameter, and wherein said processor based subsystem displays said comparison on said second display device. 31. The simulated welding system of claim 30, wherein said comparison is displayed in graphical form. 32. The simulated welding system of claim 23, wherein said processor based subsystem provides a score for at least one of said simulated welding parameters based on a comparison between said at least one simulated welding parameter and a desired value for said at least one simulated welding parameter. 33. The simulated welding system of claim 32, wherein said score is a numerical score. 34. The simulated welding system of claim 23, wherein said processor based subsystem determines a presence of a discontinuity within said simulated completed weld bead, and where said discontinuity is a presence of at least one of spatter and porosity. 35. The simulated welding system of claim 34, wherein said first display device displays said discontinuity during said simulated welding operation, in real time, and in said simulated completed weld bead. 36. The simulated welding system of claim 23, wherein said first display device displays a plurality of visual cues during said simulated welding operation, where each of said plurality of visual cues is for a distinct one of said simulated welding parameters, and where said visual cues are displayed based on a deviation of said simulated welding parameters during said simulated welding operation from a desired value for each of said welding parameters, respectively. 37. The simulated welding system of claim 23, wherein said processor based subsystem generates and displays on said first display device at least one welding effect, which can be any one of simulated welding sparks, simulated welding spatter, simulated arc glow and simulated porosity during said simulated welding operation, and where said at least one welding effect is displayed, in real time, based on said movement and orientation of said welding tool. 38. The simulated welding system of claim 23, wherein at least one of said displacement and heat values are changed dynamically based a distance between said voxels and said emitting end of said welding tool. 39. The simulated welding system of claim 23, wherein when said heat value is higher than said cooling threshold value said first and second display devices display said simulated weld puddle in a simulated fluid state and when said heat value is lower than said cooling threshold value said first and second display devices display said simulated weld puddle in a solid state. 40. The simulated welding system of claim 23, wherein said processor based subsystem changes said displacement value of at least some of said voxels of said simulated completed weld bead when said welding tool is used to make a second simulated weld bead over said simulated completed weld bead, and where each of said simulated completed weld bead and said second simulated weld bead are displayed on said first and second display devices at the same time. 41. The simulated welding system of claim 23, wherein said real-time molten metal fluidity and said real-time heat dissipation characteristics are generated by a physics model operating on at least one GPU. 42. The simulated welding system of claim 23, wherein said first display device displays a weld bead wake characteristic during creation of said simulated completed weld bead, where said weld bead wake characteristic is generated based on a real time fluidity-to-solidification transition of said simulated weld puddle as said simulated weld puddle is moved. 43. A method for simulating welding activity to be performed by a processor-based apparatus, said method comprising: tracking a movement and orientation of a welding tool using a spatial tracker;displaying a simulating welding operation on a helmet comprising a first display device;providing a second display device on a simulated welding console to display said simulated welding operation, said simulated welding console having a user input system; andreceiving information from said spatial tracker related to said movement and orientation of said welding tool;modeling, during said simulated welding operation, a simulated welding surface for a welding coupon;displaying said simulated welding surface on each of said first and second display devices;creating, during said simulated welding operation, a simulated welding arc between an emitting end of said welding tool and said simulated welding surface and simulating a creation of a weld puddle have real-time molten metal fluidity and real-time heat dissipation characteristics during said simulated welding operation, wherein said simulated weld puddle has a plurality of voxels, where each of said voxels has a first value representative of displacement and a second value representative of heat, where each of said first and second values change dynamically during said simulated welding operation to display on each of said first and second display devices a simulated deposition of material into said simulated weld puddle, and where said dynamic changes are based on said movement and orientation of said welding tool; anddisplaying a simulated completed weld bead on said first and second display devices which is based on said movement and orientation of said welding tool, and based on a cooling threshold value for a transition of said voxels from a molten state to a solid state. 44. The method of claim 43, wherein said welding tool is an actual welding tool that can be used for a real world welding operation. 45. The method of claim 43, wherein said spatial tracker includes an optical sensor mounted on said helmet. 46. The method of claim 43, further comprising: providing simulated welding sounds in real-time with the simulated welding operation via an audio speaker disposed in said helmet. 47. The method of claim 43, further comprising: displaying a plurality of simulated welding parameters, in real-time, on said second display device during said simulated welding operation, where said simulated welding parameters are generated based on said movement and orientation of said welding tool. 48. The method of claim 47, wherein at least one of said simulated welding parameters is displayed in graphical form, in real time, during said simulated welding operation. 49. The method of claim 47, wherein said simulated welding parameters include weld angle, travel angle, and travel speed. 50. The method of claim 43, further comprising: generating at least one simulated welding parameter using said movement and orientation of said welding tool;comparing said at least one simulated welding parameter to a stored value; anddisplaying said comparison on said second display device. 51. The method of claim 50, wherein said comparison is displayed in graphical form. 52. The method of claim 43, further comprising: generating at least one simulated welding parameter using said movement and orientation of said welding tool;comparing said at least one simulated welding parameter to a tolerance window defined by limits around a setpoint for said at least one welding parameter; anddisplaying said comparison on said second display device. 53. The method of claim 52, wherein said comparison is displayed in graphical form. 54. The method of claim 43, further comprising: generating at least one simulated welding parameter using said movement and orientation of said welding tool; andproviding a score for said at least one simulated welding parameter based on a comparison between said at least one simulated welding parameter and a desired value for said simulated welding parameter. 55. The method claim 54, wherein said score is a numerical score. 56. The method of claim 43, further comprising determining a presence of a discontinuity within said simulated completed weld bead, and where said discontinuity is a presence of at least one of spatter and porosity. 57. The method of claim 56, wherein said first display device displays said discontinuity during said simulated welding operation, in real time, and in said simulated completed weld bead. 58. The method of claim 43, wherein said first display device displays a plurality of visual cues during said simulated welding operation, where each of said plurality of visual cues is for a distinct one of simulated welding parameters, and where said visual cues are displayed based on a deviation of said simulated welding parameters during said simulated welding operation from a desired value for each of said simulated welding parameters, respectively. 59. The method of claim 43, further comprising: generating and displaying on said first display device at least one welding effect, which can be any one of simulated welding sparks, simulated welding spatter, simulated arc glow and simulated porosity during said simulated welding operation, and where said at least one welding effect is displayed, in real time, based on said movement and orientation of said welding tool. 60. The method of claim 43, wherein at least one of said displacement and heat values are changed dynamically based a distance between said voxels and said emitting end of said welding tool. 61. The method of claim 43, wherein when said heat value is higher than said cooling threshold value said first and second display devices display said simulated weld puddle in a simulated fluid state and when said heat value is lower than said cooling threshold value said first and second display devices display said simulated weld puddle in a solid state. 62. The method of claim 43, further comprising: changing said displacement value of at least some of said voxels of said simulated completed weld bead when said welding tool is used to make a second simulated weld bead over said simulated completed weld bead, and where each of said simulated completed weld bead and said second simulated weld bead are displayed on said first and second display devices at the same time. 63. The method of claim 43, wherein said real-time molten metal fluidity and said real-time heat dissipation characteristics are generated by a physics model operating on at least one GPU. 64. The method of claim 43, wherein said first display device displays a weld bead wake characteristic during creation of said simulated completed weld bead, where said weld bead wake characteristic is generated based on a real time fluidity-to-solidification transition of said simulated weld puddle as said simulated weld puddle is moved.
연구과제 타임라인
LOADING...
LOADING...
LOADING...
LOADING...
LOADING...
이 특허에 인용된 특허 (196)
Bloch Christopher J. ; Harrison Don ; Hill John, Apparatus and method for computerized interactive control, measurement and documentation of arc welding.
Dabral Sanjay ; Greene Raymond G. ; Koons John P. ; Seraphim Donald P. ; Yost Boris, Assembling and sealing large, hermetic and semi-hermetic, h-tiled, flat-paneled displays.
Brush George W. (Maywood NJ) Strickland Lee T. (Great Neck NY) Hon David C. (Seattle WA) Harding Ronald E. (Seattle WA) Sallis Jane (Seattle WA), Audio visual instructional system.
Chen, Steven L.; Eliazar, Austin, Augmented reality (AR) system and method for tracking parts and visually cueing a user to identify and locate parts in a scene.
Nagetgaal, Joop C., Computer process for prescribing second-order tetrahedral elements during deformation simulation in the design analysis of structures.
Dostoomian Ashod S. (Stoukhim MA) Richard Alan A. (Seekona MA) Traub Alan C. (Framingham MA) Vanzetti Riccardo (Brockton MA), Controller for spot welding.
Herbst Donald J. (Cape Girardeau MO) Fay Richard D. (Jackson MO) Frericks David L. (Jackson MO) Blair Bruce A. (Jackson MO), Device for training welders.
Paton Boris E. (Kiev SUX) Vasiliev Vsevolod V. (Kiev SUX) Bogdanovsky Valentin A. (Kiev SUX) Danilyak Sergei N. (Kiev SUX) Gavva Viktor M. (Kiev SUX) Roiko Jury P. (Kiev SUX) Nushko Valery A. (Kiev S, Electric-arc trainer for welders.
Bolas Mark (Palo Alto CA) McDowall Ian E. (Palo Alto CA) Mead Russell (Los Altos Hills CA), Image display method and apparatus with means for yoking viewpoint orienting muscles of a user.
Zboray, David Anthony; Bennett, Matthew Alan; Wallace, Matthew Wayne; Hennessey, Jeremiah; Dudac, Yvette Christine; Lenker, Zachary Steven; Lundell, Andrew Paul; Dana, Paul; Preisz, Eric A., Importing and analyzing external data using a virtual reality welding system.
Zboray, David Anthony; Bennett, Matthew Alan; Wallace, Matthew Wayne; Hennessey, Jeremiah; Dudac, Yvette Christine; Lenker, Zachary Steven; Lundell, Andrew Paul; Dana, Paul; Preisz, Eric A., Importing and analyzing external data using a virtual reality welding system.
Kidwell J. Jeffrey (Louisville OH) Reed Stuart E. (Homeworth OH) Ryan Patrick M. (Alliance OH) Harwig Dennis D. (Canton OH) Womack ; Jr. E. Allen (Akron OH), Manual arc welding speed pacer.
Smartt Herschel B. ; Kenney Kevin L. ; Johnson John A. ; Carlson Nancy M. ; Clark Denis E. ; Taylor Paul L. ; Reutzel Edward W., Method and apparatus for assessing weld quality.
Solomon Harvey Donald ; White Raymond Alan ; Fusaro ; Jr. Robert Anthony, Method for developing residual compressive stress in stainless steel and nickel base superalloys.
Goldfarb Samuel M. (Poughkeepsie NY) Herb Paul R. (LaGrangeville NY) Lukaitis Joseph M. (Pleasant Valley NY) Shi Leathen (Yorktown Heights NY), Non-destructive flex testing method and means.
Bisiaux, Bernard; Lesage, Frédéric; Petit, Sébastien; Deutsch, Sylvain, Non-destructive testing, in particular for pipes during manufacture or in the finished state.
Lesage, Frederic; Segura Rodriguez, Nidia Alejandra; Bisiaux, Bernard, Non-destructive testing, in particular for pipes during manufacture or in the finished state.
Hu, Shixin Jack; Chu, Yunxian; Hou, Wenkao; Marin, Samuel Paul; Wang, Pei-Chung, Online monitoring system and method for a short-circuiting gas metal arc welding process.
Kirmsse Helmut (Berlin) Wesselmann Ludger (Berlin DEX), Process and device for automatic determination of parameters for process control systems with unknown transfer behavior,.
Berger Jean-Yves (Bessancourt FRX) Kostelitz Michel (Versailles FRX) Reynaud Bernard (L\Isle Adam FRX) Egee Raymond (Champagne-sur-Oise FRX), Process and installation for automatic ignition of a plasma cutting torch.
Lindbom Torsten H. (1849 Kedron Cir. Fort Collins CO 80524), Robotic apparatus and method for automatically moving a tool through three dimensions and manually to an extended positi.
Vasiliev Vsevolod V. (Kiev SUX) Danilyak Sergei N. (Kiev SUX) Levina Anna I. (Kiev SUX) Nushko Valery A. (Kiev SUX) Roiko Jury P. (Kiev SUX), Spark trainer for welders.
Kovacevic, Radovan; Jandric, Zoran; Valant, Michael E.; Kmecko, Ivan S., System and method for controlling welding parameters in welding-based deposition processes.
Zboray, David Anthony; Bennett, Matthew Alan; Wallace, Matthew Wayne; Hennessey, Jeremiah; Dudac, Yvette Christine; Lenker, Zachary Steven; Lundell, Andrew Paul; Dana, Paul; Preisz, Eric A., System and method providing arc welding training in a real-time simulated virtual reality environment using real-time weld puddle feedback.
Peters, Carl; Postlethwaite, Deanna; Wallace, Matthew Wayne, Systems and methods providing an enhanced user experience in a real-time simulated virtual reality welding environment.
Bangs Edmund R. (Indian Head Park IL) Longinow Nicholas E. (Oak Park IL) Blaha James R. (Palos Heights IL), Using infrared imaging to monitor and control welding.
Bolick, Michael; Lampe, Chris; Ebensberger, Jason; Treloar, Jeremiah; Klein, Rick; Peterson, Eric Conrad; Zalkin, Chad Jason, Virtual blasting system for removal of coating and/or rust from a virtual surface.
LeMay,Steven G.; Benbrahim,Jamal; Rowe,Richard E.; Breckner,Robert E.; Beaulieu,Nicole M.; Schlottmann,Greg A., Virtual cameras and 3-D gaming environments in a gaming machine.
Wallace, Matthew Wayne; Zboray, David Anthony; Aditjandra, Antonius; Webb, Adam Lee; Postlethwaite, Deanna; Lenker, Zachary Steven, Virtual reality GTAW and pipe welding simulator and setup.
John E. White ; Hollis Ambrose ; Brent A. Stancil, Virtual reality simulation-based training of telekinegenesis system for training sequential kinematic behavior of automated kinematic machine.
Paton Boris E. (Kiev SUX) Vasiliev Vsevolod V. (Kiev SUX) Bogdanovsky Valentin A. (Kiev SUX) Baranov Alexandr I. (Kiev SUX) Danilyak Sergei N. (Kiev SUX) Schegolev Viktor A. (Moskovskaya SUX) Chernoi, Welder\s trainer.
※ AI-Helper는 부적절한 답변을 할 수 있습니다.