[특허]Real time multi dimensional image fusing

The Boeing Company

검색어에 아래의 연산자를 사용하시면 더 정확한 검색결과를 얻을 수 있습니다.
검색연산자

검색도움말
검색연산자	기능	검색시 예
()	우선순위가 가장 높은 연산자	예1) (나노 (기계 \| machine))
공백	두 개의 검색어(식)을 모두 포함하고 있는 문서 검색	예1) (나노 기계) 예2) 나노 장영실
\|	두 개의 검색어(식) 중 하나 이상 포함하고 있는 문서 검색	예1) (줄기세포 \| 면역) 예2) 줄기세포 \| 장영실
!	NOT 이후에 있는 검색어가 포함된 문서는 제외	예1) (황금 !백금) 예2) !image
*	검색어의 *란에 0개 이상의 임의의 문자가 포함된 문서 검색	예) semi*
""	따옴표 내의 구문과 완전히 일치하는 문서만 검색	예) "Transform and Quantization"

과학기술 지식인프라 ScienceON

연합인증

연합인증 가입 기관의 연구자들은 소속기관의 인증정보(ID와 암호)를 이용해 다른 대학, 연구기관, 서비스 공급자의 다양한 온라인 자원과 연구 데이터를 이용할 수 있습니다.

이는 여행자가 자국에서 발행 받은 여권으로 세계 각국을 자유롭게 여행할 수 있는 것과 같습니다.

연합인증으로 이용이 가능한 서비스는 NTIS, DataON, Edison 등이 있습니다.

한번의 인증절차만으로 연합인증 가입 서비스에 추가 로그인 없이 이용이 가능합니다.

다만, 연합인증을 위해서는 최초 1회만 인증 절차가 필요합니다. (회원이 아닐 경우 회원 가입이 필요합니다.)

연합인증 절차는 다음과 같습니다.

최초이용시에는
ScienceON에 로그인 → 연합인증 서비스 접속 → 로그인 (본인 확인 또는 회원가입) → 서비스 이용

그 이후에는
ScienceON 로그인 → 연합인증 서비스 접속 → 서비스 이용

연합인증을 활용하시면 KISTI가 제공하는 다양한 서비스를 편리하게 이용하실 수 있습니다.

특허 상세정보

MyON담기

내보내기 페이스북 공유 트위터 공유 카카오톡 공유

Real time multi dimensional image fusing

특허상세정보
국가/구분	United States(US) Patent 등록
국제특허분류(IPC7판)	G01C-021/26 G01C-021/36 G01C-023/00 G01S-017/87 H04N-005/33 G01S-017/89 G02B-027/01
출원번호	US-0644315 (2015-03-11)
등록번호	US-9715016 (2017-07-25)
발명자 / 주소	Allen, Robert C. Blanton, Brendan Gresko, Lauren Mitra, Rajib Vincent, Frank
출원인 / 주소	The Boeing Company
대리인 / 주소	McDonnell Boehnen Hulbert & Berghoff LLP
인용정보	피인용 횟수 : 1 인용 특허 : 2

초록
▼

Within examples, systems and methods of generating a synthetic image representative of an environment of a vehicle are described comprising generating a first image using infrared information from an infrared (IR) camera, generating a second image using laser point cloud data from a LIDAR, generating an embedded point cloud representative of the environment based on a combination of the first image and the second image, receiving navigation information traversed by the vehicle, transforming the embedded point cloud into a geo-referenced coordinate space ...

대표
청구항
▼

1. A method of generating a synthetic image representative of an environment of a vehicle, the method comprising: generating a first image of the environment using infrared information from an infrared (IR) camera on the vehicle;generating a second image of the environment using laser point cloud data from a light detection and ranging (LIDAR) on the vehicle;for each laser data point of the laser point cloud data from the LIDAR, projecting the laser data point into a corresponding pixel location of the first image so as to map the laser point cloud data onto the first image;based on mapping the laser point cloud data onto the first image, generating an embedded point cloud representative of the environment based on a combination of the first image and the second image such that additional data is embedded into the laser point cloud data;receiving navigation information of the environment traversed by the vehicle from data stored in a navigation database;transforming the embedded point cloud into a geo-referenced coordinate space based on the navigation information; andcombining the transformed embedded point cloud with imagery of terrain of the environment to generate the synthetic image representative of the environment of the vehicle. 2. The method of claim 1, wherein the first image, the second image, and the navigation information are each generated and received at approximately the same point in time. 3. The method of claim 1, wherein transforming the embedded point cloud data into the geo-referenced coordinate space based on the navigation information comprises: adjusting the embedded point cloud data according to the IR camera and LIDAR attitude and linear offsets relative a navigation system of the vehicle, wherein adjustments are made using six degree of freedom (DOF) platform data including latitude, longitude, altitude, heading, pitch, and roll from the navigation system of the vehicle. 4. The method of claim 1, wherein combining the transformed embedded point cloud with imagery of terrain of the environment comprises: overlaying an image of the terrain onto the transformed embedded point cloud. 5. The method of claim 1, further comprising displaying the synthetic image of the terrain of the environment on a multi-function display (MFD) of the vehicle. 6. The method of claim 1, further comprising displaying the synthetic image of the terrain of the environment on a head mounted display (HMD). 7. The method of claim 1, further comprising performing the method in real-time as the infrared information is received from the IR camera and the laser point cloud data is received from the LIDAR during operation of the vehicle traversing the environment. 8. The method of claim 1, further comprising, while the vehicle is traversing the environment: receiving the infrared information from the IR camera;receiving the laser point cloud data from the LIDAR;receiving the navigation information from a navigation system on the vehicle;performing the method in real-time to generate the synthetic image representative of the environment of the vehicle while the vehicle is traversing the environment; anddisplaying the synthetic image of the terrain of the environment on a display of the vehicle. 9. The method of claim 1, further comprising: generating the synthetic image based on the vehicle operating in a degraded visual environment (DVE) including near-zero to zero visibility conditions. 10. The method of claim 1, further comprising: determining a level of obscuration of the embedded point cloud; andadjusting parameters of one or more of the IR camera and the LIDAR on the vehicle based on the level of obscuration for adaptive feedback control of sensor parameters. 11. The method of claim 1, further comprising: storing the infrared information from the IR camera and the laser point cloud data from the LIDAR into a dataset;determining, as data of the infrared information from the IR camera and the laser point cloud data from the LIDAR is received, whether the data indicates additional spatial resolution of a representation of the environment;based on the data indicating the additional spatial resolution, generating a new higher resolution data point in the dataset; andbased on the data not indicating the additional spatial resolution, evaluating the data for update. 12. The method of claim 11, wherein determining whether the data indicates additional spatial resolution of the representation of the environment comprises: determining whether the data is of an alternate range or viewpoint to a targeted object or area. 13. The method of claim 11, wherein determining whether the data indicates additional spatial resolution of the representation of the environment comprises: determining sensor measurement accuracy, wherein the sensor measurement accuracy is based on a level of obscuration of the environment. 14. A non-transitory computer readable medium having stored thereon instructions that, upon executed by a computing device, cause the computing device to perform functions comprising: generating a first image of the environment using infrared information collected from an infrared (IR) camera on an vehicle;generating a second image of the environment using laser point cloud data collected from a light detection and ranging (LIDAR) on the vehicle;for each laser data point of the laser point cloud data from the LIDAR, projecting the laser data point into a corresponding pixel location of the first image so as to map the laser point cloud data onto the first image;based on mapping the laser point cloud data onto the first image, generating an embedded point cloud representative of the environment based on a combination of the first image and the second image such that additional data is embedded into the laser point cloud data;receiving navigation information of the environment traversed by the vehicle from data stored in a navigation database;transforming the embedded point cloud into a geo-referenced coordinate space based on the navigation information; andcombining the transformed embedded point cloud with imagery of terrain of the environment to generate the synthetic image representative of the environment of the vehicle. 15. The non-transitory computer readable medium of claim 14, wherein combining the transformed embedded point cloud with imagery of terrain of the environment comprises: overlaying an image of the terrain onto the transformed embedded point cloud. 16. The non-transitory computer readable medium of claim 14, further comprising performing the functions in real-time as the infrared information is received from the IR camera and the laser point cloud data is received from the LIDAR during operation of the vehicle traversing the environment. 17. A system comprising: an infrared (IR) camera to collect infrared information of an environment of an vehicle;a light detection and ranging (LIDAR) to collect laser point cloud data of the environment of the vehicle;a navigation system configured to determine navigation information of the vehicle;a processor to generate a synthetic representation of the environment of the vehicle, in real-time while the vehicle is traversing the environment, based on outputs of the IR camera, the LIDAR, and the navigation system, wherein generation of the synthetic representation comprises: for each laser data point of the laser point cloud data from the LIDAR, projecting the laser data point into a corresponding pixel location of the first image so as to map the laser point cloud data onto the first image;based on mapping the laser point cloud data onto the first image, generating an embedded point cloud representative of the environment based on a combination of the infrared information and the laser point cloud data such that additional data is embedded into the laser point cloud data;combining the embedded point cloud with imagery of terrain of the environment; anda display to display the synthetic image of the terrain of the environment on a display of the vehicle. 18. The system of claim 17, wherein the processor is further configured to generate the synthetic representation based on the vehicle operating in a degraded visual environment (DVE) including near-zero to zero visibility conditions. 19. The system of claim 17, wherein the processor is further configured to: determine a level of obscuration of the embedded point cloud; andadjust parameters of one or more of the IR camera and the LIDAR on the vehicle based on the level of obscuration for adaptive feedback control of sensor parameters.

이 특허에 인용된 특허 (2)

이 특허를 인용한 특허 (1)

Ganille, Thierry; Aymeric, Bruno; Lux, Johanna, Method of synthetic representation of elements of interest in a viewing system for aircraft.

IPC 상위 출원인

내보내기

상세정보
내보내기 구분	파일저장 인쇄 메일전송
구성항목	관리번호, 국가코드, 자료구분, 상태, 출원번호, 출원일자, 공개번호, 공개일자, 등록번호, 등록일자, 발명명칭(한글), 발명명칭(영문), 출원인(한글), 출원인(영문), 출원인코드, 대표IPC 관리번호, 국가코드, 자료구분, 상태, 출원번호, 출원일자, 공개번호, 공개일자, 공고번호, 공고일자, 등록번호, 등록일자, 발명명칭(한글), 발명명칭(영문), 출원인(한글), 출원인(영문), 출원인코드, 대표출원인, 출원인국적, 출원인주소, 발명자, 발명자E, 발명자코드, 발명자주소, 발명자 우편번호, 발명자국적, 대표IPC, IPC코드, 요약, 미국특허분류, 대리인주소, 대리인코드, 대리인(한글), 대리인(영문), 국제공개일자, 국제공개번호, 국제출원일자, 국제출원번호, 우선권, 우선권주장일, 우선권국가, 우선권출원번호, 원출원일자, 원출원번호, 지정국, Citing Patents, Cited Patents
저장형식	Text(ASCII format) Excel format PIAS분석(.xls)
메일정보	받는사람 (필수) @ 보내는사람 (선택) @ 제목 내용 KISTI 검색결과 이메일 서비스
안내	> 총 건의 자료가 검색되었습니다. > 다운받으실 자료의 인덱스를 입력하세요. (1-10,000) > 검색결과의 순서대로 최대 10,000건 까지 다운로드가 가능합니다. > 데이타가 많을 경우 속도가 느려질 수 있습니다.(최대 2~3분 소요) > 다운로드 파일은 UTF-8 형태로 저장됩니다. 파일의 내용이 제대로 보이지 않을실 때는 웹브라우저 상단의 보기 -> 인코딩 -> 자동선택 여부를 확인하십시오 > ~ > Text(ASCII format) Excel format

과학기술 지식인프라 ScienceON

ScienceON Chatbot

연합인증

특허 상세정보

Real time multi dimensional image fusing

초록
▼

대표
청구항
▼

이 특허에 인용된 특허 (2)

이 특허를 인용한 특허 (1)

IPC 상위 출원인

과제정보

상세정보조회

원문조회

IPC 상세정보(version : 201201)

연구과제 성과물(0)

참여연구원의 다른 문헌(0)

처리중입니다.

잠시만 기다려주세요.

ScienceON Chatbot

연합인증

특허 상세정보

Real time multi dimensional image fusing

초록 ▼

대표청구항 ▼

이 특허에 인용된 특허 (2)

이 특허를 인용한 특허 (1)

IPC 상위 출원인

과제정보

상세정보조회

원문조회

IPC 상세정보(version : 201201)

연구과제 성과물(0)

참여연구원의 다른 문헌(0)

처리중입니다.

잠시만 기다려주세요.

초록
▼

대표
청구항
▼