Method and tool for post-mortem analysis of tripped field devices in process industry using optical character recognition and intelligent character recognition
원문보기
IPC분류정보
국가/구분
United States(US) Patent
등록
국제특허분류(IPC7판)
G06K-009/34
G06K-009/00
G06T-011/60
출원번호
US-0008282
(2016-01-27)
등록번호
US-9779293
(2017-10-03)
발명자
/ 주소
Kumar, Jammikunta Ravi
Kumar, Amit
출원인 / 주소
Honeywell International Inc.
인용정보
피인용 횟수 :
0인용 특허 :
6
초록▼
A method includes capturing at least one screenshot of a display screen including an initial screenshot. The method includes removing text from the initial screenshot to generate a base image. The method includes identifying a background of the initial screenshot as a closed region. The method inclu
A method includes capturing at least one screenshot of a display screen including an initial screenshot. The method includes removing text from the initial screenshot to generate a base image. The method includes identifying a background of the initial screenshot as a closed region. The method includes, for each of the at least one screenshots: storing a time of capturing the screenshot; identifying text, text color, and text location in the screenshot; identifying each closed region in the screenshot that is different from the background of the initial screenshot, and a region color and region location for each identified closed region in the screenshot; storing the region color and the region location for each identified closed region; and storing the text color and the text location of the identified text.
대표청구항▼
1. A method comprising: capturing at least one screenshot of a display screen including an initial screenshot;removing text from the initial screenshot to generate a base image;identifying a background of the initial screenshot as a closed region; andfor each of the at least one screenshot: storing
1. A method comprising: capturing at least one screenshot of a display screen including an initial screenshot;removing text from the initial screenshot to generate a base image;identifying a background of the initial screenshot as a closed region; andfor each of the at least one screenshot: storing a time of capturing the screenshot;identifying text, text color, and text location in the screenshot;identifying each closed region in the screenshot that is different from the background of the initial screenshot, and a region color and region location for each identified closed region in the screenshot;storing the region color and the region location for each identified closed region; andstoring the text color and the text location of the identified text. 2. The method of claim 1, further comprising generating at least one new image as a reconstruction of the at least one captured screenshot by, for each new image: retrieving the base image; andin correspondence to one of the at least one captured screenshots and its stored time of capturing: retrieving the region color and the region location for each identified region, and the text color and the text location of the identified text;applying the retrieved region color to each region of the base image at the retrieved region location; andoverlapping the retrieved base image with the text in the retrieved text color at the retrieved text location. 3. The method of claim 1, further comprising: identifying a new image exhibiting a peculiarity, wherein the peculiarity includes at least one of: a change of field device data by at least a threshold amount, or a field device data operating outside an operating limit; andgenerating a user interface display screen highlighting the peculiarity. 4. The method of claim 1, wherein capturing the at least one screenshot of the display screen comprises: periodically capturing an additional screenshot according to a specified interval of time. 5. The method of claim 1, wherein: identifying the region color for each identified closed region in the screenshot further comprises: normalizing each unevenly colored region to a uniform color; andstoring the region color for each identified closed region further comprises: storing the normalized region color corresponding to the identified region. 6. The method of claim 1, further comprising: identifying each closed region within an identified region as a sub-region; andassigning a region identification to each identified region and sub-region using a tree structure. 7. The method of claim 1, further comprising: dividing the screenshot into a grid;determining the text location according to the grid; anddetermining the region location according to the grid. 8. The method of claim 7, wherein dividing the screenshot into the grid comprises one of: applying a coordinate system to the screenshot; ordividing the screenshot into a set of blocks arranged in rows and columns. 9. An apparatus comprising: a memory; andat least one processor coupled to the memory, the at least one processor configured to:capture at least one screenshot of a display screen including an initial screenshot;remove text from the initial screenshot to generate a base image;identify a background of the initial screenshot as a closed region; andfor each of the at least one screenshot: store a time of capturing the screenshot in the memory;identify text, text color, and text location in the screenshot;identify each closed region in the screenshot that is different from the background of the initial screenshot, and a region color and region location for each identified closed region in the screenshot;store, in the memory, the region color and the region location for each identified closed region; andstore, in the memory, the text color and the text location of the identified text. 10. The apparatus of claim 9, wherein the at least one processor is further configured to generate at least one new image as a reconstruction of the at least one captured screenshot by, for each new image: retrieving the base image; andin correspondence to one of the at least one captured screenshots and its stored time of capturing: retrieving the region color and the region location for each identified region, and the text color and the text location of the identified text;applying the retrieved region color to each region of the base image at the retrieved region location; andoverlapping the retrieved base image with the text in the retrieved text color at the retrieved text location. 11. The apparatus of claim 9, wherein the at least one processor is further configured to: identify a new image exhibiting a peculiarity, wherein the peculiarity includes at least one of: a change of field device data by at least a threshold amount, or a field device data operating outside an operating limit; andgenerate a user interface display screen highlighting the peculiarity. 12. The apparatus of claim 9, wherein the at least one processor is further configured to capture the at least one screenshot of the display screen by: periodically capturing an additional screenshot according to a specified interval of time. 13. The apparatus of claim 9, wherein the at least one processor is further configured to: identify the region color for each identified closed region in the screenshot by normalizing each unevenly colored region to a uniform color; andstore the region color for each identified closed region by storing the normalized region color corresponding to the identified region. 14. The apparatus of claim 9, wherein the at least one processor is further configured to: identify each closed region within an identified region as a sub-region; andassign a region identification to each identified region and sub-region using a tree structure. 15. A non-transitory computer readable medium embodying a computer program, the computer program comprising computer readable program code that, when executed by processing circuitry, causes the processing circuitry to: capture at least one screenshot of a display screen including an initial screenshot;remove text from the initial screenshot to generate a base image;identify a background of the initial screenshot as a closed region; andfor each of the at least one screenshot: store a time of capturing the screenshot in memory;identify text, text color, and text location in the screenshot;identify each closed region in the screenshot that is different from the background of the initial screenshot, and a region color and region location for each identified closed region in the screenshot;store the region color and the region location for each identified closed region; andstore the text color and the text location of the identified text. 16. The non-transitory computer readable medium of claim 15, wherein the computer program further comprises computer readable program code that, when executed by the processing circuitry, causes the processing circuitry to: generate at least one new image as a reconstruction of the at least one captured screenshot by, for each new image: retrieving the base image; andin correspondence to one of the at least one captured screenshots and its stored time of capturing: retrieving the region color and the region location for each identified region, and the text color and the text location of the identified text;applying the retrieved region color to each region of the base image at the retrieved region location; andoverlapping the retrieved base image with the text in the retrieved text color at the retrieved text location. 17. The non-transitory computer readable medium of claim 15, wherein the computer program further comprises computer readable program code that, when executed by the processing circuitry, causes the processing circuitry to: identify a new image exhibiting a peculiarity, wherein the peculiarity includes at least one of: a change of field device data by at least a threshold amount, or a field device data operating outside an operating limit; andgenerate a user interface display screen highlighting the peculiarity. 18. The non-transitory computer readable medium of claim 15, wherein the computer program further comprises computer readable program code that, when executed by the processing circuitry, causes the processing circuitry to: capture the at least one screenshot of the display screen by periodically capturing an additional screenshot according to a specified interval of time. 19. The non-transitory computer readable medium of claim 15, wherein the computer program further comprises computer readable program code that, when executed by the processing circuitry, causes the processing circuitry to: identify the region color for each identified closed region in the screenshot by normalizing each unevenly colored region to a uniform color; andstore the region color for each identified closed region by storing the normalized region color corresponding to the identified region. 20. The non-transitory computer readable medium of claim 15, wherein the computer program further comprises computer readable program code that, when executed by the processing circuitry, causes the processing circuitry to: identify each closed region within an identified region as a sub-region; andassign a region identification to each identified region and sub-region using a tree structure.
연구과제 타임라인
LOADING...
LOADING...
LOADING...
LOADING...
LOADING...
이 특허에 인용된 특허 (6)
Tandon, Vibhor; Anne, Gowtham, Apparatus for automating field device operations by capturing device method execution steps for later use and related method.
Guenther, Robert; Zuponcic, Steven A.; Hall, Kenwood H., Capturing data during operation of an industrial controller for the debugging of control programs.
Venditti, Paul; Brahmavar, Ramesh Pai; Srivastava, Ayush; Skalyo, Michael Scott; McCarthy, Kevin Thomas, Systems and methods for control reliability operations.
※ AI-Helper는 부적절한 답변을 할 수 있습니다.