초록 ▼

A mobile communications device with an integrated camera is directed towards text. A video stream is analyzed in real time to detect one or more words in a specified region of the video frames and to indicate the detected words on a display. Users can select a word in a video stream and subsequently

A mobile communications device with an integrated camera is directed towards text. A video stream is analyzed in real time to detect one or more words in a specified region of the video frames and to indicate the detected words on a display. Users can select a word in a video stream and subsequently move or extend the initial selection. It is thus possible to select multiple words. A subregion of the video frame comprising the detected word(s) is pre-processed and compressed before being sent to a remote optical character recognition (OCR) function which may be integrated in an online service such as an online search service.

대표청구항 ▼

The invention claimed is: 1. A computer-implemented method comprising: receiving, at a camera associated with a mobile communications device, a video stream comprising at least one image comprising text; defining, at a processor, a designated display area in the image; and detecting, via the proces

The invention claimed is: 1. A computer-implemented method comprising: receiving, at a camera associated with a mobile communications device, a video stream comprising at least one image comprising text; defining, at a processor, a designated display area in the image; and detecting, via the processor, a subregion of the image comprising a word in the designated display area, the process of detecting the subregion comprising using a first thresholding process; displaying the received image on the mobile communications device and indicating the detected subregion on the display of the image; applying, via the processor, a second thresholding process to the detected subregion, that second thresholding process being different from the first thresholding process, to produce a processed subregion; sending information about the processed subregion to a remote entity comprising optical character recognition functionality. 2. The computer-implemented method as claimed in claim 1 which further comprises repeating the step of detecting a subregion, and the step of displaying the received image and indicating the detected subregion on the display of that image, for subsequent frames of the video stream in real time. 3. The computer-implemented method as claimed in claim 1 wherein the second thresholding process is carried out on a subregion of a still image rather than a video frame of a real time video stream. 4. The computer-implemented method as claimed in claim 1 wherein the step of displaying the received image on the mobile communications device and indicating the detected subregion on the display of the image further comprises receiving a user input indicating acceptance of the detected subregion and additionally monitoring for user input indicating requirements to modify the detected subregion. 5. The computer-implemented method as claimed in claim 2 wherein the step of detecting a subregion of the image comprising a word in the designated display area, comprises computing information about a bounding box for that subregion in a current video frame, and wherein the method further comprises, for a subsequent video frame, shifting the designated display area on the basis of the computed information about the bounding box. 6. The computer-implemented method as claimed in claim 5 wherein the computed information about the bounding box comprises the position of the centre of that bounding box. 7. The computer-implemented method as claimed in claim 2 wherein the first thresholding process comprises using a specified threshold which is adjusted for each video frame on the basis of information about the detected subregion for that video frame. 8. The computer-implemented method as claimed in claim 1 wherein the first thresholding process comprises assessing an image element with respect to its neighboring image elements. 9. The computer-implemented method as claimed in claim 1 wherein the second thresholding process comprises using a threshold which is dynamically selected on the basis of information about potential text elements detected after using various thresholds. 10. A mobile communications device comprising: a camera arranged to receive a video stream, the video stream comprising at least one image comprising text; and a processor arranged to define a designated display area in the image; the processor being arranged to detect a subregion of the image comprising a word in the designated display area, the process of detecting the subregion comprising using a first thresholding process; a display arranged to display the received image and indicate the detected subregion on the display of the image; the processor being arranged to apply a second thresholding process to the detected subregion, that second thresholding process being different from the first thresholding process, to produce a processed subregion; an output arranged to send information about the processed subregion to a remote entity comprising optical character recognition functionality. 11. A mobile communications device as claimed in claim 10 wherein the processor is arranged to repeat the step of detecting a subregion, and the step of displaying the received image and to indicate the detected subregion on the display of that image, for subsequent frames of the video stream in real time. 12. A mobile communications device as claimed in claim 10 wherein the processor is arranged to carry out the second thresholding process on a subregion of a still image rather than a video frame of a real time video stream. 13. A mobile communications device as claimed in claim 10 which further comprises a user interface arranged to receive a user input indicating acceptance of the detected subregion and wherein the processor is arranged to monitor for user input indicating requirements to modify the detected subregion. 14. A mobile communications device as claimed in claim 11 wherein the processor is arranged to compute information about a bounding box for the subregion in a current video frame, and wherein the processor is arranged, for a subsequent video frame, to shift the designated display area on the basis of the computed information about the bounding box. 15. A mobile communications device as claimed in claim 14 wherein the processor is arranged to adjust a specified threshold used in the first thresholding process for each video frame on the basis of information about the detected subregion for that video frame. 16. One or more computer-readable media with computer-executable instructions for performing acts comprising: receiving a video stream at a camera associated with a mobile communications device, the video stream comprising at least one image comprising text; defining a designated display area in the image; and detecting a subregion of the image comprising a word in the designated display area, the process of detecting the subregion comprising using a first thresholding process displaying the received image on the mobile communications device and indicating the detected subregion on the display of the image; applying a second thresholding process to the detected subregion, that second thresholding process being different from the first thresholding process, to produce a processed subregion; sending information about the processed subregion to a remote entity comprising optical character recognition functionality.