Face detection as a metric to stabilize video during video chat session
원문보기
IPC분류정보
국가/구분
United States(US) Patent
등록
국제특허분류(IPC7판)
H04N-007/14
G06F-015/16
G06K-009/00
출원번호
US-0634927
(2009-12-10)
등록번호
US-8416277
(2013-04-09)
발명자
/ 주소
Yeh, Michael V.
출원인 / 주소
Apple Inc.
대리인 / 주소
Kenyon & Kenyon LLP
인용정보
피인용 횟수 :
3인용 특허 :
21
초록▼
A handheld communication device is used to capture a video and stabilize the video during a video chat session. The device has a camera to capture a video during a video chat session that is conducted between a user of the device and a far-end user. The video includes images frames, each of the imag
A handheld communication device is used to capture a video and stabilize the video during a video chat session. The device has a camera to capture a video during a video chat session that is conducted between a user of the device and a far-end user. The video includes images frames, each of the image frames containing an image of a face of the user. The device detects the position of the face in each image frame. Based on the detected position of the face, a boundary area of each image frame is cropped to produce an output video while the video is being captured. The image of the face stays substantially stationary in the output video. The output video is transmitted to the far-end user during the video chat session. Other embodiments are also described and claimed.
대표청구항▼
1. A method for operating a handheld communication device, the method comprising: capturing a video during a video chat session conducted between a user of the handheld communication device and a far-end user, the video captured with a camera integrated within a housing of the handheld communication
1. A method for operating a handheld communication device, the method comprising: capturing a video during a video chat session conducted between a user of the handheld communication device and a far-end user, the video captured with a camera integrated within a housing of the handheld communication device, the video comprising a plurality of images frames, each of the image frames containing an image of a face of the user;based on a detected position of the face in each image frame, cropping a boundary area of the image frame to produce an output video such that the image of the face stays substantially stationary in the output video;displaying the output video via a display device integrated within the housing on a common side of the device as the camera, andtransmitting the output video to the far-end user during the video chat session. 2. The method of claim 1, further comprising: maintaining the image of the face at a user-selectable fixed position in each of a plurality of output frames of the output video. 3. The method of claim 1, further comprising: for each image frame, calculating a motion vector between the detected position of the face and a reference position of the face; anddetermining the boundary area to be cropped based on the motion vector. 4. The method of claim 1, further comprising: determining whether a size of the boundary area to be cropped exceeds an available margin; andin response to a determination that the size of the boundary area exceeds the available margin, generating a warning to the user. 5. The method of claim 1, further comprising: maintaining the image of the face substantially stationary in the output video while the user is moving. 6. The method of claim 1, further comprising: receiving and displaying a video transmitted from the far-end user while the output video is transmitted to the far-end user during the video chat session. 7. A method for operating a handheld communication device, the method comprising: capturing a video during a video chat session conducted between a user of the handheld communication device and a far-end user, the video captured with a camera integrated within a housing of the handheld communication device, the video comprising a plurality of images frames, each of the image frames containing an image of a face of the user;based on a detected position of the face in each image frame, cropping a boundary area of the image frame to produce an output video such that the image of the face stays substantially stationary in the output video; wherein the boundary area comprises a top margin, a bottom margin, a right margin and a left margin, the cropping comprising determining a size of each of the top margin, the bottom margin, the right margin and the left margin to substantially center the image of the face in the output video; andtransmitting the output video to the far-end user during the video chat session. 8. A handheld communication device comprising: a camera to capture a video during a video chat session conducted between a user of the handheld communication device and a far-end user, the video comprising a plurality of images frames, each of the image frames containing an image of a face of the user;a single housing within which the camera is integrated on a same side as a display screen;a video processing module within the single housing to detect a position of the face in each image frame, to determine a window area in each image frame based on a detected position of the face, and to crop margins outside the window area during the video chat session, to produce an output video in which the image of the face stays substantially stationary; anda communication network interface to transmit the output video to the far-end user during the video chat session. 9. The handheld communication device of claim 8, further comprising: a user interface that provides one or more options for the user to select a fixed position in an output frame as the position of the face in the output video. 10. The handheld communication device of claim 8, wherein the video processing module comprises: a frame cropping unit to determine a size of the margins, which include a top margin, a bottom margin, a right margin and a left margin, to substantially center the image of the face in the output video. 11. The handheld communication device of claim 8, wherein the video processing module comprises: a motion detection unit to calculate a motion vector between the detected position of the face in a current image frame and a reference position of the face in a previous image frame. 12. The handheld communication device of claim 8, wherein the video processing module comprises: a warning module to generate a warning to the user when a movement of the face in one of the image frames exceeds an available margin. 13. The handheld communication device of claim 8, further comprising: a display screen to display a received video from the far-end user while the output video is transmitted to the far-end user during the video chat session. 14. An article of manufacture comprising a machine-readable storage medium having stored therein instructions that program a handheld communication device to capture, with a camera integrated within a housing of the handheld communication device, a video during a video chat session conducted between a user of the handheld communication device and a far-end user, the video comprising a plurality of images frames, each of the image frames containing an image of a face of the user;for each image frame, determine a position of a window that contains the image of the face such that the image of the face stays substantially stationary within the window area;for each image frame, crop a boundary area defined by areas outside the window to produce an output frame of an output video; anddisplay, by a display device integrated within the housing on a common side of the device as the camera, the output video, andtransmit the output video to the far-end user during the video chat session. 15. The article of manufacture of claim 14, wherein the instructions further program the communication device to maintain the image of the face at a user-selectable fixed position in each of a plurality of output frames of the output video. 16. The article of manufacture of claim 14, wherein the instructions further program the communication device to calculate a motion vector between a detected position of the face and a reference position of the face; and determine the boundary area to be cropped based on the motion vector. 17. The article of manufacture of claim 14, wherein the instructions further program the communication device to generate a warning to the user when the movement of the face exceeds an available margin. 18. The article of manufacture of claim 14, wherein the instructions further program the communication device to maintain the image of the face substantially stationary in the output video while the user is moving. 19. The article of manufacture of claim 14, wherein the instructions further program the communication device to receive and display a video received from the far-end user while the output video is transmitted to the far-end user during the video chat session. 20. An article of manufacture comprising a machine-readable storage medium having stored therein instructions that program a handheld communication device to capture, with a camera integrated within a housing of the handheld communication device, a video during a video chat session conducted between a user of the handheld communication device and a far-end user, the video comprising a plurality of images frames, each of the image frames containing an image of a face of the user;for each image frame, determine a position of a window that contains the image of the face such that the image of the face stays substantially stationary within the window area;for each image frame, crop a boundary area defined by areas outside the window to produce an output frame of an output video by determining a size of the boundary area, which includes a top margin, a bottom margin, a right margin and a left margin, to substantially center the image of the face in the output video; andtransmit the output video to the far-end user during the video chat session.
※ AI-Helper는 부적절한 답변을 할 수 있습니다.