Systems and methods for iterative adjustment of video-capture settings based on identified persona
IPC분류정보
국가/구분
United States(US) Patent
등록
국제특허분류(IPC7판)
H04N-005/235
H04N-005/232
H04N-005/243
H04N-007/14
G06T-007/73
G06T-007/11
G06T-007/143
G06T-007/194
G06K-009/00
출원번호
US-0339274
(2016-10-31)
등록번호
US-9942481
(2018-04-10)
발명자
/ 주소
Venshtain, Simion
Patel, Sanjay
Lin, Dennis J.
출원인 / 주소
Personify, Inc.
대리인 / 주소
Invention Mine LLC
인용정보
피인용 횟수 :
0인용 특허 :
116
초록▼
Disclosed herein are systems and methods for iterative adjustment of video-capture settings based on identified persona. In an embodiment, a method includes receiving video frames that are being captured by a video camera of an ongoing scene. The method also includes identifying a persona in one or
Disclosed herein are systems and methods for iterative adjustment of video-capture settings based on identified persona. In an embodiment, a method includes receiving video frames that are being captured by a video camera of an ongoing scene. The method also includes identifying a persona in one or more of the received frames at least in part by identifying, in each such frame, a set of pixels classified as being representative of the persona. The method also includes selecting, based collectively on the brightness values of the pixels in the identified set, a respective adjustment command for one or more adjustable video-capture settings of the camera, as well as outputting the selected commands to the camera for use in continuing to capture video data representative of the ongoing scene.
대표청구항▼
1. A method comprising: receiving frames of video data that are being captured by a video camera and that are representative of an ongoing scene, the video camera having one or more adjustable video-capture settings;identifying a persona in one or more of the received frames at least in part by iden
1. A method comprising: receiving frames of video data that are being captured by a video camera and that are representative of an ongoing scene, the video camera having one or more adjustable video-capture settings;identifying a persona in one or more of the received frames at least in part by identifying, in each such frame, a set of pixels classified as being representative of the persona;selecting, based collectively on brightness values of the pixels in the identified set, a respective adjustment command for one or more of the adjustable video-capture settings; andoutputting the selected adjustment commands to the video camera for use by the video camera in continuing to capture video data representative of the ongoing scene. 2. The method of claim 1, wherein identifying a set of pixels classified as being representative of the persona in a given frame comprises: obtaining a binary alpha mask for the given frame, the binary alpha mask having a first data value associated with each pixel that is in the given frame and that is classified as being representative of the persona, the binary alpha mask having a second data value associated with each pixel that is in the given frame and that is not classified as being representative of the persona, the second data value being different than the first; andconfiguring the identified set of pixels for the given frame to include only those pixels that are associated with the first data value in the corresponding binary alpha mask. 3. The method of claim 2, wherein the first data value is 1 (one), and wherein the second data value is 0 (zero). 4. The method of claim 2, wherein obtaining the binary alpha mask for the given frame comprises generating the binary alpha mask by processing image-depth data of the given frame. 5. The method of claim 2, wherein obtaining the binary alpha mask for the given frame comprises receiving the binary alpha mask from a video processor that generated the binary alpha mask by processing image-depth data of the given frame. 6. The method of claim 1, wherein selecting, based collectively on brightness values of the pixels in the identified set, a respective adjustment command for one or more of the adjustable video-capture settings comprises: generating a statistical model reflecting a distribution of said brightness values along a brightness spectrum; andselecting a respective adjustment command for one or more of the adjustable video-capture settings based at least in part on the statistical model. 7. The method of claim 6, wherein the statistical model comprises a histogram. 8. The method of claim 6, wherein identifying a set of pixels classified as being representative of the persona in a given frame comprises: generating a binary alpha mask for the given frame by processing image-depth data of the given frame, the binary alpha mask having a first data value associated with each pixel that is in the given frame and that is classified as being representative of the persona, the binary alpha mask having a second data value associated with each pixel that is in the given frame and that is not classified as being representative of the persona, the second data value being different than the first; andconfiguring the identified set of pixels for the given frame to include only those pixels that are associated with the first data value in the corresponding binary alpha mask. 9. The method of claim 1, wherein the one or more adjustable video-capture settings include one or more video-capture settings selected from the group consisting of exposure, aperture, shutter speed, frame rate, gain, analog gain, digital gain, zoom, optical zoom, and digital zoom. 10. The method of claim 1, further comprising selecting, based at least in part on the pixels in the identified set, a respective adjustment command for one or more video-processing settings. 11. The method of claim 10, wherein the one or more video-processing settings include one or more video-processing settings selected from the group consisting of white balance, contrast, gain, vibrance, hue, saturation, color temperature, and sharpness. 12. The method of claim 1, wherein the video camera has an associated application programming interface (API), and wherein selecting one or more of the adjustment commands comprises selecting one or more of the adjustment commands from the API. 13. The method of claim 1, wherein at least one of the selected adjustment commands specifies a particular value for the corresponding adjustable video-capture setting. 14. The method of claim 1, wherein at least one of the selected adjustment commands specifies a relative change to the corresponding adjustable video-capture setting. 15. A video-capture controller comprising: a frame-receiving module configured to receive frames of video data that are being captured by a video camera and that are representative of an ongoing scene, the video camera having one or more adjustable video-capture settings;a persona-identification module configured to identify a persona in one or more of the received frames at least in part by identifying, in each such frame, a set of pixels classified as being representative of the persona;a video-capture-adjustment module configured to select, based collectively on brightness values of the pixels in the identified set, a respective adjustment command for one or more of the adjustable video-capture settings; anda command-output module configured to output the selected adjustment commands to the video camera for use by the video camera in continuing to capture video data representative of the ongoing scene. 16. The video-capture controller of claim 15, wherein the persona-identification module is further configured to a set of pixels classified as being representative of the persona in a given frame at least in part by: obtaining a binary alpha mask for the given frame, the binary alpha mask having a first data value associated with each pixel that is in the given frame and that is classified as being representative of the persona, the binary alpha mask having a second data value associated with each pixel that is in the given frame and that is not classified as being representative of the persona, the second data value being different than the first; andconfiguring the identified set of pixels for the given frame to include only those pixels that are associated with the first data value in the corresponding binary alpha mask. 17. The video-capture controller of claim 15, wherein the video-capture-adjustment module is further configured to select a respective adjustment command for one or more of the adjustable video-capture settings at least in part by: generating a statistical model reflecting a distribution of said brightness values along a brightness spectrum; andselecting a respective adjustment command for one or more of the adjustable video-capture settings based at least in part on the statistical model. 18. The video-capture controller of claim 15, wherein the one or more adjustable video-capture settings include one or more video-capture settings selected from the group consisting of exposure, aperture, shutter speed, frame rate, gain, analog gain, digital gain, zoom, optical zoom, and digital zoom. 19. The video-capture controller of claim 15, wherein the video camera has an associated application programming interface (API), and wherein selecting one or more of the adjustment commands comprises selecting one or more of the adjustment commands from the API. 20. The video-capture controller of claim 15, wherein at least one of the selected adjustment commands specifies either (i) a particular value for or (ii) a relative change to the corresponding adjustable video-capture setting.
연구과제 타임라인
LOADING...
LOADING...
LOADING...
LOADING...
LOADING...
이 특허에 인용된 특허 (116)
Cipolla Roberto (Cambridge GBX) Okamoto Yasukazu (Chiba-ken JPX) Kuno Yoshinori (Osaka-fu JPX), 3D human interface apparatus using motion recognition based on dynamic image processing.
Panahpour Tehrani, Mehrdad; Ishikawa, Akio; Sakazawa, Shigeyuki, Apparatus, method and computer program for classifying pixels in a motion picture as foreground or background.
Clanton,Charles H.; Ventrella,Jeffrey J.; Paiz,Fernando J., Cinematic techniques in avatar-centric communication during a multi-user online simulation.
DeMenthon Daniel F. (Columbia MD), Computer vision system for position monitoring in three dimensions using non-coplanar light sources attached to a monito.
Tian, Dihong; Mauchly, J. William; Friel, Joseph T., Generating and rendering synthesized views with multiple video streams in telepresence video conference sessions.
Iwamoto, Masayuki; Fujimura, Koichi, Image processing apparatus, method for processing and image and computer-readable recording medium for causing a computer to process images.
Carter, James; Yaacob, Arik; Darrah, James F., Managing the layout of multiple video streams displayed on a destination display screen during a videoconference.
Bang, Gun; Um, Gi-Mun; Chang, Eun-Young; Kim, Taeone; Hur, Nam-Ho; Kim, Jin-Woong; Lee, Soo-In, Method and apparatus for improving quality of depth image.
Yeh Hwa-Young M ; Lure Yuan-Ming F ; Lin Jyh-Shyan, Method and system for re-screening nodules in radiological images using multi-resolution processing, neural network, and image processing.
Berman Arie ; Vlahos Paul ; Dadourian Arpag, Method for removing from an image the background surrounding a selected subject by generating candidate mattes.
Colmenarez, Antonio J.; Gutta, Srinivas, Person tagging in an image processing system utilizing a statistical model based on both appearance and geometric features.
Haskell, Barin Geoffry; Puri, Atul; Schmidt, Robert Lewis, Scene description nodes to support improved chroma-key shape representation of coded arbitrary images and video objects.
Mackie, David J.; Tian, Dihong; Weir, Andrew P.; Buttimer, Maurice; Friel, Joseph T.; Mauchly, J. William; Chen, Wen-Hsiung, System and method for providing enhanced video processing in a network environment.
Prahlad, Anand; Schwartz, Jeremy A.; Ngo, David; Brockway, Brian; Muller, Marcus S., Systems and methods for classifying and transferring information in a storage network.
Weiser, Reginald; McGravie, Richard; Diouskine, Roman; Teboul, Jeremy, Systems and methods for providing video conferencing services via an ethernet adapter.
Rudolph, Eric; Rui, Yong; Malvar, Henrique S; He, Li Wei; Cohen, Michael F; Tashev, Ivan, Systems and methods for real-time audio-visual communication and data collaboration in a network conference environment.
※ AI-Helper는 부적절한 답변을 할 수 있습니다.