Systems and methods for real-time virtual-reality immersive multimedia communications
원문보기
IPC분류정보
국가/구분
United States(US) Patent
등록
국제특허분류(IPC7판)
H04N-007/15
H04N-007/14
H04N-005/265
출원번호
US-0105723
(2011-05-11)
등록번호
US-9143729
(2015-09-22)
발명자
/ 주소
Anand, Raghavan
Periyannan, Alagu
출원인 / 주소
Blue Jeans Networks, Inc.
대리인 / 주소
Ascenda Law Group, PC
인용정보
피인용 횟수 :
15인용 특허 :
48
초록▼
A new approach is proposed that contemplates systems and methods to support the operation of a Virtual Media Room or Virtual Meeting Room (VMR), wherein each VMR can accept from a plurality of participants at different geographic locations a variety of video conferencing feeds of audio and video str
A new approach is proposed that contemplates systems and methods to support the operation of a Virtual Media Room or Virtual Meeting Room (VMR), wherein each VMR can accept from a plurality of participants at different geographic locations a variety of video conferencing feeds of audio and video streams from video conference endpoints. The approach further utilizes virtual reality and augmented-reality techniques to transform the video and audio streams from the participants in various customizable ways to achieve a rich set of user experiences. A globally distributed infrastructure supports the sharing of the event among the participants at geographically distributed locations through a plurality of MCUs (Multipoint Control Unit), each configured to process the plurality of audio and video streams from the plurality of video conference endpoints in real time.
대표청구항▼
1. A method, comprising: accepting a plurality of audio and video streams from a plurality of video conference endpoints, wherein each of the video conference endpoints are associated with one of a plurality of participants to a video conference, and wherein the video conference endpoints are of dif
1. A method, comprising: accepting a plurality of audio and video streams from a plurality of video conference endpoints, wherein each of the video conference endpoints are associated with one of a plurality of participants to a video conference, and wherein the video conference endpoints are of different types;automatically determining the required type of conversion between the plurality of endpoints based on video conference service provider-specific combinations of video encoding format, audio encoding format, video encoding profile, video encoding level, communication protocol video resolution screen ratio bitrate for an audio stream bitrate for a video stream encryption standard, and acoustic consideration of the respective video conference feeds of each of the plurality of video conference endpoints;for each of the participants to the video conference, (i) converting and composing, in real-time, the plurality of audio and video streams into a composite audio and video stream which is compatible with all of the different video conference endpoints, and (ii) rendering the composite audio and video stream at each of the different video conference endpoints;for each of the composite audio and video streams, (i) building a composite metadata field from a metadata field associated with each of the video streams and (ii) utilizing information from the composite metadata field to transcode and process the composite audio and video stream;enabling the video conference in real-time among the participants; andsupporting real-time human translator-free multimedia communications during the video conference by simultaneously translating, in real-time, the audio streams between different languages into a preferred language of each participant to the video conference and simultaneously providing the translations to each participant in only the preferred language of the respective participant so as to allow the participants to speak to each other in their respective preferred languages during the video conference. 2. The method of claim 1, further comprising: supporting translation from speech-to-visual for speech-initiated services. 3. The method of claim 1, further comprising: providing the participants with device-independent control over the video conference via interfaces so that the control of the video conference is independent of the video conference endpoints of different types. 4. The method of claim 1, wherein at least one endpoint is associated with a proprietary videoconferencing service, and at least one other endpoint is associated with a different proprietary videoconferencing service, or a standards-based videoconferencing service. 5. A non-transitory machine-readable storage medium comprising software instructions that, when executed by a processor, cause the processor to: accept a plurality of audio and video streams from a plurality of video conference endpoints, wherein each of the video conference endpoints are associated with one of a plurality of participants to a video conference, and wherein the video conference endpoints are of different types;automatically determine the required type of conversion between the plurality of endpoints based on video conference service provider-specific combinations of video encoding format, audio encoding format, video encoding profile, video encoding level, communication protocol video resolution screen ratio bitrate for an audio stream bitrate for a video stream encryption standard, and acoustic consideration of the respective video conference feeds of each of the plurality of video conference endpoints;for each of the participants to the video conference, (i) convert and compose, in real-time, the plurality of audio and video streams into a composite audio and video stream which is compatible with all of the different video conference endpoints, and (ii) render the composite audio and video stream at each of the different video conference endpoints;for each of the composite audio and video streams, (i) build a composite metadata field from a metadata field associated with each of the video streams and (ii) utilize information from the composite metadata field to transcode and process the composite audio and video stream;enable the video conference in real-time among the participants; andsupport real-time human translator-free multimedia communications during the video conference by simultaneously translating, in real-time, the audio streams between different languages into a preferred language of each participant to the video conference and simultaneously providing the translations to each participant in only the preferred language of the respective participant so as to allow the participants to speak to each other in their respective preferred languages during the video conference. 6. The machine-readable storage medium of claim 5, wherein at least one endpoint is associated with a proprietary videoconferencing service, and at least one other endpoint is associated with a different proprietary videoconferencing service, or a standards-based videoconferencing service.
연구과제 타임라인
LOADING...
LOADING...
LOADING...
LOADING...
LOADING...
이 특허에 인용된 특허 (48)
Saito Makoto,JPX, Apparatus for data copyright management system.
Srinivasan, Sudharshan; Kumar, Jai; Ramchandran, Kothandraman, Instant help security system for emergency help using 2G, 2.5G and 3G cellular wirelesses half duplex call.
Rosenfeld, Daniel A.; Liu, Zicheng; Cutler, Ross G.; Chou, Philip A.; Huitema, Christian; Quinn, Kori, Interest determination for auditory enhancement.
De Lind Van Wijngaarden, Adriaan J.; Erman, Bilgehan; Katkar, Vanita K; Matthews, Elissa P.; Sharp, Ronald L., Method and apparatus for the efficient transmission of multimedia streams for teleconferencing.
Lee, Seung-Youl; Jang, One-Hark; Joo, Bong-Nam; Kim, Hak-Jun, Method for controlling user interface menu, and mobile terminal and device for providing application service using the same.
Takeda, Yukiko; Tanabe, Shiro; Yang, Peng; Deng, Hui; Ma, Yuanchen; Ikeda, Hiroki, Method of implementing multi-party conference service by using broadcast/multicast service of a wireless communications system.
Nelson,Steve; Ivashin,Victor; Miceli,Sean; Boskovic,Ronald, Multi-participant conference system with controllable content delivery using a client monitor back-channel.
Lukacs Michael Edward (25 Wanamassa Point Rd. Ocean Township NJ 07712), Real time video conferencing system and method with multilayer keying of multiple video images.
Dhanoa, Shingara Singh; Paterik, Thomas Lee; Panpaliya, Monika Kishor, Script server for efficiently providing multimedia services in a multimedia system.
Agapi, Ciprian; Bodin, William K.; Cross, Jr., Charles W.; Goodman, Brian D.; Jania, Frank L.; Shaw, Darren M., Signaling correspondence between a meeting agenda and a meeting discussion.
Firestone,Scott S.; Friedrich,Walter R.; Ismail,Nermin M.; Lantz,Keith A.; Sarkar,Shantanu; Surazski,Luke K.; Wu,Duanpei, System and method for performing distributed video conferencing.
de Lind van Wijngaarden, Adriaan J.; Erman, Bilgehan; Katkar, Vanita K.; Matthews, Elissa P., System to freely configure video conferencing camera placement.
Forstadius, Antti, System, method and computer program product for providing content to a terminal and directing the rendering of such content at the terminal.
Periyannan, Alagu; Anand, Raghavan; Grupenhoff, Michael; Kalluri, Ravi Kiran; Weber, Emmanuel, Systems and methods for scalable composition of media streams for real-time multimedia communication.
Periyannan, Alagu; Anand, Raghavan; Grupenhoff, Michael; Kalluri, Ravi Kiran; Weber, Emmanuel; Villait, Anil, Systems and methods for scalable distributed global infrastructure for real-time multimedia communication.
Bregman Susan P. (Atlanta GA) Greenstein Sandra S. (Atlanta GA) Mayland Tina E. (Roswell GA) McCloskey John M. (Roswell GA) Ratzel Stephen R. (Marietta GA), Video conference system including a non-reserved video conference capability.
Scott, Mark David; Foltz, Mark Alan; Dresner, Kurt Mauro; Parker, Adam, Simplified projection of content from computer or mobile devices into appropriate videoconferences.
※ AI-Helper는 부적절한 답변을 할 수 있습니다.