Kim, Jae-Gon
(Digital Broadcasting Division, ETRI)
,
Wang, Yong
(Department of Electrical Engineering, Columbia University)
,
Chang, Shih-Fu
(Department of Electrical Engineering, Columbia University)
,
Kim, Hyung-Myung
(Department of Electrical Engineering & Computer Science, KAIST)
The adaptation of video according to the heterogeneous and dynamic resource constraints on networks and devices, as well as on user preferences, is a promising approach for universal access and consumption of video content. For optimal adaptation that satisfies the constraints while maximizing the u...
The adaptation of video according to the heterogeneous and dynamic resource constraints on networks and devices, as well as on user preferences, is a promising approach for universal access and consumption of video content. For optimal adaptation that satisfies the constraints while maximizing the utility that results from the adapted video, it is necessary to devise a systematic way of selecting an appropriate adaptation operation among multiple feasible choices. This paper presents a general conceptual framework that allows the formulation of various adaptations as constrained optimization problems by modeling the relations among feasible adaptation operations, constraints, and utilities. In particular, we present the feasibility of the framework by applying it to a use case of rate adaptation of MPEG-4 video with an explicit modeling of adaptation employing a combination of frame dropping and discrete cosine transform coefficient dropping, constraint, utility, and their mapping relations. Furthermore, we provide a description tool that describes the adaptation-constraint-utility relations as a functional form referred to as a utility function, which has been accepted as a part of the terminal and network quality of service tool in MPEG-21 Digital Item Adaptation (DIA).
The adaptation of video according to the heterogeneous and dynamic resource constraints on networks and devices, as well as on user preferences, is a promising approach for universal access and consumption of video content. For optimal adaptation that satisfies the constraints while maximizing the utility that results from the adapted video, it is necessary to devise a systematic way of selecting an appropriate adaptation operation among multiple feasible choices. This paper presents a general conceptual framework that allows the formulation of various adaptations as constrained optimization problems by modeling the relations among feasible adaptation operations, constraints, and utilities. In particular, we present the feasibility of the framework by applying it to a use case of rate adaptation of MPEG-4 video with an explicit modeling of adaptation employing a combination of frame dropping and discrete cosine transform coefficient dropping, constraint, utility, and their mapping relations. Furthermore, we provide a description tool that describes the adaptation-constraint-utility relations as a functional form referred to as a utility function, which has been accepted as a part of the terminal and network quality of service tool in MPEG-21 Digital Item Adaptation (DIA).
* AI 자동 식별 결과로 적합하지 않은 문장이 있을 수 있으니, 이용에 유의하시기 바랍니다.
제안 방법
We present a rate adaptation transcoding of MPEG-4 videos employing the combination of FD and CD operations. Let us illustrate how this specific adaptation problem is formulated and how corresponding utility functions are generated with the definitions of the three spaces as a case study of the utilitybased approach.
Our experiments show promising performance gain as well as computational efficiency by using the utility-based adaptation. The method developed in this paper can also be applied to other scenarios of adaptation, for instance, adaptation of scalable video streams and optimal adaptation based on a subjective quality measurement.
The resource-utility relationships represent analogous but broader concepts than the R-D relationships. To illustrate the adaptation methods, we exemplify the implementation by employing the combination of FD and CD (referred to as FD-CD) on MPEG-4 (simple profile) compressed streams. Both methods can be efficiently implemented in the compressed domain by truncating parts of the compressed streams without full decoding.
Vetro, A., Christopoulos, C., Sun, Huifang.
Video transcoding architectures and techniques: an overview.
IEEE signal processing magazine,
vol.20,
no.2,
18-29.
Shanableh, T., Ghanbari, M..
Heterogeneous video transcoding to lower spatio-temporal resolutions and different encoding formats.
IEEE transactions on multimedia,
vol.2,
no.2,
101-110.
Fung, Kai-Tat, Chan, Yui-Lam, Siu, Wan-Chi.
New architecture for dynamic frame-skipping transcoder.
IEEE transactions on image processing : a publication of the IEEE Signal Processing Society,
vol.11,
no.8,
886-900.
Vetro, A., Sun, Huifang, Wang, Yao.
Object-based transcoding for adaptable video content delivery.
IEEE transactions on circuits and systems for video technology : a publication of the Circuits and Systems Society,
vol.11,
no.3,
387-401.
van der Schaar, M., Radha, H..
A hybrid temporal-SNR fine-granular scalability for Internet video.
IEEE transactions on circuits and systems for video technology : a publication of the Circuits and Systems Society,
vol.11,
no.3,
318-331.
Reed, E.C., Lim, J.S..
Optimal multidimensional bit-rate control for video communication.
IEEE transactions on image processing : a publication of the IEEE Signal Processing Society,
vol.11,
no.8,
873-885.
Kim, Jae-Gon, Chang, Hyun-Sung, Kim, Jin-Woong, Kim, Hyung-Myung.
Threshold-Based Camera Motion Characterization of MPEG Video.
ETRI journal,
vol.26,
no.3,
269-272.
Mukherjee, D., Delfosse, E., Kim, Jae-Gon, Wang, Yong.
Optimal adaptation decision-taking for terminal and network quality-of-service.
IEEE transactions on multimedia,
vol.7,
no.3,
454-462.
Luna, C.E., Kondi, L.P., Katsaggelos, A.K..
Maximizing user utility in video streaming applications.
IEEE transactions on circuits and systems for video technology : a publication of the Circuits and Systems Society,
vol.13,
no.2,
141-148.
Vetro, A., Timmerer, C..
Digital item adaptation: overview of standardization and research activities.
IEEE transactions on multimedia,
vol.7,
no.3,
418-426.
※ AI-Helper는 부적절한 답변을 할 수 있습니다.