Method and apparatus for block-based compression of light-field images
원문보기
IPC분류정보
국가/구분
United States(US) Patent
등록
국제특허분류(IPC7판)
G06K-009/36
G06K-009/46
G06T-015/50
출원번호
US-0111735
(2008-04-29)
등록번호
US-8155456
(2012-04-10)
발명자
/ 주소
Babacan, Sevket Derin
Georgiev, Todor G.
출원인 / 주소
Adobe Systems Incorporated
대리인 / 주소
Kowert, Robert C.
인용정보
피인용 횟수 :
27인용 특허 :
33
초록▼
A method and apparatus for the block-based compression of light-field images. Light-field images may be preprocessed by a preprocessing module into a format that is compatible with the blocking scheme of a block-based compression technique, for example JPEG. The compression technique is then used to
A method and apparatus for the block-based compression of light-field images. Light-field images may be preprocessed by a preprocessing module into a format that is compatible with the blocking scheme of a block-based compression technique, for example JPEG. The compression technique is then used to compress the preprocessed light-field images. The light-field preprocessing module reshapes the angular data in a captured light-field image into shapes compatible with the blocking scheme of the compression technique so that blocking artifacts of block-based compression are not introduced in the final compressed image. Embodiments may produce compressed 2D images for which no specific light-field image viewer is needed to preview the full light-field image. Full light-field information is contained in one compressed 2D image.
대표청구항▼
1. A computer-implemented method, comprising: obtaining a light-field image, wherein the light-field image comprises a plurality of microimages, wherein the dimensions of the microimages are different than blocking dimensions used by a block-based compression technique;generating a plurality of bloc
1. A computer-implemented method, comprising: obtaining a light-field image, wherein the light-field image comprises a plurality of microimages, wherein the dimensions of the microimages are different than blocking dimensions used by a block-based compression technique;generating a plurality of blocks in a preprocessed light-field image from the plurality of microimages in the light-field image, wherein each block in the preprocessed light-field image contains light-field information from at least one microimage in the light-field image, and wherein the dimensions of each block in the preprocessed light-field image are the same as the blocking dimensions used by the block-based compression technique;wherein, to generate a block in the preprocessed light-field image, the method further comprises applying a cropping technique to light-field information from at least one microimage, applying an interpolation technique to light-field information from at least one microimage, or applying a cropping technique followed by an interpolation technique to light-field information from at least one microimage;compressing the preprocessed light-field image in accordance with the block-based compression technique to generate a compressed light-field image; andstoring the compressed light-field image to a storage medium. 2. The method as recited in claim 1, wherein said generating a plurality of blocks in a preprocessed light-field image from the microimages in the light-field image comprises, for each microimage: cropping the microimage to extract a region of pixels from the microimage, wherein the dimensions of the cropped region are smaller than the dimensions of the block in the preprocessed light-field image; andinterpolating the cropped region of pixels to generate pixel values for the pixels in a corresponding block in the preprocessed light-field image from the pixel values of the pixels in the cropped region. 3. The method as recited in claim 2, wherein said interpolating the cropped region of pixels comprises solving the Laplace equation to generate the pixel values for the pixels in the corresponding block from the pixel values of the pixels in the cropped region. 4. The method as recited in claim 1, wherein the dimensions of the blocks in the preprocessed light-field image are eight pixels by eight pixels. 5. The method as recited in claim 1, further comprising, prior to said generating a plurality of blocks in a preprocessed light-field image from the plurality of microimages in the light-field image, normalizing the light-field image in accordance with a calibration image. 6. The method as recited in claim 1, wherein the light-field image is captured with a plenoptic camera, wherein each microimage is approximately circular, and wherein each block in the preprocessed light-field image contains light-field information from a single corresponding microimage in the light-field image. 7. The method as recited in claim 6, further comprising, prior to said generating a plurality of blocks in a preprocessed light-field image from each microimage the microimages in the light-field image: locating each microimage in the light-field image; andextracting the located microimages from the light-field image. 8. The method as recited in claim 1, wherein said generating a plurality of blocks in a preprocessed light-field image from the microimages in the light-field image comprises: generating an intermediate image comprising blocks from the microimages in the light-field image, wherein said generating the intermediate image comprises, for each pixel location in each microimage, extracting a pixel from the pixel location and placing the pixel in a block of the intermediate image at a pixel location in the block corresponding to the current microimage's location in the light-field image, wherein the dimensions of the blocks in the intermediate image are different than the blocking dimensions used by the block-based compression technique; andgenerating the plurality of blocks in the preprocessed light-field image from the blocks in the intermediate image, wherein each block in the preprocessed light-field image contains light-field information from a corresponding block in the intermediate image, and wherein the dimensions of each block in the preprocessed light-field image are the same as the blocking dimensions used by the block-based compression technique. 9. The method as recited in claim 1, further comprising displaying the compressed light-field image using an application that is configured to open and display files compressed using the block-based compression technique. 10. A system, comprising: at least one processor; anda memory comprising program instructions, wherein the program instructions are executable by the at least one processor to: obtain a light-field image, wherein the light-field image comprises multiple a plurality of microimages, wherein the dimensions of the microimages are different than blocking dimensions used by a block-based compression technique;generate a plurality of blocks in a preprocessed light-field image from the plurality of microimages in the light-field image, wherein each block contains light-field information from at least one microimage in the light-field image, and wherein the dimensions of each block n the preprocessed light-field image are the same as the blocking dimensions used by the block-based compression technique;wherein, to generate a block in the preprocessed light-field image, the program instructions are executable by the at least one processor to apply a cropping technique to light-field information from at least one microimage, apply an interpolation technique to light-field information from at least one microimage, or apply a cropping technique followed by an interpolation technique to light-field information from at least one microimage;compress the preprocessed light-field image in accordance with the block-based compression technique to generate a compressed light-field image; andstore the compressed light-field image to a storage device. 11. The system as recited in claim 10, wherein, to generate a plurality of blocks in a preprocessed light-field image from each the microimages in the light-field image, the program instructions are executable by the at least one processor to, for each microimage: crop the microimage to extract a region of pixels from the microimage, wherein the dimensions of the cropped region are smaller than the dimensions of the block in the preprocessed light-field image; andinterpolate the cropped region of pixels to generate pixel values for the pixels in a corresponding block in the preprocessed light-field image from the pixel values of the pixels in the cropped region. 12. The system as recited in claim 11, wherein, to interpolate the cropped region of pixels, the program instructions are executable by the at least one processor to solve the Laplace equation to generate the pixel values for the pixels in the corresponding block from the pixel values of the pixels in the cropped region. 13. The system as recited in claim 10, wherein the dimensions of the blocks in the preprocessed light-field image are eight pixels by eight pixels. 14. The system as recited in claim 10, wherein the program instructions are executable by the at least one processor to, prior to said generate a plurality of blocks in a preprocessed light-field image from the plurality of microimages in the light-field image, normalize the light-field image in accordance with a calibration image for the light-field camera. 15. The system as recited in claim 10, wherein the light-field image is captured with a plenoptic camera, wherein each microimage is approximately circular, and wherein each block in the preprocessed light-field image contains light-field information from a single corresponding microimage in the light-field image. 16. The system as recited in claim 15, wherein the program instructions are executable by the at least one processor to, prior to said generate a plurality of blocks in a preprocessed light-field image from the microimages in the light-field image: locate each microimage in the light-field image; andextract the located microimages from the light-field image. 17. The system as recited in claim 10, wherein, to generate a plurality of blocks in a preprocessed light-field image from the microimages in the light-field image, the program instructions are executable by the at least one processor to: generate an intermediate image comprising blocks from the microimages in the light-field image, wherein, to generate the intermediate image, the program instructions are executable by the at least one processor to, for each pixel location in each microimage, extract a pixel from the pixel location and place the pixel in a block of the intermediate image at a pixel location in the block corresponding to the current microimage's location in the light-field image, wherein the dimensions of the blocks in the intermediate image are different than the blocking dimensions used by the block-based compression technique; andgenerate the plurality of blocks in the preprocessed light-field image from the blocks in the intermediate image, wherein each block in the preprocessed light-field image contains light-field information from a corresponding block in the intermediate image, and wherein the dimensions of each block in the preprocessed light-field image are the same as the blocking dimensions used by the block-based compression technique. 18. A non-transitory computer-readable storage medium storing program instructions, wherein the program instructions are computer-executable to implement: obtaining a light-field image, wherein the light-field image comprises a plurality of microimages, wherein the dimensions of the microimages are different than blocking dimensions used by a block-based compression technique;generating a plurality of blocks in a preprocessed light-field image from the plurality of microimages in the light-field image, wherein each block contains light-field information from at least one microimage in the light-field image, and wherein the dimensions of each block in the preprocessed light-field image are the same as the blocking dimensions used by the block-based compression technique;wherein, to generate a block in the preprocessed light-field image, the program instructions are computer-executable to implement applying a cropping technique to light-field information from at least one microimage, applying an interpolation technique to light-field information from at least one microimage, or applying a cropping technique followed by an interpolation technique to light-field information from at least one microimage;compressing the preprocessed light-field image in accordance with the block-based compression technique to generate a compressed light-field image; andstoring the compressed light-field image to a storage medium. 19. The non-transitory computer-readable storage medium as recited in claim 18, wherein, in said generating a plurality of blocks in a preprocessed light-field image from the microimages in the light-field image, the program instructions are computer-executable to implement, for each microimage: cropping the microimage to extract a region of pixels from the microimage, wherein the dimensions of the cropped region are smaller than the dimensions of the block in the preprocessed light-field image; andinterpolating the cropped region of pixels to generate pixel values for the pixels in a corresponding block in the preprocessed light-field image from the pixel values of the pixels in the cropped region. 20. The non-transitory computer-readable storage medium as recited in claim 19, wherein, in said interpolating the cropped region of pixels, the program instructions are computer-executable to implement solving the Laplace equation to generate the pixel values for the pixels in the corresponding block from the pixel values of the pixels in the cropped region. 21. The non-transitory computer-readable storage medium as recited in claim 18, wherein the dimensions of the blocks in the preprocessed light-field image are eight pixels by eight pixels. 22. The non-transitory computer-readable storage medium as recited in claim 18, wherein the program instructions are computer-executable to implement, prior to said generating a plurality of blocks in a preprocessed light-field image from the plurality of microimages in the light-field image, normalizing the light-field image in accordance with a calibration image for the light-field camera. 23. The non-transitory computer-readable storage medium as recited in claim 18, wherein the light-field image is captured with a plenoptic camera, wherein each microimage is approximately circular, and wherein each block in the preprocessed light-field image contains light-field information from a single corresponding microimage in the light-field image. 24. The non-transitory computer-readable storage medium as recited in claim 23, wherein the program instructions are computer-executable to implement, prior to said generating a plurality of blocks in a preprocessed light-field image from the microimages in the light-field image: locating each microimage in the light-field image; andextracting the located microimages from the light-field image. 25. The non-transitory computer-readable storage medium as recited in claim 18, wherein, in said generating a plurality of blocks in a preprocessed light-field image from the microimages in the light-field image, the program instructions are computer-executable to implement: generating an intermediate image comprising blocks from the microimages in the light-field image, wherein, in said generating the intermediate image, the program instructions are computer-executable to implement, for each pixel location in each microimage, extracting a pixel from the pixel location and placing the pixel in a block of the intermediate image at a pixel location in the block corresponding to the current microimage's location in the light-field image, wherein the dimensions of the blocks in the intermediate image are different than the blocking dimensions used by the block-based compression technique; andgenerating the plurality of blocks in the preprocessed light-field image from the blocks in the intermediate image, wherein each block in the preprocessed light-field image contains light-field information from a corresponding block in the intermediate image, and wherein the dimensions of each block in the preprocessed light-field image are the same as the blocking dimensions used by the block-based compression technique.
연구과제 타임라인
LOADING...
LOADING...
LOADING...
LOADING...
LOADING...
이 특허에 인용된 특허 (33)
Georgiev Todor, 3D graphics based on images and morphing.
Yamagata, Michihiro; Okayama, Hiroaki; Boku, Kazutake; Tanaka, Yasuhiro; Hayashi, Kenichi; Fushimi, Yoshimasa; Murata, Shigeki; Hayashi, Takayuki, Imaging device including a plurality of lens elements and a imaging sensor.
de Montebello Roger L. (New York NY) Globus Ronald P. (New York NY) Buck Howard S. (New York NY), Integral photography apparatus and method of forming same.
Knight, Timothy James; Pitts, Colvin; Ng, Yi-Ren; Fishman, Alex; Romanenko, Yuriy; Kalt, Jeff; Akeley, Kurt Barton, Light-field processing and analysis, camera control, and user interfaces and interaction on light-field capture devices.
Georgiev, Todor G.; Chunev, Georgi N., Methods and apparatus for rendering output images with simulated artistic effects from focused plenoptic camera data.
Georgiev, Todor G.; Lumsdaine, Andrew, Methods, apparatus, and computer-readable storage media for depth-based rendering of focused plenoptic camera data.
※ AI-Helper는 부적절한 답변을 할 수 있습니다.