An image processing apparatus generates a plurality of parallactic images having a relationship that the magnitude of an amount of image shift between parallactic images increases with an increase of a defocus amount, generates, through plural selections of the generated parallactic images permittin
An image processing apparatus generates a plurality of parallactic images having a relationship that the magnitude of an amount of image shift between parallactic images increases with an increase of a defocus amount, generates, through plural selections of the generated parallactic images permitting a repeated same selection, a series of parallactic images in which the selected parallactic images are arranged in a selection order; repeatedly applies interpolation processing to each pair of adjacent parallactic images included in the series of parallactic images to generate a plurality of interpolation images; and arranges the interpolation images between the adjacent parallactic images to output the interpolated parallactic images as an output image of a moving image.
대표청구항▼
1. An image processing apparatus comprising: a generation unit which generates at least a first parallactic image, a second parallactic image, and a third parallactic image, wherein the first parallactic image, the second parallactic image, and the third parallactic image each corresponds to each im
1. An image processing apparatus comprising: a generation unit which generates at least a first parallactic image, a second parallactic image, and a third parallactic image, wherein the first parallactic image, the second parallactic image, and the third parallactic image each corresponds to each image formed by light passing through different pupil areas; andan output unit which repeatedly outputs the first parallactic image, the second parallactic image, and the third parallactic image in order, wherein the parallax between the first parallactic image and the second parallactic image is smaller than the parallax between the first parallactic image and the third parallactic image. 2. The image processing apparatus according to claim 1, wherein the generation unit selects the generated parallactic images such that the first parallactic image of a parallactic image series and a last parallactic image are the same. 3. The image processing apparatus according to claim 1, wherein the generation unit selects the generated parallactic images such that the pupil areas corresponding to adjacent parallactic images are adjacent to each other. 4. The image processing apparatus according to claim 1, further comprising an interpolation processing unit which repeatedly applies interpolation processing to each pair of adjacent parallactic images while changing weighting in a stepwise manner. 5. The image processing apparatus according to claim 1, wherein the output unit outputs the parallactic images as movie image. 6. An image pickup apparatus comprising: a focusing optical system;an image pickup unit in which pixels that receive light passing through different pupil areas of the focusing optical system are arranged; andthe image processing apparatus according to claim 1. 7. The image pickup apparatus according to claim 6, wherein the pixel has a plurality of sub-pixels receiving light passing through different pupil areas of the focusing optical system, and the generation unit generates the parallactic images from an output of the sub-pixel corresponding to each pupil area. 8. The image pickup apparatus according to claim 7, wherein the sub-pixels are two-dimensionally arranged. 9. A display device comprising: a display unit; andthe image processing apparatus according to claim 1. 10. A control method of an image processing apparatus, comprising the steps of: generating at least a first parallactic image, a second parallactic image, and a third parallactic image, wherein the first parallactic image, the second parallactic image, and the third parallactic image each corresponds to each image formed by light passing through different pupil areas; andrepeatedly outputting the first parallactic image, the second parallactic image, and the third parallactic image in order, wherein the parallax between the first parallactic image and the second parallactic image is smaller than the parallax between the first parallactic image and the third parallactic image. 11. An image processing apparatus comprising: a first generation unit which generates at least a first parallactic image, a second parallactic image, and a third parallactic image, wherein the first parallactic image, the second parallactic image, and the third parallactic image each corresponds to each image formed by light passing through different pupil areas;a second generation unit which generates a first interpolation image which is based on the first parallactic image and the second parallactic image, and generates a second interpolation image which is based on the second parallactic image and the third parallactic image; andan output unit which outputs the first parallactic image, the first interpolation image, the second parallactic image, the second interpolation image and the third parallactic image in order, wherein the parallax between the first parallactic image and second parallactic image is smaller than the parallax between the first parallactic image and the third parallactic image. 12. The image processing apparatus according to claim 11, wherein the generation unit selects the generated parallactic images such that the first parallactic image of a parallactic image series and a last parallactic image are the same. 13. The image processing apparatus according to claim 11, wherein the generation unit selects the generated parallactic images such that the pupil areas corresponding to adjacent parallactic images are adjacent to each other. 14. The image processing apparatus according to claim 11, further comprising an interpolation processing unit which repeatedly applies interpolation processing to each pair of adjacent parallatic images while changing weighting in a stepwise manner. 15. The image processing apparatus according to claim 11, wherein the output unit outputs the parallactic images as movie image. 16. An image pickup apparatus comprising: a focusing optical system;an image pickup unit in which pixels that receive light passing through different pupil areas of the focusing optical system are arranged; andthe image processing apparatus according to claim 11. 17. The image pickup apparatus according to claim 16, wherein the pixel has a plurality of sub-pixels receiving light passing through different pupil areas of the focusing optical system, and the first generation unit generates the parallactic images from an output of the sub-pixel corresponding to each pupil area. 18. The image pickup apparatus according to claim 17, wherein the sub-pixels are two-dimensionally arranged. 19. A display device comprising: a display unit; andthe image processing apparatus according to claim 11. 20. A control method of an image processing apparatus, comprising the steps of: generating at least a first parallactic image, a second parallactic image, and a third parallactic image, wherein the first parallactic image, the second parallactic image, and the third parallactic image each corresponds to each image formed by light passing through different pupil areas;generating a first interpolation image which is based on the first parallactic image and the second parallactic image, and generating a second interpolation image which is based on the second parallactic image and the third parallactic image; andoutputting the first parallactic image, the first interpolation image, the second parallactic image, the second interpolation image, and the third parallactic image in order, wherein the parallax between the first parallactic image and the second parallactic image is smaller than the parallax between the first parallactic image and the third parallactic image.
연구과제 타임라인
LOADING...
LOADING...
LOADING...
LOADING...
LOADING...
이 특허에 인용된 특허 (26)
Knight, Timothy J.; Pitts, Colvin; Ng, Yi-Ren; Fishman, Alex, 3D light field cameras, images and files, and methods of using, operating, processing and viewing same.
Hoda, Saori; Rengakuji, Hideyuki; Homma, Yoshihiro, Image capturing apparatus and control method therefor having pixel signals for focus detection and pixel signals for image recording.
Hoda, Saori; Rengakuji, Hideyuki; Homma, Yoshihiro, Image capturing apparatus and control method therefor with defect correction information used both for defective pixel and detection pixel identification.
Nagashima, Michiyoshi; Imada, Katsumi; Nishiwaki, Seiji, Imaging apparatus and method for producing the same, portable equipment, and imaging sensor and method for producing the same.
Fukuda, Koichi, Image processing apparatus, image pickup apparatus, image processing method, and non-transitory computer-readable storage medium for generating an image based on plurality of parallax images.
※ AI-Helper는 부적절한 답변을 할 수 있습니다.