IPC분류정보
국가/구분 |
United States(US) Patent
등록
|
국제특허분류(IPC7판) |
|
출원번호 |
US-0130725
(2008-05-30)
|
등록번호 |
US-8244058
(2012-08-14)
|
발명자
/ 주소 |
- Intwala, Chintan
- Georgiev, Todor G.
|
출원인 / 주소 |
- Adobe Systems Incorporated
|
대리인 / 주소 |
|
인용정보 |
피인용 횟수 :
105 인용 특허 :
33 |
초록
▼
Various methods and apparatus for removing artifacts in frequency domain processing of light-field images are described. Methods for the reduction or removal of the artifacts are described that include methods that may be applied during frequency domain processing and a method that may be applied du
Various methods and apparatus for removing artifacts in frequency domain processing of light-field images are described. Methods for the reduction or removal of the artifacts are described that include methods that may be applied during frequency domain processing and a method that may be applied during post-processing of resultant angular views. The methods may be implemented in software as or in a light-field frequency domain processing module. The described methods include an oversampling method to determine the correct centers of slices, a phase multiplication method to determine the correct centers of slices, a method to exclude low-energy slices, and a cosmetic correction method.
대표청구항
▼
1. A computer-implemented method, comprising: processing a light-field image in the frequency domain to render multiple angular views of a scene, wherein, said processing comprises: extracting multiple slices from a Fourier transform of the light-field image; andrendering the multiple angular views
1. A computer-implemented method, comprising: processing a light-field image in the frequency domain to render multiple angular views of a scene, wherein, said processing comprises: extracting multiple slices from a Fourier transform of the light-field image; andrendering the multiple angular views from the slices in accordance with subpixel centers of the slices, wherein each subpixel center corresponds to the DC point of the analog signal underlying the respective slice, wherein rendering the multiple angular views from the slices in accordance with the subpixel centers of the slices prevents or lessens artifacts in the angular views;wherein said processing further comprises applying a technique to determine the subpixel centers for the slices, wherein the technique is one of an oversampling technique or a phase multiplication technique;wherein said oversampling technique comprises generating the Fourier transform as an oversampled Fourier transform of the light-field image and determining the subpixel centers from the slices extracted from the oversampled Fourier transform; andwherein said phase multiplication technique comprises iteratively applying phase multiplication to each slice to locate the DC point of the analog signal underlying the respective slice. 2. The method as recited in claim 1, wherein the angular views each represent a scene captured in the light-field image at a particular focal plane. 3. The method as recited in claim 1, wherein said generating the Fourier transform as an oversampled Fourier transform comprises padding the light-field image according to an oversampling rate and generating the Fourier transform from the padded light-field image. 4. The method as recited in claim 1, wherein, in said phase multiplication technique, (x, y) are pixel coordinates of an initial center for a respective slice and (δx, δy) are subpixel shifts for the pixel coordinates determined during said iterative phase multiplication, where |δx, δy|<1, and where (x+δx, y+δy) are coordinates of the subpixel center corresponding to the DC point of the analog signal underlying the respective slice. 5. The method as recited in claim 1, wherein said applying phase multiplication to each slice comprises multiplying the respective slice by the phase factor ⅇ-ⅈ(2πδxNx+2πδxMy) to locate the DC point of the analog signal underlying the respective slice, where (x, y) are pixel coordinates of an initial center for the respective slice and (δx, δy) are subpixel shifts for the pixel coordinates. 6. The method as recited in claim 1, wherein said rendering the multiple angular views from the slices comprises: determining a subset of the slices as low-energy slices; andexcluding the low-energy slices when generating the angular views from the slices. 7. The method as recited in claim 6, wherein the low-energy slices are slices that are closest to a center slice, wherein the center slice includes the DC point of the Fourier transform of the light-field image. 8. The method as recited in claim 1, further comprising: determining one of the angular views as a base view; andadjusting the pixel values in one or more of the other angular views according to the pixel values in the base view to generate cosmetically corrected angular views from the one or more of the other angular views. 9. The method as recited in claim 1, wherein said rendering the multiple angular views from the slices in accordance with the subpixel centers of the slices comprises, for each angular view to be generated: generating a stack including at least a portion of the slices, wherein the slices are aligned in the stack in accordance with the subpixel centers of the slices; andperforming an inverse Fourier transform on the stack to generate the angular view. 10. A system, comprising: at least one processor; anda memory comprising program instructions, wherein the program instructions are executable by the at least one processor to process a light-field image in the frequency domain to render multiple angular views of a scene, wherein, to process the light-field image, the program instructions are executable by the at least one processor to: extract multiple slices from a Fourier transform of the light-field image; andrender the multiple angular views from the slices in accordance with subpixel centers of the slices, wherein each subpixel center corresponds to the DC point of the analog signal underlying the respective slice, wherein rendering the multiple angular views from the slices in accordance with the subpixel centers of the slices prevents or lessens artifacts in the angular views;wherein, to process the light-field image, the program instructions are further executable by the at least one processor to apply a technique to determine the subpixel centers for the slices, wherein the technique is one of an oversampling technique or a phase multiplication technique;wherein said oversampling technique generates the Fourier transform as an oversampled Fourier transform of the light-field image and determines the subpixel centers from the slices extracted from the oversampled Fourier transform; andwherein said phase multiplication technique iteratively applies phase multiplication to each slice to locate the DC point of the analog signal underlying the respective slice. 11. The system as recited in claim 10, wherein the angular views each represent a scene captured in the light-field image at a particular focal plane. 12. The system as recited in claim 10, wherein, to generate the Fourier transform as an oversampled Fourier transform, the program instructions are executable by the at least one processor to pad the light-field image according to an oversampling rate and generate the Fourier transform from the padded light-field image. 13. The system as recited in claim 10, wherein, in said phase multiplication technique, (x, y) are pixel coordinates of an initial center for a respective slice and (δx, δy) are subpixel shifts for the pixel coordinates determined during said iterative phase multiplication, where |δx, δy|<1, and where (x+δx, y+δy) are coordinates of the subpixel center corresponding to the DC point of the analog signal underlying the respective slice. 14. The system as recited in claim 10, wherein, to apply phase multiplication to each slice, the program instructions are executable by the at least one processor to multiply the respective slice by the phase factor ⅇ-ⅈ(2πδxNx+2πδxMy) to locate the DC point of the analog signal underlying the respective slice, where (x, y) are pixel coordinates of an initial center for the respective slice and (δx, δy) are subpixel shifts for the pixel coordinates. 15. The system as recited in claim 10, wherein, to render the multiple angular views from the slices, the program instructions are executable by the at least one processor to: determine a subset of the slices as low-energy slices; andexclude the low-energy slices when generating the angular views from the slices. 16. The system as recited in claim 15, wherein the low-energy slices are slices that are closest to a center slice, wherein the center slice includes the DC point of the Fourier transform of the light-field image. 17. The system as recited in claim 10, wherein the program instructions are executable by the at least one processor to: determine one of the angular views as a base view; andadjust the pixel values in one or more of the other angular views according to the pixel values in the base view to generate cosmetically corrected angular views from the one or more of the other angular views. 18. The system as recited in claim 10, wherein, to render the multiple angular views from the slices in accordance with the subpixel centers of the slices, the program instructions are executable by the at least one processor to, for each angular view to be generated: generate a 2-dimensional (2-D) stack including at least a portion of the slices, wherein the slices are aligned in the stack in accordance with the subpixel centers of the slices; andperform an inverse four-dimensional (4-D) Fourier transform on the stack to generate the angular view. 19. A non-transitory computer-readable storage medium storing program instructions, wherein the program instructions are computer-executable to implement: processing a light-field image in the frequency domain to render multiple angular views of a scene, wherein, in said processing, the program instructions are computer-executable to implement: extracting multiple slices from a Fourier transform of the light-field image; andrendering the multiple angular views from the slices in accordance with subpixel centers of the slices, wherein each subpixel center corresponds to the DC point of the analog signal underlying the respective slice, wherein rendering the multiple angular views from the slices in accordance with the subpixel centers of the slices prevents or lessens artifacts in the angular views;wherein, in said processing, the program instructions are further computer-executable to implement applying a technique to determine the subpixel centers for the slices, wherein the technique is one of an oversampling technique or a phase multiplication technique;wherein said oversampling technique generates the Fourier transform as an oversampled Fourier transform of the light-field image and determines the subpixel centers from the slices extracted from the oversampled Fourier transform; andwherein said phase multiplication technique iteratively applies phase multiplication to each slice to locate the DC point of the analog signal underlying the respective slice. 20. The non-transitory computer-readable storage medium as recited in claim 18, wherein the angular views each represent a scene captured in the light-field image at a particular focal plane. 21. The non-transitory computer-readable storage medium as recited in claim 18, wherein, in said generating the Fourier transform as an oversampled Fourier transform, the program instructions are computer-executable to implement padding the light-field image according to an oversampling rate and generating the Fourier transform from the padded light-field image. 22. The non-transitory computer-readable storage medium as recited in claim 18, wherein, in said phase multiplication technique, (x, y) are pixel coordinates of an initial center for a respective slice and (δx, δy) are subpixel shifts for the pixel coordinates determined during said iterative phase multiplication, where |δx, δy|<1, and where (x+δx, y+δy) are coordinates of the subpixel center corresponding to the DC point of the analog signal underlying the respective slice. 23. The non-transitory computer-readable storage medium as recited in claim 18, wherein, in said applying phase multiplication to each slice, the program instructions are computer-executable to implement multiplying the respective slice by the phase factor ⅇ-ⅈ(2πδxNx+2πδxMy) to determine the DC point of the analog signal underlying the respective slice, where (x, y) are pixel coordinates of an initial center for the respective slice and (δx, δy) are subpixel shifts for the pixel coordinates. 24. The non-transitory computer-readable storage medium as recited in claim 18, wherein, in said rendering the multiple angular views from the slices, the program instructions are computer-executable to implement: determining a subset of the slices as low-energy slices; andexcluding the low-energy slices when generating the angular views from the slices. 25. The non-transitory computer-readable storage medium as recited in claim 24, wherein the low-energy slices are slices that are closest to a center slice, wherein the center slice includes the DC point of the Fourier transform of the light-field image. 26. The non-transitory computer-readable storage medium as recited in claim 18, wherein the program instructions are computer-executable to implement: determining one of the angular views as a base view;adjusting the pixel values in one or more of the other angular views according to the pixel values in the base view to generate cosmetically corrected angular views from the one or more of the other angular views. 27. The non-transitory computer-readable storage medium as recited in claim 18, wherein, in said rendering the multiple angular views of the scene from the slices in accordance with the subpixel centers of the slices, the program instructions are computer-executable to implement, for each angular view to be generated: generating a stack including at least a portion of the slices, wherein the slices are aligned in the stack in accordance with the determined subpixel centers of the slices; andperforming an inverse Fourier transform on the stack to generate the angular view.
※ AI-Helper는 부적절한 답변을 할 수 있습니다.