Method for automatically assessing the quality of a dispensed beverage
원문보기
IPC분류정보
국가/구분
United States(US) Patent
등록
국제특허분류(IPC7판)
G06K-009/00
G06K-009/46
A47J-031/44
G06T-007/40
H04L-029/08
A47J-043/12
H04L-029/06
H04M-001/725
출원번호
US-0456220
(2017-03-10)
등록번호
US-10078792
(2018-09-18)
우선권정보
IT-102016000025716 (2016-03-11)
발명자
/ 주소
Penna, Salvatore
Vitillo, Antony
Volonté, Claudio
Comotti, Nicholas
출원인 / 주소
Gruppo Cimbali S.p.a.
대리인 / 주소
Seed IP Law Group LLP
인용정보
피인용 횟수 :
0인용 특허 :
4
초록▼
A method automatically evaluates the quality of milk foam dispensed by a machine for dispensing milk-based beverages through the analysis of an image of the free surface of the frothed milk contained in a container, wherein the analysis uses automatic procedures for processing images for identifying
A method automatically evaluates the quality of milk foam dispensed by a machine for dispensing milk-based beverages through the analysis of an image of the free surface of the frothed milk contained in a container, wherein the analysis uses automatic procedures for processing images for identifying and quantifying, in the processed image, a physical characteristic representative of the texture of the surface of the frothed milk and hence indicative of the quality of milk foam, the physical characteristic being the plurality of air bubbles.
대표청구항▼
1. A method of automatically assessing the quality of frothed milk foam in a milk-based beverage prepared by a dispensing machine, the method comprising: providing a beverage containing frothed milk within a container, the beverage having a free surface of frothed milk having a surface texture;defin
1. A method of automatically assessing the quality of frothed milk foam in a milk-based beverage prepared by a dispensing machine, the method comprising: providing a beverage containing frothed milk within a container, the beverage having a free surface of frothed milk having a surface texture;defining a plurality of reference classes representative of a foam quality level based on a surface texture of the frothed milk on the free surface, wherein the surface texture is described by air bubbles on the free surface, said classes being characterized by a plurality of numerical parameters comprising size and number of the plurality of bubbles, and wherein each reference class is described by a respective plurality of numerical ranges of the plurality of numerical parameters, a numerical range corresponding to a respective numerical parameter of the plurality of numerical parameters for each reference class, whereby each reference class is defined by a respective plurality of numerical ranges of the plurality of numerical parameters;acquiring a digital image of the free surface of the beverage as a primary image;digitally processing the acquired primary image to obtain a processed image of the free surface of the frothed milk, wherein a plurality of bubbles representative of the surface texture is identified in the processed image, each bubble being defined by a contour line that defines its size;in the processed image, calculating a plurality of values of the corresponding plurality of numerical parameters which characterize the plurality of bubbles that have been identified in the processed image;checking a membership of each numerical parameter value that has been calculated in the processed image to the plurality of numerical ranges of said numerical parameter, the numerical ranges being associated with their respective reference classes, andaccording to the result of the step of checking, assigning a current reference class of the plurality of reference classes, to thereby assign a reference class of foam quality to the acquired image of the beverage containing frothed milk. 2. The method as claimed in claim 1, wherein acquiring a primary image is carried out by a data terminal equipped with a camera and a display, the data terminal being connectable to a data communication network and the method comprises, after the step of acquiring, transmitting the primary image to a server via the data communication network, wherein the step of digitally processing the primary image and the following steps are carried out on the server. 3. The method as claimed in claim 2, which further comprises, after assigning a current reference class Qk to the acquired primary image, transmitting information data indicative of the current class Qk to the data terminal to display said information data on the data terminal display. 4. The method as claimed in claim 1, which further comprises: defining a plurality of factors of degree of membership to a reference class as positive real numbers ranging from a minimum value indicating that a numerical parameter does not fall within a numerical range of the plurality of numerical ranges of the reference class, to a maximum value indicating that the numerical parameter falls within the range. 5. The method as claimed in claim 4, wherein checking the membership of each numerical parameter calculated in the processed image to the plurality of numerical ranges comprises: assigning a membership degree factor of the plurality of membership degree factors to each numerical parameter of the plurality of numerical parameters characterizing the plurality of bubbles identified in the processed image, for each reference class, such that each reference class will be represented by a plurality of membership degree factors, which are as many as the plurality of the numerical parameters of the bubbles, andassigning a current reference class of the plurality of reference classes comprisessumming up the plurality of membership degree factors for each reference class and selecting a current reference class of the plurality of reference classes which has the highest sum of the plurality of factors. 6. The method as claimed in claim 4, wherein checking the membership of each numerical parameter calculated in the processed image to the plurality of numerical ranges comprises: assigning a membership degree factor of the plurality of membership degree factors to each numerical parameter of the plurality of numerical parameters characterizing the plurality of bubbles identified in the processed image, for each reference class, such that each reference class will be represented by a plurality of membership degree factors, which are as many as the plurality of the numerical parameters of the bubbles;assigning a weight factor to each membership degree factor of a respective numerical parameter as a positive real number ranging from a minimum weight value to a maximum weight value and calculating a numerical membership index for each reference class of the plurality of classes as a sum of the plurality of membership degree factors of the corresponding plurality of numerical parameters associated with the reference class, wherein each membership degree factor is weighted by a respective weight factor, to thereby obtain a plurality of membership indexes associated with the corresponding plurality of reference classes, andassigning a current reference class of the plurality of reference classes comprisesselecting the highest membership index from the plurality of membership indexes so calculated and assigning the reference class associated with the selected numerical index as the current reference class associated with the acquired image of the beverage containing frothed milk. 7. A method of automatically assessing the quality of milk foam dispensed by a frothed milk dispensing machine, the method comprising: providing an automatic dispensing machine, for dispensing frothed milk from a dispensing outlet, which comprises a milk circuit comprising a plurality of circuit elements for which a respective plurality of machine operating parameters are set as current operating parameters, the plurality of machine operating parameters comprising a first machine operating parameter of a first circuit element;dispensing a frothed milk-based beverage from the dispensing outlet, the beverage having a free surface of frothed milk having a surface texture, in which dispensing is carried out with the current machine operating parameters;defining a plurality of reference classes representative of a foam quality level based on the surface texture of the frothed milk, wherein the surface texture is described by air bubbles on the free surface, said classes being characterized by a plurality of numerical parameters comprising the size and number of the plurality of bubbles on the free surface, and wherein each reference class is represented by a reference class value and is described by a respective plurality of numerical ranges of the plurality of numerical parameters, a numerical range corresponding to a numerical parameter of the plurality of numerical parameters for each reference class, whereby each reference class is defined by a respective plurality of numerical ranges of the plurality of numerical parameters;acquiring a digital image as a primary image of the free surface of the beverage using a data terminal which comprises a camera and is connectable to a data communication network;transmitting the acquired digital image to a computing device via the data communication network;creating a database on the computing device, comprising at least one data table which comprises, as entries, a plurality of values of the first machine operating parameter, each value of the first machine operating parameter being associated to a respective reference class value;digitally processing the acquired primary image on the computing device, to obtain a processed image, in which a plurality of bubbles representative of the surface texture of the beverage is identified, each bubble being defined by a contour line that defines its size;in the processed image, calculating a plurality of values of the corresponding plurality of numerical parameters which characterize the plurality of bubbles;checking a membership of each numerical parameter value that has been calculated in the processed image to the plurality of numerical ranges of said numerical parameter;according to the result of the step of checking, assigning a current reference class, represented by reference class value Qk of the plurality of reference class values, to thereby assign a reference class of foam quality to the captured image of the beverage containing frothed milk. 8. The method as claimed in claim 7, wherein the method is for taking corrective actions and further comprises: retrieving a nominal reference class value Qn of the plurality of reference class values and checking whether Qk differs from Qn by a value greater than a predetermined threshold value;if the value Qk differs from the nominal class value Qn by a value greater than the predetermined threshold value, retrieving, from the database, a first value of the first machine operating parameter associated with the nominal class Qn and with the first circuit element and a second value of the first machine operating parameter associated with the current reference class value Qk;checking whether the first value of the first machine operating parameter associated with the current reference class differs from the second value of the first machine operating parameter, andif it does, outputting corrective action instruction data for adjusting the first current machine operating parameter according to the difference between the first and second values of the first machine operating parameter. 9. The method as claimed in claim 7, wherein the bubbles identified in the processed image are geometrically defined as ellipses and the numerical parameters comprise the number of the plurality of bubbles, an average radius of each bubble of the plurality of bubbles, and a plurality of density values of subgroups of the plurality of bubbles, wherein each subgroup is associated with a respective numerical range of the average radius of the bubbles. 10. The method as claimed in claim 8, wherein the dispensing machine comprises a module for transmitting and receiving network data, which is configured to be connected with the data communication network, and an electronic control unit connected with the data transceiver module and to the first circuit element for electronic control thereof, wherein outputting corrective action instruction data comprises: transmitting the instruction data to the electronic control unit of the dispensing machine, andcontrolling the first circuit element executing the instruction data by automatically adjusting the first machine operating parameter by an amount equal to the difference between the first and the second values of the first machine operating parameter. 11. The method as claimed in claim 8, wherein the data terminal comprises a display, and the step of outputting corrective action instruction data comprises transmitting the instruction data to the data terminal for display of one or more instructions on a data terminal display. 12. The method as claimed in claim 7, which further comprises: defining a plurality of factors of degree of membership to a reference class as positive real numbers which comprise a minimum value indicating that a numerical parameter does not fall within a numerical range of the plurality of numerical ranges of the reference class and a maximum value indicating the belonging of the numerical parameter to the numerical range,wherein checking the membership of each numerical parameter that has been calculated in the processed image to the plurality of numerical ranges comprises:assigning a membership degree factor of the plurality of factors of degree of membership to each numerical parameter of the plurality of numerical parameters characterizing the plurality of bubbles identified in the processed image, for each reference class, such that each reference class will be represented by a plurality of membership degree factors, which are as many as the plurality of the numerical parameters of the bubbles;assigning a weight factor to each degree of membership factor of a respective numerical parameter as a positive real number ranging from a minimum weight value to a maximum weight value and calculating a numerical membership index for each reference class of the plurality of classes as a sum of the plurality of membership degree factors of the corresponding plurality of numerical parameters associated with the reference class, wherein each membership degree factor is weighted by a respective weight factor, to thereby obtain a plurality of membership indexes associated with the corresponding plurality of reference classes, andwherein assigning a current reference class of the plurality of reference classes comprisesselecting the highest membership index from the plurality of membership indexes so calculated and assigning the reference class associated with the selected numerical index as a current reference class associated with the captured image of the beverage containing frothed milk. 13. The method of claim 12, wherein assigning a current reference class of the plurality of reference classes comprises, before selecting the highest membership index, normalizing the plurality of membership indexes of the plurality of classes so as to obtain a plurality of normalized membership indexes,wherein the step of selecting the highest membership index is replaced byselecting the highest membership index ĨQ,k of the plurality of normalized membership indexes and comparing the highest normalized membership index with the normalized membership indexes ĨQ,k+1 and ĨQ,k−1 of the classes contiguous to the class associated with the highest normalized membership index, andwherein assigning a current reference class of the plurality of reference classes further compriseschecking whether the respective differences between the highest membership index and each of the normalized membership indexes of the contiguous classes is greater than or less than-equal to a threshold difference value;if both the differences between the highest membership index and each of the normalized membership indexes of the contiguous classes are greater than the threshold difference value, assigning to the highest normalized membership index the reference class associated with said highest index as current reference class associated with the acquired image of the beverage containing frothed milk; andif one between the differences between the highest normalized membership index and the normalized membership index of the contiguous class is less than or equal to the threshold difference value, calculating a final class value, Qfin, according to one of the following equations Qfin=(Qk·ĨQ,k+Qk+1·ĨQ,k+1)/(ĨQ,k+ĨQ,k+1), if ĨQ,k+1>ĨQ,k−1,or Qfin=(Qk·ĨQ,k+Qk−1·ÍQ,k−1)/(ĨQ,k+ĨQ,k−1), if ĨQ,k+1<ĨQ,k−1,and assigning the calculated final class value Qfin to the reference class value Qk of the current reference class associated with the acquired image of the beverage containing frothed milk. 14. The method as claimed in claim 8, which further comprises, before the step of retrieving the nominal reference class value Qn, inputting, as input data for the data terminal, the nominal reference class value Qn, and transmitting the value Qn to the computing device. 15. The method as claimed in claim 7, wherein the plurality of circuit elements comprises a milk pump for sucking in milk from a milk container and an air conduit connected with the milk flow to produce a milk-air mixture that is dispensed from the dispensing outlet, the air conduit comprising an air inlet, and wherein air flow introduced through the air inlet is adjustable by adjusting a flow cross-sectional opening of a flow-control valve, the first circuit element being the air flow-control valve and the first machine operating parameter being the opening of the flow cross-section. 16. The method as claimed in claim 7, wherein the plurality of circuit elements comprises a milk pump for sucking in milk from a milk container and an air conduit connected with the milk flow to produce a milk-air mixture that is dispensed from the dispensing outlet, and wherein the milk pump has an output flow rate adjustable by controlling an operating power of the pump, the first circuit element being the milk pump and the first machine operating parameter being the operating power of the pump. 17. The method as claimed in claim 7, wherein the computing device is a remote server. 18. The method as claimed in claim 7, wherein the dispensing machine comprises a module for transmitting and receiving network data and the computing device is installed in the dispensing machine, the control unit being connected with the module for transmitting and receiving network data, said module being connectable with the data communication network. 19. The method as claimed in claim 7, wherein the acquired primary image is a photographic image.
연구과제 타임라인
LOADING...
LOADING...
LOADING...
LOADING...
LOADING...
이 특허에 인용된 특허 (4)
Schwartz Nira ; Shahar Arie ; Woods Richard, Additional dynamic fluid level and bubble inspection for quality and process control.
Erba, Roberto; Oresoli, Davide, Apparatus and a method for refilling the filter-holders of an espresso coffee machine with selected doses of ground coffee to order.
Schwartz Nira (2800 Plaza Del Amo #187 Torrance CA 90503) Shahar Arie (2800 Plaza Del Amo #187 Torrance CA 90503) Woods Richard (2800 Plaza Del Amo #187 Torrance CA 90503), Dynamic fluid level and bubble inspection for quality and process control.
※ AI-Helper는 부적절한 답변을 할 수 있습니다.