JP5500062B2 - Goods sales equipment - Google Patents

Description

  The present invention relates to an article sales apparatus that sells goods such as beverages and tickets such as tickets to purchasers.

  Conventionally, article vending machines such as vending machines that sell products such as beverages and vending machines that sell tickets such as tickets have been widely used.

  Recently, a vending machine has been put into practical use in which a display is attached to the front of the apparatus body and a product display screen for displaying a plurality of types of products being sold to a purchase applicant is displayed on the display ( Non-patent document 1 etc.). This vending machine attaches a touch panel on the screen of the display and detects the pressed position to determine the type of product selected by the purchase applicant.

  The vending machine includes a camera that captures the purchase applicant, processes the image captured by the camera, and estimates the sex, age, and the like of the purchase applicant as attributes. And the goods display screen displayed on a display is changed according to the attribute estimated here. Specifically, the arrangement of products for sale is changed according to the attribute of the estimated purchase requester, or the recommended product is highlighted for the purchase requester of the estimated attribute.

  Furthermore, this vending machine also has a marketing function for counting the types of products sold for each user attribute. The result of aggregation by the marketing function is used for selecting a product display screen to be displayed on the above-described display.

http://www.itmedia.co.jp/news/articles/1008/10/news080.html

  However, when one user purchases a plurality of products, the user bends or faces down to take out the product selected by the user (purchased product). May be out of the field of view of the camera. In this case, when the face of the user enters the imaging field of view of the camera again, it is determined that the user is another user (new user), and the attribute is estimated. That is, attribute estimation may be performed multiple times for the same user.

  For this reason, the processing load of the apparatus main body (processing load for attribute estimation) is unnecessarily increased.

  An object of the present invention is to provide an article sales apparatus that prevents the process of estimating an attribute of a user who purchases an article from being unnecessarily repeated and reduces the load on the apparatus main body.

  The article sales apparatus of the present invention is configured as follows in order to solve the above-described problems and achieve the object.

  The display control unit displays a selection screen for selecting an article for sale on a display provided on the front of the apparatus main body. The configuration for detecting the selection of the article by the user may be a configuration in which, for example, a touch panel is attached to the screen of the display, and the selected article is determined according to the pressing position of the user.

  A detection part detects the presence or absence of the person located in the apparatus main body front using a proximity sensor. The proximity sensor is an infrared sensor that detects an object using infrared rays, for example.

  The imaging unit images the front of the apparatus main body. The imaging unit sets the imaging area so that the face of a person who is looking at the screen (selection screen or the like) displayed on the display is captured. The attribute estimation unit processes the image captured by the imaging unit, and estimates the gender, age, and the like of the person located in front of the apparatus main body as attributes. The display control unit described above switches the selection screen to be displayed on the display according to the attribute estimated by the attribute estimation unit.

Further, when the detection unit detects a person located in front of the apparatus main body, the attribute estimation instruction unit captures an image captured by the imaging unit at this timing and captures the image in the image. and instructing to estimate the attributes of a person are. The attribute estimation instruction unit holds the attribute of the person positioned in front of the main body with the attribute estimated this time while the detection unit continues to detect the person positioned in front of the main body . Further, the attribute estimation instruction unit estimates the attribute of the person captured in the image captured by the imaging unit to the attribute estimation unit until the detection of the person located in front of the main body in the detection unit is interrupted. Do not instruct.

  When one user purchases a plurality of articles, the user's face can be bent by bending his / her body or face down to take out the article selected by the user (purchased article). Even if the imaging unit is out of the imaging area, the detection unit continues to detect the user in front of the apparatus main body. For this reason, when the user's face enters the imaging field of the imaging unit again, the user is not determined as a new user, but is determined to be the same person as the user of the previous article. In this case, the attribute estimation instruction unit does not instruct the attribute estimation unit to estimate the attribute of the person captured in the image captured by the imaging unit.

  Therefore, it is possible to prevent the process of estimating the attribute of the user who purchases the product from being wasted, and to reduce the load on the apparatus main body.

  Moreover, it is good also as a structure which determines the selection screen which a display control part displays on a display based on the totaling result of a totaling part while providing the totaling part which totals the goods sold according to an attribute. In this way, since the selection screen of the article corresponding to the user is displayed on the display unit for the user, the sales of the article can be promoted. Further, since one user who has purchased a plurality of articles can be tabulated as one user, tabulation for users who have purchased a plurality of articles can be performed appropriately.

  Further, the detection unit may be arranged so as to detect the presence or absence of a person located in front of the article take-out port for taking out the sold article.

  Further, the display control unit may perform screen display (for example, advertisement display) other than the selection screen on the display unit or stop the screen display when the detection unit has not detected a person located in front of the apparatus main body. .

  According to the present invention, it is possible to reduce the load on the apparatus main body and to improve the counting accuracy in the marketing function.

It is a block diagram which shows the structure of the principal part of a vending machine. It is the schematic which shows the external appearance of a vending machine. It is a flowchart which shows operation | movement of a vending machine. It is a figure explaining the movement of the user who operates a vending machine. It is a timing chart which shows the timing which estimates an attribute with respect to a user.

  Embodiments of the present invention will be described below.

  FIG. 1 is a block diagram showing a configuration of a main part of a vending machine according to an embodiment of the present invention. FIG. 2 is a schematic view showing the appearance of the vending machine. 2A is a front view, and FIG. 2B is a side view. The vending machine 1 includes a main control unit 2, a detection unit 3, an image processing unit 4, a display control unit 5, an operation detection unit 6, a medium processing unit 7, a money processing unit 8, and a product release. Part 9.

  The main control unit 2 controls the operation of each part of the main body of the vending machine 1 and performs a counting process to be described later. Details of the counting process will be described later.

  The detection unit 3 includes infrared sensors 3a to 3c and detects a person located in front of the apparatus main body. As shown in FIG. 2A, the infrared sensors 3a to 3c are arranged in the width direction of the apparatus main body. The infrared sensors 3a to 3c are attached at positions where the detection position is about 60 cm high from the floor surface.

  In addition, although the detection part 3 is set as the structure which has the three infrared sensors 3a-3c arranged in the width direction of the apparatus main body here, what is necessary is just a structure which has the infrared sensor 3a arrange | positioned at least to the main body front center part. . That is, the detection unit 3 may have a configuration including only the infrared sensor 3a or a configuration including two or more infrared sensors.

  The image processing unit 4 captures a frame image captured by the camera 4a (corresponding to the imaging unit referred to in the present invention), and estimates attributes including the gender, age, and the like of the person captured in the frame image. . The camera 4a is attached to the approximate center in the width direction on the front of the apparatus main body and at a height of about 180 cm from the floor surface. The camera 4a is attached so that the imaging field of view is slightly downward, and the face of a person located in front of the main body enters the imaging area.

  The display control unit 5 controls screen display on the display 5a. As shown in FIG. 2A, the display 5a is provided in front of the main body, and is attached at a position where the upper end is about 160 cm and the lower end is about 80 cm.

  The operation detection unit 6 has a touch panel 6a pasted on the screen of the display 5a, and determines an input operation to the apparatus main body by detecting a pressed position of the touch panel 6a.

  The medium processing unit 7 includes a wireless communication antenna 7a (hereinafter simply referred to as an antenna 7a) provided at the approximate center in the width direction on the front surface of the apparatus main body and near the infrared sensor 3a. The medium processing unit 7 has a wireless communication function for performing wireless communication with a wireless communication medium (such as a non-contact IC card or a mobile phone) trapped by the antenna 7a. The medium processing unit 7 performs a settlement process for a transaction amount related to a product to be sold by wireless communication with a wireless communication medium placed on the antenna 7a.

  In addition, the money processing unit 8 accepts the insertion of coins and banknotes, and settles the transaction amount for the product to be sold. Further, the money handling unit 8 also releases change as necessary. A coin insertion slot for inserting coins, a bill insertion slot for inserting banknotes, and a change discharge opening for discharging change are provided on the front of the apparatus main body. The money processing unit 8 has a money recognition function for identifying the authenticity and type of a coin inserted from a coin insertion slot or a banknote inserted from a banknote insertion slot.

  Further, the product release unit 9 releases the product selected by the user and the payment completed to the product release port 9a. The product discharge port 9a is provided at the approximate center in the width direction on the front surface of the apparatus main body and at a height of about 45 cm from the floor surface.

  Since the product discharge port 9a is about 45 cm high from the floor as described above, the released product can be taken out by bending slightly. Moreover, the infrared sensor 3a described above is attached at a height of about 60 cm from the floor so that a user who has taken out the product discharged to the product discharge port 9a can be detected.

  Although the face of the user who is taking out the product discharged to the product discharge port 9a may be out of the imaging field of view of the camera 4a, as described above, the presence of the user is detected by the infrared sensor 3a. Can do.

  Hereinafter, the sales operation of the product in the vending machine 1 will be described. FIG. 3 is a flowchart showing the operation of the vending machine.

  A state in which the detection unit 3 does not detect a person in any of the infrared sensors 3a to 3c will be described as an initial state. That is, the initial state here is a state in which no person is located in front of the main body of the vending machine 1.

  The main control unit 2 waits for any of the infrared sensors 3a to 3c to detect a person in the detection unit 3 (s1). When the detection unit 3 detects a person with any one of the infrared sensors 3a to 3c, the infrared sensor 3a attached to the approximate center in the width direction of the apparatus main body continuously detects the person for a predetermined time (for example, 1 second). It is determined whether or not (s2).

  The persons detected in s1 include not only users who purchase products with the vending machine 1 but also passers who pass through the front of the main body of the vending machine 1. A user who purchases a product with the vending machine 1 stops at approximately the center in the width direction of the apparatus main body. On the other hand, a passerby who does not purchase products with the vending machine 1 does not stop at the approximate center in the width direction of the apparatus main body. In s <b> 2, it is determined whether the user purchases the product with the vending machine 1 or the passerby who does not purchase the product with the vending machine 1.

  If the main control unit 2 determines in s2 that the detection unit 3 continuously detects a person with the infrared sensor 3a for a predetermined time, the main control unit 2 instructs the image processing unit 4 to perform attribute estimation (s3). The image processing unit 4 estimates the user's attribute according to this instruction.

  Specifically, the image processing unit 4 captures a plurality of frame images captured by the camera 4a. The image processing unit 4 selects a frame image that is most suitable for estimating the user's attribute, in which the user's face is imaged from substantially the front, among the plurality of captured frame images. As shown in FIG. 4A, the user who purchases the product with the vending machine 1 is standing in front of the main body of the vending machine 1, so that the user's face can be imaged from the front with the camera 4a.

  The camera 4a may be activated at all times, but may be activated when the detection unit 3 detects a person with any of the infrared sensors 3a to 3c, and in particular, the person is detected with the infrared sensor 3a. You may start at the timing.

  The image processing unit 4 estimates gender, age, etc. for the person imaged in the selected frame image. Attributes are estimated by the size and shape of facial parts such as the contour of the face, eyes, nose, mouth, and corners of the eyes. Estimated using the depth of the nose and the depth of the Horai Line.

  When the attribute of the user is estimated, the main control unit 2 displays a product sales screen (product display screen) corresponding to the estimated user on the display 5a with respect to the display control unit 5. Instruct (s4). In accordance with this instruction, the display control unit 5 displays a corresponding product display screen on the display 5a. The display control unit 5 displays a product display that emphasizes a product that is frequently purchased by a user with the attribute estimated in s4, a product that the user wants to promote to the user with this attribute, or the like.

  The display control unit 5 may display the advertisement screen on the display unit 5a until the product display screen is displayed on the display unit 5a in s4, or may stop displaying the screen on the display unit 5a. Good.

  The main control unit 2 receives a payment method for the product to be sold (s5). For example, the user inserts money (coin or banknote) into the money processing unit 8 when the transaction amount is settled with money (cash). When the main control unit 2 receives the money inserted in the money processing unit 8, the main control unit 2 determines that the settlement method of the product to be sold is money. In addition, the user selects the type of wireless communication medium to be used when the transaction amount is settled with the value of a wireless communication medium such as a non-contact IC card or a mobile phone. The operation detection unit 6 accepts an operation for selecting the type of wireless communication medium.

  The main control unit 2 accepts selection of a product to be purchased by the user (s6). The user presses the display position of the product to be purchased on the product display screen displayed on the display 5a. The operation detection unit 6 detects the user's pressed position on the touch panel 6a, and determines the product selected by the user (the product displayed at the detected pressed position).

  If the settlement method of the product to be sold is a wireless communication medium, the main control unit 2 waits for the wireless communication medium to be deceived by the antenna 7a (s7, 8), and A settlement process for settlement of the transaction amount is performed by wireless communication (s9). If the settlement method of the merchandise to be sold is cash, a settlement process is performed to settle the transaction amount with the previously inserted money (s9). If the payment method for the merchandise to be sold is cash, the change is also released in s9.

  When the checkout process for the product sold in s9 is completed, the main control unit 2 instructs the product release unit 9 to release the product selected by the user this time (s10). In accordance with this instruction, the product release unit 9 releases the product to the product release port 9a.

  The main control unit 2 again receives a payment method for the product to be sold (s11), or waits for detection of a person by the infrared sensor 3a being interrupted in the detection unit 3 (s12). When the user takes out the product discharged to the product discharge port 9a, as shown in FIG. 4B, the user's face is slightly bent, and the user's face may be out of the imaging field of view of the camera 4a. However, the detection unit 3 continues to detect the presence of the user with the infrared sensor 3a.

  The main control unit 2 returns to s6 and repeats the above-described processing when receiving the payment method for the product to be sold again without interrupting the detection of the person by the infrared sensor 3a in the detection unit 3. That is, when returning to s6 this time, this user is sold as the same person as the previous user. Thereby, it is possible to prevent the attribute estimation process (the process related to s3 described above) for estimating the attribute of the user who purchases the product from being wasted, and to reduce the load on the main body of the vending machine 1.

  When the detection unit 3 stops detecting the person with the infrared sensor 3a, the main control unit 2 stores the attribute of the user in association with one or a plurality of products purchased by the user. Processing is performed (s13), and the process returns to s1. In s13, for each type of product being sold, totaling is performed by associating the number of sales by user attribute. Accordingly, popular products (products with a large number of sales) can be determined for each attribute. Moreover, the main control part 2 determines the goods display screen displayed on the indicator 5a by s4 using this total result.

  Moreover, in s13, the display control part 5 may perform switching which displays an advertisement screen on the display 5a, and may stop the screen display in the display 5a. Furthermore, in s13, if any one of the infrared sensors 3b and 3c is detected in the detection unit 3, the display may be returned to s1 without switching the screen display on the display 5a. In this way, when the person detected by any of the infrared sensors 3b and 3c is the next user, it is possible to prevent frequent switching of the screen display on the display 5a.

  FIG. 5 is a diagram illustrating timing at which user attribute estimation is performed in the above-described processing. In FIG. 5, T1 and T4 are timings when a person is detected by the infrared sensor 3a. The person detected at T1 is a person (passer) whose detection by the infrared sensor 3a is interrupted at a timing T3 before a predetermined time elapses (before reaching T2). Therefore, the attribute estimation process in s3 is not performed for this person.

  On the other hand, the person detected at T4 is determined to be a user at timing T5 when a predetermined time has elapsed, and attribute estimation is started at this point. Thereafter, the user (the person detected by the infrared sensor 3a) is determined to be the same person until the timing T6 when the detection of the person by the infrared sensor 3a is interrupted, and a plurality of products are sold until the timing T6. However, the process related to the attribute estimation for the user is not repeated.

  In the above description, the present invention has been described using a vending machine as an example. However, the present invention can be applied to other types of article selling apparatuses such as a vending machine.

DESCRIPTION OF SYMBOLS 1 ... Vending machine 2 ... Main control part 3 ... Detection part 3a-3c ... Infrared sensor 4 ... Image processing part 4a ... Camera 5 ... Display control part 5a ... Display device 6 ... Operation detection part 6a ... Touch panel 7 ... Medium processing part 8 ... Money handling unit 9 ... Product release unit 9a ... Product release port

Claims (4)

A display control unit for displaying a selection screen for selecting an article for sale on a display provided on the front of the apparatus main body;
A detection unit for detecting the presence or absence of a person located in front of the apparatus body;
An imaging unit for imaging the front of the apparatus body;
An attribute estimation unit that processes an image captured by the imaging unit and estimates an attribute of a person located in front of the apparatus main body;
When the detection unit detects a person located in front of the apparatus main body, at this timing, the attribute estimation unit captures the image captured by the imaging unit and attributes the person captured in the image. an attribute estimation instruction unit for holding at the present estimation attributes between the attributes of a person located in the body front to the detection of a person located in the body front continues in indicated, the detecting unit to estimate a With
The display control unit switches the selection screen to be displayed on the display according to the attribute estimated by the attribute estimation unit ,
The attribute estimation instructing unit estimates the attribute of the person captured in the image captured by the imaging unit with respect to the attribute estimation unit until the detection of the person located in front of the main body in the detection unit is interrupted. Do not instruct the goods sales device. It has a totaling unit that totals the sold items by attribute,
The article display device according to claim 1, wherein the display control unit determines the selection screen to be displayed on the display unit based on a counting result of the counting unit.   The article selling apparatus according to claim 1, wherein the detection unit detects the presence or absence of a person located in front of an article take-out port for taking out a sold article.   The display control unit performs screen display other than the selection screen on the display unit or stops screen display when the detection unit does not detect a person located in front of the apparatus main body. The article sales apparatus according to any one of the above.