JP6581021B2 - Management device and product provision system - Google Patents

Description

  The present invention relates to a technique for providing a product to a user.

  There has been proposed a mechanism for selling products without relying on cash by performing user authentication. For example, in Patent Document 1, a product selected in a display input device is stored in association with a user ID of a user specified by face recognition, and is selected in a display input device from a user terminal logged in using the user ID. A mechanism for instructing the ordering of ordered products is disclosed.

JP, 2015-69343, A

  In the mechanism described in Patent Document 1, it takes time and effort for the user to remember the user ID and input it by hand. SUMMARY OF THE INVENTION An object of the present invention is to provide a product after authenticating the product providing apparatus, such as a vending machine, without user effort.

  In order to solve the above problems, the present invention provides the product provision to the user's mobile communication terminal specified based on face image data representing the user's face imaged by a product provision device that provides the user with a product. A first transmission unit that transmits information for instructing the user to provide a product to the user from the device, and the product providing device when the instruction is made by the user at the mobile communication terminal. On the other hand, a management device is provided that includes a notification unit that notifies the user that the product is to be provided.

  The first transmission unit can transmit information about a product group that can be provided by the product providing device that captures the user's face and corresponds to the user to the mobile communication terminal of the user, and the notification unit You may make it notify the said product provision apparatus of the identification information of the goods which the said user selected from the goods group shown in the mobile communication terminal.

  The product providing apparatus that captures the face of the user can be provided with a second transmission unit that transmits information about the product group corresponding to the user to the product providing apparatus, and the first transmission unit includes the product You may make it transmit the information for the said user to provide the goods which the said user selected from the goods group presented in the provision apparatus.

  When the accuracy when specifying the user based on the face image data is less than a threshold, a user specifying unit for specifying the user may be provided using conditions other than the face image data. .

  When the accuracy when specifying the user based on the face image data is less than a threshold, the user specifying unit is a distance between the user's mobile communication terminal and the product providing apparatus that captures the user's face May be used to specify the user.

  When the accuracy when specifying the user based on the face image data is less than a threshold, the user specifying unit is a history that the product is provided to the user from the product providing apparatus that captures the face of the user May be used to specify the user.

  If the accuracy when specifying the user based on the face image data is less than a threshold, the user specifying unit provides a product provided by the product providing apparatus that images the user's attributes and the user's face The user may be specified using the relationship with the attribute.

  The user specifying unit may change the threshold based on an imaging condition when the product providing device images the face of the user.

  Further, the present invention provides an imaging unit that captures a user's face and generates face image data representing the face in the product providing device, and the user's mobile communication terminal specified based on the face image data. A first transmission unit that transmits information for the user to instruct the user to provide the product from the product providing device; and the product when the instruction is made by the user at the mobile communication terminal. A product providing system comprising: a notification unit that notifies the user that a product is provided to the user; and a product providing unit that provides the user with the product in response to the notification. .

  ADVANTAGE OF THE INVENTION According to this invention, it becomes possible to provide goods, after authenticating without requiring a user's effort in goods provision apparatuses, such as a vending machine.

1 is a block diagram illustrating an overall configuration of a product providing system according to a first embodiment of the present invention. It is a block diagram which shows the hardware constitutions of the management apparatus which concerns on 1st Embodiment. It is a block diagram which shows the hardware constitutions of the vending machine which concerns on 1st Embodiment. It is a block diagram which shows the hardware constitutions of the mobile communication terminal which concerns on 1st Embodiment. It is a block diagram which shows the function structure of the goods provision system which concerns on 1st Embodiment. It is a sequence diagram which shows operation | movement of the goods provision system which concerns on 1st Embodiment. It is a block diagram which shows the function structure of the goods provision system which concerns on 2nd Embodiment. It is a sequence diagram which shows operation | movement of the goods provision system which concerns on 2nd Embodiment. It is a block diagram which shows the function structure of the goods provision system which concerns on 3rd Embodiment. It is a sequence diagram which shows operation | movement of the goods provision system which concerns on 3rd Embodiment.

[First Embodiment]
[Constitution]
FIG. 1 is a block diagram showing the overall configuration of a product providing system 100 according to the first embodiment of the present invention. The product providing system 100 includes a management device 10, a vending machine 20 (hereinafter referred to as “vending machine 20”), a mobile communication terminal 30, and a network 40 including a mobile communication network 41 and a fixed communication network 42. The product providing system 100 includes a plurality of mobile communication terminals 30 and vending machines 20, but one unit is illustrated in FIG. 1.

  The mobile communication network 41 is a network that provides communication services to the mobile communication terminal 30 in accordance with a communication standard called IMT-2000 (International Mobile Telecommunications-2000), for example. The mobile communication terminal 30 is a communication terminal that performs wireless communication with a base station of the mobile communication network 41, and is, for example, a smart phone or a tablet. The vending machine 20 is a product providing apparatus that stores a product group such as a soft drink, for example, and discharges the product selected by the user from the product group to the outside of the machine. The management device 10 performs processing related to product provision and product price settlement in the vending machine 20. The management apparatus 10 is connected to the mobile communication network 41 and the fixed communication network 42, and the vending machine 20 is connected to the fixed communication network 42. When the vending machine 20 has a wireless communication function, wireless communication is performed with the base station of the mobile communication network 41, and therefore connection to the fixed communication network 42 is not essential.

  FIG. 2 is a block diagram illustrating a hardware configuration of the management apparatus 10. The management device 10 is a computer that includes a control unit 11, a communication unit 12, and a storage unit 23. The control unit 11 includes an arithmetic device such as a CPU (Central Processing Unit) and a storage device such as a ROM (Read Only Memory) and a RAM (Random Access Memory). The CPU controls the operation of each unit of the management apparatus 10 by executing a program stored in the ROM or the storage unit 13 using the RAM as a work area. The communication unit 12 is connected to the fixed communication network 42. The storage unit 13 is a large-capacity nonvolatile storage unit such as a hard disk. The storage unit 13 stores data groups and program groups used by the control unit 11. For example, the storage unit 13 identifies a terminal ID for identifying the mobile communication terminal 30 and a user who uses the mobile communication terminal 30. A user ID is stored in association with each other. In addition, the storage unit 13 includes vending machine information including the vending machine ID that is identification information of the vending machine 20 and a position where the vending machine 20 is installed, and a product ID and a product ID for identifying the product provided by the vending machine 20. Stores product information related to products, such as prices and product descriptions. Note that the IDs such as the terminal ID, user ID, and product ID described above may be any type of identification information as long as the information can identify the target.

  FIG. 3 is a diagram illustrating a hardware configuration of the vending machine 20. The vending machine 20 includes a control unit 21, a communication unit 22, a storage unit 23, a UI (User Interface) unit 24, an imaging unit 25, and a product providing unit 26. The control unit 21 includes an arithmetic device such as a CPU and a storage device such as a ROM and a RAM. In the ROM, a program executed by the CPU is stored. The CPU controls the operation of each unit of the vending machine 20 by executing a program stored in the ROM or the storage unit 23 using the RAM as a work area. The communication unit 22 is connected to a fixed communication network 42. The storage unit 23 is a large-capacity nonvolatile storage unit such as a hard disk. The storage unit 23 stores a data group and a program group used by the control unit 21. For example, a user ID for identifying a user who uses the mobile communication terminal 30, and face image data representing the face image of the user. Are stored in association with each other. This face image data is registered in advance by a user who uses the product providing system 100. The storage unit 23 stores the above-described vending machine information and product information. The UI unit 24 includes an operator such as a product selection button for selecting a product, and a display unit such as a liquid crystal panel. The imaging unit 25 includes a camera and is installed at a position for imaging the face of the user standing in front of the vending machine. The product providing unit 26 includes a storage unit that stores a plurality of products, and a discharge mechanism that discharges the product stored in the storage unit to the outside of the apparatus.

  FIG. 4 is a diagram illustrating a hardware configuration of the mobile communication terminal 30. The mobile communication terminal 30 is configured as a computer including a control unit 31, a wireless communication unit 32, a storage unit 33, and a UI unit 34. The control unit 31 includes an arithmetic device such as a CPU and a storage device such as a ROM and a RAM. The ROM stores a program executed by the CPU. The CPU controls the operation of each unit of the mobile communication terminal 30 by executing a program stored in the ROM or the storage unit 33 using the RAM as a work area. The wireless communication unit 32 includes an antenna and a communication circuit, and performs wireless communication with the base station of the mobile communication network 41. The storage unit 33 is a storage unit such as an EEPROM (Electronically Erasable and Programmable ROM) or a flash memory, and stores a data group and a program group used by the control unit 31. The UI unit 34 includes operators such as keys and touch sensors, and a display unit such as a liquid crystal panel and a liquid crystal drive circuit.

  FIG. 5 is a block diagram showing a functional configuration of the product providing system 100. In the vending machine 20, the control unit 21 executes a program and cooperates with the storage unit 23 and the imaging unit 25, thereby realizing a user specifying unit that specifies a user based on face image data representing the user's face. In the management device 10, the control unit 11 executes the program and cooperates with the communication unit 12 and the storage unit 13, so that the user's face specified by the vending machine 20 is identified based on the face image data representing the user's face. When the mobile communication terminal 30 is instructed by the user to provide a product at the first transmission unit that transmits information for the user to instruct the user to provide the product from the vending machine 20 to the mobile communication terminal 30 The vending machine 20 is realized with a notification unit that notifies the user that the product is to be provided.

[Operation]
Next, the operation of the first embodiment will be described. In FIG. 6, the user first stands in front of the vending machine 20 and presses a product selection button corresponding to a desired product among a plurality of product selection buttons provided in the vending machine 20. When the control unit 21 of the vending machine 20 accepts such a product selection operation (step S <b> 1), the image of the user standing in front of the vending machine 20 is captured by the imaging unit 25, and the face image stored in the storage unit 23. A face authentication process is performed in which it is checked against the data to determine whether there is any face image data that falls within a predetermined similar range (step S2). Since the control unit 21 (user specifying unit 210) can specify a user if face image data that can be estimated to be the same user as the imaged user is stored in the storage unit 23, it is determined that the face authentication is successful. To do. Then, the control unit 21 (user specifying unit 210) specifies the user ID stored in association with the face image data, and uses the specified user ID as the vending machine ID of the vending machine 20 and the product of the selected product. The ID is transmitted to the management apparatus 10 together with the ID (step S3).

  The control unit 11 of the management device 10 identifies the terminal ID stored in the storage unit 13 in association with the received user ID (step S4). And the control part 11 (1st transmission part 110) reads the merchandise information corresponding to received merchandise ID from the memory | storage part 13, produces | generates the screen data containing this merchandise information etc., and the mobile communication of the identified terminal ID It transmits to the terminal 30 (step S5).

  The control unit 31 of the mobile communication terminal 30 displays a screen corresponding to the received screen data on the UI unit 34. The screen displayed at this time includes a description and price of the product selected by the user, as well as options for instructing settlement of the product price. The user refers to this screen and confirms the fact that he / she purchases the product he / she has selected, and then performs an operation of selecting an option for instructing settlement. The control unit 31 receives this operation (step S6) and transmits a settlement instruction to the management apparatus 10 (step S7). Since this settlement instruction is an instruction to provide a product to the user from the vending machine 20, the screen data transmitted from the management device 10 to the mobile communication terminal 30 in step S5 is related to the provision of the product from the vending machine 20 to the user. This corresponds to information for the user to instruct.

  When receiving the settlement instruction, the control unit 11 of the management apparatus 10 performs processing related to the settlement of the product, for example, processing for withdrawing the product price from the user's settlement bank account (step S8). And the control part 11 (notification part 120) transmits the payment completion notification to the effect of payment completion to the vending machine 20 (step S9).

  When receiving the settlement completion notice, the control unit 21 of the vending machine 20 performs a process of discharging the product selected by the user to the outside and providing it to the user (step S10). Accordingly, the settlement completion notification transmitted from the management apparatus 10 to the vending machine 20 in step S9 corresponds to a notification that the vending machine 20 provides a product to the user.

  As described above, according to the first embodiment, the user does not need to memorize and input the user ID and the like, so the product is obtained after performing authentication without the user's effort. Can be provided. Although the accuracy of face authentication is not 100%, even if an incorrect user is specified by face authentication, product information is transmitted from the management device 10 to the mobile communication terminal 30 possessed by the user himself / herself. (Step S5 in FIG. 6), the user's intention to purchase the product can be reliably confirmed. Further, since the settlement process is performed by the management device 10, for example, electronic money stored in the mobile communication terminal 30 is not necessary, and of course, the user can purchase a product even if the user does not hold cash. Further, the vending machine 20 does not require a coin insertion / return device, and it is not necessary to provide a function for directly communicating between the vending machine 20 and the mobile communication terminal 30 such as NFC (Near Field Communication) or infrared rays.

[Second Embodiment]
[Constitution]
The second embodiment is different from the first embodiment in that a user selects a product using the mobile communication terminal 30 instead of the vending machine 20. In other words, the management device 10 transmits product information of products according to the user of the mobile communication terminal 30 among the product groups that can be sold by the vending machine 20 to the mobile communication terminal 30. Then, the user selects a desired product from the product group displayed on the mobile communication terminal 30 and instructs settlement. For this reason, the management apparatus 10 according to the second embodiment stores the product information of the products that can be provided in each vending machine 20 in association with the vending machine ID of the vending machine, and in addition to the attribute of the user, A product ID of a product having a high priority when provided to the user is stored.

  As shown in FIG. 7, in the management device 10, the control unit 11 executes a program and cooperates with the communication unit 12 and the storage unit 13, so that the storage unit is added to the functions described in the first embodiment. 13 implements a product extraction unit 130 that extracts product information of a product corresponding to the user from the product information group stored in 13.

[Operation]
In FIG. 8, first, the user performs a predetermined operation such as pressing a process start button on the vending machine 20. In response to this operation, the control unit 21 (user specifying unit 210) of the vending machine 20 captures the face of the user in front of the vending machine 20 by the imaging unit 25 and performs face authentication processing (step S21). Note that the imaging unit 25 of the vending machine 20 may be constantly activated, and face authentication processing may be performed using a face image captured when the user stands in front of the vending machine 20. If face image data that can be estimated to be the same user is stored, the control unit 21 determines that the authentication is successful, the user ID associated with the face image data and stored in the storage unit 23, and the storage unit 23. Is transmitted from the communication unit 22 to the management apparatus 10 (step S22).

  The control unit 11 of the management apparatus 10 specifies the terminal ID stored in the storage unit 13 in association with the received user ID (step S23). Next, the control unit 11 (product extraction unit 130) reads a product information group corresponding to the received vending machine ID from the storage unit 13, and associates the product information group with the user attribute of the received user ID from these product information groups. Then, product information including the product ID stored in the storage unit 13 is extracted (step S24). For example, if the user is a woman, the product ID of a product popular with women is extracted, and if the user is a young user, the product ID of a product popular with young people is extracted. In addition to such gender and age, various conditions that are useful for estimating the product that the user will select (purchase) such as the purchase history and health status of the user, the time zone, weather, and temperature at that time Can be used.

  The control unit 11 (first transmission unit 110) generates screen data that preferentially displays the product information of the product ID extracted in step S24, listing the product information read in step S24. It transmits to the mobile communication terminal 30 of the terminal ID specified in S23 (step S25). Here, displaying product information preferentially means that the product information is displayed in a conspicuous color, character font or large size, or the product information is displayed at a higher position on the screen. The display is to be seen with less burden.

  The control unit 31 of the mobile communication terminal 30 displays a screen corresponding to the received screen data on the UI unit 34. The screen displayed at this time includes explanations and prices for each product, as well as options for instructing payment for the price of the product selected by the user. The user refers to this screen, first selects a desired product from a plurality of product groups, confirms the fact that he / she purchases the selected product, and then performs an operation of selecting an option for instructing settlement. . The control unit 31 accepts this operation (step S26) and transmits a settlement instruction including the product ID to the management apparatus 10 (step S27). Since this settlement instruction is an instruction to provide a product to the user from the vending machine 20, the screen data transmitted from the management device 10 to the mobile communication terminal 30 in step S25 is related to the provision of the product from the vending machine 20 to the user. This corresponds to information for the user to instruct.

  When receiving the payment instruction, the control unit 11 of the management apparatus 10 performs processing related to the payment of the product corresponding to the product ID included in the payment instruction (step S28). And the control part 11 (notification part 120) transmits the payment completion notification to the effect of payment completion to the vending machine 20 (step S29).

  The payment completion notification includes the product ID. Upon receiving the payment completion notification, the control unit 21 of the vending machine 20 discharges the product corresponding to the product ID included in the notification to the outside of the machine. (Step S30). Therefore, the payment completion notification transmitted from the management apparatus 10 to the vending machine 20 in step S29 corresponds to a notification that the vending machine 20 provides products to the user.

  According to this 2nd Embodiment, there exists an effect similar to 1st Embodiment. In addition, since a product corresponding to the user's attribute is preferentially displayed at the time of product selection, there is a possibility that the user can easily select the product. Furthermore, the user can confirm the details of the product to be purchased by the mobile communication terminal 30 at hand. Further, it is easy to store the product purchase log in the storage unit 33 of the mobile communication terminal 30.

[Third Embodiment]
[Constitution]
The third embodiment differs from the second embodiment in that the user selects a product using the vending machine 20 instead of the mobile communication terminal 30. For this reason, as shown in FIG. 9, in the management device 10, the control unit 11 executes a program and cooperates with the communication unit 12 and the storage unit 13, in addition to the functions described in the second embodiment. The second transmission unit 140 that can be provided by the vending machine 20 that captures the user's face and transmits information related to the product group according to the user to the vending machine 20 is realized.

[Operation]
In FIG. 10, the user first performs a predetermined operation on the vending machine 20. In response to this operation, the control unit 21 (user specifying unit 210) of the vending machine 20 captures the face of the user standing in front of the vending machine 20 by the imaging unit 25 and performs face authentication processing (step S31). If face image data that can be estimated to be the same user is stored, the control unit 21 determines that the authentication is successful, the user ID associated with the face image data and stored in the storage unit 23, and the storage unit 23. Is transmitted from the communication unit 22 to the management apparatus 10 (step S32).

  The control unit 11 of the management device 10 identifies the terminal ID stored in the storage unit 13 in association with the received user ID (step S33). Next, the control unit 11 (product extraction unit 130) reads out the product information group corresponding to the received vending machine ID from the storage unit 13, and stores the product information group in association with the received attribute of the user ID. The merchandise information including the merchandise ID is extracted (step S34). The control unit 11 (second transmission unit 140) lists the product information read in step S34, and further generates screen data that preferentially displays the product information of the product ID extracted in step S34. 20 (step S35).

  The control unit 21 of the vending machine 20 displays a screen corresponding to the received screen data on the UI unit 24. The screen displayed at this time includes descriptions and prices of each product. A user in front of the vending machine 20 refers to this screen and first performs an operation of selecting a desired product from a plurality of product groups. The control unit 31 receives this operation (step S36), and transmits the selected product ID to the management apparatus 10 (step S37).

  The control unit 11 (first transmission unit 110) of the management apparatus 10 reads product information corresponding to the received product ID from the storage unit 13, generates screen data including the product information, and the like for the identified terminal ID. It transmits to the mobile communication terminal 30 (step S38).

  The control unit 31 of the mobile communication terminal 30 displays a screen corresponding to the received screen data on the UI unit 34. The screen displayed at this time includes an option for instructing settlement for the price of the product in addition to the description and price of the selected product. The user refers to this screen and confirms the fact that he / she purchases the product he / she has selected, and then performs an operation of selecting an option for instructing settlement. The control unit 31 accepts this operation (step S39), and transmits a settlement instruction including the product ID to the management apparatus 10 (step S40). Since this settlement instruction is an instruction to provide a product from the vending machine 20 to the user, the screen data transmitted from the management apparatus 10 to the vending machine 20 in step S38 is displayed by the user so as to provide the product from the vending machine 20 to the user. This corresponds to the information for instructing.

  When receiving the payment instruction, the control unit 11 of the management apparatus 10 performs a process related to the payment of the product corresponding to the product ID included in the payment instruction (step S41). And the control part 11 (notification part 120) transmits the payment completion notification to the effect of payment completion to the vending machine 20 (step S42).

  The payment completion notification includes the product ID. Upon receiving the payment completion notification, the control unit 21 of the vending machine 20 discharges the product corresponding to the product ID included in the notification to the outside of the machine. (Step S43). Therefore, the settlement completion notification transmitted from the management apparatus 10 to the vending machine 20 in step S42 corresponds to a notification that the vending machine 20 provides a product to the user.

  According to this 3rd Embodiment, there exists an effect similar to 1st Embodiment. Furthermore, since the product according to the user is preferentially displayed at the time of product selection, the product selection may be easy.

[Modification]
The embodiment described above can be modified as follows. The following modifications may be implemented in combination with each other.

[Modification 1]
In the above embodiment, the vending machine 20 includes the user specifying unit 210, but the management apparatus 10 may include the user specifying unit 210. Furthermore, when the accuracy when the user is specified based on the face image data is less than the threshold, the user specifying unit 210 may specify the user using conditions other than the face image data. . The accuracy here is the certainty of the identified user. In general, at the time of face authentication, the degree of coincidence of face image data obtained by imaging with respect to face image data registered in advance is calculated. For example, the degree of coincidence corresponds to the accuracy described here.

  For example, if the accuracy when the user is specified based on the face image data is less than the threshold, the user specifying unit 210 uses the distance between the user's mobile communication terminal 30 and the vending machine 20 that has captured the user's face. Thus, the user may be specified. More specifically, in the management device 10 or the vending machine 20, the position of the vending machine 20 is stored in the storage unit 13 or the storage unit 23. Then, the user specifying unit 210 realized by the management apparatus 10 or the vending machine 20 determines the position of the mobile communication terminal 30 of the user whose accuracy is less than the threshold but most likely to be the person, the position of the base station or the mobile communication terminal 30 Positioning is performed using the GPS (Global Positioning System) implemented in. Then, the user specifying unit 210 calculates the distance between the pre-stored position of the vending machine 20 and the position of the mobile communication terminal 30 that has been measured. If the distance is less than the threshold, the user specifies that the vending machine 20 It is determined that the customer wants to purchase the product. And the 1st transmission part 110 transmits the information for the said user to provide a user with a goods from the vending machine 20 with respect to the user's mobile communication terminal 30. FIG.

  In addition, when the accuracy when the user is specified based on the face image data is less than the threshold, the user specifying unit 210 uses a history in which products are provided to the user from the vending machine 20 that captures the user's face. Thus, the user may be specified. More specifically, the management device 10 or the vending machine 20 stores the product provision history in the vending machine 20 in the storage unit 13 or the storage unit 23 in association with the user ID of the user who received the product provision. Then, the user specifying unit 210 realized by the management apparatus 10 or the vending machine 20 includes a merchandise group included in the provision history corresponding to the user ID of the user whose accuracy is less than the threshold but most likely to be the person, and the vending machine 20 The selected product is compared, and if both are related to a threshold value or more, it is determined that the user is in front of the vending machine 20 and desires to purchase the product. For example, when a product that the user has purchased many times is selected in the vending machine 20, it is determined that the relationship is strong, and when a product that the user has never purchased is selected. Is considered to be weakly related. And the 1st transmission part 110 transmits the information for the said user to provide a user with a goods from the vending machine 20 with respect to the user's mobile communication terminal 30. FIG.

In addition, when the accuracy when the user is specified based on the face image data is less than the threshold, the user specifying unit 210 and the attribute of the product provided by the vending machine 20 that images the user's face The user may be specified using the relationship. More specifically, in the management device 10 or the vending machine 20, the storage unit 13 associates the product ID of a product that can be provided from the vending machine 20 with the attribute of a user who is likely to receive the product. Alternatively, it is stored in the storage unit 23. For example, the attribute that the user is a woman is stored in association with the product ID of the product for women. Then, the user specifying unit 210 realized by the management apparatus 10 or the vending machine 20 has a relationship between the attribute of the user who is most likely to be the person but the accuracy is less than the threshold and the product ID of the product selected in the vending machine 20. It is determined whether or not the stored contents are similar. And if the similarity is more than a threshold value, the user specific part 210 will judge that the said user is in front of the vending machine 20 and wants to purchase goods. The 1st transmission part 110 transmits the information for the said user to provide a user with a goods from the vending machine 20 with respect to the user's mobile communication terminal 30. FIG.

Furthermore, the user specifying unit 210 may change the threshold value to be compared with the accuracy when specifying the user based on the imaging condition when the vending machine 20 images the face of the user. For example, when the weather is bad or at night or the like, the amount of exposure is small at the time of imaging, and the accuracy when specifying the user based on the captured image is inevitably low. Therefore, the user specifying unit 210 decreases the threshold value.

[Modification 2]
In the second embodiment and the third embodiment, when there is a product (for example, a product that matches the user's attribute) according to the user in the product group stored in the vending machine 20 that has performed face authentication, FIG. In step S25 of FIG. 8 or step S35 of FIG. 10, advertisement information and coupon information related to the product may be transmitted from the management device 10 to the mobile communication terminal 30 or the vending machine 20 together with the product information. Thereby, the sales promotion activity according to the user can be realized.

[Modification 3]
The management apparatus 10 or the vending machine 20 may learn the relationship between the user attribute of the user who received the product and the attribute of the product, and extract the product corresponding to the user based on the learning result. . Specifically, the management device 10 or the vending machine 20 accumulates the user attributes of the user who provided the product and the attributes of the product at the time of providing the product, and analyzes the relationship between them using, for example, regression analysis or the like. . In this way, if the relationship between the user attribute and the product attribute is known, the management device 10 or the vending machine 20 can provide the position of the vending machine that can provide the user with a product according to the user and the inventory of the product. It becomes possible to recommend the situation.

[Modification 4]
In the second embodiment, the product list is not displayed on the mobile communication terminal 30 until the user specification by the user specifying unit 210 is completed. Therefore, before the user identification by the user identification unit 210 is completed, the product list that the mobile communication terminal 30 previously displayed and stored in the storage unit 33 can be displayed again on the UI unit 34. Good. In this way, before reaching the vending machine 20 where the user frequently purchases products, the user refers to the product list used at the time of purchasing previous products from the vending machine 20 on the mobile communication terminal 30, and which one is purchased. You can think about what to do.

[Modification 5]
There may be a case where a plurality of users purchase a plurality of products from one vending machine 20 at the same time. In such a case, the user specifying unit 210 performs face authentication of a plurality of users at the same time to specify each user, and the vending machine 20 provides each user with a desired product. At this time, as a collective purchase by a plurality of users, some privilege such as discount of merchandise price or provision of coupons may be given to these users.

[Modification 6]
The management apparatus according to the present invention can also be realized by an apparatus that integrally includes all of the functions of the vending machine 20 and the functions of the management apparatus 10 described in each embodiment.
Further, the function of the vending machine 20 and the function of the management device 10 described in each embodiment may be further distributed and implemented in a plurality of devices. For example, in the management device 10, the product extraction unit 130 and other functions may be mounted on different devices, and these devices may cooperate to realize the same mechanism as that of each of the above embodiments.

[Modification 7]
The present invention can also be implemented in the form of an information processing method performed by the management apparatus 10 or the vending machine 20 or a program for causing a computer to function as the management apparatus 10 or the vending machine 20. Such a program may be provided in a form recorded on a recording medium such as an optical disc, or may be provided in a form such that the program is downloaded to a computer via a network such as the Internet, and the program can be installed and used. Is possible.

DESCRIPTION OF SYMBOLS 10 ... Management apparatus, 11 ... Control part, 12 ... Communication part, 13 ... Memory | storage part, 20 ... Vending machine, 21 ... Control part, 22 ... Communication part, DESCRIPTION OF SYMBOLS 23 ... Memory | storage part, 24 ... UI part, 25 ... Imaging part, 26 ... Product provision part, 30 ... Mobile communication terminal, 31 ... Control part, 32 ... Wireless communication Unit, 33 ... storage unit, 34 ... UI unit, 110 ... first transmission unit, 120 ... notification unit, 130 ... product extraction unit, 140 ... second transmission unit, 210 ... User identification part.

Claims (9)

The product providing device provides the user with the product to the mobile communication terminal of the user specified based on the face image data representing the user's face imaged by the product providing device that provides the user with the product. A first transmitter that transmits information for the user to instruct;
A management device comprising: a notification unit that notifies the user of providing a product to the user when the user gives the instruction to the mobile communication terminal. The first transmission unit can transmit information about a product group that can be provided by the product providing device that captures the face of the user and that corresponds to the user to the mobile communication terminal of the user,
The management device according to claim 1, wherein the notification unit notifies the product providing device of identification information of a product selected by the user from a product group presented at the mobile communication terminal. A second transmission unit configured to transmit to the product providing apparatus information related to a product group that can be provided by the product providing apparatus that captures the user's face and that corresponds to the user;
The said 1st transmission part transmits the information for the said user to instruct | indicate so that the goods which the said user selected from the goods group shown in the said goods provision apparatus may be provided. Management device. When the accuracy when specifying the user based on the face image data is less than a threshold, a user specifying unit for specifying the user using conditions other than the face image data is provided. The management apparatus of any one of Claims 1-3. When the accuracy when specifying the user based on the face image data is less than a threshold, the user specifying unit is a distance between the user's mobile communication terminal and the product providing apparatus that captures the user's face The management apparatus according to claim 4, wherein the user is specified using When the accuracy when specifying the user based on the face image data is less than a threshold, the user specifying unit is a history that the product is provided to the user from the product providing apparatus that captures the face of the user The management apparatus according to claim 4, wherein the user is specified using If the accuracy when specifying the user based on the face image data is less than a threshold, the user specifying unit provides a product provided by the product providing apparatus that images the user's attributes and the user's face The management apparatus according to claim 4, wherein the user is specified using a relationship with the attribute of the management information. The management device according to any one of claims 4 to 7, wherein the user specifying unit varies the threshold based on an imaging condition when the product providing device images the face of the user. . An imaging unit that captures an image of the user's face in the product providing apparatus and generates face image data representing the face;
A first transmission unit that transmits information for the user to instruct the user to provide a product to the user from the product providing device to the mobile communication terminal of the user specified based on the face image data;
When the instruction is made by the user in the mobile communication terminal, a notification unit for notifying the product providing device that the product is provided to the user;
A product providing system comprising: a product providing unit that provides the product to the user in response to the notification.

Images