JP7435658B2 - Information processing equipment, information processing system, sales promotion method and program - Google Patents

Description

The present invention relates to an information processing device, an information processing system, a sales promotion method, and a program.

Online shopping is becoming commonplace. Patent Document 1 discloses an electronic shopping system that can create an atmosphere similar to shopping at an actual store while shopping at a virtual store on the Internet.

Japanese Patent Application Publication No. 2007-122248

On the other hand, when a customer attempts to purchase a product that he or she has touched or picked up in an actual store, it may be time consuming.

An object of the present invention is to provide an information processing device, an information processing system, a sales promotion method, and a program that can facilitate purchasing at a store by presenting products that are likely to be purchased.

The information processing device according to the present invention includes a user information identification unit that identifies a user who has visited the store, and identifies, based on an image, a product touched or picked up by the user who has visited the store as a candidate product for purchase by the user. The system includes a user purchase candidate product identification unit, and a purchase information management unit that manages information on the user purchase candidate products as purchase candidate product information, and the purchase information management unit is configured to identify the user who has visited the store on the product shelf. Information about the returned product is deleted from the purchase candidate product information.

Further, the information processing system according to the present invention includes a user information identification unit that identifies a user who has visited the store, and a product that the user who has visited the store has touched or picked up as a user purchase candidate product based on the image. The system includes a user purchase candidate product identification unit that identifies the user purchase candidate product, and a purchase information management unit that manages information about the user purchase candidate product as purchase candidate product information, and the purchase information management unit is configured to identify the user purchase candidate product when the user visits the store. Information about the product returned to the shelf is deleted from the purchase candidate product information.

Further, the sales promotion method according to the present invention is a sales promotion method executed by a sales promotion device, which includes a user information identification step for identifying a user who has visited the store, and a step of identifying the user information that has been touched by the user who has visited the store based on an image. A user purchase candidate product identification step for identifying a product or a picked-up product as a user purchase candidate product, and a purchase information management step for managing information on the user purchase candidate product as purchase candidate product information, In the purchase information management step, information about products returned to the product shelf by the user who visited the store is deleted from the purchase candidate product information.

Further, the program according to the present invention includes a procedure for identifying the user who has visited the store, and identifies, based on the image, a product touched or picked up by the user who has visited the store as a candidate product for purchase by the user. and a procedure for managing information on the user purchase candidate products as purchase candidate product information. Information about the returned product is deleted from the purchase candidate product information.

According to the present invention, it is possible to provide an information processing device, an information processing system, a sales promotion method, and a program that can facilitate purchasing at a store.

1 is a block diagram showing a schematic configuration of a sales promotion device 10 according to Embodiment 1. FIG. 3 is a flowchart showing a processing procedure of a sales promotion method of the sales promotion device 10 according to the first embodiment. 3 is a diagram showing how the camera 20 according to the first embodiment images the user 6 in front of the product shelf 40. FIG. 2 is a diagram showing how the camera 20 according to the first embodiment images the user 6 in front of the cash register 70. FIG. FIG. 3 is a diagram showing a display screen 31 of the cash register terminal 30 according to the first embodiment. FIG. 2 is a block diagram showing a detailed configuration of information processing section 120 according to Embodiment 1. FIG.

(Embodiment 1 of the invention)
Next, a sales promotion device according to the first embodiment will be described with reference to the drawings.
The sales promotion device according to the first embodiment recognizes a product touched by a user (store visitor) in a store, registers it as a candidate product for purchase by the user, and purchases the product either at the store or on the Internet. It is something that makes it possible.

First, the configuration of the sales promotion device according to the first embodiment will be explained.
FIG. 1 is a block diagram showing a schematic configuration of a sales promotion device 10 according to the first embodiment.
The sales promotion device 10 is a server installed in the store 1, and is connected to a camera 20 and a cash register terminal 30 in the store 1 via a signal line, and is connected to a mobile terminal of a user outside the store 1 via a network 2. 3. It is connected to the user's home personal computer (PC) 4, other stores 5, etc. Network 2 is, for example, the Internet.

The sales promotion device 10 includes an input section 110, an information processing section 120, a storage section 130, an output section 140, and the like.
The input unit 110 inputs from the camera 20 a still image or a video of the user or a product that the user has touched, which is captured by the camera 20 . Further, the input unit 110 inputs the user's purchase information, delivery instruction information, etc. from the cash register terminal 30 or from the user's mobile terminal 3, home computer 4, terminal at another store 5, etc. via the network 2.

The information processing unit 120 recognizes the user or the product touched by the user based on the image input by the input unit 110, and acquires information about the recognized user or product. Further, the information processing unit 120 searches the storage unit 130 for information on products related to the product touched by the user and obtains the information. Further, the information processing unit 120 performs billing, delivery arrangements, etc. based on the user's purchase information and delivery instruction information input by the input unit 110.

The storage unit 130 is, for example, a database, and stores information such as attributes such as name and gender, images, purchase candidate product group data, and related product group data for each user. The storage unit 130 also stores information such as attributes such as product name and price, images, and related products for each product handled at the store 1.

The output unit 140 displays the user's purchase candidate product group data and related product group data on the cash register terminal 30 when the user comes to the checkout. In addition, when a user accesses the sales promotion device 10 via the network 2 from a mobile terminal 3, a home computer 4, a terminal at another store 5, etc., the output unit 140 outputs the user's purchase candidate product group data, related information, etc. Output and return product group data.

Note that each of the components realized by the sales promotion device 10 can be realized by executing a program under the control of an arithmetic unit (not shown) included in the sales promotion device 10, which is a computer, for example. More specifically, the sales promotion device 10 loads a program stored in the storage unit 130 into a main storage device (not shown), and executes the program under control of the arithmetic unit. Further, each component is not limited to being realized by software based on a program, but may be realized by a combination of hardware, firmware, and software.

The programs described above can be stored and provided to a computer using various types of non-transitory computer readable media. Non-transitory computer-readable media includes various types of tangible storage media. Examples of non-transitory computer-readable media include magnetic recording media (e.g., flexible disks, magnetic tapes, hard disk drives), magneto-optical recording media (e.g., magneto-optical disks), CD-ROMs (Read Only Memory), CD-Rs, CD-R/W, semiconductor memory (for example, mask ROM, PROM (Programmable ROM), EPROM (Erasable PROM), flash ROM, RAM (random access memory)).

The program may also be supplied to the computer on various types of transitory computer readable media. Examples of transitory computer-readable media include electrical signals, optical signals, and electromagnetic waves. The temporary computer-readable medium can provide the program to the computer via wired communication channels, such as electrical wires and fiber optics, or wireless communication channels.

Next, the operation of the sales promotion device 10 according to the first embodiment will be explained.
FIG. 2 is a flowchart showing the processing procedure of the sales promotion method of the sales promotion device 10 according to the first embodiment. FIG. 3 is a diagram showing how the camera 20 according to the first embodiment images the user (visitor) 6 in front of the product shelf 40. The sales promotion device 10 starts processing when the store 1 opens.

When the camera 20 captures an image of the user 6 standing in front of the product shelf 40 and selecting wine 50, the image is sent to the information processing unit 120 via the input unit 110. The camera 20 is installed near each product shelf 40. The information processing unit 120 performs pattern matching between the image of the user 6 captured by the camera 20 and the image of each user stored in the storage unit 130 to identify the user 6 standing in front of the product shelf 40 (step S10). Images of each user are captured from a plurality of viewpoints when the user registers as a member or enters the store on the same day, and are registered and stored in the storage unit 130.

Further, an image of the wine 51 picked up by the user 6 or an image of the wine 52 (not shown) touched by the user 6 is also sent to the information processing unit 120 (step S20). The wine 51 picked up by the user 6 and the wine 52 touched by the user 6 are treated as "purchase candidate products" of the user 6 from now on. A purchase candidate product is a product that the user 6 is likely to purchase.

The information processing unit 120 performs pattern matching between the image of the wine 51 picked up by the user 6 or the image of the wine 52 touched by the user 6 and the image of each product stored in the storage unit 130. The wines 51 and 52 are identified, and information on the wines 51 and 52 is acquired (step S30). Images of each product are also captured in advance from a plurality of viewpoints, and are registered and stored in the storage unit 130.

Note that the actions of the user 6, the wines 51 and 52, the action of the user 6 picking up the wine, the action of the user 6 touching the wine, etc. can be sufficiently identified using current image recognition technology.
Further, the user 6 and the wines 51 and 52 can also be identified using short-range communication technology such as RFID.

The information processing unit 120 adds the acquired information on the wines 51 and 52 to the purchase candidate product group data of the user 6 stored in the storage unit 130 (step S40). The purchase candidate product group data is a collection of information on products that the user has picked up or touched, and is a collection of information on products that the user is likely to purchase.

Further, the information processing unit 120 searches for and acquires information about products related to the wines 51 and 52 stored in the storage unit 130 regarding the wines 51 and 52 (step S50). Related products are products that are recommended to be purchased together with each product handled by Store 1. For example, cheese, wine cellar, etc. are registered as related products for wines 51 and 52. ing.

The information processing unit 120 adds the acquired related product information to the related product group data of the user 6 stored in the storage unit 130 (step S60). Related product group data is a collection of information on products related to products that the user has picked up or touched, and is a collection of information on products that store 1 recommends to the user to purchase. It is.

Next, the information processing unit 120 determines whether the user 6 has come to the register to pay (step S70).
FIG. 4 is a diagram showing how the camera 20 according to the first embodiment images the user 6 in front of the cash register 70. The information processing unit 120 performs pattern matching between the image captured by the camera 20 and the image of the user 6 stored in the storage unit 130 to determine whether the user 6 has come to the cash register 70 to pay. When the information processing unit 120 determines that the user 6 has not come to checkout (No in step S70), the information processing unit 120 returns to step S10 and repeats the processing from step S10 to step S70.

On the other hand, when the information processing unit 120 determines that the user 6 has come to checkout (Yes in step S70), the information processing unit 120 displays purchase candidate product group data and related product group data on the cashier terminal 30 installed at the cash register 70 (step S60). ). The cash register terminal 30 is, for example, a touch panel.

FIG. 5 is a diagram showing the display screen 31 of the cash register terminal 30 according to the first embodiment. On the display screen 31, the purchase candidate product group data 32 is displayed as "purchase candidate product", the related product group data 33 is displayed as "recommended product", and the "product name" and "product number (product code)" of each product are displayed. ”, “Price”, etc. are displayed in a list format. The display screen 31 can also display images of products. When the user 6 first comes to the cash register 70, the "Quantity" and "Purchase" fields are blank, but when a store clerk (not shown) passes the product in the basket 60 through the cash register terminal 30, Even if the product is not in the basket 60, the input is made when the user 6 operates the cash register terminal 30 to complete the purchase procedure. Similarly, the "Delivery" field is initially blank, but is entered when the user 6 operates the cash register terminal 30 to instruct delivery of the product.

Next, when the checkout is completed, the information processing unit 120 acquires purchase information and delivery information of the user 6 (step S90), and performs billing, delivery arrangements, etc. (step S100).
With the above, the process of purchasing the product that the user 6 touched at the actual store 1 at the store 1 is completed. The user 6 can purchase a product that he picked up or touched at the store 1 but hesitated to purchase due to reasons such as its size or weight, and have it delivered without putting it in the basket 60. can.

The sales promotion device 10 according to the first embodiment also supports online shopping and is equipped with a web mail order payment function. , a home computer 4, a terminal at another store 5, etc., and when a user 6 accesses from a mobile terminal 3 etc. via the network 2, purchase candidate product group data and related product group are sent to the terminal 3 etc. It outputs and returns data.

Therefore, the user 6 displays a screen similar to the display screen 31 of the cash register terminal 30 shown in FIG. can do. Thereafter, the information processing unit 120 acquires the purchase information and delivery information of the user 6, and performs billing, delivery arrangements, etc., as in the case of the store 1.

With the above, the process of purchasing the product that the user 6 touched at the actual store 1 on the Internet is completed. User 6 can easily purchase a product that he picked up or touched at store 1 but gave up on purchasing at a later date without having to go through the trouble of searching for the product at home or on the go. can do.

Note that the information processing section 120 according to the first embodiment may include a processing section for each function performed by the information processing section 120.
FIG. 6 is a block diagram showing the detailed configuration of information processing section 120 according to the first embodiment. The information processing section 120 includes a user information acquisition section 121, a product information acquisition section 122, a purchase information management section 123, and the like.

The user information acquisition unit 121 recognizes the image captured by the camera 20 to identify the user 6 and acquires information about the user 6. Further, the user information acquisition unit 121 performs image recognition on the image captured by the camera 20 to identify the user's 6 movement. Further, the user information acquisition unit 121 recognizes the voice of the user 6, which is collected by a microphone (not shown).
The product information acquisition unit 122 recognizes the image when the user 6 touches the product, identifies the product that the user 6 touches, and acquires information about the product.

The purchase information management unit 123 manages purchase candidate product data for each user, and adds or deletes purchase candidate product data based on the user's actions such as touching the product or picking up the product. Additionally, the purchase information management unit 123 manages related product data for each user, acquires information on products related to the product touched by the user 6, and adds it to the related product data. Further, the purchase information management unit 123 acquires purchase information and delivery information of the user 6, and performs billing, delivery arrangements, and the like.

As described above, the sales promotion device 10 according to the first embodiment includes the storage unit 130 that stores user information and product images and information, the user information acquisition unit 121 that identifies the user 6 who has visited the store, and the user information acquisition unit 121 that identifies the user 6 who has visited the store. A product information acquisition unit 122 that identifies the product 51 touched by the user 6 based on an image of the product 51 touched and acquires information about the product 51 touched, and a purchase candidate for each user. It includes a purchase information management unit 123 that manages product data and adds information about the acquired product 51 to purchase candidate product data of the identified user 6. With this configuration, it is possible to easily purchase the product 51 that has been touched at the actual store 1 either at the store 1 or on the Internet.

Further, in the sales promotion device 10 according to the first embodiment, the storage unit 130 further stores information on related products that are related products for each product, and the purchase information management unit 123 stores related product data for each user. It is preferable to further manage and search for information on related products corresponding to the acquired information on the product 51 and add it to the related product data of the identified user 6.

Further, in the sales promotion device 10 according to the first embodiment, when the identified user 6 comes to checkout, or when the identified user 6 requests information via the network 2, the purchase information management unit 123 It is preferable to output purchase candidate product data.

(Other embodiments of the invention)
Note that the present invention is not limited to the first embodiment described above, and can be modified as appropriate without departing from the spirit.
For example, in the sales promotion device 10 according to the first embodiment, the camera 20 is installed near each product shelf 40, but the camera 20 is installed at a different location, such as by installing the camera 20 on the basket 60. You may also do this.

Furthermore, in the sales promotion device 10 according to the first embodiment, when the user 6 touches the product or when the user 6 picks up the product, it is determined that there is a high possibility that the user 6 will purchase the product. However, it may be determined that there is a high possibility that the user 6 will purchase the product when the user 6 performs another action. Other actions include putting the item in the basket 60 at least once, holding the item up high, pointing at the item, picking up the item and looking at it for a long time, saying ``I'll buy it.'' is possible. These actions and utterances can be sufficiently identified using current image recognition technology and voice recognition technology.

Furthermore, in the sales promotion device 10 according to the first embodiment, when the user 6 touches the product or when the user 6 picks up the product, it is determined that there is a high possibility that the user 6 will purchase the product. However, the user 6's desire to purchase the product is further determined based on the other operations described above, and the information is displayed on the cash register terminal 30, the user's mobile terminal 3, etc. based on the determined purchase desire of the user 6. The display order of products in the purchase candidate product group data and related product group data may be changed.

Furthermore, in the sales promotion device 10 according to the first embodiment, when the user 6 touches the product or when the user 6 picks up the product, it is determined that there is a high possibility that the user 6 will purchase the product. However, if the user 6 touches the product or makes a specific action or utterance after picking up the product, it is determined that the possibility of purchasing the product is low, and the user 6 The product information may not be added to the purchase candidate product group data, or the product information may be deleted from the purchase candidate product group data. Specific actions and utterances may include returning the product to the shelf, saying ``I won't buy it,'' and so on.

Further, in the sales promotion device 10 according to the first embodiment, the display of purchase candidate product group data and related product group data in the store 1, checkout procedures, etc. are performed on the cashier terminal 30, but a display device is installed on the product shelf 40. The display device may also be used to display purchase candidate product group data and related product group data, checkout procedures, and the like.

Further, although the sales promotion device 10 according to the first embodiment is installed inside the store 1, the sales promotion device 10 may be installed outside the store 1, or may be installed separately inside and outside the store 1. You can leave it there. Sales promotion device 10 according to Embodiment 1 may be configured as an information processing device or an information processing system.

As described above, the sales promotion device 10 according to the other embodiments includes the acquired product information when the purchase information management unit 123 displays purchase candidate product data based on a specific action of the user 6 who has visited the store. It is preferable to set the display order of the 51 pieces of information.

Further, in the sales promotion device 10 according to another embodiment, the purchase information management unit 123 does not add information on the acquired product 51 to purchase candidate product information based on a specific action of the user 6 who has visited the store, or , it is preferable to delete the information on the acquired product 51 from the purchase candidate product information.
Further, in the sales promotion device 10 according to another embodiment, it is preferable that the specific action includes the utterance of the user 6 who has visited the store.

Further, the information processing device according to another embodiment includes a storage unit that stores user information and product images and information, a user information acquisition unit that acquires information that identifies a user who has visited the store, and a user information acquisition unit that acquires information that identifies a user who has visited the store. A product information acquisition unit that identifies the product touched based on the image of the product touched and acquires information about the product touched, and a product information acquisition unit that manages and acquires purchase candidate product data for each user. The purchase information management section adds product information to purchase candidate product data of the identified user.

Further, the information processing system according to another embodiment includes a user information acquisition unit that identifies a user who has visited the store, and a product that has been touched by the user who has visited the store based on an image of the product that has been touched. a sales promotion device that has a product information acquisition unit that acquires information about products that are touched; a storage unit that stores user information and product images and information; and manages purchase candidate product data for each user; The information processing apparatus includes a purchase information management unit that adds information about the acquired product to purchase candidate product data of the identified user.

Part or all of the above embodiments may be described as in the following additional notes, but are not limited to the following.
(Additional note 1)
a storage unit that stores user information and product images and information;
a user information acquisition unit that identifies users who have visited the store;
a product information acquisition unit that identifies the product touched by the user who visited the store based on an image of the product touched, and acquires information about the product touched;
A sales promotion device comprising: a purchase information management unit that manages purchase candidate product data for each user and adds information on the acquired product to the purchase candidate product data of the identified user.
(Additional note 2)
The sales promotion device according to supplementary note 1, wherein the purchase information management unit sets a display order of the acquired product information when displaying the purchase candidate product data based on a specific action of the user who has visited the store.
(Additional note 3)
The purchase information management unit may not add information on the acquired product to the purchase candidate product information, or add information on the acquired product from the purchase candidate product information based on a specific action of the user who has visited the store. The sales promotion device set forth in Supplementary Note 1 or 2 to be deleted.
(Additional note 4)
The sales promotion device according to appendix 2 or 3, wherein the specific action includes utterances of the user who has visited the store.
(Appendix 5)
The storage unit further stores information on related products that are related products for each product,
The purchase information management unit further manages related product data for each user, searches for related product information corresponding to the acquired product information, and adds it to the related product data of the identified user. 4. The sales promotion device according to any one of 4.
(Appendix 6)
The purchase information management unit outputs purchase candidate product data when the identified user comes to checkout or when the identified user requests information via a network. The sales promotion device according to item 1.
(Appendix 7)
a storage unit that stores user information and product images and information;
a user information acquisition unit that acquires information identifying users who have visited the store;
a product information acquisition unit that identifies the product touched by the user who visited the store based on an image of the product touched, and acquires information about the product touched;
An information processing device comprising: a purchase information management unit that manages purchase candidate product data for each user and adds information on the acquired product to purchase candidate product data of the identified user.
(Appendix 8)
a user information acquisition unit that identifies users who have visited the store;
a sales promotion device comprising: a product information acquisition unit that identifies a product touched by the user who has visited the store based on an image of the product touched by the user and obtains information about the product touched; ,
a storage unit that stores user information and product images and information;
an information processing device having a purchase information management unit that manages purchase candidate product data for each user and adds information on the acquired product to the purchase candidate product data of the identified user;
An information processing system equipped with
(Appendix 9)
A sales promotion method carried out by a sales promotion device,
storing user information and product images and information;
a step of managing purchase candidate product data for each user;
a step of identifying a user who has visited the store;
identifying the product touched by the user who visited the store based on an image of the product touched by the user, and acquiring information about the product touched by the user;
A sales promotion method comprising: adding information on the acquired product to purchase candidate product data of the identified user.
(Appendix 10)
to the computer,
a procedure for storing user information and product images and information;
Procedures for managing purchase candidate product data for each user,
A procedure for identifying a user who has visited a store;
A step of identifying the product touched by the user who visited the store based on an image of the product touched, and acquiring information about the product touched by the user;
and adding information about the acquired product to purchase candidate product data of the identified user.

1 Store 2 Network 3 User mobile terminal 4 User home computer 5 Other stores 10 Sales promotion device 20 Camera 30 Cash register terminal 110 Input section 120 Information processing section 121 User information acquisition section 122 Product information acquisition section 123 Purchase information management section 130 Storage section 140 Output section

Claims (8)

a user information identification unit that identifies users who have visited the store;
Based on the image of the user who visited the store touching the product or picking up the product , the product that the user who visited the store touched or picked up is selected as a candidate product for purchase by the user. a user purchase candidate product identification unit for identifying;
a purchase information management unit that manages information on the user purchase candidate products as purchase candidate product information;
When the user purchase candidate product identification unit identifies that the user who visited the store returned the product that he picked up from the product shelf to the product shelf, the purchase information management unit:
deleting information about the product that the user who visited the store returned to the product shelf from the purchase candidate product information ;
outputting the purchase candidate product information with the product information deleted;
Information processing device. The user purchase candidate product identification unit identifies the user purchase candidate product based on an image of the user who has visited the store touching the product or picking up the product. information processing equipment. The information processing device according to claim 1 or 2, further comprising: an output unit that outputs the purchase candidate product information to the mobile terminal in response to access from the mobile terminal of the user who has visited the store. Any one of claims 1 to 3, wherein the purchase information management unit includes a display control unit that controls display of the purchase candidate product information on a display device installed in the store when the user who visits the store pays out. The information processing device described in section. The information according to any one of claims 1 to 4, wherein the purchase information management unit searches for information on related products corresponding to the user purchase candidate product and manages the information as information on related products of the user who visited the store. Processing equipment. a user information identification unit that identifies users who have visited the store;
Based on the image of the user who visited the store touching the product or picking up the product , the product that the user who visited the store touched or picked up is selected as a candidate product for purchase by the user. a user purchase candidate product identification unit for identifying;
a purchase information management unit that manages information on the user purchase candidate products as purchase candidate product information;
When the user purchase candidate product identification unit identifies that the user who visited the store returned the product that he picked up from the product shelf to the product shelf, the purchase information management unit:
Deleting information about the product that the user who visited the store returned to the product shelf from the purchase candidate product information ;
outputting the purchase candidate product information with the product information deleted;
Information processing system. A sales promotion method carried out by a sales promotion device,
a user information identification step for identifying a user who has visited the store;
Based on the image of the user who visited the store touching the product or picking up the product , the product that the user who visited the store touched or picked up is selected as a candidate product for purchase by the user. a step of identifying user purchase candidate products;
a purchase information management step of managing information on the user purchase candidate product as purchase candidate product information;
When it is identified in the user purchase candidate product identification step that the user has returned the product that he picked up from the product shelf he visited the store to the product shelf, in the purchase information management step,
Deleting information about the product that the user who visited the store returned to the product shelf from the purchase candidate product information ;
outputting the purchase candidate product information with the product information deleted;
Sales promotion methods. to the computer,
A procedure for identifying a user who has visited a store;
Based on the image of the user who visited the store touching the product or picking up the product , the product that the user who visited the store touched or picked up is selected as a candidate product for purchase by the user. steps to identify;
a procedure for managing information on the user purchase candidate products as purchase candidate product information;
A program for executing
In the step of identifying the product touched or picked up by the user who visited the store as the user purchase candidate product, return the product that the user who visited the store picked up from the product shelf to the product shelf. In the step of managing information on the user purchase candidate product,
Deleting information about the product that the user who visited the store returned to the product shelf from the purchase candidate product information ;
outputting the purchase candidate product information with the product information deleted;
program.

Images