JP6980994B2 - Information processing equipment, control methods, and programs - Google Patents

Description

The present invention relates to an information processing apparatus, a control method, and a program.

Technology for managing customer information has been developed in POS (Point of Sales) systems and the like. For example, Patent Document 1 discloses a technique for managing a customer's name, address, and whether or not the customer uses a plastic shopping bag, in association with a customer's identification number that can be read from a membership card.

Japanese Unexamined Patent Publication No. 2007-102527

The system of Patent Document 1 utilizes the customer's identifier read from the customer's membership card. Therefore, if the customer has not registered as a member, the customer's information cannot be grasped.

The present invention has been made in view of the above problems. One of the objects of the present invention is to provide a technique capable of acquiring customer information regarding services available to the customer regardless of whether or not the member is registered.

The first information processing apparatus of the present invention comprises (1) a calculation means for calculating a feature amount of the customer using an image captured by the customer, and (2) a service that can be used by the customer in a store. The attribute information associated with the customer's feature amount is acquired from the storage device that stores the attribute information indicating whether or not the customer owns the thing related to the use in association with the customer's feature amount. The customer who generates the attribute information by using the output control means for outputting the acquired attribute information and (3) the history information indicating the history of the customer's behavior or state regarding the use of the service, and includes the customer included in the acquired image. the attribute information described above generated in association with the feature value have a, a generation unit to be stored in the storage device,
The generation means is
A history in which a customer whose attribute information does not exist in the storage device is targeted for generation of the attribute information, and the customer is associated with a feature amount having a high degree of similarity to the feature amount of the customer calculated by the calculation means. Get at least one piece of information
The attribute information of the customer who is the generation target of the attribute information is generated from the acquired history information .
Further, the second information processing apparatus of the present invention can be used by (1) a calculation means for calculating the feature amount of the customer using the captured image captured by the customer, and (2) the customer at the store. The attribute information associated with the customer's feature amount is acquired from the storage device that stores the attribute information indicating whether or not the customer owns the thing related to the use of the service in association with the customer's feature amount. It also has an output control means that outputs the acquired attribute information.
The output control means is
A screen showing a message for confirming to the customer the attribute information indicating whether or not the customer has used the service or whether or not the customer owns the thing related to the use is displayed on the device operated by the customer.
Further, a screen for accepting an input requesting a change of the attribute information indicating whether or not the customer has used the service or whether or not the customer owns the thing related to the use is displayed on the device operated by the customer.
When the input requesting the change is received, the device operated by the customer further displays a screen for accepting the selection of whether the change of the attribute information is only this time or will be continued in the future.
If the option to continue changing the attribute information is accepted, the customer's attribute information is updated based on the change manipulated by the customer.

The first control method of the present invention is performed by a computer.
The control method includes (1) a calculation step of calculating the feature amount of the customer using the captured image captured by the customer, and (2) the thing related to the use of the service available to the customer in the store. The attribute information associated with the customer's feature amount is acquired from a storage device that stores the attribute information indicating whether or not the customer is owned in association with the customer's feature amount, and the acquired attribute information is stored. The attribute information is generated using the output control step to be output and (3) the history information indicating the history of the customer's behavior or state regarding the use of the service, and is associated with the customer's feature amount included in the acquired image. the generated attribute information have a, a generation step of storing in the storage device Te,
In the generation step
A history in which a customer whose attribute information does not exist in the storage device is targeted for generation of the attribute information, and the customer is associated with a feature amount having a high degree of similarity to the feature amount of the customer calculated by the calculation step. Get at least one piece of information
The attribute information of the customer who is the generation target of the attribute information is generated from the acquired history information .
The second control method of the present invention is performed by a computer.
The control method includes (1) a calculation step of calculating the feature amount of the customer using the captured image captured by the customer, and (2) the thing related to the use of the service available to the customer in the store. The attribute information associated with the customer's feature amount is acquired from a storage device that stores the attribute information indicating whether or not the customer is owned in association with the customer's feature amount, and the acquired attribute information is stored. Has an output control step to output,
The output control step is
A screen showing a message for confirming to the customer the attribute information indicating whether or not the customer has used the service or whether or not the customer owns the thing related to the use is displayed on the device operated by the customer.
A screen for accepting an input requesting a change in attribute information indicating whether or not the customer has used the service or whether or not the customer owns the thing related to the use is displayed on the device operated by the customer.
When the input requesting the change is received, the device operated by the customer further displays a screen for accepting the selection of whether the change of the attribute information is only this time or will be continued in the future.
If the option to continue changing the attribute information is accepted, the customer's attribute information is updated based on the change manipulated by the customer.

The program of the present invention causes a computer to execute each step of the control method of the present invention.

INDUSTRIAL APPLICABILITY According to the present invention, there is provided a technique capable of acquiring customer information regarding services available to the customer regardless of whether or not the member is registered.

It is a block diagram which illustrates the information processing apparatus of Embodiment 1 together with the usage environment. It is a figure which conceptually illustrates the operation of the information processing apparatus of Embodiment 1. FIG. It is a figure which illustrates the computer for realizing the information processing apparatus. It is a flowchart which illustrates the flow of the process executed by the information processing apparatus of Embodiment 1. FIG. It is a figure exemplifying the correspondence between a customer's feature amount and attribute information in a table format. It is a figure which illustrates another example of attribute information. It is a figure exemplifying the output information. It is a figure which illustrates the window for changing the content of output information. It is a block diagram which illustrates the information processing apparatus of Embodiment 2. It is a flowchart which illustrates the flow of the process executed by the information processing apparatus of Embodiment 2. It is a figure which illustrates the history information in a table format. It is a block diagram which illustrates the information processing apparatus of Embodiment 3. It is a flowchart which illustrates the flow of the process executed by the information processing apparatus of Embodiment 3. It is a figure which illustrates the input screen.

Hereinafter, embodiments of the present invention will be described with reference to the drawings. In all drawings, similar components are designated by the same reference numerals, and description thereof will be omitted as appropriate. Further, in each block diagram, unless otherwise specified, each block represents a configuration of a functional unit rather than a configuration of a hardware unit.

[Embodiment 1]
FIG. 1 is a block diagram illustrating the information processing apparatus 2000 of the first embodiment together with its usage environment. The information processing apparatus 2000 has a calculation unit 2020 and an output control unit 2040. The storage device 10 stores the customer's feature amount and the customer's attribute information in association with each other. The attribute information of a certain customer indicates the attribute of the customer regarding the service used by the customer in the store. More specifically, the customer's attributes regarding the service are whether or not the customer uses the service (whether or not the service is used), or whether or not the customer owns the thing used when using the service (whether or not the customer owns the thing to be used when using the service). Whether or not you own the thing related to the use of the service) is shown. The thing used when using the service is, for example, a point card used when using the point service.

The calculation unit 2020 acquires an image captured by the customer. Further, the calculation unit 2020 calculates the feature amount of the customer included in the acquired captured image. The customer feature quantity is an arbitrary value representing the customer's appearance features (for example, facial features). The output control unit 2040 uses the calculated feature amount to acquire the attribute information associated with the customer feature amount included in the acquired captured image from the storage device 10. Then, the output control unit 2040 outputs the information based on the customer's attribute shown in the acquired attribute information. The information based on the customer's attribute shown in the attribute information is the information itself shown in the attribute information or the information shown in the attribute information processed by a predetermined method.

FIG. 2 is a diagram conceptually illustrating the operation of the information processing apparatus 2000 of the first embodiment. The customer 40 purchases the product by paying the product at the cash register terminal 50. The cash register terminal 50 is operated by a clerk 30. The camera 20 is installed near the cash register terminal 50 and images the customer 40. The storage device 10 stores attribute information indicating the customer's attribute regarding the point service in association with the customer's feature amount. More specifically, the attribute information indicates whether or not the customer owns a loyalty card.

The information processing apparatus 2000 acquires the feature amount of the customer 40 imaged by the camera 20. Here, it is assumed that the feature amount of the customer 40 is v1. The information processing device 2000 acquires the attribute information associated with the feature amount v1 from the storage device 10. In this attribute information, "Ownership of point card: Yes" is indicated. Therefore, the information processing apparatus 2000 outputs information indicating that "customer 40 owns a point card".

As a result, the clerk 30 knows that the customer 40 uses the point card. Therefore, the clerk 30 talks to the customer, for example, "Do you have a point card?" And prompts the customer to present the point card.

The attribute information associated with v2 indicates "ownership of point card: none". Therefore, when the feature amount of the face of the customer 40 is v2, the information processing apparatus 2000 outputs information indicating that "the customer 40 does not own the point card". In this case, for example, the clerk 30 does not require the customer 40 to present the point card. In addition, for example, the clerk 30 makes a remark for confirmation on the premise that the customer 40 does not have a point card, such as "You do not have a point card, right?".

<Action / effect>
In the present embodiment, the attribute information of the customer is stored in association with the feature amount of the customer that can be calculated from the captured image including the customer. If the method of identifying a customer by using the feature amount of the customer is used in this way, it is necessary to use an identifier (for example, a member ID (Identifier)) given to the customer to identify the customer in order to acquire the attribute information. No. Therefore, regardless of whether or not the customer is registered as a member, it is possible to acquire attribute information indicating whether or not the customer uses the service that the customer can use in the store or whether or not the customer owns the thing related to the service.

For example, it is assumed that the attribute information is information indicating "whether or not the member has a membership card". In this case, the attribute information is stored in association with the customer's member ID. In this method, the customer must be required to present the membership card in order to obtain attribute information indicating whether or not the customer has the membership card. That is, if the customer has not registered as a member, it cannot be determined whether or not the customer is requested to present the membership card.

On the other hand, in this case, the information processing apparatus 2000 of the present embodiment can calculate the customer's feature amount from the captured image including the customer and acquire the customer's attribute information using the feature amount. Therefore, the attribute information of the customer can be used to determine whether or not the customer is requested to present the membership card.

Hereinafter, the present embodiment will be described in more detail.

<Example of hardware configuration of information processing device 2000>
Each functional component of the information processing apparatus 2000 may be realized by hardware that realizes each functional component (eg, a hard-wired electronic circuit, etc.), or a combination of hardware and software (eg, example). It may be realized by a combination of an electronic circuit and a program that controls it). Hereinafter, a case where each functional component of the information processing apparatus 2000 is realized by a combination of hardware and software will be further described.

FIG. 3 is a diagram illustrating a computer 1000 for realizing the information processing apparatus 2000. The computer 1000 is various computers. For example, the computer 1000 is a personal computer (PC), a server machine, a tablet terminal, a smartphone, or the like. The computer 1000 may be a dedicated computer designed to realize the information processing apparatus 2000, or may be a general-purpose computer.

The computer 1000 includes a bus 1020, a processor 1040, a memory 1060, a storage device 1080, an input / output interface 1100, and a network interface 1120. The bus 1020 is a data transmission path for the processor 1040, the memory 1060, the storage device 1080, the input / output interface 1100, and the network interface 1120 to transmit and receive data to and from each other. The processor 1040 is an arithmetic processing unit such as a CPU (Central Processing Unit) or a GPU (Graphics Processing Unit). The memory 1060 is a main storage device realized by RAM (Random Access Memory) or the like. The storage device 1080 is an auxiliary storage device realized by a hard disk, SSD (Solid State Drive), ROM, a memory card, or the like. However, the storage device 1080 may be realized by the same hardware as the hardware used for realizing the main storage device, such as RAM.

The input / output interface 1100 is an interface for connecting the computer 1000 and the input / output device. For example, an input device such as a keyboard and a mouse and an output device such as a display device are connected to the input / output interface 1100.

The network interface 1120 is an interface for connecting to a communication network such as a WAN (Wide Area Network) or a LAN (Local Area Network).

The storage device 1080 stores a program module that realizes each function of the information processing apparatus 2000. The processor 1040 reads each of these program modules into the memory 1060 and executes them, thereby realizing each function corresponding to the program module.

<Processing flow>
FIG. 4 is a flowchart illustrating the flow of processing executed by the information processing apparatus 2000 of the first embodiment. The calculation unit 2020 acquires an image captured by the customer (S102). The calculation unit 2020 calculates the customer feature amount included in the captured image (S104). The output control unit 2040 uses the calculated feature amount to acquire the attribute information associated with the customer feature amount included in the captured image from the storage device 10 (S106). The output control unit 2040 outputs information based on the acquired attribute information (S108).

<Usage scene of information processing device 2000>
The information processing apparatus 2000 can be used in various scenes of dealing with customers. For example, the information processing device 2000 can be used in a scene in which a store clerk who operates a product registration device responds to a customer (a scene in which a product is registered as a settlement target). The product registration device is a cash register terminal used for registering a product as a payment target.

The attribute information used in this scene is, for example, whether to use a shopping bag, whether or not you have a point card, whether or not you need split chopsticks, and whether or not to put cold and warm products in the bag separately. , Whether or not to deliver the purchased item to home, whether or not a receipt is required, the payment method (cash, electronic money, or credit card), the type of card when making a payment with electronic money, or whether or not the person is a minor, etc. show. The clerk can use the output information based on these attribute information to determine whether or not to request the customer to present the point card.

In addition, for example, the information processing apparatus 2000 can be used in a scene of responding to a customer who has visited a restaurant. The attribute information used in this scene indicates, for example, whether to use a smoking seat or a non-smoking seat, whether to use a counter seat or a table seat, or whether or not a window seat is desired. The clerk can use the output information based on these attribute information to determine the seat to be provided to the customer.

In addition, for example, the information processing apparatus 2000 can be used in a scene where an order is received from a customer. The attribute information used in this scene is, for example, conditions related to seasoning and toppings (taste intensity, amount of toppings, or type of toppings, etc.) in ordering food and drink, whether to use chopsticks or forks, or Indicates whether to use a napkin, etc. The clerk can use the output information based on these attribute information to grasp the conditions required by the customer for food and drink.

<Example of computer 1000 that realizes information processing device 2000>
As a specific computer 1000 for realizing the information processing apparatus 2000, various computers can be adopted. For example, the computer 1000 is a server (hereinafter referred to as a store server) installed in a store where the information processing apparatus 2000 is used. In addition, for example, the computer 1000 may be a server (hereinafter referred to as an external server) installed outside the store where the information processing apparatus 2000 is used.

Further, for example, the computer 1000 may be a product registration device. In this case, the information processing device 2000 is operated by a store clerk who responds to customers using, for example, a product registration device. The product registration device may be provided integrally with the payment device or may be provided separately from the payment device. The settlement device is a cash register terminal used for settlement processing (payment, etc.) of products registered as settlement targets.

When the product registration device and the settlement device are integrated, the registration process for registering the product as the settlement target and the settlement process for the product registered as the settlement target (payment, etc.) are performed using the same cash register terminal. Will be done. The format in which the customer performs the registration process and the settlement process is called a self-format. On the other hand, when the product registration device and the settlement device are separate bodies, the process of registering the product as the settlement target and the settlement process of the product registered as the settlement target are performed by different cash register terminals. This format is called a semi-self format, for example, the product registration device is operated by a store clerk, and the checkout device is operated by a customer.

In addition, for example, the computer 1000 may be a mobile terminal used by a clerk. The mobile terminal used by the clerk is, for example, a mobile terminal operated by the clerk to record which seat the customer was guided to, or a mobile terminal operated by the clerk to record an order received from the customer.

<Acquisition of captured image: S102>
The calculation unit 2020 acquires an image captured by the customer. Therefore, a camera 20 that captures a customer and generates an captured image is installed in the store. The camera 20 may be a camera that generates a moving image or a camera that captures a still image. In the former case, the captured image is an image frame constituting a moving image.

The camera 20 is provided at a position where the customer can be imaged. When taking an image of a customer who pays for a product, the camera 20 is installed, for example, in or near the product registration device. When photographing a customer who has visited a store, the camera 20 is installed at or near the entrance of the store, for example. When photographing a customer who places an order, the camera 20 is installed at or near the customer's seat, for example.

The method by which the calculation unit 2020 acquires the captured image is arbitrary. For example, the calculation unit 2020 acquires a captured image by accessing a storage device in which the captured image is stored. The storage device in which the captured image is stored may be provided inside the camera 20 that generated the captured image, or may be provided outside the camera 20. Further, for example, the calculation unit 2020 may acquire the captured image by receiving the captured image transmitted from the camera 20 or the like.

<Calculation of customer features: S104>
The calculation unit 2020 calculates the customer feature amount included in the acquired captured image (S104). Here, an existing technique can be used as a technique for calculating the feature amount of the person included in the image.

<About attribute information>
The attribute information indicates the customer's attributes regarding the service used by the customer. An example of attribute information is as described above.

FIG. 5 is a diagram illustrating the correspondence between the customer feature amount and the attribute information in a table format. The table of FIG. 5 is called a table 500. The table 500 has two columns, the feature amount 502 and the attribute information 504. The feature amount 502 indicates the feature amount of the customer. The attribute information 504 indicates the above-mentioned attribute information.

Here, the table 500 may further indicate the conditions to which the attribute information is applied. For example, it is assumed that the attribute information indicates an attribute related to the use of the shopping bag (whether or not the shopping bag is used, etc.). In this case, the condition to which the attribute information is applied is, for example, the quantity (number, weight, volume, etc.) of the product purchased by the customer. The attribute information indicates whether or not a shopping bag is used, the number of shopping bags to be used, and the like, in association with the range such as the number of products purchased by the customer.

FIG. 6 is a diagram illustrating another example of attribute information. In FIG. 6, the table 500 has an application condition 506. The application condition 506 indicates a condition to which the attribute information is applied. For example, the record in the second row of the table 500 in FIG. 6 indicates that "when a customer with a facial feature amount of v1 purchases less than three products, this customer does not use the shopping bag". .. On the other hand, the record in the third row of the table 500 in FIG. 6 shows that "when a customer having a facial feature amount of v1 purchases three or more products, this customer uses a shopping bag". There is. Further, the record in the fifth row of the table 500 in FIG. 6 indicates that "a customer whose facial feature amount is v2 does not unconditionally use the buying bag".

<Acquisition of attribute information: S104>
The output control unit 2040 acquires the attribute information associated with the customer feature amount included in the captured image by using the customer feature amount calculated by the calculation unit 2020. Specifically, the output control unit 2040 is associated with the customer feature amount having a high degree of similarity to the customer feature amount calculated by the calculation unit 2020 among the attribute information stored in the storage device 10. Get the attribute information that exists. For example, the output control unit 2040 acquires the attribute information stored in the storage device 10 in association with the same feature amount as the feature amount calculated by the calculation unit 2020. In addition, for example, the output control unit 2040 stores the feature amount stored in the storage device 10 in association with the feature amount whose degree of similarity to the feature amount calculated by the calculation unit 2020 is equal to or more than a predetermined value. The attribute information stored in the device 10 is acquired. In addition, for example, the output control unit 2040 stores the feature amount stored in the storage device 10 in association with the feature amount having the highest degree of similarity to the feature amount calculated by the calculation unit 2020. Get the stored attribute information. The predetermined value may be set in advance in the output control unit 2040, or may be stored in a storage device accessible from the output control unit 2040.

Any storage device accessible from the output control unit 2040 can be adopted as the storage device 10. The storage device 10 may be provided inside the information processing device 2000 or may be provided outside the information processing device 2000. In the former case, for example, the storage device 10 is realized as the storage device 1080 of FIG. In the latter case, for example, the storage device 10 is realized as a NAS (Network Attached Storage) provided outside the information processing device 2000.

<Output by output control unit 2040: S106>
The output control unit 2040 outputs information based on the customer's attribute (hereinafter referred to as output information) shown in the acquired attribute information. FIG. 7 is a diagram illustrating output information. In the example of FIG. 7, the information processing device 2000 is a product registration device operated by a store clerk. The display screen 60 is a screen displayed on a display device connected to the product registration device. On the display screen 60, information on the product read by the clerk with a barcode reader or the like, the total price of the product, and the like are displayed.

Further, the display screen 60 includes a window 62. The window 62 is a window containing output information. The output control unit 2040 controls the display device to display the window 62 on the display device.

In the example of FIG. 7, there are two types of attribute information. The first type of attribute information indicates whether or not the customer uses the shopping bag. The second type of attribute information indicates whether or not the customer owns a loyalty card.

In this example, the feature amount of customer A is associated with the attribute information of the first type "use of shopping bag: none" and the attribute information of the second type "ownership of point card: yes". ing. Therefore, in the window 62 output by the output control unit 2040, the information "use of shopping bag: none" and "ownership of point card: yes" is shown.

For example, in the example of FIG. 7, a store clerk operates a product registration device. In this case, the clerk who sees the window 62 knows that the customer A does not use the shopping bag and that the customer A owns the point card. Therefore, the clerk asks customer A to show the point card by asking "Do you have a point card?". On the other hand, since the customer A does not use the shopping bag, for example, the clerk does not ask the customer A a question about the shopping bag. In addition, for example, the clerk may ask a question confirming that the shopping bag is unnecessary, such as "You do not need the shopping bag, right?".

In addition, for example, in the example of FIG. 7, it is assumed that the customer A operates the product registration device. In this case, the information processing device 2000 is a self-type device. The customer A who sees the window 62 confirms that he / she does not use the shopping bag and that he / she owns the point card, and presses the button 64. As a result, the product registration process in the product registration device proceeds to the next stage.

Here, the information processing apparatus 2000 may accept an input requesting a change in the content of the output information. FIG. 8 is a diagram illustrating a window for changing the content of the output information. The display screen 60 is omitted in FIG.

The window 62 of FIG. 8 has a button 66, which is a button for requesting a change in the content of the output information. Here, it is assumed that the window 62 displays "Use of shopping bag: None", but the customer thinks "I want to use the shopping bag this time". For example, even a customer who normally uses my bag may want to use a shopping bag because he / she has forgotten his / her bag.

In such a case, the customer presses the button 66. The output control unit 2040 displays, for example, the window 68 shown in FIG. 8B in response to the button 66 being pressed.

The window 68 has radio buttons for selecting whether or not to use the shopping bag and whether or not to own the point card. The default value of the radio button is set according to the content of the output information. The customer presses the OK button after changing the use of the shopping bag from "yes" to "no". By doing so, the customer can convey to the clerk that he / she wants to use the shopping bag.

When the clerk operates the product registration device, the window 68 may be operated by the clerk. In this case, for example, the clerk asks the customer about the content of the change to be added to the output information, and operates the window 68 according to the content heard from the customer.

Here, the information processing apparatus 2000 may or may not update the attribute information based on the content of the output information changed by using the window 68. Whether or not to update the attribute information may be predetermined or may be selected by the customer.

In the latter case, for example, the output control unit 2040 displays the window 68 of FIG. 8 (c) instead of the window 68 of FIG. 8 (b). The window 68 of FIG. 8 (c) has a radio button for selecting either "only this time" or "in the future". When the former is selected, the information processing apparatus 2000 does not update the attribute information based on the changes made by the customer. On the other hand, when the latter is selected, the information processing apparatus 2000 updates the attribute information based on the changes made by the customer.

The output method of the output information is not limited to the method of displaying on the display device. For example, the output information may be output by voice. In this case, for example, a clerk wears earphones in advance so that output information is output to the earphones.

When an output device such as a display device or an earphone is connected to the information processing device 2000, the output control unit 2040 outputs output information to these output devices. On the other hand, when the output device is not connected to the information processing device 2000, the information processing device 2000 transmits output information to another device to which the output device is connected. The device that received the output information controls the output device to output the output information. For example, when the information processing device 2000 is realized as a store server, the output control unit 2040 transmits output information to the product registration device operated by the store clerk. The product registration device that has received the output information controls the display device and earphones connected to the product registration device to output the output information.

The information processing apparatus 2000 may generate a message for the customer by using the attribute information and output the message. For example, it is assumed that the attribute information is information regarding whether or not the service is used. In this case, if the attribute information indicates that "service A is used", the message "service A is necessary" is output, and the attribute information indicates that "service A is not used". If so, the message "Service A is unnecessary" is output.

Similarly, a message in the case where the attribute information indicates whether or not the user owns an object (for example, a point card) used for using the service can be generated. For example, if the attribute information indicates "I own a point card", the message "You have a point card" is displayed, and the attribute information says "I do not own a point card". If it indicates that, the message "You do not have a reward card" is displayed.

By outputting a message according to the customer's attributes in this way, it is possible to alleviate the stress and discomfort of the customer who receives a question from the clerk. For example, some customers feel uncomfortable when a clerk asks "Do you want to use service A" every time even though you do not always use service A. On the other hand, when asked "You do not use service A," the customer feels that "the clerk knows you", so the customer does not feel uncomfortable or the customer feels uncomfortable. The degree becomes smaller.

[Embodiment 2]
FIG. 9 is a block diagram illustrating the information processing apparatus 2000 of the second embodiment. Except for the matters described below, the information processing apparatus 2000 of the second embodiment is the same as the information processing apparatus 2000 of the first embodiment.

The information processing apparatus 2000 of the second embodiment has a first generation unit 2060. The first generation unit 2060 generates attribute information using the history information. The history information is information showing the history of the customer's behavior and state regarding the use of the service. For example, the history information indicates whether or not the customer has used the shopping bag, whether or not the customer has presented a point card, and the like. Further, the first generation unit 2060 stores the generated attribute information in the storage device 10 in association with the customer feature amount calculated by the calculation unit 2020.

<Processing flow>
FIG. 10 is a flowchart illustrating the flow of processing executed by the information processing apparatus 2000 of the second embodiment. The calculation unit 2020 acquires the captured image and calculates the feature amount of the customer (S202, S204). Hereinafter, this customer is also referred to as "customer for which attribute information is generated". The first generation unit 2060 acquires history information (S206). The first generation unit 2060 generates attribute information using the acquired history information (S208). The first generation unit 2060 associates the feature amount calculated in S204 with the attribute information generated in S208 and stores it in the storage device 10 (S210).

<History information: S206>
As described above, the history information is information showing the history of the customer's behavior and state regarding the use of the service. FIG. 11 is a diagram illustrating history information in a table format. The table of FIG. 11 is referred to as a table 600. The table 600 has columns of feature quantity 602, history information 604, and date and time 606. The feature amount 602 indicates the feature amount of the customer. The history information 604 indicates the past behavior or state of the customer. The date and time 606 indicates a date and time corresponding to the action or state shown in the history information 604.

It is assumed that the history information is stored in advance in a storage device accessible from the first generation unit 2060. The first generation unit 2060 acquires history information from this storage device.

For the generation of the attribute information, only the history information (the behavior history of the customer for which the attribute information is generated) corresponding to the feature amount of the customer included in the acquired image may be used, and this history information may be used. In addition, other historical information may be used. In the former case, the first generation unit 2060 uses historical information associated with a feature amount having a high degree of similarity to the feature amount calculated by the calculation unit 2020 (for example, a feature amount that matches the calculated feature amount). get.

On the other hand, in the latter case, the first generation unit 2060 acquires, for example, all the history information. In addition, for example, the first generation unit 2060 acquires the history information of another customer who has something in common with the customer who is the target of generating the attribute information. What they have in common is, for example, age, gender, or personality.

For example, when the customer's age is used as a common point, the first generation unit 2060 acquires the history information of the customer whose age is close to the age estimated from the customer's feature amount calculated by the calculation unit 2020. Similarly, when the customer's gender is used as a common point, the first generation unit 2060 acquires the history information of the customer having the same gender as the customer's gender estimated by the calculation unit 2020. Similarly, when the customer's personality is used as a common point, the first generation unit 2060 acquires the customer history information classified into the same personality as the customer's personality estimated by the calculation unit 2020. Here, for example, a customer's personality is classified into a mild personality, a nervous personality, or a rough personality. A known technique can be used as a technique for estimating the age, sex, or personality of a person using the feature amount of the person's face.

When such common points of customers are used, it is preferable to store the history information of each customer in association with the information for identifying the common points of the customers (such as the age of the customer). The information for identifying the commonalities of the customers may be the age estimated from the feature quantity of the customer, or the actual age of the customer. In the latter case, the information for identifying the common points of the customers shall be grasped in advance by some method (for example, member information or questionnaire).

<Generation of attribute information: S208>
The first generation unit 2060 generates attribute information using the acquired history information (S208). When there is only one acquired history information, the first generation unit 2060 generates attribute information from the history information. For example, when "ownership of point card: none" is indicated in the history information, the first generation unit 2060 generates the attribute information "ownership of point card: none".

When there are a plurality of acquired history information, the first generation unit 2060 generates attribute information by statistically processing the acquired history information. For example, when generating attribute information regarding the presence or absence of possession of a point card, the first generation unit 2060 has a number of history information indicating "ownership of a point card: yes" and history information indicating "ownership of a point card: none". Compare the numbers of and generate attribute information with the contents of the history information with a large number. For example, when the number of history information indicating "ownership of point card: present" is larger, the first generation unit 2060 generates attribute information indicating "ownership of point card: present".

Here, the first generation unit 2060 may generate the attribute information by performing statistical processing in which the history information is weighted. For example, the first generation unit 2060 acquires the history information of all the customers, gives a large weight to the history information of the customers having common points with the customers included in the captured image acquired by the calculation unit 2020, and other history information. Attribute information is generated from these historical information after giving a small weight to.

For example, suppose that attribute information regarding whether or not a point card is owned is generated. Further, it is assumed that the history information is associated with the age of the customer (teens, 20s, 30s, etc.) divided by 10 years.

Under this condition, it is assumed that the age of the customer for which the attribute information is generated is "20's". In this case, the first generation unit 2060 gives a large weight to the history information of each customer in his twenties, and gives a small weight to the history information of customers of other ages.

In this way, by giving weights to the history information according to the common points with the customer who is the generation target of the attribute information, the generated attribute information has the common points with the customer who is the generation target of the attribute information. It becomes easier to reflect the behavior of. Therefore, it is possible to predict the attributes of the customer, which is the target of generating the attribute information, with high accuracy.

<Opportunity for the information processing apparatus 2000 of the second embodiment to perform processing>
A series of processes related to the generation of attribute information (process of FIG. 10) is executed, for example, at the timing when a customer who does not have the corresponding attribute information is treated. The information processing apparatus 2000 attempts to output output information for a customer who responds based on the function described in the first embodiment. Then, when the feature amount having a high degree of similarity to the customer feature amount included in the acquired image is not stored in the storage device 10, the first generation unit 2060 generates the attribute information by the method described above. According to this method, attribute information about a new customer is generated at the timing of serving a new customer. Therefore, new customer attribute information will be automatically generated. However, the timing at which the first generation unit 2060 generates the attribute information may be any timing, and is not limited to the timing at which the customer is served.

<Hardware configuration>
The hardware configuration of the computer that realizes the information processing apparatus 2000 of the second embodiment is represented by, for example, FIG. 3 as in the first embodiment. However, the storage device 1080 of the computer 1000 that realizes the information processing apparatus 2000 of the present embodiment further stores a program module that realizes the functions of the information processing apparatus 2000 of the present embodiment.

<Action / effect>
According to the information processing apparatus 2000 of the present embodiment, the attribute information of the customer is generated using the history information. Therefore, the attribute information of the customer is generated based on the past behavior and state of the customer and other customers. By doing this, the customer's attributes can be inferred with high accuracy.

If the attribute information is generated using only the history information of the customer for which the attribute information is generated, the future behavior or state of the customer can be predicted based on the tendency of the customer's past behavior or state. can.

In addition, by using the history information of customers other than the customer for which the attribute information is generated, the future behavior and state of the customer for which the attribute information is generated can be obtained based on the tendency of the past behaviors and states of various customers. Can be predicted. This method is particularly suitable, for example, in the case where the customer for which the attribute information is generated is a new customer and the history information of the customer does not exist.

Furthermore, by using the history information of a customer who has something in common with the customer who is the target of generating attribute information, the attribute is based on the past behavior and state tendency of the customer who has something in common with the customer who is the target of generating attribute information. It is possible to predict the future behavior and state of the customer who is the target of information generation.

[Embodiment 3]
FIG. 12 is a block diagram illustrating the information processing apparatus 2000 of the third embodiment. Except for the matters described below, the information processing apparatus 2000 of the third embodiment is the same as the information processing apparatus 2000 of the first embodiment or the information processing apparatus 2000 of the second embodiment.

The information processing apparatus 2000 of the third embodiment has an input receiving unit 2080 and a second generation unit 2100. The input reception unit 2080 receives an input representing the customer's attribute regarding the service for the customer included in the captured image acquired by the calculation unit 2020. The second generation unit 2100 generates attribute information based on the input received by the input reception unit 2080. Further, the second generation unit 2100 stores the generated attribute information in the storage device 10 in association with the customer feature amount included in the captured image acquired by the calculation unit 2020.

<Processing flow>
FIG. 13 is a flowchart illustrating the flow of processing executed by the information processing apparatus 2000 of the third embodiment. The calculation unit 2020 calculates the customer's feature amount using the captured image (S302, S304). The input receiving unit 2080 receives an input representing a customer's attribute related to the service (S306). The second generation unit 2100 generates attribute information based on the received input (S308). The second generation unit 2100 stores the calculated special information amount and the generated attribute information in the storage device 10 in association with each other (S310).

<Acceptance of input: S306>
Various methods can be adopted as the method for the input receiving unit 2080 to receive the input. For example, the input to the input receiving unit 2080 is performed using the input screen displayed on the display device. For example, this display device is configured by using a touch panel that accepts input operations.

FIG. 14 is a diagram illustrating an input screen. The input screen 80 is an input screen displayed on the display device. The input screen 80 has an input area 82 and an input area 84. The input area 82 is an input area for receiving input regarding whether or not the shopping bag is used. The input area 84 is an input area that accepts input regarding whether or not a point card is owned.

For example, assume that the input screen 80 is displayed on the display device of the product registration device. This display device can be viewed and operated by a clerk. The clerk asks the customer if a shopping bag is needed and inputs the result in the input area 82. Similarly, the clerk asks the customer if he / she has a point card and inputs the result in the input area 84. By storing the attribute information generated using these results in the storage device 10, when the same customer visits the store again, the clerk asks whether or not this customer uses the shopping bag, and this customer is the point. You will be able to know if you have a card before asking the customer.

The input to the input screen 80 may be performed by the customer. In this case, the input screen 80 is displayed on a display device that can be viewed and operated by the customer. For example, in the product registration device, in addition to the display device for viewing by the clerk, a display device for viewing by the customer is separately provided.

Here, a default value may be set on the input screen 80. The default value is, for example, a preset fixed value. For example, set the default value for whether or not you have a point card to "Yes". In this case, "Yes" is displayed as the default value in the input area 84.

Further, for example, the default value may be calculated using the history information described above. Specifically, the attribute information generated by the first generation unit 2060 of the second embodiment is used as the default value. For example, when the attribute information "possession of point card: yes" is generated by the first generation unit 2060 of the second embodiment, the default value of the input area 84 is set to "yes".

By calculating the default value using the history of the customer's behavior and state in this way, the probability that the customer's actual behavior and state match the default value is higher than when the fixed value is used as the default value. .. If the actual behavior or state of the customer matches the default value, the clerk or the customer does not need to input to the input area 82 or the input area 84. Therefore, the labor of the clerk is reduced.

<Generation of attribute information: S308>
The second generation unit 2100 generates attribute information using the input received by the input reception unit 2080 (S308). For example, when the input "Ownership of point card: Yes" is accepted, the second generation unit 2100 generates the attribute information "Ownership of point card: Yes".

<Opportunity for the information processing apparatus 2000 of the third embodiment to perform processing>
A series of processes related to the generation of attribute information (process of FIG. 13) is performed, for example, at the timing when a customer who does not have the corresponding attribute information is treated. The information processing apparatus 2000 attempts to output output information for a customer who responds based on the function described in the first embodiment. When the attribute information associated with the feature amount having a high degree of similarity to the customer feature amount included in the acquired image is not stored in the storage device 10, the information processing device 2000 may use the above-mentioned input screen 80 or the like. Is output. Then, the information processing apparatus 2000 generates attribute information using the received input. According to this method, attribute information about a new customer is generated at the timing of serving a new customer.

In addition, for example, a series of processes related to the generation of attribute information may be started in response to an operation of a clerk. For example, the display device of the terminal operated by the clerk (for example, the display device of the product registration device) is displayed with a button for transitioning to the input screen 80 described above. The clerk displays the input screen 80 by pressing the button, and inputs the customer's attribute by himself or causes the customer to input the attribute.

The input triggered by the operation of the clerk is performed, for example, to update the attribute information. For example, when dealing with a certain customer, it is assumed that the output information output by the output control unit 2040 indicates "ownership of point card: none", but the customer presents the point card. In this case, the clerk displays the input screen 80 and inputs "Own point card: Yes". In response to this input, the second generation unit 2100 generates the attribute information "possession of the point card: yes", and instead of the existing attribute information associated with the above-mentioned customer feature amount, the generated attribute information. Is stored in the storage device 10. That is, the second generation unit 2100 updates the attribute information using the input received by the input reception unit 2080.

<Hardware configuration>
The hardware configuration of the computer that realizes the information processing apparatus 2000 of the third embodiment is represented by, for example, FIG. 3 as in the first embodiment. However, the storage device 1080 of the computer 1000 that realizes the information processing apparatus 2000 of the present embodiment further stores a program module that realizes the functions of the information processing apparatus 2000 of the present embodiment.

<Action / effect>
According to the information processing apparatus 2000 of the present embodiment, an input regarding a customer's attribute is received, and the attribute information is generated using the input. By doing so, it is possible to generate attribute information that predicts the future behavior or state of the customer based on the actual behavior or state of the customer. Therefore, the customer attribute information can be generated with high accuracy.
<Modification example>
The second generation unit 2100 can also generate attribute information using the information input using the customer's mobile terminal. The customer inputs information about the customer's attributes using a mobile terminal. The input reception unit 2080 receives the information input using the customer's mobile terminal. The second generation unit 2100 generates attribute information using the input received by the input reception unit 2080. This makes it possible to generate attribute information without visiting the store.

Although the embodiments of the present invention have been described above with reference to the drawings, these are examples of the present invention, and combinations of the above embodiments or various configurations other than the above can be adopted.

Some or all of the above embodiments may also be described, but not limited to:
1. 1. A calculation means for calculating the feature amount of the customer using the captured image captured by the customer, and
From the storage device that stores attribute information indicating whether or not the customer has used the service that can be used by the customer or whether or not the customer owns the thing related to the use, in association with the characteristic amount of the customer. An output control means that acquires the attribute information associated with the customer's feature amount and outputs information based on the acquired attribute information.
Information processing device with.
2. 2. The attribute information is generated using the history information indicating the history of the customer's behavior or state regarding the use of the service, and the generated attribute information is stored in the storage device in association with the customer's feature amount included in the acquired image. It has a generation means to be stored in 1. The information processing device described in.
3. 3. The generation means generates the attribute information using the history information of each of the plurality of customers. The information processing device described in.
4. An input receiving means for accepting input regarding the use of the service for the customer included in the acquired image.
As a generation means that generates the attribute information based on the input received by the input receiving means, and stores the generated attribute information in the storage device in association with the customer's feature amount included in the acquired image. ,
1. The information processing device described in.
5. 1. The storage device stores the attribute information in association with the conditions to which the attribute information is applied. To 4. The information processing device described in any one.
6. The attribute information indicates whether or not a shopping bag is used.
The condition to which the attribute information is applied is a condition relating to the quantity of the product to be purchased. The information processing device described in.
7. The output control means further outputs a message asking the customer whether or not to use the service, and further outputs the message.
The message output when the acquired attribute information indicates that the service is used and the message output when the acquired attribute information indicates that the service is not used are different from each other. ~ 6. The information processing device described in any one.
8. 1. It is connected to at least one of a display unit that displays the attribute information toward the customer and a display unit that displays the attribute information toward the clerk. ~ 7. The information processing device according to any one of the above.

9. A control method performed by a computer
A calculation step for calculating the feature amount of the customer using the captured image captured by the customer, and
From the storage device that stores attribute information indicating whether or not the customer has used the service that can be used by the customer or whether or not the customer owns the thing related to the use, in association with the characteristic amount of the customer. A control method having an output control step of acquiring the attribute information associated with a customer's feature amount and outputting information based on the acquired attribute information.
10. The attribute information is generated using the history information indicating the history of the customer's behavior or state regarding the use of the service, and the generated attribute information is stored in the storage device in association with the customer's feature amount included in the acquired image. Has a generation step to be stored in 9. The control method described in.
11. In the generation step, the attribute information is generated using the history information of each of the plurality of customers. The control method described in.
12. An input reception step for accepting input regarding the use of the service for the customer included in the acquired captured image, and
With the generation step of generating the attribute information based on the input received in the input reception step and storing the generated attribute information in the storage device in association with the customer's feature amount included in the acquired image. ,
Has 9. The control method described in.
13. 9. The storage device stores the attribute information in association with the conditions to which the attribute information is applied. To 12. The control method described in any one.
14. The attribute information indicates whether or not a shopping bag is used.
The condition to which the attribute information is applied is a condition relating to the quantity of the product to be purchased. The control method described in.
15. In the output control step, a message asking the customer whether or not to use the service is further output.
The message output when the acquired attribute information indicates that the service is used and the message output when the acquired attribute information indicates that the service is not used are different from each other. ~ 14. The control method described in any one.
16. 9. The computer is connected to at least one of a display unit that displays the attribute information toward the customer and a display unit that displays the attribute information toward the clerk. ~ 15. The control method described in any one of the above.

17. 9. To 16. A program that causes a computer to execute each step of the control method described in any one of them.

10 Storage device 20 Camera 30 Clerk 40 Customer 50 Cash register terminal 60 Display screen 62 Window 64 Button 66 Button 68 Window 80 Input screen 82 Input area 84 Input area 500 Table 502 Feature amount 504 Attribute information 506 Applicable conditions 600 Table 602 Feature amount 604 History Information 606 Date 1000 Computer 1020 Bus 1040 Processor 1060 Memory 1080 Storage device 1100 Input / output interface 1120 Network interface 2000 Information processing device 2020 Calculation unit 2040 Output control unit 2060 1st generation unit 2080 Input reception unit 2100 2nd generation unit

Claims (19)

A calculation means for calculating the feature amount of the customer using the captured image captured by the customer, and
From the storage device that stores the attribute information indicating whether or not the customer owns the item related to the use of the service that can be used by the customer in the store in association with the characteristic amount of the customer, the property amount is associated with the customer. An output control means that acquires the attribute information and outputs the acquired attribute information.
The attribute information is generated using the history information indicating the history of the customer's behavior or state regarding the use of the service, and the generated attribute information is stored in the storage device in association with the customer's feature amount included in the acquired image. And the generation method to be stored in
Have a,
The generation means is
A history in which a customer whose attribute information does not exist in the storage device is targeted for generation of the attribute information, and the customer is associated with a feature amount having a high degree of similarity to the feature amount of the customer calculated by the calculation means. Get at least one piece of information
An information processing device that generates the attribute information of the customer who is the target of generating the attribute information from the acquired history information. The generation means is
For the customer to be generated of the attribute information, at least one of age, gender, and personality is estimated as the attribute information of the customer from the feature amount of the customer calculated by the calculation means.
Acquire the history information of other customers who have the same attribute information as the estimated attribute information of the customer,
The information processing apparatus according to claim 1 , wherein the attribute information of the customer, which is the target of generating the attribute information, is generated from the acquired history information. The information processing apparatus according to claim 2 , wherein the generation means generates the attribute information of the customer who is the target of generating the attribute information by statistically processing the history information of the plurality of other customers. The information according to claim 2 , wherein the generation means generates the attribute information of the customer, which is the target of generation of the attribute information, by performing statistical processing in which the history information of the plurality of other customers is weighted. Processing equipment. A calculation means for calculating the feature amount of the customer using the captured image captured by the customer, and
From the storage device that stores the attribute information indicating whether or not the customer owns the item related to the use of the service that can be used by the customer in the store in association with the characteristic amount of the customer, the property amount is associated with the customer. It has an output control means for acquiring the attribute information and outputting the acquired attribute information .
The output control means is
A screen showing a message for confirming to the customer the attribute information indicating whether or not the customer has used the service or whether or not the customer owns the thing related to the use is displayed on the device operated by the customer.
A screen for accepting an input requesting a change in attribute information indicating whether or not the customer has used the service or whether or not the customer owns the thing related to the use is displayed on the device operated by the customer.
When the input requesting the change is received, the device operated by the customer further displays a screen for accepting the selection of whether the change of the attribute information is only this time or will be continued in the future.
An information processing device that updates the attribute information of the customer based on the change operated by the customer when the selection that the change of the attribute information is continued is accepted. The information processing device according to any one of claims 1 to 5, wherein the attribute information includes information indicating whether or not the point card is owned. The information processing apparatus according to any one of claims 1 to 6, wherein the attribute information further includes information indicating whether or not a customer of the service is used. Before SL history information includes information indicating whether the use of information or shopping bag indicating whether the presented point card, an information processing apparatus according to any one of claims 1 to 7. It has an input receiving means for receiving an input related to the use of the service for the customer included in the acquired image.
The generation means generates the attribute information based on the input received by the input receiving means, and associates the generated attribute information with the feature amount of the customer included in the acquired captured image in the storage device. Ru was stored, the information processing apparatus according to any one of 請Motomeko 1 to 8. The information processing device according to any one of claims 1 to 9, wherein the storage device stores the attribute information in association with a condition to which the attribute information is applied. The attribute information indicates whether or not a shopping bag is used.
The information processing device according to claim 10, wherein the condition to which the attribute information is applied is a condition relating to the quantity of the product to be purchased. The output control means is used as a message asking the customer whether or not to use the service.
When the acquired attribute information indicates that the service is used, a message confirming that the service is used is output to the customer.
To indicate that a message is output, the acquired attribute information does not use the service, it outputs a message confirming to the customer that does not use the service, any one of claims 1 to 11 The information processing device described in. The information processing according to any one of claims 1 to 12, which is connected to at least one of a display unit that displays the attribute information toward the customer and a display unit that displays the attribute information toward the clerk. Device. The output control means outputs the attribute information to a mobile terminal used by a clerk, and outputs the attribute information to a mobile terminal used by the clerk.
The mobile terminal includes at least one of a mobile terminal operated by a clerk to record which seat the customer is guided to and a mobile terminal operated by the clerk to record an order received from the customer. the information processing apparatus according to any one of claim 1 1 3. A control method performed by a computer
A calculation step for calculating the feature amount of the customer using the captured image captured by the customer, and
From the storage device that stores the attribute information indicating whether or not the customer owns the item related to the use of the service that can be used by the customer in the store in association with the characteristic amount of the customer, the property amount is associated with the customer. An output control step that acquires the attribute information and outputs the acquired attribute information.
The attribute information is generated using the history information indicating the history of the customer's behavior or state regarding the use of the service, and the generated attribute information is stored in the storage device in association with the customer's feature amount included in the acquired image. a generating step of storing, the possess in,
In the generation step
A history in which a customer whose attribute information does not exist in the storage device is targeted for generation of the attribute information, and the customer is associated with a feature amount having a high degree of similarity to the feature amount of the customer calculated by the calculation step. Get at least one piece of information
A control method for generating the attribute information of the customer who is the target of generating the attribute information from the acquired history information. A control method performed by a computer
A calculation step for calculating the feature amount of the customer using the captured image captured by the customer, and
From the storage device that stores the attribute information indicating whether or not the customer owns the item related to the use of the service that can be used by the customer in the store in association with the characteristic amount of the customer, the property amount is associated with the customer. is the attribute information acquired is, have a, and an output control step of outputting the acquired attribute information,
The output control step is
A screen showing a message for confirming to the customer the attribute information indicating whether or not the customer has used the service or whether or not the customer owns the thing related to the use is displayed on the device operated by the customer.
A screen for accepting an input requesting a change in attribute information indicating whether or not the customer has used the service or whether or not the customer owns the thing related to the use is displayed on the device operated by the customer.
When the input requesting the change is received, the device operated by the customer further displays a screen for accepting the selection of whether the change of the attribute information is only this time or will be continued in the future.
A control method for updating the attribute information of the customer based on the change operated by the customer when the selection that the change of the attribute information is continued is accepted. The control method according to claim 15 , wherein the attribute information includes information indicating whether or not the point card is owned. The control method according to any one of claims 15 to 17, wherein the attribute information further includes information indicating whether or not a customer of the service is used. A program that causes a computer to execute each step of the control method according to any one of claims 15 to 18.

Images