JP7772183B2 - Information processing device, control method, and program - Google Patents

Description

The present invention relates to an information processing device and a control method.

Technology for managing customer information in POS (Point of Sales) systems and the like has been developed. For example, Patent Document 1 discloses technology for managing customer information such as their name, address, and whether or not they use plastic bags, in association with a customer's identification number that can be read from their membership card.

Japanese Patent Application Laid-Open No. 2007-102527

The system in Patent Document 1 uses a customer identifier read from the customer's membership card. Therefore, unless the customer is registered as a member, customer information cannot be obtained.

The present invention was made in consideration of the above-mentioned problems. One of the objects of the present invention is to provide technology that can acquire customer information related to services that can be used by the customer, regardless of whether the customer is a registered member or not.

The information processing device of the present invention comprises:
an acquisition means for acquiring an image including the customer;
a generating means for generating attribute information of the customer based on the history information of the customer;
an output means for outputting attribute information corresponding to the customer identified by the image;
and
The attribute information includes information about the seat used by the customer in the store.

The control method of the present invention is executed by a computer that implements an information processing device.
The control method includes:
Get an image containing the customer,
generating attribute information of the customer based on historical information of the customer;
outputting attribute information corresponding to the customer identified by the image;
This includes:
The attribute information includes information about the seat used by the customer in the store.

The program of the present invention causes a computer to execute each step of the control method of the present invention.

The present invention provides technology that can obtain customer information regarding services available to customers, regardless of whether they are registered members.

1 is a block diagram illustrating an example of an information processing apparatus according to a first embodiment together with its usage environment. FIG. 2 is a diagram conceptually illustrating an example of the operation of the information processing apparatus according to the first embodiment. FIG. 1 is a diagram illustrating a computer for realizing an information processing device. 10 is a flowchart illustrating the flow of processing executed by the information processing apparatus according to the first embodiment. FIG. 10 is a diagram illustrating an example of the correspondence between customer features and attribute information in a table format. FIG. 10 is a diagram illustrating another example of attribute information. FIG. 10 is a diagram illustrating an example of output information. FIG. 10 is a diagram illustrating an example of a window for changing the contents of output information. FIG. 10 is a block diagram illustrating an information processing apparatus according to a second embodiment. 10 is a flowchart illustrating the flow of processing executed by an information processing apparatus according to a second embodiment. FIG. 10 is a diagram illustrating an example of history information in a table format. FIG. 10 is a block diagram illustrating an information processing apparatus according to a third embodiment. 11 is a flowchart illustrating the flow of processing executed by an information processing apparatus according to a third embodiment. FIG. 10 is a diagram illustrating an example of an input screen.

Embodiments of the present invention will be described below with reference to the drawings. Note that in all drawings, similar components will be given similar reference numerals and descriptions will be omitted where appropriate. Furthermore, in each block diagram, unless otherwise specified, each block represents a functional configuration rather than a hardware configuration.

[Embodiment 1]
FIG. 1 is a block diagram illustrating an information processing device 2000 according to a first embodiment together with its usage environment. The information processing device 2000 includes a calculation unit 2020 and an output control unit 2040. The storage device 10 stores customer features and attribute information of the customer in association with each other. The attribute information of a certain customer indicates the customer's attributes related to a service used by the customer at a store. More specifically, the customer's attributes related to the service indicate whether or not the customer uses the service (whether or not the customer uses the service) or whether or not the customer owns an item used when using the service (whether or not the customer owns an item related to the use of the service). An example of an item used when using a service is a point card used when using a point service.

The calculation unit 2020 acquires a captured image of a customer. The calculation unit 2020 further calculates the customer's feature amounts contained in the acquired captured image. The customer's feature amounts are arbitrary values that represent the customer's appearance characteristics (e.g., facial features). The output control unit 2040 uses the calculated feature amounts to acquire attribute information associated with the customer's feature amounts contained in the acquired captured image from the storage device 10. The output control unit 2040 then outputs information based on the customer's attributes indicated in the acquired attribute information. The information based on the customer's attributes indicated in the attribute information is the information indicated in the attribute information itself, or information indicated in the attribute information that has been processed using a predetermined method.

Figure 2 is a diagram conceptually illustrating the operation of the information processing device 2000 of embodiment 1. A customer 40 purchases a product by paying for it at a cash register terminal 50. The cash register terminal 50 is operated by a store clerk 30. A camera 20 is installed near the cash register terminal 50 and captures an image of the customer 40. The storage device 10 stores attribute information indicating the customer's attributes related to the point service, in association with the customer's features. More specifically, the attribute information indicates whether the customer has a point card.

The information processing device 2000 acquires the feature amount of the customer 40 captured by the camera 20. Here, let's assume that the feature amount of the customer 40 is v1. The information processing device 2000 acquires the attribute information associated with the feature amount v1 from the storage device 10. This attribute information indicates "Point card ownership: Yes." Therefore, the information processing device 2000 outputs information indicating that "Customer 40 owns a point card."

This allows the store clerk 30 to understand that the customer 40 will be using a point card. The store clerk 30 may then ask the customer, for example, "Do you have a point card?" to encourage the customer to present the card.

The attribute information associated with v2 indicates "Point card ownership: None." Therefore, if the facial feature of customer 40 is v2, the information processing device 2000 outputs information indicating that "customer 40 does not own a point card." In this case, for example, the store clerk 30 does not ask customer 40 to present a point card. Alternatively, for example, the store clerk 30 may make a statement to confirm that customer 40 does not own a point card, such as "You don't have a point card, do you?"

<Actions and Effects>
In this embodiment, customer attribute information is stored in association with customer feature amounts that can be calculated from a captured image that includes the customer. By using this method of identifying a customer using customer feature amounts, it is not necessary to use an identifier (e.g., a member ID) assigned to the customer to identify the customer in order to obtain attribute information. Therefore, regardless of whether the customer is a registered member, attribute information indicating whether the customer uses a service available at the store or whether the customer owns an item related to the service can be obtained.

For example, suppose the attribute information is information indicating whether or not a customer has a membership card. In this case, the attribute information is stored in association with the customer's membership ID. With this method, in order to obtain the attribute information indicating whether or not the customer has a membership card, the customer must be asked to present their membership card. In other words, if the customer has not registered as a member, it is not possible to determine whether or not to ask the customer to present their membership card.

In this case, the information processing device 2000 of this embodiment can calculate the customer's features from a captured image that includes the customer, and use these features to obtain the customer's attribute information. Therefore, the customer's attribute information can be used to determine whether or not to request the customer to present a membership card.

This embodiment will be described in further detail below.

<Example of Hardware Configuration of Information Processing Device 2000>
Each functional component of the information processing device 2000 may be realized by hardware that realizes the functional component (e.g., a hardwired electronic circuit, etc.), or may be realized by a combination of hardware and software (e.g., a combination of an electronic circuit and a program that controls it, etc.). Below, a case where each functional component of the information processing device 2000 is realized by a combination of hardware and software will be further described.

Figure 3 is a diagram illustrating an example of a computer 1000 for realizing the information processing device 2000. The computer 1000 may be any type of computer. For example, the computer 1000 may be a personal computer (PC), a server machine, a tablet terminal, or a smartphone. The computer 1000 may be a dedicated computer designed to realize the information processing device 2000, or may be a general-purpose computer.

The computer 1000 has a bus 1020, a processor 1040, a memory 1060, a storage device 1080, an input/output interface 1100, and a network interface 1120. The bus 1020 is a data transmission path through which the processor 1040, the memory 1060, the storage device 1080, the input/output interface 1100, and the network interface 1120 transmit and receive data to and from each other. The processor 1040 is a processing unit such as a CPU (Central Processing Unit) or a GPU (Graphics Processing Unit). The memory 1060 is a main storage device realized by RAM (Random Access Memory) or the like. The storage device 1080 is an auxiliary storage device realized by a hard disk, SSD (Solid State Drive), ROM, or memory card. However, the storage device 1080 may be realized by hardware similar to the hardware used to realize the main storage device, such as RAM.

The input/output interface 1100 is an interface for connecting the computer 1000 to input/output devices. For example, input devices such as a keyboard and a mouse, and output devices such as a display device are connected to the input/output interface 1100.

The network interface 1120 is an interface for connecting to a communication network such as a WAN (Wide Area Network) or LAN (Local Area Network).

The storage device 1080 stores program modules that realize each function of the information processing device 2000. The processor 1040 reads each of these program modules into the memory 1060 and executes them to realize each function corresponding to that program module.

<Processing flow>
4 is a flowchart illustrating the flow of processing executed by the information processing device 2000 according to the first embodiment. The calculation unit 2020 acquires a captured image of a customer (S102). The calculation unit 2020 calculates the feature amounts of the customer included in the captured image (S104). The output control unit 2040 uses the calculated feature amounts to acquire attribute information associated with the feature amounts of the customer included in the captured image from the storage device 10 (S106). The output control unit 2040 outputs information based on the acquired attribute information (S108).

<Usage Scenes of Information Processing Device 2000>
The information processing device 2000 can be used in various situations where customers are served. For example, the information processing device 2000 can be used in a situation where a store clerk who operates a product registration device serves a customer (a situation where a product is registered as a payment target). The product registration device is a cash register terminal used to register a product as a payment target.

The attribute information used in this scenario indicates, for example, whether or not a shopping bag is used, whether or not the customer has a point card, whether or not disposable chopsticks are needed, whether or not hot and cold items are to be separated into bags, whether or not the purchases will be delivered to the customer's home, whether or not a receipt is needed, the payment method (cash, electronic money, or credit card), the type of card used when paying with electronic money, or whether or not the customer is a minor. Store clerks can use the output information based on this attribute information to decide whether or not to ask the customer to present their point card.

For example, the information processing device 2000 can also be used in situations where customers are served at a restaurant. The attribute information used in this situation indicates, for example, whether the customer would like a smoking or non-smoking seat, whether they would like a counter seat or a table seat, or whether they would like a window seat. The staff can use the output information based on this attribute information to decide which seat to offer to the customer.

For example, the information processing device 2000 can also be used in situations where an order is received from a customer. The attribute information used in this situation indicates, for example, the conditions regarding seasoning and toppings when ordering food and drink (such as the strength of flavor, the amount of toppings, or the type of toppings), whether chopsticks or a fork are used, or whether a napkin is used. The waiter can use the output information based on this attribute information to understand the conditions the customer has for the food and drink.

<Example of computer 1000 realizing information processing device 2000>
Various types of computers can be used as the specific computer 1000 for realizing the information processing device 2000. For example, the computer 1000 is a server (hereinafter referred to as a store server) installed in a store where the information processing device 2000 is used. Alternatively, the computer 1000 may be a server (hereinafter referred to as an external server) installed outside the store where the information processing device 2000 is used.

For example, the computer 1000 may also be a product registration device. In this case, the information processing device 2000 is operated by, for example, a store clerk who uses the product registration device to serve customers. The product registration device may be provided integrally with a payment device, or may be provided separately from the payment device. A payment device is a cash register terminal used for payment processing (such as payment of the price) for products registered as items to be paid for.

When the product registration device and the settlement device are integrated, the registration process to register products as items to be settled and the settlement process (such as paying the price) for products registered as items to be settled are carried out using the same cash register terminal. A format in which the registration process and settlement process are carried out by the customer is called a self-service format. On the other hand, when the product registration device and the settlement device are separate, the process to register products as items to be settled and the settlement process for products registered as items to be settled are carried out at different cash register terminals. This format is called a semi-self-service format, in which, for example, the product registration device is operated by a store clerk and the settlement device is operated by the customer.

In another example, the computer 1000 may be a mobile terminal used by a store clerk. A mobile terminal used by a store clerk is, for example, a mobile terminal operated by a store clerk to record which seat a customer has been shown to, or a mobile terminal operated by a store clerk to record orders received from customers.

<Acquisition of captured image: S102>
The calculation unit 2020 acquires captured images of customers. To this end, a camera 20 is installed in the store to capture images of customers and generate captured images. The camera 20 may be a camera that generates video or a camera that captures still images. In the former case, the captured images are image frames that make up the video.

Camera 20 is installed in a position where it can capture an image of the customer. When capturing an image of a customer paying for a product, camera 20 is installed, for example, at or near the product registration device. When capturing an image of a customer entering the store, camera 20 is installed, for example, at or near the store entrance. When capturing an image of a customer placing an order, camera 20 is installed, for example, at or near the customer's seat.

The calculation unit 2020 may acquire the captured image by any method. For example, the calculation unit 2020 may acquire the captured image by accessing a storage device in which the captured image is stored. The storage device in which the captured image is stored may be provided inside the camera 20 that generated the captured image, or may be provided outside the camera 20. Furthermore, for example, the calculation unit 2020 may acquire the captured image by receiving the captured image transmitted from the camera 20 or the like.

<Calculation of Customer Features: S104>
The calculation unit 2020 calculates the feature amount of the customer included in the acquired captured image (S104). Here, existing technology can be used to calculate the feature amount of the person included in the image.

<About attribute information>
The attribute information indicates the attributes of the customer regarding the service that the customer uses. Examples of the attribute information are as described above.

Figure 5 is a diagram illustrating the correspondence between customer features and attribute information in table format. The table in Figure 5 is called table 500. Table 500 has two columns: feature 502 and attribute information 504. Feature 502 indicates the customer's feature. Attribute information 504 indicates the attribute information described above.

Here, table 500 may further indicate the conditions under which the attribute information applies. For example, the attribute information may indicate attributes related to the use of shopping bags (such as whether or not shopping bags are used). In this case, the condition to which the attribute information applies is, for example, the quantity (number, weight, volume, etc.) of items purchased by the customer. The attribute information indicates whether or not shopping bags are used, the number of shopping bags to be used, etc., in association with a range of the number of items purchased by the customer.

Figure 6 is a diagram illustrating another example of attribute information. In Figure 6, table 500 has application conditions 506. Application conditions 506 indicate the conditions under which attribute information is applied. For example, the record on the second row of table 500 in Figure 6 indicates that "if a customer whose facial feature is v1 purchases less than three items, this customer will not use a shopping bag." On the other hand, the record on the third row of table 500 in Figure 6 indicates that "if a customer whose facial feature is v1 purchases three or more items, this customer will use a shopping bag." Furthermore, the record on the fifth row of table 500 in Figure 6 indicates that "if a customer whose facial feature is v2 purchases three or more items, this customer will use a shopping bag unconditionally."

<Acquisition of attribute information: S104>
The output control unit 2040 uses the customer feature calculated by the calculation unit 2020 to acquire attribute information associated with the customer feature included in the captured image. Specifically, the output control unit 2040 acquires attribute information associated with a customer feature that has a high similarity to the customer feature calculated by the calculation unit 2020 from the attribute information stored in the storage device 10. For example, the output control unit 2040 acquires attribute information stored in the storage device 10 in association with the same feature calculated by the calculation unit 2020. As another example, the output control unit 2040 acquires attribute information stored in the storage device 10 in association with a feature stored in the storage device 10 whose degree of similarity to the feature calculated by the calculation unit 2020 is equal to or greater than a predetermined value. As another example, the output control unit 2040 acquires attribute information stored in the storage device 10 in association with a feature stored in the storage device 10 whose degree of similarity to the feature calculated by the calculation unit 2020 is highest from the feature stored in the storage device 10. The predetermined value may be set in advance in the output control unit 2040 or may be stored in a storage device accessible from the output control unit 2040 .

The storage device 10 can be any storage device accessible from the output control unit 2040. The storage device 10 may be provided inside the information processing device 2000 or outside the information processing device 2000. In the former case, the storage device 10 is realized, for example, as the storage device 1080 in FIG. 4. In the latter case, the storage device 10 is realized, for example, as a NAS (Network Attached Storage) provided outside the information processing device 2000.

<Output by output control unit 2040: S106>
The output control unit 2040 outputs information (hereinafter, output information) based on the customer attributes indicated in the acquired attribute information. FIG. 7 is a diagram illustrating an example of output information. In the example of FIG. 7, the information processing device 2000 is a product registration device operated by a store clerk. The display screen 60 is a screen displayed on a display device connected to the product registration device. The display screen 60 displays product information read by the store clerk using a barcode reader or the like, the total price of the products, and the like.

The display screen 60 further includes a window 62. The window 62 is a window that contains output information. The output control unit 2040 controls the display device to display the window 62 on the display device.

In the example of Figure 7, there are two types of attribute information. The first type of attribute information indicates whether the customer uses a shopping bag. The second type of attribute information indicates whether the customer has a point card.

In this example, the feature of customer A is associated with a first type of attribute information, "Shopping bag use: No," and a second type of attribute information, "Point card ownership: Yes." Therefore, the window 62 output by the output control unit 2040 displays the information, "Shopping bag use: No," and "Point card ownership: Yes."

For example, in the example of Figure 7, suppose a store clerk operates the product registration device. In this case, the clerk sees window 62 and realizes that customer A does not use a shopping bag and that customer A has a point card. The clerk then asks customer A, "Do you have a point card?", asking for the point card. However, since customer A does not use a shopping bag, the clerk does not ask customer A about the shopping bag, for example. Alternatively, the clerk may ask a question to confirm that a shopping bag is not needed, such as, "You do not need a shopping bag, do you?"

As another example, in the example of Figure 7, assume that customer A operates the product registration device. In this case, the information processing device 2000 is a self-service device. After viewing window 62, customer A confirms that he or she will not be using a shopping bag and that he or she has a point card, and then presses button 64. As a result, the product registration process in the product registration device proceeds to the next stage.

Here, the information processing device 2000 may accept input requesting a change to the content of the output information. Figure 8 is a diagram showing an example of a window for changing the content of the output information. Note that the display screen 60 is omitted from Figure 8.

Window 62 in Figure 8 has button 66, which is a button for requesting a change to the content of the output information. Here, suppose that window 62 displays "Shopping bag use: No," but the customer thinks, "I would like to use a shopping bag this time." For example, even if a customer normally uses their own bag, they may want to use a shopping bag because they forgot their own bag, etc.

In such a case, the customer presses button 66. In response to the pressing of button 66, the output control unit 2040 displays, for example, window 68 shown in FIG. 8(b).

Window 68 has radio buttons for selecting whether or not to use a shopping bag and whether or not to own a point card. The default values of the radio buttons are set according to the content of the output information. After changing the shopping bag usage setting from "Yes" to "No," the customer presses the OK button. In this way, the customer can communicate to the store clerk that they wish to use a shopping bag.

When a store clerk operates the product registration device, window 68 may be operated by the clerk. In this case, for example, the clerk may ask the customer what changes they would like to make to the output information, and operate window 68 in accordance with what the customer tells them.

Here, the information processing device 2000 may or may not update the attribute information based on the content of the output information changed using window 68. Whether or not to update the attribute information may be determined in advance, or may be selected by the customer.

In the latter case, for example, the output control unit 2040 displays window 68 in FIG. 8(c) instead of window 68 in FIG. 8(b). Window 68 in FIG. 8(c) has radio buttons for selecting either "Just this once" or "In the future." If the former is selected, the information processing device 2000 does not update the attribute information based on changes made by the customer. On the other hand, if the latter is selected, the information processing device 2000 updates the attribute information based on changes made by the customer.

Note that the method for outputting the output information is not limited to displaying it on a display device. For example, the output information may be output as audio. In this case, for example, the store clerk may wear earphones in advance, and the output information may be output to those earphones.

If output devices such as a display device or earphones are connected to the information processing device 2000, the output control unit 2040 outputs output information to these output devices. On the other hand, if an output device is not connected to the information processing device 2000, the information processing device 2000 transmits the output information to another device to which the output device is connected. The device that receives the output information controls the output device to output the output information. For example, if the information processing device 2000 is implemented as a store server, the output control unit 2040 transmits the output information to a product registration device operated by a store clerk. The product registration device that receives the output information controls the display device or earphones connected to the product registration device to output the output information.

The information processing device 2000 may also use attribute information to generate a message for the customer and output that message. For example, suppose the attribute information is information regarding whether or not a service will be used. In this case, if the attribute information indicates that "Service A will be used," the message "Service A is necessary" is output, and if the attribute information indicates that "Service A will not be used," the message "Service A is unnecessary" is output.

Messages can also be generated in a similar manner when the attribute information indicates whether or not the user owns an item used to use a service (such as a point card). For example, if the attribute information indicates that the user owns a point card, the message "You have a point card, don't you?" is displayed; if the attribute information indicates that the user does not own a point card, the message "You do not have a point card, do you?" is displayed.

By outputting messages tailored to each customer's attributes in this way, it is possible to reduce the stress and discomfort customers feel when asked questions by store clerks. For example, some customers may feel uncomfortable if a store clerk always asks them, "Would you like to use Service A?" even though they do not normally use Service A. On the other hand, if the clerk asks, "You won't be using Service A, will you?", the customer will feel that "the store clerk understands me," and the customer will not feel uncomfortable, or the degree of discomfort they feel will be reduced.

[Embodiment 2]
9 is a block diagram illustrating an information processing apparatus 2000 according to the second embodiment. Except for the matters described below, the information processing apparatus 2000 according to the second embodiment is the same as the information processing apparatus 2000 according to the first embodiment.

The information processing device 2000 of embodiment 2 has a first generation unit 2060. The first generation unit 2060 generates attribute information using history information. The history information is information that indicates the history of a customer's actions and status regarding the use of a service. For example, the history information indicates whether a customer used a shopping bag or whether the customer presented a point card. Furthermore, the first generation unit 2060 associates the generated attribute information with the customer's features calculated by the calculation unit 2020 and stores the information in the storage device 10.

<Processing flow>
10 is a flowchart illustrating the flow of processing executed by the information processing device 2000 according to the second embodiment. The calculation unit 2020 acquires a captured image and calculates features of the customer (S202, S204). Hereinafter, this customer will also be referred to as the "customer for whom attribute information is to be generated." The first generation unit 2060 acquires history information (S206). The first generation unit 2060 generates attribute information using the acquired history information (S208). The first generation unit 2060 associates the features calculated in S204 with the attribute information generated in S208, and stores the associated information in the storage device 10 (S210).

<Regarding History Information: S206>
As described above, history information is information that indicates the history of a customer's actions and status regarding the use of a service. FIG. 11 is a diagram illustrating an example of history information in a table format. The table in FIG. 11 is denoted as table 600. Table 600 has columns of feature amount 602, history information 604, and date and time 606. Feature amount 602 indicates a feature amount of a customer. History information 604 indicates the customer's past actions and status. Date and time 606 indicates the date and time corresponding to the action or status indicated in history information 604.

The history information is assumed to be stored in advance in a storage device accessible by the first generation unit 2060. The first generation unit 2060 obtains the history information from this storage device.

To generate the attribute information, only history information corresponding to the features of the customer included in the captured image (the behavioral history of the customer for whom the attribute information is being generated) may be used, or other history information may be used in addition to this history information. In the former case, the first generation unit 2060 acquires history information associated with features that have a high degree of similarity to the features calculated by the calculation unit 2020 (for example, features that match the calculated features).

On the other hand, in the latter case, the first generation unit 2060 acquires, for example, all history information. Additionally, for example, the first generation unit 2060 acquires history information of other customers who have something in common with the customer for whom attribute information is being generated. The commonalities may be, for example, age, gender, or personality.

For example, if the customer's age is used as the common feature, the first generation unit 2060 acquires history information of customers whose age is close to the age estimated from the customer's features calculated by the calculation unit 2020. Similarly, if the customer's gender is used as the common feature, the first generation unit 2060 acquires history information of customers whose gender is the same as the customer's gender estimated by the calculation unit 2020. Similarly, if the customer's personality is used as the common feature, the first generation unit 2060 acquires history information of customers whose personality is classified as the same as the customer's personality estimated by the calculation unit 2020. Here, for example, the customer's personality is classified into types such as a gentle personality, a nervous personality, or a rough personality. Note that known technology can be used to estimate a person's age, gender, or personality using the features of their face.

When using such commonalities among customers, it is preferable to store each customer's history information in association with information for identifying the commonalities among customers (such as the customer's age). The information for identifying the commonalities among customers may be an age estimated from the customer's features, or the customer's actual age. In the latter case, the information for identifying the commonalities among customers is assumed to be known in advance by some method (for example, membership information or a questionnaire).

<Generation of attribute information: S208>
The first generating unit 2060 generates attribute information using the acquired history information (S208). If only one piece of history information is acquired, the first generating unit 2060 generates attribute information from that history information. For example, if the history information indicates "point card ownership: none", the first generating unit 2060 generates attribute information indicating "point card ownership: none".

When multiple pieces of history information have been acquired, the first generation unit 2060 generates attribute information by statistically processing the acquired history information. For example, when generating attribute information regarding whether or not a point card is owned, the first generation unit 2060 compares the number of pieces of history information indicating "Point card owned: yes" with the number of pieces of history information indicating "Point card owned: no", and generates attribute information based on the content of the history information with the greater number. For example, when there is a greater number of pieces of history information indicating "Point card owned: yes", the first generation unit 2060 generates attribute information indicating "Point card owned: yes".

Here, the first generation unit 2060 may generate attribute information by performing weighted statistical processing on the history information. For example, the first generation unit 2060 acquires the history information of all customers, assigns a large weight to the history information of customers who have something in common with the customers included in the captured image acquired by the calculation unit 2020, and assigns a small weight to the other history information, and then generates attribute information from this history information.

For example, suppose you want to generate attribute information regarding whether or not a customer owns a point card. Also, suppose the history information is associated with the customer's age in increments of 10 years (teens, twenties, thirties, etc.).

Under these conditions, suppose the age of the customer for whom attribute information is to be generated is "in their 20s." In this case, the first generation unit 2060 assigns a high weight to the history information of each customer in their 20s, and a low weight to the history information of customers of other ages.

In this way, by assigning weights to history information based on the commonalities with the customer for whom attribute information is being generated, the generated attribute information is more likely to reflect the behavior of customers who have commonalities with the customer for whom attribute information is being generated. This makes it possible to predict with high accuracy the attributes of the customer for whom attribute information is being generated.

<Trigger for performing processing by the information processing apparatus 2000 according to the second embodiment>
A series of processes related to generating attribute information (the processes in FIG. 10 ) is executed, for example, when a customer for whom no corresponding attribute information exists is served. The information processing device 2000 attempts to output output information about the served customer based on the functions described in the first embodiment. If the storage device 10 does not store any feature quantities that are highly similar to the feature quantities of the customer contained in the acquired captured image, the first generation unit 2060 generates attribute information using the method described above. According to this method, attribute information about a new customer is generated when the customer is served. Therefore, attribute information about the new customer is automatically generated. However, the timing when the first generation unit 2060 generates attribute information may be any timing and is not limited to the timing when the customer is served.

<Hardware configuration>
The hardware configuration of the computer that realizes the information processing device 2000 of the second embodiment is shown in Fig. 3, for example, as in the first embodiment. However, the storage device 1080 of the computer 1000 that realizes the information processing device 2000 of this embodiment further stores a program module that realizes the functions of the information processing device 2000 of this embodiment.

<Actions and Effects>
According to the information processing device 2000 of this embodiment, customer attribute information is generated using history information. Therefore, the customer attribute information is generated based on the past actions and states of the customer and other customers. This makes it possible to estimate customer attributes with high accuracy.

Furthermore, if attribute information is generated using only the historical information of the customer for whom the attribute information is being generated, it is possible to predict the customer's future behavior and state based on the customer's past behavior and state trends.

Furthermore, by using historical information of customers other than the customer for whom the attribute information is being generated, it is possible to predict the future behavior and state of the customer for whom the attribute information is being generated based on trends in the past behavior and state of various customers. This method is particularly suitable in cases where, for example, the customer for whom the attribute information is being generated is a new customer and therefore no historical information exists for that customer.

Furthermore, by using historical information about customers who share commonalities with the customer for whom attribute information is being generated, it is possible to predict the future behavior and state of the customer for whom attribute information is being generated based on the past behavior and state trends of customers who share commonalities with the customer for whom attribute information is being generated.

[Embodiment 3]
12 is a block diagram illustrating an information processing apparatus 2000 according to embodiment 3. Except for the matters described below, the information processing apparatus 2000 according to embodiment 3 is similar to the information processing apparatus 2000 according to embodiment 1 or embodiment 2.

The information processing device 2000 of embodiment 3 has an input accepting unit 2080 and a second generating unit 2100. The input accepting unit 2080 accepts input representing customer attributes related to services for customers included in the captured image acquired by the calculation unit 2020. The second generating unit 2100 generates attribute information based on the input accepted by the input accepting unit 2080. Furthermore, the second generating unit 2100 associates the generated attribute information with the feature amounts of the customers included in the captured image acquired by the calculation unit 2020 and stores the information in the storage device 10.

<Processing flow>
13 is a flowchart illustrating the flow of processing executed by the information processing device 2000 according to the third embodiment. The calculation unit 2020 calculates a feature quantity of a customer using a captured image (S302, S304). The input receiving unit 2080 receives input representing attributes of the customer related to the service (S306). The second generation unit 2100 generates attribute information based on the received input (S308). The second generation unit 2100 associates the calculated special report quantity with the generated attribute information and stores them in the storage device 10 (S310).

<Accepting input: S306>
Various methods can be adopted for the input acceptance unit 2080 to accept input. For example, input to the input acceptance unit 2080 is performed using an input screen displayed on a display device. For example, this display device is configured using a touch panel that accepts input operations.

Figure 14 is a diagram illustrating an example of an input screen. Input screen 80 is an input screen displayed on a display device. Input screen 80 has input area 82 and input area 84. Input area 82 is an input area that accepts input regarding whether or not a shopping bag is used. Input area 84 is an input area that accepts input regarding whether or not a point card is owned.

For example, suppose input screen 80 is displayed on the display device of the product registration device. This display device can be viewed and operated by a store clerk. The clerk asks the customer whether they need a shopping bag and enters the answer in input area 82. Similarly, the clerk asks the customer whether they have a point card and enters the answer in input area 84. By storing the attribute information generated using these results in storage device 10, when the same customer visits the store again, the clerk will be able to determine whether the customer will use a shopping bag or whether they have a point card before asking the customer.

In addition, input into the input screen 80 may be performed by the customer. In this case, the input screen 80 is displayed on a display device that can be viewed and operated by the customer. For example, the product registration device may be provided with a separate display device for customers to view in addition to a display device for store clerks to view.

Here, a default value may be set on the input screen 80. The default value may be, for example, a fixed value that is set in advance. For example, the default value for whether or not the user has a points card may be set to "Yes." In this case, "Yes" is displayed as the default value in the input area 84.

Also, for example, the default value may be calculated using the history information described above. Specifically, the attribute information generated by the first generation unit 2060 of embodiment 2 is used as the default value. For example, if the attribute information "Point card owned: Yes" is generated by the first generation unit 2060 of embodiment 2, the default value in the input area 84 is set to "Yes."

By calculating default values using the customer's behavior and state history in this way, the probability that the customer's actual behavior and state will match the default values increases compared to when fixed values are used as default values. If the customer's actual behavior and state match the default values, the store clerk or customer does not need to enter anything into input area 82 or input area 84. This reduces the work required of the store clerk.

<Generation of attribute information: S308>
The second generating unit 2100 generates attribute information using the input received by the input receiving unit 2080 (S308). For example, when the input "point card ownership: yes" is received, the second generating unit 2100 generates attribute information "point card ownership: yes".

<Trigger for performing processing by the information processing apparatus 2000 according to the third embodiment>
A series of processes related to generating attribute information (processing in FIG. 13 ) is performed, for example, when a customer for whom no corresponding attribute information exists is served. The information processing device 2000 attempts to output output information for the served customer based on the functions described in the first embodiment. If attribute information associated with features highly similar to the features of the customer contained in the acquired captured image is not stored in the storage device 10, the information processing device 2000 outputs the input screen 80 described above, etc. Then, the information processing device 2000 generates attribute information using the received input. According to this method, attribute information for a new customer is generated when the customer is served.

In other cases, the series of processes related to generating attribute information may be initiated in response to a store clerk's operation. For example, a button for transitioning to the aforementioned input screen 80 may be displayed on the display device of the terminal operated by the store clerk (e.g., the display device of the product registration device). The store clerk presses the button to display input screen 80, where the store clerk can enter information about the customer's attributes themselves or have the customer enter information about the attributes.

Input triggered by a store clerk's operation is performed, for example, to update attribute information. For example, when serving a certain customer, the output information output by the output control unit 2040 indicates "Point card owned: No," but the customer presents a point card. In this case, the store clerk displays the input screen 80 and enters an input indicating "Point card owned: Yes." In response to this input, the second generation unit 2100 generates attribute information indicating "Point card owned: Yes" and stores the generated attribute information in the storage device 10 in place of the existing attribute information associated with the customer's features. In other words, the second generation unit 2100 updates the attribute information using the input received by the input receiving unit 2080.

<Hardware configuration>
The hardware configuration of the computer that realizes the information processing device 2000 of the third embodiment is shown in Fig. 3, for example, as in the first embodiment. However, the storage device 1080 of the computer 1000 that realizes the information processing device 2000 of this embodiment further stores a program module that realizes the functions of the information processing device 2000 of this embodiment.

<Actions and Effects>
According to the information processing device 2000 of this embodiment, input regarding customer attributes is accepted, and attribute information is generated using the input. In this way, attribute information that predicts the future behavior and state of a customer can be generated based on the customer's actual behavior and state. Therefore, customer attribute information can be generated with high accuracy.
<Modification>
The second generation unit 2100 can also generate attribute information using information input using a customer's mobile device. The customer inputs information about the customer's attributes using the mobile device. The input receiving unit 2080 receives the information input using the customer's mobile device. The second generation unit 2100 generates attribute information using the input received by the input receiving unit 2080. This allows attribute information to be generated without the customer visiting the store.

The above describes embodiments of the present invention with reference to the drawings, but these are merely examples of the present invention, and combinations of the above embodiments or various other configurations may also be adopted.

A part or all of the above-described embodiments can be described as, but not limited to, the following supplementary notes.
1. A calculation means for calculating a feature amount of a customer using a captured image of the customer;
an output control means for acquiring attribute information associated with the characteristic amounts of a customer from a storage device that stores attribute information indicating whether the customer uses a service available to the customer at the store or whether the customer owns an item related to the service, in association with the characteristic amounts of the customer, and outputting information based on the acquired attribute information;
An information processing device having the above.
2. The information processing device described in 1., further comprising a generation unit that generates the attribute information using history information indicating a history of a customer's actions or status regarding the use of a service, and stores the generated attribute information in the storage device in association with a feature amount of the customer included in the acquired captured image.
3. The information processing device according to 2., wherein the generating means generates the attribute information using history information of each of a plurality of customers.
4. An input receiving means for receiving input regarding the use of a service for a customer included in the acquired captured image;
a generating means for generating the attribute information based on the input received by the input receiving means, and storing the generated attribute information in the storage device in association with a feature amount of the customer included in the acquired captured image;
1. The information processing device according to Item 1.
5. The information processing device according to any one of 1. to 4., wherein the storage device stores the attribute information in association with a condition to which the attribute information is applied.
6. The attribute information indicates whether or not a shopping bag is used,
5. The information processing device according to 5., wherein the condition to which the attribute information is applied is a condition related to the quantity of a product to be purchased.
7. The output control means further outputs a message to the customer asking whether or not to use the service;
7. The information processing device according to any one of 1. to 6., wherein a message output when the acquired attribute information indicates that a service will be used and a message output when the acquired attribute information indicates that the service will not be used are different from each other.
8. The information processing device described in any one of 1. to 7., which is connected to at least one of a display unit that displays the attribute information to the customer and a display unit that displays the attribute information to a store clerk.

9. A computer-implemented control method comprising:
a calculation step of calculating a feature amount of the customer using a captured image of the customer;
and an output control step of acquiring attribute information associated with the customer's characteristics from a storage device that stores attribute information indicating whether the customer uses a service available to the customer at the store or whether the customer owns an item related to the service, in association with the customer's characteristics, and outputting information based on the acquired attribute information.
10. The control method according to 9., further comprising a generating step of generating the attribute information using history information indicating a history of a customer's actions or status regarding the use of a service, and storing the generated attribute information in the storage device in association with a feature amount of the customer included in the acquired captured image.
11. The control method according to 10., wherein in the generating step, the attribute information is generated using history information of each of a plurality of customers.
12. An input receiving step of receiving input regarding the use of a service from a customer included in the acquired captured image;
a generating step of generating the attribute information based on the input received in the input receiving step, and storing the generated attribute information in the storage device in association with a feature amount of the customer included in the acquired captured image;
9. The control method according to claim 9,
13. The control method according to any one of 9. to 12., wherein the storage device stores the attribute information in further association with a condition to which the attribute information is applied.
14. The attribute information indicates whether or not a shopping bag is used,
14. The control method according to 13., wherein the condition to which the attribute information is applied is a condition related to the quantity of the product to be purchased.
15. In the output control step, a message asking the customer whether or not to use the service is further output,
The control method according to any one of 9. to 14., wherein a message output when the acquired attribute information indicates that a service will be used and a message output when the acquired attribute information indicates that the service will not be used are different from each other.
16. The control method described in any one of 9. to 15., wherein the computer is connected to at least one of a display unit that displays the attribute information to the customer and a display unit that displays the attribute information to a store clerk.

17. A program that causes a computer to execute each step of the control method described in any one of 9. to 16.

10 Storage device 20 Camera 30 Clerk 40 Customer 50 Cashier terminal 60 Display screen 62 Window 64 Button 66 Button 68 Window 80 Input screen 82 Input area 84 Input area 500 Table 502 Feature amount 504 Attribute information 506 Application conditions 600 Table 602 Feature amount 604 History information 606 Date and time 1000 Computer 1020 Bus 1040 Processor 1060 Memory 1080 Storage device 1100 Input/output interface 1120 Network interface 2000 Information processing device 2020 Calculation unit 2040 Output control unit 2060 First generation unit 2080 Input reception unit 2100 Second generation unit

Claims (13)

an acquisition means for acquiring an image including the customer;
a generating means for generating attribute information of the customer based on the history information of the customer;
an output means for outputting attribute information corresponding to the customer identified by the image;
Equipped with
The attribute information includes information about the seat used by the customer in the store.
Information processing device. The attribute information includes information indicating whether a smoking seat or a non-smoking seat is to be used.
The information processing device according to claim 1 . The attribute information includes information indicating whether the customer will use a counter seat or a table seat.
3. The information processing device according to claim 1. The attribute information includes information indicating whether a window seat is desired.
4. The information processing device according to claim 1. The image is an image of the customer who has come to the store captured by a camera installed at or near the entrance of the store.
The information processing device according to claim 1 . the output means outputs the attribute information at the timing when the store attends to the customer who has come to the store.
The information processing device according to claim 1 . the output means outputs the attribute information to a mobile terminal used by the store clerk.
The information processing device according to claim 1 . the output means outputs the attribute information to a display of the mobile terminal.
The information processing device according to claim 7 . the output means outputs the attribute information to an earphone connected to the mobile terminal.
9. The information processing device according to claim 7 or 8. the output means outputs the attribute information to a product registration device operated by a store clerk.
The information processing device according to claim 1 . the output means outputs the attribute information to a display device or earphones connected to the product registration device.
The information processing device according to claim 10. One or more computers
Get an image containing the customer,
generating attribute information of the customer based on historical information of the customer;
outputting attribute information corresponding to the customer identified by the image;
The attribute information includes information about the seat used by the customer in the store.
Control method. On the computer,
an acquisition step of acquiring an image including the customer;
a generation step of generating attribute information of the customer based on history information of the customer;
an output step of outputting attribute information corresponding to the customer identified by the image;
The attribute information includes information about the seat used by the customer in the store.
program.