JP7697534B2 - Store support device, system, method, and program - Google Patents

Description

The present invention relates to a store support device, system, method, and program, and in particular to a store support device, system, method, and program for supporting a store by notifying the store of customer information.

In stores, so-called CRM (Customer Relationship Management) is sometimes used to provide appropriate customer service to each customer. CRM is an information system that records and analyzes customer service information, including purchase history, for customers identified by their name, membership number, etc.

Furthermore, Patent Document 1 discloses a technology that analyzes images taken of customers to generate information related to their belongings, and outputs customer identification information if it is determined that appropriate services need to be provided to the customer based on the information related to their belongings.

JP 2021-105945 A

Here, the CRM described above provides services to customers who are pre-registered in a customer database. However, it can also be beneficial for a store to find customers other than registered customers who are candidates for customer service and provide appropriate customer service.

In view of the above-mentioned problems, the purpose of the present disclosure is to provide a store support device, system, method, and program for detecting customer service candidates from among customers and supporting the acquisition of new customers in physical stores.

A store support device according to a first aspect of the present disclosure includes:
An acquisition means for acquiring an image of the first customer taken by a camera installed in the commercial facility;
a first determination means for determining whether a first biometric authentication for first biometric information extracted from a region of the first customer in the acquired image has been successful or unsuccessful by referring to a first database in which biometric information is registered in advance as members of a store in the commercial facility;
an extraction means for extracting wearable item information relating to a wearable item from an area of the first customer when it is determined that the first biometric authentication has failed;
a second determination means for determining whether or not there is a relationship between the accessory and the item and a luxury level equal to or higher than a predetermined level based on the accessory information by referring to a second database that associates the item with a store that handles the item, and determining that the first customer is a candidate customer to be served if it is determined that there is such a relationship;
a notification means for notifying a first terminal of a related person in the commercial facility of notification information based on the wearable item information when the first customer is determined to be a customer-to-be;
Equipped with.

A store support system according to a second aspect of the present disclosure includes:
Cameras installed in commercial facilities,
A first terminal of a related person in the commercial facility;
a first database in which biometric information of a member of a store in the commercial facility is registered in advance;
a second database that associates products with stores that sell the products;
a store support device connected to the camera, the first terminal, the first database, and the second database;
Equipped with
The store support device includes:
An acquisition means for acquiring an image of the first customer taken by the camera;
a first determination means for determining whether a first biometric authentication for first biometric information extracted from a region of the first customer in the acquired image has been successful or unsuccessful by referring to the first database;
an extraction means for extracting wearable item information relating to a wearable item from an area of the first customer when it is determined that the first biometric authentication has failed;
a second determination means for referring to the second database and determining whether or not there is a correlation between the accessory and the product with a luxury level equal to or higher than a predetermined level based on the accessory information, and determining the first customer as a candidate customer to be served if it is determined that there is a correlation;
a notification means for notifying the first terminal of notification information based on the wearable item information when the first customer is determined to be a customer-to-be served;
Equipped with.

A store support method according to a third aspect of the present disclosure includes:
The computer
An image of a first customer is acquired by a camera installed in the commercial facility;
referring to a first database in which biometric information of a member of a store in the commercial facility is registered in advance, and determining whether a first biometric authentication for the first biometric information extracted from a region of the first store visitor in the acquired image is successful or unsuccessful;
If it is determined that the first biometric authentication has failed, extracting wearable item information relating to wearable items from an area of the first customer;
referring to a second database in which products are associated with stores that handle the products, and determining whether or not there is a correlation between the accessories and the products that is a predetermined level or higher of luxury based on the accessory information, and determining that there is a correlation between the accessories and the products that is a predetermined level or higher of luxury, and if there is a correlation, determining that the first customer is a candidate customer to be served;
When the first customer is determined to be a candidate customer to be served, notification information based on the wearable item information is sent to a first terminal of a related person in the commercial facility.

A store support program stored in a non-transitory computer-readable medium according to a fourth aspect of the present disclosure,
an acquisition process for acquiring an image of the first customer by a camera installed in the commercial facility;
a first determination process for determining whether a first biometric authentication for first biometric information extracted from a region of the first store visitor in the acquired image has been successful or unsuccessful by referring to a first database in which biometric information is registered in advance as a member of a store in the commercial facility;
an extraction process of extracting wearable item information related to a wearable item from an area of the first customer when it is determined that the first biometric authentication has failed;
a second determination process for determining whether or not there is a relationship between the accessory and the item and a luxury level equal to or higher than a predetermined level based on the accessory information by referring to a second database that associates the item with a store that handles the item, and determining that the first customer is a candidate customer to be served if it is determined that there is such a relationship;
a notification process for notifying a first terminal of a related person in the commercial facility of notification information based on the wearable item information when the first customer is determined to be a customer-to-be served;
to be executed by the computer.

This disclosure makes it possible to provide a store support device, system, method, and program for detecting customer service candidates from among customers and helping to acquire new customers in physical stores.

1 is a block diagram showing a configuration of a store support device according to a first embodiment of the present invention; 4 is a flowchart showing a flow of a store support method according to the first embodiment. FIG. 11 is a block diagram showing the overall configuration of a store support system according to a second embodiment of the present invention. FIG. 11 is a block diagram showing a configuration of a store support device according to a second embodiment of the present invention. 13 is a flowchart showing the flow of a store support process according to the second embodiment. 13 is a flowchart showing the flow of a store support process according to the third embodiment. FIG. 13 is a block diagram showing the overall configuration of a store support system according to a fourth embodiment. 13 is a flowchart showing the flow of a store support process according to the fourth embodiment. FIG. 13 is a block diagram showing the overall configuration of a store support system according to a fifth embodiment.

Hereinafter, an embodiment of the present disclosure will be described in detail with reference to the drawings. In each drawing, the same or corresponding elements are denoted by the same reference numerals, and duplicated explanations will be omitted as necessary for clarity of explanation.

<Embodiment 1>
1 is a block diagram showing the configuration of a store support device 1 according to the first embodiment. The store support device 1 is an information processing device for supporting sales promotion and the like in a specific store in a commercial facility including one or more stores. The store support device 1 is connected to a first database (not shown) and a second database (not shown).

The first database is a database system in which biometric information is pre-registered as a member of a store in a commercial facility. Here, biometric information is feature information indicating physical features extracted from an image capturing at least a part of a person's body. The biometric information is, for example, facial feature information, but is not limited to this. For example, the first database may be a first storage device that stores the member's identification information and biometric information in association with each other. Furthermore, the first storage device may be one built into the store support device 1, or one in a database server connected to the store support device 1 via a communication network.

The second database is a database system that associates products with stores that sell those products. The stores include at least stores within the above-mentioned commercial facility. Therefore, the stores registered in the second database are at least open within the above-mentioned commercial facility, and may include stores that do not necessarily have members' biometric information registered in the first database. For example, the second database may be a second storage device that stores products in association with stores. The second storage device may be built into the store support device 1, or may be in a database server connected to the store support device 1 via a communication network.

The store support device 1 includes an acquisition unit 11, a first determination unit 12, an extraction unit 13, a second determination unit 14, and a notification unit 15. The acquisition unit 11 acquires an image of a first store visitor taken by a camera (not shown) installed in a commercial facility. The first determination unit 12 refers to a first database and determines whether the first biometric authentication for the first biometric information extracted from the area of the first store visitor in the acquired image is successful or unsuccessful. Note that the first database has biometric information of members of the first store in the commercial facility preregistered. Therefore, if the first biometric authentication is successful, it indicates that the first store visitor is a member of the first store, and if the first biometric authentication fails, it indicates that the first store visitor is a non-member (unregistered member) of the first store. Therefore, the first determination unit 12 can be said to determine whether the first store visitor is a member of a specified store by the first biometric authentication. The first biometric information is biometric information extracted from a body region of the first customer from an acquired image by image recognition or the like.

When it is determined that the first biometric authentication has failed, that is, when it is determined that the first customer is not a member, the extraction unit 13 extracts wearable item information about the wearable item from the area of the first customer in the image. For example, the extraction unit 13 estimates the wearable item worn by the first customer by image recognition or the like. Here, the wearable item is an item worn by the first customer, and may be called a possession. The wearable item is, for example, a bag, ornaments (accessories, rings, necklaces, earrings, etc.), a wristwatch, glasses, sunglasses, shoes, clothes (coats, jackets, pants, skirts, etc.), etc., but is not limited to these. The wearable item information is information indicating an image of the area recognized as the wearable item in the image, the type of wearable item, the brand name, the product name, the color, the pattern, the logo, the material, the shape, etc.

The second determination unit 14 refers to the second database and determines whether or not there is a relationship between the accessory and the product with a level of luxury equal to or higher than a predetermined level based on the accessory information, and if there is a relationship, determines the first customer to be a candidate customer to be served. Here, the relationship between the accessory and the product may be, for example, a commonality of attributes between the accessory and the product, or a certain degree of similarity in product characteristics. For example, the association between the accessory and the product may mean that the accessory worn by the first customer is the same or similar product or product type as a product handled by a store in the commercial facility. Alternatively, the association between the accessory and the product may mean that the accessory and the product are the same or similar brand even if the product types are different. The association between the accessory and the product with a level of luxury equal to or higher than a predetermined level means that the accessory and the product are common or similar in that they are luxury products or brands equal to or higher than a certain level. Here, the luxury level is an index value according to the brand or price of the product, such as a numerical value, a class or rank (such as a symbol), a level value, or information that combines these. For example, the luxury level correlation between the accessory and the product may be a certain level or higher when the accessory and the product are clothing with a certain level or higher of luxury. Therefore, when there is a certain correlation between the accessory indicated by the accessory information and the product registered in the second database, it can be said that the first store visitor is likely to be wearing an accessory that has a certain commonality or similarity in attributes with the products handled at the store in the commercial facility. Therefore, it can be said that the first store visitor is likely to be interested in products that are related to the accessory. In addition, at this point, it is determined that the first store visitor is not a member of the store in the commercial facility. Therefore, in these cases, the second determination unit 14 can determine that the first store visitor is a customer service candidate.

When the first customer is determined to be a candidate customer to be served, the notification unit 15 notifies the first terminal of a person involved in the commercial facility of notification information based on the attached item information. Here, the person involved in the commercial facility is, for example, a clerk at a store in the commercial facility, or staff of the entire commercial facility. And, staff of the entire commercial facility refers to people other than clerks of a specific store, such as staff at the service counter of the commercial facility or a concierge for the entire commercial facility. And, the first terminal is an information terminal worn or carried by a person involved in the commercial facility, or a computer device connected to a screen visible to the person involved.

FIG. 2 is a flowchart showing the flow of the store support method according to the first embodiment. First, the acquisition unit 11 acquires an image of a first customer captured by a camera installed in a commercial facility (S11). Next, the first determination unit 12 refers to the first database and performs a first biometric authentication on the first biometric information extracted from the area of the first customer in the image acquired in step S11 (S12). For example, the first determination unit 12 identifies the face area of the first customer from the acquired image by image recognition or the like, and extracts facial feature information from the identified face area as the first biometric information. Alternatively, the first determination unit 12 acquires the first biometric information extracted from the image by another configuration (not shown). Then, the first determination unit 12 performs the first biometric authentication by matching the first biometric information with one or more pieces of biometric information registered in advance in the first database and calculating the degree of agreement.

Then, the first determination unit 12 determines whether the first biometric authentication is successful or unsuccessful (S13). Specifically, the first determination unit 12 compares the first biometric information with the biometric information registered in the first database to calculate the degree of match, and determines whether the degree of match is a predetermined value or more. If it is determined that the degree of match is a predetermined value or more, the first determination unit 12 determines that the first biometric authentication is successful. In that case, the processing of the store support method according to the first embodiment is terminated. On the other hand, if it is determined that the degree of match is less than the predetermined value, the first determination unit 12 determines that the first biometric authentication is unsuccessful. In other words, the first determination unit 12 determines whether the first store visitor is a member or not based on the authentication result of the first biometric authentication. If the authentication result indicates success, the first determination unit 12 determines that the first store visitor is a member. On the other hand, if the authentication result indicates failure, the first determination unit 12 determines that the first customer is a non-member, that is, a person not registered in the first database.

Alternatively, the first determination unit 12 may send an authentication request including the first biometric information to the first database and receive an authentication result from the authentication process performed in the first database. In this case, the first determination unit 12 may determine whether the first biometric authentication was successful or unsuccessful and whether the first customer is a member based on the received authentication result.

If the first biometric authentication fails (NO in step S13), i.e., if it is determined that the first customer is not a member, the extraction unit 13 extracts wearable item information about the wearable items from the area of the first customer in the image (S14). The second determination unit 14 then refers to the second database and determines whether or not there is an association between the wearable item and the product based on the wearable item information (S15). If there is an association between the wearable item and the product, the first customer is determined to be a candidate customer to be served. On the other hand, if there is no association between the wearable item and the product, the first customer is determined to not be a candidate customer to be served.

If it is determined in step S15 that there is a relationship between the attached item and the product, the notification unit 15 notifies the first terminal of the relevant person in the commercial facility of the notification information based on the attached item information (S16). After that, the processing of the store support method according to this embodiment 1 is terminated. Note that if it is determined in step S15 that there is no relationship between the attached item and the product, the processing of the store support method according to this embodiment 1 is terminated.

In this way, the store support device 1 according to the present embodiment can determine that the first customer is a non-member of a store in the commercial facility by referring to the first database from the first biometric information extracted by analyzing the image captured by a camera installed in a commercial facility including one or more stores. The store support device 1 can then extract the wearable item information of the non-member first customer from the captured image, and can determine that the first customer is a candidate customer to be served by referring to the second database when there is a certain correlation between the wearable item indicated by the wearable item information and the product. Here, the certain correlation is preferably a degree of luxury equal to or higher than a predetermined level, as described above. The store support device 1 notifies the terminal of the relevant person in the commercial facility when the first customer is a non-member of a store in the commercial facility and a candidate customer to be served. Therefore, the relevant person such as a store clerk can easily visually recognize that the first customer has entered the store by receiving a notification based on the wearable item information of the candidate customer to be served, and can easily provide appropriate customer service to the first customer. Therefore, it is possible to appropriately detect candidates for customer service from among customers, and to help acquire new customers at physical stores.

The store support device 1 includes a processor, a memory, and a storage device, which are not shown in the figure. The storage device also stores a computer program that implements the processing of the store support method according to this embodiment. The processor then loads the computer program, etc. from the storage device into the memory and executes the computer program. In this way, the processor realizes the functions of the acquisition unit 11, the first determination unit 12, the extraction unit 13, the second determination unit 14, and the notification unit 15.

Alternatively, each component of the store support device 1 may be realized by dedicated hardware. Also, some or all of the components of each device may be realized by general-purpose or dedicated circuits, processors, etc., or a combination of these. These may be configured by a single chip, or may be configured by multiple chips connected via a bus. Some or all of the components of each device may be realized by a combination of the above-mentioned circuits, etc., and programs. Also, as the processor, a CPU (Central Processing Unit), GPU (Graphics Processing Unit), FPGA (Field-Programmable Gate Array), quantum processor (quantum computer control chip), etc. may be used.

<Embodiment 2>
The second embodiment is a specific example of the first embodiment. FIG. 3 is a block diagram showing the overall configuration of a store support system 1000 according to the second embodiment. The store support system 1000 is an information system for providing support to each store in a commercial facility 100 including stores 110, . . . 1n0 (n is a natural number equal to or greater than 1) and the commercial facility 100. Specifically, the store support system 1000 photographs a first customer C1 with a camera 101 installed near the entrance of the commercial facility 100, and determines whether the first customer C1 is a candidate customer of any of the stores 110, etc., based on the analysis results of the photographed image. When the first customer C1 is determined to be a candidate customer, the store support system 1000 notifies the physical characteristics and the wearable item information of the customer to a terminal of a clerk of a store that handles the brand of the wearable item information of the first customer C1.

The store support system 1000 includes a camera 101, staff terminals 111, ... 1n1, a store support device 200, and a facility management server 300. Each of the camera 101, staff terminals 111, ... 1n1, the store support device 200, and the facility management server 300 is communicatively connected via a network N. Here, the network N is a wired or wireless communication line or communication network, such as an in-store LAN (Local Area Network), the Internet, a wireless communication line network, a mobile phone line network, etc. The network N can use any type of communication protocol.

The camera 101 is installed near the entrances and exits of the entire commercial facility 100. The camera 101 captures a predetermined shooting range near the entrances and exits at predetermined intervals or when a person is detected by a human presence sensor. The camera 101 transmits the captured images to the store support device 200 via the network N. For example, when a first customer C1 visits the commercial facility 100 and is near the entrances and exits, the first customer C1 is detected by the human presence sensor. Therefore, the camera 101 captures an image including the first customer C1. Note that multiple cameras may be installed within the commercial facility 100. The camera 101 may also be installed in a location other than the entrances and exits of the entire commercial facility 100.

Stores 110 to 1n0 are tenant stores operating in the commercial facility 100. For example, store 110 has at least store clerk S1. Store clerk S1 serves customers who enter store 110. Store clerk S1 wears a store clerk terminal 111 for work purposes. Store clerk terminal 111 is an example of a wearable terminal, such as a headset that supports wireless communication. Store clerk terminal 111 communicates with the store support device 200 and facility management server 300 via network N using a built-in computer and wireless communication function. For example, store clerk terminal 111 receives notification information of a customer from the store support device 200 or the like via network N, plays audio corresponding to the notification information, and outputs it from a speaker.

In addition, at least a clerk Sn is present in the store 1n0. The clerk Sn serves customers who enter the store 1n0. The clerk Sn carries a clerk terminal 1n1 for business purposes. The clerk terminal 1n1 is an example of a portable terminal, such as a smartphone or tablet terminal (compatible with wireless communication). The clerk terminal 1n1 communicates with the store support device 200 and the facility management server 300 via the network N using a built-in computer and wireless communication function. For example, the clerk terminal 1n1 receives notification information of a customer from the store support device 200 or the like via the network N, performs an incoming call notification operation (for example, a vibration operation or an application pop-up display) in response to the notification information, and displays a message or the like in response to the notification information on the screen.

Note that store clerks S1 to Sn are an example of related parties in the commercial facility described above. Also, store clerk terminals 111 to 1n1 are an example of the first terminal described above. Therefore, the store clerk terminal may be a computer and display device installed in the store. Also, related parties in the commercial facility 100 may be staff in a place other than the store 110, for example, an information center of the commercial facility 100. In that case, the first terminal may be a computer and display device installed in the information center.

The facility management server 300 is a computer server that manages various information related to the commercial facility 100. The facility management server 300 includes at least a member DB (DataBase) 310 and a product DB 320. The facility management server 300 accepts access to the member DB 310 and the product DB 320 from the store support device 200 and the like via the network N, performs processing on the member DB 310 and the like according to the access, and returns the processing result to the store support device 200 and the like via the network N. For example, when the facility management server 300 accepts a face recognition request including face information from the store support device 200, it compares the accepted face information with the face information 312 in the member DB 310 and returns the comparison result (face recognition result) to the store support device 200. Here, the face recognition result includes information indicating the success or failure of face recognition. In addition, when face recognition indicates success, the face recognition result includes member information for which face recognition has been successful (at least information for uniquely identifying a user (member), such as a member ID). Furthermore, when the facility management server 300 receives the wearing item information from the store support device 200, it compares the product information included in the wearing item information with the product information 321 in the product DB 320. When the degree of match between the product information 321 and the received product information is equal to or greater than a threshold, the facility management server 300 returns a set of the product information 321 and the store information 322 to the store support device 200. Alternatively, when the degree of match between the product information 321 including a luxury level 3211 equal to or greater than a predetermined level and the received product information is equal to or greater than a threshold, the facility management server 300 may return a set of the product information 321 and the store information 322 to the store support device 200. Other configurations of the facility management server 300 can be realized by known techniques.

Member DB 310 is an example of the first database described above. Member DB 310 is a database that manages member information 311, face information 312, and store information 313 in association with each other. Member information 311 is information for managing members who are registered as customers of at least one of stores 110, etc. Note that member information 311 may be member information for the entire commercial facility 100. Member information 311 includes a member ID, personal information such as name, gender, date of birth, etc., and purchase history, etc.

Facial information 312 is an example of the biometric information described above, and is facial feature information of the member. For example, facial information 312 is a collection of feature points and feature quantities extracted from a facial image of the member. Store information 313 is information that can identify the store for which the member is registered, and is, for example, store identification information, a store ID, etc. Store information 313 typically corresponds to one of stores 110, etc. within the commercial facility 100.

Facial information 312 does not have to be managed by facility management server 300. For example, an authentication device that associates and manages facial information with user IDs is provided outside facility management server 300, and the authentication device is connected to network N. In this case, member DB 310 only needs to uniquely match the member ID in member information 311 with the above-mentioned user ID. Furthermore, member information 311 and facial information 312 are registered in member DB 310, but are assumed to have been approved in advance by the member (customer).

Product DB 320 is an example of the second database described above. Product DB 320 is a database that manages product information 321 and store information 322 in association with each other. Product information 321 includes product ID, product name, product type, brand name, price, product image, color, pattern, logo, material, shape, etc. Product information 321 further includes luxury level 3211. Luxury level 3211 is an example of an index value according to the brand, price, etc. of the product corresponding to product information 321. Luxury level 3211 is, for example, a numerical value, a class or rank (symbol, etc.), a level value, or information that is a combination of these. It is assumed that product DB 320 manages at least product information 321 whose luxury level 3211 is at least a predetermined level or higher.

Store information 322 is information that identifies one of stores 110, etc. in commercial facility 100 that handles the product corresponding to product information 321. In other words, store information 322 is information that indicates a store that sells the product corresponding to product information 321. Therefore, one store information 322 may be associated with two or more product information 321. Also, two or more store information 322 may be associated with the same product information 321. Also, store information 322 is information that corresponds to store information 313 described above. Store information 322 includes, for example, a store ID, a store name, a store location, etc. Store information 322 further includes clerk terminal information 3221. Clerk terminal information 3221 is information about a first terminal that can be worn, carried, or viewed by a clerk working at the store corresponding to store information 322, and includes at least destination information that can be accessed via network N.

The store support device 200 is an example of the store support device 1 described above. The store support device 200 is an information processing device connected to the camera 101, the clerk terminals 111 to 1n1, the member DB 310, and the product DB 320 via the network N. When a first customer C1 who visits the commercial facility 100 is determined to be a customer service candidate, the store support device 200 notifies the clerk terminals 111, etc. of the store 110, etc., related to the wearable item information of the first customer C1 of the physical characteristics and wearable item information of the first customer C1. The store support device 200 may be redundantly configured with multiple servers, and each functional block may be realized by multiple computers.

Figure 4 is a block diagram showing the configuration of the store support device 200 according to this embodiment 2. The store support device 200 comprises a storage unit 210, a memory 220, a communication unit 230, and a control unit 240. The storage unit 210 is an example of a storage device such as a hard disk or flash memory. The storage unit 210 stores a program 211. The program 211 is a computer program in which the store support processing etc. according to this embodiment 2 are implemented.

The memory 220 is a volatile storage device such as a RAM (Random Access Memory), and is a storage area for temporarily storing information when the control unit 240 is operating. The communication unit 230 is a communication interface with the network N.

The control unit 240 is a processor, i.e., a control device, that controls each component of the store support device 200. The control unit 240 loads the program 211 from the storage unit 210 into the memory 220 and executes the program 211. In this way, the control unit 240 realizes the functions of an acquisition unit 241, an extraction unit 242, a determination unit 243, an identification unit 244, a generation unit 245, and a notification unit 246.

The acquisition unit 241 is an example of the acquisition unit 11 described above. The acquisition unit 241 acquires an image of the first customer C1 captured by the camera 101.

The extraction unit 242 is an example of the extraction unit 13 described above. The extraction unit 242 extracts face information of the first customer C1 from the image acquired by the acquisition unit 241. In addition, when the determination unit 243 determines that the first customer C1 is a non-member, the extraction unit 242 extracts the wearable item information from the area of the first customer C1 in the image. Specifically, the extraction unit 242 detects the areas of various wearable items by image recognition of the area of the first customer C1, analyzes the areas of each detected wearable item, and extracts the type, brand name, product name, color, pattern, logo, material, shape, etc. of the wearable item as wearable item information. Note that the logic for extracting the wearable item information from the area in the image may use a known image recognition technology. In addition, the extraction unit 242 may refer to a predetermined database or product DB 320 to extract the wearable item information.

In addition, the extraction unit 242 may further extract characteristic information related to the body or appearance of the first visitor C1 from the area of the first visitor C1. Specifically, the extraction unit 242 extracts characteristic information of the body or appearance of the first visitor C1 by image recognition of the area of the first visitor C1 in the image acquired by the acquisition unit 241. The characteristic information of the body or appearance includes, but is not limited to, for example, height, hair length, hairstyle, whether or not the person wears glasses, the shape of clothing, the color of clothing, etc. The logic for extracting the characteristic information of the body or appearance from the area in the image may use a known image recognition technology.

The determination unit 243 is an example of the first determination unit 12 and the second determination unit 14 described above. The determination unit 243 refers to the member DB 310 and performs the first face authentication on the face information extracted by the extraction unit 242. For example, the determination unit 243 transmits a face authentication request including the face information to the facility management server 300 and receives the face authentication result from the facility management server 300. Then, the determination unit 243 determines whether the first visitor C1 has succeeded in the first face authentication according to the face authentication result. If the face authentication result indicates that the first face authentication has succeeded, the determination unit 243 determines that the first visitor C1 is a member. On the other hand, if the face authentication result indicates that the first face authentication has failed, the determination unit 243 determines that the first visitor C1 is a non-member.

In addition, the determination unit 243 refers to the product DB 320 and determines whether the first customer C1 is a customer service candidate based on the wearable item information extracted by the extraction unit 242. Specifically, the determination unit 243 determines whether there is a certain correlation between the information indicated by the wearable item information and the product information 321 in the product DB 320. For example, there may be a certain correlation when the information indicated by the wearable item information is included in the product information 321 in the product DB 320. When there is a certain correlation, for example when the wearable item information is included in the product information 321, the determination unit 243 determines that the first customer C1 is a customer service candidate.

When it is determined that the first visitor C1 has succeeded in the first facial authentication, the identification unit 244 refers to the member DB 310 and identifies member information 311 based on the facial authentication result. The identification unit 244 then identifies store information 313 associated with the identified member information 311 as the notification destination. The identification unit 244 then identifies store clerk terminal information 3221 corresponding to the identified store information 313. The identification unit 244 also identifies a facial image that has been successfully authenticated based on the facial authentication result. For example, the identification unit 244 identifies the facial area of the first visitor C1 in the image as the facial image.

When the identification unit 244 determines that the first customer C1 is a candidate customer to be served, it refers to the product DB 320 and identifies a store in the commercial facility 100 to which the notification will be sent based on the worn item information. That is, when the identification unit 244 determines that there is a certain correlation between the information indicated by the worn item information and the product information 321 in the product DB 320, it identifies a store that handles the product determined to be correlated. Specifically, the identification unit 244 identifies the product information 321 that corresponds to the worn item information, and identifies the store information 322 associated with the identified product information 321 as the notification destination. Furthermore, the identification unit 244 identifies the store clerk terminal information 3221 included in the identified store information 322.

When the first customer C1 is successful in the first facial authentication and is determined to be a member, the generation unit 245 generates notification information including the member information 311 identified by the identification unit 244 and the identified facial image. When the generation unit 245 determines that the first customer C1 is a candidate customer to be served, the generation unit 245 generates notification information including the wearable item information and the physical or external appearance characteristic information.

The notification unit 246 is an example of the notification unit 15 described above. When the first visitor C1 is successful in the first facial authentication and is determined to be a member, the notification unit 246 notifies the store clerk terminal of notification information including the member information and the facial image, with the specified store clerk terminal information as the destination.

Furthermore, when the first customer C1 is determined to be a customer service candidate, the notification unit 246 notifies the store clerk terminal of notification information based on the attached item information, with the identified store clerk terminal information as the destination. In particular, the notification unit 246 notifies the terminal of the identified store clerk as the first terminal of the notification information. Furthermore, the notification unit 246 includes information on physical or external characteristics in the notification information and notifies the first terminal.

Figure 5 is a flowchart showing the flow of the store support process according to the second embodiment. It is assumed that a first customer C1 enters an entrance of the commercial facility 100, and the camera 101 captures an image of the shooting range including the first customer C1 near the entrance. The camera 101 then transmits the captured image to the store support device 200 via the network N.

In response, the store support device 200 acquires an image (including the first customer C1) captured by the camera 101 via the network N from the camera 101 (S201). Next, the store support device 200 extracts facial information of the first customer C1 from the acquired image (S202). Next, the store support device 200 refers to the member DB 310 and performs facial authentication on the facial information (S203). Then, the store support device 200 determines whether the facial authentication was successful or unsuccessful (S204). In other words, the store support device 200 determines whether the first customer C1 is a member or not based on the facial authentication result.

If the face authentication is successful in step S204 and it is determined that the first customer C1 is a member, the store support device 200 identifies the member information, the store, and the store clerk terminal (S205). Specifically, the identification unit 244 of the store support device 200 identifies the member information 311 included in the face authentication result. Then, the identification unit 244 identifies the store information 313 associated with the identified member information 311 from the member DB 310 as the notification destination. Then, the identification unit 244 identifies the store clerk terminal information 3221 (included in the store information 322) corresponding to the identified store information 313 from the product DB 320. In addition, the identification unit 244 identifies the face area of the first customer C1 in the image acquired in step S201 as a face image. That is, in this case, the first customer C1 is a member of the identified store because the face authentication was successful. Therefore, the identification unit 244 identifies the face image of the member who is the first visitor C1.

Then, the store support device 200 generates notification information including the identified member information and the identified face image (S206). After that, the store support device 200 notifies the generated notification information to the store clerk terminal, with the identified store clerk terminal information 3221 as the destination (S212). For example, when the store clerk terminal information 3221 indicates the store clerk terminal 111, the store clerk terminal 111 receives the notification information from the store support device 200, plays a sound corresponding to the notification information, and outputs it from the speaker. This allows the store clerk S1 to recognize that the first customer C1, who is a member of the store 110, has visited the commercial facility 100. Therefore, when the first customer C1 enters the store 110, the store clerk S1 can promptly provide appropriate customer service.

On the other hand, if face authentication fails in step S204 and the first customer C1 is determined to be a non-member, the store support device 200 extracts the wearable item information from the area of the first customer C1 in the image acquired in step S201 (S207). Then, the store support device 200 determines whether the luxury of the wearable item is a predetermined level or higher from the extracted wearable item information (S208). That is, the store support device 200 determines whether there is a certain correlation between the information indicated by the extracted wearable item information and the product information 321 in the product DB 320. Specifically, the determination unit 243 of the store support device 200 compares the wearable item information with the product information 321 in the product DB 320 and calculates the degree of agreement. Then, the determination unit 243 determines whether the degree of agreement is a predetermined value or higher. If the degree of agreement is a predetermined value or higher, the determination unit 243 determines whether the luxury 3211 included in the corresponding product information 321 is a predetermined level or higher. If it is determined in step S208 that the quality of the accessory is below the predetermined level, the store support process ends.

On the other hand, if the luxury of the accessory is determined to be equal to or above a predetermined level in step S208, that is, if the first customer C1 is determined to be a candidate customer to be served, the store support device 200 executes steps S209 and S210.

In this case, the store support device 200 first identifies the store and the store clerk terminal that handles the brand of the wearable item (S209). For example, the identification unit 244 of the store support device 200 identifies the brand name of the product information 321 that corresponds to the wearable item information. The identification unit 244 then identifies the store information 322 associated with the product information 321 that corresponds to the identified brand name as the notification destination. The identification unit 244 then identifies the store clerk terminal information 3221 included in the identified store information 322.

In addition, independent of step S209, the store support device 200 extracts body and appearance characteristic information from the area of the first customer C1 in the image acquired in step S201 (S210). Then, the store support device 200 generates notification information including the accessory information extracted in step S207 and the body or appearance characteristic information extracted in step S210 (S211).

After steps S209 and S211, the store support device 200 notifies the generated notification information to the store clerk terminal with the specified store clerk terminal information 3221 as the destination (S212). For example, when the store clerk terminal information 3221 indicates the store clerk terminal 111, the store clerk terminal 111 receives the notification information from the store support device 200, plays a sound corresponding to the notification information, and outputs it from a speaker. For example, the store clerk terminal 111 outputs a voice message such as the type of wearable item, the product name, and the fact that a customer who is a candidate for customer service has visited the store from the speaker. Alternatively, when the store clerk terminal information 3221 indicates the store clerk terminal 1n1, the store clerk terminal 1n1 receives the notification information from the store support device 200, performs an incoming call notification operation corresponding to the notification information, and displays a message or the like corresponding to the notification information on the screen. For example, the store clerk terminal 1n1 may display the wearable item information and the body or appearance characteristic information of the first customer C1 included in the notification information on the screen by using figures or text. As a result, the sales clerk S1 or the like can recognize that the first customer C1, who is a candidate customer for the store 110 or the like where the sales clerk S1 or the like works, has visited the commercial facility 100. Therefore, when the first customer C1 enters the store 110 or the like, the sales clerk S1 or the like can promptly and appropriately serve the first customer C1. In particular, since the first customer C1 is wearing a relatively expensive accessory, it can be said that the probability that the first customer C1 has a high purchasing power is high. Therefore, the sales clerk is more likely to recommend a high-priced item to the first customer C1 and have him or her purchase it. In other words, this embodiment can contribute to improving sales promotion by the sales clerk compared to a case where there is no prior information about the first customer C1. That is, the store can easily realize customer service that makes effective use of human resources. In addition, the sales clerk can easily recommend the candidate customer for service to register as a member of the store. Therefore, this embodiment can improve the probability that the first customer C1 will register as a member of the store as a new customer.

Furthermore, in this embodiment, the extraction process for accessory information is performed when the customer is a non-member, so if the customer is a member, the load and processing time of the image analysis process can be reduced.

<Embodiment 3>
The third embodiment is an improved example of the second embodiment. In the second database according to the third embodiment, a luxury level is associated with each product, as in the second embodiment. The specifying means according to the third embodiment refers to the second database and specifies, as notification destinations, stores in the commercial facility that handle other products whose luxury levels are within a certain range of the product determined to be related. As a result, even if there is no store in the commercial facility that handles the same product or the same brand as the product worn by the customer, when a customer who is a candidate for customer service is detected, the related store can know the customer in advance. Or, even if there is a store in the commercial facility that handles the same product or the same brand as the product worn by the customer, the notification information can be similarly notified to a store that handles a similar brand. Therefore, the present embodiment can contribute to improving sales promotion by store clerks even in stores that handle similar brands.

The overall configuration of the store support system according to this embodiment is the same as that shown in FIG. 3 above, so duplicated explanations will be omitted where appropriate. Therefore, the following explanation will focus on the differences from the second embodiment above.

Figure 6 is a flowchart showing the flow of store support processing according to this embodiment 3. Steps S201 to S203 and S204 in which a customer is determined to be a member, S205, S206 and S212 are the same processes as those in Figure 5 described above. Also, steps S207, S208, S210 and S211 in which a customer is determined to be a member in step S204 are the same processes as those in Figure 5 described above. If step S208 determines that the luxury of the accessories is at or above a predetermined level, that is, if the first customer C1 is determined to be a customer to be served, the store support device 200 executes S209a independently of step S210.

In this case, the store support device 200 identifies stores and store clerk terminals that handle other products whose luxury level of the attached items is within a certain range (S209a). For example, the identification unit 244 of the store support device 200 identifies the luxury level 3211 of the product information 321 corresponding to the attached item information. The identification unit 244 then identifies other product information whose luxury level and level are within a certain range from the product DB 320. The identification unit 244 then identifies store information 322 associated with the other identified product information from the product DB 320 as the notification destination. The identification unit 244 then identifies store clerk terminal information 3221 included in the identified store information 322.

After steps S209a and S211, the store support device 200 notifies the generated notification information to the clerk terminal, with the specified clerk terminal information 3221 as the destination (S212). As a result, the notification information is notified to a clerk terminal that handles products or brands of a similar level of luxury to the accessories worn by the first customer C1. Therefore, the clerk who wears or carries the clerk terminal to which the notification information has been notified can, in response to the notification, know in advance that the candidate customer has visited the store and the characteristics of the accessories, body, or appearance of the customer. Therefore, the same effect as that of the second embodiment described above can be achieved.

<Embodiment 4>
The fourth embodiment is an improved example of the second or third embodiment. The first database according to the fourth embodiment includes information indicating whether or not a member is a good member. The image captured by the camera includes the first visitor and the second visitor. The first determination means determines whether or not the second visitor is a good member when the second biometric authentication for the second biometric information extracted from the area of the second visitor in the image is successful based on the first database. The notification means includes an image of the face area of the second visitor in the notification information and notifies the first terminal when the first visitor is determined to be a customer service candidate and the second visitor is determined to be a good member. This makes it possible to notify the store in which the good member is registered that the good member will visit and the accompanying person are customer service candidates when the customer service candidate (first visitor) and a registered good member (second visitor) visit the store. In particular, the store clerk can view the facial images of the premium members and can view the physical or external characteristics of the potential customers and the information on the items they are wearing through the screen of the store clerk terminal. This can further contribute to improving sales promotion by the store clerk. It can further increase the probability that the first customer C1 will register as a new customer of the store.

Figure 7 is a block diagram showing the overall configuration of the store support system 1000a according to the fourth embodiment. Compared to the above-mentioned store support system 1000, the store support system 1000a shows a case where a second visitor C2 visits the commercial facility 100 together with a first visitor C1. For example, the first visitor C1 and the second visitor C2 may be a couple, parent and child, siblings, partners, friends, etc. Also, compared to the above-mentioned store support system 1000, the store support device 200a and the member DB 310a of the store support system 1000 have been changed. Note that other configurations of the store support system according to this embodiment are the same as those of FIG. 3 described above, and therefore overlapping explanations will be omitted as appropriate. Therefore, the following description will focus on the differences from the above-mentioned second embodiment.

Compared to the above-mentioned member DB 310, in member DB 310a, member information 311, face information 312, and store information 313 are associated with member type 314. Member type 314 is an example of information indicating whether a member is a member in good standing or not, such as a good member or a normal member.

The store support device 200a is an improved version of the store support device 200 described above. The determination unit 243 of the store support device 200a refers to the member DB 310a and determines whether the second visitor C2 is a good member or not by performing second facial recognition on face information extracted from the area of the second visitor C2 in the image. In addition, when the first visitor C1 is determined to be a candidate visitor, the determination unit 243 may determine whether the second visitor C2 is a good member or not by performing second facial recognition. In other words, the order of the first facial recognition and the second facial recognition does not matter. Then, when the second visitor C2 is determined to be a good member, the notification unit 246 of the store support device 200a notifies the store clerk terminal by including an image of the face area of the second visitor C2 in the notification information.

Figure 8 is a flowchart showing the flow of the store support process according to this embodiment 4. First, a first customer C1 and a second customer C2 are present near the entrance/exit of the commercial facility 100, and the first customer C1 and the second customer C2 are photographed by the camera 101. Then, the camera 101 transmits an image including the first customer C1 and the second customer C2 to the store support device 200a.

In response to this, the first customer C1 is determined to be a non-member in steps S201 to S203 and S204 in Fig. 5 described above, step S207 is executed, and in S208, it is determined that the luxury of the first customer C1's accessories is at or above a predetermined level. In other words, it is determined that the first customer C1 is a customer to be served.

Then, the store support device 200a determines whether or not the image acquired in step S201 includes a companion of the first customer C1 (S221). Specifically, the store support device 200a determines whether or not a person's area is present within a predetermined distance from the area of the first customer C1 by performing image recognition on the image. If it is determined in step S221 that a companion is not included, steps S209 to S212 in FIG. 5 described above are executed.

However, as described above, the following describes a case where a second customer C2 comes to the commercial facility 100 together with a first customer C1. Therefore, it is assumed that the area of the second customer C2 is present within a predetermined distance from the area of the first customer C1 in the image. Therefore, in step S221, the store support device 200a determines that a companion of the first customer C1 is included in the image.

Then, the store support device 200a extracts the face information of the second visitor C2 from the acquired image (S222). Next, the store support device 200a refers to the member DB 310a and performs face authentication on the face information (S223). Then, the store support device 200a judges whether the face authentication was successful or unsuccessful (S224). In other words, the store support device 200a judges whether the second visitor C2 is a member or not according to the face authentication result. If the store support device 200a judges in step S224 that the second visitor C2 is a member, the store support device 200a further judges whether the second visitor C2 who has succeeded in face authentication is a good member or not. Specifically, the store support device 200a refers to the member DB 310a and judges whether the second visitor C2 is a good member or not from the face information 312 whose face authentication was successful or the member type 314 associated with the member information 311. If it is determined in step S224 that the second visitor C2 is a non-member, the store support device 200a executes the above-mentioned steps S207 to S212 in Fig. 5 for the area of the first visitor C1 and his/her companion. Alternatively, if it is determined that the second visitor C2 is not a member in good standing, for example, a normal member, the store support device 200a may execute the above-mentioned steps S207 to S212 in Fig. 5 for the area of the first visitor C1 and his/her companion.

On the other hand, if it is determined in step S224 that the second visitor C2 is a premium member, that is, the companion of the first visitor C1 who is a candidate visitor to be served is a premium member, the store support device 200a executes steps S226 and S210. In this case, the store support device 200a first identifies the member information of the companion, the store, and the store clerk terminal, similar to step S205 described above (S226). In addition, the identification unit 244 identifies the face area of the second visitor C2 in the image acquired in step S201 as a face image. Furthermore, independent of step S226, the store support device 200a extracts physical and external feature information from the area of the first visitor C1 in the image acquired in step S201 (S210).

After steps S226 and S210, the store support device 200a generates notification information including the first visitor C1's accessory information, body or appearance characteristic information, and the member information and face image of the accompanying person (second visitor C2) (S227). Note that the notification information does not necessarily need to include a face image of the good member, but it is sufficient to include at least information that can identify the good member.

Then, the store support device 200a notifies the generated notification information to the store clerk terminal, with the specified store clerk terminal information 3221 as the destination (S228). In response to this, the store clerk who wears or carries the store clerk terminal to which the notification information has been notified can know in advance that the candidate customer has visited the store, and that a good member of his/her store has visited the store, in addition to the characteristic information of the customer's accessories, body, or appearance. In particular, the store clerk can know the member information of the second customer C2, who is a good member, such as the name, gender, and age group, via the store clerk terminal. Furthermore, the store clerk can know the face image of the good member via the screen of the store clerk terminal. Therefore, it becomes easier for the store clerk to identify the candidate customer than when the first customer C1, who is a candidate customer, visits the store alone.

In addition, the order of the determination by face authentication of the first visitor C1 and the second visitor C2 may be any one. After the first visitor C1 is determined to be a good member, the store support device 200a may determine whether the accompanying second visitor C2 is a non-member and a customer service candidate. If the accompanying second visitor C2 is a customer service candidate, the store support device 200a may execute steps S226, S210, S227, and S228. For example, after the first visitor C1 is determined to be a member in step S204, the store support device 200a may further determine whether the first visitor C1 is a good member. If the first visitor C1 is determined to be a good member, the store support device 200a may determine whether a companion is included in the image as in step S221, and if a companion is included, determine whether the accompanying person is a non-member and a customer service candidate for the area of the accompanying person. Therefore, when either the first or second customer included in the image is determined to be a candidate customer to be served, and the other is determined to be a preferred member, the notification unit 246 may include an image of the preferred member's facial area in the notification information and notify the first terminal.

This embodiment may be further improved as follows. That is, when the second visitor is determined to be a preferred member, the notification means may notify the second terminal of the second visitor of the benefit information at the store for either the first visitor or the second visitor. In this case, for example, the member information 311 of the member DB 310a includes the mobile terminal information of the preferred member. Then, in S226 of FIG. 8 described above, the store support device 200a further identifies the mobile terminal information of the second visitor C2 who is a preferred member from the member DB 310a. Then, the store support device 200a notifies the relevant store benefit information to the identified mobile terminal information as the destination. Here, the benefit information may be a recommended product at the store and a discount coupon for the first visitor C1 who is a candidate visitor to be served. Or, the benefit information may be incentive information at the store for the second visitor C2 who is a preferred member. For example, the incentive information may be an upgrade in member rank or a discount coupon in return for the second customer C2 introducing the store to the first customer C1. This can encourage the good members to guide the potential customers to the store and encourage them to register as members. This can increase the probability that the potential customers will register as members compared to when they visit the store alone.

<Embodiment 5>
The fifth embodiment is a modification of the above-mentioned second to fourth embodiments. The camera according to the fifth embodiment is installed at the entrance of a store that handles luxury goods of a predetermined level or higher in a commercial facility.

Figure 9 is a block diagram showing the overall configuration of a store support system 1000b according to this embodiment 5. Compared to the above-mentioned store support system 1000, the store support system 1000b shows a case where cameras in the commercial facility 100b are installed near the entrances and exits of each store. For example, the commercial facility 100b includes stores 110b to 1n0b. In the commercial facility 100b, a camera 112 is installed near the entrance and exit. Similarly, in store 1n0b, a camera 1n2 is installed near the entrance and exit. Each of the cameras 112 to 1n2 is connected to the network N so as to be able to communicate with it.

Each of cameras 112 to 1n2, like camera 101 described above, captures an image of a predetermined shooting range near the entrance/exit at a predetermined interval or when a person is detected by a human presence sensor. Each of cameras 112 to 1n2 transmits the captured image to store support device 200 via network N. At this time, each camera may transmit camera identification information and store identification information to store support device 200 along with the image.

For example, when a first customer C1 visits store 110b in the commercial facility 100 and is near the entrance/exit of store 110b, the first customer C1 is detected by a human presence sensor. Therefore, camera 112 captures an image including first customer C1. Note that multiple cameras may be installed in each store. Also, in this embodiment, as in FIG. 3 described above, cameras may be installed at entrances/exits of the entire commercial facility 100 or in locations outside the stores.

In addition, compared to the above-mentioned store support system 1000, the store support system 1000b has a modified store support device 200b. Note that other configurations of the store support system according to this embodiment are similar to those in FIG. 3 above, so duplicated explanations will be omitted as appropriate. Therefore, the following explanation will focus on the differences from the above-mentioned embodiment 2.

The store support device 200b acquires an image taken from the camera 112 or the like via the network N, and determines whether or not a person in the image (for example, the first customer C1) is a customer service candidate, in the same manner as the store support device 200 described above. If the store support device 200b determines that the person is a customer service candidate, it extracts body and appearance characteristic information from the area of the detected first customer C1, in the same manner as the store support device 200 described above, and generates notification information. Then, if the store support device 200b according to this embodiment determines that the person is a customer service candidate, it identifies the store to which the camera that sent the image belongs and the clerk terminal of the clerk working at the store. For example, if the store support device 200b acquires an image and identification information of the store 110b from the camera 112, it identifies the store 110b as the notification destination from the identification information, and identifies the clerk terminal information 3221 included in the store information 322 corresponding to the store 110b in the product DB 320. Then, the store support device 200b notifies the store clerk terminal 111 of the notification information, with the specified store clerk terminal information 3221 as the destination. This allows the store clerk S1 of the store 110b to recognize the notification information via the store clerk terminal 111, and to easily recognize that the first customer C1 who has visited the commercial facility 100b is a customer to be served. This allows the store clerk S1 to provide appropriate customer service to the first customer C1. In other words, the store support device 200b can provide support for sales promotion and the like for the store 110b, etc.

<Other embodiments>

The biometric authentication described above extracts feature information indicating a person's physical features from a body image, compares the extracted feature information with pre-registered feature information, and considers authentication successful if the degree of match is equal to or greater than a threshold. The biometric authentication may be, for example, face authentication. In this case, the biometric information is face feature information. The biometric information may be data (feature amounts) calculated from physical features unique to an individual, such as facial feature information, fingerprints, voiceprints, veins, retinas, irises, and palm patterns.

In the above examples, the program includes instructions (or software code) that, when loaded into a computer, cause the computer to perform one or more functions described in the embodiments. The program may be stored on a non-transitory computer-readable medium or a tangible storage medium. By way of example and not limitation, the computer-readable medium or tangible storage medium includes random-access memory (RAM), read-only memory (ROM), flash memory, solid-state drive (SSD) or other memory technology, CD-ROM, digital versatile disc (DVD), Blu-ray (registered trademark) disk or other optical disk storage, magnetic cassette, magnetic tape, magnetic disk storage or other magnetic storage device. The program may be transmitted on a transitory computer-readable medium or communication medium. By way of example and not limitation, the transitory computer-readable medium or communication medium includes electrical, optical, acoustic, or other forms of propagating signals.

Note that the present disclosure is not limited to the above-described embodiments, and can be modified as appropriate without departing from the spirit and scope of the present disclosure. In addition, the present disclosure may be implemented by combining the respective embodiments as appropriate.

A part or all of the above-described embodiments can be described as, but is not limited to, the following supplementary notes.
(Appendix 1)
An acquisition means for acquiring an image of the first customer taken by a camera installed in the commercial facility;
a first determination means for determining whether a first biometric authentication for first biometric information extracted from a region of the first customer in the acquired image has been successful or unsuccessful by referring to a first database in which biometric information is registered in advance as members of a store in the commercial facility;
an extraction means for extracting wearable item information relating to a wearable item from an area of the first customer when it is determined that the first biometric authentication has failed;
a second determination means for determining whether or not there is a relationship between the accessory and the item and a luxury level equal to or higher than a predetermined level based on the accessory information by referring to a second database that associates the item with a store that handles the item, and determining that the first customer is a candidate customer to be served if it is determined that there is such a relationship;
a notification means for notifying a first terminal of a related person in the commercial facility of notification information based on the wearable item information when the first customer is determined to be a customer-to-be;
A store support device comprising:
(Appendix 2)
The store support device described in Appendix 1 further includes an identification means for identifying a store that handles the product determined to be related by referring to the second database, and the notification means notifies the notification information using a terminal of a sales clerk at the store as the first terminal.
(Appendix 3)
In the second database, the luxury level is associated with each of the products,
The identification means refers to the second database to identify stores within the commercial facility that handle the product determined to be related to the product and other products whose luxury level is within a certain range.
(Appendix 4)
The extraction means further extracts characteristic information relating to a body or an appearance of the first customer from the area of the first customer,
The store support device according to any one of claims 1 to 3, wherein the notification means includes the feature information in the notification information and notifies the first terminal.
(Appendix 5)
the first database includes information indicating whether the member is a member in good standing;
the image includes a second customer together with the first customer;
the first determination means, when a second biometric authentication is successful for the second biometric information extracted from the area of the second customer based on the first database, determines whether the second customer is the good member or not;
The store support device described in any one of Appendices 1 to 4, wherein when the first customer is determined to be a candidate customer to be served and the second customer is determined to be a preferred member, the notification means includes an image of the facial area of the second customer in the notification information and notifies the first terminal.
(Appendix 6)
The store support device described in Appendix 5, wherein the notification means notifies a second terminal of the second store visitor of special benefit information at the store for either the first store visitor or the second store visitor when the second store visitor is determined to be a preferred member.
(Appendix 7)
The store support device according to any one of claims 1 to 6, wherein the camera is installed at an entrance of a store that sells the product within the commercial facility.
(Appendix 8)
Cameras installed in commercial facilities,
A first terminal of a related person in the commercial facility;
a first database in which biometric information of a member of a store in the commercial facility is registered in advance;
a second database that associates products with stores that sell the products;
a store support device connected to the camera, the first terminal, the first database, and the second database;
Equipped with
The store support device includes:
An acquisition means for acquiring an image of the first customer taken by the camera;
a first determination means for determining whether a first biometric authentication for first biometric information extracted from a region of the first customer in the acquired image has been successful or unsuccessful by referring to the first database;
an extraction means for extracting wearable item information relating to a wearable item from an area of the first customer when it is determined that the first biometric authentication has failed;
a second determination means for referring to the second database and determining whether or not there is a correlation between the accessory and the product with a luxury level equal to or higher than a predetermined level based on the accessory information, and determining the first customer as a candidate customer to be served if it is determined that there is a correlation;
a notification means for notifying the first terminal of notification information based on the wearable item information when the first customer is determined to be a customer-to-be served;
A store support system equipped with:
(Appendix 9)
The store support device includes:
The store support system described in Appendix 8, further comprising an identification means for identifying a store that handles the product determined to be related by referring to the second database, and the notification means notifies the notification information using a terminal of a sales clerk at the store as the first terminal.
(Appendix 10)
The computer
An image of a first customer is acquired by a camera installed in the commercial facility;
referring to a first database in which biometric information of members of a store in the commercial facility is registered in advance, and determining whether a first biometric authentication for the first biometric information extracted from a region of the first store visitor in the acquired image has been successful or unsuccessful;
If it is determined that the first biometric authentication has failed, extracting wearable item information relating to wearable items from an area of the first customer;
referring to a second database in which products are associated with stores that handle the products, and determining whether or not there is a correlation between the accessories and the products that is a predetermined level or higher of luxury based on the accessory information, and determining that there is a correlation between the accessories and the products that is a predetermined level or higher of luxury, and if there is a correlation, determining that the first customer is a candidate customer to be served;
When the first customer is determined to be a customer-to-be, notification information based on the wearable item information is sent to a first terminal of a related person in the commercial facility.
How to support stores.
(Appendix 11)
an acquisition process for acquiring an image of the first customer by a camera installed in the commercial facility;
a first determination process for determining whether a first biometric authentication for first biometric information extracted from a region of the first store visitor in the acquired image has been successful or unsuccessful by referring to a first database in which biometric information is registered in advance as a member of a store in the commercial facility;
an extraction process of extracting wearable item information related to a wearable item from an area of the first customer when it is determined that the first biometric authentication has failed;
a second determination process for determining whether or not there is a relationship between the accessory and the item and a luxury level equal to or higher than a predetermined level based on the accessory information by referring to a second database that associates the item with a store that handles the item, and determining that the first customer is a candidate customer to be served if it is determined that there is such a relationship;
a notification process for notifying a first terminal of a related person in the commercial facility of notification information based on the wearable item information when the first customer is determined to be a customer-to-be served;
A non-transitory computer-readable medium storing a store support program for causing a computer to execute the above.

The present invention has been described above with reference to the embodiments (and examples), but the present invention is not limited to the above-mentioned embodiments (and examples). Various modifications that can be understood by a person skilled in the art can be made to the configuration and details of the present invention within the scope of the present invention.

REFERENCE SIGNS LIST 1 store support device 11 acquisition unit 12 first determination unit 13 extraction unit 14 second determination unit 15 notification unit 1000 store support system 1000a store support system 1000b store support system N network 100 commercial facility 100b commercial facility 101 camera C1 first customer C2 second customer 110 store 110b store 111 clerk terminal 112 camera S1 clerk 1n0 store 1n0b store 1n1 clerk terminal 1n2 camera Sn clerk 200 store support device 200a store support device 200b store support device 210 storage unit 211 program 220 memory 230 communication unit 240 control unit 241 acquisition unit 242 Extraction unit 243 Determination unit 244 Identification unit 245 Generation unit 246 Notification unit 300 Facility management server 310 Member DB
310a Member DB
311 Member information 312 Face information 313 Store information 314 Member type 320 Product DB
321 Product information 3211 Luxury 322 Store information 3221 Store clerk terminal information

Claims (10)

An acquisition means for acquiring an image of the first customer taken by a camera installed in the commercial facility;
a first determination means for determining whether a first biometric authentication for first biometric information extracted from a region of the first customer in the acquired image has been successful or unsuccessful by referring to a first database in which biometric information is registered in advance as members of a store in the commercial facility;
an extraction means for extracting wearable item information relating to a wearable item from an area of the first customer when it is determined that the first biometric authentication has failed;
a second determination means for determining whether or not there is a relationship between the accessory and the item and a luxury level equal to or higher than a predetermined level based on the accessory information by referring to a second database that associates the item with a store that handles the item, and determining that the first customer is a candidate customer to be served if it is determined that there is such a relationship;
a notification means for notifying a first terminal of a related person in the commercial facility of notification information based on the wearable item information when the first customer is determined to be a customer-to-be;
A store support device comprising: The store support device according to claim 1, further comprising an identification means for identifying a store that handles the product determined to be related by referring to the second database, and wherein the notification means notifies the notification information using a terminal of a salesperson at the store as the first terminal. In the second database, the luxury level is associated with each of the products,
The store support device according to claim 2, wherein the identification means refers to the second database to identify stores within the commercial facility that handle the product determined to be related to the product and other products whose luxury level is within a certain range. The extraction means further extracts characteristic information relating to a body or an appearance of the first customer from the area of the first customer,
The store support device according to claim 1 , wherein the notification means includes the characteristic information in the notification information and notifies the first terminal of the notification information. the first database includes information indicating whether the member is a member in good standing;
the image includes a second customer together with the first customer;
the first determination means, when a second biometric authentication is successful for the second biometric information extracted from the area of the second customer based on the first database, determines whether the second customer is the good member or not;
The store support device according to any one of claims 1 to 4, wherein when the first customer is determined to be a candidate customer to be served and the second customer is determined to be a preferred member, the notification means includes an image of the facial area of the second customer in the notification information and notifies the first terminal. The store support device according to claim 5, wherein the notification means notifies a second terminal of the second store visitor of special benefit information at the store for either the first store visitor or the second store visitor when the second store visitor is determined to be a preferred member. The store support device according to claim 1 , wherein the camera is installed at an entrance of a store that sells the product in the commercial facility. Cameras installed in commercial facilities,
A first terminal of a related person in the commercial facility;
a first database in which biometric information of a member of a store in the commercial facility is registered in advance;
a second database that associates products with stores that sell the products;
a store support device connected to the camera, the first terminal, the first database, and the second database;
Equipped with
The store support device includes:
An acquisition means for acquiring an image of the first customer taken by the camera;
a first determination means for determining whether a first biometric authentication for first biometric information extracted from a region of the first customer in the acquired image has been successful or unsuccessful by referring to the first database;
an extraction means for extracting wearable item information relating to a wearable item from an area of the first customer when it is determined that the first biometric authentication has failed;
a second determination means for referring to the second database and determining whether or not there is a correlation between the accessory and the product with a luxury level equal to or higher than a predetermined level based on the accessory information, and determining the first customer as a candidate customer to be served if it is determined that there is a correlation;
a notification means for notifying the first terminal of notification information based on the wearable item information when the first customer is determined to be a customer-to-be served;
A store support system equipped with: The computer
An image of a first customer is acquired by a camera installed in the commercial facility;
referring to a first database in which biometric information of members of a store in the commercial facility is registered in advance, and determining whether a first biometric authentication for the first biometric information extracted from a region of the first store visitor in the acquired image has been successful or unsuccessful;
If it is determined that the first biometric authentication has failed, extracting wearable item information relating to wearable items from an area of the first customer;
referring to a second database in which products are associated with stores that handle the products, and determining whether or not there is a correlation between the accessories and the products that is a predetermined level or higher of luxury based on the accessory information, and determining that there is a correlation between the accessories and the products that is a predetermined level or higher of luxury, and if there is a correlation, determining that the first customer is a candidate customer to be served;
When the first customer is determined to be a customer-to-be, notification information based on the wearable item information is sent to a first terminal of a related person in the commercial facility.
How to support stores. an acquisition process for acquiring an image of the first customer by a camera installed in the commercial facility;
a first determination process for determining whether a first biometric authentication for first biometric information extracted from a region of the first store visitor in the acquired image has been successful or unsuccessful by referring to a first database in which biometric information is registered in advance as a member of a store in the commercial facility;
an extraction process of extracting wearable item information related to a wearable item from an area of the first customer when it is determined that the first biometric authentication has failed;
a second determination process for determining whether or not there is a relationship between the accessory and the item and a luxury level equal to or higher than a predetermined level based on the accessory information by referring to a second database that associates the item with a store that handles the item, and determining that the first customer is a candidate customer to be served if it is determined that there is such a relationship;
a notification process for notifying a first terminal of a related person in the commercial facility of notification information based on the wearable item information when the first customer is determined to be a customer-to-be served;
A store support program that causes a computer to execute the above.

Images