JP7794293B2 - Usage management support device, system, method, and program - Google Patents

Description

This disclosure relates to a usage management support device, system, method, and program.

Patent Document 1 discloses technology related to an elevator control system. The system in Patent Document 1 photographs potential passengers getting on and off elevators in a building, performs image authentication of the potential passengers based on the photographed images, learns the movement patterns of each potential passenger to each floor, and controls the elevator based on the learning results.

Patent Document 2 discloses technology related to alarm devices installed at the elevator entrances on each floor. In Patent Document 2, when a person carrying a name tag with an IC (Integrated Circuit) tag gets off the elevator, the alarm device installed at the elevator entrance reads the floor information on the IC tag and activates an alarm if the floor is not permitted.

Japanese Patent Application Laid-Open No. 2020-132410 Japanese Patent Application Laid-Open No. 2000-306050

However, the technology described in Patent Document 2 has the problem that it is difficult to implement because it requires the installation of physical security gates on each floor to prevent unauthorized persons from entering each floor.

In view of the above-mentioned problems, the purpose of this disclosure is to provide a usage management support device, system, method, and program that helps prevent unauthorized users from entering each floor without the need for physical gates.

The usage management support device according to the present disclosure includes:
an identification means for identifying a first permitted floor associated with a first user who has successfully passed first face authentication for a first face image captured while riding in an elevator, by referring to a database that associates facial feature information of the user with permitted floors that the user is permitted to use;
an operation control means for controlling the operation of the elevator in accordance with the first permitted floor;
a determination means for determining whether a second user is permitted to disembark at a stop floor where the elevator has stopped in accordance with the operation control by performing second facial authentication on a second facial image of the second user disembarking at the stop floor, with reference to the database;
an output means for outputting first warning information when it is determined that the second user is not allowed to get off the vehicle;
Equipped with.

The usage management support system according to the present disclosure includes:
a database that associates facial feature information of a user with a permitted floor that the user is permitted to use;
a usage management support device connected to the database,
The usage management support device
an identification means for identifying a first permitted floor associated with a first user who has succeeded in first face authentication for a first face image captured while boarding an elevator, by referring to the database;
an operation control means for controlling the operation of the elevator in accordance with the first permitted floor;
a determination means for determining whether a second user is permitted to disembark at a stop floor where the elevator has stopped in accordance with the operation control by performing second facial authentication on a second facial image of the second user disembarking at the stop floor, with reference to the database;
an output means for outputting first warning information when it is determined that the second user is not allowed to get off the vehicle;
Equipped with.

The usage management support method according to the present disclosure includes:
The computer
by referring to a database in which facial feature information of a user is associated with an authorized floor that the user is authorized to use, the system identifies a first authorized floor that is associated with a first user who has successfully passed first face authentication on a first face image captured while boarding the elevator;
performing operation control of the elevator according to the first permitted floor;
referring to the database, and performing second facial authentication on a second facial image of a second user who gets off at a stop floor where the elevator has stopped in accordance with the operation control, to determine whether the second user is allowed to get off at the stop floor;
If it is determined that the second user is not allowed to get off the vehicle, first warning information is output.

The usage management support program disclosed herein is
a process of identifying a first permitted floor associated with a first user who has successfully passed first face authentication for a first face image captured while riding in an elevator, by referring to a database that associates facial feature information of the user with permitted floors that the user is permitted to use;
an operation control process for controlling the operation of the elevator in accordance with the first permitted floor;
a determination process of determining whether a second user is permitted to disembark at a stop floor where the elevator has stopped in accordance with the operation control by performing second facial authentication on a second facial image of the second user who disembarks at the stop floor with reference to the database;
an output process of outputting first warning information when it is determined that the second user is not allowed to get off the vehicle;
to be executed by the computer.

This disclosure provides a usage management support device, system, method, and program that helps prevent unauthorized users from entering each floor without the need for a physical gate.

1 is a block diagram showing a configuration of a usage management support device according to a first embodiment of the present invention; 1 is a flowchart showing the flow of a usage management support method according to the first embodiment. FIG. 10 is a block diagram showing the configuration of a usage management support system according to a second embodiment. FIG. 10 is a block diagram showing the configuration of an authentication device according to a second embodiment. 10 is a flowchart showing the flow of a face information registration process performed by the authentication device according to the second embodiment. FIG. 10 is a block diagram showing the configuration of a usage management support device according to a second embodiment. 10 is a flowchart showing the flow of an operation control process when boarding an elevator according to the second embodiment. 10 is a flowchart showing the flow of face authentication processing by the authentication device according to the second embodiment. FIG. 10 is a diagram showing an example of the situation inside the elevator when boarding according to the second embodiment. 10 is a flowchart showing the flow of a warning determination process when a passenger gets off an elevator according to Example 2-1 of the second embodiment. 10 is a flowchart showing the flow of a warning determination process when a passenger gets off an elevator according to Example 2-2 of the second embodiment. FIG. 10 is a diagram showing an example of a warning information display when getting off the vehicle according to the second embodiment. FIG. 10 is a diagram showing an example of warning information displayed on the administrator terminal when disembarking according to the second embodiment. 10 is a flowchart showing the flow of an operation control process when boarding an elevator according to the third embodiment. 13A and 13B are diagrams illustrating an example of pressing a designated button in an elevator according to the third embodiment. FIG. 11 is a diagram showing an example of a warning message displayed when a designated button is pressed in an elevator according to the third embodiment. FIG. 10 is a block diagram showing the configuration of a usage management support system according to a fourth embodiment. 10 is a flowchart showing the flow of a warning determination process when calling an elevator according to Example 4-1 of the present embodiment 4. 10 is a flowchart showing the flow of a warning determination process when calling an elevator according to Example 4-2 of the present embodiment 4. FIG. 10 is a diagram showing an example of an elevator call according to the fourth embodiment. FIG. 11 is a diagram showing an example of a display of warning information when calling an elevator according to the fourth embodiment. FIG. 11 is a diagram showing an example of warning information displayed on a manager terminal when an elevator is called according to the fourth embodiment.

Embodiments of the present disclosure will now be described in detail with reference to the drawings. In each drawing, identical or corresponding elements are designated by the same reference numerals, and duplicate descriptions will be omitted as necessary for clarity.

<Embodiment 1>
FIG. 1 is a block diagram showing the configuration of a usage management support device 1 according to the first embodiment. The usage management support device 1 is an information processing device that monitors users getting on and off elevators in a specified building to support management of users entering each floor. The usage management support device 1 is capable of referencing a database stored in an internal storage device (not shown) or a connected external storage device (not shown). The database manages information associating facial feature information of users with permitted floors that the users are permitted to use. Furthermore, at least a photographing device (not shown) is installed inside or outside the elevator, and the usage management support device 1 acquires images photographed by the photographing device. The usage management support device 1 includes an identification unit 11, an operation control unit 12, a determination unit 13, and an output unit 14.

The identification unit 11 refers to the database and identifies the first permitted floor associated with the first user. Here, the "first user" refers to a passenger (user) who has successfully passed the first facial authentication for a first facial image taken while boarding the elevator. "Photographed while boarding the elevator" refers to, for example, a photograph taken outside or inside the elevator (near the entrance/exit) while boarding the elevator, or a photograph of the passenger taken inside the elevator after boarding. Furthermore, "facial authentication" is a process of comparing facial feature information calculated from the facial image with facial feature information stored in the database, determining that authentication is successful if the degree of match is equal to or greater than a threshold, and identifying the user associated with the matched facial feature information. The facial authentication process may be performed internally or externally to the utilization management support device 1. The identification unit 11 identifies, from the database, at least, the first permitted floor associated with the first user identified through successful first facial authentication.

The operation control unit 12 controls the operation of the elevator according to the first permitted floor identified by the identification unit 11. For example, the operation control unit 12 instructs the elevator's operation controller or operation control system to stop at the first permitted floor.

The determination unit 13 refers to the database and performs second facial authentication on the second facial image taken of the second user to determine whether the second user is permitted to disembark at the stop floor. Here, the second facial image is a facial image taken of the second user disembarking at the stop floor where the elevator stops in accordance with operation control by the operation control unit 12. "A photograph of the second user disembarking at the stop floor where the elevator stops" refers, for example, to a photograph taken inside the elevator when the second user is about to disembark when the elevator stops at the stop floor, or a photograph of the second user taken outside the elevator after disembarking. Furthermore, for example, if the second facial authentication on the second facial image is successful and the second permitted floors associated with the second user include the stop floor, the determination unit 13 may determine that the second user is permitted to disembark at the stop floor. Alternatively, for example, the judgment unit 13 may determine that the second user is allowed to disembark at the stopping floor if second facial authentication of the second facial image is successful by comparing it with candidates of facial feature information associated with the stopping floor as an allowed floor in the database.

The output unit 14 outputs first warning information when it is determined that the second user is not allowed to disembark. For example, the output unit 14 outputs the first warning information to a speaker (not shown) or a display device (not shown) installed inside or outside the elevator. Alternatively, the output unit 14 may output the first warning information to a terminal of the elevator, stopping floor, or building manager.

Figure 2 is a flowchart showing the flow of the management support method according to this embodiment 1. First, a first facial image of a first user is captured when the first user boards an elevator. Then, by referring to the database, a first facial authentication is performed on the first facial image, and it is assumed that the first user has succeeded in the first facial authentication. The identification unit 11 then refers to the database and identifies a first permitted floor associated with the first user who has succeeded in the first facial authentication (S11). Then, the operation control unit 12 controls the operation of the elevator according to the first permitted floor (S12).

Next, the elevator stops at a predetermined stopping floor, such as the first permitted floor, in accordance with operation control by the operation control unit 12. At this time, a second facial image of the second user exiting the elevator at the stopping floor is captured.

Then, the determination unit 13 refers to the database and determines whether the second user is permitted to disembark at the stopping floor by performing second facial authentication on the second facial image (S13). If it is determined in step S13 that the second user is not permitted to disembark, the output unit 14 outputs first warning information (S14).

In this embodiment, facial recognition is used to detect when a first user, whose permitted floor is registered in advance, boards an elevator, and the elevator is controlled according to the detected permitted floor for the first user. This prevents users whose permitted floors are not registered in advance from boarding the elevator alone and attempting to travel to unauthorized floors. When a user disembarks at a floor (a permitted floor for a given user) of the elevator whose operation is controlled, a facial recognition result is obtained for the second user (not necessarily the first user) attempting to disembark. If the second user fails facial recognition or is successful but the floor is not registered as a permitted floor, the second user is determined to be unable to disembark, and an output to that effect is output. This makes it easier for people in the elevator or near the designated floor, or for an administrator, to recognize that the second user is attempting to disembark at an unauthorized floor. This can prevent the second user from disembarking if they have malicious intent. Alternatively, it can make it easier for nearby people, security guards, etc. to call out to the second user. Furthermore, if the second user is not intending to get off the vehicle by mistake, the second user will be more likely to realize this.

This means that without the need for physical gates, it is possible to make it difficult for unauthorized persons to enter each floor, helping to prevent unauthorized users from entering each floor.

The usage management support device 1 includes a processor, memory, and storage device, which are not shown in the figure. The storage device stores a computer program that implements the processing of the usage management support method according to this embodiment. The processor then loads the computer program from the storage device into the memory and executes the computer program. As a result, the processor realizes the functions of the identification unit 11, operation control unit 12, determination unit 13, and output unit 14.

Alternatively, each component of the usage management support device 1 may be realized by dedicated hardware. Furthermore, some or all of the components of each device may be realized by general-purpose or dedicated circuits, processors, etc., or a combination of these. These may be configured by a single chip, or by multiple chips connected via a bus. Some or all of the components of each device may be realized by a combination of the above-mentioned circuits, etc., and programs. Furthermore, processors that can be used include CPUs (Central Processing Units), GPUs (Graphics Processing Units), FPGAs (Field-Programmable Gate Arrays), quantum processors (quantum computer control chips), etc.

Furthermore, when some or all of the components of the usage management support device 1 are realized by multiple information processing devices, circuits, etc., the multiple information processing devices, circuits, etc. may be centrally or decentralized. For example, the information processing devices, circuits, etc. may be realized as a client-server system, cloud computing system, etc., in which each is connected via a communications network. Furthermore, the functions of the usage management support device 1 may be provided in SaaS (Software as a Service) format.

<Embodiment 2>
The present embodiment 2 is a specific example of the above-described embodiment 1. Fig. 3 is a block diagram showing the configuration of a usage management support system 1000 according to the present embodiment 2. The usage management support system 1000 is an information system for supporting the management of elevators and users on each floor (floor) using images of users captured by the floor cameras 101 and 120.

In the usage management support system 1000, at least the operation controller 110, floor camera 101, authentication device 200, usage management support device 300, and administrator terminal 400 in the elevator 100 are each connected to each other so that they can communicate with each other via a network N. Here, the network N is a wired or wireless communication line or communication network, such as a LAN (Local Area Network), the Internet, a wireless communication network, a mobile phone network, etc. Furthermore, the network N can use any type of communication protocol.

The elevator 100 is installed and operated in a specified building, such as a building. In this example, users U1 to U3 are assumed to be inside the elevator 100, but the number of passengers is not limited to this. The elevator 100 includes an operation controller 110, a camera 120, a display device 130, a floor designation unit 140, an opening/closing designation unit 150, a door 160, and a warning information output device 170.

The operation controller 110 is a device for controlling the general operation of the elevator 100, such as raising and lowering the elevator 100, opening and closing the doors 160, receiving passenger requests for designated floors and for opening and closing the doors 160, and stopping the elevator at designated floors. In this example, the operation controller 110 is connected to the camera 120, display device 130, floor designation unit 140, opening/closing designation unit 150, doors 160, and warning information output unit 170, and transmits and receives data and controls signals with each component. In response to instructions from the utilization management support device 300, the operation controller 110 performs operation control such as stopping the elevator 100 at designated permitted floors, not stopping the elevator at floors other than permitted floors, and selecting the designated button in the floor designation unit 140. The operation controller 110 also performs control such as outputting warning information received from the utilization management support device 300 to the warning information output unit 170.

Camera 120 is a photographing device installed inside elevator 100. Camera 120's photographing range is at least a portion of the interior space of elevator 100, including the faces of users U1 to U3 riding inside elevator 100. In other words, camera 120 photographs the area inside elevator 100 that includes the faces of users U1 to U3. Camera 120 photographs at least when door 160 is opened and closed, that is, at the timing when users U1 and others board and disembark. Camera 120 transmits the photographed images to usage management support device 300 via operation controller 110 and network N. It should be noted that two or more cameras 120 may be installed inside elevator 100.

The display device 130 has a screen such as an LCD display and is installed in a position where the screen can be seen by users U1 and others inside the elevator 100. The display device 130 displays on the screen moving images received from the usage management support device 300 via the network N and the operation controller 110.

The floor designation unit 140 is configured to accept designation of the stopping floor of the elevator 100 from user U1, etc., and is, for example, a collection of buttons that accept designation for each floor.

The opening/closing specification unit 150 is configured to accept specifications for opening and closing the door 160 of the elevator 100 from a user U1, etc., and is, for example, a collection of buttons that accept specifications for opening and closing the door 160.

Door 160 opens and closes at the floor where elevator 100 stops in response to an operation control signal from operation controller 110. Therefore, even if elevator 100 stops, door 160 will not close if it receives a control signal from operation controller 110 to keep the door open.

The warning information output device 170 outputs the warning information received from the usage management support device 300 via the network N and the operation controller 110 so that it can be perceived by user U1, etc. The warning information output device 170 may include a speaker, lamp, display panel, etc. For example, if the warning information is audio data of an alarm sound or warning message, the warning information output device 170 outputs the alarm sound or audio warning message via a speaker. Furthermore, if the warning information is a warning signal, the warning information output device 170 turns on or blinks a lamp, etc. Furthermore, if the warning information is text information or an image of a warning message, etc., the warning information output device 170 displays the warning message on a display panel or display device 130.

The floor camera 101 is a photographing device installed on each floor of the building, and is installed near the entrance and exit of the elevator 100, in the elevator hall. The floor camera 101 is installed in a position where it can photograph an area including the faces of users getting on and off the elevator 100. The floor camera 101 may also be a camera of an authentication terminal installed at the entrance gate of the building's entrance floor. The above-mentioned camera 120 and floor camera 101 may also be called the first camera.

The authentication device 200 is an information processing device that manages users' facial feature information and performs facial authentication. In response to a facial authentication request received from an external device, the authentication device 200 compares the facial image or facial feature information included in the request with the facial feature information of each user and returns the comparison result (authentication result) to the requestor.

Figure 4 is a block diagram showing the configuration of the authentication device 200 according to the second embodiment. The authentication device 200 comprises a face information database (DB) 210, a face detection unit 220, a feature point extraction unit 230, a registration unit 240, and an authentication unit 250. The face information DB 210 stores a user ID 211 and facial feature information 212 for that user ID in association with each other. The facial feature information 212 is a collection of feature points extracted from a facial image. The authentication device 200 may delete the facial feature information 212 in the face information DB 210 in response to a request from a user or the like corresponding to the facial feature information 212. Alternatively, the authentication device 200 may delete the facial feature information 212 after a certain period of time has elapsed since registration.

The face detection unit 220 detects a facial area included in a registration image for registering facial information and outputs the detected area to the feature point extraction unit 230. The feature point extraction unit 230 extracts feature points from the facial area detected by the face detection unit 220 and outputs facial feature information to the registration unit 240. The feature point extraction unit 230 also extracts feature points included in a facial image received from the usage management support device 300, etc., and outputs the facial feature information to the authentication unit 250.

When registering facial feature information, the registration unit 240 issues a new user ID 211. The registration unit 240 associates the issued user ID 211 with facial feature information 212 extracted from the registration image and registers them in the facial information DB 210. The authentication unit 250 performs facial authentication using the facial feature information 212. Specifically, the authentication unit 250 compares the facial feature information extracted from the facial image with the facial feature information 212 in the facial information DB 210. If the comparison is successful, the authentication unit 250 identifies the user ID 211 associated with the compared facial feature information 212. The authentication unit 250 replies to the requestor as a facial authentication result indicating whether or not the facial feature information matches. The presence or absence of a match in the facial feature information corresponds to the success or failure of authentication. Note that a match in the facial feature information (match present) refers to a case where the degree of match is equal to or greater than a threshold. Furthermore, if facial authentication is successful, the facial authentication result includes the identified user ID.

Figure 5 is a flowchart showing the flow of face information registration processing by the authentication device 200 according to the second embodiment. First, the authentication device 200 receives a face information registration request (S201). For example, the authentication device 200 receives the face information registration request from the usage management support device 300 via the network N. Next, the face detection unit 220 detects a face area from the face image included in the face information registration request (S202). Then, the feature point extraction unit 230 extracts feature points (facial feature information) from the face area detected in step S202 (S203). Then, the registration unit 240 issues a user ID 211 (S204). Then, the registration unit 240 associates the extracted facial feature information 212 with the issued user ID 211 and registers them in the face information DB 210 (S205). Thereafter, the registration unit 240 returns the issued user ID 211 to the requestor (e.g., the usage management support device 300) (S206). The authentication device 200 may perform the face information registration process in response to a face information registration request received from an arbitrary information registration terminal. For example, the information registration terminal is an information processing device such as a personal computer, a smartphone, or a tablet terminal.

Returning to FIG. 3, the description will continue.
The usage management support device 300 is an example of the usage management support device 1 described above. The usage management support device 300 is an information processing device that controls the operation of the elevator 100. The usage management support device 300 controls first facial recognition using a captured image of a passenger (user) boarding the elevator 100 and controls the operation of the elevator 100's stopping floors based on the authentication result. The usage management support device 300 also controls second facial recognition using a captured image of a passenger (user) exiting the elevator 100, determines whether the passenger is permitted to exit based on the authentication result, and controls the output of warning information according to the determination result. The usage management support device 300 can also control the camera 120, the display device 130, the floor designation unit 140, the opening/closing designation unit 150, the door 160, and the warning information output unit 170 via the network N and the operation controller 110. The usage management support device 300 may also control the operation of two or more elevators. The usage management support device 300 may be configured redundantly with a plurality of servers, and each functional block may be realized by a plurality of computers.

The administrator terminal 400 is an information processing device operated by an administrator of a building, an elevator, or each floor. The administrator terminal 400 is, for example, an information terminal such as a personal computer, a smartphone, or a tablet terminal. The administrator terminal 400 outputs warning information received from the usage management support device 300 via the network N. If the warning information is audio data of an alarm sound or a warning message, the administrator terminal 400 outputs the alarm sound or the audio of the warning message through a speaker. If the warning information is a warning signal, the administrator terminal 400 turns on or blinks a lamp. If the warning information is text information or an image of a warning message, the administrator terminal 400 displays the warning message on the screen.

Figure 6 is a block diagram showing the configuration of the usage management support device 300 according to this embodiment 2. The usage management support device 300 comprises a storage unit 310, a memory 320, a communication unit 330, and a control unit 340. The storage unit 310 is an example of a storage device such as a hard disk or flash memory. The storage unit 310 stores a program 311 and a user management DB 312. The program 311 is a computer program (usage management support program) in which the usage management support processing according to this embodiment 2, etc., is implemented.

User management DB312 is a database that manages permitted floors for each user. User management DB312 stores user ID3121 and permitted floors3122 in association with each other. User ID3121 is identification information for the target user. Permitted floors3122 is information indicating the floors that the target user is permitted to use. There may be multiple permitted floors3122 per user.

Here, user ID 3121 is information that is identical to or uniquely corresponds to user ID 211, which is managed in association with facial feature information 212 in facial information DB 210 of authentication device 200. Therefore, user management DB 312 and facial information DB 210 can be said to be databases in which a user's registration feature information (biometric information, personal authentication information, personal identification information, etc.) is associated with permitted floors 3122 via user ID 3121. In other words, user management DB 312 and facial information DB 210 can be said to be databases in which a user's facial feature information is associated with permitted floors that the user is authorized to use.

In addition, it is sufficient for the memory unit 310 to store at least the program 311. Therefore, the user management DB 312 may be stored in an external storage device connected to the usage management support device 300.

Memory 320 is a volatile storage device such as RAM (Random Access Memory) and is a storage area for temporarily storing information when control unit 340 is operating. Communication unit 330 is a communication interface with network N.

The control unit 340 is a processor, or control device, that controls each component of the usage management support device 300. The control unit 340 loads the program 311 from the storage unit 310 into the memory 320 and executes the program 311. As a result, the control unit 340 realizes the functions of the registration unit 341, authentication control unit 342, identification unit 343, operation control unit 344, judgment unit 345, and output unit 346.

The registration unit 341 registers the permitted floor 3122 for a specific user in the user management DB 312. For example, the registration unit 341 receives a pair of a specific user ID and a permitted floor indicating a specific floor from the administrator terminal 400 of the administrator of a specific floor via the network N. The registration unit 341 then associates the received user ID 3121 with the permitted floor 3122 and registers them in the user management DB 312. The registration unit 341 may also register the user's facial information. For example, the registration unit 341 receives a pair of a specific user's facial image and a permitted floor from the administrator terminal 400. The registration unit 341 then transmits a facial information registration request including the received facial image to the authentication device 200 via the network N. The registration unit 341 then receives the user ID issued when the facial information was registered from the authentication device 200. The registration unit 341 then associates the issued user ID 3121 with the accepted permitted floor 3122 and registers them in the user management DB 312 .

The authentication control unit 342 extracts the recognized facial area from the captured image as a facial image. At this time, the authentication control unit 342 may extract facial images of multiple people from a single captured image. The authentication control unit 342 controls facial authentication using the authentication device 200 for the recognized facial area or extracted facial image. Specifically, the authentication control unit 342 sends a facial authentication request including a facial image corresponding to the facial area to the authentication device 200, and receives the facial authentication result from the authentication device 200. The authentication control unit 342 then notifies the determination unit 345 of the facial authentication result received from the authentication device 200. Note that the authentication control unit 342 may extract facial feature information from the facial area and include the facial feature information in the facial authentication request.

The identification unit 343 is an example of the identification unit 11 described above. When the determination unit 345 determines that facial authentication is successful, the identification unit 343 identifies the user ID included in the facial authentication result. The identification unit 343 then identifies the permitted floor 3122 associated with the identified user ID 3121 from the user management DB 312. In other words, the identification unit 343 identifies the first permitted floor 3122 when the first facial authentication performed on the first facial image taken of the first user when boarding the elevator 100 using the facial feature information 212 in the facial information DB 210 is successful.

The operation control unit 344 is an example of the operation control unit 12 described above. The operation control unit 344 controls the operation of the elevator 100 according to the first permitted floor identified by the identification unit 343. Specifically, the operation control unit 344 controls the operation of the elevator 100 so that it stops at the first permitted floor. For example, the operation control unit 344 controls the operation by selecting a designated button for specifying a stop at the first permitted floor in the elevator 100. Specifically, the operation control unit 344 transmits a selection instruction for the designated button corresponding to the first permitted floor to the operation controller 110 via the network N. Alternatively, the operation control unit 344 controls the operation by selecting a designated button for specifying a stop at the first permitted floor in the elevator 100 (activating it). Specifically, the operation control unit 344 transmits an activation instruction for the designated button corresponding to the first permitted floor and an inactivation instruction for designated buttons corresponding to floors other than the first permitted floor to the operation controller 110 via the network N. For example, if a first user is permitted to use multiple floors, the operation control unit 344 may activate multiple designated buttons that the first user can designate and deactivate designated buttons for other floors to prevent them from being selected, i.e., to control operation.

The determination unit 345 is an example of the determination unit 13 described above. The determination unit 345 determines whether authentication is successful or not based on the facial authentication result notified by the authentication control unit 342. Furthermore, the determination unit 345 determines whether a second user who is about to disembark at a stopping floor is allowed to disembark, based on the facial authentication result.

Here, when the elevator 100 stops at a predetermined stopping floor and the second user succeeds in the second facial authentication, the identification unit 343 and the determination unit 345 may refer to the user management DB 312 to identify the second permitted floor 3122 associated with the user ID 3121 of the second user who succeeded in the second facial authentication. The determination unit 345 then determines whether the stopping floor is included in the identified second permitted floors. If the stopping floor is included in the second permitted floors, the determination unit 345 determines that the second user is allowed to disembark, and if the stopping floor is not included in the second permitted floors, the determination unit 345 determines that the second user is not allowed to disembark.

Alternatively, when the elevator 100 stops at a predetermined stopping floor, the identification unit 343 and the determination unit 345 may identify a user ID 3121 associated with the stopping floor as an allowed floor 3122 from the user management DB 312. In this case, the authentication control unit 342 and the determination unit 345 control the second facial authentication using the facial feature information 212 associated with the identified user ID 211 in the facial information DB 210. If the second facial authentication is successful, the determination unit 345 determines that the second user is allowed to disembark, and if the second facial authentication is unsuccessful, the determination unit 345 determines that the second user is not allowed to disembark.

The output unit 346 is an example of the output unit 14 described above. The output unit 346 outputs first warning information when it is determined that the second user is not allowed to disembark. Specifically, the output unit 346 transmits the first warning information to the warning information output unit 170 via the network N and the operation controller 110. The output unit 346 may also transmit the first warning information to the manager terminal 400 via the network N. Furthermore, the output unit 346 may output the first warning information including the second facial image to the manager terminal 400 of the manager of the stop floor.

Figure 7 is a flowchart showing the flow of operation control processing when boarding an elevator in this embodiment 2. First, the elevator 100 stops at a predetermined floor and opens the door 160. Then, user U1 or the like boards the elevator 100. At this time, the camera 120 captures an image including the face of user U1 or the like when boarding the elevator 100, and transmits the captured image to the usage management support device 300 via the network N. Therefore, the captured image includes the facial area of user U1 or the like.

In response to this, the usage management support device 300 acquires a captured image of the user when boarding the elevator 100 (S301). For example, the usage management support device 300 acquires the captured image from the camera 120 via the operation controller 110 and the network N. Alternatively, the usage management support device 300 may acquire the captured image from the camera 120 via the network N without going through the operation controller 110. The captured image may also be captured by the floor camera 101 instead of the camera 120. In this case, the usage management support device 300 acquires the captured image from the floor camera 101 via the network N.

Next, the usage management support device 300 extracts the user's facial image from the captured image (S302). Specifically, the usage management support device 300 recognizes the person's facial area from the captured image and extracts a facial image corresponding to the recognized facial area. The usage management support device 300 then transmits a facial recognition request including the extracted facial image to the authentication device 200 via the network N (S303). In response, the authentication device 200 performs facial recognition processing.

Figure 8 is a flowchart showing the flow of facial authentication processing by the authentication device 200 according to the second embodiment. First, the authentication device 200 receives a facial authentication request from the usage management support device 300 via the network N (S211). Next, the authentication device 200 extracts facial feature information from the facial image included in the facial authentication request, similar to steps S202 and S203 described above. Then, the authentication unit 250 of the authentication device 200 compares the facial feature information extracted from the facial image included in the facial authentication request with the facial feature information 212 in the facial information DB 210 (S212) and calculates the degree of match. Then, the authentication unit 250 determines whether the degree of match is equal to or greater than a threshold (S213). If the facial feature information matches, that is, if the degree of match of the facial feature information is equal to or greater than the threshold, the authentication unit 250 identifies the user ID 211 associated with the facial feature information 212 (S214). Then, the authentication unit 250 returns the face authentication result, including the fact that the face authentication was successful and the identified user ID 211, to the usage management support device 300 via the network N (S215). If the degree of match is less than the threshold in step S213, the authentication unit 250 returns the face authentication result, including the fact that the face authentication was unsuccessful, to the usage management support device 300 via the network N (S216).

Returning to FIG. 7, the description will continue.
The usage management support device 300 receives the facial authentication result from the authentication device 200 via the network N (S304). The usage management support device 300 then determines whether the facial authentication was successful (S305). Specifically, the usage management support device 300 references the facial authentication result, and if the facial authentication result includes a user ID, determines that the facial authentication was successful. The usage management support device 300 then identifies the user ID included in the facial authentication result (S306). The usage management support device 300 then identifies the first permitted floor 3122 associated with the identified user ID 3121 from the user management DB 312 (S307). The usage management support device 300 then changes the designation button for the identified first permitted floor to a selected state (S308). Specifically, as described above, the usage management support device 300 transmits a selection instruction for the designation button corresponding to the first permitted floor to the operation controller 110 via the network N. As a result, the operation controller 110 selects the corresponding designation button in the floor designation unit 140. On the other hand, if it is determined in step S305 that face authentication has failed, the usage management support device 300 outputs warning information (S309). As a result, the warning information output unit 170 outputs the warning information.

In addition, if two or more facial images are extracted in step S302, the usage management support device 300 repeatedly executes steps S303 to S309 for each facial image.

Note that, instead of step S308 of FIG. 7 , the utilization management support device 300 may change the designation button for the identified first permitted floor to a selectable state, i.e., activate the designation button. In this case, the utilization management support device 300 also changes the designation buttons for floors other than the identified first permitted floor to an unselectable state, i.e., deactivate the designation buttons. User U1 may then press the designation button 141 for "10F." In this case, user U1 can only select permitted floors and cannot select other floors, thereby preventing the user from pressing the wrong button. Furthermore, by not allowing a user to select a prohibited floor when boarding alone, disembarking at a prohibited floor can be prevented, improving the deterrent effect against malicious boarding and unauthorized disembarking.

Figure 9 is a diagram showing an example of the situation inside elevator 100 at the time of boarding in embodiment 2. It is assumed that, in user management DB 312, at least user U1's user ID is associated with "10F" as the permitted floor. Cameras 120-1 and 120-2 are examples of imaging devices that capture images of the interior space of elevator 100. Note that a single camera may be used. Camera 120-2 is capable of capturing images including the faces of users U1 to U3 when they board elevator 100. Furthermore, camera 120-1 is capable of capturing images including the faces of users U1 to U3 when they face outside (toward the back of Figure 9, toward door 160) after boarding inside elevator 100. It is assumed that usage management support device 300 performed the processing of Figure 7 described above using images captured by either camera 120-1 or 120-2. Then, for example, assume that user U1 succeeds in the first face authentication, and the utilization management support device 300 identifies "10F" as the permitted floor for user U1, and controls the operation of the elevator 100 by selecting the designation button 141 for "10F." Alternatively, the designation button 141 may be activated to a selectable state, and the other designation buttons may be deactivated to an unselectable state. The display device 130 indicates that a message "Moving to 10F" is being displayed. Thereafter, the elevator 100 closes the door 160 and moves to the designated floor (e.g., the 10th floor).

Next, Examples 2-1 and 2-2 will be described below regarding the warning determination process when disembarking an elevator using the second facial authentication. In Example 2-1, the usage management support device 300, similar to the operation control process when boarding, identifies the permitted floors for the second user who has successfully passed the second facial authentication, and if the identified permitted floors include a stop floor, determines that the second user is allowed to disembark.

Figure 10 is a flowchart showing the flow of the warning determination process when disembarking from an elevator according to Example 2-1 of this embodiment 2. First, the elevator 100 stops at a predetermined floor and opens the door 160. Then, the user U1 or the like disembarks from the elevator 100. At this time, the camera 120 captures an image including the face of the user U1 or the like as they disembark from the elevator 100, and transmits the captured image to the usage management support device 300 via the network N. Therefore, the captured image includes the facial area of the user U1 or the like.

In response to this, the usage management support device 300 acquires an image of the user exiting the elevator 100 (S321). Note that the image may be taken by a floor camera 101 installed in the elevator hall at the stop floor instead of the camera 120.

Next, steps S302 to S305 are executed as in FIG. 7 described above, and if the second face authentication is successful, steps S306 and S307 are executed as in FIG. 7 described above. Then, the usage management support device 300 determines whether the stopping floor of the elevator 100 is included in the permitted floors identified in step S307 (S328). If the stopping floor is included in the permitted floors for the second user, the usage management support device 300 determines that the second user can disembark at the stopping floor. In this case, the usage management support device 300 performs normal operation control on the elevator 100. In other words, after the disembarking user has finished disembarking, the elevator 100 closes the door 160 and begins moving to the next specified floor.

On the other hand, if the second user fails the second facial authentication in step S305, or if the stop floor is not included in the second user's permitted floors in step S328, the usage management support device 300 determines that the second user is not allowed to disembark at the stop floor and outputs warning information (S329). This causes the warning information output device 170 to output the warning information. At this time, the usage management support device 300 may output the warning information including a second facial image of the second user who failed the second facial authentication. In particular, the usage management support device 300 may transmit the second facial image to the administrator terminal 400 including it in the warning information. This allows the administrator or security guard to visually recognize the face of the second user who is not permitted to disembark, making it easier to call out to the user, etc.

In addition, if two or more facial images are extracted in step S302, the usage management support device 300 repeatedly executes steps S303 to S307, S328 and S329 for each facial image.

Next, in Example 2-2, when the elevator stops, the usage management support device 300 narrows down the users who have set the stopping floor as an allowed floor, and uses the facial feature information of the narrowed down users as the target for comparison in the second facial authentication.If the second facial authentication is successful, it determines that the second user is allowed to disembark.

Figure 11 is a flowchart showing the flow of the warning determination process when disembarking from the elevator according to Example 2-2 of this embodiment 2. First, when the elevator 100 stops at a predetermined stopping floor, the usage management support device 300 identifies the user ID 3121 associated with the stopping floor as an allowed floor 3122 from the user management DB 312 (S320). Then, similar to step S321 in Figure 10 described above, the usage management support device 300 acquires a captured image of the user disembarking from the elevator 100. Then, similar to step S302 in Figure 7 described above, the usage management support device 300 extracts a facial image of the second user from the captured image.

Then, the usage management support device 300 transmits a facial authentication request targeting the user ID identified in step S320 (S323). For example, if multiple user IDs are identified in step S320, the usage management support device 300 transmits a facial authentication request specifying the identified multiple user IDs and including the facial image of the second user extracted in step S302 to the authentication device 200 via the network N.

In response, the authentication device 200 extracts facial feature information from the facial image of the second user included in the facial authentication request. The authentication device 200 also narrows down the facial feature information 212 associated with the user ID 211 specified in the received facial authentication request from the facial information DB 210. The authentication device 200 then performs facial authentication processing by matching the facial feature information of the second user with each of the narrowed-down facial feature information 212. Here, in a typical facial authentication process, a one-to-N authentication is performed between the facial feature information of the second user and all of the facial feature information 212 in the facial information DB 210. In contrast, in Example 2-2, although the one-to-N authentication is performed, the target for matching the facial feature information of the second user is narrowed down to a portion of the facial feature information 212 in the facial information DB 210. Therefore, the facial authentication processing of Example 2-2 requires less facial feature information to be authenticated than a typical facial authentication processing, thereby reducing authentication costs, such as the authentication processing load and processing time. In other words, the authentication processing can be made more efficient. Then, the authentication device 200 transmits the face authentication result to the usage management support device 300.

In response, the usage management support device 300 receives the facial authentication result from the authentication device 200 via the network N (S304). Then, the usage management support device 300 determines whether or not facial authentication was successful (S305). If the second user's facial authentication is successful, the usage management support device 300 determines that the second user can disembark at the stopping floor. In this case, the usage management support device 300 performs normal operation control of the elevator 100.

On the other hand, if the second user fails the second facial authentication in step S305, the usage management support device 300 determines that the second user is not allowed to disembark at the stopping floor and outputs warning information (S329). As a result, the warning information output device 170 outputs warning information. Furthermore, as in the above-mentioned Example 2-1, the usage management support device 300 may output the warning information including the second facial image of the second user who failed the second facial authentication.

In addition, if two or more facial images are extracted in step S302, the usage management support device 300 repeatedly executes steps S323, S304, S305 and S329 for each facial image.

12 is a diagram showing an example of the display of warning information when disembarking in this embodiment 2. Here, the elevator 100 stops on the 10th floor, and users U1 and U2 successfully pass the second facial authentication, determining that they are allowed to disembark on the 10th floor, but user U3 is not permitted to disembark on the 10th floor. Disembarkation may not be permitted if facial authentication of user U3 fails, or if facial authentication of user U3 is successful but the 10th floor is not included in the permitted floors for user U3. The display device 130 displays the warning information output by step S329 in FIG. 10 or 11 at the time user U3 disembarks after users U1 and U2 have disembarked. The warning information displayed on the display device 130 includes, for example, a message indicating "Disembarkation not permitted!", a facial image captured when user U3 disembarked, and the date, time, and location (10F) of the third facial authentication. However, the warning information is not limited to these examples. Furthermore, if user U3 has succeeded in the third face authentication, the face image included in the warning information may be a face image registered for matching.

13 is a diagram showing an example of warning information displayed on an administrator terminal when disembarking according to this embodiment 2. Here, it is assumed that when elevator 100 stops at the fifth floor, users moving from inside elevator 100 toward door 160 to disembark are photographed by camera 120-1 on the door 160 side inside elevator 100. Then, it is assumed that facial recognition is performed for each user in the photographed image, and one user is determined to be NO in step S305 or NO in S328, and warning information is output (S329). As described above, administrator terminal 400 displays the warning information output in step S329 on its screen. The warning information displayed on the screen of administrator terminal 400 includes, for example, a photographed image taken by camera 120-1 on the door 160 side inside elevator 100, a facial image of the person in the image who is the target of the warning, and a warning message. The facial image may be an enlarged image of the facial area of the person in the photographed image who is the target of the warning. The warning message includes the floor to which the warning applies, the date and time, etc. In this example, the warning message reads, "An unauthorized user disembarked (entered) the fifth floor at 2:30 PM," but is not limited to this. This allows the building manager or security guard, or the manager of the company using the disembarking floor, to easily grasp the number and facial photographs of unauthorized people among those attempting to disembark from the elevator, based on the warning information displayed on the manager terminal 400.

The warning information may also include the floor on which the person being warned boarded. For example, when each user U1, etc., boards, the usage management support device 300 associates the facial image and facial feature information with the floor on which the user boarded (boarding floor) and stores the associated information in memory 320, etc., regardless of whether the first facial authentication for each user was successful. Then, when the elevator 100 stops and warning information is generated for step S329, the usage management support device 300 may include in the warning information the boarding floor associated with the facial image and facial feature information of the person being warned. The usage management support device 300 then outputs warning information including the person being warned and their boarding floor.

Furthermore, if the person to be warned is a user registered with an organization such as a company on a different floor, attribute information such as the user's name and the organization's department may be registered, and the name, etc. of the person to be warned can be identified through facial recognition. Therefore, if the person to be warned can be identified through facial recognition, the usage management support device 300 can identify attribute information such as the person's name and department, and include the identified attribute information in the warning information. Furthermore, if the person to be warned cannot be identified through facial recognition, the usage management support device 300 can include in the warning information a notice that the person to be warned is not registered. Furthermore, if the person to be warned can be identified through facial recognition but the person's attribute information cannot be identified, the usage management support device 300 can also include in the warning information a notice that the person to be warned is not registered.

In this way, in embodiment 2, the designated button for the permitted floor that was registered in advance for the user boarding the elevator is automatically selected. Therefore, even if the user does not press the designated button, the elevator automatically stops at the floor that the user is permitted to use, allowing the permitted user to complete their business smoothly. In particular, in the case of visitors, even if a guide is not accompanying them, the visitor can go to the permitted floor without getting lost or accidentally getting off at the wrong floor. Alternatively, in embodiment 2, the designated button for the permitted floor may automatically become selectable, and the designated buttons for floors other than the permitted floor may automatically become unselectable. This prevents the user from accidentally pressing a different floor.

In addition, if a second user attempts to get off at an unauthorized floor, or if the second user actually gets off, warning information is output, allowing the second user and relevant parties at the stopping floor to quickly become aware of the situation. This can prevent malicious users from entering unauthorized floors.

In addition, in Example 2-1, even if a second user blends in with other users or boards the vehicle together when boarding, facial recognition is performed for each user when disembarking and then the permitted floor is determined, so a warning can be given to the second user who is not permitted to disembark at the stopping floor. This can prevent tailgating from disembarking. Furthermore, in Example 2-2, the targets of the second facial recognition are narrowed down, thereby reducing the cost of facial recognition when disembarking.

In this way, this embodiment 2 can reduce the cost of installing physical gates and help prevent unauthorized users from entering each floor.

<Embodiment 3>
The third embodiment is a modification of the second embodiment described above. In the third embodiment, a first facial authentication is performed when a user in the elevator attempts to specify the floor at which to alight. Therefore, the elevator 100 according to the third embodiment is assumed to have a second camera installed in a position where the face of the user pressing the specification button can be photographed, for example, around the floor specification unit 140. Note that the overall configuration of the usage management support system according to the third embodiment is the same as that described above, and therefore illustrations and redundant explanations will be omitted, and the following description will focus on the differences from the second embodiment.

The identification unit in this embodiment 3 identifies a first permitted floor when a first facial authentication is performed using facial feature information from a database on a first facial image captured while a first user is in the elevator and attempting to specify a floor at which the first user will disembark. Here, "when the first user attempts to specify a floor at which the first user will disembark" refers, for example, to when the first user presses a designation button on a floor designation unit inside the elevator. If the first facial authentication is successful and the floor designated by the first user is included in the first permitted floors, the operation control unit controls operation by selecting a designation button for designating a stop at the designated floor. Alternatively, "when the first user attempts to designate a floor at which the first user will disembark" may refer, for example, to when the first user stands in front of the floor designation unit inside the elevator to designate a floor at which the first user will disembark, but before pressing the designation button. If the first facial authentication is successful at this time, the operation control unit may control operation by selecting a designation button for designating a stop at the first permitted floor.

Figure 14 is a flowchart showing the flow of the operation control process when boarding an elevator according to this embodiment 3. Here, it is assumed that the elevator 100 stops at a predetermined floor and a user U1 or the like boards the elevator 100. Then, it is assumed that the user U1 (first user) stands in front of the floor designation unit 140 inside the elevator 100 and presses the designation button corresponding to the floor at which the user wishes to disembark. At this time, the second camera photographs the face of the user U1 in front of the floor designation unit 140 and transmits the photographed image to the usage management support device 300 via the network N. Here, "a photograph taken when the user U1 specifies the floor at which the user wishes to disembark (by the second camera) inside the elevator 100" is an example of "a photograph taken as a result of boarding the elevator."

In response, the usage management support device 300 accepts user U1 pressing the designated button for the disembarking floor inside the elevator 100 (S331). At the same time, the usage management support device 300 acquires a photographed image of user U1 in front of the designated button inside the elevator 100 (S301a).

Next, steps S302 to S305 are executed as in FIG. 7 described above, and if the first user succeeds in the first facial authentication, steps S306 and S307 are executed as in FIG. 7 described above. Then, the usage management support device 300 determines whether the disembarking floor (designated floor) accepted in step S331 is included in the first permitted floors identified in step S307 (S338). If the designated floor is included in the first permitted floors of the first user, the usage management support device 300 changes the designation button for the identified first permitted floor to a selected state, as described above (S308). As a result, the operation controller 110 selects the corresponding designation button in the floor designation unit 140.

On the other hand, if it is determined in step S305 that facial authentication has failed, or if in step S338 the designated floor is not included in the first permitted floors of the first user, the usage management support device 300 outputs warning information (S309). As a result, the warning information output device 170 outputs warning information. Note that in step S309 of FIG. 14, the usage management support device 300 does not necessarily output warning information to the administrator terminal 400. This is because this would result in excessive notification if, for example, the user presses the wrong designation button. Therefore, in step S309 of FIG. 14, the usage management support device 300 may output an alarm sound or audio data or a display message indicating that the designated floor is not a permitted floor as warning information.

Note that the acceptance of the press of the exit floor designation button in step S331 of FIG. 14 may be executed after successful facial authentication in step S305 and before step S338. If facial authentication fails, the user is not authorized to use the elevator in the first place, so warning information can be output without even accepting the designation of the exit floor.

Alternatively, instead of step S308 in FIG. 14, the utilization management support device 300 may change the designation button for the identified first permitted floor to a selectable state, i.e., activate the designation button. In this case, the utilization management support device 300 also changes the designation buttons other than the identified first permitted floor to an unselectable state, i.e., deactivates the designation buttons. This makes it possible to narrow down the selectable designation buttons in advance when there are multiple first permitted floors, thereby preventing erroneous selection by the user. User U1 may then press the designation button 141 for "10F." In response, in step S331 in FIG. 14, the utilization management support device 300 may accept a press from among the activated designation buttons for the disembarking floors.

Figure 15 is a diagram showing an example of pressing a designated button in the elevator 100 according to the third embodiment. Here, it shows that user U1 has pressed the designated button 141 in front of the floor designation unit 140. Alternatively, it may be that user U1 is standing in front of the floor designation unit 140 and has not yet pressed the designated button 141. Furthermore, camera 120-3 is an example of a second camera, and captures the face of user U1 in front of the floor designation unit 140. In this example, it is assumed that the first facial authentication was successful for the first facial image of user U1 extracted from the image captured by camera 120-3. Therefore, the usage management support device 300 determines that "10F," which corresponds to the designated button 141 pressed by user U1, is included in the permitted floors 3122 associated with user U1, and changes the designated button 141 to a selected state. In other words, it shows that the designated button 141 pressed by user U1 has been activated.

FIG. 16 is a diagram showing an example of warning information displayed when a designated button is pressed in an elevator according to the third embodiment. Here, the example shows a case where user U1 is not permitted to disembark (designate) the 10th floor when, or before, he or she presses the designated button 141 corresponding to the 10th floor in front of the floor designation unit 140. Disembarkation may be not permitted if facial authentication of user U1 fails, or if facial authentication of user U1 is successful but the 10th floor is not included in the permitted floors for user U1 . The display device 130 shows that warning information similar to that shown in FIG. 12 above is displayed. However, the warning information is not limited to these.

In addition, in this embodiment 3, either Example 2-1 or 2-2 described above can be applied to the warning determination process when exiting the elevator.

In this way, this embodiment also reduces the cost of installing physical gates and helps prevent unauthorized users from entering each floor. In particular, this embodiment 3 can prevent a user who boards an elevator from mistakenly specifying a floor other than the permitted floor as the floor where they will disembark. Furthermore, if only a user who has not previously registered a permitted floor boards the elevator, the specified button will not be selected, and the user will not be able to disembark alone at an unauthorized floor. In other words, it is possible to prevent malicious users from boarding the elevator.

<Fourth Embodiment>
The fourth embodiment is an improved version of the second or third embodiment described above. According to the second or third embodiment described above, warning information is output when an elevator passenger attempts to disembark at a floor other than the permitted floor, which has the effect of deterring malicious users from boarding the elevator and preventing passengers from accidentally disembarking at floors other than the permitted floor. However, since this embodiment does not use a security gate, it is possible for passengers to disembark at floors other than the permitted floors when accompanied by an authorized user or in a large group. Therefore, the fourth embodiment detects the timing when an elevator is called in the elevator hall so that passengers who have disembarked at floors other than the permitted floors can return to their original floors, thereby strengthening the warning and deterrence measures.

The determination unit in this embodiment 4 refers to the database and determines whether to stop the elevator at a predetermined floor by performing third facial recognition on a third facial image captured of a third user attempting to press the elevator call button at a predetermined floor. If it is determined that the elevator should not be stopped at the predetermined floor, the operation control unit controls the operation so that the elevator does not stop at the predetermined floor. This prevents third users who are staying at floors other than permitted floors from boarding the elevator. Here, "attempting to press the elevator call button at a predetermined floor" refers, for example, to when a third user presses the call button in the elevator hall at the predetermined floor. Alternatively, "attempting to press the elevator call button at a predetermined floor" may refer, for example, to when a third user stands in front of the call button but before pressing the call button.

Furthermore, it is desirable that the output unit outputs second warning information when it determines not to stop the elevator at the specified floor. This makes it easier for the third user and people in the vicinity of the elevator hall on the specified floor to recognize that the third user is staying on the specified floor without permission.

Furthermore, the output unit may output second warning information including the third facial image to the terminal of the manager on the specified floor. This makes it easier for security guards, managers, etc. on the specified floor to recognize the face of the third user and then call out to or track the user.

The determination unit may also control the third facial authentication using facial feature information associated with a specific floor in the database, and if the third facial authentication fails, determine that the vehicle should not be stopped at the specific floor. This reduces the amount of facial feature information to be authenticated compared to normal facial authentication processing, reducing authentication costs such as the authentication processing load and processing time. In other words, the authentication process can be made more efficient.

Alternatively, the determination unit may refer to the database to identify a third permitted floor associated with a third user who has successfully passed the third facial authentication, and if the specified floor is not included in the third permitted floors, determine not to stop the vehicle at the specified floor. This allows the third user and related parties on the specified floor to quickly recognize this. This can therefore prevent malicious users from escaping from unauthorized floors.

Furthermore, if it is determined that the elevator should not stop at a specified floor, the operation control unit may control the operation by making the call button unselectable. This prevents the elevator from stopping and prevents a third user from boarding the elevator.

Figure 17 is a block diagram showing the configuration of the usage management support system 1000b according to this embodiment 4. Compared to Figure 3 described above, in the usage management support system 1000b, the floor camera 101-2 is installed in a position where it can capture an image of an area including the face of a user who presses a call button to call the elevator 100 on each floor. For example, it is assumed that the floor camera 101-2 (third camera) is installed above the call button for the elevator 100 in the elevator hall on a specific floor. It is also assumed that user UX (third user) is in front of the call button on the specific floor. It is also assumed that the specific floor is not registered as a permitted floor for user UX.

Figure 18 is a flowchart showing the flow of the warning determination process when calling an elevator according to Example 4-1 of this embodiment 4. First, user UX presses the call button for elevator 100 in the elevator hall on a specific floor. At this time, floor camera 101-2 captures an image of user UX's face in front of the call button and transmits the captured image to usage management support device 300 via network N.

In response to this, the usage management support device 300 accepts the user UX pressing the call button to call the elevator 100 at a specific floor (S341). In addition, the usage management support device 300 acquires a photographed image of the user UX when calling the elevator 100 (S342).

Next, steps S302 to S305 are executed as in FIG. 7 described above. If the third user succeeds in the third facial authentication, steps S306 and S307 are executed as in FIG. 7 described above. The usage management support device 300 then determines whether the specified floor received in step S341 is included in the third permitted floors identified in step S307 (S347). If the specified floor is included in the third permitted floors for the third user, the usage management support device 300 changes the specified button received in step S341 to a selected state (S348). Specifically, the usage management support device 300 transmits an instruction to select the call button for the specified floor via network N to a controller (not shown) in the elevator hall of the specified floor. As a result, the controller selects the call button, i.e., activates the call button.

On the other hand, if it is determined in step S305 that facial authentication has failed or if the specified floor is not included in the third permitted floors for the third user in step S347, the usage management support device 300 outputs warning information (S349). As a result, a warning information output device (not shown) on the specified floor outputs the warning information. For example, the warning information output device outputs an alarm sound or a warning message from a speaker in the elevator hall on the specified floor. The warning information output device may also turn on or flash a lamp in the elevator hall on the specified floor, or display a warning message on a display panel. Alternatively, the usage management support device 300 may transmit the warning information to the administrator terminal 400 via network N. Furthermore, the usage management support device 300 may output warning information including a facial image of the third user. In this case, for example, warning information such as the facial image of the third user may be displayed on a display panel in the elevator hall on the specified floor. This allows people around the elevator hall on the specified floor to recognize that the third user is not authorized to be on the specified floor, making it easier to take appropriate action. The usage management support device 300 may also transmit warning information in step S349 to the administrator terminal 400 via the network N. In this case, the administrator terminal 400 displays the received warning information, such as a facial image of the third user, on its screen. This allows the building or floor manager, supervisor, or security guard to recognize the face of the third user, making it easier to subsequently call out to or track the user.

Note that the reception of the call button press in step S341 of FIG. 18 may be performed after face authentication is successful in step S305 and before step S347. If face authentication fails, the user is not authorized to use the current floor (predetermined floor) in the first place, so warning information can be output without receiving the call button press.

Alternatively, the usage management support device 300 may make the call button unselectable, i.e., inactive, instead of or in addition to step S349 of FIG. 18.

Figure 19 is a flowchart showing the flow of the warning determination process when calling an elevator according to Example 4-2 of this embodiment 4. First, step S341 is executed as in Example 4-1 described above. Then, the usage management support device 300 identifies the user ID 3121 associated with the specified floor as the permitted floor 3122 from the user management DB 312 (S343).

Furthermore, step S342 is executed in the same manner as in Example 4-2 described above. Then, the usage management support device 300 extracts the user's facial image from the captured image (S302). After steps S343 and S302, the usage management support device 300 transmits a facial authentication request targeted at the user ID identified in step S343 (S344). For example, if multiple user IDs are identified in step S343, the usage management support device 300 specifies the identified multiple user IDs and transmits a facial authentication request including the facial image of the third user extracted in step S302 to the authentication device 200 via network N.

In response, the authentication device 200 performs facial authentication processing by comparing the facial feature information of the third user with each of the narrowed-down facial feature information 212. The authentication device 200 transmits the facial authentication results to the usage management support device 300. Thereafter, steps S304 to S307 and S347 to S349 are executed in the same manner as in Figure 18 described above.

Figure 20 is a diagram showing an example of calling the elevator 100 according to this embodiment 4. Figure 15 shows that the display device 130 is installed outside the elevator 100 (on the elevator hall side), and that the user UX has pressed the call button 180 of the elevator 100 in the elevator hall of a specific floor. Alternatively, the user UX may have pressed the call button 180 before pressing the call button 180. Furthermore, the floor camera 101-2 captures an image of the face of the user UX in front of the call button of the elevator 100 in the elevator hall of a specific floor. In this example, it is assumed that the third face authentication for the third face image of the user UX extracted from the image captured by the floor camera 101-2 has been successful. However, it is assumed that the specific floor is not associated with the user ID 3121 of the user UX as an allowed floor 3122 in the user management DB 312. Therefore, the usage management support device 300 does not activate the call button. For example, the usage management support device 300 may transmit a control signal to a controller in the elevator hall of a specific floor to inhibit activation of the call button. The usage management support device 300 may also output a warning message to the controller. The controller may then display the warning message "You are not permitted to stay on this floor!" on the display device 130.

Figure 21 is a diagram showing an example of the display of warning information when calling an elevator in this embodiment 4. Here, it shows a case where user UX was not permitted to stay on the 10th floor when, or before, pressing the call button 180 in the elevator hall on the 10th floor. Here, if disembarking is not permitted, there are cases where facial authentication of user UX fails, or where facial authentication of user UX is successful but the 10th floor is not included in the permitted floors for user U3. The display device 130 shows that warning information similar to that shown in Figure 12 above is displayed. However, warning information is not limited to these.

Figure 22 is a diagram showing an example of warning information displayed on an administrator terminal when calling an elevator according to this embodiment 4. This figure shows a case where warning information is output to the administrator terminal 400 in step S349 under the same circumstances as in Figure 21 described above. The administrator terminal 400 displays the warning information output in step S349 on its screen, as described above. The warning information displayed on the screen of the administrator terminal 400 includes, for example, an image captured by floor camera 101-2 installed above the call button in the elevator hall on the fifth floor, a facial image of the person who is the target of the warning in the image, and a warning message. The facial image may be an enlarged image of the facial area of the person who is the target of the warning in the captured image. The warning message includes the floor to be warned, the date and time, etc. In this example, the warning message states, "A user who is not authorized to be on the fifth floor is in the elevator hall on the fifth floor at 2:30 p.m." However, the warning message is not limited to this. This allows the building manager or security guard, or the manager of the company using the disembarking floor, to easily grasp the number and facial photographs of unauthorized persons among those attempting to board the elevator, based on the warning information displayed on the manager terminal 400. As described above, the warning information may include the boarding floor of the person to be warned, attribute information such as the name and department to which the person belongs, or a fact that the person is not registered.

In this way, even if a third user who has not been authorized to use a specific floor in advance or whose face information has not been registered gets off at the specific floor for some reason, the third user can be prevented from boarding the elevator again when the elevator is called to board again. This can also help relevant parties on the specific floor to call out to and track the third user.

<Other embodiments>
In the above-described first to fourth embodiments, personal authentication (authentication of identity confirmation, identity authentication, identity identification processing, etc.) has been described as face authentication. However, other biometric authentication methods using biometric information may also be used. Other technologies using captured images of a person may be applied to biometric authentication and biometric information. For example, biometric information may be data (features) calculated from physical characteristics unique to an individual, such as fingerprints, voiceprints, veins, retinas, irises, and palm patterns. Furthermore, biometric authentication may involve extracting feature information indicating a person's physical characteristics from a captured image of a part of the user's body, comparing the extracted feature information with pre-registered feature information, and determining that authentication is successful if the degree of match is equal to or greater than a threshold. For example, biometric authentication may be authentication based on a person's external shape. In this case, the feature information may be information about a person's external shape, such as information indicating characteristics such as body shape, height, and clothing.

In the above-mentioned embodiments 2 to 4, the authentication device 200 and the usage management support device 300 are described as separate information processing devices, but they may be the same. For example, the usage management support device 300 may further associate and register facial feature information with the user ID 3121 in the user management DB 312. In this case, the control unit 340 may further have the functions of the face detection unit 220, feature point extraction unit 230, registration unit 240, and authentication unit 250 in Figure 4.

In the above examples, the program includes instructions (or software code) that, when loaded into a computer, cause the computer to perform one or more functions described in the embodiments. The program may be stored on a non-transitory computer-readable medium or a tangible storage medium. By way of example and not limitation, computer-readable medium or tangible storage medium includes random-access memory (RAM), read-only memory (ROM), flash memory, solid-state drive (SSD) or other memory technology, CD-ROM, digital versatile disc (DVD), Blu-ray® disc or other optical disk storage, magnetic cassette, magnetic tape, magnetic disk storage or other magnetic storage device. The program may also be transmitted on a transitory computer-readable medium or communication medium. By way of example and not limitation, transitory computer-readable medium or communication medium includes electrical, optical, acoustic, or other forms of propagated signals.

Note that this disclosure is not limited to the above-described embodiments and can be modified as appropriate without departing from the spirit of the disclosure. Furthermore, this disclosure may be implemented by combining the respective embodiments as appropriate.

Some or all of the above embodiments can be described as, but are not limited to, the following supplementary notes.
(Appendix A1)
an identification means for identifying a first permitted floor associated with a first user who has successfully passed first face authentication for a first face image captured while riding in an elevator, by referring to a database in which facial feature information of the user is associated with a permitted floor that the user is permitted to use;
an operation control means for controlling the operation of the elevator in accordance with the first permitted floor;
a determination means for determining whether a second user is permitted to disembark at a stop floor where the elevator has stopped in accordance with the operation control by performing second facial authentication on a second facial image of the second user disembarking at the stop floor, with reference to the database;
an output means for outputting first warning information when it is determined that the second user is not allowed to get off the vehicle;
A usage management support device comprising:
(Appendix A2)
the identification means identifies the first permitted floor when the first face authentication performed using the facial feature information in the database on the first face image photographed of the first user when boarding the elevator is successful.
2. The utilization management support device according to claim A1.
(Appendix A3)
The utilization management support device according to Appendix A2, wherein the operation control means controls the operation of the elevator so that the elevator stops at the first permitted floor.
(Appendix A4)
The utilization management support device according to Appendix A2, wherein the operation control means performs the operation control by making a designation button for designating a stop at the first permitted floor in the elevator selectable.
(Appendix A5)
the specifying means specifies the first permitted floor when the first face authentication performed using the facial feature information in the database on the first face image taken when the first user is about to specify a floor at which the first user will get off in the elevator is successful.
2. The utilization management support device according to claim A1.
(Appendix A6)
The usage management support device described in Appendix A5, wherein the operation control means performs the operation control by selecting a designation button for designating a stop at the designated floor when the floor designated by the first user is included in the first permitted floors.
(Appendix A7)
The utilization management support device according to appendix A6, wherein the operation control means performs the operation control by making a designation button for designating a stop at the first permitted floor selectable.
(Appendix A8)
The determination means
controlling the second face authentication using the facial feature information associated with the stop floor as the permitted floor in the database;
The utilization management support device according to any one of appendices A1 to A7, wherein, if the second face authentication fails, it is determined that the second user is not allowed to disembark.
(Appendix A9)
The determination means
referring to the database to identify a second permitted floor associated with the second user who has succeeded in the second face authentication;
The utilization management support device according to any one of appendices A1 to A7, wherein if the stop floor is not included in the second permitted floors, it is determined that the second user is not allowed to disembark.
(Appendix A10)
The utilization management support device according to any one of appendices A1 to A9, wherein the output means outputs the first warning information including the second facial image to a terminal of a manager of the stop floor.
(Appendix A11)
the determination means refers to the database and determines whether or not to stop the elevator at the predetermined floor by performing third face authentication on a third face image captured of a third user who is about to press a call button for the elevator at the predetermined floor;
The usage management support device described in any one of Appendices A1 to A10, wherein the operation control means performs the operation control so as not to stop the elevator at the specified floor when it is determined that the elevator should not be stopped at the specified floor.
(Appendix A12)
The utilization management support device according to Appendix A11, wherein the output means outputs second warning information when it is determined that the elevator should not be stopped at the predetermined floor.
(Appendix A13)
The usage management support device according to Appendix A12, wherein the output means outputs the second warning information including the third facial image to a terminal of a manager of the predetermined floor.
(Appendix A14)
The determination means
controlling the third face authentication using the facial feature information associated with the predetermined floor in the database;
The utilization management support device according to any one of appendices A11 to A13, wherein, if the third face authentication fails, it is determined that the vehicle should not be stopped at the predetermined floor.
(Appendix A15)
The determination means
referring to the database to identify a third permitted floor associated with the third user who has succeeded in the third face authentication;
The utilization management support device according to any one of appendices A11 to A13, wherein if the predetermined floor is not included in the third permitted floors, it is determined not to stop at the predetermined floor.
(Appendix A16)
The utilization management support device described in any one of appendices A11 to A15, wherein the operation control means performs the operation control by making the call button unselectable when it is determined that the elevator should not stop at the specified floor.
(Appendix B1)
a database that associates facial feature information of a user with a permitted floor that the user is permitted to use;
a usage management support device connected to the database,
The usage management support device
an identification means for identifying a first permitted floor associated with a first user who has succeeded in first face authentication for a first face image captured while boarding an elevator, by referring to the database;
an operation control means for controlling the operation of the elevator in accordance with the first permitted floor;
a determination means for determining whether a second user is permitted to disembark at a stop floor where the elevator has stopped in accordance with the operation control by performing second facial authentication on a second facial image of the second user disembarking at the stop floor, with reference to the database;
an output means for outputting first warning information when it is determined that the second user is not allowed to get off the vehicle;
A usage management support system equipped with:
(Appendix B2)
the identification means identifies the first permitted floor when the first face authentication performed using the facial feature information in the database on the first face image photographed of the first user when boarding the elevator is successful.
A usage management support system as described in Appendix B1.
(Appendix C1)
The computer
by referring to a database in which facial feature information of a user is associated with an authorized floor that the user is authorized to use, the system identifies a first authorized floor that is associated with a first user who has successfully passed first face authentication on a first face image captured while boarding the elevator;
performing operation control of the elevator according to the first permitted floor;
referring to the database, and performing second facial authentication on a second facial image of a second user who gets off at a stop floor where the elevator has stopped in accordance with the operation control, to determine whether the second user is allowed to get off at the stop floor;
outputting first warning information when it is determined that the second user is not allowed to get off the vehicle;
Usage management support method.
(Appendix D1)
a process of identifying a first permitted floor associated with a first user who has successfully passed first face authentication for a first face image captured while riding in an elevator, by referring to a database that associates facial feature information of the user with permitted floors that the user is permitted to use;
an operation control process for controlling the operation of the elevator in accordance with the first permitted floor;
a determination process of determining whether a second user is permitted to disembark at a stop floor where the elevator has stopped in accordance with the operation control by performing second facial authentication on a second facial image of the second user who disembarks at the stop floor with reference to the database;
an output process of outputting first warning information when it is determined that the second user is not allowed to get off the vehicle;
A non-transitory computer-readable medium storing a usage management support program that causes a computer to execute the above.

The present invention has been described above with reference to embodiments (and examples), but the present invention is not limited to the above embodiments (and examples). Various modifications that would be understood by a person skilled in the art can be made to the configuration and details of the present invention within the scope of the present invention.

1 Usage management support device 11 Identification unit 12 Operation control unit 13 Determination unit 14 Output unit 1000, 1000b Usage management support system U1 to U3, UX User N Network 101, 101-2 Floor camera 100 Elevator 110 Operation controller 120, 120-1 to 120-3 Camera 130 Display device 140 Floor designation unit 141 Designation button 150 Open/close designation unit 160 Door 170 Warning information output device 180 Call button 200 Authentication device 210 Face information DB
211 User ID
212 Facial feature information 220 Face detection unit 230 Feature point extraction unit 240 Registration unit 250 Authentication unit 300 Usage management support device 310 Storage unit 311 Program 312 User management DB
3121 User ID
3122 Permitted floor 320 Memory 330 Communication unit 340 Control unit 341 Registration unit 342 Authentication control unit 343 Identification unit 344 Operation control unit 345 Determination unit 346 Output unit 400 Manager terminal

Claims (18)

an identification means for identifying a first permitted floor associated with a first user who has successfully passed first face authentication for a first face image captured while riding in an elevator, by referring to a database in which facial feature information of the user is associated with a permitted floor that the user is permitted to use;
an operation control means for controlling the operation of the elevator in accordance with the first permitted floor;
a determination means for determining whether a second user is permitted to disembark at a stop floor where the elevator has stopped in accordance with the operation control by performing second facial authentication on a second facial image of the second user disembarking at the stop floor, with reference to the database;
an output means for outputting first warning information when it is determined that the second user is not allowed to get off the vehicle;
Equipped with
the identification means identifies the first permitted floor when the first face authentication performed using the facial feature information in the database on the first face image taken of the first user when boarding the elevator is successful;
The operation control means
performing the operation control by making a designation button for designating a stop at the first permitted floor in the elevator selectable;
When the first user is permitted to use a plurality of floors, the operation control is performed by activating a plurality of designation buttons that can be designated by the first user to make them selectable, and deactivating designation buttons for other floors to make them unselectable.
Usage management support device. The operation control means controls the operation of the elevator so that the elevator stops at the first permitted floor.
The utilization management support device according to claim 1 . the specifying means specifies the first permitted floor when the first face authentication performed using the facial feature information in the database on the first face image photographed when the first user is about to specify a floor at which the first user will get off in the elevator is successful.
The utilization management support device according to claim 1. The utilization management support device according to claim 3, wherein the operation control means performs the operation control by selecting a designation button for designating a stop at the designated floor when the floor designated by the first user is included in the first permitted floors. The utilization management support device according to claim 4 , wherein the operation control means performs the operation control by making a designation button for designating a stop at the first permitted floor selectable. The determination means
controlling the second face authentication using the facial feature information associated with the stop floor as the permitted floor in the database;
The utilization management support device according to claim 1 , wherein if the second face authentication fails, it is determined that the second user is not allowed to get off the vehicle. The determination means
referring to the database to identify a second permitted floor associated with the second user who has succeeded in the second face authentication;
The utilization management support device according to claim 1 , wherein if the stop floor is not included in the second permitted floors, it is determined that the second user is not allowed to disembark. The utilization management support device according to claim 1 , wherein the output means outputs the first warning information including the second facial image to a terminal of a manager of the stop floor. the determination means refers to the database and determines whether or not to stop the elevator at the predetermined floor by performing third face authentication on a third face image captured of a third user who is about to press a call button for the elevator at the predetermined floor;
The utilization management support device according to claim 1 , wherein the operation control means, when it is determined that the elevator should not be stopped at the predetermined floor, performs the operation control so as not to stop the elevator at the predetermined floor. The utilization management support device according to claim 9 , wherein the output means outputs second warning information when it is determined that the elevator should not be stopped at the predetermined floor. The utilization management support device according to claim 10 , wherein the output means outputs the second warning information including the third facial image to a terminal of a manager of the predetermined floor. The determination means
controlling the third face authentication using the facial feature information associated with the predetermined floor in the database;
The utilization management support device according to claim 9 , wherein if the third face authentication fails, it is determined that the vehicle should not be stopped at the predetermined floor. The determination means
referring to the database to identify a third permitted floor associated with the third user who has succeeded in the third face authentication;
The utilization management support device according to claim 9 , wherein when the predetermined floor is not included in the third permitted floors, it is determined not to stop at the predetermined floor. The utilization management support device according to claim 9 , wherein the operation control means, when determining not to stop the vehicle at the predetermined floor, performs the operation control by making the call button unselectable. a database that associates facial feature information of a user with a permitted floor that the user is permitted to use;
a usage management support device connected to the database,
The usage management support device
an identification means for identifying a first permitted floor associated with a first user who has succeeded in first face authentication for a first face image captured while boarding an elevator, by referring to the database;
an operation control means for controlling the operation of the elevator in accordance with the first permitted floor;
a determination means for determining whether a second user is permitted to disembark at a stop floor where the elevator has stopped in accordance with the operation control by performing second facial authentication on a second facial image of the second user disembarking at the stop floor, with reference to the database;
an output means for outputting first warning information when it is determined that the second user is not allowed to get off the vehicle;
Equipped with
the identification means identifies the first permitted floor when the first face authentication performed using the facial feature information in the database on the first face image taken of the first user when boarding the elevator is successful;
The operation control means
performing the operation control by making a designation button for designating a stop at the first permitted floor in the elevator selectable;
When the first user is permitted to use a plurality of floors, the operation control is performed by activating a plurality of designation buttons that can be designated by the first user to make them selectable, and deactivating designation buttons for other floors to make them unselectable.
Usage management support system. the identification means identifies the first permitted floor when the first face authentication performed using the facial feature information in the database on the first face image photographed of the first user when boarding the elevator is successful.
16. The utilization management support system according to claim 15 . The computer
by referring to a database in which facial feature information of a user is associated with an authorized floor that the user is authorized to use, the system identifies a first authorized floor that is associated with a first user who has successfully passed first face authentication on a first face image captured while boarding the elevator;
performing operation control of the elevator according to the first permitted floor;
referring to the database, and performing second facial authentication on a second facial image of a second user who gets off at a stop floor where the elevator has stopped in accordance with the operation control, to determine whether the second user is allowed to get off at the stop floor;
outputting first warning information when it is determined that the second user is not allowed to get off the vehicle ;
identifying the first permitted floor when the first face authentication performed using the facial feature information in the database on the first face image captured by the first user when boarding the elevator is successful;
performing the operation control by making a designation button for designating a stop at the first permitted floor in the elevator selectable;
When the first user is permitted to use a plurality of floors, the operation control is performed by activating a plurality of designation buttons that can be designated by the first user to make them selectable, and deactivating designation buttons for other floors to make them unselectable.
Usage management support method. a process of identifying a first permitted floor associated with a first user who has successfully passed first face authentication for a first face image captured while riding in an elevator, by referring to a database that associates facial feature information of the user with permitted floors that the user is permitted to use;
an operation control process for controlling the operation of the elevator in accordance with the first permitted floor;
a determination process of determining whether a second user is permitted to disembark at a stop floor where the elevator has stopped in accordance with the operation control by performing second facial authentication on a second facial image of the second user who disembarks at the stop floor, with reference to the database;
an output process of outputting first warning information when it is determined that the second user is not allowed to get off the vehicle;
on the computer ,
identifying the first permitted floor when the first face authentication performed using the facial feature information in the database on the first face image captured by the first user when boarding the elevator is successful;
performing the operation control by making a designation button for designating a stop at the first permitted floor in the elevator selectable;
When the first user is permitted to use a plurality of floors, the operation control is performed by activating a plurality of designation buttons that can be designated by the first user to make them selectable, and deactivating designation buttons for other floors to make them unselectable.
Utilization management support program.