JP7174286B2 - Information processing device, its processing method and program - Google Patents

Description

TECHNICAL FIELD The present invention relates to an information processing apparatus, a processing method thereof, and a program for supporting prevention of nosocomial infections.

Conventionally, in order to prevent nosocomial infections in medical institutions such as hospitals, thorough hand hygiene has been practiced using dispensers that dispense disinfectants and the like.
Japanese Patent Laid-Open No. 2002-200001 discloses a mechanism for acquiring room-entry operation information using an RFID tag or the like held by a person who has entered a room (medical-related room). Further, Patent Literature 2 discloses a mechanism for notifying a server of use of a dispenser as occurrence of a hand hygiene event.

JP 2015-153049 A Japanese translation of PCT publication No. 2013-539087

However, in Patent Document 1, it is necessary to install a reader that reads the RFID tag at the entrance of each room in the hospital, and for hospitals that handle many medical instruments, the impact on the operation of medical instruments, the installation location, the installation cost, etc. Considering the above, it is a configuration that is difficult to introduce. In addition, even if it was possible to detect the use of the dispenser and identify the person who performed hand hygiene by combining Patent Documents 1 and 2, hand hygiene that could cause nosocomial infection was not performed (dispenser unused ), there is a problem that the person cannot be identified.

SUMMARY OF THE INVENTION Accordingly, an object of the present invention is to provide a mechanism for confirming the usage status of a dispenser by a person included in a captured image .

Usage history acquisition means for acquiring usage history including date and time of use of the dispenser; image acquisition means for acquiring an image captured by an imaging device; dispenser usage history acquired by the usage history acquisition means; and image acquisition means and identifying means for identifying the usage status of the dispenser by the person identified from the image based on the imaging date and time of the image acquired by the method .

ADVANTAGE OF THE INVENTION According to this invention, the mechanism which can confirm the usage condition of the dispenser by the person contained in the imaged image can be provided.

The figure which shows an example of the system block diagram of this invention. FIG. 4 is a diagram showing an example of the hardware configuration of the server 102; FIG. 2 is a block diagram showing an example of the functional configuration of the server 102; The figure which shows an example of the flowchart of a dispenser use detection process The figure which shows an example of the flowchart of a dispenser non-user identification process The figure which shows an example of the flowchart of a dispenser non-user search process The figure which shows an example of the flowchart of a dispenser non-use tendency person search process The figure which shows an example of a dispenser non-user search screen The figure which shows an example of a dispenser non-use tendency person list screen A diagram showing an example of a table managed by the server 102

Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.
FIG. 1 is a diagram showing an example of the configuration of an information processing system 100 of this embodiment.

As shown in FIG. 1, the information processing system 100 of this embodiment has a configuration in which a dispenser 101, a server 102, a monitoring camera 104, and a search terminal 105 are connected to each other via a network 103 so as to be able to communicate with each other.

The dispenser 101 is a dispenser installed at the entrance of a room or the like, and is used by those who enter the room for hand hygiene. The dispenser 101 ejects the disinfectant, hand soap, lotion, etc. stored in the container when pressed by the user or detected by the sensor. At that time, the server 102 is notified via the network 103 that the dispenser 101 has been used. Further, the dispenser 101 is assigned identification information for identifying the individual dispenser, and in this embodiment, it is assumed that the room number in which the dispenser 101 is installed is assigned as the identification information of the dispenser.

In this embodiment, the room number is used as the identification information of the dispenser, but the present invention is not limited to this. 102 may manage.

The surveillance camera 104 is a camera installed in each room, and captures images of the room and the person in the room. Further, identification information for identifying an individual surveillance camera is assigned to the surveillance camera 104, and in this embodiment, it is assumed that the room number in which the surveillance camera 104 is installed is assigned as the surveillance camera identification information. do.

In the present embodiment, the room number is used as the identification information of the surveillance camera, but the present invention is not limited to this. Instead of using the room number as the identification information of the surveillance camera, the room number and the identification information of the surveillance camera are associated. The table may be managed by server 102 .
The server 102 receives usage notifications from the dispenser 101 and captured images from the monitoring camera 104, and stores and manages them in a storage device.
The search terminal 105 acquires and displays usage information of the dispenser 101 managed by the server 102 and information from the captured image.
This completes the description of FIG.

An example of a hardware configuration applicable to the server 102 shown in FIG. 1 will be described below with reference to FIG.
In FIG. 2, reference numeral 201 denotes a CPU that controls devices and controllers connected to a system bus 204 in an integrated manner. The ROM 203 or the external memory 212 stores the BIOS (Basic Input/Output System), which is the control program for the CPU 201, an operating system program (hereinafter referred to as OS), and the functions executed by each server or each PC. various programs are stored.

A RAM 202 functions as a main memory, a work area, and the like for the CPU 201 . The CPU 201 loads programs and the like necessary for executing processing from the ROM 203 or the external memory 212 to the RAM 202, and executes the loaded programs to realize various operations.

An input controller 205 controls input from the touch sensor 210 . A video controller 206 controls display on a display device such as the display 211 . Although the display 211 is shown in FIG. 2, the display may be not only a CRT but also another display such as a liquid crystal display. These are used by users of the server 102 as needed.

A memory controller 207 stores a boot program, various applications, font data, user files, edit files, various data, and the like in an external storage device (hard disk (HD)), a flexible disk (FD), or a PCMCIA card slot. It controls access to an external memory 212 such as Compact Flash (registered trademark) memory connected via an adapter.

A communication I/F controller 208 connects and communicates with an external device via the network 103, and executes communication control processing in the network. For example, communication using TCP/IP is possible.

It should be noted that the CPU 201 enables display on the display 211 by, for example, rasterizing an outline font to a display information area in the RAM 202 . In addition, the CPU 201 makes it possible to receive a user's touch operation instruction on the touch sensor 210 on the display 211 .

Various programs and various tables described later for realizing the present invention are recorded in the external memory 212 , loaded into the RAM 202 as necessary, and executed by the CPU 201 .
This completes the description of FIG.

FIG. 3 is an example of a block diagram showing an example of the functional configuration of the server 102. As shown in FIG.
The server 102 has the following functional units.

The user information management unit 301 is a functional unit that manages user information including a user's characteristic image for specifying the user.
The dispenser use management unit 302 is a functional unit that manages the identification information of the room in which the dispenser is used and the date and time of use, which are transmitted from the dispenser installed in the room or the vicinity of the room in the building.

The captured image management unit 303 is a functional unit that manages the captured image transmitted from the camera installed in the room in the building, the image capturing date and time, and the identification information of the room in which the image was captured.

The room occupant identification unit 304 captures the captured image from the image of the person included in the captured image received by the captured image management unit 303, using the image included in the user information managed by the user information management unit 301. It is a functional part that identifies a person who has entered a room in which a camera is installed.

The dispenser non-user management unit 305 associates the captured image received by the captured image management unit 303 with the identification information of the room in which the captured image was captured by the dispenser use management unit 302 within a predetermined time period before the captured image date and time. If the date and time of use of the dispenser is not managed by the occupant identification unit 304, the person identified from the image of the person included in the captured image is managed as a person who has not used the dispenser.
The dispenser non-user output unit 306 is a functional unit that outputs information on a dispenser non-user managed by the dispenser non-user management unit 305 .

The room identification information input reception unit 307 is a functional unit that receives input of room identification information.
The dispenser never-user information acquisition unit 308 acquires the information of the never-used dispenser managed by the never-used dispenser management unit 305 in association with the room identification information whose input is received by the room identification information input receiving unit 307 . This is the function part to acquire.
The dispenser never-user output unit 306 is a functional unit that outputs the information of the dispenser never-user acquired by the dispenser never-user information acquisition unit 308 .

The dispenser never-user output unit 306 is a functional unit that outputs information on dispenser never-users managed by the dispenser never-user management unit 305 in descending order of the numbers managed by the dispenser never-user management unit 305 . be.

The dispenser non-user management unit 305 is a functional unit that manages an image of a person included in the captured image received by the captured image management unit 303 as an image of a dispenser non-user.
The dispenser non-user output unit 306 is a functional unit that outputs images of dispenser non-users managed by the dispenser non-user management unit 305 .
This completes the description of FIG.

FIG. 10 is a diagram showing an example of a table managed by the server 102. As shown in FIG.
The dispenser use log table 1010 is a table that stores information on the use of the dispenser 101, and has columns of "date and time of use of the dispenser" and "room number (where the dispenser is installed)". That is, the dispenser usage log table 1010 is an example of means for managing the identification information of the room in which the dispenser was used and the date and time of usage transmitted from the dispenser installed in the room or the vicinity of the room in the building.

The dispenser non-user table 1020 is a table that stores users who have entered the room without using the dispenser 101. The dispenser usage log table 1010 and the room entry log table 1040 are compared, and even though the user entered the room, register the record when the dispenser is not in use. It has columns of "imaging date and time", "room number", "user ID", and "captured image file path".

In other words, the dispenser non-user table 1020 is an example of means for managing captured images transmitted from cameras installed in rooms within a building. In addition, the dispenser non-user table 1020 is an example of means for managing an image of a person included in the received captured image as an image of a dispenser non-user.

The user master 1030 is a table that stores information on hospital staff and visitors, and has columns of "user ID", "user name", "face image", and "face image feature amount". As for the "face image feature amount", the feature amount of the "face image" is calculated and registered by registering the "face image". In addition, by registering the names and facial images of visitors at the time of reception, even temporary visitors such as visitors or attendants can help prevent in-hospital infections and estimate infection routes. In other words, the user master 1030 is an example of means for managing user information including a user's characteristic image for specifying the user.

The room entry log table 1040 is a table for recording detection of room entry, and has columns of "imaging date and time", "room number", and "user ID (of the user identified as having entered the room)". That is, the room entry log table 1040 is an example of means for managing the date and time when the camera installed in the room in the building captured the image of the person entering the room and the identification information of the room in which the image was captured.
This completes the description of FIG.

The processing of each flowchart will be described below. Note that the following steps are all performed by the CPU 201 of each terminal.
FIG. 4 is a diagram showing an example of a flowchart of processing for detecting that the dispenser 101 has been used.
In step S401, the dispenser 101 installed at the entrance of the room or the like detects that the dispenser has been used.
In step S<b>402 , the dispenser 101 transmits to the server 102 the room number assigned in advance as the identification information of the dispenser 101 and the date and time of use.
In step S403, the server 102 receives the room number and date of use.
In step S404, the server 102 registers the received room number and date of use in the dispenser use log table 1010 (FIG. 10).
This completes the description of FIG.

FIG. 5 is a diagram showing an example of a flow chart of a dispenser never-user identifying process. Specifically, this is a process of transmitting an image captured by the surveillance camera 104 of a person entering the room to the server 102 and registering the image of the person entering the room who has been identified as a person who has not used a dispenser in the table 1020 of a person who has not used a dispenser of the server 102 . .
In step S501, the monitoring camera 104 monitors the entrance of the room and detects a person entering the room.

In step S502, the surveillance camera 104 captures an image of the detected face of the person entering the room. Note that the technique of detecting a person entering the room and the technique of recognizing and capturing the face of the person entering the room are known techniques, so description thereof will be omitted.

In step S<b>503 , the surveillance camera 104 transmits to the server 102 the room number assigned in advance as the identification information of the surveillance camera 104 , the imaging date and time, and the captured face image of the occupant.
In step S504, the server 102 receives the room number, the imaging date and time, and the facial image of the person entering the room.

In step S505, the server 102 determines whether or not there is a dispenser usage log within a predetermined period of time before the imaging date and time. Specifically, the dispenser usage log table 1010 (FIG. 10) is searched using the room number received in step S504, and the dispenser is opened within a predetermined time (for example, 10 seconds) before the imaging date and time received in step S504. Determine if a usage log record exists.

For example, if the room number received in step S504 is 201 and the date and time of image capturing is 2016/5/1 14:00:10 (record 1041 in FIG. 10), search the dispenser usage log table 1010 using room number=201. Then, it is determined whether or not there is a dispenser usage log record within 10 seconds before the imaging date and time (2016/5/1 14:00:00 to 14:00:10). In this case, since record 1011 in FIG. 10 exists, it is determined that there is a dispenser usage log.
In step S506, the server 102 sets the dispenser usage flag to FALSE.
In step S507, the server 102 extracts feature amounts from the received face image.

In step S508, the server 102 compares the extracted feature quantity with the feature quantity of the facial image of the user, including the hospital staff, registered in advance in the user master 1030 (FIG. 10). Identify people in images. It should be noted that the extraction and comparison processing of the feature amount are known techniques, and thus the description thereof will be omitted. That is, in step S508, the image included in the managed user information is used to identify a person who has entered the room in which the camera that captured the captured image is installed, based on the image of the person included in the received captured image. It is a step which shows an example of the process to identify.

In step S<b>509 , the server 102 determines whether or not the face image received in step S<b>508 could be identified as a user registered in the user master 1030 . If it can be specified, the process proceeds to step S510, and if it cannot be specified, the process proceeds to step S514.

In step S510, the server 102 can identify the received face image as that of the user registered in the user master 1030, and therefore registers a new record having the imaging date/time, room number, and user ID values in the room entry log table 1140. do.

In step S511, the server 102 determines the value of the dispenser use flag. If TRUE, the flow chart of FIG. 5 is terminated, and if FALSE, the process proceeds to step S512.
In step S512, the server 102 stores the received face image in the external memory 212 and acquires the stored file path.

In step S<b>513 , the server 102 registers a new record having the value of the date and time of imaging, the room number, the user ID, and the file path of the face image acquired in step S<b>512 in the dispenser unused person table 1020 . That is, in step S513, if the date and time of use of the dispenser are not managed in association with the identification information of the room in which the captured image was captured within a predetermined time period before the captured date and time of the received captured image, it is included in the captured image. 10 is a step showing an example of a process of managing a person specified from an image of a person who has not used the dispenser as a person who has not used the dispenser.

In step S514, the server 102 determines that the received face image is not registered in the user master 1030, so it registers a new record with values of imaging date and time and room number in the entry log table 1140. FIG.

In step S515, the server 102 determines the value of the dispenser use flag, and if TRUE, the flow chart of FIG. 5 is terminated, and if FALSE, the process proceeds to step S516.
In step S516, the server 102 stores the received face image in the external memory 212 and acquires the stored file path.

In step S<b>517 , the server 102 registers a new record having the value of the imaging date and time, the room number, and the file path of the face image acquired in step S<b>516 in the dispenser non-user table 1020 . That is, in step S517, if the usage date and time of the dispenser are not managed in association with the identification information of the room in which the captured image was captured within a predetermined time period before the captured date and time of the received captured image, it is included in the captured image. 10 is a step showing an example of a process of managing a person specified from an image of a person who has not used the dispenser as a person who has not used the dispenser.

As described above, it is possible to provide a mechanism for recording a face image of a person who has never used a dispenser. In addition, if it is possible to identify the person who has not used the dispenser, the identified user ID is stored. It will be possible to refer to the image of the person who has become infected, and it will be possible to estimate the infection route. In addition, even before the occurrence of nosocomial infections, it is possible to call attention to users (hospital staff or visitors) identified as those who have not used dispensers, so that nosocomial infections can be prevented. Become.
This completes the description of FIG.

FIG. 6 is a diagram showing an example of a flow chart of the dispenser never-user search process. Specifically, it is a process of searching the table of the server 102 from the search terminal 105 when an in-hospital infection occurs, and searching for persons who have not used the dispenser.
In step S<b>601 , the search terminal 105 displays a dispenser never-user search screen 810 ( FIG. 8 ) on the display 211 .

In step S602, the search terminal 105 accepts input of the period and room number and pressing of the search button. It should be noted that the input of the period and the room number is not essential and may be blank. In other words, step S602 is a step showing an example of processing for accepting input of room identification information.
In step S603, the search terminal 105 transmits the room number to the server 102 for the input period.
In step S604, the server 102 receives the period and room number.

In step S605, the server 102 searches the dispenser non-user table 1020 (FIG. 10) using the received period and room number as a search condition. That is, step S605 is a step showing an example of the process of acquiring the information of the dispenser non-user managed in association with the identification information of the room whose input is accepted.

In step S606, the server 102 generates screen information including search results. Also, the captured image is acquired using the captured image file path included in the search result.
In step S<b>607 , the server 102 transmits the generated screen information and captured image to the search terminal 105 .
In step S608, the search terminal 105 receives screen information including search results.

In step S609, the search terminal 105 displays the dispenser never-user search screen 820 (FIG. 8) using the received screen information and captured image. That is, step S609 is a step showing an example of the process of outputting the information of managed dispenser non-users. Further, step S609 is a step showing an example of processing for outputting an image of a managed dispenser inexperienced person.

As described above, it is possible to confirm the information of the person who has never used the dispenser by using the designated period and room number. In addition, if the person who has not used the dispenser can be identified, the identified user ID is displayed. It will be possible to refer to the image of the person who has become infected, and it will be possible to estimate the infection route. In addition, even before the occurrence of nosocomial infections, it is possible to call attention to users (hospital staff or visitors) identified as those who have not used dispensers, so that nosocomial infections can be prevented. Become.
This completes the description of FIG.

FIG. 7 is a diagram showing an example of a flow chart of the process of searching for a person who tends to not use dispensers. Specifically, this is a process of searching the table of the server 102 from the search terminal 105 to search for users who tend to not use dispensers in order to prevent the occurrence of nosocomial infections.
In step S<b>701 , the search terminal 105 displays on the display 211 a list screen 910 ( FIG. 9 ) of people who tend not to use dispensers.
In step S702, the search terminal 105 receives the input of the period and the depression of the search button. It should be noted that input of the period is not essential and may be blank.
In step S703, the search terminal 105 transmits the input period to the server 102. FIG.
At step S704, the server 102 receives the period.

In step S705, the server 102 searches the dispenser non-user table 1020 (FIG. 10) by grouping the user IDs using the received period as a search condition.
In step S706, the server 102 aggregates and sorts the search results, and arranges them in descending order of the number of unused times. Or, for hit users,

The room entry log table 1040 is searched with the user ID, and the ratio of unused dispensers=the number of unused dispensers/the number of times of entry into the room is calculated and sorted in descending order of the dispenser unused ratio.

In step S707, the server 102 generates screen information from the aggregated and sorted search results. Also, the captured image is acquired using the captured image file path included in the search result.
In step S<b>708 , the server 102 transmits the generated screen information and captured image to the search terminal 105 .
In step S709, the search terminal 105 receives screen information including search results.

In step S710, the search terminal 105 uses the received screen information and captured image to display a list screen 920 (FIG. 9) of persons tending to never use dispensers. That is, step S710 is a step showing an example of the process of outputting the information of managed dispenser non-users in descending order of the managed number. Further, step S710 is a step showing an example of a process of outputting an image of a managed dispenser inexperienced person.

As described above, it is possible to confirm the information of the person who tends to never use the dispenser using the designated period. In addition, if it is possible to identify a person with a tendency to not use dispensers, the identified user ID is displayed. Since it becomes possible to refer to images of persons with potential suspicions and to call attention to hospital staff or visitors, it is possible to prevent in-hospital infections.
This completes the description of FIG.

As described above, a recording medium recording a program for realizing the functions of the above-described embodiments is supplied to a system or device, and the computer (or CPU or MPU) of the system or device reads the program stored in the recording medium. Needless to say, the object of the present invention can also be achieved by reading and executing.

In this case, the program itself read from the recording medium implements the novel functions of the present invention, and the recording medium recording the program constitutes the present invention.

Examples of recording media for supplying programs include flexible disks, hard disks, optical disks, magneto-optical disks, CD-ROMs, CD-Rs, DVD-ROMs, magnetic tapes, non-volatile memory cards, ROMs, EEPROMs, silicon A disk or the like can be used.

Further, by executing the program read by the computer, not only the functions of the above-described embodiments are realized, but also based on the instructions of the program, the OS (operating system) and the like running on the computer are actually executed. Needless to say, a case where part or all of the processing is performed and the functions of the above-described embodiments are realized by the processing are included.

Furthermore, after the program read from the recording medium is written in the memory provided in the function expansion board inserted into the computer or the function expansion unit connected to the computer, the function expansion board is read according to the instruction of the program code. It goes without saying that a case where a CPU or the like provided in a function expansion unit performs part or all of the actual processing and the functions of the above-described embodiments are realized by the processing.

Moreover, the present invention may be applied to a system composed of a plurality of devices or to an apparatus composed of a single device. Further, it goes without saying that the present invention can be applied to the case where it is achieved by supplying a program to a system or device. In this case, by loading a recording medium storing a program for achieving the present invention into the system or device, the system or device can enjoy the effects of the present invention.

The program may be in the form of object code, program code executed by an interpreter, script data supplied to an OS (operating system), or the like.

Furthermore, by downloading and reading out the program for achieving the present invention from a server, database, etc. on the network using a communication program, the system or device can enjoy the effects of the present invention. It should be noted that all configurations obtained by combining each of the above-described embodiments and modifications thereof are also included in the present invention.

101 dispenser 102 server 103 network 104 surveillance camera 105 search terminal

Claims (14)

a usage record acquisition means for acquiring a usage record including the date and time of use of the dispenser;
an image acquisition means for acquiring an image captured by the imaging device;
a specifying means for specifying the usage status of the dispenser by the person specified from the image based on the usage history of the dispenser acquired by the usage history acquisition means and the imaging date and time of the image acquired by the image acquisition means;
An information processing device comprising: 4. The identification means identifies the usage status of the dispenser by the person identified from the image based on whether the dispenser has been used within a predetermined time difference from the date and time when the image was captured. 1. The information processing device according to 1. The specifying means specifies that the dispenser has been used by the person specified from the image when the dispenser has been used within a predetermined time difference from the date and time when the image was taken; 3. The information processing apparatus according to claim 2, wherein the information processing apparatus specifies that there was no error. The specifying means specifies the usage status of the dispenser by the person specified from the image based on whether the dispenser has been used within a predetermined time period before the date and time when the image was taken. Item 1. The information processing apparatus according to item 1. The specifying means specifies that the dispenser has been used by the person specified from the image if there is a track record of using the dispenser within a predetermined time period prior to the date and time when the image was taken; 5. The information processing apparatus according to claim 4, wherein the information processing apparatus is specified as having never been used. The usage record of the dispenser further includes information indicating the installation location of the dispenser,
The identification means further identifies the usage status of the dispenser by the person identified from the image based on the usage record of the dispenser and the location where the image acquired by the image acquisition means is taken. The information processing apparatus according to any one of claims 1 to 5. 7. The information processing apparatus according to claim 6, wherein the information indicating the installation location of the dispenser is information identifying the room in which the dispenser is installed. 8. The information processing apparatus according to claim 6, wherein the imaging location is information for identifying a room in which an imaging device that captured the image is installed. 9. The information processing apparatus according to claim 8, wherein the image is an image of a person entering a room in which an imaging device that has captured the image is installed. 3. A person identification means for identifying a person included in said image by comparing a feature amount of a registered face image and a feature amount of a face image of a person included in said image. 10. The information processing device according to any one of 1 to 9. 11. The information processing apparatus according to any one of claims 1 to 10, further comprising output means for outputting the usage status of the dispenser specified by said specifying means. 12. The information processing apparatus according to claim 11, wherein said output means outputs information relating to a person identified as not using said dispenser. A processing method performed by an information processing device,
a use record acquisition step in which the use record acquisition means of the information processing apparatus acquires a use record including the date and time of use of the dispenser;
an image acquisition step in which the image acquisition means of the information processing device acquires an image captured by an imaging device;
The specifying means of the information processing apparatus uses the dispenser by a person specified from the image based on the usage history of the dispenser acquired by the usage history acquisition step and the image capturing date and time of the image acquired by the image acquisition step. a specific step of identifying usage;
A processing method characterized by executing information processing equipment,
a usage record acquisition means for acquiring a usage record including the date and time of use of the dispenser;
an image acquisition means for acquiring an image captured by the imaging device;
Functions as a specifying means for specifying the usage status of the dispenser by the person specified from the image, based on the usage history of the dispenser acquired by the usage history acquisition means and the date and time of image acquisition of the image acquired by the image acquisition means. program to make

Images