JP7433500B2 - Movement management system, information processing device, program - Google Patents

Description

The present invention relates to a movement management system , an information processing device, and a program.

In nursing homes, nursing care facilities, hospitals, and other facilities, the lives of cared for, mainly elderly people and people with walking difficulties, are watched over day and night by staff members in place of relatives who cannot live with them. In recent years, efforts have been made to construct reporting systems that deploy various sensors to confirm the safety of care recipients and detect abnormalities. If the reporting system determines that the facility is unsafe or detects any abnormality, facility staff will rush to the location where the care recipient is and take appropriate measures to ensure safety.

One of the sensors used in the notification system is a mat sensor that detects the presence of a resident (for example, see Patent Document 1). The mat sensor is placed on the floor, and when the cared person steps on the mat sensor as he or she passes by, the weight of the cared person is detected as pressure. If a mat sensor is placed next to the bed, in the bathroom, or in the toilet, it will be possible to detect when the person being cared for has fallen or that the person is not moving after falling, and staff can rush to the place where the person has fallen.

Furthermore, a technique has been devised that uses a camera as a sensor to monitor the movement of a cared person (for example, see Patent Document 2). Patent Document 2 discloses a notification system that sets an expected travel time according to the physical condition of a cared person on that day, and notifies the person if the cared person has not arrived at the destination by the expected travel time.

Japanese Patent Application Publication No. 2016-045118 Japanese Patent Application Publication No. 2018-181080

However, with the method of laying a mat sensor as in Patent Document 1, there is a problem that it is not possible to specify where the cared person is. That is, the size of general mat sensors is not very large, and in order to know the location of the entire facility, it is necessary to spread mat sensors on every floor, which is not practical. In addition, residents often step over mat sensors placed next to the bed, in the bathroom, or in the toilet.

Furthermore, the notification system disclosed in Patent Document 2 requires an inputter (such as the cared person or a staff member) to input a destination each time the cared person moves, which poses a problem in that it imposes a large operational burden.

In addition, if the cared person does not arrive at the destination after the estimated travel time has elapsed, a notification will be sent assuming that the cared person has fallen, etc. There is a problem in that the staff cannot be identified and the response of the staff is delayed.

Furthermore, if the cared person does not return to his or her room after arriving at the destination but moves to another place, or if the cared person stops at another place before moving to the input destination, the expected There is a problem in that the time required is longer than the travel time, and unnecessary reports are delivered to the staff.

In view of the above-mentioned problems, an object of the present invention is to provide a movement management system , etc. that requires less operational burden, makes it easy to identify where the cared person is, and allows the cared person to move freely. .

In view of the above-mentioned problems, the present invention is a movement management system having an imaging device installed at each of a plurality of passing points through which a person passes, and in which the assumption is made for each passing point to the next passing point that a person may pass through. A travel time is set, and when the top of a person's head is imaged by the imaging device 1, it is determined whether the image data of the top of the head is registered as monitoring information, and whether or not the image data of the top of the head is registered as the monitoring information is determined. If not, the image data of the top of the head and the passing point are associated with each other and registered as monitoring information, and furthermore, the measurement of the elapsed time is started, and the estimated travel time set at the passing point where the imaging device is installed and the above-mentioned The present invention is characterized in that the occurrence of an abnormality related to the person is determined based on the elapsed time.

According to the present invention, it is possible to provide a movement management system and the like that requires less operational burden, makes it easy to specify where the cared person is, and allows the cared person to move freely.

It is an example of a schematic block diagram of a notification system. It is an example of a system configuration diagram of a reporting system. It is a diagram showing an example of passage points installed in a facility. 1 is a block diagram showing a schematic hardware configuration of an information processing device. FIG. 1 is an example of a functional block diagram showing each function provided in the information processing device in a block form. It is an example of a figure explaining the judgment method of the passing direction of a cared person. FIG. 7 is a flowchart diagram illustrating an example of processing until the information processing device issues a report based on image data of the top of the head. It is a diagram showing an example of movement of a cared person within a facility. It is a figure which shows the transition example of monitoring information DB. It is a diagram showing an example of movement of visitors within the facility. It is a figure which shows the example of registration of excluded person image DB. It is a diagram showing an example of movement of staff within a facility. It is a figure which shows the example of registration of monitoring information DB. It is an example of a flowchart diagram explaining going out processing. It is a figure which shows the example of a screen which a mobile terminal or a terminal device displays at the time of a report.

DESCRIPTION OF EMBODIMENTS Hereinafter, embodiments for carrying out the present invention will be described with reference to the drawings.

<Outline of operation of the reporting system of this embodiment>
An outline of how the reporting system 100 watches over the cared person 7 will be explained using FIG. 1. FIG. 1 is an example of a schematic configuration diagram of the reporting system 100. The reporting system 100 has the following configuration.

(i) Places within the facility 5 through which the cared person 7 can pass are referred to as passing points P, and an imaging device 10 is installed at each passing point P. In FIG. 1, the imaging devices 10 are arranged at the entrance of a living room 96 where the cared person 7 resides, the entrance of a changing room 99 (in front of the bathroom 97), and the entrance of a toilet 98. The imaging device 10 can image the top of the head of the cared person 7, but the angle of view is set so as not to image parts of the person, such as the face, that lead to identification of the person (the angle of view is narrow). This ensures the privacy of the cared person 7.

(ii) Each imaging device 10 is capable of communicating with the information processing device 20 in the management room 6, and transmits image data of the top of the head of the cared person 7 who has passed through the passage point P to the information processing device 20 in real time. The information processing device 20 can communicate with the terminal device 40 and the mobile terminal 50 carried by the staff member 8, so that the staff member 8 can quickly respond in the event of an emergency.

(iii) A plurality of care recipients 7 may exist within the facility 5. Although the cared person 7 cannot be identified from the image data of the top of the head, it is possible to distinguish (identify) the cared person 7 from other cared people 7 based on the image data of the top of the head.

Using such a configuration, the reporting system 100 performs the following processing.

(1) The information processing device 20 starts measuring elapsed time when passage of the cared person 7 at the passing point P is detected based on the image data of the top of the head. For each passing point P, an estimated travel time to the next passing point P is set in advance. Since the passing direction of the passing point P can be specified, an estimated travel time is set for each passing direction of the passing point P. The information processing device 20 determines the passing direction of the cared person 7 based on the image data of the top of the head obtained at a certain passing point P, and judges whether the elapsed time exceeds the estimated travel time.

For example, in FIG. 1, the cared person 7 who has left the living room 96 may move to the changing room 99 or the toilet 98, or may return to the living room without going anywhere. Therefore, the time considered necessary to arrive at the farthest of the changing rooms 99 and the toilets 98 is set as the estimated travel time. Even if the elapsed time exceeds the estimated travel time, the information processing device 20 sends the same image data as the image data of the top of the head of the cared person 7 who has left the living room 96 to the imaging device 10 in the dressing room 99, the toilet 98, or the living room 96. If it is not received from the staff member 8, the staff member 8 is notified.

(2) When the cared person 7 passes the next passing point P (for example, the changing room 99 or the toilet 98), the information processing device 20 starts measurement by passing the passing point P (living room 96) that was passed immediately before. Finish measuring the elapsed time. Furthermore, the estimated travel time is set for the newly passed passing point P (for example, the changing room 99 or the toilet 98), and measurement of the elapsed time is started. In addition to passing through such as the changing room 99 (bathroom 97) or the toilet 98, the estimated travel time that is reasonable for the purpose of the stay is set for the passing point P of the place where the care recipient 7 stays to finish errands. .

(3) The information processing device 20 also stores, in association with the image data of the top of the head, the passing point P at which the image data of the top of the head was captured, the passing direction, the passing time, the estimated travel time, and the elapsed time (real-time measured values) (hereinafter referred to as monitoring information). For example, if the image capturing device 10 in the same living room 96 captures image data of the top of the head of the cared person 7 who has left the living room, the information processing device 20 It can be determined that the person has returned to room 96. Thereby, tracking of the cared person 7 who has returned to the living room 96 can be completed, and information about this cared person 7 can be deleted from the monitoring information.

(4) Also, as described later, an imaging device for registering excluded persons (not shown in FIG. 1) is installed to register staff 8 and visitors (hereinafter referred to as excluded persons) as persons to be excluded from monitoring targets. Accordingly, the information processing device 20 can exclude the excluded person from monitoring. This makes it possible to suppress false notifications by excluded persons.

Therefore, with the configurations (1) to (4), the cared person 7 becomes the subject of monitoring simply by passing through the passing point P, so there is no need to input the destination etc., which burdens the operation of the reporting system 100. Less is. Moreover, since the angle of view of the imaging device 10 is narrow, the privacy of the cared person 7 can be ensured. Furthermore, with the configurations (1) to (3), it is possible to immediately identify where the cared person 7 is located. Moreover, with the configurations (1) and (2), even if the cared person 7 stops by any place, the cared person 7 is not notified and can move freely.

In addition, since the excluded person registers the image data of the top of the head when going to work or visiting, and the care recipient 7 registers the image data of the top of the head when leaving the room, there is no need to register the top of the head image data in advance, and the hairstyle can be changed. Even if the head changes, the person can be monitored using the image data of the top of the head after the change. In general, it is necessary to register the image data of the top of the head in advance, and then register it again if the hairstyle etc. changes, or to distinguish the same care recipient 7 from another care recipient 7. However, in this embodiment, there is no such inconvenience.

<About terms>
The top of a person's head is the area of the skin that corresponds to the position of the parietal bone, and simply refers to the top of the head. In this embodiment, it may be the range of the head that is imaged by an imaging device installed with its optical axis directed vertically downward.

To report means to announce something. It may also be referred to as a notification, notification, alarm, warning, etc.

Facility refers to equipment for a certain purpose. Any facility where people are present will suffice. Examples include, but are not limited to, nursing homes, nursing care facilities, hospitals, etc. Moreover, it may be used not only for care recipients but also for grasping the location of people at companies, schools, etc.

A person is an object of surveillance. In this embodiment, the cared person 7, the staff member 8, and the visitor are listed. It is also possible to monitor animals such as dogs and cats.

<Configuration example>
FIG. 2 is an example of a system configuration diagram of the reporting system 100. The reporting system 100 includes a plurality of imaging devices 10, one or more imaging devices 11A and 11B for excluded person registration, an imaging device 12 at the boundary with the outside, an information processing device 20, a terminal device 40, and one or more mobile terminals 50. , and one or more alarm lamps 51.

As described above, the plurality of imaging devices 10 are installed at a location overlooking the top of the head, such as the ceiling of each passage point P, with their optical axes directed vertically downward. Preferably, the imaging device 10 is capable of capturing images in color, but black and white may also be used. It is preferable that each imaging device 10 be able to image a subject of the same size in the same size. This is because the size of the top of the head can be used as a factor in determining the care receiver 7. For example, it is conceivable to install a plurality of imaging devices 10 with the same height or to adjust the angle of view. However, the information processing device 20 can also correct objects of the same size into image data of the same size by image processing.

Each imaging device 10 may capture either a still image or a moving image. When capturing still images, a human sensor is attached to the imaging device 10, and a plurality of still images are captured only when the human sensor detects a person. As a result, it is possible to reduce the waste of imaging in a situation where the cared person 7 does not pass, and image data of the top of the head while the cared person 7 passes under the imaging device 10 can be obtained, and the information processing device 20 can The direction in which person 7 is passing can be determined. In the case of a moving image, the information processing device 20 uses image processing to detect that the top of the head has been imaged, and extracts image data of the top of the head while passing under the imaging device 10. Further, the imaging device 10 may periodically take images and, if there is a change in the image, take a moving image for a certain period of time or until there is no change in the image. Even in still images, it is preferable to use image processing to detect that the top of the head has been imaged for confirmation.

Note that, as described above, the angle of view is set to such an extent that only the top of the head can be imaged when the cared person 7 passes directly under the imaging device 10, thereby ensuring privacy. The focal length may be adjusted using a lens or the like, or the imaging device 10 may trim the central portion of the image data.

The excluded person registration imaging device 11A is an imaging device for registering image data of the top of the staff's head in order to exclude the image data of the top of the staff's head from monitoring targets. As a result, even if a staff member passes through the passage point P and the elapsed time due to work or the like exceeds the estimated travel time, the information processing device 20 can be prevented from reporting (the elapsed time is not measured for excluded persons in the first place). . The excluded person registration imaging device 11A is preferably placed at a passage point P that only staff members pass through, such as an entrance to a staff changing room, as will be described later.

The excluded person registration imaging device 11B is an imaging device for registering image data of the top of a visitor's head in order to exclude the image data of the top of the visitor's head from monitoring targets. This makes it possible to prevent the information processing device 20 from reporting even if the elapsed time exceeds the expected travel time due to the visitor passing through the passage point P and having a conversation with the care recipient 7 or the staff (in the first place, elapsed time will not be measured for excluded persons). The excluded person registration imaging device 11B may be placed at a passage point P that visitors always pass, such as a reception desk, as will be described later.

The imaging device 12 at the boundary with the outside is an imaging device placed at a location (for example, the entrance) that is the boundary between indoors and outdoors of the facility 5. The imaging device 12 at the boundary with the outside is an imaging device mainly for monitoring when the cared person 7 goes out, and the details will be explained with reference to FIG. 3.

The information processing device 20 controls the entire reporting system 100. Image data of the top of the head is acquired from each imaging device 10, the excluded person registration imaging devices 11A and 11B, and the imaging device 12 at the boundary with the outside. In the case of a moving image or when regular still images are captured, image data that simply shows the floor surface may be received. Therefore, the information processing device 20 preferably has a function of determining whether the top of the head is included in the image.

The information processing device 20 registers the image data of the top of the head of the excluded person, determines whether it is the cared person 7 or the excluded person, and in the case of the cared person 7, compares the elapsed time and the estimated travel time. , sends a notification to the mobile terminal 50, or lights up the alarm lamp 51.

The information processing device 20 is a device, such as a PC (Personal Computer) or a workstation, that executes a program and processes information. It may also have the function of a server.

The information processing device 20 is placed within a facility, for example. Alternatively, it may be placed on a cloud or the like. In the case of a facility, it may be placed anywhere, but considering that the cared person 7 will not touch it carelessly, it will be placed in the management room 6 or the like where the staff is waiting.

The terminal device 40 is a device that displays monitoring information and a map of the facility, and is mainly used by staff to check the safety of the care recipient 7. The terminal device 40 may be a console type in which a display device and an input device (keyboard, mouse, or touch panel) are connected to the information processing device 20. In this case, application software is running on the information processing device 20, and a screen displaying monitoring information and a map of the facility is generated and displayed on the display device. Alternatively, a system may be constructed such that the terminal device 40 is a client and the information processing device 20 is a server. In this case, the information processing device 20 and the terminal device 40 are connected via a network, and the information processing device 20 runs a server program called a web application or the like, and the terminal device 40 runs browser software. No matter where the terminal device 40 is located, it can be connected to the network and staff can view monitoring information and maps within the facility.

Note that the terminal device 40 may be placed not only inside the facility but also outside the facility. In order for the staff to be able to monitor it at any time, it may be placed in the management room 6, but the placement location may be arbitrary. Further, a plurality of terminal devices 40 may be arranged.

The mobile terminal 50 is mainly carried by the staff and is a terminal for receiving a report from the information processing device 20 when the elapsed time exceeds the estimated travel time. A terminal application is running on the mobile terminal 50 and is capable of receiving reports. If the terminal application receives e-mail via an e-mail application or browser, the report can be received via e-mail. Furthermore, if the terminal application is a dedicated application dedicated to the reporting system 100, the notification can be received in the form of a notification to the dedicated application.

The mobile terminal 50 is, for example, a smartphone, a mobile phone, a PDA (Personal Digital Assistant), a wearable PC (eg, wristwatch type, sunglasses type, etc.), but is not limited to these. The mobile terminal 50 can receive reports even if it is carried outside the facility or left at the staff's home.

The alarm lamps 51 are arranged at major locations within the facility, and are turned on under control from the information processing device 20. An alarm may be sounded along with the lighting.

<Example of placement of passing point P>
Each passing point P of the facility will be explained using FIG. 3. FIG. 3 shows an example of a passing point P installed in a facility. The passage point P is a place where the imaging device 10, the excluded person registration imaging devices 11A and 11B, and the imaging device 12 at the boundary with the outside are installed, so it may also be referred to as the setting location of the imaging device. As shown in the figure, the following locations are passing points P. Note that the numerical value in parentheses after the passing point Pn (n is the number of the passing point) is the code of the imaging device.
a. Entrances and exits of living rooms A to I b. Entrances and exits of common facilities (toilet 98, bathroom 97, dining room 61, etc.) c. Ends of the hallway (one end and the other)
d. Entrance 65 (boundary with outside)
e. Reception 64
f. Entrance/exit of office 63 Among these, passing points P of d, e, and f are specific passing points P, e, f are used to register image data of the top of the head of a staff member or a visitor, and d is a specific passing point P. It is used to determine whether the care receiver 7 should go out.

d. A supplementary explanation will be given regarding the passage point P31 of the entrance 65 (boundary with the outside).
The people who come in and out are staff or visitors, but since the visitors have already been registered with the imaging device 11B for registering excluded persons at the reception desk 64, the image data of the top of the head captured by the imaging device 12 at the border with the outside is not monitored. Not subject to. Staff members are registered as monitoring targets because they do not pass through the reception desk 64, but if they enter the office 63 within a preset estimated travel time and are imaged by the excluded person registration imaging device 11A, they are excluded from the monitoring targets. Furthermore, when leaving the office 63, the user registers using the excluded person registration imaging device 11A. In other words, once a person is determined to be a staff member, they are excluded from monitoring.
・It is staff or visitors who frequently go outside from indoors, but even if their going outside is confirmed by the imaging device 12 at the border with the outside, they are not reported because they are excluded from monitoring in the first place. .
- If it is confirmed by the imaging device 12 at the boundary with the outside that the person being cared for has gone from indoors to outdoors, if it is one person, it will be reported, but if there are multiple people including the excluded person, it will not be reported. It is.

e. A supplementary explanation will be given regarding the passage point P32 of the reception 64.
Visitors sign their name at the reception desk 64, and when the door at the entrance 65 is unlocked by the receptionist, they can enter the room. Therefore, visitors always pass through the reception desk 64. In this embodiment, by utilizing this, a passing point P32 (excluded person registration imaging device 11B) is installed at the reception desk 64, and image data of the top of the visitor's head is registered. No estimated travel time is set for the passing point P32 of the reception 64, and measurement of elapsed time is not started.

f. A supplementary explanation will be given regarding the passage point P33 at the entrance/exit of the office 63.
The office 63 is a room mainly used by staff. The entrance/exit of the office 63 is a passage point P33 through which the staff who come to work must pass in order to press a time card or the like. In this embodiment, by utilizing this, a passing point P33 (excluded person registration imaging device 11A) is installed at the entrance/exit of the office 63, and image data of the top of the staff's head at the start of work is registered. No estimated travel time is set for the passage point P33 at the entrance/exit of the office 63, and measurement of elapsed time is not started.

Estimated travel time will be explained. The estimated travel time is the furthest passing point P among the passing points P that can be passed next to a certain passing point P, so for example, if we take passing point P1 of living room A as an example, the next passing point P that can be passed is These are points P1 to 3, P10, P11, P15, and P18. Since the passing point P18 is the farthest from the passing point P1, the estimated travel time is set in consideration of the time required for the cared person 7 to travel the distance from the passing point P1 to the passing point P18.

From this point of view, estimated travel times are set for the passing points P1 to P21 and P31, except for the excluded person registration imaging devices 11A and 11B. The estimated travel time may be set by adding a margin α to the time when the cared person 7 moves most slowly. This makes it possible to suppress false notifications.

Note that, for example, as is clear from the passing point P10, the farthest passing point P differs depending on the passing direction, so the estimated travel time is set for each passing direction.

<Hardware configuration example>
FIG. 4 is a block diagram showing a schematic hardware configuration of the information processing device 20. As shown in FIG. Information processing device 20 can generally be implemented as a personal computer, workstation, or appliance server. The information processing device 20 includes a CPU 201 and a memory 202 that enables high-speed access to data used by the CPU 201. The CPU 201 and memory 202 are connected to other devices or drivers of the information processing apparatus 20, such as a graphics driver 204 and a network driver (NIC) 205, via a system bus 203.

An LCD (display device) 206 is connected to the graphics driver 204, executes display instructions from the CPU 201, and displays a screen. A touch panel may be integrally arranged on the LCD 206.

Further, the network driver 205 connects the information processing device 20 to the network N at the transport layer level and the physical layer level, and establishes a session with a communication partner.

An I/O bus bridge 207 is further connected to the system bus 203. On the downstream side of the I/O bus bridge 207, a storage device such as an HDD 209 is connected via an I/O bus 208 such as PCI via IDE, ATA, ATAPI, serial ATA, SCSI, USB, etc. . An SSD (Solid State Drive) may be provided instead of the HDD 209 or together with the HDD 209.

The HDD 209 stores a program 209p that controls the entire information processing device 20. The information processing device 20 executes the program 209p to accept and learn operations from the monitor. The program 209p may be distributed from a server that distributes the program, or may be distributed while being stored in a portable storage medium such as a USB memory or an optical storage medium.

Further, an input device 210 such as a keyboard and a mouse (referred to as a pointing device) is connected to the I/O bus 208 via a bus such as a USB, and receives input and commands from an operator (for example, a staff member). .

The information processing device 20 may be compatible with cloud computing. Cloud computing refers to a usage format in which resources on a network are used without being aware of specific hardware resources.

Furthermore, it is assumed that the hardware configuration diagrams of the terminal device 40 and the mobile terminal 50 are the same as or different from those in FIG. 4, but there is no problem in explaining this embodiment.

<About functions>
Next, the functions of the information processing device 20 will be explained using FIG. 5. FIG. 5 is an example of a functional block diagram showing each function provided in the information processing device 20 in a block form. The information processing device 20 includes an image data receiving section 21, an image processing section 22, an imaging device determining section 23, an excluded person registration section 24, an image search section 25, an information registration section 26, a time measurement section 27, a screen information generation section 28, It also has a reporting section 29. Each of these functions is a function or means realized by the CPU 201 shown in FIG. 4 executing the program 209p and cooperating with the hardware of the information processing device 20. There is no need to clearly distinguish between functions realized by hardware or software, and some or all of these functions may be realized by a hardware circuit such as an IC.

The information processing device 20 also stores an estimated travel time DB 31, an excluded person image DB 32 (an example of a second storage unit), and a monitoring information DB 33 (an example of a first storage unit) constructed from the memory 202 or HDD 209 shown in FIG. example). These DBs do not need to be directly owned by the information processing device 20, but may be located anywhere on the network that the information processing device 20 can access. First, each DB will be explained.

表１は、想定移動時間ＤＢ３１に記憶している想定移動時間情報を模式的に示す。想定移動時間情報は通過ポイントごとに予め設定された想定移動時間や通過ポイントＰが具体的にどの場所に対応するかなどの情報を有している。想定移動時間情報は、撮像装置ＩＤに対応付けて、通過方向ごとの想定移動時間を登録している。撮像装置ＩＤは撮像装置１０を一意に識別するための識別情報である。表１では、通過ポイントＰ１～Ｐ２１，Ｐ３１～Ｐ３３に対応させて、撮像装置ＩＤはＣ１～Ｃ２１，Ｃ３１～Ｃ３３を登録している。通過方向は通過ポイントＰを通過しうる方向であり主に２方向とするが３方向以上が存在してもよい（設置する撮像装置１０の数を減らすことができる）。通過方向ごとに想定移動時間が設定されている。また、居室のように「入」の方向では想定移動時間が不要なので、想定移動時間は設定していない（「－」を設定している）。居室以外の通過ポイントＰ（例えば廊下など）では通過方向が分かるように東西南北を設定している。通過方向は右左上下などを設定してもよい。

Table 1 schematically shows the estimated travel time information stored in the estimated travel time DB 31. The estimated travel time information includes information such as the estimated travel time set in advance for each passing point and to which location the passing point P specifically corresponds. The estimated travel time information registers the estimated travel time for each passing direction in association with the imaging device ID. The imaging device ID is identification information for uniquely identifying the imaging device 10. In Table 1, imaging device IDs C1 to C21 and C31 to C33 are registered in association with passing points P1 to P21 and P31 to P33. The passing direction is a direction in which the passing point P can be passed, and there are mainly two directions, but there may be three or more directions (the number of imaging devices 10 to be installed can be reduced). Estimated travel times are set for each passing direction. Further, in the direction of "enter" such as in a living room, the estimated travel time is not required, so the estimated travel time is not set ("-" is set). Passage points P (for example, hallways) other than living rooms are set as north, south, east, and west so that the direction of passage can be known. The passing direction may be set to the right, left, top, bottom, etc.

表２は、除外者画像ＤＢ３２に記憶している除外者登録情報を模式的に示す。除外者登録情報は除外者（スタッフ又は来訪者）の頭頂部の画像データを登録した情報である。除外者登録情報は、頭頂部の画像データと撮像日時の各項目を有している。頭頂部の画像データは、時系列に登録されている。頭頂部の画像データはスタッフ又は来訪者が外出して一定時間が経過すると削除されることが好ましい。これにより、除外者画像ＤＢ３２の記憶領域が増大することを抑制できる。

Table 2 schematically shows excluded person registration information stored in the excluded person image DB 32. The excluded person registration information is information in which image data of the top of the head of the excluded person (staff or visitor) is registered. The excluded person registration information includes image data of the top of the head and each item of imaging date and time. The image data of the top of the head is registered in chronological order. It is preferable that the image data of the top of the head be deleted after a certain period of time has passed after the staff member or visitor goes out. Thereby, it is possible to suppress the storage area of the excluded person image DB 32 from increasing.

表３は、監視情報ＤＢ３３に記憶している監視情報を模式的に示す。監視情報は被介護者７の一人一人を監視する（見守る）ための情報である。監視情報は、頭頂部の画像データ、通過ポイントＰ、通過方向、通過時刻、想定移動時間、経過時間、及び、最初の通過ポイントの各項目を有している。頭頂部の画像データは主に被介護者７のものであるが、外部との境界の撮像装置１２（通過ポイントＰ３１）で撮像されたスタッフの頭頂部の画像データが登録される場合がある。通過ポイントＰは頭頂部の画像データが最後に撮像された通過ポイントＰであり、通過方向は被介護者７が通過した方向である。通過時刻は頭頂部の画像データが撮像された撮像時刻又は受信した時刻である（日にちを登録してもよい）。想定移動時間は、想定移動時間ＤＢ３１において頭頂部の画像データを撮像した撮像装置１０に対応付けられている想定移動時間である。経過時間は、通過時刻をゼロとしてリアルタイムに測定されている経過時間である。経過時間は、同じ被介護者７が次の通過ポイントＰを通過するとゼロになる。最初の通過ポイントは、当該頭頂部の画像データが最初に撮像された通過ポイントＰである。

Table 3 schematically shows the monitoring information stored in the monitoring information DB 33. The monitoring information is information for monitoring (watching over) each of the care recipients 7. The monitoring information includes the following items: image data of the top of the head, passing point P, passing direction, passing time, estimated travel time, elapsed time, and first passing point. Although the image data of the top of the head is mainly of the cared person 7, the image data of the top of the staff's head captured by the imaging device 12 (passing point P31) at the boundary with the outside may be registered. The passing point P is the passing point P where image data of the top of the head was last captured, and the passing direction is the direction in which the cared person 7 passed. The passing time is the imaging time at which the image data of the top of the head was captured or the time at which it was received (the date may be registered). The estimated travel time is the estimated travel time associated with the imaging device 10 that captured the image data of the top of the head in the estimated travel time DB 31. The elapsed time is the elapsed time measured in real time with the passing time as zero. The elapsed time becomes zero when the same cared person 7 passes the next passing point P. The first passing point is the passing point P where the image data of the top of the head is first captured.

Note that the image data of the top of the head may be updated each time the image data of the top of the head of the same cared person 7 is captured at the next passing point P, or it may be updated each time the image data of the top of the head of the same cared person 7 is captured at the next passing point P (for example, in the living room). The image data taken at the entrance/exit) may be held, or all the image data of the top of the head of the same person 7 may be held in association with each other. In this embodiment, the description will be made on the assumption that it is updated every time an image is captured at the next passing point P. As a result, even if the hairstyle or the like gradually deteriorates, the latest image data of the top of the head is registered, making it easy to determine that the same cared person 7 is the same person.

The explanation will be returned to FIG. 5. The image data receiving unit 21 receives the imaging device ID and image data of the top of the head from the imaging device 10 at the passing point P, the excluded person registration imaging devices 11A and 11B, and the imaging device 12 at the boundary with the outside. The imaging device ID may be the passing point P. A plurality of image data of the top of the head are transmitted from one imaging device 10 so that the passing direction can be determined, but only one image data may be used when the passing direction is not specified.

The image processing section 22 performs image processing on the image data received by the image data receiving section 21. First, the passing direction is determined, which will be explained in detail with reference to FIG. In addition, for example, processing to correct the brightness that differs depending on the imaging device 10 is made equal, processing to correct so that objects of the same size appear in the same size, processing to change the passing direction to the north (in other words, processing to make the passing direction face upward) ), etc. Alternatively, the image data of the top of the head may be learned by machine learning or the like, and a process may be performed in which it is determined whether the top of the head is included in the image, and only the image data in which the top of the head is included is passed to the subsequent stage. Furthermore, the area in which the top of the head is captured in the image data may be surrounded by a rectangle or the like to reduce the time required for comparison processing, which will be described later.

The imaging device determination unit 23 determines whether the image data processed by the image processing unit 22 is an image captured by the excluded person registration imaging devices 11A, 11B based on the imaging device ID. The image data of the top of the head captured by the excluded person registration imaging devices 11A and 11B is sent to the excluded person registration section 24, and the image data of the other top of the head is sent to the image search section 25.

The excluded person registration unit 24 registers excluded person registration information in the excluded person image DB 32. That is, the image data of the top of the head of the excluded person (staff member or visitor) and the date and time of imaging are registered in the excluded person image DB 32.

The image search unit 25 searches the image data of the top of the head in the excluded person image DB 32 and the monitoring information DB 33 using the real-time image data of the top of the head sent from the imaging device determination unit 23 . The image data of the top of the head that was found (suitable) in the search of the excluded person image DB 32 is that of a staff member or a visitor, and the image data of the top of the head that was found in the search of the monitoring information DB 33 is that of care receiver 7. . Further, the image data of the top of the head that is not registered in either will be newly registered in the monitoring information DB 33.

As a search method, for example, there is a method of narrowing down the size of the top of the head to those with similar vertical and horizontal sizes and performing pattern matching. When the imaging device 10 captures color image data, a color histogram can also be created and compared. Alternatively, feature points such as SIFT (Scale Invariant Feature Transform) may be detected and the feature points may be compared.

The information registration unit 26 registers image data of the top of the head, which is not registered in either the excluded person image DB 32 or the monitoring information DB 33, in the monitoring information DB 33. Further, along with the image data of the top of the head, the passing point P, passing direction, passing time, estimated travel time, elapsed time, and first passing point P are registered. The initial value of elapsed time is zero. In addition, if the image data of the top of the head that is already registered in the monitoring information DB 33 is captured (if the search hits), the image data of the top of the head, passing point P, passing direction, passing time, estimated travel time, and , update the elapsed time.

The time measuring unit 27 measures time and updates the elapsed time in the monitoring information DB 33 as time passes.

The reporting unit 29 periodically compares the estimated travel time in the monitoring information DB 33 with the elapsed time, and if the elapsed time exceeds the estimated travel time, it reports to the mobile terminal 50 and/or lights up the alarm lamp 51. Since the passing point P and passing direction are known, when reporting, the last passing point P and passing direction are reported. Furthermore, when making a report, it is preferable to transmit a map of the inside of the facility generated by the screen information generation unit 28. As a result, the staff can quickly identify the location where the cared person 7 is unable to move due to a fall, etc., and can rush to the location. In addition, the reporting unit 29 reports only when a predetermined condition is satisfied when the cared person 7 leaves the passage point P31 of the boundary with the outside. Details will be explained in detail with reference to FIG. 14 and the like.

The screen information generation unit 28 generates screen information to be displayed by the terminal device 40 using the monitoring information in the monitoring information DB 33. For example, screen information that displays the monitoring information itself in a list form is generated. Furthermore, if it is determined to make a report based on the same judgment as the reporting unit 29, it generates screen information that displays the last passing point P and passing direction on a map of the facility as shown in FIG. Thereby, the staff can visually grasp the location where the cared person 7 is likely to be present, even if the location is difficult to understand just by the number of the passing point P.

<Judgment of passing direction>
Determination of the passing direction of the cared person 7 based on the image data of the top of the head will be explained using FIG. 6 . FIG. 6 is an example of a diagram illustrating a method of determining the passing direction of the cared person 7. The image data of the top of the head in FIGS. 6(a) to 6(c) show how the top of the head of the same cared person 7 is imaged over time at a certain passing point.

FIG. 6A shows an example of image data in which the top of the head begins to appear in the field of view of the imaging device 10. Since the angle of view of the imaging device 10 is narrow, the top of the head is not captured until the cared person 7 is directly below. The image processing unit 22 determines the center of gravity G of the changed area, for example, by taking the difference between image data before the image changes (image data showing the floor) and after the image changes.

FIG. 6B shows an example of image data in which the top of the head is captured at the center of the angle of view of the imaging device 10. In other words, the cared person 7 has moved directly below the imaging device 10 . The image processing unit 22 can similarly determine the center of gravity G. FIG. 6C shows an example of image data in which the top of the head is captured in a state where it is likely to be out of the field of view of the imaging device 10. The cared person 7 is about to pass under the imaging device 10. The image processing unit 22 can similarly determine the center of gravity G.

In this manner, the image processing unit 22 determines the center of gravity G of the top of the head in the time-series image data of the top of the head, and approximates it to a straight line using the least squares method or the like. The direction of passage can be determined by dividing the length of a straight line into the horizontal direction (east-west direction) and the vertical direction (north-south direction) and determining which component is longer. Alternatively, the determination may be made simply based on which direction (east, west, north, south, north, south, etc.) the top of the head appeared and in which direction it disappeared.

<Operating procedure>
Next, the flow of processing of the information processing device 20 will be explained using FIG. 7. FIG. 7 is a flowchart illustrating an example of a process in which the information processing device 20 issues a report based on the image data of the top of the head. The process in FIG. 7 is repeatedly executed while the reporting system 100 is in operation.

In step S1, the image data receiving section 21 receives image data. In step S2, the image processing unit 22 determines whether the image data is the top of the head. If the image data is of the top of the head, the image processing unit 22 performs the above image processing. If the image data is not the top of the head, the process advances to step S16.

If the image data is of the top of the head, in step S3, the imaging device determination unit 23 determines whether or not the user has left the passing point P at the boundary with the outside, based on the imaging device ID and the passing direction transmitted together with the image data. to decide. If the determination in step S3 is Yes, going out processing in step S4 is executed. The going out process will be explained with reference to FIG.

If the determination in step S3 is No, in step S5, the imaging device determination unit 23 determines whether or not the image data captured by the excluded person registration imaging devices 11A and 11B is in a predetermined direction, together with the image data. The determination is made based on the transmitted imaging device ID and the passing direction detected by the image processing unit 22. This predetermined direction is the direction in which the image data of the top of the head captured by the excluded person registration imaging device 11A exits from the office 63. In other words, it will be decided whether or not to continue working. Although the passing direction in the excluded person registration imaging device 11B of the reception desk 64 is determined to be the direction of moving indoors, the passing direction may also be determined in the excluded person registration imaging device 11B.

If the determination in step S5 is Yes, in step S6, the excluded person registration unit 24 registers the image data of the top of the excluded person's head and the imaging date and time in the excluded person image DB 32.

If the determination in step S5 is No, in step S7, the image search unit 25 searches the excluded person image DB 32 and the monitoring information DB 33 using the image data of the top of the head received by the image data receiving unit 21. Note that if the search results in either the excluded person image DB 32 or the monitoring information DB 33, there is no need to search the other DB. Also, you may search for either one first.

In step S8, as a result of the search, the image search unit 25 determines whether the person is an excluded person (whether a search hit was found in the excluded person image DB 32). In the case of the excluded person, the process proceeds to step S9.

If the person is an excluded person, the information registration unit 26 ends monitoring in step S9. In this case, there is a possibility that a staff member (or a visitor due to some mistake) is registered in the monitoring information DB 33 using the imaging device 12 at the border with the outside when coming to work. Regarding a staff member registered as a monitoring target, if the staff member enters the office 63 within the preset estimated travel time and is imaged by the excluded person registration imaging device 11A, the information registration unit 26 retrieves the image of the top of the head from the monitoring information DB 33. Delete the data, passing point P, passing direction, passing time, estimated travel time, and elapsed time. Alternatively, you may leave the data and register that it is not a monitoring target.

If the person is not excluded, in step S10, the image search unit 25 determines whether the image data is new image data of the top of the head. In other words, it is determined whether the image data is of the top of the head that is not registered in either the excluded person image DB 32 or the monitoring information DB 33.

If the image data is new image data of the top of the head, the information registration unit 26 registers the image data of the top of the head in the monitoring information DB 33 in step S11.

Then, in step S12, the information registration unit 26 uses the passing point P and estimated travel time acquired from the estimated travel time DB 31 based on the imaging device ID transmitted together with the image data, the passing direction determined by the image processing unit 22, and the image The passing time at which the data was received (or the time at which the image was captured) and the elapsed time (initial value zero) are registered in the monitoring information DB 33. Regarding the elapsed time in the monitoring information DB 33, the time measurement unit 27 performs a process of increasing the elapsed time associated with the image data of the crown of the head at a constant cycle, asynchronously with the reception of the image data of the crown of the head.

On the other hand, if the image data of the parietal region is not new (if the search hits the monitoring information DB 33), in step S13, the information registration unit 26 stores the image data of the parietal region received by the image data receiving unit 21 in the monitoring information DB 33. Update the image data of the top of the head. The information registration unit 26 also stores the passing point P and estimated travel time associated with the image data of the top of the head hit in the monitoring information DB 33 in the estimated travel time DB 33 based on the imaging device ID transmitted together with the image data. It is updated with the passing point P and estimated travel time obtained from . Similarly, the passing direction is updated with the passing direction determined by the image processing unit 22. Similarly, the passing time is updated. Also, initialize the elapsed time to zero.

Further, in step S14, the information registration unit 26 determines whether the cared person 7 has returned to the room. This determination is made based on whether the passing point P associated with the hit image data of the top of the head in the monitoring information DB 33 is the same as the first passing point P, and whether the passing direction is "in". If the user has not returned to his/her room, the process proceeds to step S16.

If the user returns to his or her room, the information registration unit 26 ends monitoring in step S15. The information registration unit 26 deletes the image data of the top of the head, the passing point P, the passing direction, the passing time, the estimated travel time, and the elapsed time from the monitoring information DB 33. Alternatively, you may leave the data and register that it is not a monitoring target.

In step S16, the reporting unit 29 determines whether there is a cared person 7 whose elapsed time exceeds the estimated travel time.

If there is a cared person 7 whose elapsed time has exceeded the assumed travel time corresponding to the threshold value, in step S17, the reporting unit 29 informs the cared person 7 that the place where the cared person 7 is located is a predetermined place, and that there are multiple cared people Determine whether 7 is present or not. Even if the elapsed time exceeds the estimated travel time, if the passing point associated with the image data whose elapsed time exceeds the estimated travel time is related to a predetermined location and the predetermined direction of travel is If image data that is associated with the same passing point and passing direction as the image data is stored in the monitoring information DB 33, separately from image data whose elapsed time exceeds the estimated travel time, The reporting unit 29 does not report. The predetermined place is a place where a plurality of care recipients 7 spend a long time, such as a dining room or a common room. Moreover, the requirement that there be a plurality of care recipients 7 is so that in an emergency, one of them can notify of an abnormality. By doing this, even if the elapsed time at a stopover becomes longer than the estimated travel time, no notification will be made, and erroneous notifications can be suppressed.

The reporting unit 29 reports that in the monitoring information DB 33, the passage point P of the cared person 7 for which elapsed time>estimated travel time is a predetermined place (whether or not it is a predetermined place is registered in the estimated travel time DB 31) and the passing direction is Determine whether it is "on" or not. When the passing point P is a predetermined place and the passing direction is "in", it is searched in the monitoring information DB 33 whether there is another cared person 7 who is at the same passing point P and whose passing direction is "in".

If the place where the cared person 7 is not in the predetermined place or if there are no cared people 7, the reporting unit 29 makes a notification in step S18. For example, a passing point P and a passing direction are designated and notified.

In step S19, the excluded person registration unit 24 determines whether information about excluded persons for whom a predetermined time has elapsed since going out is registered in the excluded person image DB 32.

If the excluded person information for which the predetermined time has elapsed is registered in the excluded person image DB 32, in step S20, the excluded person registration unit 24 deletes the excluded person information for which the predetermined time has elapsed from the excluded person image DB32. In addition, regarding the visitor's excluded person information, the visitor's excluded person information may be deleted from the excluded person image DB 32 at the end of the visiting time.

Through the above-described processing, it is possible to keep an eye on the cared person 7 moving smoothly within the facility while maintaining privacy using the image data of the top of the head.

<Example of movement and transition example of monitoring information DB>
An example of the operation of the notification system will be explained assuming several movement examples.

<<In the case of cared for>>
FIG. 8 shows an example of movement of the cared person 7 within the facility, and FIG. 9 shows an example of transition of the monitoring information DB 33. As shown in FIG. 8, the cared person 7 in living room A left living room A (passing point P1), passed through passing points P18 and P19, and stayed in the dining room. Thereafter, the vehicle passed through points P19, P18, and P1 and returned to room A.

FIG. 9(a) shows the monitoring information registered immediately after passing through the passage point P1 and leaving the living room A. Passing point P1, passing direction "out", passing time "13:15", estimated travel time "5 minutes", elapsed time "0", and first passing point P1 are registered.

FIG. 9(b) shows monitoring information in a state where the cared person 7 has arrived a little before the passing point P18. Only the elapsed time is updated and "60 seconds" is registered. Therefore, since the elapsed time does not exceed the estimated travel time, no notification is given.

FIG. 9(c) shows monitoring information registered immediately after passing through point P18. Passing point P18, passing direction "south", passing time "13:17", estimated travel time "3 minutes", elapsed time "0", and first passing point P1 are registered.

FIG. 9(d) shows monitoring information in a state where the cared person 7 has arrived a little before the passing point P19. Only the elapsed time is updated and "15 seconds" is registered. Therefore, since the elapsed time does not exceed the estimated travel time, no notification is given.

FIG. 9(e) shows monitoring information registered immediately after passing through point P19. Passing point P19, passing direction "Enter", passing time "13:18", estimated travel time "30 minutes", elapsed time "0", and first passing point P1 are registered.

FIG. 9(f) shows monitoring information of the cared person 7 staying in the cafeteria for a long time. Only the elapsed time is updated and "31 minutes" is registered. Although the elapsed time exceeds the estimated travel time, it is not reported because there were other care recipients 7 in the cafeteria.

FIG. 9(g) shows monitoring information registered immediately after passing through point P19 in the exit direction. Passing point P19, passing direction "out", passing time "14:00", estimated travel time "3 minutes", elapsed time "0", and first passing point P1 are registered.

After that, it is assumed that the cared person 7 passes through the passing point P18 and reaches the passing point P1.

FIG. 9(h) shows monitoring information registered immediately after passing through the passing point P1 in the direction of entry. Passing point P1, passing direction "Enter", passing time "14:05", estimated travel time "-", elapsed time "0", and first passing point P1 are registered.

The passing point P1 is the first passing point P at which behavior monitoring is started and corresponds to the room A of the cared person 7, so it is determined that the cared person 7 has returned to the living room A, and the monitoring is ended.

<<For visitors>>
FIG. 10 shows an example of a visitor's movement within the facility, and FIG. 11 shows an example of registration in the excluded person image DB 32. As shown in FIG. 10, the visitor completed the reception at the reception desk (passing point P32), passed through passing points P31, P21, and P8, and entered the living room H. After completing errands with care recipient 7 in living room H, the patient passed through passing points P8, P21, and P31, and went outside.

FIG. 11A shows excluded person information that is imaged by the excluded person registration imaging device 11A and registered in the excluded person image DB 32 when the visitor passes through the reception desk (passing point P32). In this way, when an image is captured by the excluded person registration imaging device 11B, the image data of the top of the head is registered in the excluded person image DB 32. Since the visitor is registered in the excluded person image DB32, the visitor will not be registered in the monitoring information DB33 even if the visitor passes through the passing points P31, P21, and P8.

If the visitor passes through the passing points P8, P21, and P31 alone, the passing point P31 is the passing point P at the border with the outside, and since it means that the visitor has gone out, an outing process is performed. Visitors are not reported because it is permissible in general facilities for visitors to go out alone. As shown in FIG. 11(b), the excluded person registration unit 24 registers the date and time of going out in the excluded person image DB 32. For example, the excluded person registration unit 24 deletes the image data of the top of the head of the visitor registered at the end time of the visit from the excluded person image DB 32, or deletes the image data of the top of the head of the visitor registered at the visiting end time, or deletes the image data of the top of the head of the visitor registered at the end time of the visit, or If the data is registered, the image data of the top of the visitor's head is deleted from the excluded person image DB 32. With such processing, there is no need to register the image again if the visitor temporarily goes out.

Note that when it is detected that the visitor has left the passing point P31, the excluded person registration unit 24 may immediately delete the image data of the top of the visitor's head from the excluded person image DB 32. In this case, even if a visitor goes out temporarily, he or she will have to go through the reception desk again, but this has the advantage of improving security.

The going out process is also performed when the cared person 7 passes through the passing point P31 alone. Since care recipient 7 is not allowed to go out alone in a general facility, a report is made.

The outing process is also performed when the visitor and the cared person 7 pass through the passage point P31 to the outside. Since it is permissible for visitors and cared person 7 to go out in general facilities, no report is made. If the image data of the top of the head captured by the imaging device 12 at the border with the outside is of the care recipient 7, the reporting unit 29 reports that the image data of the top of the visitor's head captured by the outside is at approximately the same time. It is determined whether an image has been captured by the imaging device 12 at the boundary. As a result, if the cared person 7 goes out alone at the passing point P31 at the boundary with the outside, it can be reported, and if the cared person 7 passes through the passing point P31 to the outside with a visitor, false notifications can be suppressed. can.

<<For staff>>
FIG. 12 shows an example of movement of staff within the facility, and FIG. 13 shows an example of registration in the monitoring information DB 33. As shown in FIG. 12, when the staff goes to work, they pass through points P31 and P33 and enter the office. After changing clothes, etc., the worker passes through the exit direction through the passing point P33 and begins work.

FIG. 13(a) shows the monitoring information registered immediately after the staff member passed through the passage point P31. Passing point P31, passing direction "Enter", passing time "8:30", estimated travel time "5 minutes", elapsed time "0", and first passing point P31 are registered. In this way, since the passing point P31 is not the excluded person registration imaging device 11A or 11B, the information registration unit 26 registers the monitoring information in the monitoring information DB 33.

FIG. 13(b) shows the monitoring information registered immediately after the staff member passed through the passage point P33. Passing point P33, passing direction "ENTER", passing time "8:31", estimated travel time "-", elapsed time "0", and first passing point P31 are registered.

The passing point P33 is a passing point P at the office entrance through which only staff members pass, and since the staff member passed through the passing point P33 (excluded person registration imaging device 11A) in the direction of entry, it is determined that the staff member has gone to work. End monitoring.

Next, the staff passed passing point P33 in the exit direction. Since the staff member passed through the passage point P33 (excluded person registration imaging device 11A) in the exit direction, the image data of the top of the staff's head is registered in the excluded person image DB 32.

Note that when the staff member passes through the passing point P31 for work and is temporarily outdoors, the date and time of going out is registered in the excluded person image DB 32 as shown in FIG. 11(b). Therefore, the state in which the excluded person information is registered in the excluded person image DB 32 can be maintained for a short time. Further, when the staff leaves work, the excluded person information is deleted from the excluded person image DB 32 after a predetermined period of time (for example, 8 hours, etc.) has elapsed. Even if it is not deleted, the excluded person information can be newly registered by passing through the passing point P33 (excluded person registration imaging device 11A) in the exit direction.

<Going out process>
FIG. 14 is an example of a flowchart explaining the going out process. The process in FIG. 14 starts when it is determined that the staff, visitor, or cared person 7 has gone out of the passing point P31 of the boundary with the outside.

First, in step S21, the image search unit 25 searches the excluded person image DB 32 using image data of the top of the head captured by the imaging device 12 at the boundary with the outside, and determines whether the excluded person has gone out.

When the excluded person goes out, the excluded person registration unit 24 registers the date and time of going out in the excluded person image DB 32 in step S22.

Next, in step S23, the image search unit 25 searches the monitoring information DB 33 using the image data of the top of the head captured by the imaging device 12 at the boundary with the outside, and determines whether the cared person 7 has gone out.

When the cared person 7 goes out, in step S24, the image search unit 25 determines whether the excluded person and the cared person 7 went out at approximately the same time. For example, it is determined whether the date and time of the excluded person's going out is registered within one minute after the imaging device 12 at the boundary with the outside captures the image data of the top of the head of the cared person 7.

If only the cared person 7 goes out, the reporting unit 29 reports in step S25. If the excluded person and the cared person 7 go out at approximately the same time, the reporting unit 29 does not report. With such processing, it is possible to report when only the cared person 7 goes out, and not to notify when the cared person 7 goes out with the excluded person.

<Example of report>
Next, the contents of the notification displayed by the mobile terminal 50 or the terminal device 40 will be explained using FIG. 15. FIG. 15 is a diagram showing an example of a screen displayed by the mobile terminal 50 or the terminal device 40 at the time of reporting. FIG. 15A shows a report screen 300 displayed by the mobile terminal 50. As shown in FIG. 15A, the last passing point P (reference numeral 301), passing direction 302, location 303, and passing time 304 are displayed on the notification screen 300. The location 303 is information in the notes column associated with the passing point P in the estimated travel time DB 31. The last passing point P (301), passing direction 302, and passing time 304 are registered in the monitoring information DB 33. The staff can narrow down the location where the cared person 7 is by looking at the report screen 300 and the last passing point P and the passing direction, and can rush to the place where the cared person 7 is at an early stage.

FIG. 15(b) is an example of a notification screen 310 displayed by the terminal device 40. On this report screen 310, the last passing point P (coded as 311) is highlighted and displayed on the facility map, and an arrow 312 indicating the passing direction, the location 313 (shaded area), and the passing time 314 are clearly displayed. has been done. Location 313 is highlighted with diagonal lines. Further, an icon 315 of the cared person 7 is also displayed at the location 313. With these, the staff can visually grasp the location where the cared person 7 is, and can quickly rush to the cared person's location.

<Summary>
As explained above, the reporting system 100 of this embodiment has the following effects. Since the cared person 7 becomes a monitoring target simply by passing through the passing point P, there is no need to input a destination or the like, and the operational burden on the reporting system 100 is reduced. Since the angle of view of the imaging device 10 is narrow, the privacy of the cared person 7 can be ensured. Further, it is possible to immediately identify where the cared person 7 is located. Further, even if the cared person 7 stops by any place, the cared person 7 is not notified and can move freely.

In addition, image data of the top of the head is registered when the excluded person goes to work or visits, and when the cared person 7 leaves the room, so there is no need to register the image data of the top of the head in advance, and the daily It can also accommodate changes in hairstyles, etc.

<Other application examples>
Although the best mode for carrying out the present invention has been described above using examples, the present invention is not limited to these examples in any way, and various modifications can be made without departing from the gist of the present invention. and substitutions can be added.

For example, in this embodiment, an example has been described in which the cared person 7 is watched over inside the facility, but the scope of the facility may include not only indoors but also outdoors. For example, passing points can be set in a courtyard or the like.

Furthermore, the facility is not limited to one floor, but may span multiple floors. In this case, monitoring points are installed on stairs and elevators.

Further, although it has been explained that the estimated travel time is set in advance, the estimated travel time may be automatically updated based on the maximum value of the times that the cared person 7 actually travels. For example, it is determined to be 1.5 times the maximum value. This allows you to set a practical estimated travel time.

Further, there may be a plurality of information processing apparatuses 20, and the functions of the information processing apparatus 20 may be distributed across the plurality of information processing apparatuses.

Further, in the configuration example shown in FIG. 5 and the like, the information processing apparatus 20 is divided into parts according to main functions in order to facilitate understanding of the processing performed by the information processing apparatus 20. The present invention is not limited by the method of dividing the processing units or the names thereof. The processing of the information processing device 20 can also be divided into more processing units depending on the processing content. Furthermore, one processing unit can be divided to include more processing.

5 facility 7 cared person 10 imaging device 11 imaging device for excluded person registration 20 information processing device 100 reporting system

Claims (6)

A movement management system having an imaging device installed at each of a plurality of passage points through which people pass,
For each passing point, the estimated travel time to the next possible passing point is set.
When the top of a person's head is imaged by the imaging device 1, it is determined whether the image data of the top of the head is registered as monitoring information,
If it is not registered as the monitoring information, the image data of the top of the head and the passing point are associated with each other and registered as monitoring information, and further, the measurement of elapsed time is started,
determining the occurrence of an abnormality related to the person based on the estimated travel time set at a passing point where the imaging device is installed and the elapsed time;
A movement management system characterized by: The movement management system includes:
If the image data of the top of the head of the person imaged by the imaging device No. 1 is registered as the monitoring information, update the passing point associated with the image data of the top of the head registered as the monitoring information. and initialize the elapsed time,
The movement management system according to claim 1, characterized in that: The estimated travel time is set according to the distance from each passing point to the farthest passing point among one or more passing points that can be passed next. Described movement management system. Detects the direction of passage of the person at the passage point based on the image data of the top of the head,
If it is detected that a person has passed in a predetermined passing direction at a predetermined passing point, the measurement of elapsed time is terminated;
The movement management system according to claim 1, characterized in that: An information processing device that communicates with a plurality of imaging devices installed at passage points through which people pass,
For each passing point, the estimated travel time to the next possible passing point is set.
When the top of a person's head is imaged by the imaging device 1, it is determined whether the image data of the top of the head is registered as monitoring information,
If it is not registered as the monitoring information, the image data of the top of the head and the passing point are associated with each other and registered as monitoring information, and further, the measurement of elapsed time is started,
determining the occurrence of an abnormality related to the person based on an estimated travel time and elapsed time set at a passing point where the imaging device is installed;
An information processing device characterized by: An information processing device that communicates with multiple imaging devices installed at passage points where people pass,
For each passing point, the estimated travel time to the next possible passing point is set.
When the top of a person's head is imaged by the imaging device No. 1, it is determined whether the image data of the top of the head is registered as monitoring information;
If it is not registered as the monitoring information, the image data of the top of the head and the passing point are associated with each other and registered as monitoring information, and further, the measurement of elapsed time is started,
determining the occurrence of an abnormality related to the person based on an estimated travel time and elapsed time set at a passing point where the imaging device is installed;
A program characterized by:

Images