JP7287815B2 - Notification system, information processing device, program - Google Patents

Description

The present invention relates to a reporting system, an information processing device, and a program.

In facilities such as nursing homes, nursing homes, and hospitals, the lives of care recipients, mainly the elderly and people with walking difficulties, are watched over day and night by staff instead of relatives who cannot live with them. In recent years, construction of a notification system for confirming the safety of care recipients and detecting abnormalities by arranging various sensors has been advanced. If the reporting system determines that the facility is unsafe or some kind of abnormality is detected, the staff of the facility will rush to the place where the care recipient is located and take appropriate measures to ensure safety.

One of the sensors used in notification systems is a mat sensor that detects the presence of a resident (see, for example, Patent Document 1). The mat sensor is laid on the floor, and when the care receiver steps on the mat sensor while passing, the weight of the care receiver is detected as pressure. If the mat sensor is placed on the side of the bed, in the bathroom, or in the toilet, for example, it can detect that the person to be cared has fallen or does not move after falling, and the staff can rush to the place where the person fell.

Also, a technique has been devised that uses a camera as a sensor to monitor the movement of a care-receiver (see, for example, Patent Document 2). Patent Literature 2 discloses a notification system that sets an expected travel time according to the physical condition of the care-receiver on that day, and notifies the user if the destination has not been reached by the expected travel time.

JP 2016-045118 A Japanese Patent Application Laid-Open No. 2018-181080

However, the method of laying the mat sensor as in Patent Literature 1 has a problem that it is impossible to specify where the care-receiver is. That is, the size of a general mat sensor is not so large, and in order to grasp the whereabouts of the entire facility, the entire floor must be covered with mat sensors, which is not practical. In addition, the occupant often straddles the mat sensor placed on the side of the bed, in the bathroom, or in the toilet.

Moreover, in the notification system of Patent Document 2, an input person (a care recipient or a staff member) must input a destination each time the care recipient moves, which poses a problem of a large operational burden.

In addition, if the care recipient does not arrive at the destination after the expected travel time has elapsed, a report is made assuming that the care recipient has fallen. There is a problem that the response of the staff is delayed due to the inability to identify the

Furthermore, if the care recipient does not return to his room after arriving at the destination and moves to another place, or if he stops by another place before moving to the input destination, It takes longer than the travel time, and there is a problem that the staff receives unnecessary reports.

SUMMARY OF THE INVENTION In view of the above problems, it is an object of the present invention to provide a reporting system or the like that reduces the operational burden, makes it easy to identify where the care receiver is, and allows the care receiver to move freely.

In view of the above problems, the present invention includes a plurality of imaging devices installed at passing points through which people pass with their optical axes directed downward in the vertical direction, and an information processing device communicating with the plurality of imaging devices. a notification system,
The information processing device includes an image data receiving unit that receives image data of the parietal region of a person who has passed through the passing point from the imaging device, image data of the parietal region received by the image data receiving unit, A first storage unit that stores a passing point at which image data is captured and an elapsed time after passing the passing point; an image search unit for searching image data of the parietal region stored in a storage unit; and image data matching the image data of the parietal region received by the image data receiving unit is stored in the first storage unit an information registration unit that initializes the elapsed time stored in the first storage unit in association with the image data of the parietal region; and a reporting unit that specifies and reports the associated passing point.

Advantageous Effects of Invention According to the present invention, it is possible to provide a reporting system or the like that reduces the operational burden, makes it easy to identify where the care recipient is, and allows the care recipient to move freely.

1 is an example of a schematic configuration diagram of a reporting system; FIG. 1 is an example of a system configuration diagram of a notification system; FIG. It is a figure which shows an example of the passing point installed in the facility. 1 is a block diagram showing a schematic hardware configuration of an information processing device; FIG. It is an example of the functional block diagram which shows each function with which an information processing apparatus is provided in block form. It is an example of the figure explaining the judgment method of the care-receiver's passing direction. FIG. 10 is a flow chart diagram illustrating an example of processing until an information processing apparatus issues a report based on image data of the top of the head. It is a figure which shows the movement example in the care-receiver's facility. It is a figure which shows the transition example of monitoring information DB. It is a figure which shows the movement example in the facility of a visitor. It is a figure which shows the registration example of excluded person image DB. It is a figure which shows the movement example in the facility of the staff. It is a figure which shows the registration example of monitoring information DB. It is an example of the flowchart figure explaining going-out processing. It is a figure which shows the example of a screen which a portable terminal or a terminal device displays at the time of a report.

EMBODIMENT OF THE INVENTION Hereinafter, it demonstrates, referring drawings for the form for implementing this invention.

<Outline of operation of reporting system of this embodiment>
An outline of how the reporting system 100 watches over the cared person 7 will be described with reference to FIG. FIG. 1 is an example of a schematic configuration diagram of the reporting system 100. As shown in FIG. The notification system 100 has the following configuration.

(i) Places in the facility 5 through which the cared person 7 can pass are called passing points P, and an imaging device 10 is installed at each passing point P. In FIG. 1, imaging devices 10 are arranged at the entrance/exit of a room 96 where the care recipient 7 resides, the entrance/exit of a dressing room 99 (before the bathroom 97), and the entrance/exit of a toilet 98, respectively. The image pickup device 10 can image the top of the head of the care recipient 7, but the angle of view is set so as not to image the part leading to the identification of the person such as the face (the angle of view is narrow). Thereby, the privacy of the cared person 7 is ensured.

(ii) Each imaging device 10 can communicate with the information processing device 20 in the control room 6, and transmits image data of the top of the head of the cared person 7 who has passed the passing point P to the information processing device 20 in real time. The information processing device 20 can communicate with the terminal device 40 and the mobile terminal 50 carried by the staff member 8, so that the staff member 8 can respond quickly in an emergency.

(iii) A plurality of care recipients 7 may exist within the facility 5 . The cared person 7 cannot be identified from the image data of the top of the head, but can be distinguished (identified) from other cared people 7 by the image data of the top of the head.

Using such a configuration, the reporting system 100 performs the following processing.

(1) When the cared person 7 passing through the passing point P is detected by the image data of the top of the head, the information processing device 20 starts measuring the elapsed time. For each passing point P, an assumed travel time to the next passing point P is set in advance. Since the passing direction can be identified at the passing point P, an assumed travel time is set for each passing direction of the passing point P. The information processing device 20 determines the passing direction of the cared person 7 based on the image data of the top of the head obtained at a certain passing point P, and determines whether the elapsed time exceeds the assumed travel time.

For example, in FIG. 1, the cared person 7 who left the living room 96 may move to the dressing room 99 or the toilet 98, or may return to the living room without going anywhere. Therefore, the time required to reach the farther one of the dressing room 99 and the toilet 98 is assumed to be the travel time. Even if the elapsed time exceeds the assumed travel time, the information processing device 20 captures the same image data as the image data of the top of the head of the care-receiver 7 who has left the living room 96 . If not received from, notify staff 8.

(2) When the cared person 7 passes the next passing point P (for example, the dressing room 99 or the toilet 98), the information processing device 20 starts measurement by passing the passing point P (living room 96) passed immediately before. end the elapsed time measurement. Also, an assumed travel time is set for a newly passed passage point P (for example, the dressing room 99 or the toilet 98), and measurement of the elapsed time is started. In addition to passing through a dressing room 99 (bathroom 97) or a toilet 98, an assumed travel time appropriate for the purpose of stay is set at the passing point P of the place where the care-receiver 7 stays to run errands. .

(3) In addition, the information processing device 20 associates the image data of the parietal region with the passing point P at which the parietal image data was captured, the passing direction, the passing time, the assumed moving time, and the elapsed time (real time). measured values) are registered (hereinafter referred to as monitoring information). For example, when the imaging device 10 in the same living room 96 captures the image data of the top of the head of the care-receiver 7 who has left the living room 96, the information processing device 20 detects that the care-receiver 7 has returned to the living room 96. As a result, tracking of the cared person 7 who has returned to the living room 96 can be terminated, and the information on this cared person 7 can be deleted from the monitoring information.

(4) Also, as will be described later, an excluded person registration imaging device (not shown in FIG. 1) is installed for registering the staff 8 and visitors (hereinafter referred to as excluded persons) as persons to be excluded from the monitoring target. Thus, the information processing device 20 can exclude the excluded person from monitoring. As a result, erroneous reporting by an excluded person can be suppressed.

Therefore, with the configuration of (1) to (4), the cared person 7 becomes a monitoring target just by passing through the passing point P, so there is no need to input the destination, etc., and the operation of the reporting system 100 is burdened. Less is. In addition, since the imaging device 10 has a narrow angle of view, the privacy of the cared person 7 can be ensured. Furthermore, the configurations (1) to (3) make it possible to immediately identify where the cared person 7 is. Also, with the configurations of (1) and (2), even if the cared person 7 stops at an arbitrary place, the cared person 7 can act freely without being notified.

In addition, since the image data of the parietal region is registered when the excluded person goes to work or visits, and when the care recipient 7 leaves the living room, there is no need to register the image data of the parietal region in advance, and the hairstyle can be changed. Even if there is a change, the person can be monitored using the image data of the top of the head after the change. In general, the image data of the top of the head is registered in advance, and if the hairstyle or the like changes, it is necessary to register again. However, this embodiment does not have such a problem.

<Terms>
The parietal region of a person is a place on the skin corresponding to the position of the parietal bone, and is simply referred to as the vertex portion of the head. In the present embodiment, the range of the head imaged by the imaging device installed with the optical axis directed downward in the vertical direction may be sufficient.

Notification means to inform. It may also be called notification, notification, alarm, warning, or the like.

A facility is a facility for a purpose. Any facility in which a person exists may be used. Examples include, but are not limited to, nursing homes, nursing homes, hospitals, and the like. Moreover, it may be used not only for care recipients but also for grasping where people exist in companies, schools, and the like.

A person is an object of surveillance. In this embodiment, the cared person 7, the staff 8, and the visitor are mentioned. It is also possible to monitor animals such as dogs and cats.

<Configuration example>
FIG. 2 is an example of a system configuration diagram of the reporting system 100. As shown in FIG. The notification system 100 includes a plurality of imaging devices 10, one or more excluded person registration imaging devices 11A and 11B, an imaging device 12 at the boundary with the outside, an information processing device 20, a terminal device 40, and one or more mobile terminals 50. , and one or more warning lamps 51 .

The plurality of imaging devices 10 are installed at a location overlooking the top of the head, such as the ceiling of each passing point P, with the optical axis directed downward in the vertical direction. It is preferable that the imaging device 10 is capable of imaging in color, but there is no problem even if it is in black and white. It is preferable that each imaging device 10 can image a subject of the same size in the same size. This is because the size of the top of the head can be used as an element for determining the care recipient 7 . For example, it is conceivable to install a plurality of imaging devices 10 at the same height, or to adjust the angle of view. However, the information processing device 20 can also correct a subject of the same size to image data of the same size by image processing.

Each imaging device 10 may capture either still images or moving images. When capturing a still image, a motion sensor is provided in the imaging device 10, and a plurality of still images are captured only when the motion sensor detects a person. As a result, it is possible to reduce the waste of taking images in a situation where the care recipient 7 does not pass, and the image data of the top of the head while the care recipient 7 passes under the imaging device 10 can be obtained, and the information processing device 20 can be used as the care recipient. The passing direction of the person 7 can be determined. In the case of moving images, the information processing device 20 detects that the parietal region has been captured by image processing, and extracts the image data of the parietal region while passing under the imaging device 10 . In addition, the image capturing apparatus 10 may capture images periodically and, if there is a change in the image, capture a moving image for a certain period of time or until there is no change in the image. It is preferable to detect that the top of the head is captured by image processing for confirmation even in a still image.

In addition, as described above, the angle of view is set to such an extent that only the top of the head can be imaged when the cared person 7 passes right under the imaging device 10, thereby ensuring privacy. The focal length may be adjusted with a lens or the like, or the imaging device 10 may trim the central portion of the image data.

The excluded person registration image pickup device 11A is an image pickup device for registering image data of the top of the head of the staff in order to exclude the image data of the top of the head of the staff from the monitoring target. As a result, even if the staff passes the passing point P and the elapsed time exceeds the assumed travel time due to work or the like, it is possible to suppress the information processing device 20 from reporting (in the first place, the elapsed time of the excluded person is not measured). . The excluded person registration imaging device 11A is preferably arranged at a passage point P through which only the staff mainly passes, such as the entrance/exit of the staff's changing room, as will be described later.

The excluded person registration imaging device 11B is an imaging device for registering the image data of the parietal region of the visitor in order to exclude the image data of the parietal region of the visitor from the monitoring target. As a result, even if the elapsed time exceeds the expected travel time for the visitor to pass through the passing point P and have a conversation with the cared person 7 or the staff, it is possible to suppress the information processing device 20 from reporting (in the first place, Elapsed time is not measured for the excluded). The excluded person registration imaging device 11B is preferably arranged at a passing point P, such as a reception, through which a visitor must pass, as will be described later.

The image pickup device 12 at the boundary with the outside is an image pickup device that is arranged at a place (for example, the entrance) that is the boundary between the indoors and outdoors of the facility 5 . The imaging device 12 at the boundary with the outside is mainly an imaging device for monitoring the going out of the cared person 7, and the details will be described with reference to FIG.

The information processing device 20 controls the entire reporting system 100 . Image data of the top of the head is acquired from each imaging device 10, the imaging devices 11A and 11B for excluded person registration, and the imaging device 12 at the boundary with the outside. In the case of moving images or when periodic still images are captured, image data simply showing the floor surface may be received. Therefore, the information processing device 20 preferably has a function of determining whether or not the top of the head is captured.

The information processing device 20 registers the image data of the top of the head of the excluded person, determines whether the care recipient 7 or the excluded person, and compares the elapsed time and the assumed travel time in the case of the care recipient 7. , the portable terminal 50 is notified, and the alarm lamp 51 is turned on.

The information processing device 20 is a device such as a PC (Personal Computer) or a work station that executes a program and processes information. It may have server functions.

The information processing device 20 is arranged, for example, in a facility. Alternatively, it may be arranged on a cloud or the like. In the facility, it can be placed anywhere, but considering that the care recipient 7 does not carelessly touch it, it is placed in the management room 6 or the like where the staff waits.

The terminal device 40 is a device that displays monitoring information and a map of the facility, and is mainly used by staff members to confirm the safety of the care recipient 7 . The terminal device 40 may be a console type in which a display device (display) and an input device (keyboard, mouse, or touch panel) are connected to the information processing device 20 . In this case, application software is running in the information processing device 20, and a screen displaying monitoring information and a map of the facility is generated and displayed on the display device. Alternatively, the system may be constructed with the terminal device 40 as the client and the information processing device 20 as the server. In this case, the information processing device 20 and the terminal device 40 are connected via a network, the information processing device 20 runs a server program called a web application, and the terminal device 40 runs browser software. No matter where the terminal device 40 is located, it can be connected to the network and the staff can view the monitoring information and the map of the facility.

It should be noted that the terminal device 40 may be arranged outside as well as inside the facility. It may be placed in the control room 6 so that the staff can monitor it at any time, but the place of placement may be arbitrary. Also, a plurality of terminal devices 40 may be arranged.

The mobile terminal 50 is mainly carried by the staff, and is a terminal for receiving a report from the information processing device 20 when the elapsed time exceeds the assumed travel time. A terminal application is running on the mobile terminal 50 so that it can receive reports. If the terminal application receives emails using an email application or a browser, the report can be received by email. Also, if the terminal application is a dedicated application dedicated to the notification system 100, the notification can be received in the form of notification to the dedicated application.

The mobile terminal 50 is, for example, a smart phone, a mobile phone, a PDA (Personal Digital Assistant), a wearable PC (for example, wristwatch type, sunglasses type, etc.), but is not limited to these. The mobile terminal 50 can receive the report even if it is carried outside the facility or left at the staff's home.

The alarm lamps 51 are arranged at main locations in the facility, and are turned on under the control of the information processing device 20 . An alarm may be sounded along with the lighting.

<Arrangement example of passing point P>
Each passing point P of the facility will be described with reference to FIG. FIG. 3 shows an example of passing points P installed in facilities. The passing point P is a place where the imaging device 10, the imaging devices 11A and 11B for excluded person registration, and the imaging device 12 at the boundary with the outside are installed, so it may be called the setting place of the imaging device. As shown, the following locations are passing points P: Note that the numerical value in parentheses after the passing point Pn (n is the number of the passing point) is the code of the imaging device).
a. Entrance/exit of rooms A to I b. Entrance/exit of common facilities (toilet 98, bathroom 97, dining room 61, etc.) c. Corridor ends (one end and the other)
d. Entrance 65 (boundary with the outside)
e. Reception 64
f. Entrance/exit of the office 63 Among these, the passing points P of d, e, and f are specific passing points P, e, f are used to register the image data of the top of the head of the staff or the visitor, and d is It is used for determining whether or not the care recipient 7 should go out.

d. The passage point P31 of the entrance 65 (boundary with the outside) will be supplemented.
It is the staff or visitors who come and go, but since the visitors have already been registered with the imaging device 11B for exclusion registration at the reception 64, the image data of the top of the head captured by the imaging device 12 at the boundary with the outside is monitored. not subject to Since the staff does not pass through the reception 64, they are registered as a monitoring target, but if they enter the office 63 within a preset assumed travel time and are imaged by the excluded person registration imaging device 11A, they are excluded from the monitoring target. Also, when leaving the office 63, they are registered by the excluded person registration imaging device 11A. In other words, when it is judged as a staff, it is excluded from the monitoring target.
・It is staff or visitors who frequently go out from indoors to outdoors, but even if they are confirmed by the imaging device 12 at the boundary with the outside, they are excluded from monitoring targets in the first place, so they are not reported. .
・When it is confirmed by the imaging device 12 at the boundary with the outside that the care recipient 7 has gone out from indoors to outdoors, if there is only one person, it will be reported, and if there are multiple people including the excluded person, it will not be reported. is.

e. The passage point P32 of the reception 64 will be supplemented.
A visitor signs his/her name at the reception desk 64 and can enter the building when the door of the entrance 65 is unlocked by the receptionist. Therefore, the visitor must pass through the reception desk 64 . In the present embodiment, by utilizing this, a passing point P32 (excluded person registration imaging device 11B) is installed at the reception 64, and the image data of the top of the visitor's head is registered. The estimated travel time is not set for the passing point P32 of the reception 64, and the measurement of the elapsed time is not started.

f. The passage point P33 at the doorway of the office 63 will be supplemented.
The office 63 is a room mainly used by staff. The entrance/exit of the office 63 is a passage point P33 that the staff who come to work must pass through in order to press a time card or the like. In the present embodiment, this is utilized to set a passing point P33 (excluded person registration imaging device 11A) at the entrance/exit of the office 63, and to register the image data of the top of the head of the staff at the start of work. The estimated travel time is not set at the passage point P33 at the entrance/exit of the office 63, and the measurement of the elapsed time is not started.

The assumed travel time will be explained. Since the assumed travel time is the farthest passing point P among the passing points P that can be passed next to a certain passing point P, for example, taking the passing point P1 of the living room A as an example, the passing point P that can be passed next is the passing point P. These are points P1-3, P10, P11, P15, and P18. Of these points, the farthest point from the passing point P1 is the passing point P18, so the estimated travel time is set in consideration of the time required for the cared person 7 to move the distance from the passing point P1 to the passing point P18.

From this point of view, an assumed travel time is set for the passing points P1 to P21 and P31, except for the excluded person registration imaging devices 11A and 11B. The estimated travel time may be set by adding a margin α to the time when the cared person 7 moves the slowest. This makes it possible to suppress erroneous reporting.

For example, as can be seen from the passing point P10, the farthest passing point P differs depending on the passing direction, so the estimated travel time is set for each passing direction.

<Hardware configuration example>
FIG. 4 is a block diagram showing a schematic hardware configuration of the information processing device 20. As shown in FIG. Information processor 20 may be implemented generally as a personal computer, workstation, or appliance server. The information processing apparatus 20 includes a CPU 201 and a memory 202 that enables high-speed access to data used by the CPU 201 . CPU 201 and memory 202 are connected via system bus 203 to other devices or drivers of information processing apparatus 20 , such as graphics driver 204 and network driver (NIC) 205 .

An LCD (display device) 206 is connected to the graphics driver 204 and executes display instructions from the CPU 201 to display a screen. A touch panel may be integrated with the LCD 206 .

Also, the network driver 205 connects the information processing device 20 to the network N at the transport layer level and the physical layer level, and establishes a session with the communication partner.

Also connected to system bus 203 is I/O bus bridge 207 . A storage device such as an HDD 209 is connected to the downstream side of the I/O bus bridge 207 via an I/O bus 208 such as PCI via IDE, ATA, ATAPI, serial ATA, SCSI, USB, or the like. . An SSD (Solid State Drive) may be provided instead of or together with the HDD 209 .

The HDD 209 stores a program 209p that controls the information processing apparatus 20 as a whole. By executing the program 209p, the information processing device 20 accepts and learns the operation of the observer. The program 209p may be distributed from a program distribution server, or may be distributed while being stored in a portable storage medium such as a USB memory or an optical storage medium.

An input device 210 such as a keyboard and mouse (referred to as a pointing device) is connected to the I/O bus 208 via a bus such as USB, and receives inputs and commands from operators (for example, staff). .

The information processing device 20 may be compatible with cloud computing. Cloud computing is a form of usage in which resources on a network are used without being conscious of specific hardware resources.

Further, even if the hardware configuration diagram of the terminal device 40 and the portable terminal 50 is the same as or different from that of FIG. 4, it does not hinder the explanation of the present embodiment.

<About functions>
Next, functions of the information processing apparatus 20 will be described with reference to FIG. FIG. 5 is an example of a functional block diagram showing each function provided in the information processing apparatus 20 in a block form. The information processing device 20 includes an image data receiving unit 21, an image processing unit 22, an imaging device determination unit 23, an excluded person registration unit 24, an image search unit 25, an information registration unit 26, a time measurement unit 27, a screen information generation unit 28, And it has a reporting unit 29 . Each of these functions is a function or means implemented by the CPU 201 shown in FIG. It is not necessary to clearly distinguish functions implemented by hardware or software, and some or all of these functions may be implemented by hardware circuits such as ICs.

The information processing apparatus 20 also includes an estimated travel time DB 31 constructed from the memory 202 or the HDD 209 shown in FIG. part). These DBs do not have to be directly owned by the information processing device 20, and may be located anywhere on the network that the information processing device 20 can access. First, each DB will be described.

表１は、想定移動時間ＤＢ３１に記憶している想定移動時間情報を模式的に示す。想定移動時間情報は通過ポイントごとに予め設定された想定移動時間や通過ポイントＰが具体的にどの場所に対応するかなどの情報を有している。想定移動時間情報は、撮像装置ＩＤに対応付けて、通過方向ごとの想定移動時間を登録している。撮像装置ＩＤは撮像装置１０を一意に識別するための識別情報である。表１では、通過ポイントＰ１～Ｐ２１，Ｐ３１～Ｐ３３に対応させて、撮像装置ＩＤはＣ１～Ｃ２１，Ｃ３１～Ｃ３３を登録している。通過方向は通過ポイントＰを通過しうる方向であり主に２方向とするが３方向以上が存在してもよい（設置する撮像装置１０の数を減らすことができる）。通過方向ごとに想定移動時間が設定されている。また、居室のように「入」の方向では想定移動時間が不要なので、想定移動時間は設定していない（「－」を設定している）。居室以外の通過ポイントＰ（例えば廊下など）では通過方向が分かるように東西南北を設定している。通過方向は右左上下などを設定してもよい。

Table 1 schematically shows estimated travel time information stored in the estimated travel time DB 31 . The estimated travel time information includes information such as the estimated travel time set in advance for each passing point and the location to which the passing point P specifically corresponds. The estimated travel time information registers the estimated travel time for each passing direction in association with the imaging device ID. The imaging device ID is identification information for uniquely identifying the imaging device 10 . In Table 1, imaging device IDs C1 to C21 and C31 to C33 are registered in association with passing points P1 to P21 and P31 to P33. The passing direction is a direction in which the passing point P can be passed, and there are mainly two directions, but three or more directions may exist (the number of imaging devices 10 to be installed can be reduced). An assumed travel time is set for each passing direction. In addition, since the estimated travel time is not required in the direction of "in" as in the living room, the estimated travel time is not set ("-" is set). North, south, east and west are set so that the passing direction can be known at the passing points P (for example, corridors) other than living rooms. The direction of passage may be set to right, left, up, down, or the like.

表２は、除外者画像ＤＢ３２に記憶している除外者登録情報を模式的に示す。除外者登録情報は除外者（スタッフ又は来訪者）の頭頂部の画像データを登録した情報である。除外者登録情報は、頭頂部の画像データと撮像日時の各項目を有している。頭頂部の画像データは、時系列に登録されている。頭頂部の画像データはスタッフ又は来訪者が外出して一定時間が経過すると削除されることが好ましい。これにより、除外者画像ＤＢ３２の記憶領域が増大することを抑制できる。

Table 2 schematically shows excluded person registration information stored in the excluded person image DB 32 . Excluded person registration information is information in which image data of the top of the head of an excluded person (staff or visitor) is registered. The excluded person registration information has items of image data of the top of the head and imaging date and time. The image data of the parietal region is registered in chronological order. The image data of the top of the head is preferably deleted after a certain period of time has passed since the staff member or visitor left the office. Accordingly, it is possible to suppress an increase in the storage area of the excluded person image DB 32 .

表３は、監視情報ＤＢ３３に記憶している監視情報を模式的に示す。監視情報は被介護者７の一人一人を監視する（見守る）ための情報である。監視情報は、頭頂部の画像データ、通過ポイントＰ、通過方向、通過時刻、想定移動時間、経過時間、及び、最初の通過ポイントの各項目を有している。頭頂部の画像データは主に被介護者７のものであるが、外部との境界の撮像装置１２（通過ポイントＰ３１）で撮像されたスタッフの頭頂部の画像データが登録される場合がある。通過ポイントＰは頭頂部の画像データが最後に撮像された通過ポイントＰであり、通過方向は被介護者７が通過した方向である。通過時刻は頭頂部の画像データが撮像された撮像時刻又は受信した時刻である（日にちを登録してもよい）。想定移動時間は、想定移動時間ＤＢ３１において頭頂部の画像データを撮像した撮像装置１０に対応付けられている想定移動時間である。経過時間は、通過時刻をゼロとしてリアルタイムに測定されている経過時間である。経過時間は、同じ被介護者７が次の通過ポイントＰを通過するとゼロになる。最初の通過ポイントは、当該頭頂部の画像データが最初に撮像された通過ポイントＰである。

Table 3 schematically shows monitoring information stored in the monitoring information DB 33 . The monitoring information is information for monitoring (watching over) each care recipient 7 . The monitoring information includes items of image data of the top of the head, passing point P, passing direction, passing time, assumed movement time, elapsed time, and first passing point. The image data of the parietal region is mainly that of the cared person 7, but the image data of the parietal region of the staff imaged by the imaging device 12 (passing point P31) at the boundary with the outside may be registered. The passing point P is the passing point P at which the image data of the top of the head was captured last, and the passing direction is the direction in which the cared person 7 passed. The passing time is the imaging time when the image data of the top of the head is captured or the time when the data is received (the date may be registered). The estimated travel time is the estimated travel time associated with the imaging device 10 that captured the image data of the top of the head in the estimated travel time DB 31 . The elapsed time is the elapsed time measured in real time with the passage time being zero. The elapsed time becomes zero when the same cared person 7 passes through the next passing point P. The first passing point is the passing point P at which the image data of the parietal region is first captured.

Note that the image data of the parietal region may be updated each time the image data of the parietal region of the same cared person 7 is imaged at the next passing point P, or (entrance/exit) may be stored, or image data of all parietal regions of the same cared person 7 may be stored in association with each other. In the present embodiment, it is assumed that the image is updated each time the next passing point P is imaged. As a result, the latest image data of the top of the head is registered even if the hairstyle or the like gradually deteriorates, so that it is easy to determine that the same cared person 7 is the same.

Returning to FIG. 5, description will be made. The image data receiving unit 21 receives the imaging device ID and the image data of the top of the head from the imaging device 10 at the passing point P, the imaging devices 11A and 11B for excluded person registration, and the imaging device 12 at the boundary with the outside. The imaging device ID may be the passing point P. A plurality of pieces of image data of the top of the head are transmitted from one imaging device 10 so that the passing direction can be known.

The image processing section 22 performs image processing on the image data received by the image data receiving section 21 . First, the passing direction is determined, which will be described in detail with reference to FIG. Further, for example, a process of correcting so that the brightness that differs depending on the imaging device 10 is equal, a process of correcting so that objects of the same size appear in the same size, a process of making the passage direction northward (that is, the face faces upward). ), and so on. Alternatively, the image data of the parietal region may be learned by machine learning or the like, and it may be determined whether or not the parietal region is captured, and only the image data in which the parietal region is captured may be passed to the subsequent stage. Furthermore, the range in which the top of the head is captured in the image data may be enclosed by a rectangle or the like to shorten the time for comparison processing, which will be described later.

The imaging device determination unit 23 determines whether or not the image data image-processed by the image processing unit 22 is the image captured by the imaging devices 11A and 11B for excluded person registration based on the imaging device ID. The image data of the parietal region captured by the imaging devices 11A and 11B for excluded person registration is sent to the excluded person registration unit 24, and the other image data of the parietal region is sent to the image search unit 25.

The excluded person registration unit 24 registers the excluded person registration information in the excluded person image DB 32 . That is, the image data of the top of the head of the excluded person (staff or visitor) and the imaging date and time are registered in the excluded person image DB 32 .

The image search unit 25 searches the parietal image data in the excluded person image DB 32 and the monitoring information DB 33 using the real-time parietal image data sent from the imaging device determination unit 23 . The image data of the parietal region hit (matched) in the search of the excluded person image DB 32 is that of the staff or the visitor, and the image data of the parietal region that is hit in the search of the monitoring information DB 33 is that of the cared person 7. . Also, the image data of the top of the head that is not registered in either of the two is to be newly registered in the monitoring information DB 33 .

As a search method, for example, there is a method of narrowing down the parietal region having approximately the same vertical and horizontal sizes and performing pattern matching. When the imaging device 10 captures color image data, color histograms can be created and compared. Alternatively, feature points such as SIFT (Scale Invariant Feature Transform) may be detected and the feature points may be compared.

The information registration unit 26 registers in the monitoring information DB 33 the image data of the top of the head that is not registered in either the excluded person image DB 32 or the monitoring information DB 33 . Along with the image data of the top of the head, the passing point P, passing direction, passing time, assumed moving time, elapsed time, and first passing point P are registered. The initial value of elapsed time is zero. In addition, when the image data of the parietal region already registered in the monitoring information DB 33 is captured (when the search hits), the image data of the parietal region, passing point P, passing direction, passing time, estimated travel time, and , to update the elapsed time.

The time measurement unit 27 measures time and updates the elapsed time in the monitoring information DB 33 as time passes.

The reporting unit 29 periodically compares the estimated travel time in the monitoring information DB 33 with the elapsed time, and notifies the portable terminal 50 and/or lights the alarm lamp 51 when the elapsed time exceeds the expected travel time. Since the passing point P and the passing direction are known, the last passed passing point P and the passing direction are reported at the time of notification. Also, when making a report, it is preferable to transmit a map of the facility generated by the screen information generation unit 28 . As a result, the staff can quickly identify the place where the person to be cared 7 is unable to move due to a fall or the like, and can rush to the place. In addition, when the cared person 7 leaves the passing point P31 of the boundary with the outside, the reporting unit 29 reports only when a predetermined condition is satisfied. Details will be described with reference to FIG. 14 and the like.

The screen information generation unit 28 generates screen information displayed by the terminal device 40 using the monitoring information in the monitoring information DB 33 . For example, it generates screen information that displays the monitoring information itself in the form of a list. Further, the same determination as that of the reporting unit 29 is made, and if it is determined to report, screen information for displaying the passing point P passed last and the passing direction on a map of the facility as shown in FIG. 3 is generated. As a result, the staff can visually grasp the place where the cared person 7 is likely to exist, even if the place is difficult to understand only by the number of the passing point P.

<Determination of Passing Direction>
Determination of the passing direction of the cared person 7 based on the image data of the top of the head will be described with reference to FIG. FIG. 6 is an example of a diagram for explaining a method of determining the passing direction of the cared person 7. As shown in FIG. The image data of the top of the head in FIGS. 6(a) to (c) show how the top of the head of the same cared person 7 is imaged over time at certain passing points.

FIG. 6A shows an example of image data in which the top of the head begins to appear in the angle of view of the imaging device 10. FIG. Since the angle of view of the imaging device 10 is narrow, the top of the head is not captured until the care recipient 7 comes close to directly below. The image processing unit 22 determines the center of gravity G of the changed area by, for example, taking the difference between the image data before the image changes (image data showing the floor) and the image data after the change.

FIG. 6B shows an example of image data in which the top of the head is captured at the center of the angle of view of the imaging device 10 . That is, the cared person 7 has moved directly below the imaging device 10 . The image processing unit 22 can similarly determine the center of gravity G. FIG. FIG. 6(c) shows an example of image data in which the top of the head is captured in a state that is likely to be out of the angle of view of the imaging device 10. FIG. The cared person 7 is about to pass under the imaging device 10 . The image processing unit 22 can similarly determine the center of gravity G. FIG.

In this manner, the image processing unit 22 determines the center of gravity G of the parietal region in the time-series image data of the parietal region, and approximates it to a straight line by the method of least squares or the like. By breaking down the length of a straight line into horizontal (east-west) and vertical (north-south) directions and determining which component is longer, the direction of passage can be determined. Alternatively, it may simply be determined by which direction of the north, south, east, and west the top of the head appears and in which direction it disappears.

<Operation procedure>
Next, the processing flow of the information processing device 20 will be described with reference to FIG. FIG. 7 is a flow chart for explaining an example of processing performed by the information processing apparatus 20 until notification is made based on the image data of the top of the head. The processing in FIG. 7 is repeatedly executed while the reporting system 100 is in operation.

In step S1, the image data receiving section 21 receives image data. In step S2, the image processing unit 22 determines whether or not the image data is the top of the head. In the case of the image data of the top of the head, the image processing unit 22 performs the above image processing. If it is not the image data of the top of the head, the process proceeds to step S16.

If the image data is of the top of the head, in step S3, the imaging device determination unit 23 determines whether or not the passing point P of the boundary with the outside has been left, based on the imaging device ID and the passing direction transmitted together with the image data. to decide. If the determination in step S3 is Yes, the going-out process in step S4 is executed. The going-out processing will be described with reference to FIG.

If the determination in step S3 is No, in step S5, the imaging device determination unit 23 determines whether or not the passing direction is the predetermined direction in the image data captured by the excluded person registration imaging devices 11A and 11B together with the image data. The determination is made based on the transmitted imaging device ID and the passing direction detected by the image processing unit 22 . This predetermined direction is the direction in which the image data of the top of the head imaged by the imaging device 11A for excluded person registration comes out of the office 63 . In other words, it is decided whether or not to work from now on. Although the passing direction in the imaging device for excluded person registration 11B at the reception 64 is determined to be the direction of moving indoors, the passing direction may be determined also in the imaging device for excluded person registration 11B.

If the determination in step S5 is Yes, in step S6, the excluded person registration unit 24 registers the image data of the top of the head of the excluded person and the imaging date and time in the excluded person image DB 32 .

If the determination in step S5 is No, in step S7, the image search unit 25 searches the excluded person image DB 32 and the monitoring information DB 33 with the image data of the top of the head received by the image data reception unit 21 . It should be noted that if a search hit is found in either the excluded person image DB 32 or the monitoring information DB 33, the other DB does not need to be searched. Also, which one may be searched first.

In step S8, as a result of the search, the image search unit 25 determines whether or not the person is an excluded person (whether there is a hit in the excluded person image DB 32). In the case of an excluded person, the process proceeds to step S9.

If the person is an excluded person, the information registration unit 26 ends the monitoring in step S9. In this case, there is a possibility that the staff member (or a visitor due to some mistake) may have been registered in the monitoring information DB 33 by the imaging device 12 at the boundary with the outside when he/she came to work. For the staff member registered as a monitoring target, if the staff member enters the office 63 within the estimated travel time set in advance and is imaged by the imaging device 11A for exclusion registration, the information registration unit 26 retrieves the image of the top of the head from the monitoring information DB 33. Data, passing point P, passing direction, passing time, assumed travel time, and elapsed time are deleted. Alternatively, it is possible to register that the data is not to be monitored while leaving the data.

If the person is not an excluded person, in step S10, the image search unit 25 determines whether or not the image data is a new parietal region. That is, it is determined whether or not the image data is the top of the head that is not registered in the excluded person image DB 32 or the monitoring information DB 33 .

If it is new parietal image data, the information registration unit 26 registers the parietal image data in the monitoring information DB 33 in step S11.

Then, in step S12, the information registration unit 26 acquires the passing point P and the assumed traveling time from the assumed traveling time DB 31 based on the imaging device ID transmitted together with the image data, the passing direction determined by the image processing unit 22, the image The passing time at which the data was received (or the time at which the image was captured) and the elapsed time (initial value of zero) are registered in the monitoring information DB 33 . As for the elapsed time in the monitoring information DB 33, the time measurement unit 27 increases the elapsed time associated with the image data of the parietal region at regular intervals asynchronously with the reception of the image data of the parietal region.

On the other hand, if the image data of the top of the head is not new (if the search hits in the monitoring information DB 33), the information registration unit 26 registers the image data of the top of the head received by the image data receiving unit 21 in the monitoring information DB 33 in step S13. update the image data of the top of the head. In addition, the information registration unit 26 registers the passing point P and the estimated travel time associated with the image data of the top of the head hit in the monitoring information DB 33 based on the imaging device ID transmitted together with the image data. is updated with the passing point P acquired from and the assumed travel time. Similarly, the passing direction is updated with the passing direction determined by the image processing unit 22 . Similarly, the passing time is updated. It also initializes the elapsed time to zero.

Further, in step S14, the information registration unit 26 determines whether or not the cared person 7 has returned to the living room. This determination is made based on whether or not the passing point P associated with the hit parietal image data in the monitoring information DB 33 is the same as the first passing point P and the passing direction is "on". If the user has not returned to the living room, the process proceeds to step S16.

When the user returns to the living room, the information registration unit 26 ends the monitoring in step S15. The information registration unit 26 deletes the image data of the top of the head, the passing point P, the passing direction, the passing time, the estimated moving time, and the elapsed time from the monitoring information DB 33 . Alternatively, it is possible to register that the data is not to be monitored while leaving the data.

In step S16, the reporting unit 29 determines whether or not there is a cared person 7 whose elapsed time has exceeded the estimated travel time.

If there is a care-receiver 7 whose elapsed time exceeds the estimated travel time corresponding to the threshold, in step S17, the reporting unit 29 determines that the location of the care-receiver 7 is a predetermined location, and that a plurality of care-receivers Determine if 7 is present. Even if the elapsed time exceeds the expected travel time, the passing point associated with the image data whose elapsed time exceeds the expected travel time is related to a predetermined place, and the predetermined passing direction is When image data associated with the same passing point and passing direction as the image data is stored in the monitoring information DB 33, apart from the image data whose elapsed time exceeds the assumed travel time, is stored in the monitoring information DB 33. The reporting unit 29 does not report. A predetermined place is a place where a plurality of care recipients 7 stay for a long time, such as a dining room or a common room. Moreover, the reason why there must be a plurality of cared persons 7 is that one of them can notify an abnormality in an emergency. By doing this, even if the elapsed time at the stopover destination is longer than the estimated travel time, no report is made, and erroneous reports can be suppressed.

The reporting unit 29 determines that the passage point P of the care-receiver 7 satisfying the elapsed time>assumed travel time in the monitoring information DB 33 is a predetermined location (whether or not it is a predetermined location is registered in the expected travel time DB 31) and the passing direction is It is judged whether it is "on" or not. When the passing point P is a predetermined place and the passing direction is "ON", the monitoring information DB 33 is searched to see if there is another cared person 7 who is the same passing point P and the passing direction is "ON".

If the place where the care receiver 7 is located is not a predetermined place, or if there are not a plurality of care receivers 7, the reporting unit 29 reports in step S18. For example, the passing point P and the passing direction are specified and notified.

In step S<b>19 , the excluded person registration unit 24 determines whether the excluded person information for which a predetermined time has passed since going out is registered in the excluded person image DB 32 .

If the excluded person information after the predetermined time has passed is registered in the excluded person image DB 32, the excluded person registration unit 24 deletes the excluded person information after the predetermined time has passed from the excluded person image DB 32 in step S20. As for the visitor's excluded person information, the visitor's excluded person information may be deleted from the excluded person image DB 32 at the end of the visitation time.

With the above-described processing, it is possible to watch over the cared person 7 moving smoothly in the facility while maintaining privacy by the image data of the top of the head.

<Movement example and monitor information DB transition example>
An example of the operation of the notification system will be described by assuming several examples of movement.

<<In the case of a care recipient>>
FIG. 8 shows an example of movement of the cared person 7 within the facility, and FIG. 9 shows an example of transition of the monitoring information DB 33. As shown in FIG. As shown in FIG. 8, the cared person 7 in the living room A left the living room A (passing point P1), passed through the passing points P18 and P19, and stayed in the cafeteria. After that, he returned to room A through passing points P19, P18, and P1.

FIG. 9(a) shows monitoring information registered immediately after passing through the passing point P1 and leaving the living room A. FIG. Passing point P1, passing direction "out", passing time "13:15", assumed travel time "5 minutes", elapsed time "0", and first passing point P1 are registered.

FIG. 9(b) shows monitoring information when the cared person 7 has reached a point just before the passing point P18. Only the elapsed time is updated and "60 seconds" is registered. Therefore, since the elapsed time does not exceed the estimated travel time, no report is made.

FIG. 9(c) shows the monitoring information registered immediately after passing the passing point P18. Passing point P18, passing direction "south", passing time "13:17", assumed travel time "3 minutes", elapsed time "0", and first passing point P1 are registered.

FIG. 9(d) shows monitoring information when the cared person 7 has reached just before the passing point P19. Only the elapsed time is updated and "15 seconds" is registered. Therefore, since the elapsed time does not exceed the estimated travel time, no report is made.

FIG. 9(e) shows monitoring information registered immediately after passing the passing point P19. Passing point P19, passing direction "on", passing time "13:18", assumed travel time "30 minutes", elapsed time "0", and first passing point P1 are registered.

FIG. 9(f) shows monitoring information of a state in which the cared person 7 stays in the cafeteria for a long time. Only the elapsed time is updated and "31 minutes" is registered. Although the elapsed time has exceeded the estimated travel time, there is another care recipient 7 in the cafeteria, so no report is made.

FIG. 9(g) shows monitoring information registered immediately after passing through the passing point P19 in the exit direction. Passing point P19, passing direction "out", passing time "14:00", assumed travel time "3 minutes", elapsed time "0", and first passing point P1 are registered.

After that, it is assumed that the cared person 7 passes through the passing point P18 and reaches the passing point P1.

FIG. 9(h) shows monitoring information registered immediately after passing through the passing point P1 in the entering direction. Passing point P1, passing direction "on", passing time "14:05", assumed travel time "-", elapsed time "0", and first passing point P1 are registered.

Passing point P1 is the first passing point P at which behavior monitoring is started, and corresponds to living room A of cared person 7. Therefore, it is determined that cared person 7 has returned to living room A, and monitoring ends.

<<For visitors>>
FIG. 10 shows an example of a visitor's movement within the facility, and FIG. 11 shows an example of registration in the excluded person image DB 32. As shown in FIG. As shown in FIG. 10, the visitor completed the reception at the reception (passing point P32), passed through points P31, P21, and P8, and entered room H. After finishing his business with the care recipient 7 in the living room H, he passed through the passage points P8, P21, and P31 and went outside.

FIG. 11A shows excluded person information captured by the excluded person registration imaging device 11A and registered in the excluded person image DB 32 as the visitor passes through the reception (passing point P32). In this way, image data of the top of the head captured by the imaging device 11B for excluded person registration is registered in the excluded person image DB 32 . Since the visitor is registered in the excluded person image DB 32, even if the visitor passes through the passing points P31, P21, and P8, the visitor is not registered in the monitoring information DB33.

When the visitor passes through the passing points P8, P21, and P31 alone, the passing point P31 is the passing point P on the border with the outside, and the visitor has gone out, so the going-out process is performed. Visitors are allowed to go out alone in general facilities, so reporting is not done. As shown in FIG. 11(b), the excluded person registration unit 24 registers the outing date and time in the excluded person image DB 32. FIG. For example, the excluded person registration unit 24 deletes the image data of the top of the visitor's head registered at the meeting end time from the excluded person image DB 32, or deletes the image of the top of the visitor's head after a predetermined time has passed since the visitor went out. If the data is registered, the image data of the parietal region of the visitor is deleted from the excluded person image DB 32 . With such processing, there is no need to register images again when the visitor temporarily goes out.

When it is detected that the visitor has left the passing point P31, the excluded person registration unit 24 may immediately delete the image data of the parietal region of the visitor from the excluded person image DB32. In this case, even if the visitor temporarily goes out, it is necessary to pass through the reception again, but there is an advantage that security can be improved.

When the cared person 7 passes through the passing point P31 to the outside by himself, the going-out process is also performed. Since the cared person 7 is not allowed to go out alone in general facilities, the notification is made.

When the visitor and the cared person 7 both pass through the passing point P31 to the outside, the going-out process is also performed. Since the visitor and the cared person 7 are allowed to go out in general facilities, no report is made. When the image data of the top of the head imaged by the imaging device 12 at the boundary with the outside belongs to the cared person 7, the reporting unit 29 detects the image data of the top of the head of the visitor at about the same time as the outside. It is determined whether or not an image has been captured by the imaging device 12 at the boundary. As a result, when the care recipient 7 goes out alone at the passing point P31 on the boundary with the outside, it is possible to report, and when the care recipient 7 and the visitor pass through the passing point P31 to the outside, erroneous reporting is suppressed. can.

<<For staff>>
FIG. 12 shows an example of staff movement within the facility, and FIG. 13 shows an example of registration in the monitoring information DB 33 . As shown in FIG. 12, staff members pass through points P31 and P33 to enter the office when they go to work. After changing clothes, etc., the worker passes through the passing point P33 in the direction of leaving and starts working.

FIG. 13(a) shows monitoring information registered immediately after the staff passes the passing point P31. Passing point P31, passing direction "on", passing time "8:30", assumed travel time "5 minutes", elapsed time "0", and first passing point P31 are registered. Thus, since the passing point P31 is not the excluded person registration imaging device 11A or 11B, the information registration unit 26 registers the monitoring information in the monitoring information DB33.

FIG. 13(b) shows monitoring information registered immediately after the staff passes the passing point P33. Passing point P33, passing direction "on", passing time "8:31", assumed travel time "-", elapsed time "0", and first passing point P31 are registered.

The passing point P33 is the passing point P at the entrance of the office through which only the staff pass, and since the staff passed in the direction of entering the passing point P33 (excluded person registration imaging device 11A), it is determined that the staff has come to work, End monitoring.

Next, the staff passed through the passing point P33 in the direction of exiting. Since the staff member has passed through the passing point P33 (excluded person registration imaging device 11A), the image data of the top of the staff member's head is registered in the excluded person image DB 32 .

When the staff member passes through the passing point P31 for work and is temporarily outside, the date and time of going out is registered in the excluded person image DB 32 as shown in FIG. 11(b). Therefore, it is possible to maintain the state in which the excluded person information is registered in the excluded person image DB 32 for a short period of time. Further, when the staff member leaves the office, the excluded person information is deleted from the excluded person image DB 32 after a predetermined period of time (for example, 8 hours) has elapsed. Even if it is not deleted, new excluded person information can be registered by passing through the passing point P33 (excluded person registration imaging device 11A) in the exit direction.

<Outside processing>
FIG. 14 is an example of a flowchart for explaining the going-out process. The process of FIG. 14 starts when it is determined that the staff, visitor, or care recipient 7 has left the passing point P31 of the boundary with the outside.

First, in step S21, the image search unit 25 searches the excluded person image DB 32 with the image data of the top of the head imaged by the imaging device 12 at the boundary with the outside, and determines whether or not the excluded person has gone out.

When the excluded person goes out, the excluded person registration unit 24 registers the date and time of going out in the excluded person image DB 32 in step S22.

Next, in step S23, the image search unit 25 searches the monitoring information DB 33 with the image data of the top of the head imaged by the imaging device 12 at the boundary with the outside, and determines whether or not the cared person 7 has gone out.

When the cared person 7 has gone out, in step S24, the image search unit 25 determines whether the excluded person and the cared person 7 have gone out at substantially the same time. For example, it is determined whether the outside date and time of the excluded person is registered within one minute after the imaging device 12 at the boundary with the outside captures the image data of the top of the head of the care recipient 7 .

When only the cared person 7 goes out, the reporting unit 29 reports in step S25. If the excluded person and the cared person 7 go out at approximately the same time, the reporting unit 29 does not report. By such processing, it is possible to report that only the care recipient 7 goes out, and not to report that the care recipient 7 goes out with the excluded person.

<Report example>
Next, the content of the report displayed by the mobile terminal 50 or the terminal device 40 will be described with reference to FIG. FIG. 15 is a diagram showing an example of a screen displayed by the mobile terminal 50 or the terminal device 40 at the time of notification. FIG. 15(a) shows a report screen 300 displayed by the mobile terminal 50. FIG. As shown in FIG. 15( a ), the report screen 300 displays the last passing point P (reference numeral 301 ), passing direction 302 , place 303 and passing time 304 . The place 303 is information in the remark column associated with the passing point P in the estimated travel time DB 31 . The last passing point P ( 301 ), passing direction 302 and passing time 304 are registered in the monitoring information DB 33 . The staff can see the report screen 300 and can narrow down the place where the cared person 7 is by the last passing point P and the passing direction, and can quickly rush to the place where the cared person 7 is.

FIG. 15(b) is an example of the report screen 310 displayed by the terminal device 40. FIG. On the report screen 310, the last passing point P (reference numeral 311) is highlighted on the map of the facility, and an arrow 312 indicating the passing direction, the place 313 (hatched portion), and the passing time 314 are clearly indicated. It is The location 313 is emphasized by diagonal lines or the like. An icon 315 of the cared person 7 is also displayed at the location 313 . As a result, the staff can visually grasp the place where the care-receiver 7 is, and can quickly rush to the place where the care-receiver 7 is.

<Summary>
As described above, the reporting system 100 of this embodiment has the following effects. Since the cared person 7 becomes a monitoring target only by passing through the passing point P, there is no need to input a destination or the like, and the operation of the reporting system 100 is less burdensome. Since the imaging device 10 has a narrow angle of view, the privacy of the cared person 7 can be ensured. In addition, it is possible to immediately identify where the cared person 7 is. In addition, even if the cared person 7 stops at an arbitrary place, the cared person 7 can act freely without being notified.

In addition, since the image data of the parietal region is registered when the excluded person goes to work or visits the person, and when the care recipient 7 leaves the room, there is no need to register the image data of the parietal region in advance. It can also accommodate changes in hairstyles.

<Other application examples>
Although the best mode for carrying out the present invention has been described above using examples, the present invention is by no means limited to such examples, and various modifications can be made without departing from the scope of the present invention. and substitutions can be added.

For example, in the present embodiment, an example of watching over the cared person 7 inside the facility has been described, but the range of the facility may include not only indoors but also outdoors. For example, a passing point can be set in a courtyard or the like.

Also, the facility is not limited to one floor, and may span multiple floors. In this case, monitoring points are installed in stairs and elevators.

Also, although it has been described that the estimated travel time is set in advance, the estimated travel time may be automatically updated based on the maximum value of the actual travel time of the care-receiver 7 . For example, it is determined to be 1.5 times the maximum value. This makes it possible to set a practical assumed travel time.

Moreover, a plurality of information processing apparatuses 20 may exist, and the functions of the information processing apparatuses 20 may be distributed across the plurality of information processing apparatuses.

Further, the configuration examples such as FIG. 5 are divided according to main functions in order to facilitate understanding of the processing by the information processing apparatus 20 . The present invention is not limited by the division method or name of the unit of processing. The processing of the information processing device 20 can also be divided into more processing units according to the content of the processing. Also, one processing unit can be divided to include more processing.

5 Facility 7 Cared Person 10 Imaging Device 11 Imaging Device for Excluded Person Registration 20 Information Processing Device 100 Reporting System

Claims (10)

A reporting system comprising a plurality of imaging devices installed with their optical axes directed downward in a vertical direction at a passing point through which a person passes, and an information processing device communicating with the plurality of imaging devices,
The information processing device is
an image data receiving unit that receives image data of the parietal region of a person who has passed through the passing point from the imaging device;
a first storage unit for storing the image data of the parietal region received by the image data receiving unit, the passing point at which the image data of the parietal region was captured, and the elapsed time after passing the passing point;
an image search unit for searching the image data of the parietal region stored in the first storage unit from the image data of the parietal region received by the image data receiving unit;
When image data matching the image data of the parietal region received by the image data receiving unit is stored in the first storage unit, the image data is stored in the first storage unit in association with the image data of the parietal region. an information registration unit that initializes the elapsed time of
a reporting unit that, when the elapsed time exceeds a threshold, specifies and reports the passing point associated with the elapsed time exceeding the threshold;
A reporting system characterized by having When image data matching the parietal image data received by the image data receiving unit is not stored in the first storage unit,
2. The information registration unit according to claim 1, wherein the information registration unit registers, in the first storage unit, the image data of the top of the head, the passing point where the image data was captured, and the initial value of the elapsed time. reporting system. an image processing unit for detecting a passing direction of a person at the passing point based on the parietal image data received by the image data receiving unit;
When it is detected that a person has passed in a predetermined passing direction at a predetermined passing point, the information registration unit deletes the image data of the top of the head from the first storage unit. 3. The notification system according to item 1 or 2. The information registration unit picks up the image data of the parietal region each time the image data of the parietal region that is the same as the image data of the parietal region stored in the first storage unit is received by the image data receiving unit. 4. The notification system according to any one of claims 1 to 3, characterized in that the determined passing point is associated with the image data of the top of the head and registered in the first storage unit. The threshold value is set according to the distance from each passing point to the farthest passing point among one or more passing points that can be passed next. A notification system according to any one of the preceding claims. Even if the elapsed time exceeds the threshold,
in the first storage unit, the passing point associated with the image data for which the elapsed time exceeds a threshold is related to a predetermined place and is associated with a predetermined passing direction;
When image data associated with the same passing point and passing direction as the image data is stored in the first storage unit separately from the image data for which the elapsed time exceeds the threshold,
The reporting system according to any one of claims 3 to 5, characterized in that said reporting unit does not report. The image data receiving unit receives the image data of the parietal region and the identification information of the imaging device that captured the image data of the parietal region,
an imaging device determination unit that determines whether or not the imaging device is an excluded person registration imaging device for which identification information of the imaging device is set in advance;
When the imaging device determination unit determines that the imaging device is the imaging device for excluded person registration for which the identification information of the imaging device is set in advance, the image data receiving unit receives from the imaging device for excluded person registration having an excluded person registration unit for registering the top image data in the second storage unit;
The image search unit further searches the second storage unit for image data of the top of the head received by the image data reception unit from the imaging device,
When image data matching the image data of the top of the head received by the image data receiving unit from the imaging device is stored in the second storage unit,
The information registration unit stores the image data of the top of the head received from the imaging device by the image data reception unit, the passing point where the image data was captured, and the initial value of the elapsed time in the first storage unit. 7. The notification system according to any one of claims 1 to 6, characterized in that registration is not performed. When at least one of a plurality of parietal image data captured at approximately the same imaging time in the direction of leaving the passing point of the boundary with the outside is stored in the second storage unit, the reporting unit does not report. 8. The reporting system according to claim 7, characterized by: An information processing device that communicates with a plurality of imaging devices installed with their optical axes directed downward in a vertical direction at a passing point through which a person passes,
an image data receiving unit that receives image data of the parietal region of a person who has passed through the passing point from the imaging device;
a first storage unit that stores the image data of the parietal region received by the image data receiving unit, a passing point at which the image data of the parietal region was captured, and the elapsed time after passing through the passing point;
an image search unit for searching the image data of the parietal region stored in the first storage unit from the image data of the parietal region received by the image data receiving unit;
When image data matching the image data of the parietal region received by the image data receiving unit is stored in the first storage unit, the image data is stored in the first storage unit in association with the image data of the parietal region. an information registration unit that initializes the elapsed time of
a reporting unit that, when the elapsed time exceeds a threshold, specifies and reports the passing point associated with the elapsed time exceeding the threshold;
An information processing device comprising: An information processing device that communicates with a plurality of imaging devices that are installed with their optical axes directed downward in the vertical direction at a passing point through which a person passes,
an image data receiving unit that receives image data of the parietal region of a person who has passed through the passing point from the imaging device;
a first storage unit for storing the image data of the parietal region received by the image data receiving unit, the passing point at which the image data of the parietal region was captured, and the elapsed time after passing the passing point;
an image search unit for searching the image data of the parietal region stored in the first storage unit from the image data of the parietal region received by the image data receiving unit;
When image data matching the image data of the parietal region received by the image data receiving unit is stored in the first storage unit, the image data is stored in the first storage unit in association with the image data of the parietal region. an information registration unit that initializes the elapsed time of
When the elapsed time exceeds a threshold, a reporting unit that specifies and reports the passing point associated with the elapsed time that exceeds the threshold,
A program to function as

Images