JP7571398B2 - Information processing device, monitoring system, and control program - Google Patents

Description

The present invention relates to an information processing device, a monitoring system, and a control program. In particular, the present invention relates to an information processing device, a monitoring system, and a control program for providing care to a care recipient.

In facilities such as hospitals and elderly care facilities, those receiving care may fall while walking or fall out of bed and injure themselves. For this reason, development is underway of a system that constantly monitors the condition of those receiving care so that nurses and caregivers can rush to their aid when they find themselves in such a situation.

In the care support system disclosed in Patent Document 1 as such a system, when a caregiver detects an abnormality in a care recipient or a situation requiring care, the caregiver can select a notification method according to the level of importance, such as seriousness, urgency, and danger. In addition, in this care support system, the detection level is set according to the ability level of each care recipient in terms of basic movements, and the caregiver selects the notification method according to the characteristics of the care recipient.

JP 2001-307257 A

However, in the care system disclosed in Patent Document 1, although the staff (caregivers) can select the notification method according to the characteristics of the person being cared for, it is up to the individual staff member to utilize their experience in providing care in future cases. As a result, inappropriate notification messages continue to be sent without being corrected, and as a result, unnecessary messages are sent when they are not necessary. If such unnecessary notifications are sent frequently, there is a problem that the mental and physical burden on the staff increases. Conversely, if a notification is not sent when it is necessary, it may lead to a serious accident, and there is a high possibility that the responsibility will fall on the individual staff member who responded when a problem occurs, and the staff member will be constantly under pressure to receive a large number of notifications and respond appropriately, which places a heavy mental and physical burden on them.

The present invention has been made in consideration of the above circumstances, and aims to provide an information processing device, a monitoring system, and a control program that can link and store response results for an event with information related to the event, thereby enabling the user to grasp information about which events are receiving the most responses and use this information to improve care.

The above object of the present invention is achieved by the following means:

(1) an acquisition unit that acquires event information regarding an event requiring care;
a transmitter that transmits to a first terminal the event information and a feedback request that requests the first terminal to feed back whether a determination regarding the event information is a correct determination or an incorrect determination;
a receiving unit that receives a response regarding the suitability of the determination regarding the event information from the first terminal;
an accumulation processing unit that associates the answer with the event information including information about the care recipient and stores the answer in a storage unit;
Equipped with
The event information stored in association with the response includes state information on which the event was determined,
The condition information includes a record of care provided to the care recipient;
The information processing device further comprises a determination unit that determines that the event has occurred based on a change in the care record within a predetermined period of time .

(2) The information processing device according to (1) above, which is provided with a display unit that displays the answers accumulated and stored in the memory unit for each piece of event information.

( 3 ) The status information includes an output from a detection unit that detects the movement of the care recipient in an observation area associated with the care recipient, and a call signal of a care call by the care recipient;
The information processing device according to (1) or (2), wherein the types of events include the care recipient getting up, getting out of bed, and falling from a bed in the observation area determined by an output from the detection unit , as well as a care call by the care recipient .

( 4 ) The information processing device according to any one of (1) to ( 3 ), wherein the receiving unit receives additional information regarding the care of the care recipient as the response.

( 5 ) The information processing device according to any one of (1) to ( 4 ) above, wherein the first terminal includes a staff terminal used by staff providing care to the care recipient.

( 6 ) The information processing device according to ( 5 ) above, wherein the first terminal includes an information manager terminal used by an information manager who gives instructions to the staff.

( 7 ) The transmission unit transmits the event information and the feedback request to the information manager terminal,
the receiving unit accepts the response to the feedback request and the instruction received from the information manager terminal;
The transmission unit transmits the instruction received from the information manager terminal to the staff member,
The information processing device according to ( 7 ) above, wherein the accumulation processing unit associates the response from the information manager received by the receiving unit with the event information and stores the response in the memory unit.
( 8 ) An acquisition unit that acquires event information regarding an event requiring care;
A transmission unit that transmits the event information to a first terminal;
a receiving unit that receives a response regarding the appropriateness of a determination regarding the event information and/or a response result from the first terminal;
an accumulation processing unit that associates the answer with the event information including information about the care recipient and stores the answer in a storage unit;
Equipped with
The event information stored in association with the response includes state information on which the event was determined,
The condition information includes a record of care provided to the care recipient;
The information processing device further comprises a determination unit that determines that the event has occurred based on a change in the care record within a predetermined period of time.

( 9 ) A detection unit that detects a movement of the care recipient in an observation area corresponding to the care recipient;
An information processing device according to any one of (1) to ( 8 ) above;
A monitoring system comprising one or more staff terminals.

(10 ) acquiring event information relating to a care-requiring event;
(b) transmitting the event information to a first terminal;
(c) receiving from the first terminal a response regarding the appropriateness of the determination regarding the event information and/or a response result;
and (d) storing the response received in the step (c) in a storage unit in association with the event information including information about the care recipient,
The event information stored in association with the response includes state information on which the event was determined,
The condition information includes a record of care provided to the care recipient;
(f) determining that the event has occurred from a change in the care record within a predetermined period of time;
A control program to be executed by a computer that controls an information processing device.

( 11 ) The control program according to ( 10) above, wherein the process further includes a step (e) of displaying the answers accumulated and stored in the memory unit for each piece of event information.

According to the present invention, the information processing device includes an acquisition unit that acquires event information related to an event requiring care, a transmission unit that transmits the event information to a first terminal, a reception unit that receives from the first terminal a response regarding the appropriateness of a judgment regarding the event information and/or a response result, and an accumulation processing unit that associates the response with the event information including information about the care recipient and stores the response in a storage unit. This makes it possible to understand which events are attracting responses and use this information to improve care.

1 is a diagram showing an overall configuration of a monitoring system according to a first embodiment. FIG. 13 is a diagram showing an example of a detection unit installed in a room of a care recipient. FIG. 2 is a block diagram showing a schematic configuration of a detection unit. FIG. 2 is a block diagram showing a schematic configuration of a server. FIG. 2 is a block diagram showing a schematic configuration of an information manager terminal; FIG. 2 is a block diagram showing a schematic configuration of a staff terminal. 11 is a sequence chart showing an FB result accumulation process according to the first embodiment. 4 is an example of an event list stored in a storage unit. 13 is an example of an operation screen for confirming an event. 13 is an example of an operation screen for inputting feedback displayed on a staff terminal. 1 is an example of an event list. 1 is an example of an event list. 13 is a flowchart showing an algorithm improvement process using an FB result. 13 is a sequence chart showing an FB result accumulation process according to the second embodiment. 13 is an example of an operation screen for confirming an event displayed on an information manager terminal. 13 is an example of an operation screen for inputting an FB displayed on an information manager terminal.

Hereinafter, an embodiment of the present invention will be described with reference to the attached drawings. Note that in the description of the drawings, the same elements are given the same reference numerals, and duplicate descriptions will be omitted. Also, the dimensional ratios in the drawings have been exaggerated for the convenience of explanation, and may differ from the actual ratios.

(Overall composition)
FIG. 1 is a diagram showing the overall configuration of a system according to the present embodiment (hereinafter referred to as the monitoring system 1) relating to the first embodiment, and FIG. 2 is a diagram showing an example of a detection unit 10 installed around the bed in the room of a care recipient 70.

As shown in FIG. 1, the monitoring system 1 includes multiple detection units 10, a server 20, an information manager terminal 30, and one or more staff terminals 40 (also referred to as care staff terminals) carried by care staff during work hours. These are connected to each other via a network 50, such as a LAN (Local Area Network), a telephone network, or a data communication network, by wire or wirelessly, so that they can communicate with each other. The network 50 may include relays such as repeaters, bridges, routers, or cross-connects that relay communication signals.

The monitoring system 1 is disposed at an appropriate location according to the care recipient 70 (also referred to as the subject or the person being watched). The care recipient 70 is, for example, a patient who needs nursing due to illness or injury, a person receiving care who needs nursing due to a decline in physical ability due to aging, or a person living alone. In particular, from the viewpoint of enabling early detection and early response, the care recipient 70 may be a person who needs to be detected when a specific inconvenient event such as an abnormal condition occurs. For this reason, the monitoring system 1 is suitably disposed in buildings such as hospitals, elderly welfare facilities, and residences according to the type of care recipient 70. In the example shown in FIG. 1, the monitoring system 1 is disposed in a facility that has multiple rooms (living rooms) in which multiple care recipients 70 live, and multiple rooms including a care station (also referred to as a nurse station). In addition, the care record includes a care record sheet, a nursing record sheet (medical chart, life record), and a diagnostic chart that record the care given to these care recipients by staff (caregivers, nurses, etc.).

The detection unit 10 is also called a sensor box, and is arranged in each room, which is the observation area of the care recipient 70. In the example shown in FIG. 1, four detection units 10 are arranged in each room of the care recipients 70, namely, A, B, C, and D. As shown in FIG. 2, the observation area of the detection unit 10 includes a bed 60. Care staff 80 (hereinafter simply referred to as staff 80) who provide nursing care or other care (care) to the care recipient 70 each carry a staff terminal 40, which is a mobile terminal. However, the position and number of each component of the monitoring system 1 are not limited to the example shown in FIG. 1. For example, the server 20 does not have to be arranged in the care station, and may be an external server unit connected to the network 50.

(Status Information and Determination Unit)
In this embodiment, the server 20 functions as an "information processing device" either alone or in cooperation with the detection unit 10. Also, in this embodiment, the information processing device acquires, by an acquisition unit, status information on the care recipient 70 from the detection unit 10 or another terminal such as the information manager terminal 30 (PC: Personal Computer). The acquired status information is stored in a memory unit of the information processing device, for example, a memory unit (database 23 described below) of the server 20.

The "status information" includes various types of information. For example, there are mainly three types of status information acquired from the detection unit 10. The first type is the "detection signal" itself detected by the sensor of the detection unit 10, and is particularly a detection signal that detects the movement of the care recipient 70 in an observation area such as a room in which the care recipient 70 is present. The second type is an "event" determined by the detection signal. The third type is a "care record" related to the care recipient 70, which is acquired from another terminal. As a specific example, the first type of "detection signal" includes an image captured by a camera, a call signal for a care call (nurse call), and a body movement signal from a body movement sensor, which will be described later. The second type of "event" is an event (tentative) determined by the control unit 11 of the detection unit 10 by image processing the image captured by the camera. The third type of "care record" is acquired through a terminal (PC), and may include not only data keyed into the terminal by a staff member or the like, but also data obtained by converting read image data obtained by scanning a handwritten paper care record sheet into text using OCR.

The server 20 functions as a "determination unit" that determines whether an event (a sudden occurrence such as an accident, or an action trigger for starting a care response) has occurred from the status information. When the status information is of the first type (detection signal), the determination unit determines the occurrence of an event such as the care recipient 70 getting up or getting out of bed from the captured image, or determines the occurrence of a care call event when a button on the care call unit is pressed.

In addition, if the status information is of the second type (event (which is also an event that is provisionally determined until a final decision is made)), a subsequent judgment is made using a confirmation/correction judgment algorithm used by the judgment unit, and the event (provisional) obtained from the detection unit 10 is either adopted as is (confirmed) or corrected to another event.

If the condition information is of the third type (care record), an event is determined based on a change in the care record. For example, changes in the amount or frequency of urination and defecation, and changes in food and drink intake are detected from long-term records of a certain care recipient 70, and if a change of a specified percentage or more occurs from the previous amount, frequency, or intake within a short period of time within a specified period, the server 20 determines an event (alert). In this case, the timing of event determination may be determined periodically (daily), or may be determined when a handwritten care record sheet is scanned and digitized.

(Detection Unit 10)
3 is a block diagram showing a schematic configuration of the detection unit 10. As shown in the figure, the detection unit 10 includes a control unit 11, a communication unit 12, a camera 13, a care call unit 14, and a voice input/output unit 15, which are connected to each other via a bus. The detection unit 10 detects status information of the care recipient 70. As described above, the status information is, for example, an image captured by the camera 13 or a detection signal by a body movement sensor.

The control unit 11 is composed of a CPU (Central Processing Unit) and memories such as RAM (Random Access Memory) and ROM (Read Only Memory), and controls each part of the detection unit 10 and performs calculation processing according to a program. The control unit 11 may also include an HDD (Hard Disk Drive) as a memory.

The communication unit 12 is an interface circuit (e.g., a LAN card, a wireless communication circuit, etc.) for communicating with other devices, such as the server 20, the information manager terminal 30, or the staff terminal 40, via the network 50.

The camera 13 is placed, for example, on the ceiling or upper part of a wall of a room, captures the bed 60 of the care recipient 70 directly below as the observation area, and outputs the captured image (image data). This captured image includes still images and videos. The camera 13 is a near-infrared camera, but a visible light camera may be used instead, or both may be used in combination.

The care call unit 14 includes a push button switch, and detects a care call when the care recipient 70 presses the switch. Instead of a push button switch, a care call may be detected by an audio microphone. When the switch of the care call unit 14 is pressed, i.e., when a care call is detected, the control unit 11 transmits a notification that a care call has been made (a care call signal) to the server 20, etc., via the communication unit 12 and the network 50.

The voice input/output unit 15 is, for example, a speaker and a microphone, and enables voice communication by transmitting and receiving voice signals between the information manager terminal 30 via the communication unit 12. The voice input/output unit 15 may be connected to the detection unit 10 via the communication unit 12 as an external device of the detection unit 10.

The detection unit 10 may further include a Doppler shift type body movement sensor that transmits and receives microwaves to and from the bed 60 and detects the Doppler shift of microwaves caused by body movements (e.g., breathing) of the care recipient 70. This body movement sensor detects chest body movements (up and down movement of the chest) caused by the breathing of the care recipient 70. If a disturbance in the period of the chest body movements or an amplitude of the chest body movements below a preset threshold is detected, it is determined that there is a micro-body movement abnormality (e.g., due to cardiac arrest). This determination of micro-body movement abnormality may be performed on the detection unit 10 side, or may be performed on the server 20 side by sending only a signal to the server 20.

In this embodiment, an event is a change in the condition of the care recipient 70 detected by the detection unit 10, such as getting up, getting out of bed, falling, or abnormal slight body movements, that should be reported (alert) to the staff 80 so that care can be provided. Events also include care calls made by the care call unit 14. The detection unit 10 transmits information about the event that has occurred to the server 20.

(Event determination by image processing)
The control unit 11 detects the behavior of the care recipient 70 from the images captured by the camera 13. The detected behaviors include "getting up" to get up from the bed 60, "getting out of bed" to leave the bed 60 after getting up, "falling" to fall off the bed 60, and "falling" to fall onto the floor or the like.

The control unit 11 detects silhouettes of images (hereinafter referred to as "human silhouettes") from multiple captured images (moving images). Human silhouettes can be detected, for example, by extracting a range of pixels with a relatively large difference by time difference between images captured before and after. Human silhouettes may be detected by a background difference method that subtracts a background image from a captured image. Detection of getting up, getting out of bed, falling, and falling over is detected from the detected human silhouette based on the posture of the care recipient 70 (e.g., standing, sitting, lying down, etc.) and the relative position to objects installed in the room such as the bed 60 to detect getting up, "getting out of bed," and "falling over (falling)." For example, "getting up" can be recognized by an increase in the width of the human silhouette crossing any side of a preset rectangle with the four corners of the bed 60 as vertices when viewed from above, becoming 20 cm or more. Also, for example, "getting out of bed" can be recognized by an increase in the ratio of the area of the human silhouette outside the rectangle to the area inside the rectangle becoming 80% or more. In addition, when determining the sitting position, it may be possible to further recognize whether the sitting position is a sitting state (sitting on the edge of the bed 60) near the edge of the bed 60. When the control unit 11 of the detection unit 10 detects any type of behavior (event) such as getting up, getting out of bed, or falling, it sends a notification to the server 20 or the like that the behavior has occurred.

Such event detection may be performed by a program processed by the CPU of the control unit 11, or may be performed by an embedded processing circuit. In this case, the detected event (tentative) is transmitted to the server 20 as the second type of status information as described above. However, without being limited to this, the server 20 may perform all or most of the detection processing, and the control unit 11 may only transmit the captured image (the first type of status information described above) to the server 20. When the control unit 11 detects any type of behavior, it transmits a notification that the behavior has occurred to the server 20, etc. In this case, the detection unit 10 and the server 20 work together to function as an information processing device, and the detection unit 10 functions as an "acquisition unit" that acquires status information and a "determination unit" that determines an event.

(Server 20)
4 is a block diagram showing a schematic configuration of the server 20. The server 20 includes a control unit 21, a communication unit 22, and a database 23. The server 20 may be provided in the same building as the room for the care recipient 70, or may be provided in a remote location and connectable via a network. For example, the server 20 may be a cloud server that is virtually constructed by a plurality of servers arranged on a network such as the Internet. Each component is connected to each other by a bus so as to be able to communicate with each other.

(Control unit 21)
The control unit 21 has a CPU, a RAM, a ROM, etc., as a configuration similar to that of the control unit 11 of the detection unit 10. The control unit 21 functions as a "determination unit", a "generation unit", and an "accumulation processing unit".

When the determination unit acquires the first type of status information (detection signal) as described above, it determines whether an event has occurred from this status information. When the determination unit acquires the second type of status information (event (tentative) detected by the detection unit 10), it determines the content of this event (tentative) that should be communicated to the staff 80 using a determination algorithm for confirmation and correction. For example, when the detection result of the event (tentative) by the detection unit 10 is getting up, it corrects this to a fall event using the determination algorithm. When the determination unit acquires the third type of status information (care record), it determines whether an event has occurred from this status information. Note that the determination unit including the determination algorithm reflects the past behavioral data of the care recipient 70, and is corrected and improved by reflecting the FB results described later (see FIG. 12 described later).

The generating unit also generates event information including the type of event determined by the determining unit, the event ID, and the personal ID (name, ID) of the care recipient 70. The accumulation processing unit links the event information generated by the generating unit with the response to the FB request (FB result), and stores it as an event list (see FIG. 8, etc., described later) in the database 23, which serves as a storage unit.

(Communication unit 22)
The communication unit 22 functions as a transmitting unit and a receiving unit. The communication unit 22 also functions as an acquiring unit that acquires status information from the detection unit 10, etc. The communication unit 22 is an interface for various local connections, such as a network interface for wired communication according to standards such as Ethernet (registered trademark) and an interface for wireless communication according to standards such as Bluetooth (registered trademark) and IEEE802.11, and communicates with each terminal connected to the network 50.

(Database 23)
The database 23 records a care recipient list, a staff list, an event list, and care records. The care recipient list and the staff list include personal IDs (name, number), room numbers, staff names, and units of affiliation for the care recipients 70 and staff 80. The event list (see FIG. 8 described later) includes event information, response status, and FB results (feedback results). The database 23 may be configured separately from the server 20. For example, only the database 23 may be a file server arranged on the cloud.

(Display unit 24)
The display unit 24 is, for example, a liquid crystal display, and displays various information. For example, the display unit 24 displays the FB results (answers) accumulated and stored in the database 23 for each piece of information about the care recipient 70 (for example, the individual ID of the care recipient) or for each piece of information about the type of event. This displayed list is generated by the generation unit by aggregating the answers for each individual ID or each type of event.

(Information Manager Terminal 30)
5 is a block diagram showing a schematic configuration of the information manager terminal 30. The information manager terminal 30 also corresponds to a first terminal. The information manager terminal 30 is a so-called PC, and includes a control unit 31, a communication unit 32, a display unit 33, an input unit 34, and an audio input/output unit 35, which are interconnected by a bus. The control unit 31 includes a CPU, a RAM, a ROM, etc., in the same configuration as the control unit 11 of the detection unit 10.

The communication unit 32 is an interface for various local connections, such as a network interface for wired communication based on standards such as Ethernet (registered trademark), and an interface for wireless communication based on standards such as Bluetooth (registered trademark) and IEEE 802.11, and communicates with each terminal connected to the network 50.

The display unit 33 is, for example, a liquid crystal display, and displays various information. The display unit 33 displays, for example, an image captured by the detection unit 10.

The input unit 34 includes a keyboard, numeric keypad, mouse, etc., and is used to input various information.

The audio input/output unit 35 is, for example, a headset equipped with a speaker and a microphone.

In this embodiment, the information manager terminal 30 is used as a terminal for the information manager 90, and displays various information within the facility to the information manager 90 and accepts instructions. In addition, voice signals are transmitted and received between the information manager 90 and the detection unit 10 or the staff terminal 40 via the communication unit 32, enabling voice calls with the staff 80, etc. Here, the information manager 90 is a manager who manages multiple staff 80. The information manager 90 may manage not only one facility, but also staff 80 working in multiple facilities. The information manager 90 may also be called a care director. The information manager 90 checks the status information of events, etc., from the detection unit 10, etc., that has been once aggregated, through the information manager terminal 30, and makes a judgment regarding the status information. Then, depending on the judgment result, the information manager 90 assigns the response to the event to the staff 80 or gives specific instructions.

Furthermore, when the detection unit 10 is installed in each room (residential room), the staff 80 or technical staff, etc., through the information manager terminal 30, associates the room number with the detection unit 10, and calibrates and specifies the position information of the objects installed in the room, such as the bed 60, i.e., the contour information viewed from above by the ceiling camera 13. In addition, they also associate the identification information, such as the name and ID number, of the care recipients 70 who are hospitalized or residing with each room number.

(Staff terminal 40)
FIG. 6 is a block diagram showing a schematic configuration of the staff terminal 40. The staff terminal 40 corresponds to a first terminal. The staff terminal 40 includes a control unit 41, a wireless communication unit 42, a display unit 43, an input unit 44, and a voice input/output unit 45, which are connected to each other by a bus. The control unit 41 includes a CPU, a RAM, a ROM, and the like, as the same configuration as the control unit 11 of the detection unit 10. The wireless communication unit 42 enables wireless communication using standards such as Wi-Fi and Bluetooth (registered trademark), and wirelessly communicates with each device via an access point 51 or directly. The display unit 43 and the input unit 44 are touch panels, and a touch sensor as the input unit 44 is superimposed on the display surface of the display unit 43, which is made of a liquid crystal or the like. The display unit 43 and the input unit 44 display various operation screens that list a plurality of events included in the event list to the staff 80, display instructions from the information manager 90, and accept various operations through the operation screen. The voice input/output unit 45 is, for example, a speaker and a microphone, and enables the staff member 80 to make voice calls to other staff terminals 40 via the wireless communication unit 42. The staff terminal 40 can be configured by, for example, a portable communication terminal device such as a tablet computer, a smartphone, or a mobile phone.

When starting work, staff member 80 performs login authentication processing via the assigned staff terminal 40. Staff member 80 inputs a staff ID and password via the touch panel (display unit 43, input unit 44) of staff terminal 40 and transmits them to server 20. Server 20 compares the authentication information stored in database 23 and transmits the authentication result according to staff member 80's authority to staff terminal 40, completing login authentication.

Each staff member 80 belongs to a staff unit (group in charge). A staff unit here refers to a group consisting of a care recipient unit to which multiple care recipients who are in a common area, such as the same floor within the facility, belong, and multiple staff members in charge of these care recipient units. For example, multiple care recipients 70 (care recipients) belonging to a care recipient unit on the east wing of the second floor of a nursing facility are shared by multiple staff members belonging to one staff unit and care is provided 24 hours a day. In this case, if an event related to a care recipient 70 is detected in a care recipient unit on the east wing of the second floor, the event information is notified to the staff terminals 40 of all staff members (who are logged in) belonging to the staff unit in charge of this care recipient unit, as described below.

(Procedure of FB result accumulation process in the first embodiment)
7 is a sequence chart showing the process of responding to an event in the monitoring system. As described above, the status information includes the "detection signal" (first type) itself from the detection unit 10, the event (second type) determined by the detection unit 10, and the "care record" (third type) regarding the care recipient 70. In the following, an example will be described in which the event (second type) determined by the detection unit 10 is used as the status information. The event here is an event such as getting up, getting out of bed, falling, or a care call, which is detected by the image captured by the camera 13 of the detection unit 10 or the call signal from the care call unit 14 as described above.

(Steps S110, S120)
The detection unit 10 detects an event from the movement of the care recipient 70 in the observation area. The detection unit 10 transmits the detected event to the server 20.

(Step S130)
The control unit 21 of the server 20 judges whether to confirm or correct the event sent from the detection unit 10. Specifically, the control unit 21 executes a judgment algorithm for confirmation and correction to judge the event detected by the detection unit 10 as correct as is, and confirms it. Alternatively, the event detected by the detection unit 10 is canceled or corrected to another event. For example, the judgment algorithm corrects the wake-up event detected by the detection unit 10 to a fall event based on the past behavioral data of the care recipient 70. The server 20 updates the event list in the database 23 by adding the confirmed or corrected event.

Figure 8 is an example of an event list stored in database 23. Events included in the event list include getting up, getting out of bed, falling, falling over, and care calls, as described above. The latest event determined in step S140 is added to the end of the event list. Each event includes data on "event information," "response status," and "FB result." Event information includes an event ID, which is an automatically assigned primary key, a room number, a target person, an event type, the date and time (time) of occurrence, image data, and response status information. Image data (image i) as status information included in the event information is still image or video data captured by detection unit 10 at the time of the event, transmitted in step S120, and is status information that was the basis for event determination. For example, it is video data for a dozen seconds before and after the time of the event occurrence (determination time).

The response status includes the status, the staff member who responded, and the date and time of the response. The FB result includes the FB result and additional information. The response status and FB result will be described later.

(Step S140)
When the event list is updated by detecting and adding a new event or changing the status of an event, the server 20 distributes the updated event list to all staff terminals 40 that are currently logged in. The distribution destination at this time may be only the staff terminal 40 used by the staff member 80 in charge of the care recipient 70 who caused the event. For example, the event list is distributed to a plurality of staff members 80 belonging to a staff unit associated with the care recipient 70. Each staff terminal 40 that receives the event list returns a receipt confirmation command in response to receiving the event list from the server 20 (not shown). The server 20 may transmit only difference data of the event list. For example, only the part that has changed from the event list transmitted immediately before, i.e., the events that have been added or updated, is transmitted to all staff terminals 40 as an event list.

(Step S150)
In response to receiving the event list from the server 20, each staff terminal 40 updates the display content on the display unit 43 of the staff terminal 40.

Figure 9 shows an example of an operation screen 431 for checking events displayed on the display unit 43 of the staff terminal 40. The operation screen 431 shown in the figure is a screen on which a list of events is displayed. The displayed events can be scrolled up and down by a flick operation.

Areas a11 and a12 of the operation screen 431 correspond to event IDs 010 and 011 in the event list in FIG. 8, respectively. Areas a11 and a12 display icons indicating that the event is a care call and a wake-up event, and that the event has already been dealt with. Area a13 corresponds to event ID 012 (Mr. B, fall event) in FIG. 8. In addition, since the event has not yet been dealt with, area a13 is displayed large to make it easier to distinguish from events that have already been dealt with. Note that area a13 may display a thumbnail image created from a still image extracted from image i012 (see FIG. 8) of the video related to this event (ID012). By operating area a14, text messages can be exchanged with other staff members 80 who are logged in.

(Steps S160, S170)
The staff member 80 checks the contents of the event on the operation screen 431 displayed on the staff terminal 40. It is also possible to transition to a screen where the details of the event can be confirmed by tapping the area a13. When the staff member 80 (staff member D) takes the initiative to take charge of an unhandled event (ID012), he or she operates the "handle" button in the area a13. By detecting the operation of the "handle" button, the control unit 41 transmits to the server 20 that the staff member D using the staff terminal 40 will be in charge. It is to be noted that when the staff member D is handling another care recipient 70 and cannot immediately handle the event, the staff member D requests the other staff member 80 to handle the event by, for example, calling the other staff member 80 through the staff terminal 40 or sending a text message.

(Steps S180, S190)
In response to receiving the signal in step S170 indicating that the person in charge will take charge, the server 20 returns an approval notification. This determines the person in charge of the selected event (ID012). The server 20 also records this person in charge (staff ID) in the event list. In this embodiment, in response to the staff member 80 operating the above-mentioned "Respond" button for the event selected and displayed on the operation screen 432, the event list (see FIG. 8) is changed to "Responded." In other words, by operating the "Respond" button, the response status of "Responded," which is information indicating that confirmation has been made, is entered, and the response date and time is recorded assuming that the event has been handled.

(Step S210)
In response to determining the person in charge, the server 20 immediately transmits a feedback request (feedback request) to the staff terminal 40 of the staff member 80 in charge. Note that the transmission of this feedback request may be performed after a predetermined time has elapsed since the person in charge was determined.

(Step S220)
The staff member 80 rushes to the room 102 of the care recipient 70 (Mr. B) whom the staff member 80 (Staff D) has decided to take charge of, checks the situation regarding the fall event, and takes necessary measures. For example, if the server 20 judges correctly and the care recipient 70 has actually fallen, the staff member 80 checks whether the care recipient 70 is conscious and checks the physical condition such as pain and physical condition. If the judgment is incorrect and the care recipient 70 has not actually fallen, the staff member 80 checks the current situation.

(Step S230)
Here, the staff 80 feedbacks the result of the rush response in step S220. FIG. 10 is an example of an operation screen 432 for inputting feedback of the event confirmation result displayed on the display unit 43. The staff 80 inputs the confirmation result of step S220 through the operation screen 432. In the operation screen 432, event information is displayed in the area a21, a radio button for inputting the judgment of suitability is arranged in the area a22, and an input box for additional information is arranged in the area a23. A send button is arranged in the area a24. In addition to the input of suitability and additional information, an appropriate event (a correct event judged by the staff in the case of a misjudgment) may be selected as an input item in the operation screen for inputting feedback. For example, when a result of rushing to an event of a fall is actually an event of getting out of bed, the getting out of bed can be selected from a list of multiple event names.

Based on the result of the situation confirmation in step S220, the staff member 80 selects whether the event judgment made by the server 20, etc. is correct. For example, if the event judged by the server 20 (after confirmation and correction) is a fall, and the staff member 80 actually rushes to the scene to check and finds that the judgment matches, the staff member 80 selects the "Correct Judgment" radio button in area a22. On the other hand, if the care recipient 70 is still asleep, does not require care, and does not match the judgment made by the server 20, the staff member 80 selects the "Incorrect Judgment" radio button in area a22. In addition, if there is additional information, it is entered by keying in area a23. Additional information is information related to care, and in particular, is information for improving the efficiency and quality of care work, and any information can be entered.

(Step S240)
When the staff member 80 has finished inputting the information, the staff member 80 presses the send button (rectangular icon) in the area a24. This causes the staff member terminal 40 to transmit the inputted FB results to the server 20.

(Step S250)
The server 20 updates the event list. That is, it performs an accumulation process of adding the received feedback result, linking it with the event information including the event determination result, and storing it in the database 23. Fig. 11A shows the event list after the feedback result for event ID 012 (within the dashed line frame) is reflected. In the example of Fig. 11A, the feedback result of an erroneous determination by staff member 80 (staff member D) for the fall event of event ID 012 is recorded.

Figure 11B is an example of an event list after Figure 11A. In Figure 11B, information on a newly occurring event ID 013 has been added. This event ID 013 is an event in which the detection unit 10 detects a wake-up event, which is judged as a fall by the judgment algorithm of the server 20, and the fall event is notified to the staff terminal 40 of the staff member 80. Upon receiving this notification, the staff member 80 (staff member D) rushes to the room 103 of the care recipient 70 (Mr. C), but the resident of this room is lying in bed 60, so there is no risk of a fall. In this situation, the staff member 80 selects an incorrect judgment as the FB result. At this time, the care recipient 70 requests milk, and the staff member 80 records this as additional information.

In this way, the information processing device (server 20) according to the first embodiment receives a response regarding the appropriateness of a judgment regarding the event information and/or the response result from the staff terminal 40 as the first terminal, and performs an accumulation process in which the received response is linked to the event information including information regarding the care recipient and stored in the memory unit. This makes it possible to understand which events are attracting responses and use this information to improve care.

In addition, in the first embodiment, event information is sent to a staff terminal 40 carried by a staff member 80 in charge of caring for the care recipient 70, and a feedback request is sent to the staff member requesting feedback on the appropriateness of the judgment by the judgment unit for the event and/or the response results, and an accumulation process is performed in which the response to the feedback request is linked to the event information by the judgment unit and stored in the memory unit. This makes it possible to improve the information processing device so that information related to care can be provided to staff members more accurately.

(Use of FB results)
FIG. 12 is a flowchart showing an algorithm improvement process using the FB result.

(Step S10)
The server 20 transmits event information regarding the determined event and a FB request to the staff member 80. This process corresponds to the processes in steps S110 to S210 in FIG.

(Steps S20, S30)
The server 20 accumulates the FB results received from the staff 80 in the database 23 .

(Step S40)
If it is time to aggregate, the process proceeds to step S50 and thereafter. The aggregation timing may be, for example, daily, weekly, or monthly.

(Step S50)
The generating unit of the server 20 aggregates, creates a list, and displays the list based on the personal ID of the care recipient 70 and the event information. For example, the event information may be a personal ID, an event type, or a combination of these. For example, the event information may aggregate the FB results for each individual and create a list (List 1). Also, the event information may aggregate the FB results for each event type and create a list (List 2). Then, the created List 1 and/or List 2 are displayed on the display unit 24 or the like. This aggregation and listing may be performed for events included in a specified area or a specified period. For example, the predetermined area may be performed for each care recipient unit to which multiple care recipients who are on the same floor in the facility belong. Also, the predetermined period may be, for example, within the most recent one month.

In this way, the responses are associated with event information and stored in the database 23, and then these are aggregated and listed, making it possible to grasp information regarding which events responses are being collected for. In addition, when the data is aggregated by care recipient, it is possible to visualize which care recipients 70 have received many responses, which can be useful for care.

(Step S60)
Based on the personal ID of the care recipient 70, the FB results are aggregated for each individual, and the algorithm of the judgment unit is improved. For example, the algorithm for event judgment based on the first and third types of status information (detection signal, care record) is improved, and the judgment algorithm for confirmation and correction in the later stage for the second type of status information (event (provisional)) is improved. For example, among the later stage judgment algorithms, the algorithm is reflected in the probability calculation algorithm. For example, when a care recipient 70 normally wakes up at 7:00, if a wake-up event is detected in the time zone between 3:00 and 5:00 in the morning, the algorithm is improved so that this judgment is not made, and when a tentative wake-up event (second type of status information) is changed to a fall event in the later stage judgment algorithm of the two-stage judgment, the algorithm is improved so that it is not changed to a fall event depending on the time zone.

At this time, the algorithm may be improved by using the video (image i (Figure 8)) before and after the event, which is included in the event information associated with the FB result. For example, the movement trajectory of the position information of the human silhouette recognized from image i in the relative positional relationship with the surrounding objects (bed 60, etc.) is accumulated, and if there is a behavior similar to this movement trajectory (similar behavior) afterwards, the FB result for the previous judgment is reflected. The judgment of this similar behavior may be made taking into account the time period. Also, if there is additional information as the FB result, if there is a behavior similar to the behavior in the event to which this additional information was added, this additional information (e.g., "request for milk") may be added to the event. For example, in the case where a care call event requesting hydration occurs at a substantially fixed time for a certain care recipient 70, if the response result of the hydration is recorded as additional information, the algorithm is improved to reflect this. As a result, if a care call event occurs during the same time period and for the same care recipient, the event information will be included in the event notification to staff 80 (step S140) as additional information about the event, allowing for efficient care.

The algorithm may be updated not only for each care recipient, but also for each care recipient unit to which multiple care recipients who are on the same floor of a facility belong. For example, an algorithm that reflects the FB results regarding events of one or more care recipients belonging to a care recipient unit is applied to multiple care recipients in the same care recipient unit.

Alternatively, when the judgment unit of the server 20 performs judgment processing using a trained model, the trained machine learning model may be improved (updated) using the FB results. For example, machine learning can be performed by supervised learning using a large amount of learning sample data in which the image i (or movement trajectory) of the detection signal is input as state information and the event type reflecting the FB result is used as the correct answer label. This learning can be performed using learning sample data for each care recipient or each care unit, or learning sample data for all care recipients in multiple facilities.

(Procedure of FB result accumulation process in the second embodiment)
Fig. 13 is a sequence chart showing the FB accumulation process in the second embodiment. Fig. 14 is an example of an operation screen for event confirmation displayed on the information manager terminal 30. In the above-mentioned first embodiment, a FB response is received from the staff 80 and accumulated. In contrast, in the second embodiment described below, a FB response is further received from the information manager 90 and accumulated. This information manager 90 checks the status information of events, etc. from the detection unit 10, etc., which has been once aggregated, through the information manager terminal 30, and distributes it to the staff 80 or gives specific instructions.

(Steps S310 to S340)
The processes of steps S310 to S340 in Fig. 13 correspond to steps S110 to S140 in Fig. 7. Here, similar to the process in Fig. 7, the determination unit of the server 20 confirms and corrects the event (tentative) detected by the detection unit 10 as a subsequent process. Then, the determination result after the subsequent process is transmitted to the information manager terminal 30.

(Step S350)
The information manager terminal 30 displays the event list received from the server 20 on the display unit 33. The operation screen 331 in FIG. 14 includes areas a31 to a35 and buttons b1 to b4. Area a31 displays event information from the event list. Area a32 displays an image i of the event information. This image i is, for example, a video having a length of about 10 to 15 seconds including the time point when the event occurs, and this video is displayed repeatedly until the stop button is operated. It is stopped by operating the pause button. A determination is made as to whether or not the staff member 80 needs to respond to the events displayed in areas a31 and a32.

(Steps S360, S370)
The information manager 90 inputs instructions through the area a33. When "Do not instruct" is selected in the area a33, that is, when no action is required, the selection is confirmed by operating the OK button b2. When "Instruct" is selected in the area a33, the user further selects which staff member 80 to instruct as the person in charge through the area a34. When sending a message to the selected staff member 80, a text message can be input in the area a35. The staff members 80 displayed in the area a34 are all the staff members 80 who are currently logged in, but only the staff members 80 who are in charge of the care recipient 70 of the event may be displayed. The display in the area a32 can be switched to a real-time display, that is, a live image from the camera 13, by using the button b1. The event to be displayed can be changed by using the button b4, and past events can be scrolled. The area a31 may display a list of events within a predetermined period (for example, within the past 24 hours) related to the displayed care recipient 70, together with the currently displayed event. After checking the display contents of the operation screen 331 and making various settings, the selection is confirmed by operating the instruction transmission button b3, and instructions are transmitted to the staff member 80 via the server 20.

(Step S380)
The server 20 accepts the input result from the information manager 90. The server 20 checks the content of the accepted instruction, and if "instruct" is selected in area a33, i.e., a person in charge is selected, it executes the processing of steps S410 to S450 (skipping S460 to S480), and if "not instruct" is selected, i.e., a person in charge is not selected, it skips steps S410 to S450 and executes the processing of steps S460 to S480.

(Steps S410 to S450: When a person in charge is selected)
In step S410, the server 20 transmits the instruction from the information manager 90 and a FB request to the staff terminal 40 used by the selected staff member 80.

In steps S420 to S450, the staff member 80 selected as the person in charge checks the instructions for the sent event via the staff terminal 40, and depending on the contents of the instructions, inputs and sends instructions on how to respond to the care recipient 70 on an emergency basis and a response to the FB request. The processes in steps S420 to S450 correspond to steps S150 and S220 to S240 in FIG. 7. In this case, an example of a correct determination of the FB response is when the server 20's determination of the event is correct and the instructions are sent as is to the staff member 80. An example of an incorrect determination is when the event determination is incorrect, in which case the information manager 90 may input the correct event type and change it to the event that was input. Thereafter, the event list is updated with the changed event type, and the staff member 80 is notified.

(Steps S460 to S480: When no person in charge is selected)
In step S460, the server 20 transmits a feedback request to the information manager 90. In step S470, the information manager 90 receives the feedback request and returns the results of the event for which the instruction was accepted in step S360.

Figure 15 is an example of an operation screen 332 for inputting feedback displayed on the display unit 33. The information manager 90 inputs the confirmation results of step S350 through the operation screen 332. On the operation screen 332, event information is displayed in area a41, and radio buttons for inputting the appropriateness of the judgment and an input box for additional information are arranged in area a42. After inputting information into area a42, the information manager 90 presses the send answer button b5. This causes the information manager 90 to send the input feedback results to the server 20.

(Step S490)
The server 20 adds the received FB results and updates the event list.

In this way, in the second embodiment, event information is sent to the information manager terminal 30, and a feedback request is sent requesting feedback on the appropriateness of the judgment of the judgment unit for the event and/or the response result, and an accumulation process is performed in which the response to the feedback request is linked to the event information including the event judgment result (event type) by the judgment unit and stored in the memory unit. This makes it possible to reflect the feedback result of the information manager 90, thereby improving the information processing device so that it can provide care information to staff more accurately.

The information processing device and the monitoring system including the same described above are the main components described in explaining the features of the above-mentioned embodiment, but are not limited to the above-mentioned configuration and can be modified in various ways within the scope of the claims. Furthermore, configurations that are included in general information processing devices and monitoring systems are not excluded. For example, the detection unit 10, server 20, information manager terminal 30, and staff terminal 40 may include components other than those described above, or may not include some of the above components.

Furthermore, in this embodiment, image data (see FIG. 8) is included in the event information and is stored in the database 23 as the first type of status information that was the basis for determining the event (type of event) as the status information that was the basis for the event determination, but this is not limited to this, and in order to reduce the amount of data, information may be stored after converting this image data into a silhouette movement trajectory or the like after image processing. In addition, status information of the second type (tentative event determination) and the third type (care record) may be stored as the status information by linking it to the FB result.

In the second embodiment, the FB request is sent to either the staff member 80 or the information manager 90 depending on whether or not the information manager 90 has selected a person in charge, but it may be sent to both regardless of the selection.

The processing in the information processing device according to the above-described embodiment may include steps other than those shown in the above-described flowcharts and sequence charts, or may not include some of the above-described steps. For example, in the processing of FIG. 12, one of steps S50 and S60 may be omitted. The order of the steps is not limited to the above-described embodiment. Furthermore, each step may be combined with other steps and executed as a single step, may be included in other steps and executed, or may be divided into multiple steps and executed.

The means and methods for performing various processes in the information processing device or monitoring system according to the above-mentioned embodiments can be realized by either a dedicated hardware circuit or a programmed computer. The above program may be provided by a computer-readable recording medium such as a USB memory or a DVD (Digital Versatile Disc)-ROM, or may be provided online via a network such as the Internet. In this case, the program recorded on the computer-readable recording medium is usually transferred to and stored in a storage unit such as a hard disk. The above program may be provided as a standalone application software, or may be incorporated as a function into the software of the device such as its detection unit.

REFERENCE SIGNS LIST 1 Monitoring system 10 Detection unit 11 Control unit 12 Communication unit 13 Camera 14 Care call unit 20 Server (information processing device)
21 Control unit 22 Communication unit 23 Database 30 Information manager terminal 31 Control unit 32 Communication unit 33 Display unit 34 Input unit 35 Voice input/output unit 40 Staff terminal 41 Control unit 42 Wireless communication unit 43 Display unit 44 Input unit 45 Voice input/output unit 50 Network 51 Access point 60 Bed 70 Care recipient 80 Staff 90 Information manager

Claims (11)

An acquisition unit that acquires event information relating to an event requiring care;
a transmitter that transmits to a first terminal the event information and a feedback request that requests the first terminal to feed back whether a determination regarding the event information is a correct determination or an incorrect determination;
a receiving unit that receives a response regarding the suitability of the determination regarding the event information from the first terminal;
an accumulation processing unit that associates the answer with the event information including information about the care recipient and stores the answer in a storage unit;
Equipped with
The event information stored in association with the response includes state information on which the event was determined,
The condition information includes a record of care provided to the care recipient;
The information processing device further comprises a determination unit that determines that the event has occurred based on a change in the care record within a predetermined period of time . The information processing device according to claim 1, further comprising a display unit that displays the answers stored in the memory unit for each piece of event information. The status information includes an output from a detection unit that detects a movement of the care recipient in an observation area associated with the care recipient, and a call signal of a care call by the care recipient,
The information processing device according to claim 1 or claim 2, wherein the types of events include the care recipient getting up, getting out of bed, and falling from a bed in the observation area determined by output from the detection unit , as well as a care call by the care recipient. The information processing device according to claim 1 , wherein the receiving unit receives additional information regarding care for the care recipient as the response. The information processing device according to claim 1 , wherein the first terminal includes a staff terminal used by a staff member who provides care to the care recipient. The information processing apparatus according to claim 5 , wherein the first terminal includes an information manager terminal used by an information manager who gives instructions to the staff. The transmission unit transmits the event information and the feedback request to the information manager terminal;
the receiving unit accepts the response to the feedback request and the instruction received from the information manager terminal;
The transmission unit transmits the instruction received from the information manager terminal to the staff member,
The information processing apparatus according to claim 6 , wherein the accumulation processing section stores the response from the information manager received by the receiving section in the storage section in association with the event information. An acquisition unit that acquires event information relating to an event requiring care;
A transmission unit that transmits the event information to a first terminal;
a receiving unit that receives a response regarding the appropriateness of a determination regarding the event information and/or a response result from the first terminal;
an accumulation processing unit that associates the answer with the event information including information about the care recipient and stores the answer in a storage unit;
Equipped with
The event information stored in association with the response includes state information on which the event was determined,
The condition information includes a record of care provided to the care recipient;
The information processing device further comprises a determination unit that determines that the event has occurred based on a change in the care record within a predetermined period of time. A detection unit that detects a movement of the care recipient in an observation area associated with the care recipient;
An information processing device according to any one of claims 1 to 8 ,
A monitoring system comprising one or more staff terminals. (a) obtaining event information relating to a care-requiring event;
(b) transmitting the event information to a first terminal;
(c) receiving from the first terminal a response regarding the appropriateness of the determination regarding the event information and/or a response result;
and (d) storing the response received in the step (c) in a storage unit in association with the event information including information about the care recipient,
The event information stored in association with the response includes state information on which the event was determined,
The condition information includes a record of care provided to the care recipient;
(f) determining that the event has occurred from a change in the care record within a predetermined period of time;
A control program to be executed by a computer that controls an information processing device. 11. The control program according to claim 10 , wherein the process further comprises the step of: (e) displaying the answers accumulated and stored in the storage unit for each of the event information.