JP7735840B2 - Mental state management system, house, program, and mental state management method - Google Patents

Description

The present invention relates to a mental state management system for managing the mental state of residents of a home, a home, a program, and a mental state management method.

Patent Document 1 below discloses a state determination system according to the background art. The biometric information acquisition means periodically acquires biometric information of the resident using a biometric sensor installed within the home. The behavioral information acquisition means periodically acquires daily behavioral information related to the resident's daily behavior within the home using a behavioral sensor installed within the home. The state determination means determines the resident's mental state based on changes in the resident's biometric information acquired by the biometric information acquisition means and changes in the resident's daily behavioral information acquired by the behavioral information acquisition means. The suggestion means suggests recommended behaviors to the resident based on the resident's mental state determined by the state determination means.

Japanese Patent Application Laid-Open No. 2020-166413

Patent Document 1 above discloses that recommended actions are suggested to residents based on their mental state, but does not specifically consider the content of the actions or the optimization of the room in which they are performed.

The present invention was made in light of these circumstances, and aims to provide a mental state management system, house, program, and mental state management method that can appropriately set the content and execution room of improvement actions to improve the mental state of residents.

One aspect of the present invention provides a mental state management system for managing the mental state of residents of a house having multiple rooms, and includes: a sensor installed in each of the multiple rooms to detect the behavior of the resident; an information processing device that calculates judgment points by scoring the results of the sensor's detection of specific behavior of the resident for each room; estimates the resident's mental state and its intensity based on the tally of the calculated judgment points for each house; sets the content of improvement actions to improve the estimated mental state and its intensity; and sets an execution room among the multiple rooms in which to perform the improvement action based on the judgment points; and an output device that outputs to the resident action suggestion information indicating the content and execution room of the improvement action set by the information processing device.

According to this aspect, the information processing device calculates judgment points by scoring the results of the sensor's detection of specific resident behavior on a room-by-room basis. The information processing device also sets the content of improvement actions to improve the estimated resident's mental state based on its condition intensity, and sets the room in which the improvement action will be performed from among multiple rooms based on the judgment points. As a result, it is possible to appropriately set the content and room of improvement actions to improve the resident's mental state.

In the above aspect, the information processing device performs a process to calculate the judgment points based on the results of comparing the specific information indicating the specific behavior detected by the sensor with predetermined basic data, and sets the average value of the accumulated specific information as the basic data.

According to this aspect, by setting the average value of the accumulated specific information as the base data, it is possible to perform the calculation process of the judgment point using appropriate base data.

In the above aspect, in the process of calculating the judgment point, the information processing device calculates the judgment point based on the results of comparing the specific information detected by the sensor with predetermined judgment basis data, and sets the average value of the specific information accumulated within the most recent predetermined period as the judgment basis data.

According to this aspect, by setting the average value of specific information accumulated within the most recent specified period as the judgment basis data, it becomes possible to calculate the judgment point using appropriate judgment basis data.

In the above aspect, the specified period is set to any one of 7 days and 10 days.

In this embodiment, since the standard period of observation necessary to encourage caution during the duration of a depressive state is said to be two to three weeks, by setting the predetermined period at seven to ten days, which is half of that, it is possible to achieve the effect of preventing a deterioration in the mental state.

In the above aspect, the mental state includes a manic state and a depressive state, and the information processing device calculates the judgment points separately for the manic state and the depressive state.

This feature makes it possible to detect both manic and depressive states as signs of a worsening mental state.

In the above aspect, the information processing device estimates the state intensity based on the difference value for each residence between the aggregated value of the judgment points related to the manic state and the aggregated value of the judgment points related to the depressive state.

According to this aspect, by using the difference value for each residence between the aggregated value of judgment points related to manic states and the aggregated value of judgment points related to depressive states, it is possible to appropriately estimate the intensity of the resident's mental state.

In the above aspect, the information processing device sets the room in which the improvement action is to be performed based on the difference between the aggregated value of the judgment points related to the manic state and the aggregated value of the judgment points related to the depressive state, on a room-by-room basis.

According to this aspect, by using the difference value per room between the aggregated value of judgment points related to manic states and the aggregated value of judgment points related to depressive states, it is possible to appropriately set the room in which improvement actions will be performed.

A home according to one aspect of the present invention comprises multiple rooms and a mental state management system according to the above aspect.

This aspect makes it possible to appropriately set the content and room for improvement actions to improve the resident's mental state.

One aspect of the present invention is a program for operating an information processing device included in a mental state management system that manages the mental state of residents of a house having multiple rooms, wherein a sensor is installed in each of the multiple rooms to detect the behavior of the resident, and the information processing device calculates judgment points by scoring the results of the sensor's detection of specific behavior of the resident for each room, estimates the resident's mental state and its condition intensity based on the tally of the calculated judgment points for each house, sets the content of improvement actions to improve the estimated mental state and condition intensity, and sets an execution room from the multiple rooms in which to perform the improvement action based on the judgment points.

This aspect makes it possible to appropriately set the content and room for improvement actions to improve the resident's mental state.

One aspect of the present invention is a mental state management method for managing the mental state of a resident of a house having multiple rooms, wherein a sensor is installed in each of the multiple rooms to detect the behavior of the resident, and an information processing device calculates judgment points by scoring the results of the sensor's detection of specific behavior of the resident for each room, estimates the resident's mental state and its intensity based on the tally of the calculated judgment points for each house, sets the content of improvement actions to improve the estimated mental state and its intensity, and sets an execution room from the multiple rooms in which to perform the improvement action based on the judgment points.

This aspect makes it possible to appropriately set the content and room for improvement actions to improve the resident's mental state.

This invention makes it possible to appropriately set the content and execution room of improvement actions to improve the mental state of residents.

1 is a diagram schematically illustrating the overall configuration of a mental state management system according to an embodiment of the present invention. FIG. 1 is a diagram showing a simplified configuration of an information processing device. 10 is a flowchart showing the processing content executed by an information processing unit. 10 is a flowchart showing the processing content executed by an information processing unit. 10 is a flowchart showing the processing content executed by an information processing unit. 10 is a flowchart showing the processing content executed by an information processing unit. 10 is a flowchart showing the processing content executed by an information processing unit. 10 is a flowchart showing the processing content executed by an information processing unit. 10 is a flowchart showing the processing content executed by an information processing unit. 10 is a flowchart showing the processing content executed by an information processing unit. FIG. 10 is a diagram showing a simplified example of room-based judgment point data. FIG. 10 is a simplified diagram showing an example of house-unit judgment point data. FIG. 10 is a simplified diagram illustrating an example of an improvement action table.

Embodiments of the present invention will be described in detail below with reference to the drawings. Note that elements with the same reference numerals in different drawings indicate the same or corresponding elements.

Figure 1 is a diagram showing a schematic diagram of the overall configuration of a mental state management system 1 according to an embodiment of the present invention.

The mental state management system 1 is constructed in a house 100 having multiple rooms 101 (101A to 101C in the example of Figure 1). The rooms 101 include a living room, dining room, bedroom, etc.

The mental state management system 1 includes an information processing device 2, sensors 3 (3A to 3C in the example of FIG. 1), and an output device 4. The information processing device 2 is a server device such as an edge server within the house 100 or a cloud server outside the house 100. The sensors 3 are installed in each of multiple rooms 101 and detect the behavior of the resident. In this embodiment, the sensors 3 are microphones that detect sounds emitted by the resident. The output device 4 is any output device such as a display or speaker for outputting action suggestion information (described below) to the resident. The output device 4 may also be a communication terminal such as a smartphone or tablet device carried by the resident. The information processing device 2 is connected to the sensors 3 and output device 4 so as to be able to communicate with each other via any communication network 5 such as a wireless LAN.

The information processing device 2 calculates judgment points by scoring the results of the detection of specific resident behavior by the sensors 3 on a room-by-room basis. The information processing device 2 also estimates the resident's mental state and the intensity of that state based on the tally of the calculated judgment points on a house-by-house basis. The information processing device 2 also sets the content of improvement actions to improve the estimated mental state and the intensity of the state. The information processing device 2 also sets the room in which the improvement action will be performed out of the multiple rooms 101 based on the judgment points. These processes will be described in detail below.

Figure 2 is a simplified diagram showing the configuration of the information processing device 2. The information processing device 2 includes an information processing unit 11, a memory unit 12, and a communication processing unit 13, which are interconnected via a bus. The information processing unit 11 is configured using a processor such as a CPU. The memory unit 12 is configured using a storage medium such as an HDD, SSD, or flash memory. The communication processing unit 13 is configured using a communication module compatible with the communication protocol of the communication network 5, such as IP.

The memory unit 12 stores a program 20. The information processing unit 11 executes the program 20 read from the memory unit 12, causing the information processing device 2 to operate as described below. The memory unit 12 also stores specific information 21, basic data 22, judgment basic data 23, room-level judgment point data 24, house-level judgment point data 25, and an improvement action table 26. These will be described in detail below.

Figures 3 to 10 are flowcharts showing the processing performed by the information processing unit 11.

Figure 3 shows the sensing process by sensor 3 in each of multiple rooms 101.

First, in step S1, the information processing unit 11 detects that a resident has entered a certain room 101 based on the detection results of a motion sensor (not shown) or the like installed in the room 101.

Next, in step S2, the information processing unit 11 begins detecting the behavior of the resident in the room 101 where entry has been detected. In this embodiment, the information processing unit 11 begins processing to detect the resident's voice using a microphone installed in the room 101 where entry has been detected.

Next, in step S3, the information processing unit 11 executes behavior determination processing. Details of the behavior determination processing will be described later using Figure 4.

Next, when the information processing unit 11 detects in step S4 that the resident has left the room 101, it ends detection of the resident's behavior in step S5.

Figure 4 shows the behavior determination process (step S3 in Figure 3) performed by the information processing unit 11.

First, in step S11, the information processing unit 11 determines whether a specific behavior (in this example, vocalization) by the resident has been detected based on the detection results of the sensor 3.

If no specific behavior is detected (step S11: NO), the information processing unit 11 repeats the processing of step S11.

If a specific behavior is detected (step S11: YES), then in step S12, the information processing unit 11 acquires specific information 21 associated with the specific behavior and stores the acquired specific information 21 in the memory unit 12. As a result, the specific information 21 is accumulated in the memory unit 12. In this embodiment, the specific information is the volume, pitch, and speaking speed of the resident's voice detected by the microphone.

Next, in step S13, the information processing unit 11 compares the specific information 21 acquired in step S12 with predetermined basic data 22 to determine whether the specific information 21 fluctuates from the basic data 22 by more than a predetermined threshold value. Details of the basic data 22 will be described later using Figure 5. The specific information 21 may be an average value during the period the occupant is present in the room, a maximum value, or the value detected by the sensor 3 itself.

If the specific information 21 has changed relative to the basic data 22 (step S13: YES), then in step S14, the information processing unit 11 executes a judgment point calculation process. Details of the judgment point calculation process will be described later using FIG. 6. If the specific information 21 has not changed relative to the basic data 22 (step S13: NO), the process of step S14 is omitted.

Next, in step S15, the information processing unit 11 stores the judgment points calculated in step S14 in the memory unit 12. As a result, room-level judgment point data 24 is accumulated in the memory unit 12.

Figure 5 shows the process for setting basic data 22.

First, in step S21, the information processing unit 11 obtains from the memory unit 12 the specific information 21 accumulated for the entire period from the start of operation of the system in the home 100 to the present.

Next, in step S22, the information processing unit 11 calculates the average value of the specific information 21 acquired in step S21.

Next, in step S23, the information processing unit 11 sets the average value calculated in step S22 as basic data 22 and stores it in the memory unit 12. The information processing unit 11 performs the process of setting the basic data 22 periodically (for example, at a fixed time every day).

Figure 6 shows the judgment point calculation process (step S14 in Figure 4) performed by the information processing unit 11.

First, in step S31, the information processing unit 11 determines whether the value detected by the sensor 3 exceeds the predetermined determination basis data 23. Details of the determination basis data 23 will be described later using Figure 7.

If the detection value by the sensor 3 exceeds the judgment basic data 23 (step S31: YES), then in step S32, the information processing unit 11 adds one judgment point to the current room-unit judgment point data 24 read from the memory unit 12, and stores the updated room-unit judgment point data 24 in the memory unit 12. As a result, the updated room-unit judgment point data 24 is accumulated in the memory unit 12.

Figure 11 is a simplified diagram showing an example of room-level judgment point data 24. The mental states of residents managed by the mental state management system 1 according to this embodiment include both manic and depressive states. The information processing unit 11 calculates judgment points separately for manic and depressive states. Specifically, the information processing unit 11 calculates manic points as judgment points related to manic states, and depression points as judgment points related to depressive states. As shown in Figure 11, the information processing unit 11 calculates manic points and depression points separately for each type of specific information 21, such as the volume, pitch, and speed of voice, for each room, such as the living room, dining room, and bedroom.

The information processing unit 11 performs the process of tallying the judgment points at a fixed time every day, and if there are multiple entries and exits to a certain room 101 in a single day, the total value for that day is calculated as the judgment point for that room 101.

Figure 7 shows the process of setting the judgment basis data 23 by the information processing unit 11.

First, in step S41, the information processing unit 11 acquires from the memory unit 12 the specific information 21 stored for the most recent predetermined period (10 days in this example). Considering that the guideline period for observation necessary to urge caution in the duration of a depressive state is said to be two to three weeks, the predetermined period is set to either seven to ten days, which corresponds to half the assessment period.

Next, in step S42, the information processing unit 11 calculates the average value of the specific information 21 acquired in step S41.

Next, in step S43, the information processing unit 11 sets the average value calculated in step S42 as the judgment basis data 23 and stores it in the memory unit 12. The information processing unit 11 performs the process of setting the judgment basis data 23 periodically (for example, at a fixed time every day).

Figure 8 shows the process of determining the mental state of a resident by the information processing unit 11. The information processing unit 11 performs the mental state determination process periodically (for example, at a set time every day).

First, in step S51, the information processing unit 11 calculates the house-wide judgment point data 25 by adding up the judgment points of the room-wide judgment point data 24 stored in the memory unit 12 for the entire house.

Figure 12 is a simplified diagram showing an example of home-level judgment point data 25. As shown in Figure 12, the information processing unit 11 calculates mania points and depression points individually for each type of specific information 21, such as voice volume, pitch, and speed, on a home-level basis.

Next, in step S52, the information processing unit 11 calculates the total mania points and depression points for the house-level judgment point data 25 calculated in step S51. In the example shown in Figure 12, the total mania points is 2 + 1 = 3, and the total depression points is 5 + 3 + 6 = 14.

Next, in step S53, the information processing unit 11 calculates the difference between the total mania points calculated in step S52 and the total depression points. In the example shown in Figure 12, the difference is 3 - 14 = -11.

Next, in step S54, the information processing unit 11 determines the difference value calculated in step S53 as the resident's mental state score. The mental state point is an index that indicates the resident's mental state (manic state or depressive state) and the intensity of that state. A positive sign for the mental state point indicates a manic state, a negative sign indicates a depressive state, and the magnitude of the absolute value indicates the intensity of the manic or depressive state.

Next, in step S55, the information processing unit 11 executes an improvement action decision process based on the mental state points determined in step S54. Details of the improvement action decision process will be described later using Figure 9.

Figure 9 shows the improvement action decision process performed by the information processing unit 11. The information processing unit 11 executes the improvement action decision process periodically (for example, at a set time every day).

First, in step S61, the information processing unit 11 reads the improvement action table 26 from the memory unit 12.

Figure 13 is a simplified diagram showing an example of the improvement behavior table 26. The improvement behavior table 26 sets a correspondence between mental state points and behavioral content. The smaller the absolute value of the mental state point (i.e., the lower the intensity of the manic or depressive state), the more behavioral content that involves physical activity is set, and the larger the absolute value of the mental state point (i.e., the higher the intensity of the manic or depressive state), the more behavioral content that involves physical rest is set. Note that even if the absolute value of the mental state point is the same, different behavioral content may be set for a manic state (positive sign) and a depressive state (negative sign).

Next, in step S62, the information processing unit 11 refers to the improvement action table 26 to set the action content corresponding to the resident's mental state point determined in step S54 as the improvement action content.

Next, in step S63, the information processing unit 11 reads the room-level judgment point data 24 from the memory unit 12, and calculates the total mania points and depression points for each room. In the example shown in FIG. 11, the total mania points for the living room are 0 and the total depression points are 3; the total mania points for the dining room are 1 and the total depression points are 5; and the total mania points for the bedroom are 2 and the total depression points are 4.

Next, in step S64, the information processing unit 11 calculates the difference between the total mania and depression points for each room, based on the total mania and depression points for each room calculated in step S63. In the example shown in FIG. 11, the difference is -3 for the living room, -4 for the dining room, and -2 for the bedroom.

Next, in step S65, the information processing unit 11 compares the difference values calculated for each room in step S64.

Next, in step S66, the information processing unit 11 sets the room with the smallest absolute value of the difference value per room as the optimal room for the resident to perform improvement actions, based on the comparison results from step S65. This is based on the premise that the more comfortable a room is for the resident, the smaller the absolute value of the difference value.

Figure 10 shows the process by the information processing unit 11 of proposing improvement actions to residents.

First, in step S71, the information processing unit 11 detects that a resident has entered a certain room 101 based on the detection results of a motion sensor (not shown) or the like installed in the room 101.

Next, in step S72, the information processing unit 11 determines whether the room 101 into which entry was detected in step S71 is the execution room set in step S66.

If the room 101 where entry was detected is an execution room (step S72: YES), then in step S73 the information processing unit 11 controls the output device 4 to output action suggestion information indicating the content of the improvement action and the execution room to the resident. The action suggestion information may be output as a display on a screen or as audio output from a speaker. On the other hand, if the room 101 where entry was detected is not an execution room (step S72: NO), the processing of step S73 is omitted.

In addition, the information processing unit 11 may cause the output device 4 to output the action suggestion information at a fixed time every day (for example, during relaxation time after dinner), rather than using the resident's entry into the execution room as a trigger for outputting the action suggestion information. Furthermore, the information processing unit 11 may use a sensor 3 such as a camera to detect times when the resident is not performing housework or errands, such as when the resident is sitting on the sofa or operating a smartphone, and cause the output device 4 to output the action suggestion information at that time.

In addition, the information processing unit 11 may manage the mental state of each of multiple residents individually by distinguishing between individuals using voice frequency analysis, etc.

Furthermore, the sensor 3 that detects the resident's behavior is not limited to a microphone. A sensor that detects the resident's physical symptoms, a sensor that detects the resident's grooming, or a sensor that detects the status of the resident's housework may also be used.

Sensors that detect residents' physical symptoms include microphones, motion sensors that detect when residents are at home, cameras that use image analysis to detect eating habits, sleep sensors that detect sleep habits, facial expression sensors that detect facial expressions, body temperature sensors that detect body temperature non-contact, and odor sensors that detect body odor.

Sensors that detect resident grooming include shower sensors that detect shower usage time, water level sensors that detect bath time, and cameras that use image analysis to detect the frequency or time required for applying makeup, brushing teeth, and styling hair.

Sensors that detect the status of household chores performed by residents include power sensors or microphones that detect the usage status of washing machines, vacuum cleaners, dishwashers, etc., weight sensors installed on trash cans to detect how often trash is emptied, odor sensors that detect odors in the room, and open/close sensors installed on the doors to storage spaces for cleaning tools to detect how often cleaning is done.

In the mental state management system 1 according to this embodiment, the information processing device 2 calculates judgment points by scoring the results of the detection of specific resident behavior by the sensor 3 on a room-by-room basis. The information processing device 2 also sets the content of improvement actions to improve the estimated resident's mental state according to the intensity of that state, and sets the room in which the improvement action will be performed from among the multiple rooms 101 based on the judgment points. As a result, it is possible to appropriately set the content and room of improvement actions to improve the resident's mental state.

REFERENCE SIGNS LIST 1 Mental state management system 2 Information processing device 3A to 3C Sensors 4 Output device 11 Information processing unit 12 Storage unit 20 Program 21 Specific information 22 Basic data 23 Basic judgment data 24 Room-based judgment point data 25 House-based judgment point data 26 Improvement action table 100 House 101A to 101C Sensors

Claims (10)

A mental state management system for managing the mental state of a resident of a house having multiple rooms,
a sensor installed in each of the plurality of rooms to detect the behavior of the resident;
an information processing device that calculates a judgment point by scoring the result of detection of the specific behavior of the resident by the sensor for each room, estimates the mental state of the resident and its state intensity based on the calculated judgment point total for each house, sets the content of an improvement action to improve the estimated mental state and state intensity, and sets an execution room among the plurality of rooms in which the improvement action will be executed based on the judgment point;
an output device that outputs to the resident action suggestion information indicating the content of the improvement action set by the information processing device and the room in which the improvement action is to be performed;
A mental state management system comprising: The information processing device includes:
Calculating the judgment points based on a comparison result between specific information indicating the specific behavior detected by the sensor and predetermined basic data;
The mental state management system according to claim 1 , wherein an average value of the accumulated specific information is set as the basic data. The information processing device includes:
In the calculation process of the judgment point, the judgment point is calculated based on a comparison result between the specific information detected by the sensor and predetermined judgment basic data;
The mental state management system according to claim 2, wherein an average value of the specific information accumulated within a recent predetermined period is set as the basic data for judgment. The mental state management system of claim 3, wherein the predetermined period is set to between 7 and 10 days. the psychiatric conditions include mania and depression;
The mental state management system according to any one of claims 1 to 4, wherein the information processing device calculates the judgment points for a manic state and a depressive state separately. The mental state management system of claim 5, wherein the information processing device estimates the state intensity based on the difference value for each residence between the aggregated value of the judgment points related to the manic state and the aggregated value of the judgment points related to the depressive state. The mental state management system of claim 5 or 6, wherein the information processing device sets the room in which the improvement action is to be performed based on the difference between the aggregated value of the judgment points related to the manic state and the aggregated value of the judgment points related to the depressive state for each room. Multiple rooms and
A mental state management system according to any one of claims 1 to 7;
A house equipped with: A program for operating an information processing device provided in a mental state management system for managing the mental states of residents of a house having multiple rooms,
a sensor for detecting the behavior of the resident is installed in each of the plurality of rooms;
The information processing device calculates judgment points by scoring the results of detection of specific behavior of the resident by the sensor on a room-by-room basis, estimates the mental state of the resident and the intensity of that state based on the calculated judgment points aggregated on a house-by-house basis, sets the content of improvement actions to improve the estimated mental state and the intensity of the state, and sets an execution room among the multiple rooms in which to perform the improvement action based on the judgment points. A mental state management method for managing the mental state of a resident of a house having multiple rooms, comprising:
a sensor for detecting the behavior of the resident is installed in each of the plurality of rooms;
A mental state management method in which an information processing device calculates judgment points by scoring the results of detection of specific behavior of the resident by the sensor on a room-by-room basis, estimates the resident's mental state and the intensity of that state based on the calculated judgment points aggregated on a house-by-house basis, sets the content of improvement actions to improve the estimated mental state and the intensity of the state, and sets an execution room among the multiple rooms in which the improvement action will be performed based on the judgment points.