JP7770574B2 - Abnormal physical condition detection device and abnormal physical condition detection method - Google Patents

Description

The present disclosure relates to an abnormal physical condition detection device and an abnormal physical condition detection method.

The driver physical condition monitor described in Patent Document 1, which has in common with the abnormal physical condition detection device of the present disclosure in terms of vehicle driving safety, detects the physical condition of the driver while driving a vehicle by issuing an alert to the driver if the driver's physical condition (e.g., heart rate, pulse waveform) while driving the vehicle is not within a certain range from the driver's physical condition when the vehicle is stopped.

Japanese Patent Application Laid-Open No. 2002-104013

However, depending on the type of illness (e.g., epilepsy), for most patients, as shown in Figure 15A, the heart rate when in abnormal physical condition is clearly higher than the heart rate when in normal physical condition. However, for some patients, as shown in Figure 15B, the former heart rate may not necessarily be clearly higher than the latter heart rate. As a result, the driver's physical condition monitor may not be able to detect that the driver is experiencing an abnormal physical condition, even if the driver operating the vehicle is suffering from the latter type of illness and is experiencing an abnormal physical condition, i.e., a sudden change in physical condition that cannot be predicted in advance.

The object of the present disclosure is to provide an abnormal physical condition detection device and an abnormal physical condition detection method that can prevent situations in which it is not possible to detect the fact that an occupant of a vehicle is experiencing an abnormal physical condition.

In order to solve the above-mentioned problems, the abnormal physical condition detection device of the present disclosure includes an imaging unit that captures an image of an occupant in a vehicle, a calculation unit that calculates the occupant's heart rate based on the image, a determination unit that determines whether the calculated heart rate is stable or not, a correction unit that corrects the heart rate threshold for detecting whether the occupant is in abnormal physical condition based on the occupant 's heart rate based on the result of the determination so that the heart rate threshold when it is determined that the occupant's heart rate is unstable is lower than the heart rate threshold when it is determined that the occupant's heart rate is stable , and a detection unit that detects that the occupant is in abnormal physical condition when the heart rate exceeds the corrected heart rate threshold.

The abnormal physical condition detection device disclosed herein can prevent situations in which it is not possible to detect that an occupant of a vehicle is experiencing an abnormal physical condition.

FIG. 2 is a functional block diagram of the abnormal physical condition detection device TK of the first embodiment. 1 shows the hardware configuration of an abnormal physical condition detection device TK according to a first embodiment. 4 is a flowchart showing the operation of the abnormal physical condition detection device TK of the first embodiment. FIG. 10 is a functional block diagram of an abnormal physical condition detection device TK according to a second embodiment. 10 shows the relationship between the occupant JI and the normal heart rate SP(T) in the second embodiment. 10 shows the relationship between the heart rate SP(T) of an occupant JI in a normal state and the weighting coefficient W in the second embodiment. 10 is a flowchart showing the operation of the abnormal physical condition detection device TK of the second embodiment. FIG. 10 is a functional block diagram of an abnormal physical condition detection device TK according to a third embodiment. 10 shows the relationship between the occupant JI and the normal stable heart rate SP(T) in the third embodiment. 11 shows the relationship between the normal stable heart rate SP(T) of an occupant JI and the weighting coefficient W in the third embodiment. 10 is a flowchart showing the operation of the abnormal physical condition detection device TK of the third embodiment. FIG. 10 is a functional block diagram of an abnormal physical condition detection device TK according to a fourth embodiment. 10 shows the relationship between the heart rate SP of an occupant JI and the body movement TD of the occupant JI in the fourth embodiment. 10 is a flowchart showing the operation of the abnormal physical condition detection device TK of the fourth embodiment. 15A shows the relationship between the heart rate when the physical condition is normal and the heart rate when the physical condition is abnormal (part 1). FIG. 15B shows the relationship between the heart rate when the physical condition is normal and the heart rate when the physical condition is abnormal (part 2).

An embodiment of a physical abnormality detection device according to the present disclosure is described below.

Embodiment 1.
First Embodiment
The abnormal physical condition detection device TK of the first embodiment will be described.

<Functions of the First Embodiment>
1 is a functional block diagram of the abnormal physical condition detection device TK of embodiment 1. The functions of the abnormal physical condition detection device TK of embodiment 1 will be described below with reference to FIG.

In the following, "heart rate" is assumed to include "pulse rate."

The abnormal physical condition detection device TK of embodiment 1 includes, as shown in FIG. 1, an imaging unit SE, a calculation unit SS, a judgment unit HT, a correction unit HS, and a detection unit KS to detect whether an occupant JI (particularly, an occupant JI driving the vehicle SR) on board a vehicle SR (not shown) is experiencing an abnormal physical condition TI.

Illness in physical condition TI refers to, for example, a condition in which a passenger JI suffers from epilepsy or the like.

The imaging unit SE corresponds to the "imaging unit", the calculation unit SS corresponds to the "calculation unit", the judgment unit HT corresponds to the "judgment unit", the correction unit HS corresponds to the "correction unit", and the detection unit KS corresponds to the "detection unit".

The photographing unit SE photographs an image GZ of the occupant JI. The photographing unit SE is composed of an optical camera that captures the image GZ under light, such as one or more visible light cameras, or one or more infrared cameras that use a near-infrared light source and a filter that transmits only the infrared region.

The calculation unit SS calculates the heart rate SP (or more precisely, the pulse rate MH (not shown)) of the occupant JI based on the image GZ captured by the image capture unit SE. The calculation unit SS performs the calculation using a conventionally known method, for example, using the change in luminance on the surface of a person's face, which differs depending on the person's pulse rate MH. Therefore, more specifically, the calculation unit SS detects the face of the occupant JI from the image GZ, and calculates the pulse wave number MH of the occupant JI based on the change in luminance on the surface of the detected face of the occupant JI.

The calculation unit SS performs the above-mentioned detection using a classifier based on a general algorithm, for example, a Haar-Like detector combined with Adaboost or Casecade.

Instead of calculating the pulse wave number MH based on the image GZ, the calculation unit SS may acquire and calculate the pulse wave number MH using, for example, a biosensor. The biosensor may be installed, for example, inside the vehicle SR (e.g., at the front of the passenger compartment, inside the seat belt, or inside the seat), or may be worn by the occupant JI in wearable form.

The determination unit HT determines whether the heart rate SP of the occupant JI calculated by the calculation unit SS is stable. The determination unit HT makes the above-mentioned determination, for example, by comparing the standard deviation value, variance value, etc. of the heart rate SP over a recent fixed period with predetermined reference standard deviation values, reference variance values, etc.

When the determination unit HT determines that the heart rate SP of the occupant JI is unstable, the correction unit HS corrects the heart rate threshold SPS used by the detection unit KS to detect an abnormal physical condition TI. More specifically, the correction unit HS reduces the heart rate threshold SPS from value A to value (A-B) by subtracting an initially set correction value (e.g., value B) from the initially set heart rate threshold SPS (e.g., value A).

The detection unit KS detects whether the occupant JI is experiencing an abnormal physical condition TI based on whether the heart rate SP of the occupant JI calculated by the calculation unit SS exceeds the heart rate threshold SPS. As the heart rate threshold SPS, the detection unit KS uses the initially set heart rate threshold SPS (e.g., the value A described above) when the heart rate SP of the occupant JI is stable, and (2) when the heart rate SP of the occupant JI is unstable, the detection unit KS uses the heart rate threshold SPS corrected by the correction unit HS (e.g., the value (A-B) described above).

Hardware Configuration of First Embodiment
FIG. 2 shows the hardware configuration of the abnormal physical condition detection device TK of the first embodiment.

In order to perform the above-mentioned functions, the abnormal physical condition detection device TK of embodiment 1 includes a processor P, a memory M, and a storage medium K, as shown in Figure 2, and may further include an input unit N and an output unit S as necessary.

The processor P is the well-known core of a computer, operating the hardware according to software. The memory M is composed of, for example, DRAM (Dynamic Random Access Memory) and SRAM (Static Random Access Memory). The storage medium K is composed of, for example, a hard disk drive (HDD), a solid state drive (SSD), and a ROM (Read Only Memory). The storage medium K stores the program PR. The program PR is a set of instructions that define the content of the processing to be executed by the processor P.

The input section N and output section S are composed of, for example, an input interface and an output interface for exchanging input signals NS and output signals SS related to the operation of the processor P with the outside of the abnormal physical condition detection device TK.

Regarding the relationship between the functions (shown in Figure 1) and hardware configuration (shown in Figure 2) of the abnormal physical condition detection device TK, on the hardware side, the processor P executes the program PR stored in the storage medium K using the memory M, and, as necessary, controls the operation of the input unit N and output unit S, thereby realizing the functions of each unit from the imaging unit SE to the detection unit KS (shown in Figure 1).

<Operation of the First Embodiment>
3 is a flowchart showing the operation of the abnormal physical condition detection device TK of embodiment 1. The operation of the abnormal physical condition detection device TK of embodiment 1 will be described below with reference to the flowchart of FIG.

In the following, for ease of explanation and understanding, it is assumed that the heart rate SP of the occupant JI of the vehicle SR is not stable.

Step ST11: The photographing unit SE (shown in Figure 1) photographs an image GZ (shown in Figure 1) of an occupant JI (shown in Figure 1) riding in the vehicle SR.

Step ST12: The calculation unit SS (shown in Figure 1) calculates the heart rate SP of the occupant JI based on the image GZ captured by the imaging unit SE.

Step ST13: The judgment unit HT (shown in Figure 1) uses the heart rate SP of occupant JI calculated by the calculation unit SS to determine whether the heart rate SP of occupant JI is stable. If it is determined that the heart rate SP of occupant JI is stable, the process proceeds to step ST15. On the other hand, if it is determined that the heart rate SP of occupant JI is not stable, the process proceeds to step ST14. Here, under the above-mentioned assumptions, it is determined that the heart rate SP of occupant JI is not stable, so the process proceeds to step ST14.

Step ST14: The correction unit HS (shown in Figure 1) corrects the heart rate threshold SPS (shown in Figure 1), which was initially the above-mentioned value A, to reduce it to the above-mentioned value (A-B).

Step ST15: The detection unit KS (shown in Figure 1) determines whether the heart rate SP of the occupant JI calculated by the calculation unit SS exceeds the heart rate threshold SPS, for example, the heart rate threshold SPS after correction by the correction unit HS (for example, the above-mentioned value (A-B)). If it is determined that the heart rate SP of the occupant JI exceeds the heart rate threshold SPS, the processing proceeds to step ST16; on the other hand, if it is determined that the heart rate SP of the occupant JI is below the heart rate threshold SPS, the processing ends.

Step ST16: When the heart rate SP of occupant JI exceeds the heart rate threshold SPS, the detection unit KS determines that occupant JI has an abnormal physical condition TI, i.e., detects that occupant JI has an abnormal physical condition TI.

Effects of the First Embodiment
As described above, in the abnormal physical condition detection device TK of embodiment 1, when the heart rate SP of the occupant JI is unstable, the detection unit KS detects whether the occupant JI has an abnormal physical condition TI based on whether the heart rate SP of the occupant JI exceeds the heart rate threshold value SPS corrected by the correction unit HS. As a result, even if the occupant JI is ill and the heart rate SP of the occupant JI is not the heart rate SP shown in Figure 15A but the heart rate SP shown in Figure 15B, it is possible to detect whether the occupant JI has an abnormal physical condition TI (the abnormal physical condition shown in Figure 15B).

Embodiment 2.
Second Embodiment
The abnormal physical condition detection device TK of the second embodiment will be described.

The abnormal physical condition detection device TK of embodiment 2 differs from the abnormal physical condition detection device TK of embodiment 1 (shown in FIG. 1) in that it uses multiple individual heart rate thresholds SPS(K) instead of a single heart rate threshold SPS. More specifically, the abnormal physical condition detection device TK of embodiment 2 focuses on the fact that the heart rates SPa, SPb, and SPc (not shown) of multiple occupants JIa, JIb, and JIc (not shown) are inherently different from one another, and more specifically, focuses on the fact that, for example, there are people whose normal heart rate SP is relatively high, and in contrast, there are people whose normal heart rate SP is relatively low. The abnormal physical condition detection device TK of embodiment 2, based on the above-mentioned focus, uses individual heart rate thresholds SPS(K), which are the heart rate thresholds SPS for each of the multiple occupants JIa, JIb, and JIc, i.e., individual heart rate thresholds SPS(Ka), SPS(Kb), and SPS(Kc).

Here, "normal times" refers to, for example, (1) when occupant JI is not on board vehicle SR, (2) when occupant JI is not driving vehicle SR, (3) when occupant JI is on board vehicle SR and is not experiencing any abnormalities in occupant JI's health, and (4) when occupant JI is driving vehicle SR and is not experiencing any abnormalities in occupant JI's health.

The individual heart rate threshold SPS (Ka) is used as a criterion for detecting whether or not an abnormal physical condition TI has occurred in occupant JIa, the individual heart rate threshold SPS (Kb) is used as a criterion for detecting whether or not an abnormal physical condition TI has occurred in occupant JIb, and the individual heart rate threshold SPS (Kc) is used as a criterion for detecting whether or not an abnormal physical condition TI has occurred in occupant JIc.

<Functions of the Second Embodiment>
4 is a functional block diagram of the abnormal physical condition detection device TK of embodiment 2. The functions of the abnormal physical condition detection device TK of embodiment 2 will be described below with reference to FIG.

As shown in Figure 4, the abnormal physical condition detection device TK of embodiment 2 includes an imaging unit SE, a calculation unit SS, a judgment unit HT, a correction unit HS, and a detection unit KS, similar to the abnormal physical condition detection device TK of embodiment 1 (shown in Figure 1).

The functions of the imaging unit SE, calculation unit SS, judgment unit HT, and detection unit KS in embodiment 2 are basically the same as the functions of the imaging unit SE, calculation unit SS, judgment unit HT, and detection unit KS in embodiment 1.

The correction unit HS of embodiment 2 calculates the value (A-B*W) instead of the calculation performed by the correction unit HS of embodiment 1, for example, calculating the value (A-B).

Figure 5 shows the relationship between occupant JI and normal heart rate SP(T) in embodiment 2.

Figure 6 shows the relationship between the normal heart rate SP(T) of occupant JI and the weighting coefficient W in embodiment 2.

The correction unit HS corrects the individual heart rate threshold SPS(K) of each of the occupants JIa, JIb, and JIc in accordance with the magnitude of their respective normal heart rates SP(T). More specifically, the correction unit HS sets the individual heart rate threshold SPS(K) so that the larger the normal heart rate SP(T) of each of the occupants JIa, JIb, and JIc, the larger the individual heart rate threshold SPS(K).

For example, as shown in Figure 5, when the normal heart rate SP(T) of occupant JIa is value S1, and as shown in Figure 6, the weighting coefficient corresponding to value S1 is 0.9, the correction unit HS corrects occupant JIa's individual heart rate threshold SPS(Ka) to be A-B*0.9.

For example, as shown in Figure 5, when the normal heart rate SP(T) of occupant JIb is value U1 (U1 < S1), and as shown in Figure 6, the weighting coefficient corresponding to value U1 is 1.1, the correction unit HS corrects the individual heart rate threshold SPS(Kb) of occupant JIb to be A-B * 1.1.

For example, as shown in Figure 5, when the normal heart rate SP(T) of occupant JIc is value T1 (T1<S1 and T1>U1), and the weighting coefficient corresponding to value T1 is 1.0 as shown in Figure 6, the correction unit HS corrects the individual heart rate threshold SPS(Kc) to be A-B*1.0.

The normal SP(T) of occupants JIa, JIb, and JIC is, for example, the average or median of the heart rates SP of occupants JIa, JIb, and JIc.

The correction unit HS determines whether the occupant JI riding in the vehicle SR is occupant JIa, occupant JIb, or occupant JIc, for example, by analyzing the image of the occupant JI's face captured in the image GZ.

Hardware Configuration of Second Embodiment
The abnormal physical condition detection device TK of the second embodiment has the same hardware configuration (shown in FIG. 2) as the abnormal physical condition detection device TK of the first embodiment.

<Operation of the Second Embodiment>
7 is a flowchart showing the operation of the abnormal physical condition detection device TK of embodiment 2. The operation of the abnormal physical condition detection device TK of embodiment 2 will be described below with reference to the flowchart of FIG.

In the following, for ease of explanation and understanding, it is assumed that the occupant JI aboard the vehicle SR is occupant JIa.

Steps ST21 to ST23: Similar to steps ST11 to ST13 in embodiment 1, the photographing unit SE (shown in Figure 4) photographs an image GZ, the calculation unit SS (shown in Figure 4) calculates the heart rate SP of the occupant JI, and the judgment unit HT (shown in Figure 4) judges the stability of the heart rate SP of the occupant JI.

Step ST24: The correction unit HS of embodiment 2 (shown in Figure 4) differs from the correction unit HS of embodiment 1 (shown in Figure 1) in that, instead of using the heart rate threshold SPS of embodiment 1, the correction unit HS recognizes that occupant JI is occupant JIa by analyzing the image GZ of occupant JI. Based on the above recognition, the correction unit HS calculates the individual heart rate threshold SPS (Ka) of occupant JIa by the correction described above with reference to Figures 5 and 6.

Step ST25: The detection unit KS (shown in FIG. 4) determines whether the heart rate SP of occupant JI calculated by the calculation unit SS, i.e., the heart rate SP of occupant JIa, exceeds the individual heart rate threshold SPS(Ka) of occupant JIa after correction by the correction unit HS. If it is determined that the heart rate SP of occupant JIa exceeds the individual heart rate threshold SPS(Ka) of occupant JIa, the processing proceeds to step ST26; on the other hand, if it is determined that the heart rate SP of occupant JIa is below the heart rate threshold SPS(Ka) of occupant JIa, the processing ends.

Step ST26: When the heart rate SP of occupant JIa exceeds the heart rate threshold SPS (Ka) of occupant JIa, the detection unit KS determines that occupant JIa has an abnormal physical condition TI, i.e., detects that occupant JIa has an abnormal physical condition TI.

Effects of the Second Embodiment
As described above, in the abnormal physical condition detection device TK of the second embodiment, the correction unit HS corrects the individual heart rate thresholds SPS(K) of each of the occupants JIa, JIb, and JIc, i.e., the individual heart rate thresholds SPS(Ka), SPS(Kb), and SPS(Kc), in accordance with the magnitude of the normal heart rate SP(T) of each of the occupants JIa, JIb, and JIc. This makes it possible to detect whether an abnormal physical condition TI has occurred in the occupant JI, taking into consideration individual differences in whether the normal heart rate SP(T) of each of the occupants JIa, JIb, and JIc is high or low.

Embodiment 3.
Third Embodiment
The abnormal physical condition detection device TK of the third embodiment will be described.

The abnormal physical condition detection device TK of embodiment 3 differs from the abnormal physical condition detection device TK of embodiment 2 (shown in Figure 4) in that instead of using the normal heart rate SP(T), the normal stable heart rate SP(T) is used to calculate the individual heart rate thresholds SPS(Ka), SPS(Kb), and SPS(Kc) of occupants JIa, JIb, and JIc.

Here, "stable" means that the heart rate SP, for example, shows relatively little change over time.

<Functions of the Third Embodiment>
8 is a functional block diagram of the abnormal physical condition detection device TK of embodiment 3. The functions of the abnormal physical condition detection device TK of embodiment 3 will be described below with reference to FIG.

As shown in Figure 8, the abnormal physical condition detection device TK of embodiment 3 includes an imaging unit SE, a calculation unit SS, a judgment unit HT, a correction unit HS, and a detection unit KS, similar to the abnormal physical condition detection device TK of embodiment 2 (shown in Figure 4).

The functions of the imaging unit SE, calculation unit SS, judgment unit HT, and detection unit KS in embodiment 3 are basically the same as the functions of the imaging unit SE, calculation unit SS, judgment unit HT, and detection unit KS in embodiment 2.

The correction unit HS of embodiment 3 performs the calculation of the value (A-B*W) by the correction unit HS of embodiment 2, but performs this calculation based on the normal stable heart rate SP(T) described above.

Figure 9 shows the relationship between occupant JI and normal stable heart rate SP(T) in embodiment 3.

Figure 10 shows the relationship between the normal stable heart rate SP(T) of occupant JI and the weighting coefficient W in embodiment 3.

As shown in Figures 9 and 10, the correction unit HS of embodiment 3 differs from the correction unit HS of embodiment 2 in that it calculates the individual heart rate threshold SPS(K) based on the stable heart rate SP(T) under normal circumstances.

For example, as shown in Figure 9, when the normal stable heart rate SP(T) of occupant JIa is value S2, and as shown in Figure 10, the weighting coefficient corresponding to value S2 is 0.9, the correction unit HS corrects occupant JIa's individual heart rate threshold SPS(Ka) to be A-B*0.9.

For example, as shown in Figure 9, when the normal stable heart rate SP(T) of occupant JIb is value U2 (U2 < S2), and as shown in Figure 10, the weighting coefficient corresponding to value U2 is 1.1, the correction unit HS corrects the individual heart rate threshold SPS(Kb) of occupant JIb to be A-B * 1.1.

For example, as shown in Figure 9, when the normal stable heart rate SP(T) of occupant JIc is value T2 (T2<S2 and T2>U2), and the weighting coefficient corresponding to value T2 is 1.0 as shown in Figure 10, the correction unit HS corrects occupant JIc's individual heart rate threshold SPS(Kc) to be A-B*1.0.

The correction unit HS determines whether the normal heart rate SP(T) is stable, for example, by comparing the standard deviation value, variance, etc. of the normal heart rate SP(T) of the occupant JI riding in the vehicle SR with predetermined reference standard deviation values, reference variance values, etc.

<Hardware Configuration of Third Embodiment>
The abnormal physical condition detection device TK of the third embodiment has the same hardware configuration (shown in FIG. 2) as the abnormal physical condition detection device TK of the first embodiment.

<Operation of the Third Embodiment>
11 is a flowchart showing the operation of the abnormal physical condition detection device TK of embodiment 3. The operation of the abnormal physical condition detection device TK of embodiment 3 will be described below with reference to the flowchart of FIG.

In the following, for ease of explanation and understanding, it is assumed that the occupant JI aboard the vehicle SR is occupant JIa.

Steps ST31 to ST33: Similar to steps ST21 to ST23 in embodiment 2, the photographing unit SE (shown in Figure 8) photographs an image GZ, the calculation unit SS (shown in Figure 8) calculates the heart rate SP of the occupant JI, and the judgment unit HT (shown in Figure 8) judges the stability of the heart rate SP of the occupant JI.

Step ST34: The correction unit HS (shown in Figure 8) of embodiment 3, like the correction unit HS (shown in Figure 4) of embodiment 2, analyzes the image GZ of occupant JI to recognize that occupant JI is occupant JIa. Based on the above recognition, the correction unit HS calculates the individual heart rate threshold SPS (Ka) of occupant JIa by the correction described above with reference to Figures 9 and 10, instead of the correction described with reference to Figures 5 and 6 in embodiment 2.

Step ST35: The detection unit KS (shown in FIG. 8), like the detection unit KS in embodiment 2, determines whether the heart rate SP of the occupant JIa calculated by the calculation unit SS, i.e., the heart rate SP of the occupant JIa, exceeds the individual heart rate threshold SPS(Ka) of the occupant JIa after correction by the correction unit HS. If it is determined that the heart rate SP of the occupant JIa exceeds the individual heart rate threshold SPS(Ka) of the occupant JIa, the processing proceeds to step ST36. On the other hand, if it is determined that the heart rate SP of the occupant JIa is below the heart rate threshold SPS(Ka) of the occupant JIa, the processing ends.

Step ST36: Similar to the detection unit KS of embodiment 2, when the heart rate SP of occupant JIa exceeds the individual heart rate threshold SPS (Ka) of occupant JIa, the detection unit KS determines that occupant JIa has an abnormal physical condition TI, i.e., detects that occupant JIa has an abnormal physical condition TI.

Effects of the Third Embodiment
As described above, in the abnormal physical condition detection device TK of embodiment 3, the correction unit HS calculates the individual heart rate thresholds SPS(K) of the occupants JIa, JIb, and JIc, i.e., calculates the individual heart rate thresholds SPS(Ka), SPS(Kb), and SPS(Kc), based on the normal, stable heart rate SP(T) instead of based on the normal heart rate SP(T) as in embodiment 2. This makes it possible to set the individual heart rate thresholds SPS(Ka), SPS(Kb), and SPS(Kc) of the occupants JIa, JIb, and JIc with higher accuracy.

Embodiment 4.
Fourth Embodiment
The abnormal physical condition detection device TK of the fourth embodiment will be described.

The abnormal physical condition detection device TK of embodiment 4 differs from the abnormal physical condition detection devices TK of embodiments 1 to 3 (shown in Figures 1, 4, and 8) in that the correction unit HS corrects the heart rate threshold SPS (step ST14 in embodiment 1, step ST24 in embodiment 2, and step ST34 in embodiment 3) taking into account whether or not body movement TD is occurring in the occupant JI aboard the vehicle SR (particularly, the occupant JI driving the vehicle SR).

<Functions and Hardware Configuration of Fourth Embodiment>
12 is a functional block diagram of the abnormal physical condition detection device TK of embodiment 4. The functions of the abnormal physical condition detection device TK of embodiment 4 will be described below with reference to FIG.

As shown in Figure 12, the abnormal physical condition detection device TK of embodiment 4 includes an imaging unit SE, a calculation unit SS, a judgment unit HT, a correction unit HS, and a detection unit KS, similar to the abnormal physical condition detection device TK of embodiment 1 (shown in Figure 1).

As shown in Figure 12, the abnormal physical condition detection device TK of embodiment 4 differs from the abnormal physical condition detection device TK of embodiment 1 in that it further includes a detection unit KC.

Detection unit KC corresponds to the "detection unit".

The detection unit KC detects whether or not a body movement TD is occurring in an occupant JI who is riding in or driving the vehicle SR, and whether or not the body movement TD of the occupant JI is below a predetermined reference body movement. The detection unit KC performs this detection by, for example, using a conventionally known general algorithm (e.g., OpenPose) to calculate the amount of movement of the occupant JI based on the skeleton of the occupant JI.

Figure 13 shows the relationship between the heart rate SP of occupant JI and the body movement TD of occupant JI in embodiment 4.

As shown in Figure 13, when the occupant JI is experiencing body movement TD while riding in the vehicle SR, i.e., when the occupant JI is swaying, for example, due to the vehicle SR traveling on a rough road, the heart rate SP of the occupant JI differs from when the occupant JI is not swaying and becomes unstable.

The abnormal physical condition detection device TK of embodiment 4 has a hardware configuration similar to that of the abnormal physical condition detection device TK of embodiment 1 (shown in Figure 2).

<Operation of the Fourth Embodiment>
14 is a flowchart showing the operation of the abnormal physical condition detection device TK of embodiment 4. The operation of the abnormal physical condition detection device TK of embodiment 4 will be described below with reference to the flowchart of FIG.

Steps ST41 to ST46: Similar to steps ST11 to ST16 in embodiment 1, steps ST21 to ST26 in embodiment 2, and steps ST31 to ST36 in embodiment 3, the image GZ of the occupant JI is captured by the capture unit SE (shown in Figure 12) and an abnormal physical condition TI is detected by the detection unit KS (shown in Figure 12).

Step ST47: The detection unit KC (shown in Figure 12) detects whether body movement TD is occurring in the occupant JI who is riding in or driving the vehicle SR, and whether the body movement TD of the occupant JI is below the above-mentioned reference body movement.

When it is detected that occupant JI is experiencing body movement TD and that the detected body movement TD of occupant JI is not below the reference body movement, the process proceeds to end. On the other hand, when it is detected that occupant JI is not experiencing body movement TD, or when it is detected that occupant JI is experiencing body movement TD and that the detected body movement TD of occupant JI is below the reference body movement, the process proceeds to step ST42, and steps ST42 to ST46 are subsequently performed, as in embodiments 1 to 3.

Effects of the Fourth Embodiment
As described above, in the abnormal physical condition detection device TK of the fourth embodiment, the detection unit KC detects whether or not the occupant JI in the vehicle SR is experiencing body movement TD and whether or not the body movement TD of the occupant JI is below the reference body movement. Only when it is detected that the body movement TD of the occupant JI is below the reference body movement is the subsequent processing (the processing of steps ST42 to ST46) performed. This allows the detection unit KS to detect whether or not the occupant JI is experiencing an abnormal physical condition TI based on the occupant JI's heart rate SP, which is not affected by the occupant JI's body movement TD, unlike the heart rate SP of the first to third embodiments.

The above-described embodiments may be combined with each other without departing from the spirit of this disclosure, and components within each embodiment may be deleted or modified, or other components may be added, as appropriate.

The abnormal physical condition detection device disclosed herein can be used to prevent situations in which it is not possible to detect that an occupant of a vehicle is experiencing an abnormal physical condition.

GZ image, HS correction unit, HT judgment unit, JI occupant, K storage medium, KC detection unit, KS detection unit, SE photography unit, SP heart rate, SPS heart rate threshold, SS calculation unit, TD body movement, TI physical condition abnormality, TK physical condition abnormality detection device.

Claims (8)

an image capturing unit that captures images of occupants in the vehicle;
a calculation unit that calculates a heart rate of the occupant based on the image;
a determination unit that determines whether the calculated heart rate is stable;
a correction unit that corrects a heart rate threshold for detecting whether the occupant is in an abnormal physical condition based on the heart rate of the occupant based on the result of the determination so that the heart rate threshold when it is determined that the occupant's heart rate is unstable becomes a lower value than the heart rate threshold when it is determined that the occupant's heart rate is stable ;
a detection unit that detects that the occupant is in an abnormal physical condition when the heart rate exceeds the corrected heart rate threshold;
A physical condition abnormality detection device including: The abnormal physical condition is a state of epilepsy.
The abnormal physical condition detection device according to claim 1. The image is acquired by light.
The abnormal physical condition detection device according to claim 1. the determination unit determines whether the heart rate of the occupant is stable by comparing a variance value of the heart rate calculated by the calculation unit with a predetermined reference variance value.
The abnormal physical condition detection device according to claim 1. the correction unit corrects the heart rate threshold value in accordance with a normal heart rate of each occupant.
The abnormal physical condition detection device according to claim 1. the correction unit corrects the heart rate threshold value in accordance with a stable heart rate of each occupant under normal circumstances.
The abnormal physical condition detection device according to claim 1. The vehicle seat further includes a detection unit that detects whether or not the occupant is moving,
the calculation unit calculates the heart rate of the occupant when the detection unit detects that the body movement is lower than a predetermined reference body movement.
The abnormal physical condition detection device according to claim 1. The photographing unit photographs images of the occupants of the vehicle,
a calculation unit that calculates a heart rate of the occupant based on the image;
a determination unit determining whether the calculated heart rate is stable;
a correction unit corrects a heart rate threshold for detecting whether the occupant is in an abnormal physical condition based on the heart rate of the occupant based on the result of the determination so that the heart rate threshold when it is determined that the occupant's heart rate is unstable is lower than the heart rate threshold when it is determined that the occupant's heart rate is stable ,
a detection unit that detects that the occupant is in abnormal physical condition when the heart rate exceeds the corrected heart rate threshold;
A method for detecting abnormal physical condition.