JP7766797B2 - Sensor control device, sensor control method, and sensor control system - Google Patents

Description

The present disclosure relates to a sensor control device, a sensor control method, and a sensor control system.

BACKGROUND ART Conventionally, a technology is known in which a sensor is mounted in a vehicle interior so that its orientation can be changed and which is capable of detecting objects within the vehicle interior, and in which the range in which the sensor detects objects is controlled by controlling the orientation of the sensor.
For example, Patent Document 1 discloses a technology in which a driver of a vehicle operates a three-dimensional position designation device to spatially designate a shooting direction, and the orientation of the camera is controlled so that the camera faces in a direction in which the shooting area based on the designated shooting direction is located at the center of the image.

JP 2012-4809 A

Conventional technology such as that disclosed in Patent Document 1 had the problem that a person had to indicate the desired direction to control the orientation of the sensor.

This disclosure has been made to solve the above-mentioned problems, and aims to provide a sensor control device that can control the orientation of a sensor that is mounted in a vehicle cabin in a manner that allows it to change its orientation and that is capable of detecting objects within the vehicle cabin without the need for human instruction.

The sensor control device according to the present disclosure includes a sensor mounted on the ceiling of a vehicle interior so as to be capable of changing its orientation and capable of detecting an object within the vehicle interior, an orientation setting information acquisition unit that acquires orientation setting information used to set a target angle for the orientation of the sensor, and a sensor that can detect an object, including an abandoned object, that is present on or under a seat within the vehicle interior according to the orientation setting information acquired by the orientation setting information acquisition unit, and that can capture an image of an area including the seating surfaces, backrests, and headrests of the front seats where occupants of the front seats may be present, and an area including the seating surfaces of the rear seats. and an angle varied from the target angle and capable of capturing an image of the area in which a rear seat occupant may be present, including the seat surface, backrest, and headrest of the rear seat, and capable of detecting the state of the rear seat occupant ; a target setting unit that selectively sets a target angle for the target angle; a sensor information acquisition unit that acquires sensor information related to the sensor; an orientation detection unit that detects the current orientation of the sensor based on the sensor information acquired by the sensor information acquisition unit; and an orientation control unit that changes the orientation of the sensor until the current orientation of the sensor detected by the orientation detection unit matches the target angle set by the target setting unit.

According to the present disclosure, it is possible to control the orientation of a sensor that is mounted in a vehicle cabin in such a way that its orientation can be changed and that can detect objects within the vehicle cabin, without the need for human instruction.

1 is a diagram illustrating an example of the configuration of a sensor control device according to a first embodiment; FIG. 2 is a diagram for explaining a configuration example of a camera as a sensor in the first embodiment. 10A and 10B are diagrams for explaining an example of the installation position of a camera as a sensor and an orientation according to a situation detection function in embodiment 1. 10 is a flowchart for explaining an operation of the sensor control device in a sensor orientation control process performed by the sensor control device according to the first embodiment. 5 is a flowchart for explaining details of an example of processing by a target setting unit in step ST2 of FIG. 4; 4 is a flowchart for explaining an operation of the sensor control device in a situation detection process performed by the sensor control device according to the first embodiment. 10 is a flowchart for explaining the operation of the target setting unit in the first embodiment when the target setting unit sets a target angle using information other than vehicle information, in this case, timer information, as orientation setting information. 8A and 8B are diagrams illustrating an example of a hardware configuration of a sensor control device according to the first embodiment.

To explain the present disclosure in more detail, the following describes the form for implementing the present disclosure with reference to the accompanying drawings.

Embodiment 1.
FIG. 1 is a diagram illustrating an example of the configuration of a sensor control device 1 according to the first embodiment.
The sensor control device 1 according to the first embodiment is mounted on, for example, a vehicle. The sensor control device 1 is connected to a sensor 2, and the sensor control device 1 and the sensor 2 together constitute a sensor control system 100.

Sensor 2 is a sensor mounted in the vehicle cabin in such a way that its orientation can be changed and that can detect objects within the vehicle cabin. Sensor 2 is, for example, a camera, a Time of Flight (ToF) sensor, an ultrasonic sensor, an infrared sensor, or a millimeter-wave radar.

The sensor control device 1 has a function to control the orientation of the sensor 2 (hereinafter referred to as the "sensor orientation control function") and a function to detect the situation inside the vehicle cabin based on information about the sensor 2 obtained from the sensor 2 (hereinafter referred to as the "sensor information") (hereinafter referred to as the "situation detection function").
The situation detection function includes various functions. In the first embodiment, as an example, the situation detection function includes a "seat surrounding object detection function" that detects an object present above or below a seat in the vehicle interior (so-called an abandoned object), and a "rear seat occupant detection function" that detects the presence or absence of a rear seat occupant in the vehicle interior (hereinafter referred to as a "rear seat occupant"), whether the rear seat occupant is fastening a seat belt, the physique of the rear seat occupant, etc.

As described above, the sensor control device 1 has a sensor orientation control function and controls the orientation of the sensor 2 .
The sensor control device 1 sets the direction in which the sensor 2 should be directed based on information used to set the direction in which the sensor 2 should be directed (hereinafter referred to as "orientation setting information"), and controls the direction of the sensor 2 so that the sensor 2 faces in the set direction.

For example, the sensor control device 1 determines the situation detection function to be executed based on the orientation setting information, sets the orientation in which the sensor 2 should be pointed depending on the determined situation detection function, and controls the orientation of the sensor 2 to that orientation. In detail, for example, the sensor control device 1 determines whether to execute the seat surrounding object detection function or the rear seat occupant detection function based on the orientation setting information, sets the orientation in which the sensor 2 should be pointed depending on whether to execute the seat surrounding object detection function or the rear seat occupant detection function, and controls the orientation of the sensor 2 to that orientation.

In embodiment 1, the range that sensor 2 should detect is determined depending on the situation detection function being executed. If the situation detection function includes multiple functions, the range that sensor 2 should detect for each function may be determined in advance. In other words, as in embodiment 1, the range that sensor 2 should detect depending on the seat surrounding object detection function and the range that sensor 2 should detect depending on the rear seat occupant detection function may each be determined in advance.

As described above, the sensor control device 1 has a situation detection function (a seat surrounding object detection function and a rear seat occupant detection function) and detects the situation inside the vehicle cabin.
The sensor control device 1 controls the orientation of the sensor 2 using the sensor orientation control function, and then detects the situation inside the vehicle cabin based on the sensor information acquired from the sensor 2 .

An example configuration of the sensor control device 1 according to embodiment 1, and details of the sensor orientation control function and situation detection function performed by the sensor control device 1, will be described later using specific examples.

In the following first embodiment, the sensor 2 is assumed to be a camera, for example. The camera is an imaging device mounted in the vehicle interior so that its orientation can be changed and which is capable of capturing images of the interior of the vehicle interior.
In the first embodiment, the camera is assumed to be a camera mounted on the vehicle separately from a camera included in a so-called "Driver Monitoring System (DMS)" that is mounted on the vehicle to monitor the state of the driver inside the vehicle cabin, but this is merely an example. The camera may also be a camera shared with the DMS.

FIG. 2 is a diagram for explaining an example of the configuration of the camera 21 as the sensor 2 in the first embodiment.
FIG. 3 is a diagram for explaining an example of the installation position of the camera 21 as the sensor 2 in the first embodiment and an example of the orientation according to the situation detection function.
The camera 21 shown in FIG. 2 is installed inside the vehicle cabin and viewed from the left side relative to the direction of travel.
Figure 3 is a diagram of the interior of a vehicle equipped with a camera 21 as shown in Figure 2, viewed from the left side relative to the direction of travel of the vehicle. In Figure 3, the vehicle is a left-hand drive vehicle, D indicates the driver, DS indicates the driver's seat, P indicates rear seat passengers (hereinafter referred to as "rear seat passengers"), PS indicates the rear seats, H indicates the steering wheel, and C indicates the ceiling.
2 and 3, the direction of the X axis corresponds to the width direction of the vehicle, the direction of the Y axis corresponds to the downward direction of the vehicle, and the direction of the Z axis corresponds to the direction opposite to the traveling direction of the vehicle, i.e., the rearward direction with respect to the traveling direction of the vehicle.
For ease of explanation, only the camera 21 is shown in Fig. 2. For ease of explanation, only the camera 21, the driver, the driver's seat, the rear seat passengers, the rear seats, the steering wheel, and the ceiling are shown in Fig. 3.

The camera 21 is installed on the ceiling inside the vehicle.
2, the camera 21 has a movable shaft (indicated by MS in FIG. 2) that adjusts the orientation of the camera 21 in the forward/backward direction relative to the traveling direction of the vehicle when the camera 21 is installed in the vehicle cabin, and a drive device (indicated by M in FIG. 2) that operates the movable shaft in response to a control signal from the sensor control device 1 to change the orientation of the camera 21. The drive device is, for example, a motor such as a stepping motor.
In the first embodiment, as an example, the camera 21 is configured to be able to change its orientation in the forward and backward directions relative to the traveling direction of the vehicle within a range from a direction facing directly downward when installed in the vehicle cabin to a direction facing backward by a preset angle (indicated by X in FIG. 2) as shown in Fig. 2. Note that in the first embodiment, "directly downward" is not limited to strictly directly downward, but also includes approximately directly downward.
For example, the orientation of the camera 21 is expressed as an angle that increases as the camera 21 faces rearward relative to the traveling direction of the vehicle, with the orientation of the camera 21 facing directly downward as a reference, being 0 degrees. In other words, the orientation of the camera 21 can be changed within a range of, for example, 0 degrees to X degrees.

For example, the camera 21 is installed on the ceiling above the front seats inside the vehicle, as shown in FIG.
As shown in Fig. 3A, when the camera 21 is pointed most forward in the direction of travel of the vehicle, in other words, when it is facing directly downward, it captures an image of an area including the seating surface, backrest, and headrest of the front seat, where a front seat occupant (the driver in Fig. 3) may be present, and an area including the seating surface of the rear seat, where a rear seat occupant may be present. In Fig. 3A, the image capturing area of the camera 21 is indicated by "E1".
On the other hand, when the camera 21 is pointed farthest rearward relative to the direction of travel of the vehicle, in other words, when the camera 21 is turned by an angle of X degrees from a state in which it is pointed straight down, it captures an image of the area in which rear seat occupants may be present, including the seat surface, backrest, and headrest of the rear seat. In Figure 3B, the imaging range of the camera 21 is indicated by "E2".

In the first embodiment, as an example, when the seat peripheral object detection function among the situation detection functions is executed, the imaging range to be captured by the camera 21 is determined as the imaging range E1 in Fig. 3A. In other words, when the seat peripheral object detection function is executed, it is determined in advance that the direction to which the camera 21 should be directed is directly below.
Furthermore, when the rear seat occupant detection function of the situation detection function is executed, the imaging range to be captured by the camera 21 is assumed to be predetermined as the imaging range indicated by E2 in Fig. 3B. In other words, when the rear seat occupant detection function is executed, the direction to which the camera 21 should be directed is assumed to be predetermined as X degrees.

When the sensor control device 1 determines that the seat surrounding object detection function should be executed, it controls the camera 21 to face directly downward so that the camera 21 captures the image range shown by E1 in Figure 3A. Furthermore, when the sensor control device 1 determines that the rear seat occupant detection function should be executed, it controls the camera 21 to face in the X degree direction so that the camera 21 captures the image range shown by E2 in Figure 3B.

Returning to FIG. 1, an example of the configuration of the sensor control device 1 will be described.
As shown in Figure 1, the sensor control device 1 includes an orientation setting information acquisition unit 11, a target setting unit 12, a sensor information acquisition unit 13, an orientation detection unit 14, an orientation control unit 15, a situation detection unit 16, and a detection result output unit 17.

The orientation setting information acquisition unit 11 acquires orientation setting information used to set the orientation in which the camera 21 should be pointed. In embodiment 1, the orientation in which the camera 21 should be pointed is also referred to as the "target angle of the orientation of the camera 21." In other words, the orientation setting information acquisition unit 11 acquires orientation setting information used to set the target angle of the orientation of the camera 21. In the following description, when the term "target angle" is simply used, this "target angle" means the "target angle of the orientation of the camera 21."

The orientation setting information is, for example, information related to the vehicle (hereinafter referred to as "vehicle information"). The vehicle information includes, for example, information indicating the status of the vehicle's engine (for example, whether the engine is running or not), vehicle speed, information indicating the presence or absence of a driver in the vehicle cabin, or information indicating whether the vehicle doors are open or closed.
The orientation setting information acquisition unit 11 may acquire information indicating the status of the vehicle's engine from, for example, an ignition switch (not shown) mounted on the vehicle. The orientation setting information acquisition unit 11 may also acquire vehicle speed from, for example, a vehicle speed sensor (not shown) mounted on the vehicle. The orientation setting information acquisition unit 11 may also acquire information indicating the presence or absence of a driver from, for example, a DMS (not shown). The orientation setting information acquisition unit 11 may also acquire information indicating whether the vehicle's doors are open or closed from a door sensor mounted on the vehicle.
In addition, the vehicle information acquired by the orientation setting information acquisition unit 11 may include multiple types of information, such as information indicating the status of the vehicle's engine, vehicle speed, information indicating whether or not a driver is present in the vehicle cabin, or information on whether the vehicle's doors are open or closed, as described above.
The orientation setting information acquisition unit 11 outputs the acquired orientation setting information, in this case, vehicle information, to the target setting unit 12 .

The target setting unit 12 sets the target angle based on the orientation setting information acquired by the orientation setting information acquisition unit 11, in this case vehicle information.

Here, an example of a method for setting a target angle by the target setting unit 12 will be described.
For example, the target setting unit 12 first determines a function to be executed from among the situation detection functions executable in the vehicle based on the orientation setting information, which is vehicle information in this case. The situation detection functions executable in the vehicle determined by the target setting unit 12 are the seat surrounding object detection function and the rear seat occupant detection function in this case. That is, the target setting unit 12 determines whether the seat surrounding object detection function or the rear seat occupant detection function should be executed based on the vehicle information.

For example, the target setting unit 12 determines whether to execute the seat surrounding object detection function or the rear seat occupant detection function by comparing the vehicle information with conditions for determining the function to be executed (hereinafter referred to as "function determination conditions"). The function determination conditions are generated in advance by an administrator or the like and stored in a location that can be referenced by the sensor control device 1.

For example, if the situation inside the vehicle is such that there is a possibility that an infant or a small child will be left behind, it is desirable to detect whether or not such a child has been left behind inside the vehicle. On the other hand, if the situation inside the vehicle is such that there is a low possibility that an infant or a small child will be left behind, it is desirable to detect the condition of the occupants in the vehicle rather than whether or not such a child has been left behind inside the vehicle.
The administrator or the like generates function determination conditions so that if the situation inside the vehicle cabin predicted based on the vehicle information is, for example, a situation where there is a possibility that an infant or young child will be left behind, the seat surrounding object detection function is executed, and if the situation is one where there is a low possibility that an infant or young child will be left behind, the rear seat occupant detection function, which detects the situation of the occupants inside the vehicle cabin rather than detecting leaving something behind, is executed.

The function determination conditions include, for example, the following conditions <Condition 1> to <Condition 3>.

<Condition 1>
When the engine is running, the rear seat occupant detection function is executed, and when the engine is not running, the seat surrounding object detection function is executed.

<Condition 2>
When the vehicle is moving, the rear seat occupant detection function is executed, and when the vehicle is stopped, the seat surrounding object detection function is executed.

<Condition 3>
If the driver is present in the vehicle, the rear seat occupant detection function is executed, and if the driver is not present in the vehicle, the seat surrounding object detection function is executed.

For example, the target setting unit 12 determines whether the engine is running based on information indicating the status of the vehicle engine, which is included in the vehicle information. If the target setting unit 12 determines that the engine is running, it determines that the rear seat occupant detection function should be executed, and if the target setting unit 12 determines that the engine is not running, it determines that the seat surrounding object detection function should be executed (determination based on <Condition 1>).
If the engine is running, it is assumed that there is an occupant in the vehicle, and it is unlikely that an infant or child has been left inside the vehicle. Conversely, if the engine is not running, the vehicle is stopped, there is no occupant in the vehicle, and it is assumed that there is a possibility that an infant or child has been left inside the vehicle.

Furthermore, for example, the target setting unit 12 determines whether the vehicle is moving based on the vehicle speed included in the vehicle information. For example, if the vehicle speed is equal to or less than a predetermined threshold (hereinafter referred to as the "moving determination threshold"), the target setting unit 12 determines that the vehicle is stopped, in other words, not moving, and if the vehicle speed is greater than the moving determination threshold, the target setting unit 12 determines that the vehicle is moving. If the target setting unit 12 determines that the vehicle is moving, the target setting unit 12 determines that the rear seat occupant detection function should be executed, and if the target setting unit 12 determines that the vehicle is not moving, the target setting unit 12 determines that the seat surrounding object detection function should be executed (determination based on <Condition 2>).
If the vehicle is moving, it is assumed that there are occupants in the vehicle and that there is little possibility that an infant or child has been left behind inside the vehicle. Conversely, if the vehicle is stopped, it is assumed that there are no occupants in the vehicle and that there is a possibility that an infant or child has been left behind inside the vehicle.

For example, the target setting unit 12 may determine whether the vehicle is moving based on the vehicle speed and vehicle door open/close information included in the vehicle information. For example, the target setting unit 12 may determine that the vehicle is stopped, in other words, not moving, when the vehicle speed is equal to or less than the moving determination threshold and the door is open, and may determine that the vehicle is moving when the door is closed even if the vehicle speed is equal to or less than the moving determination threshold, or when the vehicle speed is greater than the moving determination threshold. In this way, the target setting unit 12 may determine whether to execute the rear seat occupant detection function or the seat surrounding object detection function based on multiple different types of orientation setting information.
If the vehicle speed is below the threshold for determining whether the vehicle is moving and the door is open, it is assumed that the vehicle is stopped and the occupants are getting out. In such a situation, it is assumed that there is a possibility that the occupants may have left their belongings behind inside the vehicle.

Furthermore, for example, the target setting unit 12 determines whether or not a driver is present in the vehicle cabin based on information indicating the presence or absence of a driver in the vehicle cabin, which is included in the vehicle information. If the target setting unit 12 determines that a driver is present in the vehicle cabin, it determines that the rear seat occupant detection function should be executed, and if it determines that a driver is not present in the vehicle cabin, it determines that the seat surrounding object detection function should be executed (determination based on <Condition 3>).
If the driver is present in the vehicle, it is assumed that there is a low possibility that an infant or child has been left behind in the vehicle. Conversely, if the driver is not present in the vehicle, the vehicle is stopped, there are no other occupants in the vehicle other than the driver, and it is assumed that there is a possibility that an infant or child has been left behind in the vehicle.

When the target setting unit 12 determines whether the seat surrounding object detection function or the rear seat occupant detection function should be executed, it sets the orientation of the camera 21 according to the determined function as the target angle.
Specifically, when the target setting unit 12 determines that the seat peripheral object detection function should be executed, it sets the orientation of the camera 21 corresponding to the seat peripheral object detection function (i.e., 0 degrees in this case) as the target angle. On the other hand, when the target setting unit 12 determines that the rear seat occupant detection function should be executed, it sets the orientation of the camera 21 corresponding to the rear seat occupant detection function (i.e., X degrees in this case) as the target angle.
For example, information (hereinafter referred to as "angle setting information") in which a situation detection function is associated with a target angle is generated in advance and stored in a location that can be referenced by the sensor control device 1. The target setting unit 12 may set a target angle by matching the situation detection function that has been determined to be executed with the angle setting information.

The target setting unit 12 outputs information indicating the set target angle (hereinafter referred to as "target angle information") to the orientation control unit 15.

Here, when the target angle is set, the target setting unit 12 outputs target angle information to the orientation control unit 15, and stores the set target angle as the latest target angle in a location that can be referenced by the sensor control device 1. The target setting unit 12 updates the latest target angle every time a target angle is set.
For example, when the orientation control unit 15 acquires target angle information from the target setting unit 12, the latest target angle may be stored.

The sensor information acquisition unit 13 acquires sensor information from the camera 21 .
The sensor information includes at least information relating to the result of the camera 21 detecting an object inside the vehicle cabin, specifically, an image of the interior of the vehicle cabin captured by the camera 21, and information for detecting the orientation of the camera 21. The information for detecting the orientation of the camera 21 includes, for example, information relating to a rotary encoder (not shown in FIG. 2 ) included in the camera 21, information relating to the number of steps of a stepping motor that is a drive device included in the camera 21, etc.
The sensor information acquisition unit 13 outputs the acquired sensor information to the orientation detection unit 14 and the situation detection unit 16 .

The orientation detection unit 14 detects the current orientation of the camera 21 based on the sensor information acquired by the sensor information acquisition unit 13. Specifically, the orientation detection unit 14 detects the current orientation of the camera 21 based on information for detecting the orientation of the camera 21, which is included in the sensor information acquired by the sensor information acquisition unit 13. The orientation detection unit 14 can detect the current orientation of the camera 21 based on information about a rotary encoder included in the camera 21 or information about the number of steps of a stepping motor. Alternatively, for example, the orientation detection unit 14 may detect the current orientation of the camera 21 based on a captured image. The positions of structures within the vehicle cabin and the installation position and angle of view of the camera 21 are known in advance. The structures within the vehicle cabin are, for example, window frames or pillars. The orientation detection unit 14 can detect the current orientation of the camera 21 based on the positions of the structures within the vehicle cabin captured in the captured image, the positions of the structures within the vehicle cabin, and the installation position of the camera 21.
The orientation detection unit 14 outputs information relating to the detected current orientation of the camera 21 (hereinafter referred to as “orientation information”) to the orientation control unit 15 .

The orientation control unit 15 changes the orientation of the camera 21 until the current orientation of the camera 21 detected by the orientation detection unit 14 matches the target angle set by the target setting unit 12 .
Specifically, when the orientation control unit 15 acquires the target angle information from the target setting unit 12, it outputs a control signal to a driving device such as a stepping motor of the camera 21 to operate a movable axis. Note that the control signal includes, for example, a signal indicating the target angle. Furthermore, for example, the control signal may include a signal indicating whether the orientation of the camera 21 should be changed to a positive direction or a negative direction. For example, the orientation control unit 15 stores a history of target angles previously set by the target setting unit 12. The orientation control unit 15 can determine whether the orientation of the camera 21 should be changed to a positive direction or a negative direction by comparing the latest target angle with the immediately previous target angle.
When the orientation control unit 15 outputs a control signal, the orientation of the camera 21 is changed, for example, to the direction of the target angle instructed by the control signal, or to the direction instructed by the control signal.

When the orientation control unit 15 outputs a control signal to the camera 21, it determines whether the orientation of the camera 21 has reached the target angle based on the current orientation of the camera 21 detected by the orientation detection unit 14 after the control signal was output. The orientation control unit 15 may determine whether the orientation of the camera 21 has reached the target angle by comparing the current orientation of the camera 21 detected by the orientation detection unit 14 with the latest target angle stored.
If it is determined that the orientation of the camera 21 is not at the target angle, the orientation control unit 15 continues to output a control signal to the camera 21 to operate the movable axis, thereby changing the orientation of the camera 21.
When it is determined that the orientation of camera 21 has reached the target angle, orientation control unit 15 stops changing the orientation of camera 21. For example, orientation control unit 15 may stop outputting a control signal to the drive device of camera 21 that causes the movable axis to operate, or may output a control signal to stop the operation of the movable axis instead of outputting a control signal to the drive device of camera 21 that causes the movable axis to operate.

For example, the orientation control unit 15 may output a control signal to the camera 21 to operate the movable axis only when there is a difference between the latest target angle and the immediately previous target angle, and may not output the control signal if there is no difference between the latest target angle and the immediately previous target angle, assuming that the orientation of the camera 21 will not change. This allows the orientation control unit 15 to reduce the output of unnecessary control signals to the camera 21.

Also, for example, the target setting unit 12 may set a target angle and output target angle information to the orientation control unit 15 only when the determined situation detection function differs from the previously set target angle, i.e., the situation detection function corresponding to the most recent stored target angle. Note that the target setting unit 12 can determine whether the determined situation detection function differs from the previously set target angle based on the angle setting information. For example, the target setting unit 12 may set a target angle and output target angle information to the orientation control unit 15 only when the content of the orientation setting information has changed. If target angle information is not output from the target setting unit 12, the orientation control unit 15 will not output a control signal to the camera 21 to operate the movable axis. In this way, the orientation control unit 15 can reduce the output of unnecessary control signals to the camera 21.

The situation detection unit 16 detects the situation inside the vehicle cabin based on information (here, captured images) regarding the results of the camera 21 detecting objects inside the vehicle cabin, which is included in the sensor information acquired by the sensor information acquisition unit 13.
The situation detection unit 16 detects the situation inside the vehicle cabin based on the sensor information in accordance with the situation detection function that the target setting unit 12 has determined to be executed. The situation detection unit 16 may acquire information about the situation detection function that the target setting unit 12 has determined to be executed from the target setting unit 12 or via the orientation control unit 15. The arrow from the target setting unit 12 to the situation detection unit 16 is omitted in FIG. 1 .

For example, if the target setting unit 12 determines that the rear seat occupant detection function should be executed, the situation detection unit 16 performs, based on the captured image, the detection of the presence or absence of rear seat occupants, whether the rear seat occupants are fastening their seat belts, or the physical build of the rear seat occupants, etc. The situation detection unit 16 may use a known image recognition processing technique to perform the detection of the presence or absence of rear seat occupants, whether the rear seat occupants are fastening their seat belts, or the physical build of the rear seat occupants, etc.
When the target setting unit 12 determines that the rear seat occupant detection function should be executed, the orientation control unit 15 controls the orientation of the camera 21 to an orientation (here, X degrees) corresponding to the rear seat occupant detection function. When the orientation of the camera 21 is turned to X degrees, the camera 21 captures an image of the imaging range indicated by E2 in Fig. 3B. Based on the captured image capturing the imaging range indicated by E2 in Fig. 3B, in other words, based on the captured image capturing the range where a rear seat occupant may be present, the situation detection unit 16 can detect the presence or absence of a rear seat occupant, whether the rear seat occupant is fastening a seat belt, or the physical build of the rear seat occupant.

Furthermore, for example, if the target setting unit 12 determines that the seat surrounding object detection function should be executed, the situation detection unit 16 performs, based on the captured image, the detection of the presence or absence of a child in a child seat installed on the seat, the presence or absence of a child crawling under the seat, the detection of objects under the seat or at the feet, etc. The situation detection unit 16 may use a known image recognition processing technique to perform the detection of the presence or absence of a child in a child seat installed on the seat, the presence or absence of a child crawling under the seat, the detection of objects under the seat or at the feet, etc.
When the target setting unit 12 determines that the seat peripheral object detection function should be executed, the orientation control unit 15 controls the orientation of the camera 21 to an orientation corresponding to the seat peripheral object detection function (here, 0 degrees). When the orientation of the camera 21 is 0 degrees, the camera 21 captures an image of the imaging range indicated by E1 in Fig. 3A. Based on the captured image of the imaging range indicated by E1 in Fig. 3A, in other words, based on the captured image of a wide range including the front and rear seats in the vehicle interior, the situation detection unit 16 can detect the presence or absence of a child in a child car seat installed on a seat, the presence or absence of a child crawling under the seat, and objects under the seat or at the feet.

It should be noted that, between the time when the target setting unit 12 determines that the seat surrounding object detection function or rear seat occupant detection function should be executed and the time when the orientation of the camera 21 reaches the target angle based on the control of the orientation control unit 15, the situation detection unit 16 may begin detecting the situation inside the vehicle cabin according to the seat surrounding object detection function or rear seat occupant detection function that the target setting unit 12 has determined should be executed. If the situation detection unit 16 begins detecting the situation inside the vehicle cabin before the orientation of the camera 21 reaches the target angle, the accuracy of the detection may be reduced.

Therefore, for example, when the orientation control unit 15 has completed changing the orientation of the camera 21 to the target angle, it may output a completion notification to the situation detection unit 16 indicating that the change in orientation of the camera 21 has been completed, and when the completion notification is output from the orientation control unit 15, the situation detection unit 16 may start detecting the situation inside the vehicle cabin according to the situation detection function determined to be executed by the target setting unit 12. The situation detection unit 16 waits for the orientation to be determined to be according to the situation detection function determined to be executed by the target setting unit 12, in other words, waits for the change in orientation of the camera 21 to the target angle to be completed, before starting to detect the situation inside the vehicle cabin, thereby preventing a decrease in the accuracy of the detection.

Furthermore, for example, after the orientation control unit 15 changes the orientation of the camera 21, the target angle may be updated to a different angle, causing the orientation control unit 15 to change the orientation of the camera 21 to another target angle. In this case, after the orientation control unit 15 starts changing the orientation of the camera 21, until the change in the orientation of the camera 21 is completed, in other words, when the orientation of the camera 21 is not at the target angle, the situation detection unit 16 may start detecting the situation inside the vehicle cabin according to the seat surrounding object detection function or the rear seat occupant detection function.
Therefore, for example, when the orientation control unit 15 starts changing the orientation of the camera 21, it outputs a start notification to the situation detection unit 16 indicating that the change in orientation of the camera 21 has started, and when the start notification is output from the orientation control unit 15, the situation detection unit 16 may thereafter not detect the situation inside the vehicle cabin according to the situation detection function until a completion notification is output.
For example, the orientation control unit 15 compares the latest target angle with the immediately previous target angle, and if there is a difference between the latest target angle and the immediately previous target angle, outputs a start notification to the situation detection unit 16 .
Even in this case, the situation detection unit 16 waits for the camera 21 to be oriented in accordance with the situation detection function determined by the target setting unit 12 to be executed, in other words, waits for the camera 21 to have completely changed its orientation to the target angle before starting to detect the situation inside the vehicle cabin, thereby preventing a decrease in the accuracy of the detection.

The situation detection unit 16 outputs information relating to the results of detecting the situation inside the vehicle cabin (hereinafter referred to as “detection result information”) to the detection result output unit 17 .
For example, when the situation inside the vehicle cabin satisfies a condition for issuing a warning to the vehicle occupants or people around the vehicle (hereinafter referred to as a "warning condition"), the situation detection unit 16 outputs information for issuing a warning to the vehicle occupants or people around the vehicle (hereinafter referred to as "warning information") as detection result information to the detection result output unit 17. The warning condition is generated in advance by an administrator or the like and stored in a location that can be referenced by the situation detection unit 16. The warning condition may be, for example, "the rear seat occupant detection function detects that the rear seat occupant is not fastening a seat belt" or "the seat surrounding object detection function detects that an infant or toddler has been detected."
Furthermore, for example, the situation detection unit 16 outputs information relating to the detected physique of the rear seat occupant to the detection result output unit 17 as detection result information.

The detection result output unit 17 outputs the detection result information output from the situation detection unit 16 to various devices (not shown).
For example, when warning information is output as detection result information from the situation detection unit 16, the detection result output unit 17 outputs the warning information to the audio output device, causing a warning sound or a warning message to be output. Furthermore, when warning information is output as detection result information from the situation detection unit 16, the detection result output unit 17 outputs the warning information to the display device, causing a warning message to be displayed. The audio output device is, for example, a speaker included in a navigation device mounted on the vehicle, or a speaker included in a mobile terminal carried by a vehicle occupant. Furthermore, the display device is, for example, a display included in a navigation device mounted on the vehicle, or a display included in a mobile terminal carried by a vehicle occupant.
Furthermore, for example, when warning information indicating that an infant has been detected is output from the situation detection unit 16, the detection result output unit 17 may cause application software of a mobile device carried by a vehicle occupant to display a warning indicating that an infant has been left behind, or may cause a warning sound to be output from a speaker of the mobile device. The detection result output unit 17 may combine the display of a warning indicating that an infant has been left behind with the output of a warning sound. Note that the warning information includes, for example, information indicating the content of the warning condition that the situation detection unit 16 has determined to be satisfied.
Furthermore, for example, when the situation detection unit 16 outputs information on the physique of a rear seat occupant as detection result information, the detection result output unit 17 outputs the detection result information to the seat belt control device.

The operation of the sensor control device 1 according to the first embodiment will be described.
The sensor control device 1 according to the first embodiment performs processing based on a sensor orientation control function (hereinafter referred to as "sensor orientation control processing") and processing based on a situation detection function (hereinafter referred to as "situation detection processing").
First, the operation of the sensor control device 1 in the sensor orientation control process performed by the sensor control device 1 will be described.

FIG. 4 is a flowchart for explaining the operation of the sensor control device 1 in the sensor orientation control process performed by the sensor control device 1 according to the first embodiment.
For example, when the power supply of the vehicle is turned on, the sensor control device 1 repeatedly performs the operation shown in the flowchart of FIG. 4 until the power supply of the vehicle is turned off.
Furthermore, for example, while the vehicle engine is running, the sensor control device 1 repeatedly performs the operations shown in the flowchart of Fig. 4. After the engine has stopped and a certain period of time has elapsed, the power to the sensor control system 100 is turned off to reduce battery consumption.

The orientation setting information acquisition unit 11 acquires orientation setting information (step ST1).
The orientation setting information acquisition unit 11 outputs the acquired orientation setting information, in this case, vehicle information, to the target setting unit 12 .

The target setting unit 12 sets a target angle based on the vehicle information acquired by the orientation setting information acquisition unit 11 in step ST1 (step ST2).
The target setting unit 12 outputs the target angle information to the orientation control unit 15 .

When the orientation control unit 15 acquires target angle information from the target setting unit 12 in step ST2, it outputs a control signal to a driving device such as a stepping motor possessed by the camera 21 to operate the movable axis, thereby changing the orientation of the camera 21 (step ST3).

For example, in step ST3, the orientation control unit 15 may output a control signal to the camera 21 to operate the movable axis only if there is a difference between the latest target angle and the immediately previous target angle, and may not output the control signal if there is no difference between the latest target angle and the immediately previous target angle, assuming that the orientation of the camera 21 will not be changed.
If the orientation control unit 15 does not output a control signal, the processing of the sensor control device 1 ends.

The sensor information acquisition unit 13 acquires sensor information from the camera 21 (step ST4).
The sensor information acquisition unit 13 outputs the acquired sensor information to the orientation detection unit 14 and the situation detection unit 16 .

The orientation detection unit 14 detects the current orientation of the camera 21 based on the information for detecting the orientation of the camera 21, which is included in the sensor information acquired by the sensor information acquisition unit 13 in step ST4 (step ST5).
The orientation detection unit 14 outputs the orientation information to the orientation control unit 15 .

When the orientation control unit 15 changes the orientation of the camera 21 in step ST3, specifically, when it outputs a control signal to the camera 21 to operate the movable axis, it determines whether the orientation of the camera 21 has reached the target angle from the current orientation of the camera 21 detected by the orientation detection unit 14 in step ST5 after outputting the control signal (step ST6).

If it is determined in step ST6 that the orientation of the camera 21 is not at the target angle (if the answer is "NO" in step ST6), the processing of the sensor control device 1 returns to the processing of step ST3, and the orientation control unit 15 continues to output a control signal to the camera 21 to operate the movable axis, thereby changing the orientation of the camera 21.

If it is determined in step ST6 that the orientation of the camera 21 has reached the target angle ("YES" in step ST6), the orientation control unit 15 causes the camera 21 to stop changing its orientation. The processing of the sensor control device 1 then ends.

Figure 5 is a flowchart illustrating details of an example of processing by the goal setting unit 12 in step ST2 of Figure 4.

The target setting unit 12 compares the orientation setting information, in this case vehicle information, with the function determination conditions (step ST21) and determines whether the seat surrounding object detection function or the rear seat occupant detection function should be executed (step ST22).

If it is determined in step ST22 that the seat surrounding object detection function should be executed (if "YES" in step ST22), the target setting unit 12 sets the orientation of the camera 21 corresponding to the seat surrounding object detection function to a target angle (step ST23).

On the other hand, if it is determined in step ST22 that the rear seat occupant detection function should be executed (if the answer is "NO" in step ST22), the target setting unit 12 sets the orientation of the camera 21 corresponding to the rear seat occupant detection function to a target angle (step ST24).

For example, in steps ST22 and ST24, the target setting unit 12 may determine whether the situation detection function (seat surrounding object detection function or rear seat occupant detection function) determined in step ST22 is different from the situation detection function corresponding to the previous target angle, and only if it is different, set a target angle for the orientation of the camera 21 and output target angle information to the orientation control unit 15.
Also, for example, in step ST22, the target setting unit 12 may determine whether the content of the orientation setting information has changed, and set the target angle only if the content of the orientation setting information has changed, and output the target angle information to the orientation control unit 15.
If the target setting unit 12 does not output the target angle information to the orientation control unit 15, the processing of the sensor control device 1 ends.

In this way, the sensor control device 1 sets the target angle for the orientation of the camera 21 based on the orientation setting information, here, vehicle information, and then changes the orientation of the camera 21 until the orientation of the camera 21 reaches the target angle. The sensor control device 1 detects the current orientation of the camera 21 based on the sensor information, and determines whether the orientation of the camera 21 has reached the target angle from the detected current orientation of the camera 21.
This allows the sensor control device 1 to control the orientation of the camera 21 without requiring instructions from a person, thereby reducing the hassle of instructing the vehicle occupants on the orientation of the sensor 2.
Furthermore, if the occupant were to manually adjust the orientation of the camera 21 each time to orient it to detect an abandoned infant, the occupant's attention would be focused on the abandoned item or infant at that point, significantly reducing the possibility of the abandoned item or infant occurring in the first place. To detect the occurrence of an abandoned item or infant, the on-seat object detection function must operate automatically. The sensor control device 1 can control the orientation of the camera 21 to an orientation that can detect the occurrence of an abandoned item or infant when the occupant's attention is not focused on the abandoned item or infant.

The sensor control device 1 determines the situation detection function (seat surrounding object detection function or rear seat occupant detection function) to be executed in the vehicle based on the vehicle information, and sets the target angle based on the determined situation detection function.
This allows the sensor control device 1 to control the orientation of the camera 21 so as to obtain captured images that allow the situation detection function to be performed with high accuracy, without the need for human instructions.

Next, the operation of the sensor control device 1 in the situation detection process performed by the sensor control device 1 will be described.
FIG. 6 is a flowchart for explaining the operation of the sensor control device 1 in the situation detection process performed by the sensor control device 1 according to the first embodiment.
For example, when the power supply of the vehicle is turned on, the sensor control device 1 repeatedly performs the operation shown in the flowchart of Fig. 6 until the power supply of the vehicle is turned off. Also, for example, the sensor control device 1 may not perform the operation shown in the flowchart of Fig. 6 from the time it determines that a change in the orientation of the camera 21 has started in the sensor orientation control process until it determines that the change in the orientation of the camera 21 has been completed.
Furthermore, for example, while the vehicle engine is running, the sensor control device 1 repeatedly performs the operations shown in the flowchart of Fig. 6. After the engine has stopped and a certain period of time has elapsed, the power to the sensor control system 100 is turned off to reduce battery consumption.

The situation detection unit 16 acquires sensor information from the sensor information acquisition unit 13 (step ST101) that has been acquired by the sensor information acquisition unit 13 (see step ST4 in Figure 4).

Then, the situation detection unit 16 detects the situation inside the vehicle cabin based on the captured image included in the sensor information acquired in step ST101 (step ST102).
In step ST102, the situation detection unit 16 detects the situation inside the vehicle cabin based on the captured image in accordance with the situation detection function that the target setting unit 12 has determined to be executed (see step ST2 in FIG. 4).
The situation detection unit 16 outputs the detection result information to the detection result output unit 17 .

The detection result output unit 17 outputs the detection result information output from the situation detection unit 16 in step ST102 to various devices (step ST103).

In this way, the sensor control device 1 detects the situation inside the vehicle cabin based on the sensor information acquired from the camera 21, specifically, the captured image.
The sensor control device 1 detects the situation inside the vehicle cabin based on the captured image taken by the camera 21, whose orientation is controlled according to the situation detection function, and can therefore perform various situation detection functions based on the captured image that allows the function to be performed accurately.

The sensor control device 1 also outputs detection result information to various devices. This allows the sensor control device 1 to inform vehicle occupants and others of the situation inside the vehicle cabin.

In the above-described first embodiment, in the sensor orientation control function of the sensor control device 1, the orientation setting information used by the target setting unit 12 when setting the target angle is the vehicle information, and the target setting unit 12 sets the target angle based on the vehicle information. However, this is merely an example.
For example, the target setting unit 12 may set the target angle using information other than the vehicle information as orientation setting information. Specifically, the orientation setting information may be information from a timer that counts the elapsed time since the camera 21 was controlled to its current orientation (hereinafter referred to as "timer information"), and the target setting unit 12 may set the target angle based on the timer information.
In this case, for example, the orientation setting information acquisition unit 11 acquires, as orientation setting information, timer information from a timer that counts the time that has elapsed since the camera 21 was controlled to the current orientation.

The timer is stored in a location that can be referenced by the sensor control device 1. For example, when the target setting unit 12 sets a target angle, it stores the history of the target angle. When the target angle is reached, the target setting unit 12 starts counting up the timer. At this time, the target setting unit 12 executes the detection process of the "seat surrounding object detection function" or the "rear seat occupant detection function" at the position of the camera 21 at the reached target angle. When the count of the timer reaches a preset count number, the target setting unit 12 sets a target angle different from the current target angle. The orientation control unit 15 changes the orientation of the camera 21 until the orientation of the camera 21 becomes the target angle different from the current target angle set by the target setting unit 12. Details of how the target setting unit 12 sets a target angle different from the current target angle will be described later.

The orientation setting information acquisition unit 11 outputs the timer information acquired from the timer to the target setting unit 12.

In this case, for example, the target setting unit 12 sets the target angle based on the timer information acquired by the orientation setting information acquisition unit 11 .
In detail, the target setting unit 12 first determines, based on timer information, whether the time elapsed since the camera 21 was controlled to its current orientation has reached a predetermined time (hereinafter referred to as the "target angle duration").
The "target angle duration" is set in advance by an administrator or the like and stored in a location accessible by the sensor control device 1. The target angle duration is set to an appropriate time, such as 2 seconds or 5 seconds. The target angle duration may be set to a different time for each situation detection function, such as 2 seconds for the seat surrounding object detection function and 3 seconds for the rear seat occupant detection function. For example, if different times are set for each situation detection function, when the target angle (i.e., the latest target angle) is reached, the target setting unit 12 may set the next target angle duration by comparing information associating the target angle, situation detection function, and target angle duration (hereinafter referred to as "angle function correspondence information") with the latest target angle. That is, the target setting unit 12 may set the next target angle duration to the target angle duration associated with the latest target angle in the angle function correspondence information. Note that the angle function correspondence information is generated in advance by an administrator or the like and stored in a location accessible by the sensor control device 1.
Here, as an example, the target angle duration is set to a uniform time such as 2 seconds.

When it is determined that the elapsed time has reached the target angle duration, the target setting unit 12 sets a target angle. In detail, the target setting unit 12 refers to the angle function correspondence information, for example, and sets the target angle for the orientation of the camera 21 to an angle different from the target angle that was set when the timer information counting started, i.e., the latest target angle.
A specific example will be given.
For example, suppose that the angle function correspondence information associates a target angle of "0 degrees," a "seat peripheral object detection function," and a target angle duration of "2 seconds." Also, suppose that the angle function correspondence information associates a target angle of "X degrees," a "rear seat occupant detection function," and a target angle duration of "2 seconds."
Now, for example, it is assumed that the latest target angle is 0 degrees, that is, the seat surrounding object detection function is currently being executed.
In this case, the target setting unit 12 sets the target angle to an angle other than 0 degrees, that is, X degrees.

The target setting unit 12 outputs the target angle information to the orientation control unit 15.

FIG. 7 is a flowchart for explaining the operation of the target setting unit 12 in the first embodiment when the target setting unit 12 sets a target angle using information other than vehicle information, in this case, timer information, as orientation setting information.
When the target setting unit 12 sets a target angle using timer information as orientation setting information, the sensor control device 1 performs the operation shown in the flowchart of FIG. 7 in step ST2 of the operation described using the flowchart of FIG. 4, instead of the operation described using the flowchart of FIG. 5.

The target setting unit 12 first determines whether a set time has elapsed based on the orientation setting information (here, timer information) acquired by the orientation setting information acquisition unit 11 in step ST1 of Fig. 4 (step ST211). Specifically, the target setting unit 12 determines whether the elapsed time since the camera 21 was controlled to its current orientation has reached the target angle duration.

If it is determined that the elapsed time has reached the target angle duration ("YES" in step ST211), the target setting unit 12 refers to the angle function correspondence information and sets the target angle for the orientation of the camera 21 to an angle different from the target angle that was set when the timer information counting started, i.e., the latest target angle (step ST211).
For example, if the latest target angle is the target angle associated with the seat peripheral object detection function (here, 0 degrees), the target setting unit 12 sets the target angle associated with the rear seat occupant detection function (here, X degrees) as the target angle. On the other hand, if the latest target angle is not the target angle associated with the seat peripheral object detection function (here, 0 degrees), the target setting unit 12 sets the target angle associated with the seat peripheral object detection function (here, 0 degrees) as the target angle.
The target setting unit 12 outputs the target angle information to the orientation control unit 15 .

In this way, in the sensor control device 1, even if the target setting unit 12 sets the target angle using timer information as orientation setting information, the sensor control device 1 can control the orientation of the camera 21 without requiring human instructions.
The target setting unit 12 sets the target angle using the timer information as orientation setting information, so that the sensor control device 1 can automatically sweep the orientation of the camera 21 .

In the first embodiment described above, the situation detection function includes two functions, namely, a seat peripheral object detection function and a rear seat occupant detection function, but this is merely an example. The situation detection function may include three or more functions. For example, the situation detection function may include other functions in addition to the above two functions, or may include three or more functions other than the above two functions.
The sensor control device 1 only needs to control the orientation of the camera 21 so that the camera 21 faces in a direction associated with the situation detection function.
In the case where the situation detection function includes three or more functions and the target setting unit 12 in the sensor control device 1 sets the target angle based on timer information, for example, the angle function correspondence information may associate the target angle, the situation detection function, the target angle duration, and the priority of the target angle setting. Then, in the sensor control device 1, the target setting unit 12 may set the target angle with the highest priority among target angles different from the latest target angle set in the angle function correspondence information as the target angle. The sensor control device 1 automatically sweeps the orientation of the camera 21 in order according to the priority of the orientation.
Alternatively, the target setting unit 12 may simply switch the target angles associated with three or more functions in sequence in a preset order, so that the target angles become the target angles, and the camera 21 automatically sweeps.

In addition, in the above-described first embodiment, the orientation of the camera 21 associated with one situation detection function is one, but this is merely an example. When the sensor control device 1 determines that one situation detection function is to be executed, it may gradually change the orientation of the camera 21 so that it has two or more orientations.

In addition, in the above-described embodiment 1, the camera 21 is configured to be able to change its orientation in the forward and backward directions relative to the traveling direction of the vehicle within a range from facing directly downward when installed in the vehicle cabin to facing backward by X degrees, as shown in FIG. 2 , but this is merely one example.
For example, the camera 21 may be capable of changing its orientation from pointing directly downward when installed inside the vehicle cabin to pointing forward relative to the traveling direction of the vehicle.
Furthermore, the camera 21 may be configured so that its orientation can be changed left and right relative to the traveling direction of the vehicle when installed inside the vehicle cabin.
The camera 21 may also be provided with a stopper that prevents the camera 21 from pointing further forward or backward or left or right.

In addition, in the above-described first embodiment, one camera 21 is installed in the vehicle cabin, but this is merely an example. For example, multiple cameras 21 may be installed in the vehicle cabin.

In the first embodiment, the sensor 2 is the camera 21, but this is merely an example. As described above, the sensor 2 may be, for example, a Time of Flight (ToF) sensor, an ultrasonic sensor, or a millimeter-wave radar.
In the sensor control device 1, the sensor information acquisition unit 13 acquires sensor information from a sensor 2 such as a ToF sensor, an ultrasonic sensor, or a millimeter-wave radar. The sensor information includes at least information about an object detected by the sensor 2 (such as information about the distance to the object) and information for detecting the orientation of the sensor 2.
The target setting unit 12 sets a target angle for the orientation of the sensor 2 such as a ToF sensor, an ultrasonic sensor, or a millimeter wave radar, based on the orientation setting information acquired by the orientation setting information acquisition unit 11 .
The orientation detection unit 14 detects the current orientation of the sensor 2, such as a ToF sensor, an ultrasonic sensor, or a millimeter wave radar, based on information for detecting the orientation of the sensor 2 contained in the sensor information acquired by the sensor information acquisition unit 13.
The orientation control unit 15 changes the orientation of the sensor 2, such as a ToF sensor, an ultrasonic sensor, or a millimeter wave radar, detected by the orientation detection unit 14 until the current orientation of the sensor 2 becomes the target angle set by the target setting unit 12.
The situation detection unit 16 detects the situation inside the vehicle cabin based on information about the object detected by the sensor 2, which is included in the sensor information acquired by the sensor information acquisition unit 13.

Furthermore, in the first embodiment described above, the sensor control device 1 has a situation detection function, but this is merely an example. The sensor control device 1 may be configured not to have the situation detection function, and a device other than the sensor control device 1 may have the situation detection function. For example, a monitoring device (not shown) provided outside the sensor control device 1 may have the situation detection function.
In this case, the sensor control device 1 may be configured without the situation detection unit 16 and the detection result output unit 17 .

In the first embodiment, the orientation setting information is vehicle information or timer information, but this is merely an example. The orientation setting information may be, for example, sensor information.
In this case, the target setting unit 12 determines whether to execute the seat surrounding object detection function or the rear seat occupant detection function by, for example, comparing the sensor information with the function determination conditions. The function determination conditions include, for example, conditions that associate the contents of the sensor information, in other words, the state of the object detected by the sensor 2, with the function to be executed.

8A and 8B are diagrams illustrating an example of a hardware configuration of the sensor control device 1 according to the first embodiment.
In the first embodiment, the functions of the orientation setting information acquisition unit 11, the target setting unit 12, the sensor information acquisition unit 13, the orientation detection unit 14, the orientation control unit 15, the situation detection unit 16, and the detection result output unit 17 are realized by the processing circuit 1001. That is, the sensor control device 1 includes the processing circuit 1001 for controlling the orientation of the sensor 2 that is mounted in a vehicle interior so that its orientation can be changed and that is capable of detecting an object in the vehicle interior.
The processing circuitry 1001 may be dedicated hardware as shown in FIG. 8A, or may be a processor 1004 that executes a program stored in memory as shown in FIG. 8B.

When the processing circuit 1001 is dedicated hardware, the processing circuit 1001 may be, for example, a single circuit, a composite circuit, a programmed processor, a parallel programmed processor, an ASIC (Application Specific Integrated Circuit), an FPGA (Field-Programmable Gate Array), or a combination thereof.

When the processing circuit is a processor 1004, the functions of the orientation setting information acquisition unit 11, target setting unit 12, sensor information acquisition unit 13, orientation detection unit 14, orientation control unit 15, situation detection unit 16, and detection result output unit 17 are realized by software, firmware, or a combination of software and firmware. The software or firmware is written as a program and stored in memory 1005. The processor 1004 reads and executes the program stored in memory 1005 to perform the functions of the orientation setting information acquisition unit 11, target setting unit 12, sensor information acquisition unit 13, orientation detection unit 14, orientation control unit 15, situation detection unit 16, and detection result output unit 17. In other words, the sensor control device 1 includes memory 1005 for storing a program that, when executed by the processor 1004, results in the execution of steps ST1 to ST6 of FIG. 4 described above. In addition, the program stored in memory 1005 can also be said to cause the computer to execute the processing procedures or methods of the orientation setting information acquisition unit 11, the target setting unit 12, the sensor information acquisition unit 13, the orientation detection unit 14, the orientation control unit 15, the situation detection unit 16, and the detection result output unit 17. Here, the memory 1005 may be, for example, a non-volatile or volatile semiconductor memory such as a RAM, a ROM (Read Only Memory), a flash memory, an EPROM (Erasable Programmable Read Only Memory), or an EEPROM (Electrically Erasable Programmable Read-Only Memory), a magnetic disk, a flexible disk, an optical disk, a compact disk, a mini disk, or a DVD (Digital Versatile Disc).

Note that the functions of the orientation setting information acquisition unit 11, the target setting unit 12, the sensor information acquisition unit 13, the orientation detection unit 14, the orientation control unit 15, the situation detection unit 16, and the detection result output unit 17 may be partially realized by dedicated hardware and partially realized by software or firmware. For example, the functions of the orientation setting information acquisition unit 11 and the sensor information acquisition unit 13 may be realized by a processing circuit 1001 as dedicated hardware, and the functions of the target setting unit 12, the orientation detection unit 14, the orientation control unit 15, the situation detection unit 16, and the detection result output unit 17 may be realized by the processor 1004 reading and executing a program stored in the memory 1005.
The sensor control device 1 also includes an input interface device 1002 and an output interface device 1003 that perform wired or wireless communication with devices such as the sensor 2 .
The orientation control unit 15 may also be configured with a motor driver IC (Integrated Circuit) for driving the motor or a composite circuit for driving the motor that uses a FET (Field Effect Transistor) or the like.

In the above-described first embodiment, the sensor control device 1 is an on-board device mounted on a vehicle, and the orientation setting information acquisition unit 11, the target setting unit 12, the sensor information acquisition unit 13, the orientation detection unit 14, the orientation control unit 15, the situation detection unit 16, and the detection result output unit 17 are provided in the on-board device.
Alternatively, some of the orientation setting information acquisition unit 11, the target setting unit 12, the sensor information acquisition unit 13, the orientation detection unit 14, the orientation control unit 15, the situation detection unit 16, and the detection result output unit 17 may be mounted on an in-vehicle device of a vehicle, and the others may be provided in a server connected to the in-vehicle device via a network, so that the sensor 2, the in-vehicle device, and the server constitute the sensor control system 100. Alternatively, the orientation setting information acquisition unit 11, the target setting unit 12, the sensor information acquisition unit 13, the orientation detection unit 14, the orientation control unit 15, the situation detection unit 16, and the detection result output unit 17 may all be provided in the server.

As described above, according to the first embodiment, the sensor control device 1 includes the orientation setting information acquisition unit 11 that acquires orientation setting information used to set a target angle for the orientation of the sensor 2, the sensor 2 being mounted in a vehicle cabin so that its orientation can be changed and capable of detecting objects within the vehicle cabin; the target setting unit 12 that sets the target angle based on the orientation setting information acquired by the orientation setting information acquisition unit 11; the sensor information acquisition unit 13 that acquires sensor information related to the sensor 2; the orientation detection unit 14 that detects the current orientation of the sensor 2 based on the sensor information acquired by the sensor information acquisition unit 13; and the orientation control unit 15 that changes the orientation of the sensor 2 until the current orientation of the sensor 2 detected by the orientation detection unit 14 matches the target angle set by the target setting unit 12. Therefore, the sensor control device 1 can control the orientation of the sensor 2, the sensor 2 being mounted in a vehicle cabin so that its orientation can be changed and capable of detecting objects within the vehicle cabin, without requiring human instruction. The sensor control device 1 can reduce the hassle of instructing a vehicle occupant about the orientation of the sensor 2.
Furthermore, if the occupant were to manually adjust the orientation of the camera 21 each time to orient it to detect an abandoned infant, the occupant's attention would be focused on the abandoned item or infant at that point, significantly reducing the possibility of the abandoned item or infant occurring in the first place. To detect the occurrence of an abandoned item or infant, the on-seat object detection function must be automatically activated. The sensor control device 1 can control the orientation of the camera 21 to an orientation that can detect the occurrence of an abandoned item or infant when the occupant's attention is not focused on the abandoned item or infant.

According to embodiment 1, the orientation setting information is vehicle information related to the vehicle, and the target setting unit 12 sets the target angle based on the vehicle information. Therefore, the sensor control device 1 can control the orientation of the sensor 2 so as to obtain sensor information for accurately executing the situation detection function to be executed, without requiring human instruction.

According to embodiment 1, the orientation setting information is timer information that counts the elapsed time since the sensor 2 was controlled to its current orientation, and the target setting unit 12 sets the target angle based on the timer information and the target angle that was set when the timer information counting started. Therefore, the sensor control device 1 can automatically sweep the orientation of the sensor 2 without the need for human instructions.

Furthermore, according to embodiment 1, the sensor information includes information about objects in the vehicle cabin detected by the sensor 2, and the sensor control device 1 is configured to include a situation detection unit 16 that detects the situation in the vehicle cabin based on the sensor information acquired by the sensor information acquisition unit 13. The sensor control device 1 detects the situation in the vehicle cabin based on information about objects detected by the sensor 2, whose orientation is controlled according to the situation detection function, and therefore can perform various situation detection functions based on sensor information for accurately performing those functions.

Furthermore, according to embodiment 1, in the sensor control device 1, the orientation control unit 15, upon completing the change in the orientation of the sensor 2 to the target angle, outputs a completion notification to the situation detection unit 16 indicating that the change in the orientation of the sensor 2 has been completed, and the situation detection unit 16 is configured to start detecting the situation inside the vehicle cabin when the completion notification is output from the orientation control unit 15. The sensor control device 1 waits for the orientation to be determined to be appropriate for the situation detection function that it has determined should be executed, in other words, waits for the change in the orientation of the sensor 2 to be completed to the target angle, before starting to detect the situation inside the vehicle cabin, thereby preventing a decrease in the accuracy of the detection.

Furthermore, according to embodiment 1, the sensor control device 1 is configured to include a detection result output unit 17 that outputs detection result information regarding the results of the situation inside the vehicle cabin detected by the situation detection unit 16. Therefore, the sensor control device 1 can notify vehicle occupants, etc.

Furthermore, according to the first embodiment, the sensor control system 100 is configured to include the sensor control device 1 as described above and the sensor 2 that is mounted in the vehicle cabin so that its orientation can be changed and that can detect objects within the vehicle cabin. Therefore, the sensor control system 100 can control the orientation of the sensor 2 that is mounted in the vehicle cabin so that its orientation can be changed and that can detect objects within the vehicle cabin without requiring human instruction. The sensor control system 100 can reduce the hassle of instructing the vehicle occupants on the orientation of the sensor 2.
Furthermore, if the occupant were to manually adjust the orientation of the camera 21 each time to orient it to detect an abandoned infant, the occupant's attention would be focused on the abandoned item or infant at that point, significantly reducing the possibility of the abandoned item or infant occurring in the first place. To detect the occurrence of an abandoned item or infant, the on-seat object detection function must operate automatically. The sensor control device 1 can control the orientation of the camera 21 to an orientation that can detect the occurrence of an abandoned item or infant when the occupant's attention is not focused on the abandoned item or infant.

In addition, any component of the embodiment may be modified or omitted.

The sensor control device 1 of the present disclosure can control the orientation of a sensor that is mounted in a vehicle cabin in such a way that its orientation can be changed and that can detect objects within the vehicle cabin without the need for human instruction.

1 Sensor control device, 11 Orientation setting information acquisition unit, 12 Target setting unit, 13 Sensor information acquisition unit, 14 Orientation detection unit, 15 Orientation control unit, 16 Situation detection unit, 17 Detection result output unit, 2 Sensor, 21 Camera, 100 Sensor control system, 1001 Processing circuit, 1002 Input interface device, 1003 Output interface device, 1004 Processor, 1005 Memory.

Claims (15)

an orientation setting information acquisition unit that acquires orientation setting information used to set a target angle for the orientation of a sensor that is mounted on a ceiling inside the vehicle cabin in a manner that allows the sensor to change its orientation and that is capable of detecting an object inside the vehicle cabin;
a target setting unit that selectively sets the target angle to one of an angle at which an image can be captured of an area including the seating surface, backrest, and headrest of the front seat where an occupant of the front seat may be present and an area including the seating surface of the rear seat, and an angle that is changed from the angle at which an image can be captured of an area including the seating surface, backrest, and headrest of the rear seat where an occupant of the rear seat may be present and that can detect an object, including an abandoned object, that is present above or below the seat in the vehicle compartment, according to the information for orientation setting acquired by the information acquisition unit for orientation setting ;
a sensor information acquisition unit that acquires sensor information related to the sensor;
an orientation detection unit that detects a current orientation of the sensor based on the sensor information acquired by the sensor information acquisition unit;
and an orientation control unit that changes the orientation of the sensor until the current orientation of the sensor detected by the orientation detection unit becomes the target angle set by the target setting unit. the orientation setting information is vehicle information related to a vehicle,
The sensor control device according to claim 1 , wherein the target setting unit sets the target angle based on the vehicle information. 3. The sensor control device according to claim 2, wherein the vehicle information includes information indicating the status of the engine of the vehicle, vehicle speed, information indicating whether a driver is present, information indicating whether the doors of the vehicle are open or closed, or information indicating whether a seat belt is fastened. 4. The sensor control device according to claim 2, wherein the target setting unit determines a situation detection function to be executed in the vehicle based on the vehicle information, and sets the target angle based on the determined situation detection function. the orientation setting information is timer information that counts the elapsed time since the sensor was controlled to the current orientation,
The sensor control device according to claim 1 , wherein the target setting unit sets the target angle based on the timer information and the target angle that was set when the timer information started counting. 6. The sensor control device according to claim 5, wherein, when the elapsed time reaches a target angle duration, the target setting unit sets the target angle to an angle different from the target angle that was set when the timer information started counting. the sensor information includes information about a rotary encoder included in the sensor, information about the number of steps of a stepping motor included in the sensor, or an image captured by the sensor of the interior of the vehicle;
The sensor control device according to claim 1 , wherein the orientation detection unit detects the current orientation of the sensor based on information about the rotary encoder, information about the number of steps of the stepping motor, or the captured image. When the sensor information is the captured image,
8. The sensor control device according to claim 7, wherein the orientation detection unit detects the current orientation of the sensor based on the position of a structure in the vehicle interior captured in the captured image, the position of the structure in the vehicle interior, and an installation position of the sensor. the sensor information includes information about the object in the vehicle interior detected by the sensor,
The sensor control device according to claim 1 , further comprising: a situation detection unit that detects a situation inside the vehicle cabin based on the sensor information acquired by the sensor information acquisition unit. when the orientation control unit completes changing the orientation of the sensor to the target angle, it outputs a completion notification indicating that the change of the orientation of the sensor has been completed to the situation detection unit;
The sensor control device according to claim 9 , wherein the situation detection unit starts detecting the situation inside the vehicle cabin when the completion notification is output from the orientation control unit. The sensor control device according to claim 9 , further comprising a detection result output unit that outputs detection result information relating to the result of the detection of the situation inside the vehicle compartment by the situation detection unit. The sensor control device according to claim 11, wherein the detection result information is warning information for outputting a warning. The sensor control device according to claim 1 , wherein the sensor includes a camera, a ToF sensor, an ultrasonic sensor, a millimeter wave radar, or an infrared sensor. a step in which an orientation setting information acquisition unit acquires orientation setting information used to set a target angle of an orientation of a sensor that is mounted on a ceiling inside the vehicle cabin so as to be orientation-changeable and that is capable of detecting an object inside the vehicle cabin;
a step in which a target setting unit selectively sets the target angle to an angle at which an image can be captured of an area including the seating surface, backrest, and headrest of the front seat where an occupant of the front seat may be present and an area including the seating surface of the rear seat, and an angle changed from the angle at which an image can be captured of an area including the seating surface, backrest, and headrest of the rear seat where an occupant of the rear seat may be present and an area including the seating surface, backrest, and headrest of the rear seat, and an area in which a state of the occupant of the rear seat may be detected , according to the information for orientation setting acquired by the information acquisition unit for orientation setting ;
a step of acquiring sensor information related to the sensor by a sensor information acquisition unit;
an orientation detection unit detecting a current orientation of the sensor based on the sensor information acquired by the sensor information acquisition unit;
and a step of changing the orientation of the sensor by an orientation control unit until the current orientation of the sensor detected by the orientation detection unit becomes the target angle set by the target setting unit. The sensor control device according to claim 1;
the sensor is mounted in the vehicle interior so that its orientation can be changed, and the sensor is capable of detecting the object in the vehicle interior.