JP7613299B2 - Notification control device and notification system - Google Patents

Description

The present invention relates to a notification control device for controlling a notification device that notifies a vehicle user, and a notification system equipped with the notification control device.

As technology for electrification and automation advances, vehicles are being equipped with perimeter monitoring devices to provide automatic driving and driving assistance. Here, dirt, water droplets, and other debris adhere to the lens of the perimeter monitoring device or the cover or glass in front of it. Patent Document 1 discloses a technology for cleaning the perimeter monitoring device with a cleaning device when the device becomes dirty with debris.

JP 2019-104365 A JP 2020-086787 A

Incidentally, if a notification of cleaning is sent to the vehicle user when the perimeter monitoring device is being cleaned, the user can know that the perimeter monitoring device is being cleaned, and the user can be encouraged to drive more carefully.

However, when a vehicle is traveling in an environment where debris is likely to adhere to the perimeter monitoring device, cleaning of the perimeter monitoring device is performed repeatedly within a short period of time; in other words, cleaning of the perimeter monitoring device is performed frequently. As a result, notifications to clean the perimeter monitoring device are also sent frequently, which can be annoying for some users.

The present invention was made in consideration of the above problems, and aims to provide a notification control device and notification system that can reduce the annoyance felt by the vehicle user when notifying the user that a surroundings monitoring device needs to be cleaned.

A notification control device according to one aspect of the present invention includes:
A notification control device for controlling a notification device that notifies a user of a vehicle,
When the surroundings monitoring device mounted on the vehicle is being washed, the notification device is caused to notify that the surroundings monitoring device is being washed;
This notification control device is configured to control the notification device so that, when the cleaning frequency of the surrounding monitoring device is equal to or greater than a predetermined frequency, the frequency of the notification to perform the cleaning is lowered relative to the cleaning frequency, or so that the notification to perform the cleaning is less noticeable compared to when the cleaning frequency is less than the predetermined frequency.

Another aspect of the present invention is
The notification control device;
A notification device that is controlled by the notification control device and that provides a notification to a user of the vehicle;
The notification system includes:

According to the present invention, when the cleaning frequency of the perimeter monitoring device is equal to or greater than a predetermined frequency, the frequency of the notification to perform cleaning is lowered relative to the cleaning frequency, or the notification to perform cleaning is made less noticeable compared to when the cleaning frequency is less than the predetermined frequency. This reduces the annoyance felt by the user of the vehicle in receiving the notification to perform cleaning of the perimeter monitoring device.

FIG. 1 is a schematic diagram of a cleaning system according to a first embodiment. FIG. 2 is a flow chart illustrating the main control operations of the ECU. FIG. 3 is a schematic diagram of a cleaning system according to the second embodiment. FIG. 4 is a diagram showing a part of the display screen of the center display.

Specific embodiments to which the present invention is applied will be described in detail below with reference to the drawings. However, the present invention is not limited to the following embodiments. In addition, the following descriptions and drawings have been simplified as appropriate for clarity of explanation.

First Embodiment
FIG. 1 is a schematic diagram of a washing system 100 of a first embodiment. The washing system 100 is a system for washing an on-board camera 102. The on-board camera 102 is an example of a surroundings monitoring device mounted on a vehicle. Image data acquired by the on-board camera 102 is used for controlling automatic driving and driving assistance of the vehicle. As shown in FIG. 1, the washing system 100 includes an electronic control unit (hereinafter referred to as "ECU") 101, an on-board camera 102, a dirt detection sensor 103, a washing device 104, a head-up display 105, and a notification setting device 106. The ECU 101 is connected to each of the dirt detection sensor 103, the washing device 104, the head-up display 105, and the notification setting device 106 so as to be able to communicate with each other.

The dirt detection sensor 103 is a sensor for detecting dirt on the lens of the vehicle-mounted camera 102 or the cover or glass in front of it. The cleaning device 104 is a device for cleaning the vehicle-mounted camera 102. The ECU 101 is functionally equipped with a cleaning control unit 1011. When the dirt detection sensor 103 detects dirt on the vehicle-mounted camera 102, the cleaning control unit 1011 activates the cleaning device 104 and cleans the vehicle-mounted camera 102. The head-up display 105 is an example of a notification device that notifies the user of the vehicle, and when the cleaning device 104 is cleaning the vehicle-mounted camera 102, it notifies the user that cleaning is being performed. When the vehicle-mounted camera 102 is being cleaned, the head-up display 105 displays that cleaning is being performed. The notification setting device 106 is a device that allows the user to change the setting of the notification mode of cleaning by the head-up display 105 through user operation. The ECU 101 functionally includes a determination unit 1012 and a notification control unit 1013 to cause the head-up display 105 to notify the driver that the in-vehicle camera 102 has been cleaned, i.e., to control the head-up display 105.

When notifying the driver of the on-board camera 102 to clean the camera, if the vehicle is traveling in an environment where the on-board camera 102 is prone to becoming soiled, the on-board camera 102 will be cleaned repeatedly within a short period of time. In other words, the on-board camera 102 will be cleaned frequently, and accordingly, the notification to clean the camera will be sent frequently. In this case, some users may find the notification to clean the camera annoying.

The notification setting device 106 is provided to reduce the annoyance felt by the user in response to the cleaning notification, and is a device that allows the user to change the setting from a notification mode that notifies the user of cleaning each time the in-vehicle camera 102 is cleaned (hereinafter referred to as the "normal notification mode") to a notification mode that reduces the annoyance felt by the user (hereinafter referred to as the "specific notification mode"). The notification setting device 106 of this embodiment is configured so that the user can select whether or not to allow the setting change of the notification mode from the normal notification mode to the specific notification mode. Also, in this embodiment, the specific notification mode is set to a notification mode that lowers the frequency of cleaning notification relative to the cleaning frequency, as described below.

The determination unit 1012 provided in the ECU 101 determines whether the notification setting device 106 is permitted to change the notification mode from the normal notification mode to a specific notification mode.

The determination unit 1012 also determines whether the cleaning frequency of the vehicle-mounted camera 102 is equal to or greater than a predetermined frequency.

Furthermore, the determination unit 1012 determines whether the driving state of the vehicle is a predetermined driving state. Here, the predetermined driving state is a driving state in which it is desirable to notify the user of cleaning in a normal notification manner, and is a driving state in which the user is assumed to be paying attention to driving the vehicle. Examples of the predetermined driving state include a driving state in which the user holds the steering wheel while driving, a driving state on a highway, and a driving state in a traffic jam.

The notification control unit 1013 provided in the ECU 101 controls the head-up display 105 based on the determination result by the determination unit 1012.

Figure 2 is a flowchart that explains the main control operations of the ECU 101, which are executed each time the vehicle-mounted camera 102 is cleaned.

In FIG. 2, first, in step S11 (hereinafter, "step" will be omitted) corresponding to the function of the determination unit 1012, it is determined whether the driving state of the vehicle is a predetermined driving state, for example, whether the driving state is one in which the user is holding the steering wheel and driving. If a positive determination is made in S11, the process proceeds to S15, and if a negative determination is made in S11, the process proceeds to S12.

In S12, which corresponds to the function of the determination unit 1012, it is determined whether the cleaning frequency of the in-vehicle camera 102 is equal to or greater than a predetermined frequency. Whether the cleaning frequency is equal to or greater than a predetermined frequency may be determined based on whether the elapsed time from the previous cleaning to the current cleaning being less than a predetermined time, or whether the number of cleanings performed within a predetermined time is equal to or greater than a predetermined number. If a positive determination is made in S12, the process proceeds to S13, and if a negative determination is made in S12, the process proceeds to S15.

In S13, which corresponds to the function of the determination unit 1012, it is determined whether or not the notification setting device 106 is permitted to change the setting from the normal notification mode to a specific notification mode. If a positive determination is made in S13, the process proceeds to S14, and if a negative determination is made in S13, the process proceeds to S15.

In S14, which corresponds to the function of the notification control unit 1013, a notification process for cleaning is executed in a specific notification mode. Specifically, the head-up display 105 is caused to display that cleaning is being executed for a predetermined period of time that is longer than the period in which cleaning is repeated. This makes it possible to lower the frequency of notifications for cleaning execution relative to the cleaning frequency. Once the process of S14 is executed, the current routine is returned.

In S15, which corresponds to the function of the notification control unit 1013, the head-up display 105 is caused to display that cleaning is in progress. In other words, the notification process for cleaning is executed in the normal notification mode. When the process of S14 is executed, the current routine is returned.

As described above, according to this embodiment, when the cleaning frequency of the in-vehicle camera 102 is equal to or greater than a predetermined frequency, the frequency of notifications to perform cleaning is lowered relative to the cleaning frequency. This reduces the annoyance felt by the user of the vehicle when notifying the user that the in-vehicle camera 102 needs to be cleaned.

In addition, according to this embodiment, when the vehicle is in a predetermined driving state, a notification to perform cleaning is given in a normal notification manner regardless of the cleaning frequency. This makes it possible to appropriately notify the user to perform cleaning when it is assumed that the user is paying attention to driving the vehicle, in order to encourage the user to drive more carefully.

In addition, according to this embodiment, the user can select whether or not to allow the notification mode to be changed from the normal notification mode to a specific notification mode. This can improve user convenience.

Second Embodiment
3 is a schematic diagram of a cleaning system 200 according to the second embodiment. The following description will focus on the differences from the first embodiment. The cleaning system 200 according to the second embodiment is a system for cleaning an on-board camera 202 and an optical sensor 203. The on-board camera 202 and the optical sensor 203 are examples of a surroundings monitoring device mounted on a vehicle. Image data acquired by the on-board camera 202 and measurement data acquired by the optical sensor 203 are used for controlling automatic driving and driving assistance of the vehicle. 3, the cleaning system 200 includes an electronic control unit (hereinafter referred to as "ECU") 201, an on-board camera 202, an optical sensor 203, a first dirt detection sensor 204 that detects dirt on the on-board camera 202, a second dirt detection sensor 205 that detects dirt on the optical sensor 203, a first cleaning device 206 that cleans the on-board camera 202, a second cleaning device 207 that cleans the optical sensor 203, a center display 208, and a notification setting device 209. The ECU 201 is connected to each of the first dirt detection sensor 204, the second dirt detection sensor 205, the first cleaning device 206, the second cleaning device 207, the center display 208, and the notification setting device 209 so as to be able to communicate with each other.

The ECU 201 is functionally equipped with a cleaning control unit 2011, which operates the first cleaning device 206 to clean the in-vehicle camera 202 when the first dirt detection sensor 204 detects dirt on the in-vehicle camera 202, and operates the second cleaning device 207 to clean the optical sensor 203 when the second dirt detection sensor 205 detects dirt on the optical sensor 203. The center display 208 is an example of a notification device that notifies the user of the vehicle, and notifies the user of the execution of cleaning. The notification setting device 209 is a device that allows the user to change the setting of the notification mode of the cleaning execution by the center display 208 through a user's operation, and is configured to allow the user to select whether or not to allow the setting change of the notification mode from the normal notification mode to a specific notification mode, as in the first embodiment. In this embodiment, the specific notification mode is set to a notification mode that lowers the notification frequency of the cleaning execution relative to the cleaning frequency, as in the first embodiment.

The ECU 201 functionally includes a determination unit 2012 similar to that of the first embodiment. The center display 208 functionally includes a notification control unit 2081 similar to that of the first embodiment. The center display 208 includes an electronic control unit, and the electronic control unit included in the center display 208 functions as the notification control unit 2081.

Figure 4 is a diagram showing a part of the display screen 301 of the center display 208. The display screen 301 is provided with an icon 302 for indicating that the periphery monitoring device is being washed and a counter 303 for indicating the frequency of washing of the periphery monitoring device. In this embodiment, unlike the first embodiment, multiple periphery monitoring devices are washed. In this case, the notification device notifies the washing of the periphery monitoring device without distinguishing which periphery monitoring device is being washed. That is, in this embodiment, when the on-board camera 202 is being washed or the optical sensor 203 is being washed, the icon 302 lights up to indicate that the periphery monitoring device is being washed, without distinguishing whether the on-board camera 202 is being washed or the optical sensor 203 is being washed. In other words, the center display 208 regards the on-board camera 202 and the optical sensor 203 as one (integrated) periphery monitoring device, and displays that the periphery monitoring device is being washed.

As in the first embodiment, the determination unit 2012 provided in the ECU 201 determines whether the notification setting device 209 has permitted a change in the notification mode from a normal notification mode to a specific notification mode, whether the cleaning frequency of the periphery monitoring device is equal to or greater than a predetermined frequency, and whether the driving state of the vehicle is equal to or greater than a predetermined driving state. The cleaning frequency of the periphery monitoring device is the combined cleaning frequency of the on-board camera 202 and the optical sensor 203. The determination unit 2012 obtains the cleaning frequency of the periphery monitoring device (the number of cleanings performed within a predetermined time), which is the combined cleaning frequency of the on-board camera 202 and the optical sensor 203, and determines whether the cleaning frequency is equal to or greater than a predetermined frequency.

The ECU 201 transmits the determination result of the determination unit 2012 and the cleaning frequency of the periphery monitoring device to the center display 208. The communication control unit 2081 provided in the center display 208 turns on the icon 302 based on the determination result of the determination unit 2012, as in the first embodiment. The communication control unit 2081 also causes the counter 303 to display the cleaning frequency of the periphery monitoring device. Note that the cleaning frequency of the periphery monitoring device is always displayed and is not repeatedly turned on and off, so there is little impact on the annoyance felt by the user.

This embodiment achieves the same effects as the first embodiment.

(Modification)
In the first and second embodiments, as a specific notification mode for lowering the frequency of notification of cleaning execution relative to the cleaning frequency, the display is made to display that cleaning is being performed for a predetermined time that is longer than the time that cleaning is repeated, but it is also possible to make the display display that cleaning is being performed when the elapsed time from the notification of cleaning execution is equal to or longer than the predetermined time, and not to make the display display that cleaning is being performed when the elapsed time is less than the predetermined time. This also makes it possible to lower the frequency of notification of cleaning execution relative to the cleaning frequency.

In the first and second embodiments, a notification mode in which the frequency of notifications that cleaning is being performed is lower than the cleaning frequency is set as the specific notification mode, but a notification mode in which the notification that cleaning is being performed is less noticeable than when the cleaning frequency is less than a predetermined frequency, i.e., compared to the normal notification mode, may be set as the specific notification mode. For example, the specific notification mode may be a notification mode in which the display color of the icon provided on the display to indicate that cleaning is being performed is made lighter or less noticeable than in the normal notification mode. Also, the specific notification mode may be a notification mode in which the position of the display indicating that cleaning is being performed is changed to a position that is less noticeable than in the normal notification mode, and then the fact that cleaning is being performed is displayed.

In the first and second embodiments, a display is used as the notification device to visually notify the vehicle user that cleaning is to be performed, but the notification device is not limited to a display and may be a speaker or other device that audibly notifies the user that cleaning is to be performed. In this case, an example of a notification mode that makes the notification that cleaning is to be performed less noticeable than the normal notification mode is to make the notification sound quieter than the normal notification mode.

In the first and second embodiments, the notification setting device is configured to allow the user to select whether or not to allow the setting change of the notification mode from the normal notification mode to a specific notification mode, but in addition to this configuration, the notification setting device may be configured to allow the user to arbitrarily limit the notification frequency by setting. In this case, the predetermined frequency in S12 and the predetermined time in S14 of the flowchart in FIG. 2 may be variably set according to the user's setting.

In the first and second embodiments, the determination unit determines whether the notification setting device is permitted to change the notification mode from a normal notification mode to a specific notification mode and whether the driving state of the vehicle is a specified driving state, but these determinations may be omitted. That is, S11 and S13 in the flowchart of FIG. 2 may be omitted. Also, the order of the determinations of S11, S12, and S13 may be interchanged.

In the first and second embodiments, an in-vehicle terminal such as a head-up display or a center display is used as the notification device, but the notification device may also be a mobile terminal such as a smartphone.

In the second embodiment, the cleaning frequency of the perimeter monitoring device is displayed, but this display may be omitted.

In the second embodiment, when multiple peripheral monitoring devices are cleaned, the notification device issues a notification to clean the peripheral monitoring devices without distinguishing which peripheral monitoring devices are being cleaned. However, a notification to clean the peripheral monitoring devices may be issued to each of the multiple peripheral monitoring devices. In this case, the notification control unit may change the notification mode for each of the multiple peripheral monitoring devices so that when the cleaning frequency is equal to or greater than a predetermined frequency, the notification frequency to clean the peripheral monitoring devices is lower than the cleaning frequency, or so that the notification to clean the peripheral monitoring devices is less noticeable than when the cleaning frequency is less than the predetermined frequency. This also has the effect of reducing the annoyance felt by the user in response to the cleaning notification.

The present invention is not limited to the above embodiment, and can be modified as appropriate without departing from the spirit and scope of the invention.

100 Cleaning system 101 Electronic control unit (ECU)
1011 Cleaning control unit 1012 Determination unit 1013 Notification control unit 102 Vehicle-mounted camera 103 Dirt detection sensor 104 Notification setting device 105 Head-up display 106 Cleaning device 200 Cleaning system 201 Electronic control unit (ECU)
2011 Cleaning control unit 2012 Determination unit 202 Vehicle-mounted camera 203 Optical sensor 204 First dirt detection sensor 205 Second dirt detection sensor 206 First cleaning device 207 Second cleaning device 208 Center display 2081 Notification control unit 209 Notification setting device 301 Display screen 302 Icon 303 Counter

Claims (2)

A notification control device for controlling a notification device that notifies a user of a vehicle,
When the surroundings monitoring device mounted on the vehicle is being washed, the notification device is caused to notify that the surroundings monitoring device is being washed;
When the cleaning frequency of the periphery monitoring device is equal to or greater than a predetermined frequency and the driving state of the vehicle is not a predetermined driving state , the notification device is controlled so that the frequency of the notification of cleaning execution is lowered relative to the cleaning frequency, or so that the notification of cleaning execution is less noticeable than when the cleaning frequency is less than the predetermined frequency ,
The notification control device, characterized in that the predetermined driving state is a driving state in which the user is driving with his/her hands on a steering wheel . The notification control device according to claim 1 ;
A notification device that is controlled by the notification control device and that provides a notification to a user of the vehicle;
A notification system comprising:

Images