JP7633836B2 - DISPLAY CONTROL DEVICE, CONTROL METHOD AND PROGRAM FOR DISPLAY CONTROL DEVICE - Google Patents

Description

The present invention relates to a display control device, a control method for a display control device, and a program.

Conventionally, a technology has been proposed that, when the vehicle's traveling speed is lower than a certain threshold, automatically displays surrounding images without the user (driver) having to switch display modes, thereby providing the user with information about the conditions of the necessary areas around the vehicle.

JP 2011-015174 A

However, in the conventional technology, even in such a situation, when the vehicle's traveling speed becomes lower than a predetermined threshold, the surrounding image is displayed, and there is a risk that the navigation information required by the user will not be provided.
The present invention has been made in view of the above, and has an object to provide information required by a user while improving usability and reducing the amount of operations required by the user.

The display control device of the embodiment includes a judgment unit that judges whether or not the vehicles are in a passing state based on at least the vehicle speed information and the shift position information out of the passing screen display request signal, vehicle speed information, and shift position information, and a control unit that displays a passing support screen on a display device when it is determined that the vehicles are in the passing state.
According to the above configuration, when a vehicle is in a passing state based on at least the vehicle speed information and the shift position information out of the passing screen display request signal, the vehicle speed information, and the shift position information, a passing support screen can be displayed on the display device, thereby improving usability and providing the information required by the user while reducing the effort required for user operation.

In the above configuration, there is provided a first display mode in which a passing support screen is displayed based on the passing screen display request signal, the vehicle speed information, and the shift position information, and a second display mode in which a passing support screen is displayed based on the vehicle speed information and the shift position information, and the control unit may be configured to display a mode selection screen that prompts the user to select between the first display mode and the second display mode.
According to the above configuration, the passing assistance screen can be displayed at a frequency desired by the user.

The control unit may display a setting screen that prompts a user to select whether to display or not display the passing support screen.
According to the above configuration, the passing support screen can be displayed in a situation desired by the user.

In addition, when the first display mode is selected, the control unit may display the passing assistance screen when a display request is made by the passing screen display request signal, the vehicle speed based on the vehicle speed information is equal to or lower than a predetermined vehicle speed, and the shift position based on the shift position information is a forward position.
According to the above configuration, it is possible to reliably determine whether or not passing assistance is necessary, and to display the passing assistance screen.

In addition, when the second display mode is selected, the control unit may display the passing assistance screen when the vehicle speed based on the vehicle speed information is equal to or lower than a predetermined vehicle speed and the shift position based on the shift position information is a forward position.
According to the above configuration, when the vehicle speed is equal to or lower than a predetermined vehicle speed and the shift position based on the shift position information is in the forward position, the passing assistance screen is displayed, so that even a user who is not good at passing vehicles can more easily perform passing driving.

The control unit may continue to display the passing support screen for a first predetermined time even if the shift position information is no longer the forward position when the passing support screen is displayed.
According to the above configuration, even if the shift position is temporarily not in the forward position due to steering or reversing while passing other vehicles, the passing support screen continues to be displayed, thereby improving usability.

The control unit may continue to display the passing support screen for a second predetermined time even if the vehicle speed exceeds the predetermined vehicle speed when the passing support screen is displayed.
According to the above configuration, even if the vehicle speed temporarily exceeds a predetermined vehicle speed due to vehicle operation during passing driving, the passing support screen continues to be displayed, thereby improving usability.

In addition, the control method of the display control device of the embodiment is a control method of the display control device executed by a display control device to which a passing screen display request signal is input from the outside, and includes a process of determining whether or not the vehicles are in a passing state based on at least the vehicle speed information and the shift position information out of the passing screen display request signal, vehicle speed information, and shift position information, and a process of displaying a passing assistance screen on a display device when it is determined that the vehicles are in the passing state.
According to the above configuration, when a vehicle is in a passing state based on at least the vehicle speed information and the shift position information out of the passing screen display request signal, the vehicle speed information, and the shift position information, a passing support screen can be displayed on the display device, thereby improving usability and providing the information required by the user while reducing the effort required for user operation.

The program of the embodiment is a program for controlling a display control device to which a passing screen display request signal is input from outside using a computer, and causes the computer to function as a means for determining whether or not the vehicles are in a passing state based on at least the vehicle speed information and the shift position information out of the passing screen display request signal, vehicle speed information, and shift position information, and as a means for displaying a passing support screen on a display device when it is determined that the vehicles are in the passing state.
According to the above configuration, when a vehicle is in a passing state based on at least the vehicle speed information and the shift position information out of the passing screen display request signal, the vehicle speed information, and the shift position information, a passing support screen can be displayed on the display device, thereby improving usability and providing the information required by the user while reducing the effort required for user operation.

FIG. 1 is a block diagram showing a schematic configuration of an in-vehicle surroundings monitoring system according to an embodiment of the present invention. FIG. 2 is a functional block diagram of the camera ECU. FIG. 3 is an explanatory diagram of an example of the initial setting screen. FIG. 4 is a main processing flowchart according to the embodiment. FIG. 5 is a process flowchart of the first passing assistance mode process. FIG. 6 is an explanatory diagram of an example of a passing support display screen on which a passing support image is displayed. FIG. 7 is a process flowchart of the second passing assistance mode process.

The following describes the embodiments with reference to the drawings. The configurations (technical features) of the embodiments shown below, as well as the actions and effects brought about by said configurations, are merely examples. The present invention can be realized with configurations other than those disclosed in the following embodiments, and it is possible to obtain at least one of the various effects obtained by the basic configuration.

The following exemplary embodiments include similar components. Therefore, in the following, similar components are given the same reference numerals, and duplicate explanations are omitted. In addition, in this specification, ordinal numbers are used for the convenience of distinguishing between members (components), parts, etc., and do not indicate priority or order.

FIG. 1 is a block diagram showing a schematic configuration of an in-vehicle surroundings monitoring system according to an embodiment of the present invention.
The vehicle-mounted surroundings monitoring system 10 includes a stereo camera unit 11, a first surroundings monitoring camera 12-1 to a fourth surroundings monitoring camera 12-4, a vehicle speed sensor 13, a shift sensor 14, a camera ECU 15, and a touch panel display 16.

The stereo camera unit 11 processes the output signal of the imaging unit 11A, which has a pair of imaging elements, and determines whether or not it is necessary to display a passing assistance image, and outputs a passing screen display request signal RQ to the camera ECU 15 via the CAN (Controller Area Network).

The first periphery monitoring camera 12-1 to the fourth periphery monitoring camera 12-4 have the same configuration, and each outputs a periphery monitoring image of the corresponding imaging area.
In this embodiment, the first periphery monitoring camera 12-1 is disposed near the front grille so as to be able to monitor the area ahead of the vehicle.
The second periphery monitoring camera 12-2 is disposed on the right side mirror of the vehicle so as to be able to monitor the right side of the vehicle.

The third periphery monitoring camera 12-3 is disposed on the left side mirror of the vehicle so as to be able to monitor the left side of the vehicle.
The fourth periphery monitoring camera 12-4 is disposed near the rear bumper of the vehicle so as to be able to monitor the area behind the vehicle.

The vehicle speed sensor 13 detects the speed of the vehicle and outputs vehicle speed information DV.
The shift sensor 14 detects the position (eg, drive D, neutral N, etc.) of a movable part (eg, a lever, an arm, a button) of a gear shift operation unit of the vehicle, and outputs shift position information DS.

The camera ECU 15 controls the display of the passing assistance image based on at least the vehicle speed information DV and the shift position information DS out of the passing assistance image display request signal RQ input from the stereo camera unit 11, the vehicle speed information DV from the vehicle speed sensor 13, and the shift position information DS from the shift sensor. The camera ECU 15 also controls the display of the surrounding monitoring images based on the surrounding monitoring images output by the first surrounding monitoring camera 12-1 to the fourth surrounding monitoring camera 12-4.

The touch panel display 16 displays the passing assistance image and the surroundings monitoring image under the control of the camera ECU 15. It also performs various operations such as setting the passing assistance mode, which will be described later.

FIG. 2 is a functional block diagram of the camera ECU.
The camera ECU 15 functions as a display control device and includes a judgment unit 15A that judges whether or not the vehicles are in a passing state based on at least the vehicle speed information DV and the shift position information DS out of the passing assistance image display request signal RQ, the vehicle speed information DV, and the shift position information DS, a control unit 15B that displays a passing assistance screen on the touch panel display 16, which is a display device, when the judgment unit 15A judges that the vehicles are in a passing state, and a camera I/F unit 15C that performs interface operation between the first surroundings monitoring camera 12-1 to the fourth surroundings monitoring camera 12-4.

Here, the passing assistance mode will be described in detail.
In the present embodiment, there are two passing assistance modes: a first passing assistance mode and a second passing assistance mode.

First, the first passing assistance mode will be described.
The first passing assistance mode is a mode in which the passing assistance screen is automatically displayed on the touch panel display 16 only when the passing assistance function is on, the vehicle speed corresponding to the vehicle speed information DV is below a predetermined speed (e.g., 5 km/hr), the shift position corresponding to the shift position information DS is drive D or neutral N (when the vehicle is in a forward position; the same applies below), and a passing screen display request signal RQ is output from the stereo camera unit 11.

In this embodiment, this first passing assistance mode is the standard passing assistance mode.

Next, the second passing assistance mode will be described.
On the other hand, the second passing assistance mode is a mode in which the passing assistance screen is automatically displayed on the touch panel display 16 when the passing assistance function is on, the vehicle speed corresponding to the vehicle speed information DV is below a predetermined speed (e.g., 5 km/hr), and the shift position corresponding to the shift position information DS is drive D or neutral N.

In other words, the second passing assistance mode is a mode in which the passing assistance screen is automatically displayed on the touch panel display 16 regardless of whether or not a passing screen display request signal RQ is output from the stereo camera unit 11, and is a passing assistance mode that always switches to the passing assistance mode when the vehicle speed is below a predetermined speed and the shift position is in drive D or neutral N.

Here, the initial settings for the passing assistance function will be described.
FIG. 3 is an explanatory diagram of an example of the initial setting screen.
In this embodiment, it is possible to set the passing assistance function to on (used)/off (not used) and to set the passing assistance mode to be executed when the passing assistance function is on (used).

In the passing assistance function setting area 21 of the omnidirectional monitor setting tab TB1 of the initial setting screen DG1, as shown in FIG. 3, an on/off setting button 22 for the passing assistance function is provided.

The initial setting screen DG1 further includes a standard button 23 corresponding to the first passing assistance mode (shown as first mode in the figure) and a constant button 24 corresponding to the second passing assistance mode (shown as second mode in the figure). These standard button 23 and constant button 24 are exclusively selected. The example in Figure 4 shows the standard button 23 in a selected state.

In the front image automatic display function setting area 25 of the omnidirectional monitor setting tab TB1 of the initial setting screen DG1, as shown in FIG. 4, an on/off setting button 26 for the front image automatic display function is provided.

This automatic front image display function does not display the front image captured by the first surroundings monitoring camera 12-1 when the vehicle is shifted into drive D or neutral N by shifting only the steering wheel, but displays the front image captured by the first surroundings monitoring camera 12-1 when the vehicle is shifted into drive D or neutral N via rear (reverse) R.

Next, the operation of the embodiment will be described.
FIG. 4 is a main processing flowchart according to the embodiment.
First, the camera ECU 15 determines whether the passing assistance mode is on (step S11).

If it is determined in step S11 that the passing assistance mode is on, i.e., the on/off setting button 22 for the passing assistance function on the initial setting screen DG1 is on (step S11; Yes), the camera ECU 15 functions as a determination unit 15A and determines whether the set mode is the first passing assistance mode or the second passing assistance mode (step S12).

If it is determined in step S12 that the setting mode is the first passing assistance mode, i.e., if the standard button 23 on the initial setting screen DG1 is selected (step S12; first passing assistance mode), the camera ECU 15 transitions to first passing assistance mode processing (step S13).

FIG. 5 is a process flowchart of the first passing assistance mode process.
First, the determination unit 15A of the camera ECU 15 determines whether or not the assistance execution is permitted (step S21).
In the determination of step S21, when the assistance execution permission state is not established (step S21; No), the process goes to a standby state.

If it is determined in step S21 that assistance execution is permitted (step S21; Yes), the judgment unit 15A of the camera ECU 15 determines whether or not a navigation screen is currently being displayed on the touch panel display 16 (step S22).

If it is determined in step S22 that the navigation screen is not being displayed (step S22; No), it is deemed that the conditions for performing passing assistance are not met, so the camera ECU 15 transitions the process back to step S21 and enters a standby state.

If it is determined in step S22 that the navigation screen is being displayed (step S22; Yes), the determination unit 15A of the camera ECU 15 determines whether the shift position is drive D or neutral N based on the shift position information DS (step S23).

If it is determined in step S23 that the shift position is neither drive D nor neutral N (step S23; No), it is deemed that the conditions for performing passing assistance are not met, so the determination unit 15A of the camera ECU 15 transitions the process back to step S21 and goes into standby mode.

If it is determined in step S23 that the shift position is drive D or neutral N (step S23; Yes), the determination unit 15A of the camera ECU 15 determines whether the vehicle speed is equal to or lower than a predetermined speed (e.g., 5 km/hr) based on the vehicle speed information DV (step S24).

If it is determined in step S24 that the vehicle speed exceeds the predetermined speed (step S24; No), it is deemed that the conditions for performing passing assistance are not met, so the camera ECU 15 transitions the process back to step S21 and enters a standby state.

If it is determined in step S24 that the vehicle speed is equal to or lower than the predetermined speed (step S24; Yes), the determination unit 15A of the camera ECU 15 determines whether or not a passing screen display request signal RQ has been sent from the stereo camera unit 11 (step S25).

If it is determined in step S25 that the passing screen display request signal RQ has not been received (step S25; No), it is considered that the conditions for performing passing assistance are not met, and the determination unit 15A of the camera ECU 15 goes into a standby state.

If it is determined in step S25 that a passing screen display request signal RQ has been made (step S25; Yes), the conditions for passing assistance are met, so a passing assistance image is displayed on the touch panel display 16 (step S26).

FIG. 6 is an explanatory diagram of an example of a passing support display screen on which a passing support image is displayed.
In a first display area 31 on the screen of the touch panel display 16, an image GD1 of the right side of the host vehicle MV based on the output of the second surroundings monitoring camera 12-2 is displayed as a passing assistance image.

In addition, the second display area 32 of the screen of the touch panel display 16 displays an image GD2 that includes an oncoming vehicle OV that is located in front of the host vehicle MV and is to be passed, as a front image based on the output of the first surroundings monitoring camera 12-1.
Furthermore, in a third display area 33 on the screen of the touch panel display 16, comments such as warnings to the user are displayed.

As a result of the above configuration, the user (driver) can switch to the passing assistance mode when a passing screen display request signal RQ is input from the stereo camera unit 11, the vehicle speed is below a predetermined speed, and the shift position is drive D or neutral N, and the image GD1 as a passing assistance image is automatically displayed in the first display area 31. Therefore, the user can perform passing driving while taking into consideration the automatically displayed image GD1 as the passing assistance image, so that in a situation where a passing assistance image is required, passing driving can be performed without bothering the user.

Next, the process in the second passing assistance mode will be described.
FIG. 7 is a process flowchart of the second passing assistance mode process.
First, the determination unit 15A of the camera ECU 15 determines whether or not the assistance execution is permitted (step S31).
In the determination of step S31, when the assistance execution permission state is not established (step S31; No), the process goes to a standby state.

If the determination in step S31 indicates that assistance execution is permitted (step S31; Yes), the determination unit 15A of the camera ECU 15 determines whether the navigation screen is currently being displayed on the touch panel display 16 (step S32).

If it is determined in step S32 that the navigation screen is being displayed (step S32; Yes), the determination unit 15A of the camera ECU 15 determines whether the shift position is drive D or neutral N based on the shift position information DS (step S33).

If it is determined in step S33 that the shift position is neither drive D nor neutral N (step S33; No), it is deemed that the conditions for performing passing assistance are not met, and the determination unit 15A of the camera ECU 15 ends the process.

If it is determined in step S33 that the shift position is drive D or neutral N (step S33; Yes), the determination unit 15A of the camera ECU 15 determines whether the vehicle speed is equal to or lower than a predetermined speed (e.g., 5 km/hr) based on the vehicle speed information DV (step S34).

If the vehicle speed exceeds the predetermined speed in the determination of step S34 (step S34; No), it is considered that the conditions for performing passing assistance are not met, and the determination unit 15A of the camera ECU 15 ends the process.

If the vehicle speed is determined to be equal to or lower than the predetermined speed in step S34 (step S34; Yes), the determination unit 15A of the camera ECU 15 determines that the conditions for performing passing assistance are met and displays a passing assistance image on the touch panel display 16 (step S35).

On the other hand, if it is determined in step S32 that the navigation screen is not being displayed (step S32; No), the judgment unit 15A of the camera ECU 15 determines whether the shift position is parking P or not based on the shift position information DS (step S36).
When it is determined in step S36 that the shift position is the parking position P (step S36; Yes), the determination unit 15A of the camera ECU 15 transitions the process to step S33 and performs the above-mentioned process.

If it is determined in step S36 that the shift position is not parking P (step S36; No), the determination unit 15A of the camera ECU 15 determines whether the shift position is rear (reverse) R based on the shift position information DS (step S37).

If it is determined in step S37 that the shift position is not rear (reverse) R (step S36; No), the determination unit 15A of the camera ECU 15 transitions the process back to step S32 and repeats the above-mentioned process.

If it is determined in step S37 that the shift position is rear (reverse) R (step S37; Yes), the determination unit 15A of the camera ECU 15 determines whether the front automatic display is on or not based on the initial settings (step S38).

If the determination in step S38 is that the front automatic display is off (step S38; No), the determination unit 15A of the camera ECU 15 transitions the process back to step S32 and repeats the above-mentioned process.

If the determination in step S38 is that the front automatic display is on (step S38; Yes), the determination unit 15A of the camera ECU 15 transitions the process to step S33 and performs the above-mentioned process.

Then, if the shift position is drive D or neutral N and the vehicle speed is equal to or lower than a predetermined speed, the judgment unit 15A of the camera ECU 15 displays the passing assistance image and ends the process (steps S33 to S35).

As explained above, according to the second passing assistance mode processing, when the shift position is drive D or neutral N and the vehicle speed is below a predetermined speed, the passing assistance image is displayed at all times. Therefore, compared to the first passing assistance mode processing, the passing assistance image is displayed even when there is no passing assistance image display request signal RQ from the stereo camera unit 11, so passing assistance is performed more frequently, and even users who have difficulty passing other vehicles can easily do so.

As described above, according to this embodiment, the presence or absence of the passing assistance function and the frequency of the passing assistance function when provided can be selected between the first passing assistance mode and the second passing assistance mode, making it possible to provide passing assistance in a situation more desired by the user.

Although not described in detail in the above explanation, once the passing assistance mode (first passing assistance mode or second passing assistance mode) has been entered, if the shift position temporarily becomes other than drive D or neutral N for a first predetermined period of time (e.g., within 30 seconds), the passing assistance mode may be continued and the passing assistance image may continue to be displayed, as this is a temporary change in the shift position due to a change in direction, etc.

Similarly, once the vehicle has transitioned to the passing assistance mode (first passing assistance mode or second passing assistance mode), if the vehicle speed temporarily exceeds a predetermined value for a second predetermined period of time (e.g., within 20 seconds), this is treated as a temporary change in the travel speed, and the passing assistance mode may be continued and the passing assistance image may continue to be displayed.
The first and second predetermined times can be set arbitrarily, and may be the same.

The program executed by the camera ECU 15 as the display control device of this embodiment may be configured to be provided by recording it in an installable or executable file format on a computer-readable disk-shaped recording medium such as a DVD (Digital Versatile Disk), a USB memory, a semiconductor memory device such as an SSD (Solid state Disk), etc.

Furthermore, the program executed by the camera ECU 15 as the display control device of this embodiment may be configured to be stored on a computer connected to a network such as the Internet and provided by being downloaded via the network. Also, the program executed by the camera ECU 15 of this embodiment may be configured to be provided or distributed via a network such as the Internet.

Although the above is an example of an embodiment of the present invention, the above embodiment is merely an example and is not intended to limit the scope of the invention. The above embodiment can be implemented in various other forms, and various omissions, substitutions, combinations, and modifications can be made without departing from the spirit of the invention. Furthermore, the specifications of each configuration, shape, display element, etc. (structure, type, direction, shape, size, length, width, thickness, height, number, arrangement, position, material, etc.) can be modified as appropriate.

REFERENCE SIGNS LIST 10 In-vehicle surroundings monitoring system 11 Stereo camera unit 11A Imaging unit 11B Signal processing unit 12-1 to 12-4 First surroundings monitoring camera to fourth surroundings camera 13 Vehicle speed sensor 14 Shift sensor 15 Camera ECU
15A Determination unit 15B Control unit 15C Camera I/F unit 16 Touch panel display 21 Assistance function setting area 22 OFF setting button 23 Standard button 24 Always-on button 25 Front image automatic display function setting area 26 OFF setting button 31 First display area 32 Second display area 33 Third display area D Drive DG1 Initial setting screen DS Shift position information DV Vehicle speed information GD1, GD2 Image MV Own vehicle N Neutral OV Oncoming vehicle P Parking RQ Passing screen display request signal TB1 Omnidirectional monitor setting tab

Claims (8)

a determination unit that determines whether or not a vehicle is in a passing state based on at least the vehicle speed information and the shift position information among the passing assistance screen display request signal, the vehicle speed information, and the shift position information;
a control unit that displays , when it is determined that the vehicle is in the passing state , a passing assistance screen on a display device, the passing assistance screen being a screen showing a portion of the vehicle in the passing state ;
Equipped with
a first display mode in which a passing assistance screen is displayed based on the passing assistance screen display request signal, the vehicle speed information, and the shift position information;
a second display mode in which a passing assistance screen is displayed based on the vehicle speed information and the shift position information,
The control unit displays a mode selection screen that prompts a user to select the first display mode or the second display mode. The control unit displays a setting screen that prompts a user to select whether to display or not display the passing support screen.
The display control device according to claim 1 . When the first display mode is selected, a display request is made by the passing assistance screen display request signal,
The vehicle speed based on the vehicle speed information is equal to or lower than a predetermined vehicle speed,
When the shift position based on the shift position information is a forward position, the passing assistance screen is displayed.
The display control device according to claim 1 or 2 . When the second display mode is selected, the control unit
The vehicle speed based on the vehicle speed information is equal to or lower than a predetermined vehicle speed,
When the shift position based on the shift position information is a forward position, the passing support screen is constantly displayed.
The display control device according to claim 1 or 2 . The control unit continues to display the passing support screen for a first predetermined time even if the shift position information is no longer a forward position when the passing support screen is displayed.
The display control device according to claim 3 or 4 . the control unit continues to display the passing support screen for a second predetermined time even if the vehicle speed exceeds a predetermined vehicle speed when the passing support screen is displayed.
The display control device according to claim 3 or 4 . A method executed by a display control device to which a passing support screen display request signal is input from an external device, comprising:
determining whether a vehicle is in a passing state based on at least the vehicle speed information and the gear shift position information among the passing assistance screen display request signal, the vehicle speed information, and the gear shift position information;
a step of displaying a passing assistance screen on a display device when it is determined that the vehicle is in the passing state ;
Equipped with
a first display mode in which a passing assistance screen is displayed based on the passing assistance screen display request signal, the vehicle speed information, and the shift position information;
a second display mode in which a passing assistance screen is displayed based on the vehicle speed information and the shift position information,
A control method for a display control device , comprising: before the step of displaying the passing assistance screen, a step of displaying a mode selection screen that prompts a user to select the first display mode or the second display mode . A program for controlling a display control device to which a passing support screen display request signal is input from an external device, by a computer,
The computer,
a determination unit that determines whether or not a vehicle is in a passing state based on at least the vehicle speed information and the shift position information among the passing assistance screen display request signal, the vehicle speed information, and the shift position information;
a control unit that displays , when it is determined that the vehicle is in the passing state , a passing assistance screen on a display device, the passing assistance screen being a screen showing a portion of the vehicle in the passing state ;
A program for causing the device to function as a
a first display mode in which a passing assistance screen is displayed based on the passing assistance screen display request signal, the vehicle speed information, and the shift position information;
a second display mode in which a passing assistance screen is displayed based on the vehicle speed information and the shift position information,
The control unit displays a mode selection screen that prompts a user to select the first display mode or the second display mode .

Images