JP6950282B2 - Peripheral monitoring device - Google Patents

Description

An embodiment of the present invention relates to a peripheral monitoring device.

Conventionally, a technique has been proposed in which a peripheral image obtained by photographing the periphery of a vehicle is displayed on a display unit inside the vehicle. In addition, a technique for sharpening and displaying a part of a peripheral image has been proposed.

Japanese Unexamined Patent Publication No. 2003-274393

However, in the prior art, a sharpened peripheral image is displayed regardless of the intention of the user. Therefore, in the past, the display may not be performed according to the user's intention.

The peripheral monitoring device according to the embodiment of the present invention includes, for example, an acquisition unit, a first display control unit, a reception unit, and a second display control unit. The acquisition unit acquires the first peripheral image of the vehicle. The first display control unit displays on the display unit a selection screen for selecting a second peripheral image on which image processing related to visibility has been executed for the first peripheral image. The reception unit accepts the selection of the second peripheral image. The second display control unit displays the second peripheral image that has received the selection on the display unit. The first display control unit displays the selection screen when the vehicle is in a traveling state when the condition relating to the visibility of the display unit is satisfied, and then when the stop of the vehicle is detected. According to this configuration, for example, since the second peripheral image selected by the user is displayed in the display area, it is possible to realize the display according to the intention of the user.
Further, the peripheral monitoring device according to the embodiment of the present invention includes, for example, an acquisition unit, a first display control unit, a reception unit, and a second display control unit. The acquisition unit acquires the first peripheral image of the vehicle. The first display control unit displays on the display unit a selection screen for selecting a second peripheral image on which image processing related to visibility has been executed for the first peripheral image. The reception unit accepts the selection of the second peripheral image. The second display control unit displays the second peripheral image that has received the selection on the display unit. When the display unit displays a display screen different from the peripheral image of the vehicle and the condition regarding the visibility of the display unit is satisfied, the first display control unit has a display screen different from the peripheral image of the vehicle. when displaying a peripheral image of the vehicle from, that displays the selection screen before displaying the peripheral image of the vehicle.
Further, the peripheral monitoring device according to the embodiment of the present invention includes, for example, an acquisition unit, a first display control unit, a reception unit, and a second display control unit. The acquisition unit acquires the first peripheral image of the vehicle. The first display control unit displays on the display unit a selection screen for selecting a second peripheral image on which image processing related to visibility has been executed for the first peripheral image. The reception unit accepts the selection of the second peripheral image. The second display control unit displays the second peripheral image that has received the selection on the display unit. The first display control unit displays the selection screen including information about the second peripheral image selected in the past .

Further, for example, the first display control unit may display the selection screen when the condition regarding the visibility of the display unit is satisfied. According to this configuration, for example, since the selection screen is displayed when the condition is satisfied, it is possible to realize the display according to the user's intention without causing the user to feel annoyed.

Further, for example, the condition is at least one of a condition for showing a change in the shooting environment around the vehicle and a condition for showing a change in the visual state of the display unit of the driver by the user. According to this configuration, for example, when a change in the shooting environment or a change in the visual appearance of the display unit occurs, the selection screen is displayed. Therefore, in addition to the above effects, the selection screen is displayed at an appropriate timing. Can be done.

Further, for example, if the vehicle is in a traveling state when the condition is satisfied, the first display control unit displays the selection screen when the vehicle is subsequently detected to stop. According to this configuration, for example, it is possible to realize the display according to the user's intention without hindering the driving of the vehicle.

Further, for example, when the condition is satisfied when the first display control unit displays a display screen different from the peripheral image of the vehicle on the display unit, the display screen different from the peripheral image of the vehicle is displayed. When displaying the peripheral image of the vehicle, the selection screen is displayed before displaying the peripheral image of the vehicle. According to this configuration, for example, in addition to the above effects, the selection screen can be displayed at an appropriate timing.

Further, for example, the first display control unit displays the selection screen including information on the second peripheral image selected in the past. According to this configuration, for example, it is possible to realize a display that is more in line with the user's intention.

FIG. 1 is a schematic view showing an example of the vehicle of the present embodiment. FIG. 2 is an example of a plan view of the vehicle of the present embodiment. FIG. 3 is a diagram showing an example of the hardware configuration of the peripheral monitoring device of the present embodiment. FIG. 4 is a block diagram showing an example of the functional configuration of the peripheral monitoring device of the present embodiment. FIG. 5 is a schematic view showing an example of a normal screen of the present embodiment. FIG. 6 is a schematic view showing an example of the selection screen of the present embodiment. FIG. 7 is a schematic view showing an example of the display form of the selection screen of the present embodiment. FIG. 8 is a schematic view showing an example of the display form of the selection screen of the present embodiment. FIG. 9 is a schematic view showing an example of the selection screen of the present embodiment. FIG. 10 is a schematic view showing an example of the selection screen of the present embodiment. FIG. 11 is a schematic view showing an example of the selection screen of the present embodiment. FIG. 12 is a schematic view showing an example of a normal screen of the present embodiment. FIG. 13 is a schematic view showing a second peripheral image displayed on the normal screen of the present embodiment. FIG. 14 is a flowchart showing an example of the procedure of the peripheral monitoring process of the present embodiment.

Hereinafter, the details of the peripheral monitoring device of the present embodiment will be described with reference to the attached drawings.

In the present embodiment, a mode in which the peripheral monitoring device is mounted on the vehicle will be described as an example.

1 and 2 are schematic views showing an example of a vehicle 1 equipped with the peripheral monitoring device 100 of the present embodiment. FIG. 1 is an example of a perspective view of the vehicle 1 in a state where a part of the passenger compartment 2a of the vehicle 1 is seen through. FIG. 2 is an example of a plan view of the vehicle 1.

The vehicle 1 is, for example, an internal combustion engine vehicle, an electric vehicle, a fuel cell vehicle, a hybrid vehicle, or the like. An internal combustion engine vehicle is a vehicle whose drive source is an internal combustion engine. Electric vehicles and fuel cell vehicles are vehicles that use an electric motor as a drive source. A hybrid vehicle is a vehicle that is driven by both an internal combustion engine and an electric motor. The vehicle 1 may be equipped with various transmission devices, or may be equipped with various devices and parts necessary for driving an internal combustion engine or an electric motor. In addition, the method, number, layout, and the like of the devices involved in driving the wheels 3 in the vehicle 1 can be set in various ways.

The driving method of the vehicle 1 is not limited. The driving method of the vehicle 1 is, for example, two-wheel drive, three-wheel drive, or four-wheel drive. For example, vehicle 1 is a four-wheel drive with four wheels 3. In this case, the vehicle 1 has two left and right front wheels 3F and two left and right rear wheels 3R. In the vehicle 1, the tire angle of the front wheels 3F changes in response to the operation of the steering unit 4. Further, various lights such as headlights 13 are provided on the vehicle body 2 of the vehicle 1.

The vehicle 1 includes a vehicle compartment 2a. The passenger compartment 2a is a space on which the occupants ride. A steering unit 4, an acceleration operation unit 5, a braking operation unit 6, a speed change operation unit 7, and the like are provided in the vehicle interior 2a. The steering unit 4 is a steering wheel protruding from the dashboard. The acceleration operation unit 5 is an accelerator pedal arranged under the driver's feet. The braking operation unit 6 is a brake pedal arranged under the driver's feet. The shift operation unit 7 is a shift lever protruding from the center console. The parts provided in the passenger compartment 2a are not limited to these.

Further, a monitoring device 11 is provided in the vehicle interior 2a. In the present embodiment, the monitoring device 11 is arranged at the center of the dashboard in the vehicle width direction. The monitor device 11 is provided with a display device 8, an audio output device 9, an operation input unit 10, a display drive unit 17, and the like.

The display device 8 is an example of a display unit. The display device 8 is, for example, an LCD (Liquid Crystal Display), an OLELD (Organic Electro-Luminescent Display), or the like. The audio output device 9 is, for example, a speaker.

The operation input unit 10 receives an operation input of a user (for example, a driver or a passenger in the passenger seat). The operation input unit 10 is, for example, a touch panel, a switch, a dial, a joystick, a push button, or the like.

In the present embodiment, the operation input unit 10 is a touch panel and is arranged so as to cover the surface of the display device 8. The user can visually recognize the image displayed on the display device 8 via the operation input unit 10. Further, the user performs various operation inputs by instructing the operation of the position corresponding to the image displayed on the display device 8 via the operation input unit 10.

The display drive unit 17 drives the display device 8 so as to change the tilt angle of the display device 8. The display drive unit 17 changes the tilt angle of the display device 8 by driving the display device 8 in response to an operation instruction of the operation input unit 10 by the user.

The monitoring device 11 may include a plurality of types of operation input units 10. Further, a part of the plurality of types of operation input units 10 may be arranged at a position different from that of the monitoring device 11. For example, the operation input unit 10 arranged at a position different from that of the monitoring device 11 is operated by the user when turning on / off the headlight 13 provided in the vehicle 1 and adjusting various mechanisms. Further, the audio output device 9 may be arranged at a position different from that of the monitor device 11 in the vehicle interior 2a.

In this embodiment, the case where the display device 8 provided in the monitor device 11 is used as the display unit in the peripheral monitoring device 100 will be described. That is, in the present embodiment, a case where the display unit in the peripheral monitoring device 100 is also used as a navigation system or an audio system will be described as an example. However, the display unit in the peripheral monitoring device 100 may be provided separately from the navigation system and the audio system.

Further, the vehicle 1 is provided with a plurality of photographing units 16. For example, the vehicle 1 is provided with four photographing units 16 (16a to 16d).

The photographing unit 16 is, for example, a digital camera having a built-in photographing element such as a CCD (Charge Coupled Device) or a CIS (CMOS Image Sensor). The photographing unit 16 shoots at a predetermined frame rate and obtains captured image data (hereinafter, referred to as a captured image). Each of the photographing units 16 has a wide-angle lens. For example, the photographing unit 16 photographs a viewing angle range of 140 ° to 220 ° in the horizontal direction.

These plurality of photographing units 16 are installed in a direction capable of photographing the environment around the vehicle 1. For example, the photographing unit 16 is installed so as to be able to photograph each of the front direction, the left-right side direction, and the rear direction with respect to the vehicle 1.

In the present embodiment, the photographing unit 16a is arranged at the front end 2c of the vehicle body 2 and is provided on the front grill or the like. Further, the photographing unit 16b is arranged at the left end 2d of the vehicle body 2 and is provided at the left door mirror 2g. Further, the photographing unit 16c is arranged at the rear end portion 2e of the vehicle body 2 and is provided on the wall portion below the door 2h of the rear trunk. Further, the photographing unit 16d is arranged at the right end 2f of the vehicle body 2 and is provided at the right door mirror 2g.

The periphery of the vehicle 1 is photographed by the photographing by these plurality of photographing units 16. That is, the captured image captured by each of the plurality of photographing units 16 is a peripheral image captured around the vehicle 1. In the present embodiment, the captured image captured by the photographing unit 16 will be referred to as a first peripheral image.

Further, the vehicle 1 is provided with a photographing unit 15. The photographing unit 15 is installed at a position where the inside of the vehicle interior 2a can be photographed. In the present embodiment, the photographing unit 15 is arranged at a position where a driver who is a user driving the vehicle 1 can be photographed. In the present embodiment, the captured image captured by the photographing unit 15 will be referred to as a driver image.

FIG. 3 is a diagram showing an example of the hardware configuration of the peripheral monitoring device 100 mounted on the vehicle 1.

The peripheral monitoring device 100 includes a monitoring device 11, an ECU (electronic control unit) 14, a photographing unit 16, a display driving unit 17, a brake system 18, an accelerator sensor 20, a wheel speed sensor 22, and an acceleration sensor 26. And an auto light system 27 and a driver monitor system 28.

The monitor device 11, the ECU 14, the display drive unit 17, the brake system 18, the accelerator sensor 20, the wheel speed sensor 22, the acceleration sensor 26, the auto light system 27, and the driver monitor system 28 are all inside the vehicle. It is electrically connected via the network 23. The in-vehicle network 23 is, for example, a CAN (Controller Area Network).

As described above, the display drive unit 17 drives the display device 8 and changes the tilt angle of the display device 8. The brake system 18 is electrically connected to the brake sensor 18b. The brake system 18 locks the brake, enhances the braking force, and the like. The brake sensor 18b is a sensor that detects the position of the movable portion of the braking operation portion 6. The accelerator sensor 20 is a sensor that detects the position of the movable portion of the acceleration operation unit 5.

The wheel speed sensor 22 is a sensor that detects the amount of rotation of the wheel 3 and the number of rotations per unit time. The acceleration sensor 26 is a sensor that detects the acceleration of the vehicle 1.

The auto light system 27 is electrically connected to a light such as the headlight 13. The auto light system 27 is a system that automatically turns on or off lights such as headlights 13 and small lights according to the environment outside the vehicle 1. For example, the auto light system 27 turns on and off the headlight 13 according to the brightness outside the vehicle, the presence or absence of rain, and the like.

The driver monitor system 28 is a system that monitors the state of the driver. The driver monitor system 28 is electrically connected to the photographing unit 15. For example, the driver monitor system 28 detects the state of the driver by analyzing the face image of the driver included in the driver image taken by the photographing unit 15. In the present embodiment, the driver monitor system 28 detects whether or not the driver who is driving the vehicle 1 wears sunglasses, whether or not the driver is staring at the display device 8, and the like. Gaze means a state in which the display device 8 is continuously visually recognized for a time (for example, several seconds) equal to or longer than a predetermined threshold value. The driver monitor system 28 may be mounted on the ECU 14.

In this embodiment, an example of monitoring the state of the driver using the driver monitor system 28 is shown. However, by using the same system for a person in the passenger seat, it is possible to monitor the condition of the person in the passenger seat. As a result, even if the person in the passenger seat becomes the user to be monitored, whether or not the person in the passenger seat is wearing sunglasses and whether or not the display device 8 is staring at. , Etc. can be detected.

The ECU 14 controls each part of the device mounted on the vehicle 1. The ECU 14 is electrically connected to each part of the device provided in the vehicle 1 via the in-vehicle network 23. Further, the ECU 14 is electrically connected to the photographing unit 16 and the monitoring device 11.

The ECU 14 includes a CPU 14a (Central Processing Unit), a ROM 14b (Read Only Memory), a RAM 14c (Random Access Memory), and an SSD 14f (Solid State Drive, flash memory).

The CPU 14a, ROM 14b, RAM 14c and the like can be integrated in the same package. Further, the ECU 14 may be realized by another logic operation processor such as a DSP (Digital Signal Processor), a logic circuit, or the like instead of the CPU 14a. Further, an HDD (Hard Disk Drive) may be provided instead of the SSD 14f, and the SSD 14f and the HDD may be provided separately from the ECU 14.

Next, the functional configuration of the peripheral monitoring device 100 of the present embodiment will be described.

FIG. 4 is a block diagram showing an example of the functional configuration of the peripheral monitoring device 100 of the present embodiment. The peripheral monitoring device 100 includes an acquisition unit 30A, a display control unit 30B, an image processing unit 30E, a detection unit 30F, a reception unit 30G, and a learning unit 30H. The display control unit 30B includes a first display control unit 30C and a second display control unit 30D.

Each of the above units (acquisition unit 30A, display control unit 30B, first display control unit 30C, second display control unit 30D, image processing unit 30E, detection unit 30F, reception unit 30G, and learning unit 30H) may be, for example, 1 or It is realized by multiple processors. For example, each of the above parts may be realized by causing a processor such as a CPU 14a (see FIG. 3) to execute a program, that is, by software. Each of the above parts may be realized by a processor such as a dedicated IC (Integrated Circuit), that is, hardware. Each of the above parts may be realized by using software and hardware in combination. When a plurality of processors are used, each processor may realize one of each part, or may realize two or more of each part.

In the present embodiment, the CPU 14a realizes each of the above parts by reading and executing a program installed and stored in a storage device such as a ROM 14b.

The acquisition unit 30A acquires the first peripheral image of the vehicle 1. As described above, the photographing unit 16 obtains a first peripheral image by photographing the periphery of the vehicle 1. The acquisition unit 30A acquires the first peripheral image by receiving the first peripheral image from the photographing unit 16.

The display control unit 30B controls to display various images and various display screens on the display device 8. In the present embodiment, the display control unit 30B displays a predetermined normal screen on the display device 8 in the normal state. The normal state indicates a state in which the conditions described later (details will be described later) are not satisfied.

FIG. 5 is a schematic view showing an example of the normal screen 62. The normal screen 62 includes the display area 50A of the first peripheral image 52. In the example shown in FIG. 5, the normal screen 62 includes the display area 50A of the first peripheral image 52.

The display area 50A of the first peripheral image 52 is an area for displaying the first peripheral image 52 acquired from the photographing unit 16.

The normal screen 62 may include another display area. Further, the normal screen 62 may be a display screen 70 including at least the display area 50A of the first peripheral image 52.

Returning to FIG. 4, the description will be continued. The display control unit 30B includes a first display control unit 30C and a second display control unit 30D.

The first display control unit 30C displays on the display device 8 a selection screen for selecting the second peripheral image on which the image processing related to visibility has been executed for the first peripheral image 52.

The image processing related to visibility refers to image processing that changes the visibility of the first peripheral image 52. For example, image processing related to visibility includes edge enhancement, noise removal, super-resolution, luminance correction, and the like. The image processing related to visibility is not limited to these.

The image processing unit 30E performs the above image processing on the first peripheral image 52 to generate a second peripheral image. The image processing unit 30E uses a known image processing method to perform edge enhancement, noise removal, super-resolution (high resolution), luminance correction, and the like on the first peripheral image 52. In the present embodiment, the image processing unit 30E performs edge enhancement, noise removal, super-resolution, and luminance correction so as to improve the visibility of the first peripheral image 52 with respect to the first peripheral image 52. And so on.

The image processing unit 30E may perform image processing relating to visibility to the entire region of the first peripheral image 52, or may perform image processing relating to visibility to a part of the region of the first peripheral image 52. Image processing may be performed.

The first display control unit 30C displays the selection screen of the second peripheral image on which the image processing has been executed on the first peripheral image 52 on the display device 8. For example, the first display control unit 30C switches the display screen 70 of the display device 8 from the normal screen 62 (see FIG. 5) to the selection screen.

FIG. 6 is a schematic view showing an example of the selection screen 60. The selection screen 60 is a display screen 70 showing the second peripheral image 54 so that the user can select it. In the present embodiment, the selection screen 60 is a display screen 70 showing the first peripheral image 52 and the second peripheral image 54 so that the user can select them. That is, for example, on the selection screen 60, the user can select the first peripheral image 52, which is a peripheral image for which image processing has not been executed, and the second peripheral image 54, which is a peripheral image for which image processing has been executed. It is the display screen 70 shown.

For example, the selection screen 60 includes a thumbnail of the first peripheral image 52 and a thumbnail of the second peripheral image 54. Hereinafter, the thumbnail of the first peripheral image 52 will be referred to as the first thumbnail 53. Further, in the following, the thumbnail of the second peripheral image 54 will be referred to as the second thumbnail 55.

The selection screen 60 may be any screen as long as the second peripheral image 54 image-processed by the image processing unit 30E can be selected, and is not limited to the display of thumbnails. For example, the selection screen 60 may be character information indicating the content of the image processing applied to the second peripheral image 54, or a symbol or an image showing the content of the image processing in a schematic manner.

The content of image processing is represented by the type of image processing and the strength of image processing. The types of image processing are, for example, edge enhancement, noise removal, super-resolution, luminance correction, and the like. The strength of the image processing is, for example, the strength of edge enhancement, the strength of noise removal, the resolution, the brightness value after correction, and the like. The type of image processing is not limited to these. Further, the method of expressing the strength of image processing is not limited to the above.

In the present embodiment, the first display control unit 30C displays the selection screen 60 on the display device 8 when the condition relating to the visibility of the display device 8 is satisfied.

The condition regarding visibility is a condition regarding a change in the visibility of the display screen 70 of the display device 8 by the user.

The visibility of the display screen 70 is caused by, for example, a change in the visibility state of the display device 8 by the driver or a change in the environment outside the vehicle 1. Specifically, the visibility of the display screen 70 by the driver changes depending on the posture of the driver, the orientation of the face, and the like. Further, the visibility of the display screen 70 by the driver changes depending on the intensity of the light shining from the outside of the vehicle 1 toward the display device 8. In addition, the brightness and sharpness of the first peripheral image 52 captured by the photographing unit 16 may change due to changes in the brightness and weather outside the vehicle 1. Therefore, the visibility of the display screen 70 displayed on the display device 8 changes due to changes in the environment outside the vehicle 1.

Therefore, the condition relating to visibility is, for example, at least one of a condition relating to indicating a change in the photographing environment around the vehicle 1 and a condition relating to indicating a change in the viewing condition of the display device 8 by the driver.

When the condition regarding the visibility of the display device 8 is satisfied, it means that the shooting environment around the vehicle 1 shows a predetermined change, or the visibility status of the display device 8 by the driver shows a predetermined change. When, indicate.

Specifically, when the shooting environment around the vehicle 1 shows a predetermined change, that is, when the lights mounted on the vehicle 1 such as the headlight 13 and the small lamp are switched from the off state to the on state. , When the light is switched from the lit state to the extinguished state, when the brightness around the vehicle 1 is out of the predetermined brightness range, and the like.

When the photographing environment around the vehicle 1 shows a predetermined change, the first peripheral image 52 photographed by the photographing unit 16 may be an image that is difficult to see when displayed on the display device 8. Therefore, in the present embodiment, the change in the shooting environment around the vehicle 1 is used as one of the determinations that the condition regarding visibility is satisfied.

Further, when the visual condition of the display device 8 by the driver shows a predetermined change, the driver stares at the display device 8 when the tilt angle of the display device 8 is changed according to the operation instruction by the user. When the driver puts on sunglasses, when the driver removes sunglasses, and so on.

When the visual environment of the display device 8 is too bright to be visually recognized, or too dark to be visually recognized, the driver often changes the tilt angle of the display device 8 or stares at the display device 8. Further, when the driver puts on or removes sunglasses, the appearance of the display device 8 from the driver often changes. Therefore, in the present embodiment, actions such as changing the tilt angle of the display device 8, staring at the display device 8, putting on or taking off sunglasses, etc. are used as one of the determinations that the condition relating to visibility is satisfied. ..

In the present embodiment, the detection unit 30F detects whether or not the condition related to visibility is satisfied.

For example, when the detection unit 30F detects that the engine has started, it determines that the engine of the vehicle 1 has switched from the stopped state to the engine started state. By this determination, the detection unit 30F detects that the condition related to visibility is satisfied.

Further, the detection unit 30F switches between the on state and the off state when the light mounted on the vehicle 1 changes from off to on, or when the light changes from on to off. It is determined that it was.

Specifically, the detection unit 30F receives a signal from the auto light system 27 indicating switching between the on state and the off state of the headlight 13 and the small light, so that the light is in the on state and the off state. It is determined that the switch has been made between. Further, the detection unit 30F receives a signal indicating on or off of the light, which is instructed by the operation of the operation input unit 10 by the user, from the operation input unit 10. As a result, the detection unit 30F may determine that the light has been switched between the lit state and the extinguished state. Based on these determinations, the detection unit 30F detects that the condition for indicating a change in the photographing environment around the vehicle 1 is satisfied.

Further, an illuminance sensor for detecting the illuminance of the outside world is arranged on the vehicle body 2. Then, when the detection unit 30F detects an illuminance of a predetermined brightness or less by the illuminance sensor, or when it detects an illuminance of a predetermined brightness or more, the brightness around the vehicle 1 is within a predetermined range of brightness. Determine that it is outside. Even if the detection unit 30F analyzes the brightness and brightness of the first peripheral image 52 acquired from the photographing unit 16 and determines that the brightness around the vehicle 1 is out of the predetermined brightness range. good. Based on these determinations, the detection unit 30F detects that the condition for indicating a change in the photographing environment around the vehicle 1 is satisfied.

Further, the detection unit 30F detects that the condition related to visibility is satisfied by receiving a signal indicating a change in the tilt angle of the display device 8 from the display drive unit 17.

Further, the detection unit 30F receives from the driver monitor system 28 detection results such as whether or not the driver who is driving the vehicle 1 wears sunglasses and whether or not the driver is staring at the display device 8. Detects that the condition for visibility is satisfied.

When the detection unit 30F detects that the condition relating to the visibility of the display device 8 is satisfied, the detection unit 30F outputs an establishment signal indicating that the condition is satisfied to the display control unit 30B. The first display control unit 30C of the display control unit 30B determines that the condition regarding the visibility of the display device 8 is satisfied by receiving the establishment signal from the detection unit 30F. Then, when the first display control unit 30C determines that the condition is satisfied, the first display control unit 30C displays the selection screen 60 on the display device 8.

In addition to the above conditions, the first display control unit 30C may display the selection screen 60 on the display device 8 when other conditions are satisfied.

For example, if the vehicle 1 is in a traveling state when the above conditions are satisfied, the first display control unit 30C may display the selection screen 60 on the display device 8 when the vehicle 1 is subsequently detected to stop. good. Further, for example, when the first display control unit 30C is displaying the display screen 70 different from the peripheral image of the vehicle 1 on the display device 8 and the above condition is satisfied, the display screen 70 different from the peripheral image of the vehicle 1 is satisfied. When displaying the peripheral image of the vehicle 1, the selection screen 60 may be displayed before displaying the peripheral image of the vehicle 1. In this case, the peripheral monitoring device 100 can realize the display according to the user's intention without interfering with the driving of the vehicle 1, for example.

If the first display control unit 30C detects whether or not the vehicle 1 is in a stopped state by using the detection result of the rotation speed of the wheel 3 of the wheel speed sensor 22 and the detection result of the acceleration by the acceleration sensor 26, good. Then, when the above conditions are satisfied and the stop of the vehicle 1 is detected, the first display control unit 30C may display the selection screen 60 on the display device 8.

Further, when the first display control unit 30C controls to display the first peripheral image 52 in the display area 50A of the first peripheral image 52 (see FIG. 5), the first peripheral image 52 is displayed on the display device 8. It may be determined that it is displayed. Then, when the above conditions are satisfied and the first peripheral image 52 is displayed on the display device 8, the first display control unit 30C may display the selection screen 60 on the display device 8.

The first display control unit 30C may display the selection screen 60 on the display device 8 on condition that the engine of the vehicle 1 is switched from the stopped state to the engine started state. When the engine is switched from the stopped state to the started state, the time when the engine is started is also included.

The first display control unit 30C displays the selection screen 60 on the display device 8 by switching the display screen of the display device 8 from the normal screen 62 (see FIG. 5) to the selection screen 60 (see FIG. 6). It is not limited to the form.

7 and 8 are schematic views showing an example of the display form of the selection screen 60. For example, as shown in FIG. 7, the first display control unit 30C may arrange the normal screen 62 and the selection screen 60 on one display screen 70C and display them on the display device 8.

Further, as shown in FIG. 8, the first display control unit 30C may display the display screen 70D in which the selection screen 60 is superposed on the front surface of the normal screen 62 on the display device 8.

Further, the first display control unit 30C may display the selection screen 60 in a part of the area of the normal screen 62 of FIG.

The first display control unit 30C may display the second thumbnail 55 of each of the plurality of second peripheral images 54 having different image processing contents on the selection screen 60.

In this case, the image processing unit 30E executes a plurality of image processings having different contents, that is, different types and intensities of image processing, on the first peripheral image 52 acquired by the acquisition unit 30A, and a plurality of second peripheral images. 54 may be generated. Then, the first display control unit 30C may display the second thumbnail 55 of the second peripheral image 54, which has been subjected to image processing having different contents, on the selection screen 60.

FIG. 9 is a schematic view showing an example of the selection screen 60A. The selection screen 60A is an example of the selection screen 60. The selection screen 60A includes a first thumbnail 53 of the first peripheral image 52 and a second thumbnail 55 of each of a plurality of second peripheral images 54 having different image processing contents. FIG. 9 shows, as an example, a case where the selection screen 60A includes five second thumbnails 55 (second thumbnails 55A to 55E). The number of second thumbnails 55 of the second peripheral image 54 included in the selection screen 60A is not limited.

The second thumbnail 55A and the second thumbnail 55B are thumbnails of the second peripheral image 54 for which the brightness correction has been executed with respect to the first peripheral image 52. The intensity of the brightness correction is different between the second peripheral image 54 of the second thumbnail 55A and the second peripheral image 54 of the second thumbnail 55B. In the example shown in FIG. 9, the second peripheral image 54 of the second thumbnail 55B is brightness-corrected so as to have a higher luminance value than the second peripheral image 54 of the second thumbnail 55A.

The second thumbnail 55C to the second thumbnail 55E are the second thumbnail 55 of the second peripheral image 54 in which the edge is emphasized with respect to the first peripheral image 52. The second peripheral image 54 of the second thumbnail 55C to the second peripheral image 54 of the second thumbnail 55E have different edge enhancement intensities. In the example shown in FIG. 9, the second peripheral image 54 of the second thumbnail 55E, the second peripheral image 54 of the second thumbnail 55D, and the second peripheral image 54 of the second thumbnail 55C are more strongly edge-enhanced in this order. ing.

The type of image processing applied to the second peripheral image 54 represented by the second thumbnail 55 included in the selection screen 60A is not limited to edge enhancement and luminance correction. That is, the type of image processing applied to the second peripheral image 54 represented by the second thumbnail 55 included in the selection screen 60A may be, for example, noise removal or super-resolution.

Further, FIG. 9 shows a form in which the selection screen 60A includes a second thumbnail 55 of a plurality of second peripheral images 54 having different image processing intensities for each type of image processing. However, the selection screen 60A is a form in which two or more types of image processing are performed, and the second thumbnail 55 of each of a plurality of second peripheral images 54 having different combinations of the types of image processing performed is included. May be good.

The first display control unit 30C may display the selection screen 60 that does not include the first thumbnail 53 of the first peripheral image 52 on the display device 8.

FIG. 10 is a schematic view showing an example of the selection screen 60B. The selection screen 60B is an example of the selection screen 60. The first display control unit 30C may display the selection screen 60B including only the second thumbnail 55 on the display device 8.

Further, the first display control unit 30C may display the selection screen 60 including the adjustment gauge 56 on the display device 8. The adjustment gauge 56 is an image for receiving an instruction for adjusting the intensity of image processing. The user operates and inputs an adjustment instruction for the intensity of image processing by operating the position of the adjustment button 56A on the adjustment gauge 56 displayed on the display device 8 via the operation input unit 10.

For example, when the adjustment button 56A is positioned at one end of the adjustment gauge 56 in the long direction by the operation instruction of the operation input unit 10 by the user, the image processing unit 30E sends a signal indicating that the image processing is not performed. Accept. Further, for example, the more the adjustment button 56A is positioned closer to the other end of the adjustment gauge 56 in the elongated direction by the operation instruction of the operation input unit 10 by the user, the stronger the image processing of the image processing unit 30E is. A signal indicating a larger value toward a predetermined maximum value is received. Then, the image processing unit 30E may adjust the intensity of the image processing of the second peripheral image 54 so that the intensity corresponds to the signal input by the operation. Then, the first display control unit 30C may display the second thumbnail 55 of the second peripheral image 54 whose image processing intensity has been adjusted on the display device 8. When the image processing unit 30E receives a signal indicating that no image processing is performed, the image processing unit 30E does not perform image processing. Therefore, in this case, the first display control unit 30C may display the first thumbnail 53 of the first peripheral image 52 on the display device 8.

The first display control unit 30C may display the selection screen 60 step by step according to the selection by the user. For example, first, the first display control unit 30C includes a selection screen 60 including a first thumbnail 53 of the first peripheral image 52 and a second thumbnail 55 of the second peripheral image 54 (see FIGS. 6 and 9). Is displayed on the display device 8. Then, when the second thumbnail 55 is selected by the operation of the operation input unit 10 by the user, the first display control unit 30C does not include the first thumbnail 53 of the first peripheral image 52 (see FIG. 10). ) May be displayed on the display device 8.

Further, the first display control unit 30C can select the first peripheral image 52, which is a peripheral image in which image processing has not been executed, and the second peripheral image 54, which is a peripheral image in which image processing has been executed, by the user. The adjustment gauge 56 may be further displayed on the selection screen 60 shown in 1.

FIG. 11 is a schematic view showing an example of the selection screen 60C. The selection screen 60C is an example of the selection screen 60. The selection screen 60C includes a first thumbnail 53 of the first peripheral image 52, a second thumbnail 55 of the second peripheral image 54, and an adjustment gauge 56 for receiving an image processing intensity adjustment instruction for the second peripheral image 54. ,including. The first display control unit 30C may display such a selection screen 60C on the display device 8.

In this case, the user operates the position of the adjustment button 56A on the adjustment gauge 56 displayed on the selection screen 60C via the operation input unit 10 to instruct the second peripheral image 54 to adjust the intensity of image processing. Operation input. Then, the image processing unit 30E may adjust the intensity of the image processing of the second peripheral image 54 so as to have the intensity input by the operation. Then, the first display control unit 30C may display the selection screen 60C including the second thumbnail 55 of the second peripheral image 54 whose image processing intensity has been adjusted on the display device 8.

The first display control unit 30C may display the second thumbnail 55 of the second peripheral image 54, which has been subjected to image processing of the content according to the condition related to visibility, on the selection screen 60.

In this case, the image processing unit 30E may perform image processing on the first peripheral image 52 acquired by the acquisition unit 30A according to the conditions related to visibility to generate the second peripheral image 54. Then, the first display control unit 30C may display the second thumbnail 55 of the second peripheral image 54, which has been subjected to image processing of the content according to the condition related to visibility, on the selection screen 60.

For example, the first display control unit 30C may display the second thumbnail 55 of the second peripheral image 54, which has been subjected to the stronger image processing, on the selection screen 60 as the tilt angle of the display device 8 is larger. .. Specifically, the first display control unit 30C may display the second peripheral image 54 having higher brightness (or lower brightness) on the selection screen 60 as the tilt angle of the display device 8 is larger. good.

Further, for example, the first display control unit 30C may display the second peripheral image 54 on which the image processing of stronger intensity is executed is displayed on the selection screen 60 as the driver stares at the display device 8 for a longer time. .. Specifically, the longer the time for staring at the display device 8, the higher the resolution (or the lower resolution) of the second peripheral image 54 may be displayed on the selection screen 60.

Returning to FIG. 4, the reception unit 30G will be described next. The reception unit 30G accepts the selection of the second peripheral image 54 on the selection screen 60.

For example, the user operates the operation input unit 10 while visually recognizing the selection screen 60 displayed on the display device 8, and operates the second thumbnail 55 of the second peripheral image 54 subjected to the image processing intended by the user. Instruct. As a result, the user selects the second peripheral image 54 that has undergone the desired image processing. The reception unit 30G accepts the user's selection of the second peripheral image 54 from the operation input unit 10.

The reception unit 30G outputs the selection information indicating the second peripheral image 54 that has received the selection to the display control unit 30B and the learning unit 30H.

The learning unit 30H learns the past selection status of the second peripheral image 54. In other words, the learning unit 30H learns the user's preference.

The learning unit 30H receives selection information from the reception unit 30G. The selection information includes, for example, the content of image processing (type and intensity of image processing) applied to the selected second peripheral image 54. The learning unit 30H updates the selection history information every time the selection information is received from the reception unit 30G.

The selection history information is information indicating the selection history of the second peripheral image 54 by the user. For example, the selection history information is associated with the content of the image processing and the date and time when the selection information is received. The learning unit 30H extracts the content of the image processing shown in the selection information received from the reception unit 30G and registers it in the selection history information.

The selection history information may be associated with the content of the image processing, the date and time when the selection information is received, and the information indicating the above conditions at the date and time.

In this case, the learning unit 30H receives information indicating the above conditions detected at the date and time when the selection information is received from the detection unit 30F. For example, the learning unit 30H has information indicating whether the light mounted on the vehicle 1 is in the off state or the on state at the date and time when the selection information is received, and the light is switched from the off state to the on state. And the information indicating whether or not the driver wore sunglasses are accepted as the information indicating the conditions.

Then, the learning unit 30H updates the selection history information every time the selection information is received from the reception unit 30G. Specifically, the learning unit 30H registers the content of the image processing, the date and time when the selection information is received, and the information indicating the above conditions at the date and time in association with each other in the selection history information.

Then, each time the learning unit 30H receives new selection information from the reception unit 30G, the learning unit 30H learns the past selection status of the second peripheral image 54 using the selection history information and generates learning information. The timing of generating learning information by the learning unit 30H is not limited to this timing. The learning information is information indicating the past selection status of the second peripheral image 54. That is, the learning information is information indicating the user's preference. For example, the learning information indicates the content of image processing applied to the second peripheral image 54 that has been selected a predetermined number of times or more in the past.

For example, the learning unit 30H uses the selection history information to continuously display the second peripheral image 54 having the same image processing content a predetermined number of times (for example, 3) regardless of whether the light is off or on. Time) Analyze whether or not it has been selected more than once. Then, when the learning unit 30H is selected more than the predetermined number of times, the learning unit 30H generates the content of the image processing as learning information indicating the learning result.

Further, for example, the learning unit 30H uses the selection history information to continuously perform the second peripheral image 54 having the same image processing content a predetermined number of times (for example, three times) regardless of whether or not the driver wears sunglasses. ) You may analyze whether or not the above selection has been made. Also in this case, when the learning unit 30H is selected more than the predetermined number of times, the learning unit 30H generates the content of the image processing as learning information indicating the learning result.

Further, for example, the learning unit 30H uses the selection history information to display the second peripheral image 54, which has been subjected to the same image processing, a predetermined number of times within a predetermined time after the light is switched from the off state to the on state. It is analyzed whether or not it is continuously selected (for example, three times) or more. Then, when the learning unit 30H is selected more than the predetermined number of times, the learning unit 30H generates the content of the image processing as learning information indicating the learning result.

Further, for example, in the learning unit 30H, the content of the image processing of the second peripheral image 54 selected within a predetermined time after the state of the driver changes from the state of wearing sunglasses to the state of removing sunglasses is equal to or more than a predetermined number of times. Analyze whether they were the same. Then, when the learning unit 30H is selected more than the predetermined number of times, the learning unit 30H generates the content of the image processing as learning information indicating the learning result.

It is assumed that the learning unit 30H does not generate learning information when it learns that there is no second peripheral image 54 selected more than the predetermined number of times.

The learning information which is the learning result by the learning unit 30H is used by the first display control unit 30C. For example, the first display control unit 30C uses the learning information to display the selection screen 60 according to the user's past selection status on the display device 8. For example, the first display control unit 30C displays the selection screen 60 including information about the second peripheral image 54 selected in the past.

For example, the first display control unit 30C specifies the content of the image processing selected more than a predetermined number of times, which is shown in the learning information. That is, the first display control unit 30C identifies the content of the image processing executed on the second peripheral image 54 selected in the past by reading the learning information.

Then, the first display control unit 30C adds information indicating that the image has been selected in the past to the second thumbnail 55 of the second peripheral image 54 that has been subjected to image processing of the specified content, and displays the information on the selection screen 60. do.

An example will be described with reference to FIG. For example, among the second peripheral images 54 of the second thumbnail 55 displayed on the selection screen 60, the second peripheral image 54 of the second thumbnail 55D has the same contents as the second peripheral image 54 continuously selected in the past. It is assumed that the second peripheral image 54 has been subjected to the image processing of. In this case, the first display control unit 30C indicates that the second peripheral image 54 has been subjected to image processing of the contents selected in the past in the vicinity of the second thumbnail 55D based on the learning information (information indicating that the second peripheral image 54 has been subjected to image processing of the contents selected in the past. For example, the border M) is displayed.

The first display control unit 30C may display the second peripheral image 54, which is highly likely to be selected, on the display device 8 without displaying the selection screen 60, depending on the learning information.

In this case, for example, the first display control unit 30C identifies the content of the image processing executed on the second peripheral image 54 selected in the past by reading the learning information. Then, the first display control unit 30C may display the second peripheral image 54 to which the image processing of the content has been performed on the display device 8.

The first display control unit 30C may display the selection screen 60 on the display device 8 other than when the condition regarding the visibility of the display device 8 is satisfied. For example, when the display instruction of the selection screen 60 is input by the operation instruction of the operation input unit 10 by the user, the first display control unit 30C may display the selection screen 60 on the display device 8.

In this case, for example, the normal screen 62 may be provided with a selection button for instructing the display of the selection screen 60. FIG. 12 is a schematic view showing an example of the normal screen 62. For example, the normal screen 62 may be a display screen 70 provided with a selection button B. The selection button B is a button image operated by the user when instructing the display of the selection screen 60. The user instructs the display of the selection screen 60 by instructing the operation of the selection button B. Then, the operation input unit 10 outputs a signal indicating a display instruction to the first display control unit 30C. When the first display control unit 30C receives a signal indicating a display instruction from the operation input unit 10, the selection screen 60 may be displayed on the display device 8.

Returning to FIG. 4, the description will be continued. Next, the second display control unit 30D will be described.

As described above, when the user selects the second thumbnail 55 of the second peripheral image 54 subjected to the desired image processing while referring to the selection screen 60, the reception unit 30G receives the second peripheral image 54 by the user. Accept your choice. The reception unit 30G outputs information indicating the second peripheral image 54 that has received the selection to the second display control unit 30D.

The second display control unit 30D displays the second peripheral image 54 that has received the selection on the display device 8.

Specifically, the second display control unit 30D displays the second peripheral image 54 of the selected second thumbnail 55, not the selected second thumbnail 55, in the display area 50A of the first peripheral image 52.

FIG. 13 is a schematic view showing a second peripheral image 54 displayed on the normal screen 62. For example, the second display control unit 30D displays the selected second peripheral image 54 in place of the first peripheral image 52 in the display area 50A of the first peripheral image 52 on the normal screen 62.

Therefore, the display device 8 displays the second peripheral image 54 that has undergone image processing selected by the user.

Next, the procedure of the peripheral monitoring process executed by the peripheral monitoring device 100 of the present embodiment will be described.

FIG. 14 is a flowchart showing an example of the procedure of peripheral monitoring processing.

First, the acquisition unit 30A acquires the first peripheral image 52 from the photographing unit 16 (step S100). Next, the display control unit 30B displays the normal screen 62 including the first peripheral image 52 on the display device 8 (step S102). By the process of step S102, the normal screen 62 shown in FIG. 5 is displayed on the display device 8.

Next, the first display control unit 30C determines whether or not the condition regarding the visibility of the display device 8 is satisfied (step S104). For example, the first display control unit 30C determines in step S104 by determining whether or not an establishment signal indicating that the condition has been satisfied has been received from the detection unit 30F. If it is determined that the condition is not satisfied (step S104: No), the process proceeds to step S126, which will be described later. If it is determined that the condition is satisfied (step S104: Yes), the process proceeds to step S106.

In step S106, the first display control unit 30C determines whether or not the first peripheral image 52 is being displayed on the display device 8 (step S106). For example, the first display control unit 30C determines in step S106 by determining whether or not the display control of the normal screen 62 (see FIG. 5) including the first peripheral image 52 is being performed on the display device 8. .. If a navigation screen, an audio screen, or the like is displayed and the first peripheral image 52 is not being displayed on the display device 8, a negative determination is made (step S106: No). Then, the negative determination (step S106: No) is repeated until an affirmative determination (step S106: Yes) is made in step S106. When the first peripheral image 52 is being displayed on the display device 8, a positive determination is made (step S106: Yes), and the process proceeds to step S108.

In step S108, the first display control unit 30C determines whether or not the vehicle 1 is stopped (step S108). For example, the first display control unit 30C detects whether or not the vehicle 1 is in a stopped state by using the detection result of the rotation speed of the wheel 3 of the wheel speed sensor 22 and the detection result of the acceleration by the acceleration sensor 26. do. If the vehicle 1 is not stopped, a negative determination is made (step S108: No). Then, the negative determination (step S108: No) is repeated until an affirmative determination (step S108: Yes) is made in step S108. If it is determined that the vehicle 1 is stopped, an affirmative determination is made (step S108: Yes), and the process proceeds to step S110.

Next, the first display control unit 30C determines whether or not there is learning information (step S110). In the present embodiment, the first display control unit 30C determines in step S110 by determining whether or not there is learning information generated by the learning unit 30H.

If a negative determination is made in step S110 (step S110: No), the process proceeds to step S112. In step S112, the image processing unit 30E executes image processing related to visibility on the first peripheral image 52 acquired in step S100 to generate a second peripheral image 54 (step S112). For example, the image processing unit 30E generates one or a plurality of second peripheral images 54 having different image processing contents. At this time, as described above, the image processing unit 30E may execute image processing of the contents according to the conditions used for the determination in step S104 to generate the second peripheral image 54.

Next, the first display control unit 30C displays the selection screen 60 for selecting the second peripheral image 54 generated in step S112 on the display device 8 (step S114). By the process of step S114, for example, as shown in FIGS. 6 to 10, the selection screen 60 including the second thumbnail 55 of the second peripheral image 54 is displayed on the display device 8. Then, the process proceeds to step S122, which will be described later.

On the other hand, if an affirmative determination is made in step S110 (step S110: Yes), the process proceeds to step S116. In step S116, the first display control unit 30C uses the learning information generated by the learning unit 30H to specify the content of the image processing executed on the second peripheral image 54 selected in the past (step S116). ..

Next, the image processing unit 30E executes image processing related to visibility on the first peripheral image 52 acquired in step S100 to generate a second peripheral image 54 (step S118). The process of step S118 is the same as that of step S112.

Next, the first display control unit 30C displays the selection screen 60 for selecting the second peripheral image 54 generated in step S118 on the display device 8 (step S120). In step S120, the first display control unit 30C performs the second peripheral image 54 to which the image processing of the content specified in step S116 is performed among the second thumbnail 55 of the second peripheral image 54 generated in step S118. Information (for example, a frame line M) indicating that the image has been selected in the past is added to the second thumbnail 55 of the above, and the image is displayed on the display device 8. Then, the process proceeds to step S122.

As described above, the process of step S120 may be omitted in order to reduce the selection load of the user. In this case, as shown in FIG. 12, a button B for displaying the selection screen 60 may be prepared. Then, when the user gives an operation instruction to the selection button B, the selection screen 60 may be displayed on the display device 8. In this case, the user can arbitrarily display the selection screen 60, which is preferable.

In step S122, the reception unit 30G determines whether or not the selection of the second peripheral image 54 has been accepted (step S122). The reception unit 30G repeats the negative determination (step S122: No) until it determines that the selection of the second peripheral image 54 has been accepted (step S122: Yes). If an affirmative decision is made in step S122 (step S122: Yes), the process proceeds to step S124.

In step S124, the second display control unit 30D displays the second peripheral image 54 whose selection has been accepted in step S122 in the display area 50A of the first peripheral image 52 (step S124). By the process of step S124, the display device 8 displays the second peripheral image 54 on which the image processing selected by the user has been executed (see FIG. 13).

Next, the display control unit 30B determines whether or not to end the process (step S126). For example, the display control unit 30B determines in step S126 by determining whether or not the engine of the vehicle 1 has been turned off. If a negative determination is made in step S126 (step S126: No), the process returns to step S100. If an affirmative judgment is made in step S126 (step S126: Yes), this routine ends.

As described above, the peripheral monitoring device 100 of the present embodiment includes, for example, an acquisition unit 30A, a first display control unit 30C, a reception unit 30G, and a second display control unit 30D. The acquisition unit 30A acquires the first peripheral image 52 of the vehicle 1. The first display control unit 30C displays on the display device 8 a selection screen 60 for selecting the second peripheral image 54 on which the image processing related to visibility has been executed for the first peripheral image 52. The reception unit 30G accepts the selection of the second peripheral image 54. The second display control unit 30D displays the second peripheral image 54 that has received the selection on the display device 8.

Here, conventionally, an image obtained by sharpening a peripheral image has always been displayed on a display device regardless of the intention of the user. For this reason, conventionally, depending on the situation of the user, the traveling environment of the vehicle 1, and the like, an image that is harder to see than the captured image before the sharpening process may be displayed. Further, in the past, it is unknown to the user whether the sharpened image is displayed or the captured image is displayed as it is, and the reliability of the device may be misunderstood. rice field.

On the other hand, the peripheral monitoring device 100 of the present embodiment displays the selection screen 60 of the second peripheral image 54, and displays the second peripheral image 54 selected by the user via the selection screen 60 on the display device 8. ..

Therefore, the user can intentionally select the second peripheral image 54 that has undergone the desired image processing.

Therefore, the peripheral monitoring device 100 of the present embodiment can realize the display according to the intention of the user.

Further, it is easy to understand that the peripheral monitoring device 100 of the present embodiment has a function of performing image processing related to visibility on the first peripheral image 52 by displaying the selection screen 60. Can be provided. Further, the peripheral monitoring device 100 of the present embodiment can suppress a misunderstanding of the reliability of the peripheral monitoring device 100.

In the present embodiment, the image displayed before displaying the selection screen 60 is the first peripheral image 52 that has not been subjected to image processing related to visibility, and after being selected by the user on the selection screen 60. The displayed image has been described as being a second peripheral image 54 that has undergone image processing related to visibility. However, it is not limited to such a form.

For example, the image displayed before displaying the selection screen 60 may be the second peripheral image 54 that has undergone image processing related to visibility. That is, the second peripheral image 54 that has already undergone image processing may be displayed before the selection screen 60 is displayed. The second peripheral image 54 that has already undergone image processing is, for example, a peripheral image that has undergone the same image processing as the second peripheral image 54 that was selected in the past (for example, last time).

The image displayed after being selected by the user on the selection screen 60 is an image related to visibility different from the image processing related to visibility applied to the second peripheral image 54 displayed before displaying the selection screen 60. It may be the second peripheral image 54 which has been processed. That is, after displaying the second peripheral image 54 that has already undergone image processing, the selection screen 60 is displayed, and the image that is displayed after being selected on the selection screen 60 is the first image that has already undergone image processing. The second peripheral image 54 may be obtained by subjecting the two peripheral image 54 to another image processing.

Further, the image displayed before displaying the selection screen 60 is a second peripheral image 54 subjected to image processing related to visibility, and the image displayed after being selected by the user on the selection screen 60 is related to visibility. The first peripheral image 52 that has not been subjected to image processing may be used.

The program for executing the above processing, which is executed by the peripheral monitoring device 100 of the present embodiment, is provided by being incorporated in the ROM 14b or the like in advance.

The program executed by the peripheral monitoring device 100 of the above embodiment is a file in a format that can be installed or executed in these devices, such as a CD-ROM, a flexible disk (FD), a CD-R, or a DVD. It may be configured to be recorded and provided on a computer-readable recording medium such as a Digital Versatile Disk).

Further, the program executed by the peripheral monitoring device 100 of the above embodiment may be stored on a computer connected to a network such as the Internet and provided by downloading via the network. Further, the program for executing each of the above-mentioned processes in the peripheral monitoring device 100 of the above-described embodiment may be configured to be provided or distributed via a network such as the Internet.

Although the embodiments of the present invention have been described above, these embodiments are presented as examples and are not intended to limit the scope of the invention. These novel embodiments can be implemented in various other embodiments, and various omissions, replacements, and changes can be made without departing from the gist of the invention. These embodiments are included in the scope and gist of the invention, and are also included in the scope of the invention described in the claims and the equivalent scope thereof.

1 ... Vehicle, 8 ... Display device, 30A ... Acquisition unit, 30C ... 1st display control unit, 30D ... 2nd display control unit, 30F ... Detection unit, 30G ... Reception unit, 100 ... Peripheral monitoring device

Claims (9)

The acquisition unit that acquires the first peripheral image of the vehicle,
A first display control unit that displays a selection screen for selecting a second peripheral image on which image processing related to visibility has been executed on the first peripheral image is displayed on the display unit.
The reception section that accepts the selection of the second peripheral image and
A second display control unit that displays the second peripheral image that has received the selection on the display unit, and
Equipped with a,
The first display control unit is
If the vehicle is in a running state when the condition relating to the visibility of the display unit is satisfied, the selection screen is displayed when the stop of the vehicle is subsequently detected.
Peripheral monitoring device. The acquisition unit that acquires the first peripheral image of the vehicle,
A first display control unit that displays a selection screen for selecting a second peripheral image on which image processing related to visibility has been executed on the first peripheral image is displayed on the display unit.
The reception section that accepts the selection of the second peripheral image and
A second display control unit that displays the second peripheral image that has received the selection on the display unit, and
Equipped with a,
The first display control unit is
When a display screen different from the peripheral image of the vehicle is displayed on the display unit and the condition regarding the visibility of the display unit is satisfied, the peripheral image of the vehicle is displayed from the display screen different from the peripheral image of the vehicle. At the time of displaying the selection screen before displaying the peripheral image of the vehicle.
Peripheral monitoring device. Claim 1 or claim 2 is at least one of a condition for showing a change in the shooting environment around the vehicle and a condition for showing a change in the visual state of the display unit by the user. Peripheral monitoring device described in. The first display control unit is
Display the selection screen, which includes information about the second peripheral image selected in the past.
The peripheral monitoring device according to any one of claims 1 to 3. The acquisition unit that acquires the first peripheral image of the vehicle,
A first display control unit that displays a selection screen for selecting a second peripheral image on which image processing related to visibility has been executed on the first peripheral image is displayed on the display unit.
The reception section that accepts the selection of the second peripheral image and
A second display control unit that displays the second peripheral image that has received the selection on the display unit, and
Equipped with a,
The first display control unit is
Display the selection screen, which includes information about the second peripheral image selected in the past.
Peripheral monitoring device. The first display control unit is
When the condition regarding the visibility of the display unit is satisfied, the selection screen is displayed.
The peripheral monitoring device according to claim 5. The peripheral aspect of claim 6 , wherein the condition is at least one of a condition for indicating a change in the shooting environment around the vehicle and a condition for indicating a change in the visual state of the display unit by the user. Monitoring device. The first display control unit is
If the vehicle is in a running state when the condition is satisfied, the selection screen is displayed when the stop of the vehicle is subsequently detected.
The peripheral monitoring device according to claim 6 or 7. The first display control unit is
If the condition is satisfied when a display screen different from the peripheral image of the vehicle is displayed on the display unit, the vehicle is displayed when the peripheral image of the vehicle is displayed from a display screen different from the peripheral image of the vehicle. Display the selection screen before displaying the peripheral image of
The peripheral monitoring device according to claim 6 or 7.

Images