JP7398237B2 - Display device for electronic mirror - Google Patents

Description

The present invention relates to a technique for displaying images on an electronic mirror.

In recent years, studies have been progressing to replace room mirrors (rearview mirrors) and door mirrors installed in automobiles and the like with electronic mirrors for checking the rear. An electronic mirror is a device that displays an image of the surroundings of a car etc. using an imaging device, and when the mirror is placed in the position where the electronic mirror is installed, the user will recognize it when the user looks at the mirror. It is a device that displays images (images) similar to mirror images (scenery reflected in a mirror).

However, since electronic mirrors are devices that display images, the sense in which a user recognizes an image displayed on an electronic mirror is significantly different from the sense in which a user recognizes an image reflected in a mirror. For this reason, users who are accustomed to using mirrors may feel strange when viewing images displayed on electronic mirrors. Possible causes of this are, for example, the following:
(1) With a mirror, the user's gaze point (the object the user is focusing on) is a mirror image of the user, so the distance from the user's viewpoint to the user's gaze point (equivalent to the subject distance) is long. On the other hand, with an electronic mirror (image display device), the user's point of gaze (the object that the user is focusing on) is a point (or a predetermined area) on the electronic mirror's display surface. The distance from the user's viewpoint to the user's point of interest (corresponding to the subject distance) is short.
(2) With a mirror, the field of view changes depending on the viewing angle of the user, whereas with an electronic mirror, the field of view does not change depending on the viewing angle of the user.

Techniques have been developed to reduce the above-mentioned discomfort. For example, Patent Document 1 discloses a technique for providing a monitor for checking the surroundings of a vehicle that has a feeling similar to that of a rearview mirror.

JP2013-216286A

In the above technology (the technology disclosed in Patent Document 1), it is necessary to execute complicated processing, and it is necessary to install high-performance processing to execute the processing. Specifically, the monitor device for checking the surroundings of a vehicle disclosed in Patent Document 1 includes an image processing unit that processes an input image captured by a back camera that captures an image of the rear of the vehicle, and displays a processed output image. The vehicle includes an image display means and an attitude detection means for detecting the relative position of the driver's head. The image processing means executes a process of cutting out a part of the input image from the entire imaging range and outputting it as an output image based on the relative position of the driver's head detected by the posture detection means. According to the amount of displacement of the relative position of the driver's head detected in the above, a process is executed to move the cropping range of the input image in the direction opposite to the displacement direction.

As described above, with the technology disclosed in Patent Document 1, it is necessary to execute complicated processing in order to reduce the discomfort felt when the user (driver) looks at the display screen of the monitor device for checking the surroundings of the vehicle. be. Further, the technique disclosed in Patent Document 1 requires a high-performance device (an expensive device) to execute the complicated processing.

In view of the above-mentioned problems, the present invention provides a simple mechanism that allows users to view the display screen without performing complex processing or installing high-performance equipment (expensive equipment). The purpose of the present invention is to realize a display device for electronic mirrors that reduces the sense of discomfort caused by electronic mirrors.

In order to solve the above problems, a first invention is an electronic mirror display device for displaying an image or video captured by an imaging device, and includes a display section and a light shielding section.

The display unit includes a display screen, generates a control signal for displaying the image or video acquired by the imaging device, and displays the image or video on the display screen based on the control signal.

The light shielding section is installed so as to cover a part of the display screen in a plan view when the display screen is viewed from infinity in the normal direction of the tangential plane of the center point of the display screen. The light shielding section is installed on the display screen side at a position spaced apart from the display screen.

In this electronic mirror display device, the light shielding section is installed in front of the display screen so as to cover a part of the display screen, so that a semi-shielding region can be generated in a pseudo manner. In this electronic mirror display device, the semi-shielding area generated by providing the light-shielding part changes as the viewpoint of both eyes moves, similar to when looking at an image reflected in a mirror (mirror image). Because it moves, the sense of discomfort when viewing the image (video) displayed on the display screen of the display unit is dramatically reduced.

Therefore, this display device for electronic mirrors uses a simple mechanism, without performing complicated processing or installing high-performance equipment (expensive equipment), to ensure that when the user looks at the display screen, The sense of discomfort can be reduced.

Note that the "semi-occlusion area" refers to an area that can only be observed with one eye.

A second invention is an electronic mirror display device for displaying an image or video captured by an imaging device, and includes a display section and a light shielding section.

The display unit includes a display screen, generates a control signal for displaying the image or video acquired by the imaging device, and displays the image or video on the display screen based on the control signal.

The light blocking portion is arranged such that a semi-blocking area is created on the display screen when the user views the display screen.

In this electronic mirror display device, the light shielding part is arranged so that a semi-shielding area is created on the display screen when the user looks at the display screen, so it is possible to create a pseudo semi-shielding area. can. In this electronic mirror display device, the semi-shielding area generated by providing the light-shielding part changes as the viewpoint of both eyes moves, similar to when looking at an image reflected in a mirror (mirror image). Because it moves, the sense of discomfort when viewing the image (video) displayed on the display screen of the display unit is dramatically reduced.

Therefore, this display device for electronic mirrors uses a simple mechanism, without performing complicated processing or installing high-performance equipment (expensive equipment), to ensure that when the user looks at the display screen, The sense of discomfort can be reduced.

A third invention is the first or second invention, in which the light shielding section includes a first light shielding section and a second light shielding section.

The first light-shielding portion covers the left edge in the horizontal direction when an image or video is displayed on the display screen in plan view when the display screen is viewed from infinity in the normal direction of the tangential plane of the center point of the display screen. It is arranged so as to cover a predetermined area including.

The second light shielding portion covers the right edge in the horizontal direction when an image or video is displayed on the display screen in plan view when the display screen is viewed from infinity in the normal direction of the tangent plane to the center point of the display screen. It is arranged so as to cover a predetermined area including.

As a result, in this electronic mirror display device, the semi-shielding area generated by providing the first light-shielding part and the second light-shielding part changes into an image reflected in the mirror (mirror image) according to the movement of the viewpoints of both eyes. Since the user moves in the same way as when viewing the image, the discomfort felt when viewing the image (video) displayed on the display screen of the display unit is dramatically reduced.

Therefore, this display device for electronic mirrors uses a simple mechanism, without performing complicated processing or installing high-performance equipment (expensive equipment), to ensure that when the user looks at the display screen, The sense of discomfort can be reduced.

A fourth invention is any one of the first to third inventions, further comprising an optical distance extension part installed between the display screen and the light shielding part.

Accordingly, in this electronic mirror display device, the optical distance can be extended by the optical distance extension part, so that the arrangement interval between the display screen and the light shielding part can be shortened. As a result, this electronic mirror display device can be made smaller in size.

A fifth invention is the fourth invention, in which the optical distance extension section includes an optical system consisting of one or more lenses.

Thereby, an optical distance extension section can be realized using an optical system consisting of one or more lenses.

A sixth invention is the fourth or fifth invention, wherein the optical distance extension section includes one or more reflecting mirrors.

Thereby, an optical distance extension can be realized using one or more reflecting mirrors.

According to the present invention, it is possible to reduce discomfort when a user looks at a display screen using a simple mechanism without executing complicated processing or installing high-performance equipment (expensive equipment). A display device for electronic mirror can be realized.

FIG. 1 is a schematic configuration diagram of an electronic mirror display system 1000 according to a first embodiment. FIG. 1 is a schematic configuration diagram of an electronic mirror display device 100 according to a first embodiment. FIG. 1 is a schematic configuration diagram of a display unit 1 and an imaging device Cam1 of an electronic mirror display device 100 according to a first embodiment. FIG. 3 is a diagram showing an example of an image (video) displayed on the display screen 11. FIG. FIG. 7 is a diagram for explaining a semi-occluded area (an area that can only be observed with one eye) that occurs when a user looks at mirror Mrr1 with both eyes. FIG. 4 is a diagram for explaining a semi-occlusion area that occurs when a user views the display screen 11 of the display unit 1 of the electronic mirror display device 100 with both eyes. FIG. 4 is a diagram for explaining a semi-occlusion area that occurs when a user views the display screen 11 of the display unit 1 of the electronic mirror display device 100 with both eyes. FIG. 2 is a schematic configuration diagram of an electronic mirror display device 200 according to a second embodiment. (1) When the user looks at the display screen 11 of the display unit 1 of the electronic mirror display device 100 of the first embodiment with both eyes (state 5); FIG. 7 is a diagram schematically showing a case where the display screen 11 of the display section 1 of the electronic mirror display device 200 is viewed (state 6). FIG. 2 is a diagram schematically showing a display screen 11 of a display unit 1 and a mechanism for extending an optical distance using a plurality of mirrors. FIG. 3 is a diagram schematically showing a case where a user views a display screen 11 of a display unit 1 of an electronic mirror display device with both eyes. FIG. 7 is a schematic configuration diagram of an electronic mirror display device according to another embodiment. FIG. 3 is a diagram showing a CPU bus configuration.

[First embodiment]
The first embodiment will be described below with reference to the drawings.

In addition, below, the case where the electronic mirror display system using the display device for electronic mirrors is mounted in a car is demonstrated as an example.

<1.1: Configuration of electronic mirror display system>
FIG. 1 is a schematic configuration diagram of an electronic mirror display system 1000 according to the first embodiment. Note that FIG. 1 shows a case where the electronic mirror display system 1000 is installed in the automobile Vhcl1, and schematically shows the positional relationship (arrangement) of each device and the driver Drv1 when the automobile Vhcl1 is viewed from above. It shows.

FIG. 2 is a schematic configuration diagram of the electronic mirror display device 100 according to the first embodiment. Specifically, FIG. 2 shows a top view, a front view, and a cross-sectional view taken along the line AA of the electronic mirror display device 100.

FIG. 3 is a schematic configuration diagram of the display unit 1 and the imaging device Cam1 of the electronic mirror display device 100 according to the first embodiment.

As shown in FIG. 1, the electronic mirror display system 1000 is provided in a vehicle Vhcl1, and includes an imaging device Cam1 and an electronic mirror display device 100.

(1.1.1: Configuration of imaging device)
As shown in FIG. 3, the imaging device Cam1 includes an imaging lens C_opt, an aperture C_ap, an imaging element C11, a control section C12, an analog signal processing section C13, a digital signal processing section C14, and a camera interface section C15. Equipped with

The imaging lens C_opt is an imaging lens that collects light from behind the vehicle Vhcl1 (light from a subject behind the vehicle Vhcl1). Note that the imaging lens C_opt may be configured using a plurality of lenses.

The aperture C_ap is an aperture that adjusts the amount of light from behind the vehicle Vhcl1 (light from a subject behind the vehicle Vhcl1) collected by the imaging lens C_opt.

The image sensor C11 is an image sensor realized by, for example, a CMOS image sensor or a CCD image sensor, and converts light from behind the vehicle Vhcl1 (light from an object behind the vehicle Vhcl1) into an image signal (video signal) by photoelectric conversion. ). The image sensor C11 then outputs the image signal (video signal) acquired by photoelectric conversion to the analog signal processing section C13.

The control unit C12 is a control unit for controlling each unit of the imaging device Cam1. The control unit C12 receives a control signal CTL for controlling the imaging device Cam1 output from the display unit 1 via the camera interface unit C15.

The control unit C12 generates a control signal CTL_c1 for controlling the imaging lens C_opt based on the control signal CTL, and controls the imaging lens C_opt using the generated control signal CTL_c1 (for example, on the optical axis of the imaging lens C_opt). control the focus by changing the position of).

Further, the control unit C12 generates a control signal CTL_c2 for controlling the aperture C_ap based on the control signal CTL, and controls the aperture C_ap using the generated control signal CTL_c2 (for example, adjusts the aperture state of the aperture C_ap). (adjust the aperture value)).

Further, the control unit C12 generates a control signal CTL_c3 for controlling the analog signal processing unit C13 based on the control signal CTL, and outputs the generated control signal CTL_c3 to the analog signal processing unit C13.

Furthermore, the control unit C12 generates a control signal CTL_c4 for controlling the digital signal processing unit C14 based on the control signal CTL, and outputs the generated control signal CTL_c4 to the digital signal processing unit C14.

The analog signal processing unit C13 receives an image signal (video signal) output from the image sensor C11 and a control signal CTL_c3 output from the control unit C12. Then, the analog signal processing unit C13 performs analog signal processing (for example, signal gain adjustment processing, noise reduction processing, etc.) on the image signal (video signal) output from the image sensor C11 based on the control signal CTL_c3. The image signal (video signal) subjected to analog signal processing is converted into a digital signal by A/D conversion, and the digital signal is output to the digital signal processing section C14.

The digital signal processing section C14 receives the digital image signal (digital video signal) output from the analog signal processing section C13 and the control signal CTL_c4 output from the control section C12. Based on the control signal CTL_c4, the digital signal processing unit C14 performs digital signal processing (for example, dynamic range adjustment processing, pixel interpolation) on the digital image signal (digital video signal) output from the analog signal processing unit C13. The digital image signal (digital video signal) subjected to digital signal processing is output to the camera interface section C15.

The camera interface section C15 is an interface through which the imaging device Cam1 performs data communication with an external device or functional section. The camera interface section C15 is connected to the interface section 122 of the display section 1, as shown in FIG. 3, and can perform data communication with the display section 1 via the interface section 122 of the display section 1. The camera interface section C15 receives the control signal CTL output from the interface section 122 of the display section 1, and outputs the received control signal CTL to the control section C12. Further, the camera interface section C15 outputs the digital image signal (digital video signal) output from the digital signal processing section C14 to the interface section 122 of the display section 1 as a digital image signal (digital video signal) D_img.

(1.1.2: Configuration of electronic mirror display device)
The electronic mirror display device 100 includes a support member B1, a display section 1, and a light shielding section 2, as shown in FIG. As shown in FIG. 1, the electronic mirror display device 100 is installed in the automobile Vhcl1, for example, in place of a rearview mirror at a location where a rearview mirror is installed.

The support member B1 is a member for supporting the display section 1 and the light shielding section 2.

The display unit 1 includes a display screen 11, a camera control unit 121, an interface unit 122, and a display control unit 123, as shown in FIGS. 2 and 3. The display unit 1 also includes a storage unit 12 that houses a camera control unit 121, an interface unit 122, and a display control unit 123. As shown in FIG. 2, the display section 1 is supported by a support member B1.

The display screen 11 is a display panel for displaying video (or images), and is realized by, for example, a liquid crystal display panel or an organic EL display panel (EL: electro-luminescence). The display screen 11 is arranged so that its display surface is on the side where the light shielding part 2 is arranged. The display screen 11 displays video (or images) under the control of the display control unit 123. Specifically, image data (video data) and a control signal (display control signal) generated by the display control unit 123 are input, and based on the input image data (video data) and control signal (display control signal), , a video (or image) is displayed on the display screen 11 by controlling the display of each pixel on the display screen 11.

The camera control unit 121 generates a control signal CTL for controlling the imaging device Cam1, and outputs the generated control signal CTL to the imaging device Cam1 via the interface unit 122.

The interface unit 122 inputs the control signal CTL generated by the camera control unit 121, and outputs the control signal CTL to the imaging device Cam1. Further, the interface unit 122 inputs a digital image signal (digital video signal) D_img output from the imaging device Cam1. Then, the interface section 122 outputs the digital image signal (digital video signal) D_img to the display control section 123.

The display control unit 123 inputs the digital image signal (digital video signal) D_img output from the interface unit 122. The display control unit 123 generates image data (video data) for displaying the input digital image signal (digital video signal) D_img on the display screen, and a control signal for displaying the image data (video data) on the display screen. (signals (e.g., gate drive signals, source drive signals) for driving the display screen (display panel)), and sends the generated image data (video data) and control signals (display control signals) to the display screen. Output. Note that the display control unit 123 displays on the display screen 11 an image (video) that is left and right reversed (mirror image (video)) with respect to the image (video) acquired (captured) by the imaging device Cam1. Control the display as follows.

The light blocking portion 2 is made of a material that blocks light. Note that the light shielding part 2 may be formed of a member that scatters straight-travelling light or a material whose light transmittance is less than or equal to a predetermined value (for example, the light transmittance is 50% or less).

The light shielding part 2 is a part of the display screen 11 in plan view when the display screen 11 is viewed from infinity in the normal direction of the tangential plane of the center point of the display screen 11 (the center point of the display surface of the display screen 11). installed to cover the The light shielding section 2 is installed on the side of the display section 1 where the display screen 11 is arranged, and at a position spaced apart from the display screen 11.

Moreover, the light shielding part 2 may be composed of a plurality of members. For example, as shown in FIG. 2, the light shielding section 2 may include a first light shielding section 21 and a second light shielding section 22.

As shown in FIG. 2, the first light shielding part 21 is arranged to cover a predetermined area including the left end of the display screen 11 when the display screen 11 of the electronic mirror display device 100 is viewed from the front. .

As shown in FIG. 2, the second light shielding section 22 is arranged to cover a predetermined area including the right end of the display screen 11 when the display screen 11 of the electronic mirror display device 100 is viewed from the front. .

<1.2: Operation of electronic mirror display system>
The operation of the electronic mirror display system 1000 configured as above will be described below.

FIG. 4 is a diagram showing an example of an image (video) displayed on the display screen 11.

The electronic mirror display system 1000, for example, when the vehicle Vhcl1 is in a predetermined state (for example, the engine is running and the electrical system of the vehicle Vhcl1 is available, or the vehicle Vhcl1 is running) It is activated automatically or manually by the driver Drv1.

When the electronic mirror display system 1000 is activated, the imaging device Cam1 photographs the scenery behind the automobile Vhcl1. Specifically, by executing the following process, the scenery behind the car Vhcl1 is photographed by the imaging device Cam1.

Photographing parameters of the imaging device Cam1 (direction of the optical axis of the optical system of the imaging device Cam1, angle of view, focal length, aperture value, etc.) are set automatically or manually. In the manual case, for example, a user (e.g., driver Drv1) inputs data for setting shooting parameters into the interface section of the display section 1 (the user's input means is not shown), and the camera control of the display section 1 is performed. The unit 121 generates a control signal CTL for setting imaging parameters based on data input by the user, and transmits the generated control signal CTL to the imaging device Cam1 via the interface unit 122.

The control unit C12 of the imaging device Cam1 receives the control signal CTL transmitted from the display unit 1 via the camera interface unit C15, and sets the shooting parameters of the imaging device Cam1 based on the received control signal CTL. .

After the imaging parameters are set, the camera control unit 121 of the display unit 1 generates a control signal CTL instructing to execute imaging, and transmits the generated control signal CTL to the imaging device Cam1 via the interface unit 122. Send to.

The imaging device Cam1 receives the control signal CTL described above from the display unit 1, and executes imaging processing based on the control signal CTL. In other words, light from behind the vehicle Vhcl1 (light from a subject behind the vehicle Vhcl1) collected by the imaging lens C_opt is photoelectrically converted by the imaging device C11 and acquired as an image signal (video signal). . The acquired image signal (video signal) is then output from the image sensor C11 to the analog signal processing section C13.

The analog signal processing unit C13 performs analog signal processing (for example, signal gain adjustment processing, noise reduction processing, etc.) on the image signal (video signal) output from the image sensor C11. The image signal (video signal) is converted into a digital signal by A/D conversion, and the digital signal is output to the digital signal processing section C14.

The digital signal processing unit C14 performs digital signal processing (for example, dynamic range adjustment processing, pixel interpolation processing, etc.) on the digital image signal (digital video signal) output from the analog signal processing unit C13, and performs digital signal processing. A digital image signal (digital video signal) is obtained. Then, the digital signal processing unit C14 outputs the acquired digital image signal (digital video signal) to the display unit 1 via the camera interface unit C15 as a digital image signal (digital video signal) D_img.

The display control unit 123 inputs the digital image signal (digital video signal) D_img output from the interface unit 122. The display control unit 123 generates image data (video data) for displaying the input digital image signal (digital video signal) D_img on the display screen, and a control signal for displaying the image data (video data) on the display screen. (signals (e.g., gate drive signals, source drive signals) for driving the display screen (display panel)), and sends the generated image data (video data) and control signals (display control signals) to the display screen. Output. Note that the display control unit 123 displays on the display screen 11 an image (video) that is left and right reversed (mirror image (video)) with respect to the image (video) acquired (captured) by the imaging device Cam1. Control the display as follows.

The display screen 11 displays images (videos) under the control of the display control unit 123. Specifically, image data (video data) and a control signal (display control signal) generated by the display control unit 123 are input, and based on the input image data (video data) and control signal (display control signal), , a video (or image) is displayed on the display screen 11 by controlling the display of each pixel on the display screen 11.

By processing in this way, in the electronic mirror display system 1000, for example, a captured image (captured video) of the scenery behind the car Vhcl1 (obtained by the imaging device Cam1) as schematically shown in the upper diagram of FIG. ) is displayed on the display screen 11, and an image (video) that is left and right reversed. Note that in the electronic mirror display system 1000, through the above processing, for example, 30 frames of images (captured images) are acquired per second. That is, the electronic mirror display system 1000 acquires a video at, for example, 30 fps (frames per second) through the above processing, and displays the video on the display screen 11.

Since the electronic mirror display device 100 is provided with the light shielding portion 2 (the first light shielding portion 21, the second light shielding portion 22), the display screen 11 of the electronic mirror display device 100 is provided with the light shielding portion 2 (the first light shielding portion 21, the second light shielding portion 22). When a user (for example, driver Drv1) looks at the electronic mirror display device 100, the user (for example, driver Drv1) is recognized as shown in the lower diagram of FIG. 4 (the left end and right end of the video (image) (are recognized as being hidden by the first light shielding part 21 and the second light shielding part 22, respectively).

Here, the principle by which the electronic mirror display device 100 can reduce the sense of discomfort when the user views the display screen 11 will be explained using FIGS. 5 to 7.

FIG. 5 is a diagram for explaining a semi-occlusion area (a range that can only be observed with one eye) that occurs when the user looks at the mirror Mrr1 with both eyes. Specifically, FIG. 5 shows the user's left eye viewpoint _VPL , right eye viewpoint _VPR , mirror Mrr1, object Obj1, object Obj2, mirror image Obj1_mrr of object Obj1 reflected in mirror Mrr1, when viewed from above. FIG. 3 is a diagram schematically showing the positional relationship between a mirror image Obj2_mrr of an object Obj2 reflected in a mirror Mrr1 and a semi-shielded area.

FIG. 6 is a diagram for explaining a semi-occlusion area that occurs when a user views the display screen 11 of the display unit 1 of the electronic mirror display device 100 with both eyes. Specifically, FIG. 6 shows the user's left eye viewpoint _VPL , right eye viewpoint _VPR , display screen 11, and light shielding part 2 (first light shielding part 21, second light shielding part 22) when viewed from above. , and a diagram schematically showing the positional relationship of the semi-shielded area.

FIG. 7 is a diagram for explaining a semi-occlusion area that occurs when a user views the display screen 11 of the display unit 1 of the electronic mirror display device 100 with both eyes. Specifically, FIG. 7 shows the user's left eye viewpoint _VPL , right eye viewpoint _VPR , display screen 11, and light shielding part 2 (first light shielding part 21, second light shielding part 22) when viewed from above. , and a diagram schematically showing the positional relationship of the semi-shielded area. Further, FIG. 7 shows a diagram clearly showing the binocularly perceptible area and the semi-occluded area in the image (video) displayed on the display screen 11 of the display unit 1.

First, using FIG. 5, the relationship between the movement of the viewpoints of both eyes and the movement of the semi-occluded area in the case of a mirror will be explained.

The case shown in the left diagram of FIG. 5 (the state shown in the left diagram of FIG. 5 is referred to as "state A") will be explained. In the case of the left diagram in FIG. 5, the straight line connecting the midpoint between the left eye viewpoint VP _L (state A) and the right eye viewpoint VP _R (state A) and the center point of the mirror Mrr1 passes through the center point of the mirror Mrr1. , coincides with the normal of the mirror surface. In this case (state A), in the left diagram of FIG. 5, the region indicated by L_hs (state A) and the region indicated by R_hs (state A) become semi-shielded regions. In other words, in the case of state A, the left semi-occluded region L_hs (state A) cannot be observed with the left eye but can only be observed with the right eye, and the right semi-occluded region R_hs (state A) cannot be observed with the right eye. This is an area that can only be observed with the left eye.

Note that the left eye viewpoint, right eye viewpoint, left half-occluded area, and right half-occluded area in the case of state X are VP _L (stateX), VP _R (state ) (the same applies hereafter).

The right diagram of FIG. 5 shows a state when the viewpoint is moved to the right in the case of the left diagram of FIG. 5 (state A) (this state is referred to as "state B"). As can be seen from the right diagram in FIG. 5, when the viewpoint is moved to the right, the semi-occluded area moves in the opposite direction to the direction of movement of the viewpoint (in the case of FIG. 5, to the right).

In other words, when a user looks at an image reflected in a mirror (mirror image), when the user's binocular viewpoints move in a direction parallel to the mirror surface, the semi-occluded area is located in the opposite direction of the binocular viewpoint movement. move in the direction. By perceiving that the semi-occluded area moves in accordance with the movement of the viewpoints of both eyes, humans can perceive the sense of depth of the image reflected in the mirror (mirror image).

Next, using FIG. 6, the relationship between the movement of the viewpoints of both eyes and the movement of the semi-shielding area in the case of the electronic mirror display device 100 will be explained.

The case shown in the left diagram of FIG. 6 (the state shown in the left diagram of FIG. 6 is referred to as "state 1") will be explained. In _the case of the left diagram in FIG _. It is assumed that the normal line of the display surface passes through . In this case (state 1), the light shielding part 2 (first light shielding part 21, second light shielding part 22) separates the visual field from the left eye viewpoint VP _L (state 1) and the visual field from the right eye viewpoint VP _R (state 1). Therefore, in the left diagram of FIG. 6, the region indicated by L_hs (state 1) and the region indicated by R_hs (state 1) become semi-shielded regions. In other words, in the case of state 1, the left semi-occluded area L_hs (state 1) cannot be observed with the left eye but can only be observed with the right eye, and the right semi-occluded area R_hs (state 1) cannot be observed with the right eye. This is an area that can only be observed with the left eye.

The right diagram in FIG. 6 shows a state when the viewpoint is moved to the right (this state is referred to as "state 2") in the case of the left diagram in FIG. 6 (state 1). As can be seen from the right diagram in FIG. 6, when the viewpoint is moved to the right, the semi-occlusion area moves in the opposite direction to the direction of movement of the viewpoint (in the case of FIG. 6, to the right).

That is, when a user (for example, driver Drv1) views an image (video) displayed on the display screen 11 of the display unit 1 of the electronic mirror display device 100, the display screen 11 displays the user's binocular viewpoints. When moved in a direction parallel to the plane, the semi-occluding region moves in a direction opposite to the direction of movement of the binocular viewpoints.

Then, by perceiving that the semi-occluded area moves in accordance with the movement of the viewpoints of both eyes, the user (for example, driver Drv1) can display the It is possible to recognize the sense of depth of an image (video) (the sense of depth of an object in an image (video)).

In the case where the light shielding part 2 is not provided, even if the user (for example, driver Drv1) views the image (video) displayed on the display screen 11 with both eyes, a semi-shielded area does not occur, and Even if the viewpoint is moved, the semi-occluded area does not move. For this reason, the user (for example, driver Drv1) has a sense of perceiving an object in the image (video) displayed on the display screen 11 with both eyes, and an image (mirror image) of the user in a mirror such as a rearview mirror. The feeling of watching something is very different. In other words, when a user (for example, driver Drv1) perceives an object in an image (video) displayed on the display screen 11 with both eyes, the user sees an image (mirror image) reflected in a mirror such as a rearview mirror. Sometimes, a sense of discomfort arises because the semi-occluded area does not move as the viewpoints of both eyes move.

On the other hand, the electronic mirror display device 100 includes a light shielding section 2, and the light shielding section 2 allows the semi-shielding region to be expanded as the viewpoint of both eyes moves, similar to when the user is looking at a mirror. Moving. Therefore, when a user (for example, driver Drv1) perceives an object in the image (video) displayed on the display screen 11 of the electronic mirror display device 100, the user perceives an object in the image (video) displayed on the display screen 11 of the electronic mirror display device 100. Similar to when viewing a mirror image, the semi-occluded area moves as the viewpoints of both eyes move, so a natural sense of depth can be perceived. As a result, the electronic mirror display device 100 can dramatically reduce the discomfort the user feels when viewing the display screen 11.

As shown in FIG. 7, the viewpoints of both eyes in the case of the left diagram in FIG. 7 (the state shown in the left diagram in FIG. 7 is referred to as "state 3") are moved to the right in FIG. When the state shown in the figure on the right (this state is referred to as "state 4") occurs, the direction of movement of the viewpoint of both eyes is opposite to that of the user, similar to when the user looks at an image (mirror image) reflected in a mirror such as a rearview mirror. The semi-occluded area moves. In other words, the semi-occluded area on the image (video) displayed on the display screen 11 and the area that can be seen with both eyes also moves as the viewpoint moves, as shown in FIG. In addition, in FIG. 7, the left half-occluded area, the right half-occluded area, and the binocularly visible area on the image (video) displayed on the display screen 11 in state 3 are respectively expressed as L'_hs. (state 3), R'_hs (state 3), and RL (state 3), which are the left half-shielding region, the right half-shielding region on the image (video) displayed on the display screen 11 in state 4, The binocularly visible areas are expressed as L'_hs (state 4), R'_hs (state 4), and RL (state 4), respectively.

As can be seen from FIG. 7, in the electronic mirror display device 100, by providing the light shielding part 2 (first light shielding part 21, second light shielding part 22) in front of the display screen 11, a semi-shielding area is created in a pseudo manner. can be generated. In the electronic mirror display device 100, the semi-shielding area generated by providing the light shielding part 2 is similar to that when looking at an image reflected in a mirror (mirror image) according to the movement of the viewpoints of both eyes. Therefore, the sense of discomfort when viewing the image (video) displayed on the display screen 11 is dramatically reduced.

As described above, in the electronic mirror display system 1000, by simply providing the light shielding part 2 (the first light shielding part 21, the second light shielding part 22) in front of the display screen 11 in the electronic mirror display device 100, the display screen 11 can be The discomfort felt when viewing the displayed image (video) can be dramatically reduced. In other words, the electronic mirror display device 100 allows the user to display images using a simple mechanism without performing complicated processing or installing high-performance equipment (expensive equipment) as in the prior art. It is possible to reduce the feeling of discomfort when looking at the screen.

[Second embodiment]
Next, a second embodiment will be described. Note that the same parts as in the above embodiment are denoted by the same reference numerals, and detailed description thereof will be omitted.

FIG. 8 is a schematic configuration diagram of an electronic mirror display device 200 according to the second embodiment. Specifically, FIG. 8 shows a top view, a front view, and a cross-sectional view taken along line AA of the electronic mirror display device 200.

FIG. 9 shows (1) when the user looks at the display screen 11 of the display unit 1 of the electronic mirror display device 100 of the first embodiment with both eyes (state 5), and (2) when the user looks at the display screen 11 with both eyes. FIG. 7 is a diagram schematically showing a case where the display screen 11 of the display unit 1 of the electronic mirror display device 200 of the second embodiment is viewed (state 6). Specifically, FIG. 9 shows the user's left eye viewpoint _VPL , right eye viewpoint _VPR , display screen 11, and light shielding part 2 (first light shielding part 21, second light shielding part 22) when viewed from above. , and a diagram schematically showing the positional relationship of the optical distance extension section 3. FIG. Further, FIG. 9 shows a diagram clearly showing the binocularly perceptible area and the semi-occluded area in the image (video) displayed on the display screen 11 of the display unit 1.

FIG. 10 is a diagram schematically showing the display screen 11 of the display section 1 and a mechanism for extending the optical distance using a plurality of mirrors. Specifically, the upper diagram in FIG. 10 shows the positional relationship between the user's viewpoint when viewed from above, the display screen 11 of the display unit 1, and the mechanism that extends the optical distance using a plurality of mirrors. . The lower diagram in FIG. 10 shows the positional relationship between the user's viewpoint when viewed from the side, the display screen 11 of the display unit 1, and the mechanism that extends the optical distance using a plurality of mirrors. Note that in FIG. 10, for convenience of explanation, only the optical path from one viewpoint (the right eye viewpoint VP _R in FIG. 10) is shown.

The electronic mirror display system of the second embodiment has a configuration in which the electronic mirror display device 100 of the electronic mirror display system 1000 of the first embodiment is replaced with an electronic mirror display device 200.

As shown in FIG. 8, the electronic mirror display device 200 of the second embodiment has a configuration in which an optical distance extension portion 3 is added to the electronic mirror display device 100 of the first embodiment.

The optical distance extension part 3 is a member that extends the optical distance, and is used, for example, in (1) an optical system composed of one or more lenses, or (2) an optical system composed of one or more lenses. , and one or more reflecting mirrors. The optical distance extension part 3 is installed between the light shielding part 2 (the first light shielding part 21, the second light shielding part 22) and the display screen 11, as shown in FIG.

The optical distance extension unit 3 provides a semi-obstructed area on the display surface of the display screen 11 and an area that can be seen with both eyes when the position of the viewpoint of the user's eyes and the positional relationship with the display screen 11 are the same. This is a member that extends the optical distance so that they are substantially the same and the distance between the display screen 11 and the light shielding part 2 is shortened.

For example, as shown in FIG. 8, when the positional relationship between the viewpoint of the user's eyes and the display screen 11 is the same in state 5 and state 6, the optical distance is extended as shown in the right diagram of FIG. The section 3 is installed between the display screen 11 and the light shielding section 2 (first light shielding section 21, second light shielding section 22). That is, as shown in the right diagram of FIG. 8, the optical distance extending section 3 extends the optical distance in a direction away from the viewpoints of both eyes, so that the following can be achieved.
(1) The distance between the display screen 11 and the light shielding part 2 (distance w2 in the right diagram of FIG. 9) can be shortened.
(2) In state 6, when the user looks at the display screen 11 from the binocular viewpoints VP _L (state 6) and VP _R (state 6), the semi-obscured area L'_hs (state 6) on the display surface of the display screen 11 is ), R'_hs (state 6), and the binocularly visible area RL (state 6), and in state 5, the user views the display screen 11 from the binocular viewpoints VP _L (state 5) and VP _R (state 5). The semi-shielded regions L'_hs (state 5), R'_hs (state 5) on the display surface of the display screen 11 when viewed, and the binocularly visible region RL (state 5) can be made similar.

As described above, in the electronic mirror display system of this embodiment, since the optical distance extension section 3 is further provided in the electronic mirror display device 200, the optical distance from the viewpoint of the user's both eyes can be extended, and as a result, , the distance between the display screen 11 and the light shielding part 2 can be shortened. Therefore, the electronic mirror display device 200 can have a smaller size than the electronic mirror display device 100 while realizing the same functions as the electronic mirror display device 100.

In addition, although the optical distance extension part 3 is assumed to be an optical system composed of one or more lenses in the above, it is not limited to this, and the optical distance extension part 3 may be, for example, a reflecting mirror. , a mechanism for extending the optical distance may be adopted. For example, as shown in FIG. 10, a mechanism for extending the optical distance using a plurality of reflecting mirrors (a first mirror and a second mirror in FIG. 10) may be adopted as the optical distance extension section 3. Moreover, the optical distance extension part 3 may be realized by combining one or more reflecting mirrors and an optical system consisting of one or more lenses.

[Other embodiments]
In the above embodiment, it is assumed that the display surface of the display screen 11 of the display unit 1 is flat, but the display surface is not limited to this. For example, the display screen 11 may have a curved display surface. It may be something. This will be explained using FIG. 11.

FIG. 11 is a diagram schematically showing a case where a user looks at the display screen 11 of the display unit 1 of the electronic mirror display device with both eyes. Specifically, FIG. 11 shows the user's left eye viewpoint _VPL , right eye viewpoint _VPR , the display screen 11 having a non-flat display surface, and the light shielding part 2 (the first light shielding part) when viewed from above. FIG. 21 is a diagram schematically showing the positional relationship of the second light shielding part 22).

The display screen 11 of the display unit 1 may have a curved display surface, for example, as shown in FIG. 11 when viewed from above. Furthermore, in this case, the light shielding part 2 may also be curved when viewed from above, as shown in FIG. In the electronic mirror display device of the present invention, the center point of the display surface of the display screen 11 in FIG. Then, the light shielding portion 2 is configured so that a region (region AR_L and region AR_R in FIG. 11) covering the end of the display surface of the display screen 11 is generated when viewed from infinity on the normal line Norm (Tngt_plane1). It may take any form as long as it is provided.

Furthermore, the light shielding section 2 is not limited to the above-mentioned shape, size, number of components, arrangement, etc., and may generate a semi-shielding area when the user looks at the display screen 11 with both eyes. If so, it may be of any other form.

Further, the separation distance between the light shielding section 2 and the display screen 11 may be any distance that generates a semi-shielding area when the user views the display screen 11 with both eyes. Note that the distance between the light shielding part 2 and the display screen 11 is preferably, for example, several centimeters or more.

Further, in the above embodiment, a case has been described in which the light shielding section 2 is composed of the first light shielding section 21 and the second light shielding section 22, but the present invention is not limited to this. The light shielding part 2 may have, for example, a frame-like shape with an opening in the center.

FIG. 12 shows a schematic configuration diagram of an electronic mirror display device according to another embodiment. As shown in FIG. 12, the light shielding part 2 may have a frame-like shape with an opening in the center.

In this case, as shown in FIG. 12, the light shielding part 2 includes a first light shielding part 2a located at a position covering the left end of the display screen 11, and a second light shielding part 2a located at a position covering the right end of the display screen 11. It is composed of a light shielding part 2b, a third light shielding part 2c disposed at a position covering the upper end of the display screen 11, and a fourth light shielding part 2d disposed at a position covering the lower end of the display screen 11. In the light shielding unit 2 shown in FIG. 12, the visible area (perceivable area) of the image (video) on the display screen 11 changes even when the line of sight moves in the vertical direction, in the same way as when looking in a mirror. . For this reason, even when the user moves his or her line of sight in the vertical direction, the user's discomfort when looking at the display screen 11 can be reduced.

Furthermore, in the configuration shown in FIG. 12, an optical distance extension section 3 may be added between the display screen 11 and the light shielding section 2, as in the second embodiment.

In addition, although the above explanation assumes that a rear monitor is installed in place of a car's rearview mirror, the invention is not limited to this, and if an electronic monitor is used instead of a mirror. The present invention can be applied to any case.

Furthermore, in the electronic mirror display system and the electronic mirror display device described in the above embodiments, each block may be individually formed into one chip using a semiconductor device such as an LSI, or may be formed into a single chip including a part or all of the blocks. It may also be made into chips.

Although it is referred to as an LSI here, it may also be called an IC, system LSI, super LSI, or ultra LSI depending on the degree of integration.

Moreover, the method of circuit integration is not limited to LSI, and may be implemented using a dedicated circuit or a general-purpose processor. An FPGA (Field Programmable Gate Array) that can be programmed after the LSI is manufactured or a reconfigurable processor that can reconfigure the connections and settings of circuit cells inside the LSI may be used.

Furthermore, part or all of the processing of each functional block in each of the above embodiments may be realized by a program. Part or all of the processing of each functional block in each of the above embodiments is performed by a central processing unit (CPU) in a computer. Further, programs for performing each process are stored in a storage device such as a hard disk or ROM, and are read out to the ROM or RAM and executed.

Further, each process of the above embodiments may be realized by hardware, or by software (including cases where it is realized together with an OS (operating system), middleware, or a predetermined library). Furthermore, it may be realized by mixed processing of software and hardware.

For example, when each functional unit of the above embodiment is realized by software, the hardware configuration shown in FIG. 13 (for example, a hardware configuration in which a CPU, ROM, RAM, input unit, output unit, etc. are connected by a bus) Each functional unit may be realized by software processing using .

Further, the execution order of the processing method in the above embodiment is not necessarily limited to the description of the above embodiment, and the execution order can be changed without departing from the gist of the invention.

A computer program that causes a computer to execute the method described above and a computer-readable recording medium on which the program is recorded are included within the scope of the present invention. Here, examples of computer-readable recording media include flexible disks, hard disks, CD-ROMs, MOs, DVDs, DVD-ROMs, DVD-RAMs, large-capacity DVDs, next-generation DVDs, and semiconductor memories. .

The computer program is not limited to one recorded on the recording medium, but may be transmitted via a telecommunication line, a wireless or wired communication line, a network typified by the Internet, or the like.

Note that the specific configuration of the present invention is not limited to the above-described embodiments, and various changes and modifications can be made without departing from the gist of the invention.

1000 Electronic mirror display system 100, 200 Electronic mirror display device 1 Display section 11 Display screen 2 Light shielding section 21 First light shielding section 22 Second light shielding section 3 Optical distance extension section Cam1 Imaging device

Claims (6)

An electronic mirror display device for displaying images or videos acquired by an imaging device, the display device comprising:
A display that includes a display screen, generates a control signal for displaying the image or video acquired by the imaging device in a horizontally reversed manner , and displays the image or video on the display screen based on the control signal. Department and
A light shielding part installed to cover a part of the display screen in a plan view when the display screen is viewed from infinity in the normal direction of a tangential plane of the center point of the display screen, the light shielding part being installed to cover a part of the display screen, the light shielding part installed on the side at a position spaced apart from the display screen;
Equipped with
placed in a first position, which is a position where a mirror is placed for the user to look backward while looking forward;
When placed in the first position, the size is such that it does not block the user's line of sight when the user looks directly ahead;
Display device for electronic mirror. An electronic mirror display device for displaying images or videos acquired by an imaging device, the display device comprising:
A display that includes a display screen, generates a control signal for displaying the image or video acquired by the imaging device in a horizontally reversed manner , and displays the image or video on the display screen based on the control signal. Department and
a light shielding part arranged so that a semi-shielding area is created on the display screen when a user looks at the display screen;
Equipped with
placed in a first position, which is a position where a mirror is placed for the user to look backward while looking forward;
When placed in the first position, the size is such that it does not block the user's line of sight when the user looks directly ahead;
Display device for electronic mirror. The light shielding part includes a first light shielding part and a second light shielding part,
The first light-shielding portion is configured to be arranged in a horizontal direction when an image or video is displayed on the display screen in a plan view when the display screen is viewed from infinity in a direction normal to a plane tangential to the center point of the display screen. It is arranged to cover a predetermined area including the left side edge,
The second light-shielding portion is configured to be arranged in a horizontal direction when an image or video is displayed on the display screen in a plan view when the display screen is viewed from infinity in the normal direction of the tangential plane of the center point of the display screen. arranged to cover a predetermined area including the right end;
The electronic mirror display device according to claim 1 or 2. further comprising an optical distance extension part installed between the display screen and the light shielding part,
An electronic mirror display device according to any one of claims 1 to 3. The optical distance extension section includes an optical system consisting of one or more lenses.
The electronic mirror display device according to claim 4. the optical distance extension includes one or more reflectors;
The electronic mirror display device according to claim 4 or 5.

Images