JP7760838B2 - Display control device, display device, and display control method - Google Patents

Description

The present invention relates to a display control device, a display device, and a display control method to be installed in a vehicle such as an automobile.

Patent document 1 discloses a control device and control method for a multi-display device equipped with multiple display devices.

The multi-display device of Patent Document 1 (see, for example, Figures 1 and 19) uses a CID (Center Information Display) that displays map information and the vehicle's current position, an ICD (Instrumental Cluster Display) that displays the speedometer, and a HUD (Head-Up Display).

Patent document 1, paragraph [0002], states, "Conventionally, in systems that use multiple display devices in conjunction with one another, there has been a problem in that while a user is paying attention to information displayed on one display device, it is difficult for the user to notice changes in information displayed on other display devices. Furthermore, when the information displayed on each display device is related to one another, it is difficult to grasp this relationship."

As a solution to this problem, for example, claim 1 states, "Adding awareness-guiding information (information that emphasizes a specific image) that guides awareness."

JP 2017-71398 A

The inventors have investigated technology for displaying images in multiple display areas with different display distances (near/far mixed display technology), and as a result have found that it is sometimes difficult for a viewer to distinguish between an image that appears close (near image) and an image that appears far away (far image).

For example, a distant image may be placed near a nearby image. Furthermore, if both the nearby image and the distant image contain, for example, multiple pieces of display content erected on the road surface, each piece of display content may be perceived individually, resulting in a lack of perspective and reduced distinguishability between nearby and distant display content.

In this case, viewers may find the display visually distracting. Furthermore, it cannot be ruled out that the perception of important information may be delayed due to the mixed perception of ADAS (Adaptive Driver Assistance System) information, warning signs superimposed on leading vehicles that require caution (distant information), and vehicle speed indicators that are visible in the foreground.

Here, even if awareness-guiding information is added, as in the technology of Patent Document 1, it does not fundamentally solve the problem of reduced discrimination between near and far images, i.e., making it difficult to distinguish between near and far images.

Furthermore, when there are multiple display contents, it is not possible to distinguish which of them is a nearby image and which is a distant image, and each display content is perceived separately, resulting in visual annoyance, but this does not provide a fundamental solution to this problem.

One of the objectives of the present invention is to prevent a decrease in the discernibility between near and far images and improve the visibility of displayed images.

Other objects of the present invention will become apparent to those skilled in the art by reference to the following exemplary aspects and best modes, as well as the accompanying drawings.

Below, we will provide examples of embodiments according to the present invention to facilitate an understanding of the overview of the present invention.

In a first aspect of the present invention, a display control device includes:
A display control device that performs image display control,
a control unit for controlling a display mode of the image,
the images include a near image displayed closer to the viewer and a far image displayed farther away from the viewer;
The control unit
When it is determined that the discriminability between the near image and the far image is reduced, or when it is determined that the discriminability should be improved,
changing the display mode of the background of the nearby image;
and,
Adding a frame image surrounding the neighboring image;
and,
adding a line image to at least a portion of the periphery of the neighboring image;
and,
When the neighboring image includes a plurality of display contents, a line image is added so as to span at least two of the plurality of display contents.
The display mode change process includes at least one of the above.

In the first mode, when a near image and a far image are displayed at different display distances, a display mode change process is performed on the near image in a specified case, making it easier to distinguish from the far image and improving the visibility of the displayed image.

Because the human field of vision has a certain extent, for example, even when a viewer is looking at a distant image, a nearby image may also be in their field of vision. Because the distant image and the nearby image have different display distances (for example, the distance to the image or the image display surface relative to the viewer's viewpoint), they are generally distinguishable based on the difference in display distance, but there are also cases where the difference in distance between the two images is relatively small.

Furthermore, for example, if there are multiple display contents as distant images and they are displayed together, it becomes difficult to distinguish them from the multiple display contents as nearby images that are visible in the foreground.

In such cases, by performing display mode change processing such as adding a background to the nearby image, changing the background (including changing the shape, color, etc.), adding a frame, or adding a line image (including adding a line image that spans multiple display contents), it is possible to naturally show that multiple display contents are displayed together.

In other words, the distinctiveness (visual distinctiveness) of nearby images (or a group of nearby images when there are multiple display contents) compared to distant images can be improved without creating a sense of incongruity.

As a result, even if a nearby image falls within the view range, the viewer can focus on the distant image without being particularly aware of the nearby image, reducing the annoyance. This results in an easy-to-view display.

In a second aspect dependent on the first aspect,
When it is determined that the discriminability between the near image and the far image is reduced, or when it is determined that the discriminability should be improved,
When the number of display contents included in the distant image is greater than a predetermined threshold,
Or,
When at least one predetermined display content having high importance is displayed as the distant image, or when the number of the displayed contents exceeds a predetermined threshold,
Or,
When it is detected that importance has increased for at least one display content displayed as the distant image,
may be.

In the second aspect, an example of a situation in which it is determined that the discriminability between near and far images is reduced is when the number of display contents as far images exceeds a threshold. Furthermore, an example of a situation in which it is determined that the discriminability should be improved is when the importance (display priority) of the display contents as far images increases.

In the example situation, it is desirable for the viewer (driver, etc.) to focus their attention on the information presented by the distant image, and it is necessary to avoid the nearby image entering their field of view and making it difficult to see. Therefore, a display mode change process is performed on the nearby image to increase the distinguishability of the nearby image relative to the distant image. This makes it possible to present various types of information in an easy-to-see display.

In a third aspect dependent from the second aspect,
The predetermined display content having high importance is
AR display content superimposed on a real scene;
Or,
Display content for driving assistance information provided by an advanced driver assistance system (ADAS) (ADAS display content);
may be.

In the third aspect, AR display content and ADAS display content treat distant images as highly important display content. These displays contribute to safe driving, etc., and often present important information, so they are treated as important display content.

In a fourth aspect dependent from the second aspect,
When it is detected that the importance of the at least one display content has increased,
When the navigation display is on, if the distance to the branch point where steering is required is within a predetermined distance,
Or,
If there is an increased risk to safe driving regarding the ADAS display content that is already being displayed,
may be.

The fourth aspect illustrates a case in which it may be determined that the importance of the display content as a distant image has increased. When approaching a point where steering (operation of the steering wheel, etc.) is required, or when the risk of ADAS display content increases, a caution or warning display is displayed, and the viewer (driver, etc.) must quickly notice the display and take appropriate action. Therefore, it is preferable to reduce the annoyance caused by a nearby image entering the field of view. Therefore, in the above case, a display mode change process is performed for the nearby image.

In a fifth aspect dependent on any one of the first to fourth aspects,
The display control device is mounted on a vehicle,
The height direction of the vehicle is defined as a vertical direction, the width direction of the vehicle is defined as a horizontal direction or a left-right direction, and the direction perpendicular to the vertical and horizontal directions is defined as a depth direction,
In a case where a plurality of display contents are displayed as the neighboring image and the plurality of display contents are arranged horizontally at intervals,
The display mode change process includes:
The process may be a process of making the viewer perceive that the plurality of display contents are arranged in a cohesive manner in the horizontal direction.

In the fifth mode, when multiple display contents are arranged horizontally as neighboring images, the display mode change process is performed to give the impression that the display contents are arranged together.

If each display content is perceived individually (separately), the viewer will need to determine whether it is a near image or a far image for each display content, which is expected to increase the viewer's burden and inconvenience.

For example, a background of a specific shape (which can also be a specific color or a pattern such as a gradation) can be displayed across the display area of each display content, or a line image with curved portions can be displayed across the left and rightmost display content, giving the impression that the display content arranged in a row is united in the left-right direction (however, this is just one example and is not limited to this).

This allows the viewer to intuitively recognize that this is the display area for the near image. This increases the distinguishability of the near image from the distant image in a natural way, without causing any discomfort to the viewer.

In a sixth aspect dependent from the fifth aspect,
The display mode change process includes:
The process is a process of making the viewer perceive that the plurality of display contents are arranged cohesively in the horizontal direction,
The increase in the overall visibility of the plurality of display contents perceived as a unity may be suppressed.

In the sixth aspect, the display mode change process in the fifth aspect described above does not "improve the discernibility of nearby images by increasing visibility and attracting attention through emphasis processing," as in, for example, Patent Document 1, mentioned above, but rather clarifies that the increase in visibility of multiple displayed contents as a whole is suppressed.

In other words, this aspect suppresses an increase in visibility, maintains natural vision within the viewer's field of vision, and, for example, increases the discriminability (recognizability) of distant images by "facilitating the visual separation of nearby images from distant images." This allows the viewer to effortlessly focus on distant images, etc., that are of high importance.

In a seventh aspect dependent on the fifth or sixth aspect,
The display mode change process includes:
Furthermore, the method may include processing for creating a sense of depth in at least a part of the display area of the plurality of display contents by using at least one of linear perspective and aerial perspective that adjusts the degree of definition.

In the seventh aspect, the multiple display contents included in the near image not only create a sense of horizontal unity, but also create a sense of depth. To express the sense of depth, linear perspective can be used, for example. It is also possible to use aerial perspective (a way of expressing perspective through changes in sharpness, whereby objects that are close are sharper and objects that are farther away are less sharp and more blurred).

When distant images are superimposed on real scenes, the display content is often arranged with a sense of perspective. Therefore, incorporating perspective into nearby images increases the consistency between the two images, resulting in a more natural visual experience.

On the other hand, the perspective used in nearby images is different from the perspective of distant images, so nearby images displayed using perspective (in other words, the display area of the nearby image) are intuitively easier to distinguish from distant images.

This ensures a natural visual perception, reduces any sense of discomfort felt by the viewer, and makes it easier to distinguish between the two images.

In an eighth aspect dependent on any one of the fifth to seventh aspects,
The display mode change process includes:
The method may include a process of changing the display of the near image, which is mainly displayed in achromatic colors, from the far image, which is mainly displayed in chromatic colors.

The eighth aspect clarifies that the display mode after the display mode change process for the nearby image can be primarily achromatic.

Distant images include AR images and ADAS images, and are often displayed in chromatic colors such as red, yellow, and blue to easily attract the viewer's attention. This is because the road surfaces on which vehicles travel are often achromatic (e.g., dark colors), and the white lines painted on the road surface are also achromatic, making it difficult to attract the viewer's attention if they are displayed in similar colors.

With this in mind, nearby images (including the background) can be given a different impression from distant images by primarily using achromatic colors (for example, gray, black, white, and gradations using these colors). This makes nearby images easier to intuitively distinguish from distant images.

For example, it is conceivable that the background of the display area for multiple display contents could be colored a dark color such as gray, while the majority of the display contents could be represented, for example, as white text or figures (however, this is just one example and is not limited to this). This would allow for an easy-to-read display without creating any sense of incongruity.

In a ninth aspect dependent on any one of the fifth to eighth aspects,
The display area of the near image may be disposed below the display area of the far image.

The ninth aspect clarifies that, from the viewer's perspective, the display area of the near image is located below the display area of the far image. If the viewer lowers their line of sight slightly while looking at the far image, the near image often comes into their field of view, which often increases the annoyance caused by the mixed vision of the near and far image. Therefore, the display mode change process for the near image as described above is effective.

In a tenth aspect, the display device comprises:
a head-up display device that displays a distant image;
a display device or a head-up display device that displays a nearby image by display control by the display control device according to any one of the first to ninth aspects;
Includes:

According to the tenth aspect, it is possible to provide a display device that can suppress a decrease in the distinguishability between near and far images and improve the visibility of displayed images.

In an eleventh aspect, a display control method includes:
A display control method for controlling display of a near image displayed closer to a viewer and a far image displayed farther away, the method comprising:
a step of determining whether or not a situation exists in which the discriminability between the near image and the far image is reduced, or whether or not the discriminability should be improved;
When the result of the determination is positive, a step of executing a display mode change process including at least one of changing a display mode of the background of the nearby image, adding a frame image surrounding the nearby image, adding a line image to at least a part of the periphery of the nearby image, and, when the nearby image includes a plurality of display contents, adding a line image so as to span at least two of the plurality of display contents;
Includes:

According to the eleventh aspect, it is possible to suppress a decrease in the discriminability between near and far images and improve the visibility of the displayed image using a relatively simple method.

Those skilled in the art will readily understand that the exemplified embodiments of the present invention can be further modified without departing from the spirit of the present invention.

FIG. 1 is a diagram showing a configuration example of an example of a display device (an in-vehicle display device including a display device and a HUD device) and an example of setting a virtual image display surface by the HUD device. 2A and 2B are diagrams showing another example of a display device using a display device and a HUD device. FIG. 3 is a diagram showing an example of a display by the display device shown in FIGS. FIG. 4 is a diagram showing an example of the configuration of a display device using two HUD devices. FIG. 5 is a diagram showing an example of a display on the display device shown in FIG. Figure 6 (A) is a diagram showing an example of the display of a nearby image and a distant image before the display mode change processing, and Figures 6 (B) and (C) are diagrams showing an example of the display of a nearby image and a distant image after the display mode change processing. Figure 7 (A) is a diagram showing an example of the display of a nearby image and a distant image before the display mode change process, and Figures 7 (B) and (C) are diagrams showing other examples of the display of a nearby image and a distant image after the display mode change process. Figure 8 (A) is a diagram showing an example of the display of a nearby image and a distant image before the display mode change process, and Figures 8 (B), (C), and (D) are diagrams showing further examples of the display of a nearby image and a distant image after the display mode change process. Figure 9 (A) shows an example of the display of a nearby image and a distant image before the display mode change process, and Figures 9 (B) and (C) show how the display mode of the nearby image changes gradually as the vehicle approaches a branch point where steering is required. 10A and 10B are diagrams showing an example of a distant image determined to be of high importance, and an example of a nearby image after the display mode change process. Figure 11 (A) shows a driving scene in which both the near image and the far image are visible through the windshield before the display mode change process, and Figure 11 (B) shows a driving scene in which the importance of the far image has increased and the display mode change process has been performed on the near image. FIG. 12 is a diagram showing an example of the configuration of a system that controls the display of a display device. FIG. 13 is a flowchart showing an example of a display control procedure for a nearby image.

The best mode described below is used to facilitate understanding of the present invention. Therefore, those skilled in the art should note that the present invention is not unduly limited by the embodiment described below.

Please refer to Figure 1. Figure 1 shows an example of the configuration of an example display device (an in-vehicle display device including a display device and a HUD device) and an example of setting a virtual image display surface using the HUD device.

In Figure 1, the direction along the line segment connecting the viewer's left and right eyes (in other words, the width direction of the vehicle 1) is the left-right direction (or lateral direction), the direction along the line segment that is perpendicular to the left-right direction and perpendicular to the ground or a surface equivalent to the ground (here, road surface 6) is the up-down direction (or height direction), and the direction along the line segment that is perpendicular to both the left-right direction and the up-down direction (directions indicating the forward and backward directions of the vehicle 1) is the front-back direction. The front direction is also sometimes referred to as the depth direction. The left-right direction can also be written as the X direction, the up-down direction as the Y direction, and the front-back direction as the Z direction.

Furthermore, the expressions near image/far image are used in this specification, with a near image being an image displayed closer to the viewer, and a far image being an image displayed further back than the near image. In other words, an image displayed in a display area (display surface) closer to the viewer is a near image, and an image displayed in a display area (display surface) further back is a far image. A near image can also be referred to as a near-placed image or a near-side image. A far image can also be referred to as a far-placed image or a far-side image.

In this example, the display device is an in-vehicle display device installed in vehicle 1. This in-vehicle display device includes at least one of a display device (including a control unit 140, a display control unit 107, and a display (display device) 108 such as a liquid crystal panel) and a head-up display (HUD) device 100 (including a control unit 140 and a device main body 120). In the example of Figure 1, both are installed in vehicle 1.

The HUD device 100 is installed, for example, in the dashboard (in other words, the instrument panel) 41.

The device body 120 has a display 150 such as a liquid crystal panel, a screen (display unit) 160 with a display surface 164, and a curved mirror (concave mirror, etc.) 170 with a light-reflecting surface 179.

The curved mirror (concave mirror, etc.) 170 reflects light from the screen 160 and projects (projects) display light K onto the windshield (projected member) 2 of the vehicle 1. A portion of the display light K is reflected from the windshield (projected member) 2 and incident on the viewpoint (eye) A of the viewer (driver, etc.). Apparent light beams E1 to E3 corresponding to each incident light beam are focused at an imaging point in front of the viewer, thereby displaying a virtual image on the virtual image display surface PS. The virtual image display surface PS is a virtual (apparent) surface set in real space in front of the viewer, corresponding to the display surface 164 on the screen 160.

The virtual image display surface PS may be, for example, an elevation surface a perpendicular to the road surface 6, inclined surfaces b and c inclined relative to the road surface 6, a road surface superimposed surface d superimposed on the road surface 6, or a surface e in which the side closer to the viewer is an elevation surface (including a pseudo-elevation surface) and the farther side is an inclined surface. When using surfaces other than elevation surface a, the display distance of the virtual image varies depending on the display position on the virtual image display surface, making 3D display possible.

Next, please refer to Figure 2. Figures 2(A) and (B) are diagrams showing another example of a display device using a display device and a HUD device. In Figure 2, parts that are common to Figure 1 are given the same reference numerals. This also applies to the other drawings.

The examples in Figures 2(A) and (B) have in common that the distant image V1 is displayed by the HUD device 100, and the near image V2 is displayed by a display (display device) 108 installed inside the vehicle.

However, the display (display device) 108 in Figure 2(B) is located closer to the viewer (driver) (closer to the steering wheel 4) than in Figure 2(A). This is a structural difference.

In Figures 2(A) and (B), the HUD device 100 is provided with a display 151 that displays the original image. However, the optical system that guides the display light from the display 151 to the curved mirror (concave mirror, etc.) 170 is omitted.

Next, refer to Figure 3. Figure 3 shows an example of a display by the display device shown in Figures 2(A) and (B).

In Figure 3, three display contents are displayed as nearby images on the display (display device) 108, arranged in a row horizontally (left and right) with a gap between them. The one on the far left is a barcode display D1 showing various information (for example, vehicle temperature and RPM data), the one in the center is a vehicle speed display (displaying "80 km/h") D2, and the one on the far right is a display showing the current time (displaying "12:56 pm") D3.

In addition, in front of the vehicle 1, a navigation display F1 and a fuel gauge display F2 are displayed as AR displays superimposed on the real view. These are displayed on a virtual image display surface 111 set in front of the vehicle 1.

The distant images F1 and F2 are viewed by the driver (viewer) through the windshield 2. The display area of the near images D1-D3 is located below the distant images F1 and F2 from the viewer's (driver's) perspective, and the vertical distance is small. A viewer looking into the distance can see the near images D1-D3 by slightly lowering their line of sight. However, because the field of view is broad, it is likely that the near images D1-D3 will often fall within the viewer's field of view even when they are looking at the distant images F1 and F2.

Next, refer to Figure 4. Figure 4 is a diagram showing an example configuration of a display device using two HUD devices. In Figure 4, the nearby image V2 is displayed as a virtual image by the HUD device 101. Furthermore, the nearby image V2 is displayed on the far side of the windshield 2 as seen by the viewer.

The distant image V1 is displayed as a virtual image by the HUD device 100, as in the example of Figure 2. Note that one of the HUD devices may be referred to as the "first HUD device" and the other as the "second HUD device."

Next, refer to Figure 5. Figure 5 is a diagram showing an example of a display by the display device shown in Figure 4. The display content is the same as that shown in Figure 3. However, Figure 4 does not include the display (display device) 108 shown in Figure 3. A convenient display area 113 is set on the instrument panel 41, and nearby images D1 to D3 are displayed in this display area 113.

Next, refer to Figure 6. Figure 6 (A) shows an example of the display of a near image and a far image before the display mode change process, and Figures 6 (B) and (C) show an example of the display of a near image and a far image after the display mode change process.

In the example of Figure 6, the control unit 140 (see Figure 1) can perform a display mode change process on the nearby image. The display mode change process can be performed, for example, when it is determined that the discriminability between the nearby image and the distant image is reduced, or when it is determined that it would be better to increase the discriminability.

The display mode change process may perform display control that includes at least one of the following: changing the display mode of the background of the nearby image; adding a frame image surrounding the nearby image; adding a line image to at least a portion of the periphery of the nearby image; and, if the nearby image includes multiple display contents, adding a line image that spans at least two of the multiple display contents.

Figure 6(A) shows the normal display mode of the nearby image (the display mode before the display mode change process). This display mode is the same as that shown previously in Figure 3.

In Figure 6(B), in addition to F1 and F2, the distant image also includes speed limit information F3, a warning sign (the words "Caution: Strong Winds") F4, and information indicating the distance to the vehicle ahead F5. F3 can be seen as an important navigation display, while F4 and F5 are driving assistance information (ADAS information, ADAS image) provided by the Advanced Driver Assistance System (ADAS).

Here, the predetermined threshold for the number of display contents as distant images is m (here, m = 2).

In the state of Figure 6(A), the number of display contents included in the distant image does not exceed the threshold (m = 2), but in the state of Figure 6(B), it exceeds the threshold. When the number of display contents in the distant image exceeds the threshold, the burden on the viewer (driver) to look at each display content and understand its meaning increases.

Here, if nearby images D1-D3 enter the viewer's field of vision (field of view) while the viewer is looking at distant images F1-F5, the viewer's burden increases even further. In particular, if D1-D3 are grasped (perceived) individually (separately), the viewer will feel annoyed. Furthermore, the viewer will need to individually recognize the information presented by each display content, which increases the viewer's cognitive burden.

The control unit 140 therefore performs a display mode change process on the nearby image. The display mode change process allows the multiple display contents D1 to D3, which are spaced apart horizontally, to be intuitively perceived as a cohesive whole in the left-right direction. Furthermore, this display change makes it easier to distinguish between nearby and distant images. Therefore, even when a nearby image comes into the field of view (visibility), the nearby image can be intuitively recognized as distinct from a distant image. As a result, the viewer can focus their attention on the distant image without being distracted by the nearby image.

In this case, changing the display mode of the near image does not improve visibility (attractiveness) through enhancement processing or the like, as in Patent Document 1, but rather has a visual effect of making it easier to distinguish from distant images while suppressing an increase in visibility, allowing the near image to be separated from the distant image without creating a sense of incongruity. Therefore, it is possible to improve the visibility of distant images without creating a sense of incongruity.

In Figure 6 (B), a background 115 is applied across the leftmost display content D1 and the rightmost display content D3. This background may be a predetermined color or pattern 115c applied within an area of a predetermined outline.

In addition, in Figure 6(B), the central vehicle speed display ("80 km/h") D2 is intentionally excluded from the background 115. In other words, the background 115 has an inverted trapezoidal cutout. The pair of opposing diagonal sides of this inverted trapezoid helps to create a sense of perspective that is the opposite of that of normal linear perspective. In other words, in Figure 6(B), the addition of a background makes it easier to intuitively grasp the unity of the displayed content in the left-right direction, and also creates a sense of perspective that is different from that of normal linear perspective. This is consistent with the display content F1 and F5 of distant images that are displayed in perspective, ensuring a natural visual perception and preventing any sense of incongruity.

In Figure 6(C), the background 116 has a colored area (which may be a pattern, etc.) that has a trapezoidal outline. The three display contents D1 to D3 are arranged within the trapezoidal background 116. In Figure 6(C), too, the unity of the display contents D1 to D3 in the left-right direction is easily perceived. The pair of oblique sides of the trapezoid also creates a sense of perspective. This makes it easier to achieve consistency with the distant image, and makes it easier to distinguish between the distant image and the close image while maintaining a natural visual perception. This results in an easy-to-view display.

Next, refer to Figure 7. Figure 7 (A) shows an example of the display of a near image and a far image before the display mode change process, and Figures 7 (B) and (C) show other examples of the display of a near image and a far image after the display mode change process.

Figure 7(A) is the same as Figure 6(A). Figures 7(B) and (C) are variations of the example of Figure 6(C) shown above (an example in which a trapezoidal background is added). In Figure 7(B), aerial perspective is used to create a sense of depth. The trapezoidal background has a gradation display in which the clarity is higher at the bottom and lower at the top, either in stages or continuously.

This creates a natural sense of perspective. This has the effect of improving consistency with the perspective of distant images, making it easier to distinguish from distant images while maintaining a natural visual sensation.

In the example of Figure 7(C), a grid-like line image 119 drawn using linear perspective is added inside a trapezoidal background 118. This creates a natural sense of perspective. The resulting effect is the same as in Figure 7(B).

Next, refer to Figure 8. Figure 8 (A) shows an example of the display of a near image and a far image before the display mode change process, and Figures 8 (B), (C), and (D) show further examples of the display of a near image and a far image after the display mode change process.

Figure 8(A) is the same as Figure 6(A). In Figure 8(B), a display mode change process has been performed on the nearby image, and a line image Q has been added to the periphery (surroundings) of the display contents D1 to D3 of the nearby image.

This line image Q is composed of line segments Q1 and Q4 extending in the left-right direction, a hypotenuse Q2 connected to line segment Q1, and a hypotenuse Q3 connected to line segment Q4. The addition of this line image Q creates the impression that the display contents D1 to D3 are arranged together. The presence of hypotenuses Q2 and Q3 also creates a sense of perspective that is different from the perspective of a distant image. This also makes it easier to distinguish between nearby and distant images. The addition of a sense of perspective also has the effect of increasing consistency with the display contents F1 and F5, which are drawn in perspective. Therefore, even when the display mode is changed, a natural visual perception is maintained and the viewer does not feel uncomfortable.

In Figure 8(C), the line image has line segments P1 and P7 extending horizontally, a lane P2 connected to line segment P1, a diagonal line P4 connected to line segment P7, and a line segment P3 extending horizontally and connecting the upper ends of the pair of opposing diagonal lines. The obtained effect is the same as in Figure 8(B).

In Figure 8 (D), a frame P8 has been added that surrounds the three display contents D1 to D3. Note that the interior of frame P8 may be colored or patterned. Figure 8 (D) emphasizes that multiple display contents D1 to D3 are arranged together, and that what is within the frame is a nearby image. This makes it easier to distinguish between distant images and nearby images, resulting in an easy-to-view display.

Next, let's look at Figure 9. Figure 9 (A) shows an example of the display of a near image and a far image before the display mode change process, and Figures 9 (B) and (C) show how the display mode of the near image changes gradually as the vehicle approaches a turning point where steering is required.

In Figure 9 (A), a highway exit 904 can be seen in the distance through the windshield 2. This highway exit 904 corresponds to a fork in the road where the vehicle must steer. The HUD device displays a pointer J1 at the exit 904 to call attention (or to guide the driver's gaze). Normal display is used for nearby areas.

In Figure 9(B), the vehicle is approaching an exit 904, and the distance to the exit 904 is within a predetermined threshold. As a result, a sign display (AR display) 906 that more clearly shows the exit 904 is displayed. Accordingly, a display mode change process is performed on the nearby image. In Figure 9(B), the change process of adding a line image Q, as previously shown in Figure 8(B), is performed.

In Figure 9(C), the vehicle approaches the exit 904. As a result, a display 907 for guiding the vehicle is displayed on the road surface. Accordingly, the display mode of the nearby image is changed. In Figure 9(C), the display mode is changed to create a sense of perspective using gradation, as previously shown in Figure 7(B). As a result, the perspective of the nearby image is consistent with the distant image, which is the display 907 for guiding the vehicle on the road surface (displayed with a unique sense of perspective), maintaining a natural visual perception. Meanwhile, the intuitive distinction between the distant and nearby displays is improved. This results in a display that is easy to see.

Next, let's look at Figure 10. Figures 10(A) and (B) show an example of a distant image determined to be of high importance, and an example of a nearby image after the display mode change process.

In Figure 10 (A), a speed limit display LS1 is displayed as an AR display. Additionally, the ADAS displays a warning mark M1 superimposed on the vehicle G1 ahead. This warning mark M1 corresponds to a distant image of high importance.

In response to this, a display mode change process is performed on the nearby image, changing it to the display mode shown in Figure 6 (B) above.

In addition, in Figure 10(B), the preceding vehicle G2 is located far away and does not pose any particular problems. However, a person B1 has entered the road, and the ADAS displays a frame C1 as a warning display. This frame C1 as a warning display corresponds to a distant image of high importance.

In response to this, a display mode change process is performed on the nearby image, changing it to the display mode shown in Figure 8 (D) above.

Next, let's look at Figure 11. Figure 11(A) shows a driving scene in which both the near image and the far image are visible through the windshield before the display mode change process, and Figure 11(B) shows a driving scene in which the importance of the far image has increased and the display mode change process has been performed on the near image.

In Figure 11 (A), both the near image and the distant image are visible in front of the vehicle through the windshield 2. Ahead of the vehicle, a leading vehicle G3 can be seen in the distance. In addition, a speed limit display (AR display) LS1 is displayed as a distant image.

Figure 11(B) shows a driving scene that requires more caution than Figure 11(A). The road ahead of the vehicle curves to the left. The vehicle is also traveling at high speed. There are also vehicles G4, G5, and G6 ahead, and particular attention must be paid to the distance between the vehicle and the nearest vehicle ahead, G4.

The distant image displays a speed limit LS2, a warning mark U1 for the preceding vehicle G4, a mark (following distance mark) W1 that helps maintain a safe distance between vehicles, and multiple arrows W2 that guide the vehicle's path. The multiple arrows W2 are arranged to follow the white lines 9 on the road surface 6. The number of display contents for the distant image has increased significantly, and the importance of the display (display priority) has also increased.

In addition, the nearby image is placed directly below the distant image, and if the nearby image enters the field of view, it is likely to increase the viewer's cognitive burden.

Therefore, a display mode change process is performed on the nearby images. Here, the three display contents as nearby images are surrounded by a frame, the inside of which is colored, and a background is added to the entire image.

After this display mode change process, the nearby image is displayed primarily in achromatic colors. The reasons for this are as follows:

As shown in Figure 11, distant images include AR images and ADAS images, and are often displayed in chromatic colors such as red, yellow, and blue to easily attract the viewer's attention.

This is because the road surface 6 on which vehicles travel is often achromatic (e.g., dark), and the white lines 9 and other markings on the road surface are also achromatic, making it difficult to attract the viewer's attention using similar colors.

With this in mind, nearby images (including the background) can be given a different impression from distant images by primarily using achromatic colors (for example, gray, black, white, and gradations using these colors). This makes nearby images easier to intuitively distinguish from distant images.

In the example of Figure 11 (B), the background color S1 of the nearby image is, for example, light gray, the barcode display D1 is displayed in black and white (or a cool color that is a receding color), and the vehicle speed display D2 is displayed in white, resulting in a predominantly achromatic display. This allows the nearby image to be distinguished from the distant image in a natural way without causing any sense of incongruity, reducing the burden on the viewer.

Next, let's look at Figure 12. Figure 12 shows an example configuration of a system that controls the display on a display device.

The in-vehicle display device (display device) 180 has an I/O interface 30, a processor (control device) 172 having a control unit (display control unit) 140, an image processing unit 210, an image display unit 230, a storage unit (memory) 350, and an external vehicle communication connection device 420.

The image display unit 230 includes the display control unit 107 and display 108 shown in FIG. 1, as well as the display 150 and display control unit 163 (not shown in FIG. 1), which are components of the HUD device 100.

The I/O interface 30 is connected to a road information database 403, a vehicle position detection unit 405, an external vehicle sensor 407, a gaze direction detection unit 409, an eye position detection unit 411, a mobile information terminal 413, and a vehicle ECU 415.

The vehicle ECU 415 receives necessary information from various sensors, such as a pitch angle sensor 417 and a steering angle sensor 419, as needed. The I/O interface 30 is also connected to an external vehicle communication connection device 420.

The storage unit (memory) 350 also includes, for example, a real object and its position detection module 510, a surrounding environment detection module 512, a vehicle situation detection module 514, an image type determination module 516, an image placement determination module 518, a graphic display module 520, and a display mode determination module 522.

The display mode determination module 522 includes a display mode determination module 327 for nearby images (nearby display) and a display mode determination module 329 for distant images (distant display). When the processor 172 operates in accordance with the above modules, functional blocks such as the control unit 140 and various processing units are constructed. The control unit 140 controls the display mode change process for nearby images described above, etc.

Next, refer to Figure 13. Figure 13 is a flowchart showing an example of a display control procedure for nearby images.

In step S1, the vehicle's driving conditions, surrounding environment, etc. are detected and various information is acquired. In step S2, the display content of the nearby image is determined based on the various acquired information.

In step S3, it is determined whether or not a display mode change process is required when displaying the display content of the nearby image. In other words, it is determined whether or not the display mode change conditions are met. If the answer is yes, then in step S4, a display mode change process is carried out. The display mode change process can include, for example, adding a background, adding a line image, adding a frame, displaying a gradation, changing the background color, etc.

If the answer is N in step S3, the display will be in the normal display mode in step S5. An end determination is made in step S6; if the answer is N, the process returns to step S1; if the answer is Y, the process will end.

As described above, the present invention can suppress a decrease in the discriminability between near and far images, improving the visibility of displayed images.

The present invention is susceptible to various modifications and applications. For example, the display mode change process for nearby images is not limited to the example described in the above embodiment, and various display modes can be adopted as appropriate.

In this specification, the term "vehicle" can also be broadly interpreted as a vehicle. Navigation-related terms (e.g., AR display, ADAS display, etc.) are also broadly interpreted. HUD devices and display devices (and display devices in the broad sense) are also intended to include those used as simulators (e.g., aircraft simulators, simulators as game devices, etc.).

The present invention is not limited to the exemplary embodiments described above, and those skilled in the art could easily modify the exemplary embodiments described above to the extent that they fall within the scope of the claims.

1: Vehicle (host vehicle), 2: Windshield (projection target), 6: Road surface, 30: I/O interface, 41: Instrument panel (dashboard), 100: HUD device, 108: Display (LCD panel, etc.), 109: Display surface of display, 120: HUD device main body, 140: Control unit (display control unit), 160: HUD device display (LCD panel, etc.), 160: Screen, 164: Display surface of screen, 170: Curved mirror (concave mirror, etc.), 179: Reflecting surface of curved mirror, 210: Image processing unit, 230: Image display unit, 350: Memory unit, 522: Display mode determination module, 327: Near image display mode determination module, 329: Far image display mode determination module, K: Display light, PS: Image display surface

Claims (11)

a first HUD device that generates a distant image by reflecting light from a first display device toward a projection target using a curved mirror;
a second HUD device that generates a near image that is displayed closer than the far image by directly projecting light from a second display onto the projection target; and a display control device that executes display control of the second HUD device,
a control unit for controlling a display mode of the distant image and the near image,
The control unit
When it is determined that the discriminability between the near image and the far image is reduced, or when it is determined that the discriminability should be improved,
changing the display mode of the background of the nearby image;
and,
Adding a frame image surrounding the neighboring image;
and,
adding a line image to at least a portion of the periphery of the neighboring image;
and,
When the neighboring image includes a plurality of display contents, a line image is added so as to span at least two of the plurality of display contents.
Execute a display mode change process including at least one of the following:
In a case where a plurality of display contents are displayed as the neighboring image and the plurality of display contents are arranged at intervals,
The display mode change process includes:
a process of making a viewer perceive that the plurality of display contents are arranged in a cohesive manner,
the background, the frame image, and the line image in the display mode change process have a pair of oblique sides that are opposed to each other in the horizontal direction ;
Display control device. When it is determined that the discriminability between the near image and the far image is reduced, or when it is determined that the discriminability should be improved,
When the number of display contents included in the distant image is greater than a predetermined threshold,
Or,
When at least one predetermined display content having high importance is displayed as the distant image, or when the number of the displayed contents exceeds a predetermined threshold,
Or,
When it is detected that importance has increased for at least one display content displayed as the distant image,
The display control device according to claim 1 , wherein: The predetermined display content having high importance is
AR display content superimposed on a real scene;
Or,
Display content for driving assistance information provided by an advanced driver assistance system (ADAS) (ADAS display content);
The display control device according to claim 2 , wherein: When it is detected that the importance of the at least one display content has increased,
When the navigation display is on, if the distance to the branch point where steering is required is within a predetermined distance,
Or,
If there is an increased risk to safe driving regarding the ADAS display content that is already being displayed,
The display control device according to claim 2 , wherein: The display mode change process includes:
a process of making the viewer perceive that the plurality of display contents are arranged cohesively in the horizontal direction;
The display control device according to any one of claims 1 to 4. The display mode change process includes:
The process is a process of making the viewer perceive that the plurality of display contents are arranged cohesively in the horizontal direction,
The increase in the overall visibility of the multiple displayed contents perceived as a unit is suppressed.
The display control device according to claim 5 . The display mode change process includes:
The method further includes processing for creating a sense of depth in at least a part of a display area of the plurality of display contents by at least one of linear perspective and aerial perspective that adjusts the degree of definition.
The display control device according to claim 5 or 6. The display mode change process includes:
a process of changing the display of the near image to a display mainly in achromatic colors, in contrast to the far image, which is mainly in chromatic colors;
The display control device according to any one of claims 5 to 7. a display area for the near image is disposed below a display area for the far image;
The display control device according to any one of claims 5 to 8. a head-up display device that displays a distant image;
a display device or a head-up display device that displays a nearby image under display control by the display control device according to any one of claims 1 to 9;
A display device comprising: A display control method for controlling display modes of a distant image and a near image, comprising:
a step of determining whether or not a situation exists in which the discriminability between the near image and the far image is reduced, or whether or not the discriminability should be improved;
When the result of the determination is positive, a step of executing a display mode change process including at least one of changing a display mode of the background of the nearby image, adding a frame image surrounding the nearby image, adding a line image to at least a part of the periphery of the nearby image, and, when the nearby image includes a plurality of display contents, adding a line image so as to span at least two of the plurality of display contents;
In a case where a plurality of display contents are displayed as the neighboring image and the plurality of display contents are arranged at intervals,
The display mode change process includes:
a process of making a viewer perceive that the plurality of display contents are arranged in a cohesive manner,
the background, the frame image, and the line image in the display mode change process have a pair of oblique sides that are opposed to each other in the horizontal direction;
Display control method.