JP7739766B2 - Display control device, display device, and display control method - Google Patents

Description

The present invention relates to a display control device, a display device, and a display control method to be installed in a vehicle such as an automobile.

Patent document 1 discloses a control device and control method for a multi-display device equipped with multiple display devices.

The multi-display device of Patent Document 1 (see, for example, Figures 1 and 19) uses a CID (Center Information Display) that displays map information and the vehicle's current position, an ICD (Instrumental Cluster Display) that displays the speedometer, and a HUD (Head-Up Display).

Patent document 1, paragraph [0002], states, "Conventionally, in systems that use multiple display devices in conjunction with one another, there has been a problem in that while a user is paying attention to information displayed on one display device, it is difficult for the user to notice changes in information displayed on other display devices. Furthermore, when the information displayed on each display device is related to one another, it is difficult to grasp this relationship."

As a solution to this problem, for example, claim 1 states, "Adding awareness-guiding information (information that emphasizes a specific image) that guides awareness."

JP 2017-71398 A

The inventors have investigated technology for displaying images in multiple display areas with different display distances (near/far mixed display technology), and as a result have found that it is sometimes difficult for a viewer to distinguish between an image that appears close (near image) and an image that appears far away (far image).

For example, a distant image may be placed near a nearby image. Furthermore, if both the nearby image and the distant image contain, for example, multiple pieces of display content erected on the road surface, each piece of display content may be perceived individually, resulting in a lack of perspective and reduced distinguishability between nearby and distant display content.

In this case, viewers may find the display visually distracting. Furthermore, it cannot be ruled out that the perception of important information may be delayed due to the mixed perception of ADAS (Adaptive Driver Assistance System) information, warning signs superimposed on leading vehicles that require caution (distant information), and vehicle speed indicators that are visible in the foreground.

Here, even if awareness-guiding information is added, as in the technology of Patent Document 1, it does not fundamentally solve the problem of reduced discrimination between near and far images, i.e., making it difficult to distinguish between near and far images.

Furthermore, when there are multiple display contents, it becomes difficult to distinguish which are nearby images and which are distant images, and each display content is perceived separately, resulting in visual annoyance, but this does not provide a fundamental solution to this problem.

One of the objectives of the present invention is to prevent a decrease in the discernibility between near and far images and improve the visibility of displayed images.

Other objects of the present invention will become apparent to those skilled in the art by reference to the following exemplary aspects and best modes, as well as the accompanying drawings.

Below, we will provide examples of embodiments according to the present invention to facilitate an understanding of the overview of the present invention.

In a first aspect of the present invention, a display control device is a display control device that performs image display control,
a control unit for controlling a display mode of the image,
the images include a near image displayed closer to the viewer and a far image displayed farther away from the viewer;
The control unit
When it is determined that the discriminability between the near image and the far image is reduced, or when it is determined that the discriminability should be improved,
The distance between the nearby image and the distant image is increased by moving the nearby image farther away from the distant image.
The nearby image is hidden.
shrinking the neighboring image;
The display mode of the nearby image is changed and reduced.
When the neighboring image includes a plurality of display contents, the spacing between adjacently arranged display contents is increased.
A visual separation process including at least one of the above is performed.

Because the human field of vision has a certain extent, for example, even when a viewer is looking at a distant image, a nearby image may also be in their field of vision. Because the distant image and the nearby image have different display distances (for example, the distance to the image or the image display surface relative to the viewer's viewpoint), they are generally distinguishable based on the difference in display distance, but there are also cases where the difference in distance between the two images is relatively small.

Furthermore, for example, if there are multiple display contents as distant images and they are displayed together, it becomes difficult to distinguish them from the multiple display contents as nearby images that are visible in the foreground.

In such a case, for example, by moving the near image farther away from the distant image and increasing the distance between the two images, the two images will be separated in position, making it easier to visually separate the near image from the distant image.

Furthermore, temporarily erasing the nearby image is essentially the same as removing the nearby image from the viewer's field of view. In other words, the nearby image is now sufficiently visually separated from the distant image.

Furthermore, by reducing the size of the nearby image (for example, by reducing the size of icons or text such as graphics that make up the nearby image), the visibility of the nearby image is reduced, making it easier to visually separate the nearby image from the distant image. Also, for example, if the distant image and nearby image contain the same type of display content (icons, etc.), the difference in size makes it easier to perceive the nearby image as visually separated from the distant image. Reducing the size of the nearby image also has the effect of increasing the distance between it and the distant image.

Furthermore, when reducing nearby images, changing the display mode of the nearby images (preferably interpreted broadly as including the background) can further promote visual separation of nearby images. Examples of changes in display mode include changing the design of text or graphics, or changing the color, brightness, saturation, etc. of components or background.

In addition, increasing the spacing between display contents for nearby images reduces the annoyance caused by the perception that multiple display contents are densely arranged, which facilitates visual separation of nearby images from distant images. For example, assuming that the distant image also includes multiple display contents, if the display contents for the distant image are densely arranged and the display contents for the nearby image are similarly densely arranged, it is expected that it will be difficult to distinguish between the distant image and the nearby image. In this case, by dispersing the display contents of the nearby image, the difference in the density of the arrangement of the distant image becomes clearer, making it easier to visually separate the nearby image from the distant image.

By performing visual separation processing, it becomes easier to visually separate nearby images (or a group of nearby images when there are multiple display contents) from distant images without causing any discomfort. Therefore, even if a nearby image falls within the viewer's field of view, the viewer can focus on the distant image without being particularly aware of the nearby image, reducing annoyance. This results in an easy-to-view display.

In a second aspect dependent on the first aspect,
When it is determined that the discriminability between the near image and the far image is reduced, or when it is determined that the discriminability should be improved,
When the number of display contents included in the distant image is greater than a predetermined threshold,
Or,
When at least one predetermined display content having high importance is displayed as the distant image, or when the number of the displayed contents exceeds a predetermined threshold,
Or,
When it is detected that importance has increased for at least one display content displayed as the distant image,
may be.

In the second aspect, an example of a situation in which it is determined that the discriminability between near and far images is reduced is when the number of display contents as far images exceeds a threshold. Furthermore, an example of a situation in which it is determined that the discriminability should be improved is when the importance (display priority) of the display contents as far images increases.

In the example situation, it is desirable for the viewer (driver, etc.) to focus their attention on the information presented by the distant image, and it is necessary to avoid the nearby image entering their field of view and obscuring their view. Therefore, visual separation processing is performed on the nearby image to increase the distinguishability of the nearby image from the distant image. This makes it possible to present various types of information in an easy-to-see display.

In a third aspect dependent from the second aspect,
The predetermined display content having high importance is
AR display content superimposed on a real scene;
Or,
Display content for driving assistance information provided by an advanced driver assistance system (ADAS) (ADAS display content);
may be.

In the third aspect, AR display content and ADAS display content treat distant images as highly important display content. These displays contribute to safe driving, etc., and often present important information, so they are treated as important display content.

In a fourth aspect dependent from the second aspect,
When it is detected that the importance of the at least one display content has increased,
When the navigation display is on, if the distance to the branch point where steering is required is within a predetermined distance,
Or,
If there is an increased risk to safe driving regarding the ADAS display content that is already being displayed,
may be.

The fourth aspect illustrates a case in which it may be determined that the importance of the display content as a distant image has increased. When approaching a point where steering (operation of the steering wheel, etc.) is required, or when the risk of the ADAS display content increases, a caution or warning display is displayed, and the viewer (driver, etc.) must quickly notice the display and take appropriate action. Therefore, it is preferable to reduce the annoyance caused by nearby images entering the field of view. Therefore, in the above case, visual separation processing is performed on the nearby image.

In a fifth aspect dependent on any one of the first to fourth aspects,
The display control device is mounted on a vehicle,
The height direction of the vehicle is defined as a vertical direction or an up-down direction, the width direction of the vehicle is defined as a horizontal direction or a left-right direction, and the direction perpendicular to the vertical and horizontal directions is defined as a depth direction,
the neighboring image includes first and second display contents arranged in a horizontal direction;
Furthermore, when the first and second display contents are located below the display area of the distant image,
The visual separation process includes:
The first display content is moved to the left along a horizontal direction, and the second display content is moved to the right along a horizontal direction to increase the spacing between the first and second display contents; and
When the display area of the first display content is a left display area and the display area of the second display content is a right display area,
a process of preventing the display area of the distant image from overlapping the left display area and the right display area of the nearby image in the vertical direction;
Or,
a process of vertically overlapping the display area of the far image and the right display area of the near image, but not overlapping the left areas;
Or,
The display area of the distant image and the left display area of the near image may be vertically overlapped, but the right areas may not overlap.

The fifth aspect specifically illustrates a preferred example of the "processing of widening the spacing between adjacently arranged display contents when the nearby image includes multiple display contents" in the first aspect.

Increasing the spacing can be achieved by moving some display content to the left in the horizontal direction (left-right direction) and moving other display content to the right in the horizontal direction (left-right direction). The display area of the display content moved to the left is the "left display area," and the display area of the display content moved to the right is the "right display area."

Increasing the spacing between displayed content also means that a non-display area (in other words, space) where no image is displayed is provided between the left and right display areas.

The display area for the distant image is located above this non-display area. If the area of the non-display area is made large enough, the display area for the distant image and the left/right display areas can be prevented from overlapping in the vertical direction (lengthwise).

It is also possible to prevent only the left or right display area from overlapping vertically with the display area of the distant image.

Note that "not overlapping vertically" specifically means that even if the display area of the distant image located at the top is moved (shifted) to the lower position where the nearby image is located, the two areas will not overlap.

One of the reasons for this visual annoyance is thought to be that the viewer perceives the distant image on the top and the nearby image on the bottom as a "collection of cohesive, similar images." By distributing the display content of the nearby image to the left and right and inserting a relatively large space between them, it becomes more difficult for the viewer to perceive the distant image and nearby image as a "collection of cohesive, similar images," and the nearby image becomes more easily visually separated from the distant image.

Furthermore, if only one of the left or right display areas overlaps vertically with the display area of the distant image, while the other does not, the display content of the nearby image tends to be arranged asymmetrically, giving the impression of novelty in the horizontal direction (left-right direction), but of difficulty in perceiving a connection to the distant image in the vertical direction (up-down direction). This makes it less likely that the viewer will perceive the distant image as a single, cohesive collection of images. This helps visually separate the nearby image from the distant image.

In a sixth aspect dependent from the fifth aspect,
the display area of the far image and the right display area of the near image overlap in the vertical direction, but when processing is performed to prevent the left areas from overlapping, the area of the right display area is larger than the area of the left display area;
The display area of the distant image and the left display area of the near image overlap vertically, but when processing is performed to prevent the right areas from overlapping, the area of the left display area may be larger than the area of the right display area.

In the sixth aspect, when only one of the left or right display areas in the fifth aspect overlaps vertically with the display area of the distant image, while the other does not, the area of the overlapping display area is set larger than the area of the non-overlapping display area. A larger display area is advantageous in terms of increasing the number of display contents, and also has the advantage of allowing display contents that are long horizontally to be arranged, with greater flexibility in arrangement.

For example, if there are four display contents as neighboring images, one display content can be displayed in a non-overlapping display area, and the other three display contents can be displayed in overlapping display areas with larger areas, allowing for left-right asymmetrical display content arrangement.

A display in which the display content of nearby images is arranged asymmetrically from left to right also has a certain design element to it, and gives the viewer the impression that the images are not simply dispersed but are similar in type and with a unique element of novelty. This naturally leads to a tendency for the viewer to recognize the nearby image as distinct from the distant image. Furthermore, this asymmetric display, including the non-display area (space area), can also be seen as a kind of design arrangement, and horizontally it tends to give the impression of a unique, cohesive design. On the other hand, vertically (up and down), it gives the impression that it is difficult to perceive a connection with the distant image.

Therefore, viewers are less likely to perceive distant images as a single cohesive set of images. This helps visually separate nearby images from distant images.

In a seventh aspect dependent on any one of the first to sixth aspects,
The visual separation process includes:
The method may further include a process of changing the display of the near image to a display mainly in achromatic colors in contrast to the far image, which is mainly in chromatic colors.

The eighth aspect clarifies that in visual separation processing of nearby images, the display mode can be changed so that achromatic colors are the dominant display.

Distant images include AR images and ADAS images, and are often displayed in chromatic colors such as red, yellow, and blue to easily attract the viewer's attention. This is because the road surfaces on which vehicles travel are often achromatic (e.g., dark colors), and the white lines painted on the road surface are also achromatic, making it difficult to attract the viewer's attention if they are displayed in similar colors.

With this in mind, nearby images (including the background) can be given a different impression from distant images by primarily using achromatic colors (for example, gray, black, white, and gradations using these colors). This makes nearby images easier to intuitively distinguish from distant images.

For example, it is conceivable that the background of the display area for multiple display contents could be colored a dark color such as gray, while the majority of the display contents could be represented, for example, as white text or figures (however, this is just one example and is not limiting). This contributes to realizing an easy-to-read display without creating any sense of incongruity.

In an eighth aspect, the display device comprises:
a head-up display device that displays a distant image;
a display device or a head-up display device that displays a nearby image by display control by the display control device according to any one of the first to seventh aspects;
Includes.

According to the eighth aspect, it is possible to provide a display device that can suppress a decrease in the distinguishability between near and far images and improve the visibility of displayed images.

In a ninth aspect, a display control method includes:
A display control method for controlling display of a near image displayed closer to a viewer and a far image displayed farther away, the method comprising:
a step of determining whether or not a situation exists in which the discriminability between the near image and the far image is reduced, or whether or not the discriminability should be improved;
When the result of the determination is positive, a step of performing a visual separation process including at least one of: moving the nearby image farther away from the distant image to increase a non-display area between the nearby image and the distant image; hiding the nearby image; reducing the nearby image; reducing the nearby image by changing a display mode; and, when the nearby image includes a plurality of display contents, widening a space between adjacently arranged display contents.
Includes:

According to the ninth aspect, it is possible to suppress a decrease in the discriminability between near and far images and improve the visibility of the displayed image using a relatively simple method.

Those skilled in the art will readily understand that the exemplified embodiments of the present invention can be further modified without departing from the spirit of the present invention.

FIG. 1 is a diagram showing a configuration example of an example of a display device (an in-vehicle display device including a display device and a HUD device) and an example of setting a virtual image display surface by the HUD device. 2A and 2B are diagrams showing another example of a display device using a display device and a HUD device. FIG. 3 is a diagram showing an example of a display by the display device shown in FIGS. FIG. 4 is a diagram showing an example of the configuration of a display device using two HUD devices. FIG. 5 is a diagram showing an example of a display on the display device shown in FIG. FIG. 6A is a diagram showing an example of a display of a near image and a far image before visual separation processing, and FIG. 6B is a diagram showing an example of a display of a near image and a far image after visual separation processing. Figure 7(A) is a diagram showing an example of the display of a nearby image and a distant image before visual separation processing, and Figures 7(B) to (E) are diagrams showing other examples of the display of a nearby image and a distant image after visual separation processing. Figure 8(A) is a diagram showing an example of the display of a nearby image and a distant image before visual separation processing, and Figure 8(B) is a diagram showing yet another example of the display of a nearby image and a distant image after visual separation processing. Figure 9(A) is a diagram showing an example of the display of a nearby image and a distant image before visual separation processing, and Figures 9(B) and (C) are diagrams showing yet another example (a modified example of Figure 8(B)) of the display of a nearby image and a distant image after visual separation processing. Figure 10(A) shows an example of the display of a nearby image and a distant image before visual separation processing, and Figures 10(B) and (C) show how the display mode of the nearby image changes gradually as the vehicle approaches a branch point where steering is required. 11A and 11B are diagrams showing an example of a distant image determined to be of high importance, and an example of a nearby image after visual separation processing. Figure 12(A) shows a driving scene in which both the near image and the far image before visual separation processing are visible through the windshield, and Figure 12(B) shows an example of a driving scene in which the importance of the far image has increased and visual separation processing has been performed on the near image. FIG. 13 is a diagram showing an example of the configuration of a system that controls the display of a display device. FIG. 14 is a flowchart showing an example of a display control procedure for a nearby image.

The best mode described below is used to facilitate understanding of the present invention. Therefore, those skilled in the art should note that the present invention is not unduly limited by the embodiments described below.

Please refer to Figure 1. Figure 1 shows an example of the configuration of an example display device (an in-vehicle display device including a display device and a HUD device) and an example of setting a virtual image display surface using the HUD device.

In FIG. 1, the direction along the line connecting the viewer's left and right eyes (in other words, the width direction of the vehicle 1) is the left-right direction (or lateral direction), the direction along the line perpendicular to the left-right direction and perpendicular to the ground or a surface equivalent to the ground (here, road surface 6) is the up-down direction (or longitudinal direction, or height direction), and the direction along the line perpendicular to both the left-right and up-down directions (directions indicating the forward and backward directions of the vehicle 1) is the front-rear direction. The front direction is also sometimes referred to as the depth direction. The left-right direction can also be written as the X direction, the up-down direction as the Y direction, and the front-rear direction as the Z direction.

Furthermore, in this specification, the expressions "near image" and "far image" are used, where a near image is an image displayed closer to the viewer, and a far image is an image displayed further back than the near image. The distances (display distances) from the viewer's viewpoint to each image are different.
In other words, the image displayed in the display area (display surface) closer to the viewer is the near image, and the image displayed in the display area (display surface) further back is the far image. The near image can also be referred to as the near-placed image or the near-side image. The far image can also be referred to as the far-side placed image or the far-side image.

In this example, the display device is an in-vehicle display device installed in vehicle 1. This in-vehicle display device includes at least one of a display device (including a control unit 140, a display control unit 107, and a display (display device) 108 such as a liquid crystal panel) and a head-up display (HUD) device 100 (including a control unit 140 and a device main body 120). In the example of Figure 1, both are installed in vehicle 1.

The HUD device 100 is installed, for example, in the dashboard (in other words, the instrument panel) 41.

The device body 120 has a display 150 such as a liquid crystal panel, a screen (display unit) 160 with a display surface 164, and a curved mirror (concave mirror, etc.) 170 with a light-reflecting surface 179.

The curved mirror (concave mirror, etc.) 170 reflects light from the screen 160 and projects (projects) display light K onto the windshield (projected member) 2 of the vehicle 1. A portion of the display light K is reflected from the windshield (projected member) 2 and incident on the viewpoint (eye) A of the viewer (driver, etc.). Apparent light beams E1 to E3 corresponding to each incident light beam are focused at an imaging point in front of the viewer, thereby displaying a virtual image on the virtual image display surface PS. The virtual image display surface PS is a virtual (apparent) surface set in real space in front of the viewer, corresponding to the display surface 164 on the screen 160.

The virtual image display surface PS may be, for example, an elevation surface a perpendicular to the road surface 6, inclined surfaces b and c inclined relative to the road surface 6, a road surface superimposed surface d superimposed on the road surface 6, or a surface e in which the side closer to the viewer is an elevation surface (including a pseudo-elevation surface) and the farther side is an inclined surface. When using surfaces other than elevation surface a, the display distance of the virtual image varies depending on the display position on the virtual image display surface, making 3D display possible.

Next, please refer to Figure 2. Figures 2(A) and (B) are diagrams showing another example of a display device using a display device and a HUD device. In Figure 2, parts that are common to Figure 1 are given the same reference numerals. This also applies to the other drawings.

The examples in Figures 2(A) and (B) have in common that the distant image V1 is displayed by the HUD device 100, and the near image V2 is displayed by a display (display device) 108 installed inside the vehicle.

However, the display (display device) 108 in Figure 2(B) is located closer to the viewer (driver) (closer to the steering wheel 4) than in Figure 2(A). This is a structural difference.

In Figures 2(A) and (B), the HUD device 100 is provided with a display 151 that displays the original image. However, the optical system that guides the display light from the display 151 to the curved mirror (concave mirror, etc.) 170 is omitted.

Next, refer to Figure 3. Figure 3 shows an example of a display by the display device shown in Figures 2(A) and (B).

In Figure 3, three display contents are displayed as nearby images on the display (display device) 108, arranged in a row horizontally (left and right) with a gap between them. The one on the far left is a barcode display D1 showing various information (for example, vehicle temperature and RPM data), the one in the center is a vehicle speed display (displaying "80 km/h") D2, and the one on the far right is a display showing the current time (displaying "12:56 pm") D3.

In addition, in front of the vehicle 1, a navigation display F1 and a fuel gauge display F2 are displayed as AR displays superimposed on the real view. These are displayed on a virtual image display surface 111 set in front of the vehicle 1.

The distant images F1 and F2 are viewed by the driver (viewer) through the windshield 2. The display area of the near images D1-D3 is located below the distant images F1 and F2 from the viewer's (driver's) perspective, and the vertical distance is small. A viewer looking into the distance can see the near images D1-D3 by slightly lowering their line of sight. However, because the field of view is broad, it is likely that the near images D1-D3 will often fall within the viewer's field of view even when they are looking at the distant images F1 and F2.

Next, refer to Figure 4. Figure 4 is a diagram showing an example configuration of a display device using two HUD devices. In Figure 4, the nearby image V2 is displayed as a virtual image by the HUD device 101. Furthermore, the nearby image V2 is displayed on the far side of the windshield 2 as seen by the viewer.

The distant image V1 is displayed as a virtual image by the HUD device 100, as in the example of Figure 2. Note that one of the HUD devices may be referred to as the "first HUD device" and the other as the "second HUD device."

Next, refer to Figure 5. Figure 5 is a diagram showing an example of a display by the display device shown in Figure 4. The display content is the same as that shown in Figure 3. However, Figure 4 does not include the display (display device) 108 shown in Figure 3. A convenient display area 113 is set on the instrument panel 41, and nearby images D1 to D3 are displayed in this display area 113.

Next, refer to Figure 6. Figure 6(A) is a diagram showing an example of the display of a near image and a far image before visual separation processing, and Figure 6(B) is a diagram showing an example of the display of a near image and a far image after visual separation processing.

In the example of Figure 6, the control unit 140 (see Figure 1) can perform visual separation processing on nearby images. Visual separation processing can be performed, for example, when it is determined that the discriminability between nearby images and distant images is reduced, or when it is determined that it would be better to improve the discriminability.

In visual separation processing, display control may be performed that includes at least one of the following: increasing the distance between the nearby image and the distant image by moving the nearby image farther away from the distant image; hiding the nearby image; reducing the size of the nearby image; reducing the size of the nearby image by changing the display mode; and, when the nearby image includes multiple display contents, increasing the distance between adjacently arranged display contents.

Figure 6(A) shows the normal display state of nearby images (the display state before visual separation processing). This display state is the same as that shown previously in Figure 3.

In Figure 6(B), in addition to F1 and F2, the distant image also includes speed limit information F3, a warning sign (the words "Caution: Strong Winds") F4, and information indicating the distance to the vehicle ahead F5. F3 can be seen as an important navigation display, while F4 and F5 are driving assistance information (ADAS information, ADAS image) provided by the Advanced Driver Assistance System (ADAS).

Here, the predetermined threshold for the number of display contents as distant images is m (here, m = 2).

In the state of Figure 6(A), the number of display contents included in the distant image does not exceed the threshold (m = 2), but in the state of Figure 6(B), it exceeds the threshold. When the number of display contents in the distant image exceeds the threshold, the burden on the viewer (driver) to look at each display content and understand its meaning increases.

Here, if nearby images D1-D3 enter the viewer's field of vision (field of view) while the viewer is looking at distant images F1-F5, the viewer's burden increases even further. In particular, if D1-D3 are grasped (perceived) individually (separately), the viewer will feel annoyed. Furthermore, the viewer will need to individually recognize the information presented by each display content, which increases the viewer's cognitive burden.

The control unit 140 therefore performs visual separation processing on the nearby images. In Figure 6(B), the display contents D1 to D3 of the nearby images are shifted downward (in the -Y direction). In other words, the display contents D1 to D3 of the nearby images are moved farther away from the display contents F1 to F5 of the distant image, widening the vertical gap (non-display area or space area) between the two images.

This separates the distant image from the nearby image in terms of position, making it easier to visually separate the nearby image from the distant image.

Next, let's look at Figure 7. Figure 7(A) shows an example of the display of a near image and a far image before visual separation processing, and Figures 7(B) to (E) show other examples of the display of a near image and a far image after visual separation processing.

Figure 7(A) is the same as Figure 6(A). In Figure 7(B), the display contents D1 to D3 of the nearby image are temporarily erased as a visual separation process. Temporarily erasing the nearby image is essentially the same as the nearby image being outside the viewer's field of view. In other words, the nearby image is visually sufficiently separated from the distant image.

In Figure 7 (C), a process is performed to reduce the size of the display content of the nearby image. By reducing the size of the nearby image (more specifically, for example, by reducing the size of the graphic icons or text that make up the nearby image), the visibility of the nearby image is reduced, making it easier to visually separate the nearby image from the distant image. Also, for example, if the distant image and nearby image contain the same type of display content (icons, etc.), the difference in size makes it easier to perceive the nearby image as visually separated from the distant image. Furthermore, reducing the size of the nearby image also has the effect of increasing the distance between it and the distant image.

Figure 7(D) is similar to Figure 7(C) in that the nearby image is reduced. However, in Figure 7(D), the display mode of the nearby image (preferably interpreted broadly as including the background) is changed when the nearby image is reduced. This can further promote visual separation of the nearby image. Examples of changes to the display mode include changing the design of the text and graphics, or changing the color, brightness, saturation, etc. of the components and background. In Figure 7(D), the vehicle speed display D2 is changed to a white display. Furthermore, the barcode display D1 and time display D3 are changed from chromatic to achromatic. Comparing Figure 7(C) and Figure 7(D), Figure 7(D) reduces the visibility of the display contents D1 to D3 of the nearby image, thereby promoting visual separation from the distant image.

In addition, in Figure 7(E), the positions of display contents D1 to D3 of the nearby image are moved, increasing the spacing between adjacent display contents. This reduces the annoyance caused by the perception that multiple display contents are closely spaced, and also helps to visually separate the nearby image from the distant image.

In Figure 7(E), the distant image also includes multiple display contents, and the display contents of the distant image are arranged quite densely. If the display contents of the nearby image were also arranged densely, it would be difficult to distinguish between the distant image and the nearby image. In Figure 7(E), the display contents D1 to D3 of the nearby image are arranged in a dispersed manner, which makes the difference in the density of the distant image arrangement clearer and makes it easier to visually separate the nearby image from the distant image. Note that display content D1 has been moved to the left, display content D2 has been moved downward, and display content D3 has been moved to the right.

In this way, by performing visual separation processing, it becomes easier to visually separate nearby images (or a group of nearby images when there are multiple display contents) from distant images without causing any discomfort. Therefore, even if a nearby image falls within the viewer's field of view, the viewer can focus on the distant image without being particularly aware of the nearby image, reducing annoyance. This results in an easy-to-view display.

Next, refer to Figure 8. Figure 8(A) shows an example of the display of a near image and a far image before visual separation processing, and Figure 8(B) shows yet another example of the display of a near image and a far image after visual separation processing.

In Figure 8 (A), the display of the distant image is the same as in Figures 6 and 7. The navigation display F1 and fuel gauge display F2 are displayed as AR displays.

Meanwhile, the nearby image is displayed in a predetermined display area on the dashboard (instrument panel) 41. In FIG. 8(A), an arrow icon display D4 and a remaining battery charge display D5 are displayed in the left display area 119, and a vehicle speed display D6 is displayed in the right display area 121. The left display area 119 and the right display area 121 are arranged adjacent to each other with a predetermined distance between them.

In addition, Figure 8 (A) uses the notations a1, a2, a3, and a4, which indicate the positions of the edges of the display area. a1 indicates the left edge of the left display area 119 of the near image, a2 indicates the left edge of the display area 111 of the far image, a3 indicates the right edge of the display area 111 of the far image, and a4 indicates the right edge of the right display area 121 of the near image.

In the example of Figure 8 (A), a1 and a2 are located at approximately the same position in the horizontal direction (left and right, along the X-axis), and a3 and a4 are located at approximately the same position in the horizontal direction. If the edge position of the display area 111 of the distant image and the edge position of the display areas 119 and 121 of the nearby images are aligned, the viewer may perceive the distant image and the nearby image as a collection of cohesive images of the same type. This can be one cause of annoyance.

In other words, in the example of Figure 8 (A), the display area 111 of the distant image (or the display contents F1 and F2 of the distant image) overlaps with the display areas 119 and 121 of the nearby image (or the display contents D5 and D6 of the nearby image) in the vertical direction (up and down, along the Y axis). This can be a cause of visual annoyance.

In more concrete terms, "overlapping vertically" means that if the display area (or display content) of the distant image located at the top were moved (shifted) to the lower position where the nearby image is located, an overlap (including partial overlap) would occur between the two areas (both contents).

Next, refer to Figure 8(B). In Figure 8(B), as a result of the visual separation process, the left display area 119 (or display content D4, D5: first display content) has been moved to the left in the horizontal direction (left-right direction), and the right display area 121 (or display content D6: second display content) has been moved to the right in the horizontal direction (left-right direction). As a result, a fairly large, horizontally elongated non-display area (space area, empty area) 123 has been provided between the left display area 119 and the right display area 121.

The display area 111 of the distant image is located above this non-display area (space area) 123. As in the example of Figure 8 (B), if the area of the non-display area 123 is made large to a certain extent, the display area 111 of the distant image and the display areas 110, 121 on the left and right of the nearby image can be prevented from overlapping in the vertical direction (up and down).

In Figure 8 (B), a1 is located to the left of a2, and a4 is located to the right of a3. Therefore, even if the display area 111 of the distant image located at the top is moved (shifted) to the lower position where the nearby image is located, the display area 111 of the distant image will fit within the non-display area 123 and will not overlap with the left display area 119 and the right display area 121. In other words, the display contents F1 to F5 of the distant image do not overlap vertically with the display contents D4 to D6 of the nearby image.

It is also possible to have only one of the left or right display areas (119 or 121) not overlap vertically with the distant image display area 111. An example of this will be described later.

As mentioned above, one cause of visual annoyance is thought to be the perception of the distant image on the top and the nearby image on the bottom as a "collection of cohesive, similar images." By distributing the display content of the nearby image to the left and right and inserting a relatively large space between them, it becomes more difficult for the viewer to perceive the distant image and nearby image as a "collection of cohesive, similar images," and the nearby image becomes more easily visually separated vertically from the distant image. This makes it easier to distinguish between the distant image and the nearby image, reducing annoyance.

Next, refer to Figure 9. Figure 9(A) shows an example of the display of a near image and a far image before visual separation processing, and Figures 9(B) and (C) show yet another example (a modified version of Figure 8(B)) of the display of a near image and a far image after visual separation processing.

Figure 9(A) is the same as Figure 8(A). In Figure 9(B), as a result of the visual separation process, the left display area 119 (or display content D4, D5: first display content) has been moved to the left in the horizontal direction (left-right direction), and the right display area 125 (or display content D7, D6: second display content) has been moved to the right in the horizontal direction (left-right direction). As a result, the distance between the left display area 119 and the right display area 125 has increased. Note that display content D7 is a fuel gauge that indicates the amount of remaining fuel.

However, in Figure 9 (B), the display area 111 of the distant image and the right display area 125 of the near image overlap vertically, but the left area 119 does not overlap. A non-display area (space area) 127 is provided between the left display area 119 and the right display area 125.

In Figure 9 (B), a1 is located to the left of a2, and a4 is located to the left of a3.

In addition, in Figure 9 (B), the area of the right-side display area 125, which overlaps vertically, is set larger than the area of the left-side display area 119, which does not overlap. A larger display area has the advantage of increasing the number of display contents, and also allows for the arrangement of horizontally long display contents, with the added advantage of greater flexibility in arrangement. The left-side display area 119 displays two display contents, D4 and D5, while the right-side display area 125 displays two display contents, D7 and D6, so the number of contents is the same. However, the right-side display area 125 displays the fairly horizontally long remaining fuel gauge D7 in an easy-to-read size.

In addition, in Figure 9 (C), the display area 111 of the distant image and the left display area 131 of the near image overlap vertically, but the right area 121 does not overlap. A non-display area (space area) 129 is provided between the left display area 131 and the right display area 121.

The left display area 131 displays an arrow icon D4, a time display D8, a meter display D9 showing the remaining battery charge, and a meter display D10 showing the remaining fuel charge. The right display area also displays the vehicle speed D6.

In addition, in Figure 9 (C), the area of the left display area 131, which overlaps vertically, is set larger than the area of the right display area 121, which does not overlap. A larger display area has the advantage of allowing for a larger number of display contents, and also has the advantage of allowing for horizontally long display contents to be arranged with greater flexibility in arrangement. The display contents displayed in the left display area 131 are four: D4, D8, D9, and D10, and the display content displayed in the right display area 121 is one: D6.

As in the examples of Figures 9(B) and (C), if only one of the left or right display areas overlaps vertically with the display area of the distant image, while the other does not, the display content of the nearby image tends to be arranged asymmetrically, giving the impression of novelty in the horizontal direction (left-right direction), but of difficulty in perceiving a connection to the distant image in the vertical direction (up-down direction). This makes it less likely that the viewer will perceive the distant image as a single, cohesive collection of images. This helps to visually separate the nearby image from the distant image vertically.

Furthermore, by making the areas of the left and right display areas different, it becomes possible to arrange display content asymmetrically, for example, as shown in Figures 9(B) and (C).

The asymmetrical arrangement of the display content of nearby images also has a certain design element to it, and gives the viewer the impression that the images are not simply dispersed but are similar in type and novel, so the viewer naturally tends to recognize nearby images as distinct from distant images.

Furthermore, this asymmetrical layout, including the non-display areas (space areas), can also be seen as a type of design arrangement, and in the horizontal direction it is easy to give the impression of a unified design. On the other hand, in the vertical direction (up and down), it gives the impression that it is difficult to sense the connection with the distant image.

Therefore, viewers are less likely to perceive distant images as a single cohesive set of images. This helps visually separate nearby images from distant images.

Next, let's look at Figure 10. Figure 10(A) shows an example of the display of a near image and a far image before visual separation processing, and Figures 10(B) and (C) show how the display mode of the near image gradually changes as the vehicle approaches a turning point where steering is required.

In Figure 10 (A), a highway exit 904 can be seen in the distance through the windshield 2. This highway exit 904 corresponds to a fork in the road where the vehicle must steer. The HUD device displays a pointer J1 at the exit 904 to call attention (or to guide the driver's gaze). The nearby display (display contents D1 to D3) is displayed normally.

In Figure 10(B), the vehicle is approaching an exit 904, and the distance to the exit 904 is within a predetermined threshold. As a result, a sign display (AR display) 906 is displayed, more clearly indicating the exit 904. Accordingly, a visual separation process is performed on the nearby image. In Figure 10(B), display content D1 is moved to the left, and display content D3 is moved to the right, thereby widening the space between adjacent display content. Because the display content of the nearby image is dispersed and no longer densely arranged, even if the nearby display is included in the field of view (field of vision) when gazing at the distant image, the nearby image is naturally separated from the distant image, reducing annoyance.

In Figure 10(C), the vehicle approaches exit 904. As a result, a display 907 for guiding the vehicle's progress is displayed on the road surface. Accordingly, the display mode for the nearby image is changed. In Figure 10(C), a gradient background is applied only to display content D2, impressing the viewer (such as the driver) with the highly important vehicle speed information. Furthermore, the perspective of nearby image display content D2 is consistent with the distant image display 907 on the road surface for guiding the vehicle's progress (displayed with a unique perspective), maintaining a natural visual appearance. Meanwhile, applying a gradient background only to display content D2 increases the design novelty of the nearby image display contents D1 to D3, improving intuitive distinction between distant and nearby displays. This results in a more easily viewable display.

Next, let's look at Figure 11. Figures 11(A) and (B) show examples of distant images that are determined to be of high importance, and examples of nearby images after visual separation processing.

In Figure 11 (A), a speed limit display LS1 is displayed as an AR display. Additionally, an attention-call mark M1 is displayed by ADAS superimposed on the vehicle G1 ahead. This attention-call mark M1 corresponds to a distant image of high importance.

In response to this, visual separation processing is performed on the nearby images, and the display is changed to the display mode shown in Figure 7(D) above. However, while the speed limit and vehicle speed were 80 km/h in Figure 7(D), they are 60 km/h in Figure 11(A).

In addition, in Figure 11 (B), the preceding vehicle G2 is located far away and does not pose any particular problems. However, a person B1 has entered the road, and the ADAS displays a frame C1 as a warning display. This frame C1 as a warning display corresponds to a distant image of high importance.

In response to this, visual separation processing is performed on the nearby images, and the display is changed to the same format as in Figure 11 (A).

Next, let's look at Figure 12. Figure 12(A) shows a driving scene in which both a nearby image and a distant image are visible through the windshield before visual separation processing, and Figure 12(B) shows an example of a driving scene in which the importance of the distant image has increased and visual separation processing has been performed on the nearby image.

In Figure 12 (A), both the near image and the far image are visible in front of the vehicle through the windshield 2. Ahead of the vehicle, a leading vehicle G3 can be seen in the distance. In addition, a speed limit display (AR display) LS1 is displayed as a far image.

Figure 12(B) shows a driving scene that requires more caution than Figure 12(A). The road ahead of the vehicle curves to the left. The vehicle is also traveling at high speed. There are also vehicles G4, G5, and G6 ahead, and particular attention must be paid to the distance between the vehicle and the nearest vehicle ahead, G4.

The distant image displays a speed limit LS2, a warning mark U1 for the preceding vehicle G4, a mark (following distance mark) W1 that helps maintain a safe distance between vehicles, and multiple arrows W2 that guide the vehicle's path. The multiple arrows W2 are arranged to follow the white lines 9 on the road surface 6. The number of display contents for the distant image has increased significantly, and the importance of the display (display priority) has also increased.

In addition, the nearby image is placed directly below the distant image, and if the nearby image enters the field of view, it is likely to increase the viewer's cognitive burden.

Therefore, visual separation processing is performed on the nearby image. Here, for the three display contents D1 to D3 serving as the nearby image, processing is performed to disperse the dense arrangement into a sparse arrangement by increasing the spacing between adjacent display contents. In addition, the three display contents D1 to D3 are surrounded by a frame Q10, the inside of which is colored, and a background is added to the entire image. This makes it easier to visually separate the nearby image from the distant image in a natural way.

In addition, in Figure 12(B), the neighboring images after visual separation processing are displayed primarily in achromatic colors. The reason for this is as follows:

As shown in Figure 12(B), distant images include AR images and ADAS images, and are often displayed in chromatic colors such as red, yellow, and blue to easily attract the viewer's attention.

This is because the road surface 6 on which vehicles travel is often achromatic (e.g., dark), and the white lines 9 and other markings on the road surface are also achromatic, making it difficult to attract the viewer's attention using similar colors.

With this in mind, nearby images (including the background) can be given a different impression from distant images by primarily using achromatic colors (for example, gray, black, white, and gradations using these colors). This makes nearby images easier to intuitively distinguish from distant images.

In the example of Figure 12 (B), the background color S1 of the nearby image is, for example, light gray, the barcode display D1 is displayed in black and white (or a cool color that is a receding color), and the vehicle speed display D2 is displayed in white, resulting in a predominantly achromatic display. This allows the nearby image to be distinguished from the distant image in a natural way without causing any sense of incongruity, reducing the burden on the viewer.

Next, let's look at Figure 13. Figure 13 shows an example configuration of a system that controls the display on a display device.

The in-vehicle display device (display device) 180 has an I/O interface 30, a processor (control device) 172 having a control unit (display control unit) 140, an image processing unit 210, an image display unit 230, a storage unit (memory) 350, and an external vehicle communication connection device 420.

The image display unit 230 includes the display control unit 107 and display 108 shown in FIG. 1, as well as the display 150 and display control unit 163 (not shown in FIG. 1), which are components of the HUD device 100.

The I/O interface 30 is connected to a road information database 403, a vehicle position detection unit 405, an external vehicle sensor 407, a gaze direction detection unit 409, an eye position detection unit 411, a mobile information terminal 413, and a vehicle ECU 415.

The vehicle ECU 415 receives necessary information as needed from various sensors, such as a pitch angle sensor 417 and a steering angle sensor 419. The I/O interface 420 is also connected to an external vehicle communication device 420.

The storage unit (memory) 350 also includes, for example, a real object and its position detection module 510, a surrounding environment detection module 512, a vehicle situation detection module 514, an image type determination module 516, an image placement determination module 518, a graphic display module 520, and a display mode determination module 522.

The display mode determination module 522 includes a display mode determination module 327 for nearby images (nearby display) and a display mode determination module 329 for distant images (distant display).

The display mode determination module 327 also has a visual separation processing execution module 328 that executes visual separation processing.

When the processor 172 operates in accordance with the above modules, for example, the control unit 140 and various processing units are constructed as functional blocks. The control unit 140 controls the visual separation process of nearby images described above.

Next, refer to Figure 14. Figure 14 is a flowchart showing an example of a display control procedure for nearby images.

In step S1, the vehicle's driving conditions, surrounding environment, etc. are detected and various information is acquired. In step S2, the display content of the nearby image is determined based on the various acquired information.

In step S3, it is determined whether visual separation processing is required when displaying the display content of the nearby image. In other words, it is determined whether the conditions for changing the display mode are met. If the answer is yes, in step S4, processing to change the display mode is performed. Visual separation processing may include, for example, increasing the distance of the nearby image from the distant image, hiding it, making it smaller, changing the display mode to make it smaller, changing the color of at least one of the display and background to a mainly achromatic color, increasing the distance between multiple display contents to disperse them, etc.

If the answer is N in step S3, the display will be in the normal display mode in step S5. An end determination is made in step S6; if the answer is N, the process returns to step S1; if the answer is Y, the process will end.

As described above, the present invention can suppress a decrease in the discriminability between near and far images, improving the visibility of displayed images.

The present invention is susceptible to various modifications and applications. For example, the visual separation process for nearby images is not limited to the examples given in the above embodiments, and various display formats can be adopted as appropriate.

In this specification, the term "vehicle" can also be broadly interpreted as a vehicle. Navigation-related terms (e.g., AR display, ADAS display, etc.) are also broadly interpreted. HUD devices and display devices (and display devices in the broad sense) are also intended to include those used as simulators (e.g., aircraft simulators, simulators as game devices, etc.).

The present invention is not limited to the exemplary embodiments described above, and those skilled in the art could easily modify the exemplary embodiments described above to the extent that they fall within the scope of the claims.

1: Vehicle (host vehicle), 2: Windshield (projection target), 6: Road surface, 30: I/O interface, 41: Instrument panel (dashboard), 100: HUD device, 108: Display (LCD panel, etc.), 109: Display surface of display, 120: HUD device main body, 140: Control unit (display control unit), 160: HUD device display (LCD panel, etc.), 160: Screen, 164: Display surface of screen, 170: Curved mirror (concave mirror, etc.), 179: Reflecting surface of curved mirror, 210: Image processing unit, 230: Image display unit, 350: Memory unit, 522: Display mode determination module, 327: Near image display mode determination module, 329: Far image display mode determination module, 328: Visual separation processing execution module, K: Display light, PS: Image display surface

Claims (8)

A display control device that performs image display control,
a control unit for controlling a display mode of the image,
the images include a near image displayed closer to the viewer and a far image displayed farther away from the viewer;
The control unit
When it is determined that the discriminability between the near image and the far image is reduced, or when it is determined that the discriminability should be improved,
The distance between the nearby image and the distant image is increased by moving the nearby image farther away from the distant image.
The nearby image is hidden.
shrinking the neighboring image;
The display mode of the nearby image is changed and reduced.
When the neighboring image includes a plurality of display contents, the spacing between adjacently arranged display contents is increased.
performing a visual separation process including at least one of:
When it is determined that the discriminability between the near image and the far image is reduced, or when it is determined that the discriminability should be improved,
When the number of display contents included in the distant image is greater than a predetermined threshold,
Or,
When at least one predetermined display content having high importance is displayed as the distant image, or when the number of the displayed contents exceeds a predetermined threshold,
Or,
When it is detected that importance has increased for at least one display content displayed as the distant image,
A display control device. A display control device that performs image display control,
a control unit for controlling a display mode of the image,
the images include a near image displayed closer to the viewer and a far image displayed farther away from the viewer;
The control unit
When it is determined that the discriminability between the near image and the far image is reduced, or when it is determined that the discriminability should be improved,
The distance between the nearby image and the distant image is increased by moving the nearby image farther away from the distant image.
The nearby image is hidden.
shrinking the neighboring image;
The display mode of the nearby image is changed and reduced.
When the neighboring image includes a plurality of display contents, the spacing between adjacently arranged display contents is increased.
performing a visual separation process including at least one of:
The display control device is mounted on a vehicle,
The height direction of the vehicle is defined as a vertical direction or an up-down direction, the width direction of the vehicle is defined as a horizontal direction or a left-right direction, and the direction perpendicular to the vertical and horizontal directions is defined as a depth direction,
the neighboring image includes first and second display contents arranged in a horizontal direction;
Furthermore, when the first and second display contents are located below the display area of the distant image,
The visual separation process includes:
The first display content is moved to the left along a horizontal direction, and the second display content is moved to the right along a horizontal direction to increase the spacing between the first and second display contents; and
When the display area of the first display content is a left display area and the display area of the second display content is a right display area,
a process of preventing the display area of the distant image from overlapping the left display area and the right display area of the nearby image in the vertical direction;
Or,
a process of vertically overlapping the display area of the far image and the right display area of the near image, but not overlapping the left display area of the near image;
Or,
A display control device that performs processing to vertically overlap the display area of the distant image and the left display area of the near image, but not to overlap the right display area of the near image. The predetermined display content having high importance is
AR display content superimposed on a real scene;
Or,
Display content for driving assistance information provided by an advanced driver assistance system (ADAS) (ADAS display content);
The display control device according to claim 1 , wherein: When it is detected that the importance of the at least one display content has increased,
When the navigation display is on, if the distance to the branch point where steering is required is within a predetermined distance,
Or,
If there is an increased risk to safe driving regarding the ADAS display content that is already being displayed,
The display control device according to claim 1 , wherein: the display area of the far image and the right display area of the near image overlap in the vertical direction, but when processing is executed to prevent the left display area from overlapping, the area of the right display area is larger than the area of the left display area;
the display area of the far image and the left display area of the near image overlap in the vertical direction, but when processing is executed to prevent the right display area from overlapping, the area of the left display area is larger than the area of the right display area;
The display control device according to claim 2 . The visual separation process includes:
The method further includes a process of changing the display of the near image to a display mainly in achromatic colors, in contrast to the far image mainly in chromatic colors.
The display control device according to any one of claims 1 to 5 . a head-up display device that displays a distant image;
a display device or a head-up display device that displays a nearby image under display control by the display control device according to any one of claims 1 to 6 ;
A display device comprising: A display control method for controlling display of a near image displayed closer to a viewer and a far image displayed farther away, the method comprising:
a step of determining whether or not a situation exists in which the discriminability between the near image and the far image is reduced, or whether or not the discriminability should be improved;
When the result of the determination is positive, a step of performing a visual separation process including at least one of: moving the nearby image farther away from the distant image to increase a non-display area between the nearby image and the distant image; hiding the nearby image; reducing the nearby image; reducing the nearby image by changing a display mode; and, when the nearby image includes a plurality of display contents, widening a space between adjacently arranged display contents.
Including ,
When it is determined that the discriminability between the near image and the far image is reduced, or when it is determined that the discriminability should be improved,
When the number of display contents included in the distant image is greater than a predetermined threshold,
Or,
When at least one predetermined display content having high importance is displayed as the distant image, or when the number of the displayed contents exceeds a predetermined threshold,
Or,
When it is detected that importance has increased for at least one display content displayed as the distant image,
A display control method.