JP5822666B2 - Information display system - Google Patents

Description

  The present invention relates to an information display system in which a user performs a spatial operation on a stereoscopically displayed video.

A conventional touch panel device is configured to recognize a three-dimensional position when an object such as a finger approaches. Therefore, the user can perform an input operation without directly touching the input area on the display surface. For example, a touch panel device according to Patent Document 1 has a spatial thickness in a direction perpendicular to a display surface, and is provided on a side surface excluding an upper surface and a lower surface, and detects the position of an object such as a spatially inserted finger. A plurality of sensors are provided. A calculation unit that calculates a position on the display surface pointed to by the object based on a detection result of the sensor; a display unit that displays an indication point indicating that the object is pointing to the position obtained by the calculation unit; If the sensor closest to the display surface senses an object inserted in the space, or the indication point displayed on the display surface is present within a predetermined coordinate section representing the input area for a certain period of time And an input confirmation means for confirming the input in the case.
This eliminates the need to directly touch the input area on the display surface with a finger or the like, so that the user can perform an input operation with a clean image.

Japanese Patent Laid-Open No. 8-212005

  In the touch panel device according to Patent Literature 1, a sensing space (that is, an operation space) of an object such as a finger is constructed in the thickness direction with respect to a single flat display surface. Therefore, there is a problem that the display space and the operation space do not match.

  The present invention has been made to solve the above-described problems, and by sensing spatial coordinates with respect to a user's hand who wants to directly operate a stereoscopic image, the display space and the operation space can be reduced. An object of the present invention is to provide a matching user interface with a good operational feeling.

  In the information display system according to the present invention, a panel unit in which a display panel provided with a display surface and a touch panel for detecting the proximity and contact of a user's finger are overlapped is configured such that the display surface is concave or convex. A three-dimensional display and a control device that controls display on the display panel based on the output of the touch panel, and the control device has a vertex to make the image displayed on the concave display surface an illusion with a convex three-dimensional image. The area to be illusioned in the depression is converted to lighter than the other areas, or the area to be illusioned in the depression is compared to the other areas in order to make the image displayed on the convex display surface illusion with the concave stereoscopic image. A content conversion unit that performs lightness conversion for dark display and a touch panel output that calculates coordinates representing the position of the finger relative to the stereoscopic display. -View detection that estimates the user's viewpoint position with respect to the stereoscopic display from the determination results of the contact detection unit, the operation finger direction determination unit that determines the finger direction from the calculation result of the proximity / contact detection unit, and the operation finger direction determination unit A sensing coordinate conversion unit that converts coordinates representing the position of the finger into coordinates on a stereoscopic image in a state of viewing the stereoscopic display from the viewpoint position estimated by the viewpoint detection unit, and the stereoscopic image converted by the sensing coordinate conversion unit A spatial coordinate determination unit that determines whether or not the coordinates of the upper finger overlap a predetermined region on the stereoscopic image, and a control unit that changes an image displayed on the stereoscopic display based on the determination result of the spatial coordinate determination unit Is provided.

  According to the present invention, a stereoscopic display in which the stereoscopic image opposite to the unevenness of the display surface is illusioned and the stereoscopic image is made to follow the viewpoint movement of the user is used, and the coordinates of the finger detected by the touch panel are determined by the user. Since the coordinates are converted from the viewpoint position into the coordinates on the stereoscopic image as seen from the stereoscopic display, the display space of the stereoscopic image and the operation space can be matched. Therefore, it is possible to provide a user interface with a good operational feeling so that a three-dimensional image following the viewpoint can be directly operated with a finger.

It is a figure which shows the hardware constitutions of the information display system which concerns on Embodiment 1 of this invention. 2 is a block diagram illustrating a software configuration of the information display system according to Embodiment 1. FIG. It is a figure which shows the positional relationship of the three-dimensional display by Embodiment 1, and a user. 4A and 4B are diagrams for explaining the effect that the display image of the stereoscopic display shown in FIG. 3 follows the viewpoint. FIG. 4A is a display surface when the stereoscopic display is viewed from the left direction, and FIG. The display surface, FIG. 4C, shows the display surface viewed from the right direction. 5A and 5B are diagrams for explaining the effect of the display image of the curved display following the viewpoint, in which FIG. 5A is a display surface when the curved display is viewed from the left, FIG. 5B is a display surface when viewed from the front, and FIG. 5 (c) shows the display surface viewed from the right direction. It is the top view to which the display panel of the three-dimensional display by Embodiment 1 was expanded, and shows a viewing angle characteristic. It is the top view to which the display panel of the three-dimensional display by Embodiment 1 was expanded, and shows the structure of an antireflection film. FIG. 3 is an external perspective view of a stereoscopic display according to Embodiment 1 and shows an example of brightness conversion of a display panel. 6 is a diagram illustrating a state in which a penguin image is displayed on the stereoscopic display according to Embodiment 1. FIG. 6 is a diagram illustrating a state in which a dial image is displayed on the stereoscopic display according to Embodiment 1. FIG. 6 is a diagram illustrating a state in which an image of a three-dimensional vector icon is displayed on the stereoscopic display according to Embodiment 1. FIG.

Embodiment 1 FIG.
The information display system shown in FIG. 1 includes a display panel 1a to 1c, a capacitive touch panel 2a to 2c that can also be used as a space sensor, an antireflection film 3a to 3c, and a three-dimensional display 100 that includes a support unit 4. A personal computer (hereinafter referred to as PC) 5 that controls the stereoscopic display 100 is configured. As shown in FIG. 2, the PC 5 includes touch panel controllers 6 a to 6 c, proximity / contact detectors 7 a to 7 c, an operating finger direction determination unit 8, a viewpoint detection unit 9, and a sensing coordinate conversion unit 10. The computer executes the processes of the spatial coordinate determination unit 11, the overall control unit 12, the content conversion unit 13, the image shape conversion unit 14, and the display control units 15a to 15c. These processing contents are described in a program and stored in a memory (not shown), and are realized by a CPU (not shown) executing a program stored in the memory. In the configuration example of FIG. 1, the three-dimensional display 100 and the PC 5 are separated, but they may be integrated. The PC 5 may have a hardware configuration using a processor or the like specialized for image processing.

  As shown in FIG. 1, a flat panel unit is configured by overlapping a touch panel 2a and an antireflection film 3a on a display panel 1a. Similarly, the touch panel 2b and the antireflection film 3b are overlaid on the display panel 1b, and the touch panel 2c and the antireflection film 3c are overlaid on the display panel 1c to constitute a total of three panel units. Then, these three sets of panel units are fixed by the support portion 4 so that adjacent panel surfaces are perpendicular to each other, and the three-dimensional display 100 is obtained.

  In the first embodiment, the entire three-dimensional display 100 is formed in a concave shape so that the display surfaces of the display panels 1a to 1c face each other. When displaying an image that makes the unevenness opposite to the actual shape appear on the display having such a three-dimensional structure (for example, it is easy to recognize that the human face is basically convex), the user can see the viewpoint (this viewpoint is This is an illusionary effect that the video always faces the user when moving the stance point (not the gazing point).

Here, the effect that the image of the stereoscopic display 100 follows the viewpoint will be described with reference to FIGS. 3 and 4. FIG. 3 shows the positional relationship (left direction, front direction, right direction) between the stereoscopic display 100 and the user. 4A is a display surface of the stereoscopic display 100 viewed from the left direction, FIG. 4B is a display surface viewed from the front direction, and FIG. 4C is an example of the display surface viewed from the right direction. is there.
The three-dimensional display 100 having a concave shape so that the display surface faces inward can be seen only slightly because the left display panel 1b is shaded when viewed from the left, and the right display panel 1a is not visible. Looks big. At this time, the face picture image seen by the user is shown in FIG. 4A. When the display content is illusioned to be convex, the illusion that the face picture rotates in the viewpoint direction can be obtained.
When viewed from the right, the right display panel 1a is shaded so that it can be seen only a little, and the left display panel 1b appears larger. As shown in FIG. 4C, the illusion that the face picture rotates in the direction of the viewpoint can be obtained on the right side as well as on the left side.

In addition to the three-dimensional display 100 in which the plurality of display panels 1a to 1c are concave, a three-dimensional display can be realized by using one or more display panels with curved surfaces. The effect of the stereoscopic display image following the viewpoint in this configuration will be described with reference to FIG.
The stereoscopic display shown in FIG. 5 is a curved display 101 in which a pair of panel units are curved in a concave shape so that the display surface faces inward. FIG. 5B shows a display surface when the curved display 101 is viewed from the front direction. When viewed from the left side, the left side of the curved display 101 is shaded so that it can be seen only a little, and the right side of the curved display 101 appears larger. FIG. 5A shows an image of a face picture that can be seen by the user at this time. When the display contents are illusioned to be convex, an illusion that the face picture rotates in the direction of the viewpoint can be obtained. Similarly, when viewed from the right direction, as shown in FIG. 5C, the illusion that the face picture rotates in the viewpoint direction can be obtained.

Moreover, the viewing angles of the display panels 1a to 1c shown in FIG. 1 are set toward the outside of the three-dimensional display 100, and the luminance in the central direction is lowered to reduce the reflection between the display panels 1a to 1c. An example of this is shown in FIGS.
FIG. 6 is an enlarged plan view of the display panels 1a and 1b of the stereoscopic display 100, and shows viewing angle characteristics. The arrows in the figure represent the viewing angles of the display panels 1a and 1b, and the longer the arrows, the higher the luminance. In this way, the viewing angle facing the open side is set to be better than the viewing angle facing the contact side of the display panels 1a and 1b, the brightness on the contact side is lowered, and the reflection between the panel surfaces is reduced. Reduce. Although illustration is omitted, the brightness of the display panel 1c is similarly adjusted to reduce reflection between the panel surfaces. Note that the change in luminance according to the viewing angle is realized by using, for example, a TN (Twisted Nematic) liquid crystal panel as the display panels 1a to 1c, and utilizing characteristics depending on the orientation direction of liquid crystal molecules.

  FIG. 7 is an enlarged plan view of the display panels 1a and 1b of the stereoscopic display 100, and shows the structure of the antireflection films 3a and 3b. The antireflection films 3a and 3b have a fine slit-like surface structure formed so that the slit faces the outside of the 3D display 100, that is, the directivity indicated by an arrow in the figure is outside the 3D display 100. Install so that it faces. Thereby, reflection of the center part direction of the three-dimensional display 100 is set small, and reflection of panel surfaces is reduced. Although illustration is abbreviate | omitted, the directivity of the antireflection film 3c installed in the display panel 1c is adjusted similarly, and the reflection of panel surfaces is reduced.

  In order to reduce the reflection between the panel surfaces, both the method of adjusting the luminance as shown in FIG. 6 and the method of using the antireflection films 3a to 3c as shown in FIG. Either one may be implemented. Moreover, what is necessary is just to determine the reflection reduction method according to the characteristic of a display panel, such as the case where an organic EL (Electro Luminescence) panel is used, when using a liquid crystal panel as the display panels 1a-1c.

  Moreover, when the panel unit which piled up the display panels 1a-1c, the touch panels 2a-2c, and the antireflection films 3a-3c is a rectangle respectively, the support part 4 shown in FIG. However, the present invention is not limited to this. For example, when the panel unit is a pentagon or other free shape, the support unit 4 supports the posture in which the adjacent panel surfaces face each other at an arbitrary angle so that there is no gap between the panel surfaces. do it.

  Next, details of the PC 5 will be described with reference to FIG. The PC 5 is a control device that displays images on the display panels 1a to 1c, acquires signals output from the touch panels 2a to 2c, and obtains coordinate values representing the positions of objects that are close to or in contact with. In the configuration example of FIG. 2, in order to use the stereoscopic display 100, the touch panel control unit 6a corresponding to the display panel 1a, the proximity / contact detection unit 7a, the display control unit 15a, and the touch panel control corresponding to the display panel 1b. Unit 6b, proximity / contact detection unit 7b and display control unit 15b, touch panel control unit 6c corresponding to display 1c, proximity / contact detection unit 7c, and display control unit 15c. On the other hand, when the curved display 101 shown in FIG. 5 is used, the touch panel control unit, the proximity / contact detection unit, and the display control unit may be provided one by one.

The touch panel control units 6a to 6c acquire signals output from the touch panels 2a to 2c, and detect charge displacement when an object (such as a hand or a finger) is present in the adjacent space of the panel based on the charge distribution. At this time, since the plurality of touch panels 2a to 2c are used side by side, they are easily influenced by each other. Therefore, the touch panel control units 6a to 6c acquire the signals of the touch panels 2a to 2c while holding their hands in the space assumed to be used, perform calibration, and reflect the calibration result to stabilize Then, it is set so that the charge displacement can be detected.
The proximity / contact detection units 7a to 7c obtain, for example, three-dimensional relative spatial coordinates of the finger touch panels 2a to 2c based on the detection results of the touch panel control units 6a to 6c. When the finger touches the touch panels 2a to 2c, two-dimensional relative space coordinates pointing on the surfaces of the touch panels 2a to 2c are obtained.

  The operation finger direction determination unit 8 calculates a three-dimensional absolute space coordinate of the finger relative to the three-dimensional display 100 from the relative space coordinates of the proximity / contact detection units 7a to 7c, and further calculates the shape and direction of the finger from the absolute space coordinate. Etc. are judged. The touch panel 2a-2c can measure the distribution of charges on three surfaces perpendicular to each other, making it possible to recognize more complicated finger signs, such as making OK circles with a finger, compared to a single-plate touch panel. It becomes.

The viewpoint detection unit 9 estimates the position of the viewpoint according to the finger direction determined by the operation finger direction determination unit 8. For example, when the operation finger direction determination unit 8 determines the shape of the fist with the index finger extended and the direction in which the index finger extends, the viewpoint detection unit 9 determines whether the left hand or the right hand is based on the positional relationship between the grip fist and the index finger. The direction of the user with respect to the stereoscopic display 100 is determined from the determination result of the left hand or the right hand and the direction of the index finger, and further, the distance according to the physique is calculated by determining whether the user is an adult or a child from the charge amount, and the stereoscopic display 100 Estimate the absolute space coordinates of the viewpoint position for.
Instead of the viewpoint detection unit 9, an absolute space coordinate of the viewpoint position may be measured using an image sensor.

  The sensing coordinate conversion unit 10 is a coordinate on a convex stereoscopic image in which the absolute space coordinates of the fingertip calculated by the operation finger direction determination unit 8 are viewed from the absolute space coordinates of the viewpoint position estimated by the viewpoint detection unit 9. Convert to Since there is an effect that the two-dimensional image displayed on the three-dimensional display 100 is illusioned to be a convex three-dimensional image, the two-dimensional coordinates of the display image and the three-dimensional coordinates of the three-dimensional image that the user is viewing from the viewpoint position Does not match. Therefore, the sensing coordinate conversion unit 10 calculates the coordinate system of the stereoscopic image viewed from the absolute space coordinates of the viewpoint estimated by the viewpoint detection unit 9, and converts the absolute space coordinates of the fingertip into this coordinate system.

  The spatial coordinate determination unit 11 determines whether or not the coordinates of the designated position converted by the sensing coordinate conversion unit 10 match a predetermined coordinate or a predetermined area of the image displayed on the display panels 1a to 1c. Thus, it is determined whether or not the user has designated with a finger a predetermined area corresponding to the operation icon or the like displayed in 3D.

  The overall control unit 12 includes input touch panel control units 6a to 6c, proximity / contact detection units 7a to 7c, an operation finger direction determination unit 8, a viewpoint detection unit 9, a sensing coordinate conversion unit 10, and a spatial coordinate determination unit 11. Controls both the output content conversion unit 13, the image shape conversion unit 14, and the display control units 15a to 15c, and executes various application programs. For example, the overall control unit 12 receives a determination result indicating that the user has designated an operation icon from the spatial coordinate determination unit 11, and executes an application program associated with the operation icon.

The content conversion unit 13 performs lightness conversion so that a portion desired to be viewed as a vertex is displayed brightly in order to make the image displayed on the concave stereoscopic display 100 an illusion of being convex. An example of brightness conversion is shown in FIG.
FIG. 8 is an external perspective view of the stereoscopic display 100, and shows an example of brightness conversion of the display panels 1a to 1c. The central part A where the three vertices of the display panels 1a to 1c gather is the deepest part of the concave three-dimensional display 100 and is usually often dark. In order to make this an illusion of convexity, the brightness of the central part A illusioned at the apex is increased, and the brightness is lowered so that it gradually darkens from the central part A to the diagonal part B on the near side.

The image shape conversion unit 14 performs image processing for transforming the shape of the image whose brightness has been converted by the content conversion unit 13 using a general method such as projective conversion. For example, when the curved display 101 shown in FIG. 5 is used, the shape of the image is converted to match the display surface shape of the curved inner concave surface.
Therefore, when using the three-dimensional display 100 comprised by the planar display panels 1a-1c, this image shape conversion part 14 is unnecessary.

  The display control units 15a to 15c output the image data converted by the content conversion unit 13 or the image shape conversion unit 14 to the display panels 1a to 1c and display them synchronously.

  Next, an operation example of the information display system will be described with reference to FIGS. 9 and 10. FIGS. 9 and 10 are examples, and it goes without saying that the information display system can be used for other purposes.

FIG. 9 is a diagram illustrating a state in which a penguin image is displayed on the stereoscopic display 100. The application program executed by the overall control unit 12 is to invert the direction of the penguin in accordance with the movement of the finger.
FIG. 9A shows a state where the user holds his / her finger over the stereoscopic display of the penguin image facing leftward on the drawing paper. At this time, the touch panel control units 6a to 6c detect the displacement of the charge distribution of the touch panels 2a to 2c, and the proximity / contact detection units 7a to 7c detect the relative space coordinates of the finger, respectively. Then, the operating finger direction determination unit 8 converts each relative space coordinate into an absolute space coordinate to determine the finger direction, and the viewpoint detection unit 9 estimates the viewpoint position of the user. In the case of FIG. 9A, since the index finger of the right hand extends from right to left, it is estimated that the user's viewpoint is in the right direction from the front. Then, the sensing coordinate conversion unit 10 converts the absolute spatial coordinates of the fingertip into coordinates on the stereoscopic image that the user is viewing, and the spatial coordinate determination unit 11 indicates that the fingertip coordinate points to the beak part of the penguin. Is notified to the overall control unit 12.

  When the user's finger moves from the position shown in FIG. 9 (a) to the position shown in FIG. 9 (b), the PC 5 performs the same processing as described above, and the coordinate of the fingertip is changed to the penguin from the spatial coordinate determination unit 11 to the overall control unit 12. Information indicating that the position is to the right of the beak portion is output. When the coordinate of the fingertip moves from left to right to a predetermined coordinate, the overall control unit 12 outputs a penguin image that is horizontally reversed to the content conversion unit 13. And the content conversion part 13 adjusts the brightness of an image, and the display control parts 15a-15c display the image on the display panels 1a-1c. Accordingly, as shown in FIG. 9B, a penguin image facing rightward on the drawing paper is displayed on the stereoscopic display 100, and the orientation of the penguin is changed in accordance with the movement of the user's finger.

  During the above operations, the user's viewpoint does not basically move in many cases. However, when the viewpoint is moved after the finger operation is completed, the penguin's orientation follows the illusion even if the image of the penguin is the same. The effect that comes is obtained.

FIG. 10 is an example in which the information display system is used as a user interface, and shows a state in which a dial image is displayed on the stereoscopic display 100 as an example of a three-dimensional operation icon. The application program executed by the overall control unit 12 rotates the dial in accordance with the movement of the user's finger.
FIG. 10A shows a state in which the user has made a gesture of pinching the dial with respect to the stereoscopic display of the dial image with the knob directed in the vertical direction on the drawing paper. At this time, the touch panel control units 6a to 6c detect the displacement of the charge distribution of the touch panels 2a to 2c, and the proximity / contact detection units 7a to 7c detect the relative space coordinates of the finger, respectively. Then, the operation finger direction determination unit 8 converts each relative space coordinate to an absolute space coordinate to determine the direction of the finger, and determines that the finger has a shape that pinches the dial. In this example, it is assumed that there is no movement of the viewpoint during the operation of rotating the dial, and the finger approach direction is estimated from the coordinates where the fingertip or hand first entered the sensing area and the current coordinates. And Then, the viewpoint detection unit 9 estimates the user's viewpoint position based on information such as the finger direction. The sensing coordinate conversion unit 10 converts the absolute spatial coordinates of the finger into coordinates on the stereoscopic image that the user is viewing, and the spatial coordinate determination unit 11 indicates that the fingertip coordinates pinch the dial knob. Determine and notify the overall control unit 12.

  When the user's finger moves from the position shown in FIG. 10 (a) to the position shown in FIG. 10 (b), the PC 5 performs the same process as described above, and turns from the spatial coordinate determination unit 11 to the overall control unit 12 in the left-right direction. Information indicating that the gesture is for pinching the knob is output. The overall control unit 12 outputs a dial image in which the direction of the knob is rotated in accordance with the coordinates of the gesture to the content conversion unit 13. And the content conversion part 13 adjusts the brightness of an image, and the display control parts 15a-15c display the image on the display panels 1a-1c. Accordingly, as shown in FIG. 10B, a dial image in which the knob is directed in the left-right direction on the drawing paper is displayed on the three-dimensional display 100, and the direction of the dial is changed in accordance with the movement of the user's finger.

  When using a video for the user interface, it is necessary to follow the video to the viewpoint in order to improve the operational feeling. However, in the conventional user interface device, special equipment (for example, a camera) is required to follow the video to the viewpoint position. And a device called an eye tracking system comprising an image processing device). In contrast, in the information display system according to the first embodiment, the image follows the viewpoint due to the illusion, so no special equipment for tracking the viewpoint is required and the reaction speed is not delayed.

FIG. 11 is an example in which the information display system is used for a user interface, and shows a state where a three-dimensional vector icon imitating the shape of a hand is displayed on the three-dimensional display 100. The application program executed by the overall control unit 12 changes the position and orientation of the three-dimensional vector icon in accordance with the movement of the user's finger.
Also in this case, the PC 5 performs the same processing as described above, and information representing the coordinates and direction of the user's finger is output from the spatial coordinate determination unit 11 to the overall control unit 12. The overall control unit 12 displays a three-dimensional vector icon oriented in the same direction as the direction of the finger on the screen corresponding to the coordinate of the finger according to the information.

  By operating the three-dimensional vector icon displayed on the stereoscopic display 100, the user can adjust the coordinates and direction to desired values. Therefore, coordinates smaller than the fingertip can be designated. In addition, since the user can visually obtain an operational feeling (feedback) when operating on a stereoscopic display in the air, a reliable operation can be performed.

  9 to 11, for the sake of explanation, the seams of the panels are made conspicuous to distinguish the display panels 1a to 1c. However, since the panels are actually in contact with each other with no gaps, the seams are formed. Inconspicuous.

  As described above, according to the first embodiment, the information display system includes three sets of panel units in which the display panels 1a to 1c provided with the display surface and the touch panels 2a to 2c for detecting the proximity and contact of the user's finger are overlapped. The three-dimensional display 100 is configured such that the display surface has a concave shape, and the PC 5 that controls the display of the display panels 1a to 1c based on the outputs of the touch panels 2a to 2c. In order to make the image displayed on the surface an illusion of a convex three-dimensional image, the content conversion unit 13 that performs brightness conversion for displaying the region illusioned at the vertex brighter than the other regions, and the output of the touch panels 2a to 2c from the display panel 1a To the proximity / contact detection units 7a to 7c for calculating coordinates representing the position of the finger with respect to ˜1c, and the proximity / contact detection units 7a to 7c. The operation finger direction determination unit 8 that determines the direction of the finger from the output result, the viewpoint detection unit 9 that estimates the user's viewpoint position with respect to the stereoscopic display 100 from the determination result of the operation finger direction determination unit 8, and the coordinates that represent the finger position Is converted from the viewpoint position estimated by the viewpoint detection unit 9 into coordinates on the stereoscopic image in the state of viewing the stereoscopic display 100, and the coordinates of the finger on the stereoscopic image converted by the sensing coordinate conversion unit 10 are A spatial coordinate determination unit 11 that determines whether or not it overlaps a predetermined area on the stereoscopic image, and an overall control unit 12 that changes an image displayed on the stereoscopic display 100 based on the determination result of the spatial coordinate determination unit 11. It was configured as follows. For this reason, the display space illusioned with the convex stereoscopic image and the operation space can be matched. Therefore, it is possible to provide a user interface with a good operational feeling so that a three-dimensional image following the viewpoint can be directly operated with a finger.

  Further, according to the first embodiment, the stereoscopic display 100 sets the viewing angle of the display surface configured in a concave shape toward the outside of the display surface so as to reduce the luminance in the center direction of the display surface. Therefore, reflection between panel surfaces can be reduced.

  In addition, according to the first embodiment, the stereoscopic display 100 is configured to include the antireflection films 3a to 3c having directivity facing the outside of the display surface, so that reflection in the center direction of the display surface is reduced. Thus, reflection between panel surfaces can be reduced.

  Further, according to the first embodiment, the overall control unit 12 of the PC 5 has a three-dimensional vector indicating the finger direction determined by the operating finger direction determination unit 8 at the position of the finger coordinates output by the sensing coordinate conversion unit 10. An icon is displayed, and the direction of the three-dimensional vector icon is changed according to the movement of the finger. For this reason, in a user interface that displays a fine image that is difficult to directly operate with the fingertip, the user does not operate the fine image, but operates the three-dimensional vector icon that moves according to the viewpoint and the finger. It can be performed. Therefore, it is possible to provide a user interface with a good operational feeling.

  Further, according to the first embodiment, the stereoscopic display is configured by the curved display 101 whose display surface is curved in a concave shape, and the PC 5 is an image that transforms the image into a shape of the display surface of the curved display 101 by projective transformation. The configuration is configured to include the shape conversion unit 14. For this reason, even when a single display panel is used, a user interface with a good operational feeling is provided so that a three-dimensional image following a viewpoint can be directly operated with a finger by forming a physically concave display surface. Can do.

In the above description, the configuration example in which the stereoscopic display 100 or the curved display 101 is concave and the image displayed on the concave display surface is illusioned with the convex stereoscopic image has been described. The curved display 101 may be convex, and the image displayed on the convex display surface may be illusioned with the concave stereoscopic image.
In the case of this configuration, the content conversion unit 13 performs lightness conversion for darkly displaying the region to be illusioned in the depression in order to make the image displayed on the convex surface an illusion. In the case of the convex three-dimensional display 100, the lightness of the central part on the convex side where the three vertices of the display panels 1a to 1c are gathered is lowered to make it appear as a dent, and it naturally brightens from the central part to the recessed diagonal part. You should increase the brightness as you go.

  In addition to the above, within the scope of the invention, the invention of the present application can be modified with any component of the embodiment or omitted with any component of the embodiment.

  1a to 1c display panel, 2a to 2c touch panel, 3a to 3c antireflection film, 4 support unit, 5 PC, 6a to 6c touch panel control unit, 7a to 7c proximity / contact detection unit, 8 operation finger direction determination unit, 9 viewpoint Detection unit, 10 sensing coordinate conversion unit, 11 spatial coordinate determination unit, 12 overall control unit, 13 content conversion unit, 14 image shape conversion unit, 15a to 15c display control unit, 100 stereoscopic display, 101 curved display, A center unit, B Diagonal part.

Claims (6)

A three-dimensional display configured such that a display panel provided with a display surface and a touch panel for detecting the proximity and contact of a user's finger are overlapped so that the display surface has a concave shape or a convex shape;
A control device for controlling the display of the display panel based on the output of the touch panel;
The controller is
In order to make the image displayed on the concave display surface an illusion with a convex three-dimensional image, brightness conversion is performed to display a region illusioned at the vertex brighter than other regions, or on the convex display surface In order to make the image to be displayed an illusion of a concave stereoscopic image, a content conversion unit that performs brightness conversion to display an area illusion of the depression darker than other areas,
From the output of the touch panel, a proximity / contact detection unit that calculates coordinates representing the position of the finger with respect to the stereoscopic display;
An operation finger direction determination unit that determines the direction of the finger from the calculation result of the proximity / contact detection unit;
From a determination result of the operating finger direction determination unit, a viewpoint detection unit that estimates the viewpoint position of the user with respect to the stereoscopic display;
A sensing coordinate conversion unit that converts coordinates representing the position of the finger into coordinates on the stereoscopic image in a state of viewing the stereoscopic display from the viewpoint position estimated by the viewpoint detection unit;
A spatial coordinate determination unit that determines whether or not the finger coordinates on the stereoscopic image converted by the sensing coordinate conversion unit overlap a predetermined region on the stereoscopic image;
An information display system comprising: a control unit that changes an image displayed on the three-dimensional display based on a determination result of the spatial coordinate determination unit.   The information display system according to claim 1, wherein the three-dimensional display includes a combination of a plurality of planar panel units, and the combined display surface is configured in a concave shape or a convex shape. The three-dimensional display is composed of a set of panel units whose display surfaces are curved in a concave shape or a convex shape,
The information display system according to claim 1, wherein the control device includes an image shape conversion unit that performs projective conversion of an image and deforms the image into a shape of the display surface.   The three-dimensional display is characterized in that the viewing angle of the display surface configured in a concave shape is set toward the outside of the display surface to reduce the luminance in the center direction of the display surface. The information display system according to any one of the above.   The information display system according to any one of claims 1 to 4, wherein the three-dimensional display includes an antireflection film having directivity facing the outside of the display surface.   The control unit of the control device displays a three-dimensional vector icon indicating the direction of the finger determined by the operating finger direction determination unit at the position of the finger coordinate output from the sensing coordinate conversion unit, and matches the movement of the finger. 6. The information display system according to claim 1, wherein the direction of the three-dimensional vector icon is changed.

Images