JP4802267B2 - Storage medium and image generation apparatus - Google Patents

Description

  The present invention relates to an image generation device and the like.

  In a conventional computer graphics environment, various information is displayed on a flat display screen, a desired position on the display screen is indicated by a pointing device such as a mouse or a tablet, and the position coordinates are based on the indicated position coordinates. An object displayed on the screen was specified and operated.

JP-A-8-202522

  However, the conventional pointing device indicates a position coordinate in two dimensions (a plane) and cannot indicate a three-dimensional position coordinate. In the conventional flat display, for example, a plurality of pieces of plane information (a group of information such as documents and drawings) can be superimposed and displayed as in the window system, but the portion hidden in the plane information on the near side is The display of the position coordinates by the pointing device is limited to the plane displayed on the front (upper). In order to specify the position coordinates of other planes, there has been a problem that the planes must be rearranged to display the desired plane on the front side.

  In the first mode, a plurality of virtual planes for virtually displaying given information are arranged substantially in parallel at a given interval, and a virtual space including the plurality of virtual planes is displayed as a stereoscopic image. 3 is a stereoscopic image display device for displaying a pointer indicating a desired position on one virtual plane among the plurality of virtual planes (for example, a pointer control unit shown in FIG. 3). 12 and a display unit 30), and among the plurality of virtual planes, at least a virtual plane closer to the viewer than the virtual plane on which the pointer is located is transparent. .

  In an eighth aspect, given information and a plurality of virtual planes that virtually display the given information at given intervals are arranged substantially in parallel, and a virtual space including the plurality of virtual planes is provided. An information storage medium storing computer-executable software including information for displaying on a display screen as a stereoscopic video (for example, the stereoscopic video display program 202 shown in FIG. 3), the plurality of virtual Pointer display information for displaying a pointer indicating a desired position on one virtual plane among the planes, and at least a virtual plane closer to the viewer than the virtual plane on which the pointer is located among the plurality of virtual planes Information (for example, virtual plane data 206 shown in FIG. 3) for making the image transparent.

Here, the virtual plane may be arranged substantially parallel to the display screen.
In addition, as a display method of the stereoscopic video display device, a method of showing different images on the left and right eyes using glasses such as a stereoscopic endoscope, a head mounted display (HMD), polarized glasses, anaglyph, and time-division glasses. Alternatively, a system that does not use glasses that show different images to the left and right eyes by a lenticular plate, a parallax barrier, or the like may be used. Further, a twin-lens system without a wraparound effect or a multi-lens system with a wraparound effect may be used.

  In addition to documents, diagrams, tables, etc., given information includes information on three-dimensional things such as map information. For example, when displaying map information, it is useful for a three-dimensional map or the like that displays a map of ground roads, railway lines, etc., and a route map of a subway, etc. on different virtual planes for stereoscopic display.

  According to the 1st or 8th form, desired information can be instruct | indicated with a pointer among the given information displayed on the some virtual plane displayed stereoscopically. In addition, since the virtual plane on the viewer side is more transparent than the virtual plane where the pointer is located, the information indicated by the pointer can be easily recognized. Furthermore, since at least information displayed on the virtual plane closer to the viewer than the virtual plane on which the pointer is positioned can be viewed, information on the virtual plane on which the pointer is positioned can be manipulated while referring to such information. .

  Further, as a second mode, in the stereoscopic video display apparatus according to the first mode, a moving means (for example, the pointer control unit 12 shown in FIG. 3) for moving the pointer between the plurality of virtual planes. It is good also to prepare.

  As a ninth form, the information storage medium of the eighth form may include movement information for moving the pointer between the plurality of virtual planes.

  According to the second or ninth aspect, since the pointer can be moved between the virtual planes, the pointer only needs to indicate the two-dimensional position coordinates in each virtual plane. That is, it is not necessary to provide a pointing device or the like for instructing the three-dimensional position coordinates, and a conventional pointing device for instructing the two-dimensional position coordinates can be used.

  As a third mode, in the stereoscopic video display apparatus according to the second mode, the moving means moves the pointer from a virtual plane on which the pointer is located to another virtual plane at every given time. It is good also as providing the means for making it move.

  Further, as a tenth form, in the information storage medium of the ninth form, information for moving the pointer from the virtual plane on which the pointer is located to another virtual plane is included for every lapse of a given time. It's also good.

  According to the 3rd or 10th form, since a pointer can be moved to another virtual plane for every given time progress, a pointer can be moved to the desired virtual plane more easily and reliably.

  Note that the timing of moving the pointer may be moved to another virtual plane when a given time elapses without changing the position of the pointer in the current virtual plane.

  Further, as a fourth mode, in the stereoscopic video display device according to the second or third mode, the moving unit automatically and sequentially turns the virtual plane on the viewer side from the virtual plane where the pointer is located. Means for moving the pointer may be provided.

  Further, as an eleventh aspect, in the information storage medium of the ninth or tenth aspect, information for automatically and sequentially moving the pointer from the virtual plane on which the pointer is located to the virtual plane on the viewer side It is good also as including.

  According to the fourth or eleventh aspect, since the pointer can be moved to the virtual plane on the viewer side, the viewer only has to instruct in the direction to sink the pointer (from the viewer side to the back side), The operability can be further improved.

  Further, as a fifth mode, in the stereoscopic video display device according to any one of the first to fourth modes, display state changing means for changing the display state of the virtual plane on which the pointer is located (for example, FIG. 3). It is good also as providing the virtual plane control part 14) shown in FIG.

  According to the fifth embodiment, the virtual plane on which the pointer is positioned can be displayed in an easy-to-understand manner for the observer, and the operability for a desired object can be improved.

  As a sixth aspect, in the stereoscopic video display apparatus according to the fifth aspect, the display state changing means may change the luminance or color of a virtual plane on which the pointer is located.

  According to the sixth aspect, since the luminance or color of the virtual plane on which the pointer is located is changed, the observer can more easily recognize on which virtual plane the pointer is located.

  Further, as a seventh aspect, in the stereoscopic video display device according to the fifth or sixth aspect, the display state changing means enlarges and displays given information virtually displayed on a virtual plane where the pointer is located. It's also good.

  According to the seventh aspect, the information on the virtual plane on which the pointer is positioned can be enlarged and displayed, so that the information on the virtual plane indicated by the pointer can be displayed more easily. In addition, since the information of the virtual plane where the pointer is not located can be reduced and displayed, more information can be viewed at a time, and information search and confirmation can be facilitated. .

It is a perspective view which shows an example of the external appearance of the stereoscopic vision video display apparatus in this Embodiment. It is a figure which shows an example of the virtual plane displayed as a stereoscopic vision image, and a pointer in this Embodiment. It is a block diagram which shows an example of the principal part structure in this Embodiment. 3 is a diagram illustrating an example of a data configuration of pointer data 208. FIG. It is a figure which shows an example of a data structure of the time data. It is a flowchart which shows the operation | movement which concerns on the position coordinate instruction | indication process in this Embodiment.

  Hereinafter, preferred embodiments of the present invention will be described with reference to the drawings. In the present embodiment, the stereoscopic video display device arranges a plurality of virtual planes for virtually displaying information substantially in parallel, and displays a virtual space constituted by the plurality of virtual planes as a stereoscopic video on a display screen. To do. The virtual plane is arranged in parallel with the display screen.

  FIG. 1 is a perspective view showing an example of the appearance of a stereoscopic video display device 100 according to the present embodiment. In FIG. 1A, the stereoscopic video display device 100 includes a display unit 30 and a communication terminal 60a. In addition, the display unit 30 is integrated with an input unit 40 including a touch panel, and as shown in FIG. 1B, a desired display screen can be displayed by pressing the display screen with a finger or the like (touch input). Enter the position.

  FIG. 2 is a diagram illustrating an example of a plurality of virtual planes displayed in the virtual space in the present embodiment. FIG. 2A is a diagram showing a plurality of virtual planes parallel to a display screen (not shown). In FIG. 2A, the objects 1A, 2A, 2B, 3A, and 3B are virtually displayed on the virtual planes p1, p2, and p3 (here, the object is a group of documents to be operated). , Data of figures, tables, images, etc.). In FIG. 2A, the direction of the observer's line of sight is the direction of the arrow d. In FIG. 2A, the pointer C is located on the virtual plane p2. Therefore, the color of the virtual plane p2 is changed and displayed.

  In addition, it is good also as changing and displaying the brightness | luminance of the virtual plane where the pointer C is located. Further, for example, as shown in FIG. 2B, the display size of information displayed on the virtual plane p1 where the pointer C is located may be changed (for example, characters and symbols are enlarged and displayed). good. In that case, usually (when the pointer C is not located), information can be displayed with fine characters and symbols, so that more information can be displayed, and information search and confirmation Can be made easier.

  In the state shown in FIG. 2A, the pointer C indicates a position coordinate on the virtual plane p2. Then, an object (for example, object 2A) displayed on the virtual plane p2 is designated based on the designated position.

  Further, if the touch input is continued for a given time or longer without changing the position of the pointer C in the state shown in FIG. 2A (without changing the touch position), the pointer C is moved down by one. Move to the virtual plane p3 (from the observer to the back side).

  When touch input is not performed for a given time or more, the pointer C moves to the virtual plane p1 that is one level higher (observer side).

  FIG. 3 is a block diagram illustrating an example of a main configuration of the stereoscopic video display apparatus 100 according to the present embodiment. In the figure, a stereoscopic video display apparatus 100 is configured by a processing unit 10, a storage unit 20, a display unit 30, an input unit 40, a frame buffer 50, a communication unit 60, and a clock 70. Connected by.

  The processing unit 10 stereoscopically displays various data and the pointer C on a plurality of virtual planes based on a stereoscopic video display program 202 in the storage unit 20, pointer data 208, an operation instruction input from the input unit 40, and the like. For this purpose, a process for generating an image for the purpose and storing the generated image in the frame buffer 50 is performed. Since various methods for generating and displaying stereoscopic images have been developed and put into practical use, detailed explanations are omitted. However, in the application of the present invention, stereoscopic vision without glasses is integrated with a high-definition liquid crystal panel. A lenticular system capable of displaying video is practical and suitable.

  In addition, the video stored in the frame buffer 50 is read at a given timing, and the display unit 30 displays the video as a stereoscopic video. Further, based on the position coordinates indicated by the pointer C, an object designation (hit test) process (a process for setting the designated object of the pointer data 208 (see FIG. 4)) is performed. At that time, an object closest to the position coordinate indicated by the pointer C is designated. Therefore, it is not necessary to indicate the exact position of the object, and the object can be specified more easily.

  The processing unit 10 includes a pointer control unit 12 and a virtual plane control unit 14. The pointer control unit 12 performs processing for setting each data of the pointer data 208. Specifically, when a virtual plane on which the current pointer C is located, a process for setting a position coordinate indicated by the pointer C, or touch input is performed, an input is made based on the current time input from the clock 70. When a certain time is measured and no touch input is performed, processing such as processing for measuring the time without input is performed.

  When the input time set in the pointer data 208 is equal to or longer than the dwell time t1 set in the time data 204, the pointer control unit 12 moves down the virtual plane set in the pointer data 208 by one. And the input time is reset to “0”. Also, when the touch position is moved (the position coordinate of the pointer C is changed), the time with input is reset to “0”. Further, when the no-input time becomes equal to or longer than the residence time t2, the virtual plane set in the pointer data 208 is updated to a virtual plane one level higher and the no-input time is reset to “0”. Then, according to the set pointer data 208, processing for arranging the pointer C is performed.

  FIG. 4 is a block diagram showing an example of the data structure of the pointer data 208. As shown in FIG. In the figure, the pointer data 208 includes a virtual plane where the pointer C is currently located and a position coordinate, a time with input indicating a time during which the touch input from the input unit 40 is continued without moving the touch position, and an input unit. A no-input time indicating a time during which no touch input is made from 40 and a designated object designated by the pointer C are set.

  In the pointer data 208 shown in FIG. 4, for example, p2 is set as the virtual plane on which the pointer C is located, and (x1, y1) is set as the position coordinates. Also, ta is set as the time with input, and tb is set as the time without input. An object 2A displayed on the virtual plane p2 is set as an object designated by the pointer C.

  FIG. 5 is a diagram illustrating an example of a data configuration of the time data 204. The residence time with input is set to t1, and the residence time without input is set to t2. The residence time is a time during which the pointer C stays on one virtual plane when moving between the virtual planes. That is, when the touch input is continued for the dwell time t1 with the input (the time with the input in the pointer data 208 is t1 or more) (if the touch position does not move during that time), the pointer control unit 12 The pointer C is moved to the lower virtual plane. Further, the pointer control unit 12 places the pointer C on the virtual plane one level higher when the state where there is no touch input continues for the no-input dwell time t2 (the no-input time in the pointer data 208 becomes t2 or more). Move.

  For example, in the time data 204, a different residence time may be set for each type of object specified by the pointer C.

  Further, the residence times t1 and t2 set in the time data 204 may be changed at any time as desired by the observer.

  The virtual plane control unit 14 determines the arrangement position of the virtual plane in the virtual space, the number of virtual planes, and the like based on the virtual plane data 206 in which the arrangement position of each virtual plane and the data displayed on each virtual plane are set. Perform the setting process. In addition, processing for setting the display state of the virtual plane is performed. Specifically, the virtual plane on which the current pointer C is located is acquired from the pointer data 208, and the process of changing the color of the virtual plane to change only the virtual plane to a display state different from the normal display state, Processing such as processing for transparently displaying the virtual plane above (on the front side of the observer) the positioned virtual plane is performed.

  As shown in FIG. 3, the storage unit 20 stores the above-described time data 204, virtual plane data 206, and pointer data 208 in addition to the stereoscopic video display program 202. The storage unit 20 is realized by an information storage medium such as MO, FD, DVD, hard disk, CD-ROM, DVD, and IC card.

  Further, a part or all of the programs and data stored in the storage unit 20 may be received and stored by the communication unit 60 from other devices via a transmission medium such as a network line. Further, in FIG. 3, the storage unit 20 is illustrated and described as a main part of the stereoscopic video display device 100, but is not included in the stereoscopic video display device 100, such as a server constructed on a network. It may be an information storage medium.

  The display unit 30 includes a three-dimensional display that displays a stereoscopic image by providing a lenticular plate on the LCD, and displays an image output from the frame buffer 50 at a given timing.

  As a three-dimensional display, a stereoscopic image, a head-mounted display (HMD), polarized glasses, anaglyph glasses, time-division glasses, etc. are used to show different planar images for the right eye and the left eye for stereoscopic viewing. Alternatively, the parallax barrier or the like may be of a type in which an image for the right eye and an image for the left eye are seen by each eye in front of the image surface of the display screen.

  The input unit 40 includes a pointing device configured with a touch panel or the like provided integrally with the display unit 30, and outputs a position coordinate signal input by touching to the processing unit 10. The input unit 40 is not limited to a touch panel, and may be a mouse, a trackball, a joystick, a tablet, or the like as long as it is a pointing device that designates two-dimensional position coordinates. Also provided are operation keys for inputting operation instructions such as changing the display range of information displayed on each virtual plane (scrolling, enlarging / reducing, etc.), changing the position of each virtual plane, and the display order (sorting). It's also good.

  The frame buffer 50 stores information displayed on a plurality of virtual planes set by the processing unit 10 based on each data in the storage unit 20 and an image including the pointer C. The stored video is output to the display unit 30 at a given timing and displayed as a stereoscopic video.

  The communication unit 60 receives various types of information transmitted from other devices via a wireless transmission medium such as infrared communication in addition to wired lines such as a network line, and transmits various types of information to other devices. To do. The clock 70 measures the time and outputs a time signal indicating the current time to the processing unit 10 as needed.

  Next, an operation related to the position coordinate instruction processing in the present embodiment will be described based on the flowchart shown in FIG.

  First, the processing unit 10 determines whether or not there is a touch input from the input unit 40 (step S1). If there is a touch input, the position coordinates in the pointer data 208 are set according to the touch position where the touch input is made (step S2), and whether or not the pointer C has moved within the virtual plane set in the pointer data 208 is determined. That is, it is determined whether or not the position coordinate of the pointer C has changed (step S3). When the pointer C moves, the processing unit 10 considers that the virtual plane has been determined, performs a hit test process based on the position coordinates indicated by the pointer C after movement, and designates the object closest to the position coordinates. (Step S4). Then, the pointer control unit 12 resets the time with input (step S5), and returns to step S1.

  If the pointer C has not moved in step S3, the pointer controller 12 updates the time when the pointer data 208 is input based on the current time input from the clock 70 (step S6). And it is discriminate | determined whether the residence time t1 with an input set to the time data 204 passed (step S7). If it has elapsed, the process proceeds to step S8, and if it has not elapsed, the process returns to step S1.

  In step S8, the pointer control unit 12 determines whether or not the virtual plane where the pointer C is currently located (the virtual plane set in the pointer data 208) is the lowest (the farthest from the observer) virtual plane. Determine. If it is not the lowest virtual plane, the pointer C is further moved to the next lower virtual plane (the virtual plane of the pointer data 208 is updated to the next lower virtual plane) (step S9), and the time with input is reset. (Step S10). If it is the lowest virtual plane, the time with input is reset as it is (step S10). Then, the process returns to step S1, and it is determined again whether or not there is a touch input.

  On the other hand, if it is determined in step S1 that no touch input has been performed, the pointer control unit 12 updates the no-input time of the pointer data 208 based on the current time input from the clock 70 (step S1). S11). Next, it is determined whether or not the no-input dwell time t2 has elapsed (step S12), and if not, the process returns to step S1. If the no-input dwell time t2 has elapsed, it is determined whether or not the virtual plane on which the current pointer C is located is the highest (most front side as viewed from the observer) (step S13). If it is not the uppermost virtual plane, the pointer C is moved to the upper virtual plane (the virtual plane set in the pointer data 208 is updated to the upper virtual plane) (step S14), and no input time Is reset (step S15). In step S13, if it is the uppermost virtual plane, the no-input time is reset as it is (step S15). Then, the process returns to step S1.

  As described above, according to the present invention, the pointer C is arranged on one virtual plane and indicates the position coordinates on the virtual plane. Further, since the pointer C can move between the virtual planes in both the back side and the near side, it is possible to easily indicate a desired position on the virtual plane displayed as a stereoscopic video. In addition, since the virtual plane on the viewer side (near side) is more transparent than the virtual plane on which the pointer C is located, information indicated by the pointer C can be displayed more easily and easily operated.

  The present invention is not limited to the one described in the above embodiment, and various modifications can be made. In the above embodiment, when the dwell time has elapsed without the pointer C moving in the virtual plane (without changing the position coordinates), the pointer C moves in the virtual plane. If the position coordinate is changed, the virtual plane is determined as the virtual plane on which the pointer C is positioned. However, for example, the virtual plane on which the pointer C is positioned may be determined by inputting a determination key. good.

  In the above embodiment, when the pointer C is located on the lowermost virtual plane, the pointer C is placed on the lowermost virtual plane as it is even if the input continues for the dwell time t1 or longer. For example, when the touch input is continued for the dwell time t1 or longer while the pointer C is positioned on the lowermost virtual plane, the pointer C may be moved to the uppermost virtual plane. Similarly, when the pointer C is positioned on the uppermost virtual plane and the touch input is not performed for the dwell time t2 or longer, the pointer C may be moved to the lowermost virtual plane.

DESCRIPTION OF SYMBOLS 100 Stereoscopic image display apparatus 10 Processing part 12 Pointer control part 14 Virtual plane control part 20 Storage part 202 Stereoscopic image display program 204 Time data 206 Virtual plane data 208 Pointer data 30 Display part 40 Input part 50 Frame buffer 60 Communication part 70 Clock 80 bus

Claims (8)

A plurality of virtual planes for virtually displaying given information is arranged substantially parallel to the virtual space at a given interval in the depth direction when viewed from the user's line of sight, and includes the plurality of virtual planes A program for generating an image of the virtual space,
Pointer arrangement means for arranging a pointer for indicating a desired position on one virtual plane among the plurality of virtual planes;
First moving means for moving the pointer one virtual plane at a time toward the lowest virtual plane among the plurality of virtual planes according to a predetermined operation by the user;
No-input time counting means for measuring the duration time when there is no operation input by the user,
The pointer is moved by one virtual plane toward the uppermost virtual plane of the plurality of virtual planes each time the duration time measured by the non-input time counting means reaches a given no-input dwell time. Two moving means,
A computer-readable storage medium storing a program for causing the computer to function as In claim 1,
The computer is connected to a display device having a touch panel that displays an image of the virtual space,
The program is
Further causing the computer to function as an input time counting means for measuring the duration of the touch operation input to the same touch position by the user,
The first moving means moves the pointer one virtual plane toward the lowest virtual plane every time the duration time measured by the time counting means with input reaches a given residence time with input. Function the computer to
Is a program for
Storage medium. In claim 1 or 2,
In the virtual plane, a plurality of types of given objects in which the residence time without input is set are displayed,
The program is
Among the objects displayed on the virtual plane where the pointer is located, the computer is further functioned as designated object setting means for setting the designated object based on the position coordinates of the pointer,
When the duration time counted by the no-input time-counting means reaches the no-input dwell time set for the designated object, the second moving means is selected from the virtual plane on which the pointer is located. Causing the computer to function to move the pointer to a virtual plane closer to the top virtual plane;
Is a program for
Storage medium. In claim 2,
The virtual plane displays a plurality of types of given objects in which the residence time with input is set,
The program is
Among the objects displayed on the virtual plane where the pointer is located, the computer is further functioned as designated object setting means for setting the designated object based on the position coordinates of the pointer,
When the duration time counted by the time measuring means with input reaches the dwell time with input set for the designated object, the first moving means is one from the virtual plane on which the pointer is located. Causing the computer to function to move the pointer to a virtual plane closer to the lowest virtual plane;
Is a program for
Storage medium. In claim 2 or 4,
The program is
When the second moving means has reached the dwell time with input when the duration time counted by the time timer with input reaches the dwell time with input when the virtual plane on which the pointer is located is the lowest virtual plane, Is a program for causing the computer to function so as to be moved to the uppermost virtual plane.
Storage medium. In any one of Claim 1 to 5,
The program is
A program for causing the computer to further function as means for making the virtual plane on the user side transparent from the virtual plane on which the pointer is located among the plurality of virtual planes.
Storage medium. In any one of Claim 1 to 6,
The program is
A program for further causing the computer to function as display state changing means for changing a display state of a virtual plane on which the pointer is located.
Storage medium. An image generating apparatus that generates a virtual space image by arranging a plurality of virtual planes that virtually display given information at a given interval in the depth direction when viewed from the user's line of sight, substantially parallel to the virtual space Because
Pointer placement means for placing a pointer indicating a desired position on one virtual plane among the plurality of virtual planes;
First moving means for moving the pointer one virtual plane at a time toward the lowest virtual plane of the plurality of virtual planes according to a predetermined operation by the user;
An input-free time measuring means for measuring a duration time in which there is no operation input by the user;
The pointer is moved by one virtual plane toward the uppermost virtual plane of the plurality of virtual planes each time the duration time measured by the non-input time counting means reaches a given no-input dwell time. Two moving means;
An image generation apparatus comprising:

Images