JP6823946B2 - How to draw figures, drawing devices and simulators - Google Patents

Description

The present invention relates to a method of drawing a figure, a drawing device and a simulator.

Conventionally, a drawing device has been used to generate and display a three-dimensional figure.

With the increasing performance of arithmetic units, it has become possible to draw three-dimensional figures at high speed, and the generation and display of realistic images is used as a video expression.

By using such a drawing technique of three-dimensional graphics as an image of a simulator, a movie, or a game, an effect full of realism is obtained.

However, since a large computing power is required to simultaneously generate a large number of three-dimensional figures included in one frame, if the processing power of the arithmetic unit is insufficient, frame dropping of an image or the operation of a human figure may occur. Clashing may occur.

For example, in Patent Document 1, when a predetermined event occurs in a video in which a plurality of human figures are drawn as two-dimensional figures, the human figure within the range affected by the predetermined event is switched to the three-dimensional figure and drawn. I am proposing to do it.

In this way, Patent Document 1 attempts to draw an image within the processing capacity of the arithmetic unit to prevent frame dropping of the image or clogging of the movement of the human figure.

Japanese Unexamined Patent Publication No. 2012-113642

In the method of Patent Document 1, when an event occurs, a plurality of person figures in a predetermined range change from a two-dimensional figure to a three-dimensional figure at a time, so that the realism of the person figure suddenly changes, resulting in an unnatural image. There is a risk of becoming.

An object of the present specification is to propose a method, a drawing apparatus, and a simulator for drawing a figure that can obtain a natural image while suppressing the amount of processing for drawing an image.

According to the method disclosed in the present specification, the number of pixels used when the drawn figure drawn as a three-dimensional figure is displayed as a two-dimensional figure is obtained, and when the number of pixels is equal to or more than a predetermined threshold value, the above The drawn figure is displayed as a three-dimensional figure, and when the number of pixels is smaller than a predetermined threshold value, the drawn figure is displayed as a two-dimensional figure.

Further, according to the drawing apparatus disclosed in the present specification, the number of pixels used when the drawn figure drawn as a three-dimensional figure is displayed as a two-dimensional figure is obtained, and the number of pixels is equal to or greater than a predetermined threshold value. Occasionally, display information for displaying the drawn figure as a three-dimensional figure is generated, and when the number of pixels is smaller than a predetermined threshold, display information for displaying the drawn figure as a two-dimensional figure is generated. It has a part.

Further, according to the simulator disclosed in the present embodiment, the number of pixels used when the drawn figure drawn as a three-dimensional figure is displayed as a two-dimensional figure is obtained, and when the number of pixels is equal to or more than a predetermined threshold value. , A processing unit that generates display information for displaying the drawn figure as a three-dimensional figure, and when the number of pixels is smaller than a predetermined threshold, generates display information for displaying the drawn figure as a two-dimensional figure. An image generation unit including the above, and a display unit for displaying an image generated by the image generation unit.

According to the method disclosed in the present specification described above, a natural image can be obtained while suppressing the amount of processing for drawing an image.

Further, according to the drawing apparatus disclosed in the present specification described above, a natural image can be obtained while suppressing the amount of processing for drawing an image.

Further, according to the simulator disclosed in the present specification described above, a natural simulated visual field image can be obtained while suppressing the amount of processing for drawing an image.

It is a figure which shows one Embodiment of the drawing system disclosed in this specification. It is a figure which shows one image generated by the system of this embodiment. It is a flowchart explaining the process of generating 3D display information and 2D display information for displaying a figure. (A) shows a figure of a stationary person, (B) shows a figure of a walking person, and (C) shows a figure of a running person. is there. It is a flowchart explaining operation of a drawing system. (A) shows a figure of a person at a reference position, (B) is a figure showing a state in which a two-dimensional figure of each person is drawn on the memory, and (C) is a figure of each two-dimensional figure. It is a figure explaining that the number of pixels is obtained. It is a flowchart explaining the process of step S502.

Hereinafter, a preferred embodiment of the system disclosed in the present specification will be described with reference to the drawings. However, the technical scope of the present invention is not limited to those embodiments, but extends to the inventions described in the claims and their equivalents.

FIG. 1 is a diagram showing an embodiment of the system disclosed in the present specification.

The system 1 of the present embodiment uses three-dimensional graphics technology to generate and display an image including a three-dimensional figure. By continuously displaying each of the generated images, a three-dimensional graphics image is formed. System 1 can be used, for example, to generate a simulated visual field image of a train simulator or the like.

The system 1 includes a control device 20, a drawing device 10, and a display device 30.

The control device 20 outputs a drawing command for instructing a figure to be drawn to the drawing device 10 for each frame forming the image based on a predetermined video scenario.

The drawing device 10 generates an image in which each figure is drawn for each frame according to a drawing command input from the control device 20, and outputs the image to the display device 30. The display device 30 displays the image input from the drawing device 10.

The processing unit 11 has one or more processors and peripheral circuits. The processing unit 11 controls each hardware component of the drawing device 10 and performs various processes according to a predetermined program stored in the storage unit 12 in advance, and stores the data generated during the process for temporarily storing the data. Part 12 is used.

The storage unit 12 may have a semiconductor memory such as a random access memory (RAM) or a read-only memory (ROM), or a non-volatile memory such as a magnetic disk or a flash memory. Further, the storage unit 12 may be connected to a drive capable of reading a storage medium for storing a predetermined program. In addition, the storage unit 12 has a graphic memory 12a for storing display information to be displayed on the display device 30.

The display unit 13 is controlled by the processing unit 11 and can display various types of information. As the display unit 13, for example, a liquid crystal display can be used. The drawing device 10 does not have to have the display unit 13.

The operation unit 14 is operated by the administrator of the system 1 and can input operation information. The drawing device 10 does not have to have the operation unit 14.

The communication unit 15 communicates with the control device 20 and the display device 30.

The drawing device 10 can be formed by using, for example, a computer having a graphics processing unit (GPU), a state machine, or the like.

FIG. 2 is a diagram showing an image generated by the system.

The image shown in FIG. 2 shows a simulated image of a platform of a railway station, and includes a figure of a railroad vehicle, a figure of the platform, and a large number of figures. The railroad car figure and the platform figure are drawn as three-dimensional figures. The human figure includes a figure drawn as a three-dimensional figure and a figure drawn as a two-dimensional figure. The three-dimensional figure is formed by a plurality of polygons, and the two-dimensional figure is formed by embedding a predetermined texture inside the contour.

In the system 1, a person figure having a small size displayed in the image, which is arranged in the back of the simulated image, is drawn as a two-dimensional figure, so that the processing capacity for drawing the image is suppressed and a natural image is obtained. Draw the shape that gives.

Hereinafter, the operation of the system 1 will be further described below.

The drawing device 10 generates a three-dimensional figure such as a person figure based on the figure information for drawing the three-dimensional figure. In the system 1, all graphic information such as a human figure to be drawn is stored in the storage unit 12 of the drawing device 10. The graphic information may be input from the control device 20 together with the drawing command, or the graphic information of a predetermined graphic such as a person graphic that is frequently drawn is stored in the storage unit 12 of the drawing device 10. You may do so.

The graphic information includes, for example, the coordinates of each vertex for generating each polygon forming a three-dimensional graphic, the function of each side, and the texture information.

The drawing device 10 may generate display information for displaying a three-dimensional figure such as a person figure on the display device 30 for each drawing command from the control device 20, but the system 1 has a high frequency of drawing. With respect to a predetermined figure such as a person figure, three-dimensional display information for displaying as a three-dimensional figure at a reference position is generated in advance. With respect to the graphic in which these three-dimensional display information is generated in advance, a predetermined calculation is performed for each input of a drawing command from the control device 20 based on the three-dimensional display information at the reference position generated in advance. By requesting the display information to be written in the graphic memory 12a, the drawing of the three-dimensional figure can be performed quickly.

As the three-dimensional display information for displaying the three-dimensional figure at the reference position, the three-dimensional display information is generated with a height of 180 cm for the person figure. The dimensions of the three-dimensional display information of the person figure are adjusted based on the perspective relationship depending on the position where the person figure is arranged according to the drawing command from the control device 20, and the display information for writing to the graphic memory 12a is obtained by calculation. ..

Further, the drawing device 10 generates two-dimensional display information for displaying a predetermined figure such as a person figure that is frequently drawn as a two-dimensional figure at a reference position based on the three-dimensional display information. Is done in advance. With respect to the figure in which these two-dimensional display information is generated in advance, a predetermined calculation is performed for each input of a drawing command from the control device 20 based on the two-dimensional display information at the reference position generated in advance. By requesting the display information for writing to the graphic memory 12a, the two-dimensional figure can be drawn quickly.

Next, the process in which the drawing apparatus 10 generates the three-dimensional display information at the reference position and the two-dimensional display information at the reference position based on the three-dimensional display information will be described below with reference to the flowchart shown in FIG.

First, in step S301, the processing unit 11 of the drawing device 10 displays the person figure as a three-dimensional figure at a reference position based on the figure information for drawing the three-dimensional figure. Generate information.

A human figure is formed by a plurality of polygons. Each polygon is generated based on graphic information and has a predetermined shape and texture.

The drawing device 10 generates three-dimensional display information of a human figure having three postures, a stationary posture, a walking posture, and a running posture, as a human figure that is frequently drawn.

The drawing device 10 generates three-dimensional display information of a person figure in a state of facing a plurality of different directions with respect to a stationary posture. Further, the drawing device 10 generates three-dimensional display information of a person figure in a plurality of different walking states in each of the states facing different directions with respect to the walking posture. Similarly, the drawing device 10 generates three-dimensional display information of a person figure in a plurality of different traveling states in each of a state in which the drawing device 10 faces a plurality of different directions with respect to the traveling posture. The drawing device 10 generates three-dimensional display information of a plurality of different directions, a plurality of different walking states, and a plurality of different running states for all figures that may be instructed as drawing commands from the control device 20. To do.

The generated three-dimensional display information of the person figure at the reference position of each posture is stored in the storage unit 12.

Next, in step S302, the processing unit 11 of the drawing apparatus 10 generates two-dimensional display information for displaying the person figure as a two-dimensional figure at the reference position based on the generated three-dimensional display information.

Here, the two-dimensional display information is generated for a representative state of the three-dimensional display information of the person figure generated in step S301.

For the stationary posture, the processing unit 11 of the drawing device 10 generates, for example, two-dimensional display information of a person figure in a state of facing eight directions, as shown in FIG. 4A. Further, in each direction, a predetermined number of frames of stationary human figures having different time series are generated. The processing unit 11 obtains the contour of the two-dimensional figure at the reference position based on the two-dimensional display information of the figure of a person in a stationary posture, and embeds a predetermined texture inside the contour to be stationary. Generates two-dimensional display information of posture. A predetermined number of different rest states are specified by the frame number and direction of the rest posture.

As shown in FIG. 4B, the processing unit 11 of the drawing device 10 generates three-dimensional display information of a predetermined number of different walking state human figures with respect to the walking posture. As the walking state of the generated two-dimensional display information, a person with a large amount of change in the human figure is selected. The processing unit 11 obtains the contour of the two-dimensional figure at the reference position based on the three-dimensional display information of the person figure in the walking posture, and embeds a predetermined texture inside the contour to walk. Generates two-dimensional display information of a person figure in a posture. A predetermined number of different walking states are specified by the frame number and direction of the walking posture.

Similarly, the processing unit 11 of the drawing device 10 generates three-dimensional display information of a predetermined number of different human figures in the traveling state with respect to the traveling posture, as shown in FIG. 4C. As the running state of the generated three-dimensional display information, one having a large amount of change in the human figure is selected. The processing unit 11 obtains the contour of the two-dimensional figure at the reference position based on the three-dimensional display information of the person figure in the running posture, and embeds a predetermined texture inside the contour to run the figure. Generates two-dimensional display information of a person figure in a posture. A predetermined number of different running states are specified by the frame number and direction of the running posture.

The two-dimensional display information of the person figure at the reference position of each posture generated is stored in the storage unit 12.

Next, the operation of the drawing apparatus 10 to generate an image based on the drawing command will be described below with reference to the flowchart shown in FIG.

First, in step S501, the drawing device 10 receives a drawing command of a figure to be drawn for each frame from the control device 20. Here, it is assumed that the control device 20 instructs the drawing device 10 as a drawing command to draw the three human figures shown in FIG. 6A. The drawing command includes a position in the three-dimensional space for drawing the person figure, and the posture, frame number, and direction of the person figure.

In the example shown in FIG. 6A, the drawing commands are the posture, frame number, and direction of the person figure, that is, the person figure F1 in the predetermined direction of the third frame of the walking posture and the stationary posture. It includes a person figure F2 in a predetermined direction in the fifth frame and a person figure F3 in a predetermined direction in the seventh frame in a traveling posture. The drawing command may also include a command for drawing another figure.

Next, in step S502, the processing unit 11 of the drawing apparatus 10 determines whether to display each person figure as a three-dimensional figure or as a two-dimensional figure.

The process of step S502 will be described below with reference to the flowchart shown in FIG. 7.

First, in step S701, the processing unit 11 of the drawing device 10 draws each person figure to be drawn as a two-dimensional figure on a predetermined memory area based on the two-dimensional display information at the reference position.

The processing unit 11 receives from the storage unit 12 the two-dimensional display information at the reference position of the person figure that best matches the drawing command in response to the drawing command for drawing the person figure F1 in the third frame of the walking posture. read out. This is because the number of two-dimensional display information at the reference position generated in advance does not correspond to all drawing commands. Then, the processing unit 11 calculates the dimensions when the person figure F1 is arranged at the position in the three-dimensional space to be drawn based on the two-dimensional display information at the read reference position, and writes the figure F1 to the memory. Generates dimensional display information. Here, it is preferable that the two-dimensional display information has only the contour information of the two-dimensional figure and does not have the texture information from the viewpoint of improving the processing speed. As will be described later, this process is for obtaining the number of pixels used when the person figure F1 is displayed as a two-dimensional figure, and it is sufficient if the outline can be drawn. Therefore, the processing unit 11 generates two-dimensional display information for displaying only the outline of the person figure F1. This also applies to the processing for the person figures F2 and F3.

Further, the processing unit 11 reads from the storage unit 12 the two-dimensional display information at the reference position that most closely matches the drawing command in response to the drawing command for drawing the person figure F2 in the fifth frame in the stationary posture. Then, the dimensions when the figure F2 is arranged at the position in the three-dimensional space for drawing are calculated to generate the two-dimensional display information to be written in the memory.

Further, the processing unit 11 reads from the storage unit 12 the two-dimensional display information at the reference position that most closely matches the drawing command in response to the drawing command for drawing the person figure F3 in the seventh frame of the traveling posture. Then, the dimensions when the figure F3 is arranged at the position in the three-dimensional space for drawing are calculated to generate the two-dimensional display information to be written in the memory.

Then, the processing unit 11 performs a predetermined operation such as concealment processing on the three two-dimensional display information for writing to the generated memory as described above, and then writes the two-dimensional figure in the memory. Draw as the outline of.

FIG. 6B is a diagram showing a state in which a two-dimensional figure of each person is drawn on the memory.

The region D1 representing the contour corresponding to the human figure F1 is located in the foreground and has a large dimension. Next, the area D2 representing the contour corresponding to the person figure F2 has a large dimension, and the area D3 representing the contour corresponding to the person figure F3 has the smallest dimension.

Next, in step S702, the processing unit 11 obtains the number of pixels used when the person figures F1 to F3 are displayed as two-dimensional figures based on the dimensions of the areas D1 to D3.

FIG. 6C is a diagram for explaining how to obtain the number of pixels of each two-dimensional figure.

The processing unit 11 obtains the number of pixels included in the outline of each region D1 to D3. These number of pixels are the number of pixels used when each person figure F1 to F3 is displayed as a two-dimensional figure. In FIG. 6C, the label “1” is arranged for the pixels included in the area D1. Similarly, the label "2" is placed on the pixels contained inside the area D2, and the label "3" is placed on the pixels contained inside the area D3. The processing unit 11 obtains the number of pixels in which the label "1" is arranged, and sets the number of pixels to be used when the person figure F1 is displayed as a two-dimensional figure. Similarly, the processing unit 11 obtains the number of pixels in which the label "2" is arranged, sets the number of pixels used when the person figure F2 is displayed as a two-dimensional figure, and arranges the label "3". The number of pixels is calculated and used as the number of pixels used when the person figure F3 is displayed as a two-dimensional figure.

Next, in step S703, when the number of pixels in each area D1 to D3 is equal to or greater than a predetermined threshold value Th, the processing unit 11 determines that the corresponding person figures F1 to F3 are displayed as three-dimensional figures, and each area. When the number of pixels of D1 to D3 is smaller than the predetermined threshold value Th, it is determined that the corresponding person figures F1 to F3 are displayed as two-dimensional figures.

In the example shown in FIG. 6C, it is determined that the person figure F1 corresponding to the area D1 is displayed as a three-dimensional figure, and the person figures F2 and F3 corresponding to the areas D2 and D3 are displayed as two-dimensional figures. It was decided to do.

The predetermined threshold value Th is preferably set as appropriate based on the processing speed of the drawing device 10 or the content of the drawing command (number of figures, etc.) input from the control device 20.

Then, the process proceeds to step S503.

Next, in step S503, the processing unit 11 generates display information of each person figure F1 to F3 and writes it in the graphic memory 12a. Specifically, the processing unit 11 draws the person figure F1 with respect to the person figure F1 in the three-dimensional space based on the three-dimensional display information at the reference position of the person figure F1 generated in advance. The dimensions when arranged at the position are calculated to generate three-dimensional display information for writing to the graphic memory 12a.

Further, the processing unit 11 arranges the person figure F2 at a position in the three-dimensional space for drawing the person figure F2 based on the two-dimensional display information at the reference position of the person figure F2 generated in advance. The two-dimensional display information for writing to the graphic memory 12a is generated by calculating the dimensions in the case of.

Similarly, the processing unit 11 positions the person figure F3 at a position in the three-dimensional space for drawing the person figure F3 based on the two-dimensional display information at the reference position of the person figure F3 generated in advance. Two-dimensional display information for writing to the graphic memory 12a is generated by calculating the dimensions when arranged.

Then, the processing unit 11 performs a predetermined calculation such as concealment processing on the three-dimensional display information and the two-dimensional display information of the three person figures F1 for writing to the graphic memory 12a generated as described above. After that, it is written to the graphic memory 12a and an image as one frame is drawn.

Next, in step S504, the processing unit 11 outputs the display information of the graphic memory 12a to the display device 30 to display an image.

The process of determining step S502 described above is performed frame by frame. Therefore, a person figure that was displayed as a three-dimensional figure in the previous frame may be displayed as a two-dimensional figure in the next frame. Similarly, a person figure that was displayed as a two-dimensional figure in the previous frame may be displayed as a three-dimensional figure in the next frame.

Here, since the number of pixels used for drawing a person figure displayed as a two-dimensional figure is small, even if a change occurs between the two-dimensional display and the three-dimensional display, the influence on the entire image is affected. small.

The drawing device 10 repeats each of the above-described processes S501 to S504 when there is a drawing command for the next frame from the control device 20.

According to the system 1 of the present embodiment described above, it is possible to obtain a natural image while suppressing the processing capacity for drawing an image including a three-dimensional figure.

In the present invention, the method and drawing device for drawing the figure of the above-described embodiment can be appropriately changed as long as the gist of the present invention is not deviated.

For example, in the above-described embodiment, the decision to display as a three-dimensional figure or a two-dimensional figure is made for a person figure, but the decision to display as a three-dimensional figure or a two-dimensional figure is drawn in the image. It is applicable to some or all of the figures.

Further, in the above-described embodiment, the processing unit realizes the process of generating an image by executing the program, but the operation of the processing unit may be realized by using hardware such as an electronic circuit. Good.

The drawing device described above is preferably used by being incorporated in a simulator. For example, a simulator such as a railway simulator including a simulated field of view display device having an image generation unit including the above-mentioned drawing device and a display unit for displaying an image generated by the image generation unit can be mentioned.

1 System 10 Drawing device 11 Processing unit 12 Storage unit 12a Graphic memory 13 Display unit 14 Operation unit 15 Communication unit

Claims (4)

Generates 3D display information for displaying as a 3D figure for a 3D figure of a person in a reference posture including a stationary posture, a walking posture, and a running posture. Based on the three-dimensional display information, two-dimensional display information for displaying a three-dimensional figure of a person as a two-dimensional figure is generated.
Select the two-dimensional display information in the reference posture that most closely matches the posture of the person included in the drawing command.
Based on the selected two-dimensional display information, the number of pixels used when the three-dimensional figure of a person is displayed as a two-dimensional figure is obtained.
When the number of pixels is equal to or greater than a predetermined threshold value, the person included in the drawing command is displayed as a three-dimensional figure based on the three-dimensional display information .
When the number of pixels is smaller than the predetermined threshold value, based on the two-dimensional display information, a method of displaying a person included in the drawing command as a two-dimensional figure. Based on the selected two-dimensional display information, the number of pixels included inside the contour when the person included in the drawing command is displayed as a two-dimensional figure is displayed as a two-dimensional figure of the person. The method according to claim 1 , wherein the number of pixels used at the time is obtained. Generates 3D display information for displaying as a 3D figure for a 3D figure of a person in a reference posture including a stationary posture, a walking posture, and a running posture. Based on the three-dimensional display information, two-dimensional display information for displaying a three-dimensional figure of a person as a two-dimensional figure is generated.
Select the two-dimensional display information in the reference posture that most closely matches the posture of the person included in the drawing command.
Based on the selected two-dimensional display information, the number of pixels used when the three-dimensional figure of a person is displayed as a two-dimensional figure is obtained.
When the number of pixels is equal to or greater than a predetermined threshold value, display information for displaying a person included in the drawing command as a three-dimensional figure is generated based on the three-dimensional display information .
When the number of pixels is smaller than the predetermined threshold value, based on the two-dimensional display information, the drawing generates display information for displaying a two-dimensional figure of the person included in the instruction processing unit drawing apparatus comprising a. Generates 3D display information for displaying as a 3D figure for a 3D figure of a person in a reference posture including a stationary posture, a walking posture, and a running posture. Based on the three-dimensional display information, two-dimensional display information for displaying a three-dimensional figure of a person as a two-dimensional figure is generated.
Select the two-dimensional display information in the reference posture that most closely matches the posture of the person included in the drawing command.
Based on the selected two-dimensional display information, the number of pixels used when the three-dimensional figure of a person is displayed as a two-dimensional figure is obtained.
When the number of pixels is equal to or greater than a predetermined threshold value, display information for displaying a person included in the drawing command as a three-dimensional figure is generated based on the three-dimensional display information .
When the number of pixels is smaller than the predetermined threshold value, based on the two-dimensional display information, the drawing generates display information for displaying a two-dimensional figure of the person included in the instruction, the image generation unit comprises a processing unit When,
A display unit that displays the display information generated by the image generation unit as an image , and
Simulator with.