JP3520592B2 - Video camera imaging device - Google Patents

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a video camera image pickup device suitable for use in, for example, evaluating the degree of perfection of a left and right eye independent image display type display device.

[0002]

2. Description of the Related Art A head mounted display (HMD) as a display device of left and right independent image display system
3D projector devices and the like are known. Such a display device is configured to produce a video or image that is actually visible to the human eye, so that, for example, virtual reality can be experienced.

[0003]

Conventionally, there has been no suitable means for objectively evaluating the degree of perfection of the display device of the left and right independent image display system. In the conventional method, the evaluation is judged by verbally asking each individual their impressions or by having them answer a questionnaire. In such a method, there is a lot of room for the subjective element of the individual, and it is difficult to feed it back to the design.

The function or performance of the human eye varies with each individual or condition. For example, the accommodation power of eyes, the visual acuity, the distance of the eyes from the display, etc. vary depending on each individual or environment, and are not constant. Therefore, even if they are the same image or video, the images or videos actually seen by the human eye should be different.

In view of the above problems, an object of the present invention is to provide a video camera imaging device capable of reproducing what a predetermined image or image actually looks like to human eyes.

In view of the above problems, an object of the present invention is to provide a video camera image pickup device for objectively evaluating the degree of perfection of a display device of the left and right eye independent image display system.

[0007]

According to the present invention, for example, as shown in FIGS. 1, 2 and 3 , a pair of video cameras for the left and right eyes and a video signal of the video cameras are input to perform image processing. and a monitoring device which inputs a video signal from the image recognition apparatus and the image recognition device for displaying it, human
Obtained visually when the object is viewed or actually
An imitation image of the image is displayed on the monitor, and
By moving your video camera to the desired position
It is characterized in that it imitates human's gaze motion .

[0008]

According to the present invention, in the video camera image pickup device, the gaze action includes an eye movement and a head movement.

According to the present invention, in the video camera image pickup device, it is possible to imitate a human visual function by image processing by the image recognition device or focus adjustment of the video camera. .

According to the present invention, in the video camera image pickup device, the human visual function includes the function of the retina.

According to the present invention, in the video camera imaging device, the human visual function includes a focus adjusting function of the crystalline lens of the eye.

According to the present invention, in the video camera image pickup device, the human visual function includes a myopic function, a farsighted function and a presbyopia function.

According to the present invention, in the video camera image pickup device, the human visual function includes a low vision function and an astigmatic function.

[0015]

According to the present invention, in a video camera image pickup device, light from a plurality of projectors is divided into a plurality of lights.
Of the screen via the deflection filter and half mirror
The left and right eye independent image display method designed to project to the back side
Caused by multiple parts of the above optical system of the display device
Detects error or assembly error of multiple parts of the above optical system
Characterized by being adapted to.

According to the invention, for example, FIGS. 1, 2 and
As shown in FIG. 10 , a pair of left and right eye video cameras and
Image recognition that processes image by inputting video signal from video camera
The video signal from the recognition device and the image recognition device
And a monitor device that displays the
The imitation image of the image obtained visually or actually with the naked eye.
In addition to displaying on the monitor,
Image processing or focus adjustment of the above video camera
It is characterized by imitating human visual function.

[0018]

According to the present invention, the video camera image pickup device is constructed so as to be able to imitate the gaze action of a human. There are eye movements and head movements in human gaze movements.

(1) Eye movement Eye movement will be described with reference to FIG. FIG. 9A shows a state in which the human eyes 503L and 503R have the target object 501, and FIG. 9B shows images of the visual fields 504L and 504R at that time. When gazing at an object 501 with a human eye, the eye moves, and the image 501L by the left eye 503L has its visual field 504.
The image 501R moved to the center position of L and viewed by the right eye 503R
Moves to the center position of its visual field 504R. When the target object to be watched changes to another target object 502, similarly, the eyeball moves and the image 502L by the left eye 503L has its field of view 5.
Move to the center position of 04L and see the image 50 by the right eye 503R.
2R moves to the center position of its field of view 504R.

In such eye movement, a convergence / divergence movement that moves the viewpoint between a near object and a far object, an impulsive motion that randomly changes the object one after another, and a moving object are chased. There is a follow-up movement that moves the viewpoint.

(2) Head Movement It is said that the range in which a person can naturally gaze only by eye movement without head movement is 30 degrees in the horizontal direction and 20 degrees in the vertical direction. The gaze range expands considerably due to head movement.

According to the present invention, the video camera imaging device is configured to mimic human visual function. The human visual functions include the following. (1) Function of Retina The image that appears on the human retina is an image with little optical aberration in the central vision portion, but an image with large optical aberration in the surroundings.

(2) Focusing function of crystalline lens The focusing function of the crystalline lens of the human eye will be described with reference to FIG. 10A. The thickness of the lens 802 is adjusted so that the image of the object point 801 is formed at the point 804 on the retina. The focus adjustment power of the crystalline lens 802 changes depending on various factors such as the distance to the object point 801, the moving speed of the object point 801, the visual acuity of an individual, and the degree of eye fatigue. For example, if the eye fatigue increases,
The focus adjusting force of the crystalline lens 802 cannot follow the moving speed of the object point 801.

The graph of FIG. 11 shows the relationship between the focus adjustable range of the lens of the human eye and age. The length in the vertical direction of the shaded portion represents the range in which the lens can be adjusted in focus at that age, that is, the range of eye accommodation power. The range of accommodative power of the eye decreases with age. This is presbyopia. In the presbyopia, the eye accommodation power range 604 is narrower than the normal vision eye accommodation power range 601.

The range 602 of accommodation power of the myopic eye is biased to the plus (+) side from the range 601 of accommodation power of the normal vision eye, and the range 603 of accommodation power of the hyperopia eye is 603 of the normal vision eye. It is biased to the minus (-) side of the adjustment force range 601.

(3) Amblyopia function and astigmatism function Amblyopia is a phenomenon in which fine characters cannot be seen because the resolution is insufficient. Causes are diseases of the retina or optic nerve, abnormalities in visual information processing inside the brain, and the like. Astigmatism is a phenomenon in which optical aberration is asymmetric. Normal,
It looks like a low-pass filter in one direction. For example, when a pattern as shown in FIG. 11A is passed through a low-pass filter in the horizontal direction, an image as shown in FIG. 11B is obtained.

According to the present invention, the video camera imaging device detects errors and aberrations in order to objectively evaluate the degree of perfection of the left and right independent image display type display devices.
Such errors and aberrations are as follows.

(1) Assembly error The assembly error is detected by using a cross-shaped geometric figure as shown in FIG. 13A as a standard pattern. The assembly error includes a rotation error of the lens around the optical axis and an error other than that (referred to as a linear error here).

If there is only a rotation error, then FIG.
As shown in B, an image 701 of the left-eye video camera 31L
The image L and the image 701R of the right-eye video camera 31R appear to rotate relative to each other. If there is only a linear error,
As shown in FIG. 3C, the two images 702L and 702R are displaced from each other in the vertical and horizontal directions with respect to each other. When both the rotation error and the straight line error are present, as shown in FIG. 13C, the image 703L of the left-eye video camera 31L is laterally separated from the image 703R of the right-eye video camera 31R by a distance a in the vertical direction. Are separated by a distance b and are further rotated by a rotation angle θ.

(2) Optical aberration A geometrical figure having point symmetry as shown in FIG. 14A is used as a standard pattern. When there is distortion, FIG. 14B and FIG.
An image like C appears, and if there is spherical aberration, the image is blurred at the peripheral portion as shown in FIG. 14D. When there is chromatic aberration, one white line is red (R), green (G), and blue (B) as shown in FIG. 14E.
Appears as three lines.

[0031]

DESCRIPTION OF THE PREFERRED EMBODIMENTS An example of a video camera image pickup device according to the present invention will be described with reference to FIGS. This example is configured to evaluate the degree of perfection of a display device of a left and right independent image display system, particularly a stereoscopic projector. Therefore, FIG. 1 shows a video camera imaging device 30 according to the present invention.
And the stereoscopic projector device 10 are shown.

First, the three-dimensional projector device 10 will be described. The stereoscopic projector device 10 has a rear screen 11 and a projector device 12 arranged behind the screen 11. The projector device 12 includes two projectors 13L and 13R for the left and right eyes, deflection filters 14L and 14R arranged in front of the projectors 13L and 13R, and a half mirror 15.
The two projectors 13L, 13R have terminals 13a, 1
3b is connected, and the video signal is input from the terminals 13a and 13b.

Light from the two projectors 13L and 13R is projected on the back side of the screen 11 via the deflection filters 14L and 14R and the half mirror 15, respectively. A left-eye image 21L and a right-eye image 21R are generated on the screen 11. When such an image is viewed by a person wearing polarizing filter type glasses from the front side of the screen 11, a stereoscopic image 23 is seen in front of the screen 11.

Next, the video camera image pickup device 30 of this example will be described. The video camera imaging device 30 of the present example includes two video cameras 31L and 31R for the left and right eyes and two deflection filters 32 disposed in front of the video cameras 31L and 31R and having deflection directions different from each other by 90 degrees.
L, 32R, and such deflection filters 32L, 32
R has a function of deflection filter type glasses. Video signals from the video cameras 31L and 31R are output terminals 31a and 31
It is taken out from b.

The video cameras 31L and 31R are, for example,
It may be of a motorized focus type, each of which is a drive device 33.
It is mounted on L and 33R. Such a drive device 33
The L and 33R are configured so that the video cameras 31L and 31R can be arranged at desired positions. For example, the video cameras 31L and 31R can rotate in the vertical and horizontal directions and around a predetermined rotation axis. Thereby, the video cameras 31L and 31R are configured so as to imitate the gaze action of a human. Terminals 33a and 33b are connected to the driving devices 33L and 33R, and a command signal is supplied via the terminals 33a and 33b.

The configuration and operation of the video camera image pickup apparatus according to this embodiment will be described with reference to FIG. The video camera imaging device according to this example has an image recognition computer 41, and the image recognition computer 41 includes an instruction console 4
3, a keyboard 45 and a mouse 47 are connected.
Various commands can be input to the image recognition computer 41 from the keyboard 45 and the mouse 47.

The video camera image pickup apparatus of the present example further includes two monitors 51L and 51R for the left and right eyes which display images picked up by the two video cameras 31L and 31R and images picked up by the two video cameras 31L and 31R. And a monitor 52 for displaying a composite image of Monitor 5
2 has a function of combining two video signals and displaying them. The left and right eye monitors 51L and 51R are connected to two video cameras 31 via terminals 31a and 31b.
The L and 31R video signals are input respectively. The composite image monitor 52 inputs the video signals of the two video cameras 31L and 31R via the terminals 31a and 31b.

The video camera image pickup device further has two image processing monitors 53L and 53R for the left and right eyes for displaying images from the two video cameras 31L and 31R and performing image processing on the screen.

The left and right eye monitors 51L and 51R and the composite video monitor 52 may be replaced by one monitor, and the left and right eye image processing monitors 53L and 53 may be substituted.
R may be replaced by one monitor. Image processing monitors 53L, 53 for the left and right eyes as image processing monitors
In addition to R, a composite image monitor may be further provided.

The video camera image pickup apparatus of this example further includes a video camera drive control unit 61 and a stereoscopic image generation computer 6.
3 which are connected to the image recognition computer 41. The video camera drive control unit 61 has a terminal 33a,
A command signal is supplied to the driving devices 33L and 33R (FIG. 1) via 33b. As a result, the video camera 31L,
31R is arranged at a desired position. The stereoscopic image generation computer 63 inputs the signal from the image recognition computer 41 and generates a video signal for generating a stereoscopic image.

Next, the operation of the video camera image pickup apparatus of the present invention will be described. According to this example, it is configured to imitate the gazing motion and visual function of a human.

(1) Gaze operation The gaze operation will be described with reference to FIG. There are two types of human gaze movements, which are eye movements and head movements. According to the present example, such imitation of the gaze action may be performed manually or automatically. Here, the case of manual operation will be described. A cross cursor 56 is displayed on the image processing monitor 53R for the right eye, and the center 56A of the cross cursor 56 is moved to the gazing point on the object to be gazed next.
The cross cursor 56 is moved by the mouse 47.

When the gazing point for the right eye is set in this way,
Next, the image recognition computer 41 obtains the gazing point for the left eye. A rectangular frame-shaped designated range 57 is displayed on the image processing monitor 53L for the left eye, and the image recognition computer 41 moves the designated range 57 to obtain the next gazing point. For example, when the designated range 57 is first moved in the horizontal direction to obtain the horizontal position, it is then moved in the vertical direction to obtain the vertical position.

The detection of the horizontal position and the detection of the vertical position may be performed by, for example, obtaining a position where the degree of similarity of images within the designated range 57 is maximum. Within the designated range 57, if the difference between each element of the image of the right-eye image processing monitor 53R and the corresponding element of the image of the left-eye image processing monitor 53L is calculated, the position where it is the minimum is obtained. Good.

Thus, the image processing monitors 5 for the left and right eyes
When the gazing point is obtained by the 3L and 53R, the video cameras 31L and 31 are set so that the gazing point is located at the center of the screen.
Drive R. The command signal from the image recognition computer 41 passes through the video camera drive control unit 61 and the drive unit 3
It is supplied to 3L and 33R. As a result, the video cameras 31L and 31R move, and the gazing motion of a human being is imitated. Such a drive mechanism provides both eye movement and head movement. A specific example of the drive mechanism will be described later.

Although the case of manual operation has been described, the same applies to the case of automatic operation. In the case of performing automatically, the keyboard 45 is operated while looking at the instruction console 43, and the gaze position is adjusted by the mouse 47 to the image processing monitor 53L,
Set on the image of 53R. Hereinafter, the gaze operation is performed by the automatic instruction control system.

It is also possible to perform a simulation when changing the point of interest one after another by such an instruction control system. As a mode of change of the gazing point, when a near object or a distant object is viewed (convergence divergence motion), when the gazing point is moved to another object one after another (impulsive motion), a moving object There is a case where the gazing point is moved so as to chase (following movement).

(2) Function of the retina The image reflected on the human retina has a small optical aberration in the central vision portion, but a large optical aberration in the periphery thereof. In order to mimic such a function of the human retina, the image processing monitors 53L, 5L, 5
A low-pass filter is applied to the periphery of the 3R image. For example, the set frequency of the low pass filter is set to be lower from the center of the image toward the periphery. Such image processing is performed by the image recognition computer 41 and displayed by the image processing monitors 53L and 53R.

(3) Focus adjusting function of crystalline lens As shown in FIG. 10B, in order to mimic the focusing function of the crystalline lens 802, the distance between the imaging lens 803 and the imaging element 805 of the video cameras 31L and 31R is set. You can control it. For example, when the object point 801 approaches, the crystalline lens 8
02 becomes thicker, but video cameras 31L and 31R
Then, the distance between the imaging lens 803 and the imaging element 805 becomes large. On the contrary, when the object point 801 moves away, the thickness of the crystalline lens 802 becomes thin, but the video cameras 31L, 31
In R, the distance between the imaging lens 803 and the imaging element 805 becomes small. In this way, by controlling the left and right eye video cameras 31L and 31R by the image recognition computer 41, the focusing function of the crystalline lens of the human eye can be imitated.

In order to mimic the functions of myopia and hyperopia,
Video camera 31 by image recognition computer 41
It is only necessary to limit the focus adjustment range of L and 31R. As shown in FIG. 11, in the case of the myopia function, the focus adjustment range may be biased to the plus (+) side, and in the case of the hyperopia function, the focus adjustment range may be biased to the minus (−) side. Further, in the case of the presbyopia function, the focus adjustment range may be biased to the minus (-) side and narrowed.

(4) Amblyopia function and astigmatism function In order to imitate the amblyopia function of the human eye, after the image processing for imitating the above-mentioned function of the retina is performed, a low-pass filter is applied to the entire image. In order to imitate the astigmatic function, a low-pass filter is applied in one direction after performing the above-mentioned image processing for imitating the function of the retina. For example,
As shown in the example of FIG. 11, a low pass filter is applied in the horizontal direction.

According to this example, the perfection of the display device of the left and right independent image display system can be objectively evaluated. That is, according to this example, the error and the aberration in the display device of the left and right independent image display system can be detected.
There are a stereoscopic projector and a head mounted display as display devices of the left and right independent image display systems.

(1) Assembly error In order to detect an assembly error, a cross-shaped geometric figure as shown in FIG. 13A is used as a standard pattern. A synthetic image of a standard pattern is generated by the two video cameras 31L and 31R, and it is detected whether or not the synthetic image matches the ideal standard pattern generated by the image recognition computer 41. The difference between the two is the assembly error. Assembling errors include a rotation error around the optical axis of the lens and other errors (herein referred to as linear errors).

If there is only a rotation error, FIG.
As shown in B, an image 701 of the left-eye video camera 31L
The image L and the image 701R of the right-eye video camera 31R appear to rotate relative to each other. If there is only a linear error,
As shown in FIG. 3C, the two images 702L and 702R are displaced from each other in the vertical and horizontal directions with respect to each other. That is,
The image 702L of the left-eye video camera 31L is laterally spaced from the image 702R of the right-eye video camera 31R by a distance a and vertically by a distance b.

When both the rotation error and the straight line error are present, as shown in FIG. 13C, the left-eye video camera 3 is used.
The image 703L of 1L is the image 70 of the video camera 31R for the right eye.
It is separated from 3R by a distance a in the horizontal direction and a distance b in the vertical direction, and further rotates by a rotation angle θ.

As a method of detecting such a linear error and a rotation error, the distances a and b and the rotation angle θ are calculated by the image recognition computer 41 without actually moving the positions of the left and right eye video cameras 31L and 31R. How to do
Images 701R, 7 of the left and right eye video cameras 31L, 31R
There is a method in which the positions of the left and right eye video cameras 31L and 31R are actually moved until 01L, 702R, 702L, 703R, and 703L match, and the amount of movement is measured.

In the former method, the calculated error amount a,
It is necessary to adjust the positions of the optical components by b and θ. still,
Although the video cameras 31L and 31R are moved in the above description, the driving devices 33L and 33R may be moved instead of the video cameras 31L and 31R.

In these two methods, the error is obtained by using the shift between the images of the left and right eye video cameras 31L and 31R. However, the left and right eye video cameras 31L, 31
It is also possible to independently obtain the R assembly error. For example, the error is obtained by comparing the position of the image obtained by optical calculation with the image actually obtained by the video camera and detecting the shift between the two.

For example, in FIG. 13B, if the image 701R is the image to be obtained by the right-eye video camera 31R, the image 701L is the image actually obtained by the right-eye video camera 31R. It can be seen that the right-eye video camera 31R has a rotation error.

Next, referring to FIG. 1 again, an error in the distance between the left and right eye video cameras 31L and 31R and the screen 11 will be described. Left and right eye video camera 31L,
Assuming that the lens of the camera is adjusted so that the clearest image can be obtained as an image by 31R, the distance from the lens to the position of the screen 11 can be calculated. The difference between the theoretical distance thus obtained and the actual distance from the screen 11 to the lens of the video camera is the error.

Referring again to FIG. 4, left and right video cameras 31L and 31R and head mounted display 1
The error of the distance between 00 will be described. In the head mounted display 100, the screen is obtained as a virtual image of the liquid crystal displays 101L and 101R magnified by the lenses 103L and 103R.

The distance from the lenses of the left and right eye video cameras 31L and 31R to the virtual image is determined by the distance between the lenses 103L and 103R of the head mounted display 100 and the liquid crystal displays 101L and 101R.
It can be calculated. Accordingly, the left and right eye video cameras 31L and 31R generate virtual screen images, and the left and right eye video cameras 31L and 31R
The error is determined by detecting the distance from R to the image on such a screen and comparing it with the calculated distance. That is, the error in the distance from the left / right eye video cameras 31L, 31R to the lenses 103L, 103R and the left / right eye video cameras 31L, 31R to the liquid crystal display 10
It is possible to detect an error in the distance to 1L and 101R.

(2) Optical Aberration In order to detect various aberrations of a lens, a geometrical figure of point symmetry as shown in FIG. 14A is used as a standard pattern. Two
A synthetic image of a standard pattern is generated by one of the video cameras 31L and 31R, and the synthetic image is compared with the ideal standard pattern generated by the image recognition computer 41. If there is distortion aberration, the image becomes as shown in FIGS. 14B and 14C, and if there is spherical aberration, as shown in FIG. 14D, the peripheral portion is blurred. If there is chromatic aberration, as shown in FIG.
The white line of the book appears as three lines of red (R), green (G), and blue (B).

The configuration and operation of the drive unit of the video camera image pickup apparatus 30 of this embodiment will be described with reference to FIG. The drive device of this example is provided with a mechanism that imitates the human eye movement. Here, a case where the video camera imaging device 30 according to the present invention is applied to the head mounted display 100 will be described. The head mounted display 100 is a liquid crystal display 101L for left and right eyes,
101R and convex lenses 103L and 103R for the left and right eyes.

The images on the liquid crystal displays 101L and 101R are viewed by the human eye through the convex lenses 103L and 103R, respectively, and a stereoscopic image is obtained. In this example, the left and right binocular video cameras 31L and 31R are arranged adjacent to the convex lenses 103L and 103R of the head mounted display 100.

The video cameras 31L and 31R can be rotated around the vertical rotation shafts 112L and 112R by the first step motors 111L and 111R, respectively.
The first step motors 111L and 111R are supported by motor supporting first fittings 113L and 113R, respectively. The first metal fittings 113L and 113R can be rotated around the horizontal rotation shafts 115L and 115R by the second step motors 114L and 114R, respectively. The second step motors 114L and 114R are respectively second motor mounting metal fittings 116L and 116R.
Supported by.

The second metal fitting 116L on the left side is attached to the fixed base 131L on the left side, and the second metal fitting 116R on the right side.
Is fixed to the moving table 121.

A metal fitting 123L for supporting a ball screw is mounted on the moving base 121, and a female screw 125A is supported by the metal fitting 123L. Right fixed base 13
The third metal fitting 12 for supporting the motor is provided at a position corresponding to 1R.
4 is mounted, and the third step motor 126 is supported by the third metal fitting 124. The rotation shaft of the third step motor 126 has a ball screw 125B.
Is attached, and such a ball screw 125B is a female screw 1
25A is engaged.

Between the fixed bases 131L and 131R on both sides, parallel and horizontal slide shafts 133 and 133 are arranged so as to connect them, and the slide shafts 133 and 133 penetrate the movable base 121. is doing. The movable base 121 can slide along the slide shafts 133 and 133 between the fixed bases 131L and 131R on both sides. When the third step motor 126 is actuated, the ball screw 125B rotates with respect to the internal screw 125A, so that the moving base 121 moves the slide shaft 133,
Move along 133.

The video cameras 31L and 31R rotate around vertical rotation shafts 112L and 112R by the first step motors 111L and 111R, respectively, and rotate around horizontal rotation shafts 115L and 115R by the second step motors 114L and 114R, respectively. And the horizontal slide shafts 133, 13 are rotated by the third step motor 126.
Move linearly along 3.

First, second and third step motors 11
1L, 111R 114L, 114R, 126 are shown in FIG.
It is driven by the command signal from the video camera drive control unit 61 shown in FIG. 1, and thereby the eye movement of the human eye is imitated.

Next, the head mounted display 10
A mechanism for supporting 0 will be described. As shown in FIG. 4, L-shaped members 135L and 135R are attached to the two fixed bases 131L and 131R, respectively. Each such L-shaped member 135L, 135R has a pair of screws 136L,
136R is installed.

FIG. 5 shows a head mounted display 1
00 shows the details of the mounting part, FIG. 5A shows the front configuration, and FIG. 5B shows the plan configuration. A recess 137 is formed on the side surface of the head mounted display 100, and the screws 136L and 136R are provided in the recesses 137 and 1R.
37 is configured to engage. In this manner, the head mounted display 100 is supported by the tips of the screws 136L and 136R engaging with the recesses 137 and 137 of the head mounted display 100.

With reference to FIG. 6, the structure and operation of another example of the driving device of the video camera image pickup device 30 of this example will be described. 6A shows a side structure, FIG. 6B shows a plane structure, and FIG. 6C shows a front structure.

In this example, the two video cameras 31L and 31R for the left and right eyes are rotatable in the directions of the arrows 201A and 201B (FIG. 6A), that is, the upper and lower turntables 201L and 201R which are rotatable about the horizontal rotation axis. And arrow 202A,
Horizontal turntables 202L and 202R rotatable in the direction 202B (FIG. 6B), that is, rotatable around a vertical rotation axis.
And a camera axis direction turntable 203 that is rotatable in the directions of arrows 203A and 203B (FIG. 6C), that is, rotatable about a rotation axis parallel to the optical axes of the video cameras 31L and 31R.
L, 203R.

Thus, the video cameras 31L and 31R
Can rotate about three axes: a horizontal rotation axis, a vertical rotation axis, and a rotation axis parallel to the optical axis. In this example, the video cameras 31L and 31R may be configured to manually rotate around the three axes. The focus can be adjusted by rotating the piston rings 205L and 205R attached to the video cameras 31L and 31R, and the focus position can be grasped.

With reference to FIGS. 7 and 8, the structure and operation of the control device of the video camera image pickup device of this embodiment will be described. FIG. 7A shows a side structure, and FIG. 7B shows a plane structure. The control device of this example is provided with a mechanism that imitates a human head movement.

The control device of this example is a video camera 31L,
31R and its drive unit (generally denoted by reference numeral 300) for supporting a first table 301 and the first table 30.
The lower second table 303 that supports the first table 1, the lower third table 305 that supports the second table 303, and the lowermost fourth table that supports the third table 305. And a stand 307.

The video cameras 31L and 31R supported by the first table 301 and the entire driving device 300 thereof may have the same structure as that shown in FIG. 4, for example. However, in FIG. 7, the head mounted display 100, the supports 135R and 135L, and the adjustment screws 136R and 136L are omitted.

The first table 301 is rotatably supported in the direction of the arrow 311; that is, about the first rotation axis perpendicular to the second table 303 below the first table 301, and the second table 303 is indicated by the arrow 31.
It is rotatably supported in three directions, that is, about a substantially horizontal second rotation axis arranged along the surface of the third table 305 below the third table 305. That is, it is rotatably supported around a substantially horizontal third rotation axis arranged along the surface of the lowermost fourth table 307.

The first axis of rotation and the second axis of rotation are at a right angle to each other, and the second axis of rotation and the third axis of rotation are at a right angle to each other. In this way, the video camera 31 is configured to be rotatable about the three rotation axes.

On the second table 303, a step motor 321 supported by a first metal member 321A for supporting a motor is provided at a substantially central portion. The step motor 321 has a rotary shaft 312 having a first rotary axis as a central axis, and an upper end portion of the rotary shaft 312 is connected to the first table 301. A plurality of wheels, for example, two wheels 322 are provided around the second table 303.
A, 322B are provided, and such wheels 322A, 322 are provided.
The first table 301 is configured to rotate on B. Thus, the video camera 31L and the first base 301
Since the weight of is carried by the two wheels 322A and 322B, the load in the thrust direction of the rotary shaft 312 of the step motor 321 is reduced.

A first rotary hinge 331 arranged along the diametrical direction is provided on the third table 305, and the rotary hinge 331 has a rotary shaft 314 having a second rotary axis as a central axis. Have.

As shown in FIG. 8, a metal fitting 335 for supporting a ball screw is attached to the peripheral portion of the second table 303, and the first ball screw (female screw) 334A is attached by the metal fitting 335. It is supported. Third platform 305
Further, a second metal fitting 333 for supporting the motor is further provided on the above position, and the second step motor 332 is supported by the metal fitting 333. A male screw 334B is attached to the rotary shaft of the second step motor 332.
Is formed, and the male screw 334B is engaged with the first ball screw (female screw) 334A.

When the second step motor 332 is driven, the male screw 334B of the rotary shaft rotates, whereby the first step motor 332 rotates.
Of the ball screw (female screw) 334A moves along the male screw 334B, and the second base 303 rotates about the second rotation axis with respect to the third base 305.

Similarly, the second rotary hinge 341 is mounted on the fourth table 307, and the structure shown in FIG. 8 is provided between the third table 305 and the fourth table 307. Therefore, the third table 305 can rotate about the third rotation axis 316.

Thus, the three stands 301, 303, 30
5 is configured to rotate in the directions of arrows 311, 313, and 315 about rotation axes 312, 314, and 416, respectively, whereby the video camera 31 is configured to imitate human eye movement and head movement. Has been done.

In the above example, the left to which the present invention is applied
The stereoscopic project and head-mounted display were shown as the display device of the right-eye independent image display system, but the display of the left-right independent image display system of other types such as holography and lenticular type stereoscopic display was shown.
Of course, the present invention can be applied to a ray device .

The present invention may also be applied when a person views a flat display such as a CRT or a liquid crystal television as an object.

Although the embodiments of the present invention have been described in detail above, those skilled in the art will understand that the present invention is not limited to the above-mentioned embodiments and various other configurations can be adopted without departing from the gist of the present invention. Easy to understand.

[0091]

According to the present invention, since the video camera of the video camera image pickup device is configured to imitate a human gaze movement, for example, eye movement and head movement, a predetermined image or image is actually displayed. It has the advantage of being able to predict what it will look like to the human eye.

According to the present invention, the image recognition computer 41 of the video camera image pickup device or the focus adjustment of the video camera.
Since the nodes are configured to mimic the human visual function, for example, the function of the retina, the function of myopia and hyperopia and the function of presbyopia, the function of amblyopia and astigmatism. There is an advantage in being able to predict what it will look like.

According to the present invention, the video camera imaging device is configured to mimic the gaze and visual function of a human being,
There is an advantage that it is possible to predict how an image generated by the display device of the left and right independent image display system actually looks to human eyes.

According to the video camera imaging device of the present invention,
Since it is possible to predict how the image generated by the display device of the left and right independent image display system actually looks to human eyes, it is possible to obtain a guideline for designing and improving such a display device. There are advantages.

According to the present invention, the image recognition computer 41 of the video camera image pickup device is constructed so as to be able to detect an assembly error, a rotation error and an optical aberration in the left and right independent image display type display device. , There is an advantage that the perfection of the display device of the left and right independent image display system can be evaluated and contributed to the improvement of hardware and software.

According to the present invention, it is possible to predict what a given image or image actually looks like to the human eye, thus providing a quantitative and direct judgment material in the study of visual engineering. There is an advantage that can provide a visual model for.

[Brief description of drawings]

FIG. 1 is a diagram showing an example in which a video camera imaging device according to the present invention is applied to a display device of a left and right independent image display system.

FIG. 2 is a diagram showing an example in which the video camera imaging device according to the present invention is applied to a display device of a left and right independent image display system.

FIG. 3 is an explanatory diagram for explaining an example of image processing in the video camera imaging device of the present invention.

FIG. 4 is a diagram showing an example of a video camera driving device in the video camera imaging device of the present invention.

5 is an explanatory diagram for explaining a mounting portion of the head mounted display in the example of FIG.

FIG. 6 is a diagram showing another example of a video camera driving device in the video camera imaging device of the present invention.

FIG. 7 is a diagram showing a video camera control device in the video camera imaging device of the present invention.

8 is a diagram showing a part of details of the example of FIG. 7. FIG.

FIG. 9 is an explanatory diagram for explaining an eye movement of a human eye.

FIG. 10 is an explanatory diagram for comparing the focus adjusting function of the crystalline lens of the eye and the focus adjusting function of the video camera.

FIG. 11 is an explanatory diagram for explaining myopia, hyperopia and presbyopia.

FIG. 12 is an explanatory diagram for explaining an astigmatic function.

FIG. 13 is a diagram showing an example of a cross-shaped standard pattern used for detecting an assembly error.

FIG. 14 is a diagram showing an example of a standard pattern composed of point-symmetrical figures used for detecting optical aberration.

[Explanation of symbols]

10 3D projector device 11 screens 12 Projector device 13L, 13R projector 13a, 13b terminals 14L, 14R deflection filter 15 Half mirror 21L, 21R video 23 three-dimensional image 30 Video camera imaging device 31L, 31R video camera 31a, 31b terminals 32L, 32R deflection filter 33L, 33R drive 33a, 33b terminals 41 Image recognition computer 43 Instruction console 45 keyboard 47 mice 51L, 51R Left and right eye monitors 52 Composite image monitor 53L, 53R image processing monitor 56 cross cursor 61 Video camera drive controller 63 3D image generation computer 100 head mounted display 101L, 101R liquid crystal display 103L, 103R convex lens 111L, 111R First step motor 112L, 112R rotating shaft 113L, 113R First metal fitting 114L, 114R Second step motor 115L, 115R rotating shaft 116L, 116R Second metal fitting 121 Mobile platform 123L metal fittings 123R 124 Third bracket 125 ball screw 126 Third Step Motor 131L, 131R fixed base 133 slide shaft 135 L-shaped member 136L, 136R screw 137 recess 201L, 201R turntable 201A, 201B rotation direction 202L, 202R turntable 202A, 202B rotation direction 203L, 203R turntable 203A, 203B rotation direction 205L, 205R piston ring 301, 303, 305, 307 units 301a broken line 311, 313, 315 Rotational direction 312, 314, 316 rotating shaft 321 First Step Motor 322A, 322B wheels 331 First rotating hinge 332 Second step motor 333 First metal fitting 334A First Ball Screw 334B male screw 335 Second bracket 341 Second rotation hinge 342 Third step motor 343 Third bracket 344A Second ball screw 344B male screw 345 4th metal fittings 501 object 501L, 501R image 502 object 502L, 502R image 503L left eye 503R right eye 504L, 504R field of view 701 standard pattern 801 Object 802 crystalline lens 803 Imaging lens 804 Image point 805 Imaging element

─────────────────────────────────────────────────── ─── Continued Front Page (58) Fields surveyed (Int.Cl. ⁷ , DB name) G03B 35/00-37/06 H04N 13/00

Claims (9)

(57) [Claims] 1. A pair of video cameras for the left and right eyes, an image recognition device for inputting video signals from the video cameras and performing image processing, and a monitor device for inputting video signals from the image recognition device and displaying them. Have a visual effect when a human sees an object or actually
A simulated image of the displayed image is displayed on the monitor and
To move the pair of video cameras to the desired position
Therefore , the video camera imaging device is characterized by imitating a human's gaze motion . 2. The video camera image pickup device according to claim 1, wherein the gaze motion includes eye movement and head movement . 3. The video camera imaging device according to claim 1, wherein the image processing in the image recognition device or the video camera is performed.
A video camera image pickup device characterized by being configured to imitate human visual function by adjusting the focus of the camera. 4. The video camera imaging device according to claim 3, wherein the human visual function includes a function of a retina . 5. The video camera image pickup device according to claim 3 or 4, wherein the human visual function includes a focus adjusting function of a crystalline lens of an eye . 6. The video camera imaging device according to claim 3, 4 or 5, wherein the human visual function is a myopia function, a farsighted function and a presbyopia function.
A video camera device characterized by including . 7. The video camera imaging device according to claim 3, 4, 5 or 6, wherein the human visual function includes a low vision function and an astigmatism function . 8. The video camera image pickup device according to claim 1 , wherein light from a plurality of projectors is deflected by a plurality of deflection filters, respectively.
Projector to the back of the screen via a mirror and a half mirror.
Left and right eye independent image display type display with shadow
Error caused by multiple parts of the optical system of the device
To detect the assembly error of multiple parts of the above optical system.
A video camera image pickup apparatus is characterized in that the. 9. A pair of video cameras for the left and right eyes and the bidet.
An image recognition device that inputs the video signal from the camera and processes the image.
And the video signal from the image recognition device is input and displayed.
With a monitor device shown, When a human sees an object or is actually visually
A simulated image of the displayed image is displayed on the monitor and
Image processing in image recognition device or the above video camera
By adjusting the focus of the
A video camera image pickup device characterized by the above.