JP5963637B2 - Display device with imaging device - Google Patents

Description

  The present invention relates to a display device with an image pickup device in which an image pickup device is integrally provided in a relatively thin display device such as an organic EL, liquid crystal, and plasma method, and is particularly suitable for real-time bidirectional communication such as a videophone. The present invention relates to a display device with an imaging device.

  In recent years, the remarkable development of communication networks has enabled real-time two-way communication such as videophones. A videophone is composed of an imaging means for converting a subject image into an electrical image signal and a display means for converting the electrical image signal into an optical signal for display. The user of the videophone phone conversations while looking at the other party's face displayed on the screen of the display means, and at the same time, the user's face is photographed by the imaging means and sent as an electrical signal to the other party. However, in a device used for two-way communication such as a conventional videophone, the image pickup means is provided next to the display means or as another independent device, so that the recipient who is looking at the display means is photographed from an oblique direction. Will do. Therefore, the line of sight of the recipient's face reflected on the display means is facing a different point from the line of sight of the person who is viewing the display means. There is a problem that it is awkward and uncomfortable. In addition, the imaging device and the display device must be manufactured separately and assembled as a display device, or provided as separate devices, which increases the manufacturing cost.

  In view of such a problem, the present inventor disclosed the following display device with an image device in Patent Document 1. The display device includes a display unit including a plurality of display pixels and a light shielding member disposed between the display pixels, and an imaging unit disposed on a back portion of the display unit, and the light shielding member is partly an imaging unit. The image pickup means includes an image forming means at a position corresponding to the opening.

  Such a display device with an imaging device can take an image of a party while looking at the display means, and can match the line of sight with the other party displayed on the display means. Further, by providing a thin image pickup means on the front face of the display means, it is possible to avoid an increase in the size of the entire apparatus.

  However, the position of the opponent's face shown on the screen of the display means does not always coincide with the position of the imaging means arranged in the screen. In addition, the position of the user who sees the face of the opponent displayed at a position shifted from the position of the image pickup means arranged in the screen of the display means may be shifted in accordance with the position of the face of the opponent. .

  FIG. 6 is a diagram for explaining a difference between a viewing direction of a user who watches a display unit such as a videophone and a direction of an image pickup unit in the prior art. In the figure, 108 is a display panel as display means, 106 is a camera as imaging means, and 610 is a user. An X mark 611 indicates the position of the opponent's face displayed on the display panel 108.

FIG. 6A shows a deviation between the user's line-of-sight direction and the optical axis direction of the imaging means when a display device in which the camera 106 for photographing the user is incorporated in the display panel 108 is used. In the figure, the face 611 of the other party is displayed at a position deviated in the + x direction in the figure with respect to the position of the camera 106 (the position of the x mark in the figure). The other party's face 611 is watched at a shifted position. In this case, the photographing direction of the camera 106 photographs the user 610 and gaze direction of the user 610 is offset by an angle theta _1, looking at the image of the user taken by the camera 106 the angle theta ₁ is greater The person on the other end of the videophone call recognizes that the user is not talking while looking at his / her face.

  In order for the person on the other side of the videophone who has seen the user's image taken by the camera 106 to be recognized as if he / she is looking at him / her, the direction in which the camera 106 takes the user 610 and the user It is necessary to reduce the angle θ formed with the viewing direction of 610.

Therefore, in order to reduce the angle θ between the shooting direction in which the camera 106 shoots the user 610 and the line-of-sight direction of the user 610, the user is placed behind the back of the display panel 108 as shown in FIG. A camera 106 to be photographed is arranged. By doing so, the angle θ ₂ formed by the imaging direction in which the camera 106 images the user 610 and the viewing direction of the user 610 becomes smaller than θ ₁ . As a result, the person on the other side who sees the user's image photographed by the camera 106 recognizes that the user is looking at himself / herself.

JP-A-2005-010407

  However, in order to reduce the angle θ between the shooting direction in which the camera 106 captures the user 610 and the line-of-sight direction of the user 610, if the camera 106 that captures the user is arranged behind the display panel 108, the following is performed. There was a problem like this. That is, the camera 106 at the rear rear part of the display panel 108 has to photograph the user 610 through the display panel 108, and the image to be photographed is deteriorated due to the diffraction due to the periodic structure of the display pixels of the display panel 108. There was a drawback that it would.

  SUMMARY OF THE INVENTION An object of the present invention is to provide an image pickup apparatus that allows a user who is interacting with a videophone to recognize that the user is looking at him / herself and is speaking, and can take a high-quality image of the user. It is to provide an attached display device.

To achieve the above object, according to the present invention, a display means for displaying an image I by the plurality of display pixels having optical transparency arranged in a two-dimensional, subject positioned on the front side of the display means a display device with an image sensing device having an imaging unit for the subject light is disposed on the rear side of said display means in order to image from the display means, in response to each of the plurality of display pixels disposed, have a plurality of position phase adjusting means for adjusting the optical path length of the object light with a light-transmitting property, wherein the plurality of phase adjusting means, in the direction of the optical axis of subject light transmitted through the display means has a different thickness, the phase adjusting means of the same thickness, the imaging device-equipped display device comprising that are arranged at a predetermined period is provided.

  According to the present invention, it is possible to provide a high-quality image of the user to the other party who interacts with the display device with an imaging device such as a videophone, and when the user is looking at himself / herself and talking, It is possible to provide a display device with an imaging device that can be recognized by the user.

The side view and rear view of the display apparatus with an imaging device according to the first embodiment of the present invention. The side view in the other use condition of the display apparatus with an imaging device concerning the 1st example of the present invention. The rear view of the display panel of the display apparatus with an imaging device concerning the 1st example of the present invention. 1 is a cross-sectional view of a display panel of a display device with an imaging device according to a first embodiment of the present invention. Sectional drawing of the display panel of the display apparatus with an imaging device concerning the 2nd Example of this invention. The figure for demonstrating the shift | offset | difference of a user's eyes | visual_axis direction and the direction of an imaging device in the display apparatus with an imaging device in a prior art.

  Embodiments of the present invention will be described below in detail with reference to the accompanying drawings.

  FIG. 1 shows a side view (a) and a rear view (b) of a display device 100 with an image pickup device according to a first embodiment of the present invention. The display device with an imaging device 100 according to the present embodiment is a display device with an imaging device that can be used in a videophone, a video conference system, and the like. The display device that displays a received image and a user who views the received image. Imaging means for capturing an image is provided.

  In the figure, reference numeral 108 denotes a display panel which is a light transmissive display means, and is incorporated in the display panel frame 102. A leg portion 103 is provided on the back surface (+ z direction in the figure) of the display panel frame 102, and the display device 100 is configured to stand upright by a pedestal 104 fixed to the leg portion 103.

  A photographing optical system for photographing a user (subject) who observes the front surface of the display panel 108 is disposed on the rear surface (+ z direction in the drawing) of the display panel 108. The photographing optical system includes a camera 106 that is an imaging device disposed at an end of the display panel 108 in the short side direction (y direction in the figure) and a reflection mirror 107 that is a reflection member that guides subject light to the camera 106. Yes. Since the camera 106 is disposed at a position away from the position on the optical axis of the subject light transmitted through the display panel 108, the subject light transmitted through the display panel 108 is guided to the camera 106 by the reflection mirror 107. Since the distance between the user who observes the display device 100 and the camera 106 can be increased by this photographing optical system, the angle formed by the photographing direction in which the camera 106 photographs the user and the user's line-of-sight direction can be reduced. It becomes possible. As a result, the other person who sees the user's image photographed by the camera 106 can recognize the user as if he / she is looking at him / her.

  Here, the camera 106 and the reflection mirror 107 constituting the photographing optical system are disposed in a housing 105 fixed to the display panel frame 102. Further, the housing 105 is configured to be housed inside the leg portion 103.

  In addition, the display panel frame 102 and the leg portion 103 of the display device 100 are connected by a hinge 109. Therefore, the display panel frame 102 is configured to be rotatable with respect to the leg portion 103 about the x-axis direction in the figure.

  FIG. 2 shows a side view of the display device 100 with the imaging device of the present embodiment. 1 is different from the side view (a) of FIG. 1 in that the angle of the display panel frame 102 is changed so that the user can easily view the display image. Even in this case, since the housing 105 provided with the camera 106 and the reflection mirror 107 rotates integrally with the display panel frame 102, the angle of the display panel frame 102 is changed so that the user can easily see the display image. However, it is possible to capture the image of the user from substantially the front.

  FIG. 3 is a rear view of the display panel 108. 2A is a rear view of the entire display panel 108, and FIG. 2B is a partially enlarged view of the rear view 1A. As will be described later, the display panel 108 constituting a part of the display device 100 of the present embodiment is configured by a two-dimensional array of pixels including an organic EL element that can transmit light, and the back surface is a central portion thereof. The light shielding member 301 is covered except for the opening 302. The opening 302 of the display panel 108 corresponds to the photographing optical path of the camera 106, and the camera 106 receives the subject light that has passed through the opening 302 of the display panel 108 formed of an organic EL through a reflection mirror, thereby receiving the user. Take a picture. Here, the light shielding member 301 may be provided separately from the display panel 108 or may be provided integrally in the manufacturing process of the organic EL that is the display panel 108.

  FIG. 3B shows a 12 × 4 display pixel portion in the opening 302 where the light shielding member 301 is not provided. One display pixel portion is a rectangle that is long in the vertical direction (y direction in the figure), and has a structure in which display pixels that emit red, green, and blue light in the horizontal direction (x direction in the figure) are periodically arranged. One picture element is composed of three pixels that emit red, green, and blue light arranged in the horizontal direction (x direction in the figure). The display panel 108 of the display device 100 of the present invention includes a phase adjustment member for irregularly adjusting the optical path length of light transmitted through each pixel. In this embodiment, phase adjustment members having different thicknesses are formed in each display pixel unit in units of 6 pixels in the horizontal direction and 2 pixels in the vertical direction. In addition, the display pixel portion in which the phase adjustment member having the same thickness is formed in a period of 6 pixels in the horizontal direction and in a period of 2 pixels in the vertical direction can simplify the manufacturing process of the phase adjustment member. I am trying.

  Next, the configuration of the display panel 108 constituting the display device 100 of this embodiment will be described in more detail.

  4 is a cross-sectional view of the display panel 108. FIG. 4A is a cross-sectional view taken along the line AA 'of a partially enlarged view of the rear view of the display panel 108 of FIG. 3B, and FIG. 2 is a cross-sectional view of the organic EL layer 400 shown in FIG. In the figure, the −z direction is the display surface direction.

  In the cross-sectional view of the display panel 108 in FIG. 4A, reference numeral 400 denotes an organic EL layer. Reference numeral 409 denotes a switching and driving TFT on the back side of the organic EL layer 400, and 410 denotes a phase adjustment member that changes the optical path length of light transmitted through each display pixel unit on the back side (+ z direction side) of the display panel 108. It is. The display panel 108 of this embodiment is a top emission type organic EL panel having the organic EL layer 400 on the display surface side and the TFT 409 on the back surface side.

  Since the TFT 409 is made of polysilicon or the like and disposed at the boundary between the display pixel portions, it forms a periodic light shielding structure. In a region where the TFT 409 is not disposed, light can be transmitted, and light incident from the display surface side (−z direction side) is emitted from the display panel 108 via the organic EL layer 400 and the phase adjustment member 410.

  Here, the phase adjustment member 410 is made of a transparent photocurable resin, and is formed using an optical nanoimprint technique or the like. The thickness of the phase modulation member 410 (thickness in the optical axis direction of incident light) varies depending on each display pixel, and is set so that the optical path length is equal to or less than the wavelength of visible light. For example, assuming that the refractive index of the photocurable resin is 1.51, the thickness of the phase modulation member 410a is 132 nm, the thickness of the phase modulation member 410b is 397 nm, the thickness of the phase modulation member 410c is 199 nm, and the thickness of the phase modulation member 410d. The thickness is 66 nm. Similarly, the thickness of the phase modulation member 410e is 331 nm, and the thickness of the phase modulation member 410f is 265 nm. In each display pixel portion of the present embodiment, a phase adjustment member 410 having the same thickness is formed with a period of 6 pixels in the horizontal direction and with a period of 2 pixels in the vertical direction, as shown in FIG. Note that the predetermined period of the phase adjusting member having the same thickness in the direction orthogonal to each other in the two-dimensional array of the plurality of display pixels is not limited to this.

  When the camera 106 photographs a user through the display panel 108, the photographing light incident from the −z direction side in the drawing is transmitted through the organic EL layer 400, and a rule depending on the period of the display pixel in the layer where the TFT 409 is formed. The phase is modulated by the nature. The optical path length of the light diffracted by the TFT layer 409 is changed by the phase adjusting member 410 having an irregular thickness. Therefore, the intensifying direction of the light transmitted through the adjacent display pixel portions becomes irregular and strong diffraction does not occur.

  As a result, even if the user is photographed through the display panel 108 of the present embodiment configured by organic EL, it is possible to photograph a good image that is not affected by diffraction. At the same time, since the camera 106 images the user at a position farther from the user observing the display device 100, the user can identify himself / herself to the other person who viewed the user's image captured by the camera 106. It becomes possible to have you recognize as you see.

  In the display panel 108 of the present embodiment described above, the phase adjusting member 210 having a different thickness is formed in the horizontal direction (long side direction) with a period of 6 pixels. For this reason, diffracted light corresponding to a period of six pixels in the horizontal direction of the display pixel portion is generated, but since the diffraction angle is minute, there is almost no influence on the image quality of the captured image. Similarly, in the vertical direction (short-side direction), the phase adjustment member 410 having a different thickness is formed at a cycle of 2 pixels, so that diffracted light corresponding to the 2 pixel cycle in the vertical direction of the display pixel portion is generated. Since the diffraction angle is very small, there is almost no influence on the image quality of the photographed image.

  FIG. 4B is a partial cross-sectional view of the display panel 108 including the organic EL layer 400. In the figure, 401 is a planarizing layer, and 402 is an anode made of transparent ITO (Indium Tin Oxide) or the like. Reference numeral 403 denotes a hole transport layer, 404 denotes a light emitting layer, 405 denotes an electron transport layer, 406 denotes an electron injection layer, 407 denotes a cathode made of ITO or the like, and 408 denotes a flattening layer. Among the light emitting layers 404 in the figure, 404R is a light emitting layer that emits red light, 404G is a light emitting layer that emits green light, and 404B is a light emitting layer that emits blue light, and is in the x direction (the long side direction of the display panel 108). Are arranged in a cycle of three pixels. The details of the configuration of the organic EL layer 400 are disclosed in, for example, Japanese Patent Application Laid-Open No. 2009-187697 filed by the present applicant, and thus further description thereof is omitted here.

  The display panel 108 of this embodiment is an example of a top emission type organic EL panel having the organic EL layer 400 on the display surface side and the TFT layer 409 on the back surface side. However, even in a bottom emission type organic EL panel having the TFT layer 409 on the display surface side and the organic EL layer 400 on the back surface side, the phase adjustment member 410 having an irregular thickness is provided in each display pixel portion. Thus, the same effect can be obtained.

  Next, a second embodiment of the present invention will be described. The display device of the present embodiment is different from the first embodiment only in the configuration of the phase adjusting member provided on the display panel 108. Therefore, the display device of this embodiment also has the same configuration as the display device 100 of the first embodiment shown in FIGS. 1 to 3 already described. Hereinafter, the configuration of the display panel of this embodiment will be described.

  FIG. 5 is a cross-sectional view of the display panel 108 according to the present embodiment. FIG. 5A is a cross-sectional view taken along the line AA ′ in the partially enlarged view of the rear view of the display panel 108 in FIG. (B) is a partial sectional view of a display panel including an organic EL layer. In the figure, the −z direction is the display surface direction. In the figure, the same parts as those in FIG. 4 are denoted by the same reference numerals.

  In FIG. 5A, 500 is an organic EL layer, and 409 is a switching and driving TFT on the back side of the organic EL layer 500. The display panel 108 of this embodiment is a top emission type organic EL panel having the organic EL layer 500 on the display surface side and the TFT 409 on the back surface side.

  Since the TFT 409 is made of polysilicon or the like and is arranged at the boundary between the display pixel portions, it forms a periodic light shielding structure. In a region where the TFT 409 is not provided, light can be transmitted, and light incident from the display surface side (−z direction side) is emitted from the display panel 108 via the organic EL layer 500.

  In FIG. 5B, 401 is a planarization layer, and 502 is an anode made of transparent ITO or the like disposed on the back side of the display panel 108. Reference numeral 403 denotes a hole transport layer, 404 denotes a light emitting layer, 405 denotes an electron transport layer, 406 denotes an electron injection layer, and 407 denotes a cathode made of ITO or the like. Reference numeral 408 denotes a planarization layer. Among the light emitting layers 404 in the figure, 404R is a light emitting layer that emits red light, 404G is a light emitting layer that emits green light, and 404B is a light emitting layer that emits blue light, and is in the x direction (the long side direction of the display panel 108). Are arranged in a cycle of 3 pixels.

  In this embodiment, the anode 502 has a configuration that also serves as a phase adjusting member that changes the optical path length of the light transmitted through each display pixel portion. The anode 502 is made of a transparent conductive material such as ITO, and is printed with a pattern by a printing method. The thickness of the anode 502 differs depending on each display pixel. In this embodiment, the optical path length difference of each display pixel that has passed through the anode 502 and the planarization layer 401 is set to be half or less of the wavelength of visible light. For example, assuming that the refractive index of ITO constituting the anode is 2.0 and the refractive index of the planarization layer 401 is 1.5, the thickness of the anode 502a is 200 nm, the thickness of the anode 502b is 600 nm, and the thickness of the anode 502c is 300 nm. The thickness of the anode 502 is 100 nm. Similarly, the thickness of the anode 502e is 500 nm, and the thickness of the anode 502f is 400 nm. As shown in FIG. 5A, in this embodiment, anodes 502 having the same thickness are formed in each display pixel portion with a period of 6 pixels in the horizontal direction and a period of 2 pixels in the vertical direction.

  When the camera 106 photographs a user through the display panel 108, photographing light incident from the −z direction side in the figure passes through the organic EL layer 500, and the optical path length is irregularly changed by the anode 502 of the organic EL layer 500. Is done. The phase of light transmitted through the organic EL layer 500 is modulated by the regularity depending on the period of the display pixel in the layer in which the TFT 409 is formed, but the direction in which the light transmitted through the adjacent display pixel portion is intensified is not. It becomes regular and does not produce strong diffraction.

  As a result, even when a user is photographed through the display panel 108 configured with an organic EL, a good image that is not affected by diffraction can be photographed. At the same time, since the camera 106 images the user at a position farther from the user observing the display device 100, the user can identify himself / herself to the other person who viewed the user's image captured by the camera 106. It becomes possible to have you recognize as you see.

  In this embodiment, since the anode 502 having different thicknesses is formed in the horizontal direction (long side direction) of the display panel 108 in a cycle of 6 pixels, the diffracted light corresponding to the 6 pixel cycle in the horizontal direction of the display pixel portion. Will occur. However, since the diffraction angle is very small, there is almost no influence on the image quality of the photographed image. Similarly, in the vertical direction (short side direction) of the display panel 108, the anodes 502 having different thicknesses are formed with a period of two pixels, so that diffracted light corresponding to the two-pixel period in the vertical direction of the display pixel portion is generated. However, since the diffraction angle is very small, there is almost no influence on the image quality of the photographed image.

  In this embodiment, the thickness of the electrode (anode 502) that the organic EL layer (display pixel) has on the back side of the display panel 108 is irregularly configured, and the optical path length of the light transmitted through each display pixel portion An example of the irregularity is shown. However, for example, changing the optical path length of each display pixel unit by changing the thickness of the electron injection layer 406 constituting the organic EL layer 500 has the same effect.

  In the first and second embodiments, a plane mirror is shown as an example of the reflection mirror 107 which is a part of the configuration of the display device 100. However, the reflection mirror is configured by a spherical reflection mirror having a convex spherical surface. May be. In the case of using a spherical reflecting mirror, there is an effect that the photographing optical path can be downsized such that the size of the opening 302 can be reduced. Further, the reflection mirror may be a hologram mirror.

  As mentioned above, although preferable embodiment of this invention was described, this invention is not limited to these embodiment, A various deformation | transformation and change are possible within the range of the summary.

Claims (7)

Display means for displaying the image I by the plurality of display pixels having optical transparency arranged in a two-dimensional, the display means to image the object light from an object located on the front side of the display means It met display device with an image sensing device having an imaging means disposed on the rear side,
The display means, corresponding to each of the plurality of display pixels arranged, a plurality of position phase adjusting means for adjusting the optical path length of the subject light and having a light transmitting property,
Wherein the plurality of phase adjusting means has an optical axis direction to different thicknesses of the subject light transmitted through said display means,
The display device with an imaging device, wherein the phase adjusting means having the same thickness is disposed at a predetermined cycle. 2. The display device with an imaging device according to claim 1, wherein each of the plurality of phase adjusting units is disposed on a back side of the display unit with respect to each of the plurality of display pixels. Wherein the plurality of phase adjusting means, imaging unit-integrated display according to claim 1, wherein each of the plurality of display pixels is an electrode that has been closed respectively on the rear side of said display means. Wherein the predetermined period, the display with an imaging device according to any one of claims 1 to 3, wherein Ttei Rukoto different from each other in the arrangement directions orthogonal to each other in the two-dimensional array of said plurality of display pixels apparatus. Further comprising a light shielding means provided on the rear side of the display hand stage,
The light shielding means, the imaging device-equipped display device according to any one of claims 1 to 4, characterized in that it has an opening for transmitting the object light. The imaging means is arranged at a position different from the position on the optical axis of the object light incident on said display means,
Before SL imaging unit-integrated display according to the subject light transmitted through the display unit in any one of claims 1 to 5, further comprising a reflecting means for guiding the imaging means. The reflection means is a reflection mirror;
The reflecting mirror is a flat surface mirror, the image pickup unit-integrated display according to claim 6, characterized in that at least one of the spherical reflecting mirrors and holographic mirrors.

Images