JP7812901B2 - Imaging device with display function - Google Patents

Description

This disclosure relates to an imaging device with a display function.

To assist in the safe driving of vehicles such as automobiles and trains, studies are being conducted to film the driver and analyze the driver's condition from the filmed footage. To film the driver, it is preferable to place an imaging device on the instrument panel facing the driver's face.

In recent years, information necessary for driving, such as speedometers, placed on instrument panels, has been displayed on flat displays such as liquid crystal display devices. For this reason, for example, Patent Document 1 discloses a display device in which a liquid crystal panel is placed on the instrument panel and a camera is placed behind the liquid crystal panel.

JP 2014-031140 A

The purpose of this disclosure is to provide an imaging device with a display function that can capture clear subject images.

An imaging device with a display function according to one embodiment of the present disclosure is an imaging device with a display function that includes a liquid crystal panel, an infrared camera having a focusing lens and an imaging element, and a backlight disposed on the rear surface of the liquid crystal panel, wherein the liquid crystal panel has a display area that includes a first area and a second area positioned to surround the first area in a planar view, at least the imaging element of the infrared camera is disposed on the optical path of light that has passed through the first area and the focusing lens, and the liquid crystal panel does not have a black matrix in at least the first area and has color filters in the first area and the second area.

One embodiment of the present disclosure provides an imaging device with a display function that can capture clear subject images using an infrared camera located on the back side of the liquid crystal panel.

FIG. 1 shows the wavelength dependence of the light transmittance of a color filter and a black matrix used in a typical liquid crystal panel. FIG. 2 shows an example in which an object image is acquired by using infrared light as illumination light and passing through a liquid crystal panel. FIG. 3 shows a schematic plan view of the color filter and black matrix of the liquid crystal panel, and the transmittance of red light, green light, blue light and infrared light along the line AA. FIG. 4 is a schematic diagram showing the generation of diffraction images by red light, green light, blue light, and infrared light. FIG. 5 is an exploded perspective view showing a schematic configuration of the image pickup device with a display function according to the first embodiment. FIG. 6 is a schematic cross-sectional view of the main part of the image pickup device with a display function shown in FIG. FIG. 7 is a schematic cross-sectional view of the first region of the liquid crystal panel in the x-axis direction. FIG. 8 is a schematic cross-sectional view of the second region of the liquid crystal panel 50 in the x-axis direction. FIG. 9 is a schematic cross-sectional view of the second region in the y-axis direction. FIG. 10 is a schematic exploded perspective view of the main components of a liquid crystal panel. FIG. 11 is a plan view of the color filters and the black matrix. FIG. 12 is a schematic cross-sectional view of the first region of the imaging device with a display function according to the second embodiment, taken along the x-axis direction. FIG. 13 is a schematic cross-sectional view in the y-axis direction of a first region of a pixel in which a red filter is arranged on an opposing substrate according to the second embodiment. FIG. 14 is a schematic cross-sectional view in the y-axis direction of a first region of a pixel in which a green filter is arranged on an opposing substrate according to the second embodiment. FIG. 15 is a schematic cross-sectional view in the y-axis direction of a first region of a pixel in which a blue filter is arranged on an opposing substrate according to the second embodiment. FIG. 16 is a schematic cross-sectional view of the first region in the x-axis direction of another imaging device with a display function according to the second embodiment. FIG. 17 is a schematic cross-sectional view of the first region of the pixel in which the red filter is arranged, taken along the y-axis direction, of the counter substrate shown in FIG. FIG. 18 is a schematic cross-sectional view of the first region of the pixel in which the green filter is arranged, taken along the y-axis direction, of the counter substrate shown in FIG. FIG. 19 is a schematic cross-sectional view of the first region of the pixel in which the blue filter is arranged, taken along the y-axis direction, of the counter substrate shown in FIG. FIG. 20 is a schematic cross-sectional view of an imaging device with a display function according to the third embodiment. FIG. 21 is a schematic cross-sectional view of another image pickup device with a display function according to the third embodiment. FIG. 22 is an exploded perspective view of the main components of the liquid crystal panel of the image pickup device with a display function according to the fourth embodiment. FIG. 23 is a schematic cross-sectional view of an imaging device with a display function according to the fifth embodiment. FIG. 24 is a schematic plan view of the main part of an imaging device with a display function according to the fifth embodiment. FIG. 25 is a schematic cross-sectional view of another image pickup device with a display function according to the fifth embodiment. FIG. 26 is a schematic plan view showing an example of the arrangement of a plurality of illumination light-emitting elements and a plurality of infrared light-emitting elements of a backlight in another image pickup device with a display function according to the fifth embodiment. FIG. 27 is a schematic cross-sectional view of an imaging device with a display function according to the sixth embodiment. FIG. 28 is a timing chart showing the operation timing of each unit in the imaging device with a display function according to the seventh embodiment. FIG. 29 is another timing chart showing the operation timing of each unit in the image pickup device with a display function according to the seventh embodiment. FIG. 30 is another timing chart showing the operation timing of each unit in the image pickup device with a display function according to the seventh embodiment. FIG. 31 is another timing chart showing the operation timing of each unit in the imaging device with a display function according to the seventh embodiment. FIG. 32 is a schematic cross-sectional view of an imaging device with a display function according to the eighth embodiment.

Configurations in which an imaging device is placed near a display device are already available in smartphones, tablet devices, laptops, and the like. However, on these devices, the position of the lens and lens window that represent the imaging device can be clearly identified. For this reason, if a similar structure were used to configure an automobile instrument panel, it is conceivable that the driver would be aware of the presence of the imaging device every time they looked at the display on the LCD panel, for example.

To make the position of the imaging device less noticeable, smartphones and other devices often have a notch on one side of the display device, with the imaging device located within the notch. When this structure is used to create an automobile instrument panel, the display area is not rectangular, but rather the notch is missing. This can detract from the aesthetic appeal of the instrument panel when in display mode, and if the imaging device is located in the notch where no image is displayed, it may be noticeable to the driver. Similarly, the driver may be aware of the presence of the imaging device every time they look at the LCD panel display.

In light of these issues, the inventors of the present application considered placing an imaging device in a display area where images can be displayed. For example, they considered whether it would be possible to place an imaging device that captures infrared images in the center of a liquid crystal panel and capture infrared images through the liquid crystal panel.

Figure 1 shows the wavelength dependence of the light transmittance of color filters used in typical LCD panels. As shown in Figure 1, blue (B), green (G), and red (R) filters (monochromatic filters) have the optical property of selectively transmitting light in the blue, green, and red wavelength bands, respectively, in the visible range. On the other hand, the blue, green, and red filters transmit light with wavelengths longer than the visible range without absorbing it. For example, the transmittance of all filters for infrared light with a wavelength of 950 nm is approximately 90%. On the other hand, the black matrix (BM) located in the boundary region of the color filters has a transmittance of approximately 0.1% for both visible light and infrared light.

It is known that polarizing plates and liquid crystal layers have almost no optical effect on infrared light. Therefore, when infrared light is used as illumination and an image is captured with an imaging device through a liquid crystal panel equipped with color filters, it is thought that the image can be captured with almost no difference in transmittance between the blue, green, and red filter regions.

Figure 2 shows an example of an image of a subject captured using infrared light as illumination and transmitted through an LCD panel. As shown in Figure 2, an image was captured, but it was not a clear image, and multiple images were captured. In particular, the image blur in the horizontal direction was greater than in the vertical direction. This is thought to be due to the influence of the black matrix of the LCD panel.

Figure 3 is a schematic plan view of the color filters and black matrix of an LCD panel. The transmittance of red light, green light, blue light, and infrared light along line A-A is shown below. The filter regions of each RGB color selectively transmit light in their respective wavelength bands. For example, red light selectively transmits only through the red filter region, and is mostly absorbed by the green and blue filter regions. The same is true for green light and blue light. For this reason, the transmission regions in the direction of line A-A are repeated at the same intervals for red light, green light, and blue light.

On the other hand, as mentioned above, infrared light is transmitted to the same extent regardless of the filter color. However, the transmittance of the black matrix for infrared light with a wavelength of 950 nm is only about 0.1%, so most infrared light is blocked.

The areas through which red, green, blue, and infrared light pass correspond to the slits in the diffraction grating, and the color filter and black matrix act as a diffraction grating for red, green, blue, and infrared light. For red, green, and blue light, the slit spacing is three times the pixel pitch in the direction of line A-A, and for infrared light, the slit spacing is equal to the pixel pitch. If the slit spacing is d and the wavelength of light is λ, then the spacing D between positions where a diffraction image is formed by the reinforcement of light in the diffraction grating is roughly expressed as D ∝ λ/d.

In addition, the brightness of the resulting diffraction image depends on the ratio A = Amax/Amin between the maximum transmittance Amax and the minimum transmittance Amin.

Figure 4 is a schematic diagram showing the generation of diffraction images by red, green, blue, and infrared light. Images of the subject created by red, green, blue, and infrared light contain ±1st-order, ±2nd-order, ±3rd-order, and other diffraction images. As mentioned above, the spacing D between the diffraction images is proportional to the wavelength λ and inversely proportional to the slit spacing d. Therefore, although the slit spacing for the diffraction images created by red, green, and blue light is the same, the spacing for the blue diffraction images is the shortest due to the different wavelengths. On the other hand, for infrared light, the slit spacing d is three times that for red light, etc., and the wavelength is also longer, so the spacing between the diffraction images created by infrared light is more than three times that of the diffraction images created by red, green, and blue light. As a result, when infrared light is used for photography, the diffraction images are likely to be perceived as overlapping images.

Each pixel is longer in the y-axis direction than in the x-axis direction, along which the blue, green, and red filters are arranged. In other words, the pixel pitch is shorter in the x-axis direction. For this reason, as shown in Figure 2, it is thought that image blur will be greater in the x-axis direction than in the y-axis direction.

Based on these findings, the inventors of the present application came up with the idea of an imaging device with a display function. The imaging device with a display function disclosed herein is capable of capturing an image of a subject facing the front side of the display device, i.e., the display area. The imaging device with a display function may be called an electronic device equipped with an imaging device and a display device, or may be called a display device with an imaging device.

Such an imaging device with display function can be mounted on the instrument panel of an automobile and suitably used to capture images of the driver's upper body, particularly the face. It can also be used to capture images of people driving or operating vehicles other than automobiles, such as trains and airplanes. As described below, the imaging device with display function of the present disclosure can capture images from within the display area. Therefore, for example, when using the imaging device with display function of the present disclosure as the display of a laptop, tablet, or smartphone, it is possible to capture images from near the position of the eyes of the face displayed on the display. Therefore, when conducting a web conference, compared to conventional cases where a camera is placed in the frame area, participants can view images from a more natural angle through the display, meaning they can see each other's faces and eyes as if they are looking at each other's eyes during the conference.

The imaging device with display function of the present disclosure will be described below with reference to the drawings. The present disclosure is not limited to the following embodiments, and appropriate design changes may be made within the scope of the configuration of the present disclosure. Furthermore, in the following description, the same parts or parts having similar functions will be designated by the same reference numerals in different drawings, and repeated description may be omitted. Furthermore, the configurations described in the embodiments and variations may be combined or modified as appropriate without departing from the spirit of the present disclosure. To make the description easier to understand, the drawings referenced below may show simplified or schematic configurations, or may omit some components. Furthermore, the dimensional ratios between components shown in each drawing do not necessarily represent actual dimensional ratios.

(First embodiment)
FIG. 5 is an exploded perspective view showing a schematic configuration of the image pickup device with a display function of this embodiment, and FIG. 6 is a schematic cross-sectional view of the main part of the image pickup device with a display function of this embodiment.

The image capture device 101 with a display function includes a liquid crystal panel 50, an infrared camera 60, and a backlight 70. The image capture device 101 with a display function also includes a cover glass 90, a first polarizing plate 91, a second polarizing plate 92, and an optical structure 80. The liquid crystal panel 50, the backlight 70, the first polarizing plate 91, the second polarizing plate 92, and the optical structure 80 form a display device.

The liquid crystal panel 50 has a front surface 50a and a back surface 50b. The front surface 50a includes a display region DR and a non-display region NR that surrounds and is located around the display region DR. The display region DR is the region where an image is displayed, while the non-display region NR is an region where no image is displayed because a driving circuit, wiring, etc. are provided.

The display region DR includes a first region DR1 and a second region DR2. The first region DR1 is surrounded by the second region DR2. The first region DR1 is preferably located toward the center of the display region DR, and is preferably located toward the center and away from the outer edge of the display region DR. The second region DR2 is the area of the display region DR other than the first region DR1, and the outer edge of the first region DR1 is in contact with the inner edge of the second region DR2. The first region DR1 and the second region DR2 are regions defined on the front surface 50a and are defined continuously in the thickness direction of the liquid crystal panel 50. In other words, the first region DR1 and the second region DR2 are also defined on the back surface 50b, and in a planar view, the first region DR1 and the second region DR2 on the front surface 50a overlap with the first region DR1 and the second region DR2 on the back surface 50b, respectively.

The first region DR1 has a circular shape with a diameter of, for example, approximately 5 mm to 2 cm. The shape of the first region DR1 is not limited to a circle, but may also be an ellipse, an oval, a rectangle, or a polygon.

As described in detail below, the liquid crystal panel 50 is configured to be able to display an image across the entire display region DR. That is, it is capable of displaying color images in the first region DR1 and the second region DR2. More specifically, pixels are configured and color filters are arranged in the first region DR1 and the second region DR2 of the liquid crystal panel 50. The liquid crystal panel 50 does not have a black matrix in the first region DR1. In other words, the black matrix is arranged only in the second region DR2, and not in the first region DR1.

The first polarizer 91 and the second polarizer 92 are arranged on the front surface 50a and the back surface 50b of the liquid crystal panel 50, respectively. The first polarizer 91 and the second polarizer 92 cover and overlap the first region DR1 and the second region DR2, respectively. By also arranging the first polarizer 91 and the second polarizer 92 in the first region DR1, it is possible to display an image in the first region DR1 that is similar to that in the second region DR2. Furthermore, since there is no need to process the first polarizer 91 and the second polarizer 92, manufacturing costs can be reduced. The first polarizer 91 and the second polarizer 92 are arranged in a crossed Nicol relationship.

The cover glass 90 is placed on the first polarizer 91 to protect the liquid crystal panel 50. The backlight 70 is placed on the outside of the second polarizer 92 via the optical structure 80.

The optical structure 80 improves the uniformity of light emitted from the backlight 70 and increases brightness by adjusting the direction of light propagation so that it is perpendicular to the liquid crystal panel 50. For example, the optical structure 80 includes a brightness enhancement film 81, such as a BEF (Brightness Enhancement Film), and a diffuser plate 82. While FIG. 5 shows only these two components of the optical structure 80, the optical structure 80 may also include other plate- or film-shaped optical elements. The optical structure 80 has an optical structure through-hole 80h in the region overlapping with the first region DR1. In this embodiment, through-holes 81h and 82h are provided in the brightness enhancement film 81 and the diffuser plate 82, respectively, in the regions overlapping with the first region DR1.

Next, the structure of the liquid crystal panel 50 will be described in detail. The liquid crystal panel 50 may be a liquid crystal panel using various driving methods, and is characterized by not having a black matrix in the first region DR1. Figures 7 and 8 are schematic cross-sectional views of the first and second regions of the liquid crystal panel 50 in the x-axis direction, and Figure 9 is a schematic cross-sectional view of the second region in the y-axis direction. Figure 10 is a schematic exploded perspective view of the main components of the liquid crystal panel 50. Figure 11 is a plan view of the color filters and black matrix.

The liquid crystal panel 50 includes a TFT substrate 10, a counter substrate 40, and a liquid crystal layer 30 disposed between the TFT substrate 10 and the counter substrate 40.

The TFT substrate 10 has the same structure in the first region DR1 and the second region DR2. That is, the liquid crystal panel 50 has the same drive structure in the first region DR1 and the second region DR2. Specifically, the TFT substrate 10 includes a substrate 11, multiple scanning lines 12, an insulating layer 13, multiple data lines 14, multiple pixel electrodes 15, multiple TFTs, an insulating layer 16, and a counter electrode 19. Each TFT has a gate electrode 12b, a semiconductor layer 17, a source electrode 14s, and a drain electrode 18. The scanning lines 12, data lines 14, gate electrodes 12b, source electrodes 14s, and drain electrodes 18 are made of, for example, a metal that is substantially opaque to visible light and infrared light. The pixel electrodes 15 and counter electrode 19 are made of a transparent conductor such as ITO that is transparent to visible light and infrared light.

The substrate 11 is made of glass or other material that transmits visible light and infrared light. An undercoat layer or other layer may be provided on the surface of the substrate 11. Multiple scanning lines 12 extend in the x-axis direction on the substrate 11 and are arranged in the y-axis direction. The gate electrode 12b of each TFT is connected to the scanning line 12.

A gate insulating film, which constitutes part of the insulating layer 13, is formed on the substrate 11, covering the multiple scanning lines 12 and gate electrodes 12b. The semiconductor layer 17 is located on the gate insulating film so as to overlap the gate electrodes 12b in a plan view.

Multiple data lines 14 extend in the y-axis direction on the gate insulating film and are arranged in the x-axis direction. One end of the source electrode 14s of each TFT is connected to a data line 14. The other end of the source electrode 12s is connected to the semiconductor layer 17.

The drain electrode 18 is arranged spaced apart in the x-axis direction from the source electrode 14s, with the gate electrode 12b in between, and one end of the drain electrode 18 is connected to the semiconductor layer 17.

An insulating film that forms part of the insulating layer 13 is formed on the gate insulating film, covering the data line 14, semiconductor layer 17, and drain electrode 18.

Multiple pixel electrodes 15 are arranged two-dimensionally in the x and y directions on the insulating film. Each pixel electrode is connected to the other end of the drain electrode via a contact hole provided in the insulating film.

An insulating layer 16 is formed on the insulating layer 13, covering the pixel electrodes 15. A counter electrode 19 is formed on the insulating layer 16. The counter electrode has multiple slits 19s formed therein, extending, for example, in the y-axis direction.

The area surrounded by a pair of scanning lines 12 and a pair of data lines 14 constitutes a pixel, and each pixel includes a TFT, which is a switching element, and a pixel electrode 15.

As described above, the TFT substrate 10 has the same structure in the first region DR1 and the second region DR2. That is, the multiple scanning lines 12, the multiple data lines 14, the multiple TFTs, and the multiple pixel electrodes 15 are located in the first region DR1 and the second region DR2 of the liquid crystal panel 50, respectively. To ensure a sufficient amount of light incident on the imaging element, the first region DR1 is preferably large enough to accommodate eight or more of each of the multiple scanning lines 12, the multiple data lines 14, the multiple TFTs, and the multiple pixel electrodes 15.

The arrangement pitch of these components is preferably approximately the same in the first region DR1 and the second region DR2. Specifically, the spacing between adjacent scanning lines 12 in the first region DR1 is preferably in the range of 0.5 to 1.5 times the spacing between adjacent scanning lines 12 in the second region DR2. Furthermore, the spacing between adjacent data lines 14 in the first region DR1 is preferably in the range of 0.5 to 1.5 times the spacing between adjacent data lines 14 in the second region DR2. Furthermore, the spacing between adjacent TFTs in the first region DR1 is preferably in the range of 0.5 to 1.5 times the spacing between adjacent TFTs in the second region DR2. Furthermore, the spacing between adjacent pixel electrodes 15 in the first region DR1 is preferably in the range of 0.5 to 1.5 times the spacing between adjacent pixel electrodes 15 in the second region DR2. Furthermore, it is preferable that the area of the pixel electrode 15 in the first region DR1 be in the range of 0.5 to 1.5 times the area of the pixel electrode 15 in the second region DR2.

By satisfying this relationship, it is possible to display a single integrated still image or video in the first area DR1 and the second area DR2 without performing any special image processing in the first area DR1 and the second area DR2.

The opposing substrate 40 includes a substrate 41, a black matrix 42, and a color filter 43, and has a different structure in the first region DR1 than in the second region DR2. Specifically, the opposing substrate 40 does not have a black matrix 42 in the first region, but does have a black matrix in the second region. The opposing substrate 40 further includes an overcoat layer 44 that covers the color filter 43.

The substrate 41 is made of glass or other material that transmits visible light and infrared light. A black matrix 42 is formed in the second region DR2 of the substrate 41. The black matrix 42 is made of a material that has a visible light and infrared light transmittance of 30% or less, preferably 1% or less, for example. The black matrix 42 is located at the boundary between each pixel, and has a portion 42x extending in the x-axis direction and a portion 42y extending in the y-axis direction. As described above, the black matrix 42 is not formed in the first region DR1 of the substrate 41.

The color filter 43 includes a red filter 43R, a green filter 43G, and a blue filter 43B, and is arranged on the substrate 41. More specifically, one of the red filter 43R, the blue filter 43B, and the green filter 43G is arranged for each pixel. As shown in Figure 11, the red filter 43R, the green filter 43G, and the blue filter 43B are arranged repeatedly in the x-axis direction.

On the other hand, filters of the same color are arranged in the y-axis direction. Therefore, as shown in Figure 9, the red filter 43R, green filter 43G, and blue filter 43B may each be continuous in the y-direction.

As described above, in the second region DR2, the black matrix 42 is disposed, and therefore the boundary between the color filter 43 of each pixel and the color filter of an adjacent pixel is located at the black matrix 42. Therefore, the black matrix 42 prevents color mixing between two colors selected from red, blue, and green between adjacent pixels. In the second region DR2, the color filters 43 between a pair of adjacent pixels may be in contact with each other, or may be spaced apart by a distance smaller than the width of the black matrix.

In contrast, in the first region DR1, it is preferable that the color filter of each pixel be in contact with the color filter of an adjacent pixel. This prevents light from escaping without passing through the color filter at the boundaries of each pixel in the first region DR1 where the black matrix 42 is not formed, even without the black matrix, allowing for accurate color image display.

Furthermore, when the imaging device with display function of this embodiment is used in an automobile instrument panel, the driver will gaze at the liquid crystal panel 50 from the front. Therefore, color mixing between pixels is less likely to occur than when the liquid crystal panel is viewed from an oblique direction, and even if a black matrix is not arranged in the first region DR1, there is less likely to be a significant difference in the display quality of the image displayed in the first region DR1 and the second region DR2.

In this embodiment, the color filter of each pixel does not overlap with a portion of the color filter of an adjacent pixel. However, due to manufacturing errors or other reasons, the color filter of some pixels in the first region DR1 may overlap with a portion of the color filter of an adjacent pixel. A structure that actively utilizes overlapping color filters will be described in the next embodiment.

The backlight 70 is fixed at a predetermined position relative to the liquid crystal panel 50 by a housing 85. In this embodiment, the backlight 70 is a direct-illumination type, and emits white light onto the liquid crystal panel 50 via an optical structure 80. The backlight 70 includes a chassis 71 having a bottom 71a facing the liquid crystal panel, and a plurality of display light-emitting elements 72 arranged on the bottom 71a. The display light-emitting elements 72 are mounted on a mounting board 74 arranged inside the bottom 71a. The display light-emitting elements 72 may be driven element by element or area by area using local dimming. The display light-emitting elements 72 emit white light, for example. Alternatively, the display light-emitting elements 72 may emit blue light or ultraviolet light. In this case, the backlight 70 may further include a wavelength conversion member covering the display light-emitting elements 72, or a wavelength conversion sheet provided above the plurality of display light-emitting elements 72, and may be configured to convert the light emitted from the display light-emitting elements 72 into yellow light or white light, which is then emitted from the backlight 70 and incident on the optical structure 80 as white light.

The backlight 70 further includes at least one infrared light-emitting element 73 mounted on a mounting substrate 74 on the bottom 71a. The infrared light-emitting element 73 emits infrared light, which passes through the liquid crystal panel 50 and illuminates the subject (driver).

The backlight 70 may further include a partition structure 75 disposed on the mounting substrate 74. The partition structure 75 has multiple reflective surfaces 75r and divides the bottom 71a into regions each containing, for example, one or more display light-emitting elements 72. The reflective surfaces 75r prevent the light emitted from the display light-emitting elements 72 from spreading laterally, thereby increasing the brightness of the light emitted from the backlight 70. Furthermore, when the backlight 70 is driven using local dimming, the contrast near the boundary between the lit and unlit sections is increased.

It is preferable that at least one of the reflecting surfaces 75r is located between the focusing lens 63 of the infrared camera 60 (described below) and the infrared light emitting element 73. This prevents infrared light emitted from the infrared light emitting element 73 from directly entering the infrared camera 60.

The infrared camera 60 includes an image sensor 61 and is positioned relative to the liquid crystal panel 50 so that the image sensor 61 is located on the optical path LP of light that has passed through the first region DR1 of the liquid crystal panel 50 from the outside. In this embodiment, the optical path LP is configured to be linear without being bent by a reflector or the like. Therefore, the infrared camera 60 is positioned on the rear side of the liquid crystal panel 50.

Specifically, the infrared camera 60 has a circuit board 62 equipped with a drive circuit for the image sensor 61, and the image sensor 61 is mounted on the circuit board 62. The chassis 71 of the backlight 70 has a chassis through-hole 71h in an area overlapping with the first region DR1 of the bottom 71a, and the circuit board 62 is arranged outside the chassis 71 so that the image sensor 61 is located within the chassis through-hole 71h. By arranging the circuit board 62 outside the chassis 71, an increase in the height of the chassis 71 can be prevented, and a decrease in the in-plane uniformity of the backlight can be prevented.

The infrared camera 60 preferably further includes a condensing lens 63, an infrared transmission filter 64, and a lens barrel 65. The lens barrel 65 surrounds the image sensor 61 and is attached to the circuit board 62, and is inserted into the chassis through-hole 71h. The condensing lens is supported at one end of the lens barrel 65, and the infrared transmission filter 64 is supported on the lens barrel 65 between the condensing lens 63 and the image sensor 61. The condensing lens 63 condenses external light that passes through the optical path PL onto the image sensor 61.

By inserting the lens barrel 65 into the chassis through-hole 71h, the condenser lens 63 is positioned between the bottom 71a of the chassis 71 and the liquid crystal panel 50. This configuration allows the condenser lens 63 to be closer to the liquid crystal panel 50, making it possible to reduce the size of the first region DR1.

The area of the first region DR1 is preferably equal to or larger than the opening area of the focusing lens 63. Furthermore, the opening area of the optical structure through-hole 80h is preferably equal to or larger than the opening area of the focusing lens 63. This prevents the field of view of the infrared camera 60 from being reduced.

Furthermore, it is preferable that the opening area of the optical structure through hole 80h be equal to or smaller than the area of the first region DR1. Furthermore, it is more preferable that the opening area of the optical structure through hole 80h be equal to or larger than the opening area of the focusing lens 63, and that the opening area of the optical structure through hole 80h be equal to or smaller than the area of the first region DR1. By satisfying these relationships, it is possible to further reduce the loss of the field of view of the infrared camera 60.

The infrared transmission filter 64 absorbs visible light and selectively transmits infrared light. For example, the infrared transmission filter 64 has spectral characteristics that make the transmittance at a wavelength of 920 nm higher than the transmittance at a wavelength of 550 nm. By placing the infrared transmission filter 64 with the above-described spectral characteristics between the condenser lens 63 and the image sensor 61, stray visible light can be efficiently suppressed, and the image of the driver obtained by illumination with infrared light can be captured more clearly.

The backlight 70 is arranged on the chassis 71 so as to surround the optical path LP, and may further include a cylindrical light shield 76 that blocks infrared rays. If the infrared camera 60 includes a lens barrel 65, it is preferable that the light shield 76 surround the lens barrel 65.

The light shielding body 76 preferably transmits visible light and absorbs infrared light. For example, the light shielding body 76 preferably has spectral characteristics in which the transmittance at a wavelength of 920 nm is equal to or smaller than the transmittance at a wavelength of 550 nm. The inclusion of the light shielding body 76 prevents infrared light emitted from the infrared light-emitting element 73 of the backlight 70 from directly entering the infrared camera 60, suppressing overexposure and allowing for a clearer image of the driver. Furthermore, by transmitting visible light, even with the inclusion of the light shielding body 76, light emitted from the display light-emitting element 72 can be allowed to enter the optical path LP. This allows light from the backlight 70 to also enter the first region of the liquid crystal panel 50, preventing a decrease in the brightness of the liquid crystal panel 50 in the first region. In other words, when an image on the display device is viewed from the outside, the difference in display quality between the first region DR1 and the second region DR2 can be reduced.

In the image capture device with display function of this embodiment, the liquid crystal panel is driven using the FFS method. Therefore, the liquid crystal panel 50 operates in normally black mode.

In the imaging device with display function of this embodiment, the first region does not have a black matrix, which reduces the effects of diffraction on the image and makes it possible to capture a clear infrared image. Furthermore, the second region is positioned to surround the first region, allowing images to be displayed in both the first and second regions. This means that the infrared camera can be placed behind the LCD panel, making it difficult for the driver to see the area where the camera is located, i.e., the camera hole. This reduces the driver's awareness of the camera hole while driving and the psychological burden it places on them, making it possible to monitor the driver's condition while providing a comfortable driving environment.

In addition, in the image capture device with display function of this embodiment, the liquid crystal panel is driven using the FFS method. Therefore, the liquid crystal panel operates in normally black mode. In other words, areas where no voltage is applied to drive the liquid crystal, such as between pixels, display black. Therefore, even if a black matrix is not formed in the first region, the effects of light leakage during black display are reduced.

In this embodiment, the image capture device with display function has a black matrix in the second region DR2, but the second region DR2 does not have to have a black matrix either. In this case, the opposing substrate of the image capture device with display function has the cross-sectional structure shown in FIG. 7 in the second region as well. In other words, the opposing substrate has the same structure in the first region DR1 and the second region DR2.

In this case, as shown in FIG. 6 , the first region DR1' is defined as the region overlapping with the focusing lens 63 of the infrared camera 60 in a plan view. The first region DR1' is surrounded by the second region DR2'. The second region DR2' is the area in the display region DR other than the first region DR1', and the outer edge of the first region DR1' is in contact with the inner edge of the second region DR2'. The first region DR1' and the second region DR2' are regions defined on the front surface 50a and are defined continuously in the thickness direction of the liquid crystal panel 50. Furthermore, to ensure a sufficient amount of light entering the imaging element, the first region DR1' is preferably large enough to accommodate eight or more of each of the multiple scanning lines 12, multiple data lines 14, multiple TFTs, and multiple pixel electrodes 15.

In this case, the area of the first region DR1' is equal to the opening area of the focusing lens 63. It is also preferable that the opening area of the optical structure through-hole 80h be equal to or larger than the opening area of the focusing lens 63. This prevents the field of view of the infrared camera 60 from being reduced. It is also preferable that the opening area of the optical structure through-hole 80h be equal to or larger than the opening area of the first region DR1'.

Even if the second region DR2' does not have a black matrix, as described above, the effects of diffraction on the image are suppressed, making it possible to capture a clear infrared image. The camera hole is also less visible. In particular, with this configuration, there is no difference in the structure of the liquid crystal panel 50 between the first region DR1' and the second region DR2', making the camera hole even less visible.

Furthermore, because the LCD panel does not have a black matrix across the entire display region DR, the first region DR1' can be set at any position. In other words, no matter which position in the display region DR the image sensor detects, a clear image can be obtained. Therefore, the number and positions of infrared cameras can be changed as desired using the same LCD panel.

It is preferable that the color filter of each pixel be in contact with the color filter of an adjacent pixel over 90% or more of the display region DR, which includes the entire first region DR1 and at least a portion of the second region DR2. Because no black matrix is formed in the first region DR1 or the second region DR2, satisfying this characteristic suppresses light leakage that does not pass through the color filter, enabling the image capture device with display function to display high-quality color images.

Second Embodiment
Figure 12 is a schematic cross-sectional view of the first region DR1 of an imaging device with display function in the x-axis direction, and Figures 13 to 15 are each schematic cross-sectional views of the first region of a pixel in which a red filter, a green filter, and a blue filter are arranged on the opposing substrate of a liquid crystal panel in the y-axis direction.

The imaging device with display function of this embodiment differs from the first embodiment in that two or more different color filters overlap in the area of each pixel in the first region DR1 that borders the boundary with adjacent pixels.

For example, consider a case where three color filters are formed by first forming a green filter 43G, then a red filter 43R, and finally a blue filter 43B. The boundary extending in the y-axis direction between adjacent pairs of pixels can be a combination of red-green, green-blue, and blue-red color filters.

At the boundary between the red and green filters, the end of the green filter 43G and the end of the red filter 43R meet, with the blue filter 43B overlapping on top of them. At the boundary between the green and blue filters, the end of the blue filter 43B overlaps on top of the end of the green filter 43G. At the boundary between the blue and red filters, the end of the blue filter 43B overlaps on top of the end of the red filter 43R.

On the other hand, color filters of the same color are arranged in pixels adjacent in the y-axis direction. For this reason, color filters of different colors are arranged overlapping each other. As shown in Figure 13, at the boundary extending in the x-axis direction between pixels adjacent to red filters 43R in the y-axis direction, striped blue filters 43B extending in the x-axis direction are positioned on top of the red filters 43R, resulting in two or more different color filters overlapping.

Also, as shown in Figure 14, at the boundary extending in the x-axis direction between pixels adjacent to a green filter 43G in the y-axis direction, a striped blue filter 43B extending in the x-axis direction is positioned above the green filter 43G, resulting in two or more different color filters overlapping. As shown in Figure 15, at the boundary extending in the x-axis direction between pixels adjacent to a blue filter 43B in the y-axis direction, a striped red filter 43R extending in the x-axis direction is positioned below the blue filter 43B, resulting in two different color filters overlapping.

The overlap width of two different color filters in the x-axis direction is Wx, the overlap width in the y-axis direction is Wy, the pixel pitch in the x-axis direction is px, and the pixel pitch in the y-axis direction is py, and the overlap width is 0.01 × px≦Wx≦0.2px.
0.01×py≦Wy≦0.2py
It is preferable that the following relationship is satisfied.

This configuration allows the color filters of adjacent pixels to more reliably contact each other. This reduces the possibility of gaps occurring due to manufacturing errors in the formation of the color filters, which could result in the color filters not contacting each other. Furthermore, by overlapping two or more color filters at the boundary between pixels, an area is formed at the boundary between adjacent pixels where neither of the colors of light from the color filters formed in each pixel is transmitted. This suppresses light mixing between adjacent pixels, making it possible to display a clearer image. In particular, this is highly effective in suppressing light mixing between adjacent pixels when viewed obliquely in the x-axis direction.

It is preferable that one of the two color filters overlapping between adjacent pixels is a blue filter. This is because blue filters have low transmittance and low reflectance, and relatively blue-based reflected colors tend to be preferred.

The number of color filters overlapping at the boundary between adjacent pixels in the first region DR1 is not limited to two and may be three or more. In other words, the image capture device with display function of this embodiment may differ from the first embodiment in that three or more different color filters overlap in the region of each pixel in the first region DR1 that abuts the boundary with an adjacent pixel.

Figure 16 is a schematic cross-sectional view in the x-axis direction of the first region DR1 of an imaging device with display function, and Figures 17 to 19 are schematic cross-sectional views in the y-axis direction of the first region of a pixel in which a red filter, a green filter, and a blue filter are arranged on the opposing substrate of a liquid crystal panel.

In pixels arranged in the x-axis direction, at the boundary between the red and green filters, the end of the red filter 43R overlaps the end of the green filter 43G. Furthermore, a striped blue filter 43B extending in the y-axis direction is placed on top of that. At the boundary between the green and blue filters, the red filter 43R extending in the y-axis direction is placed on top of the end of the green filter 43G, and the blue filter 43B is placed on top of that. At the boundary between the blue and red filters, the end of the red filter 43R overlaps the green filter 43G extending in the y-axis direction, and the end of the blue filter 43B overlaps that.

On the other hand, color filters of the same color are arranged in adjacent pixels in the y-axis direction. For this reason, color filters of different colors extending in the x-axis direction are arranged in an overlapping manner. As shown in Figure 17, at the boundary extending in the x-axis direction between pixels adjacent to a red filter 43R in the y-axis direction, the red filter 43R is arranged on top of a striped green filter 43G extending in the x-axis direction, and a blue filter 43B extending in the x-axis direction is arranged on top of that.

Also, as shown in Figure 18, at the boundary extending in the x-axis direction between pixels adjacent to a green filter 43G in the y-axis direction, a striped red filter 43R extending in the x-axis direction is superimposed on the green filter 43G, and a striped blue filter 43B extending in the x-axis direction is further superimposed on that. As shown in Figure 19, at the boundary extending in the x-axis direction between pixels adjacent to a blue filter 43B in the y-axis direction, a striped red filter 43R extending in the x-axis direction is superimposed on a striped green filter 43G extending in the x-axis direction, and a blue filter 43B is further superimposed on that. The preferred value for the overlapping width of three different color filters is as described above.

In this way, three or more different color filters overlap at the boundary between adjacent pixels, creating an area at the boundary between adjacent pixels where no light of any color passes. This suppresses light mixing between adjacent pixels, making it possible to display a clearer image. In particular, when observed obliquely in the x-axis direction, this is highly effective in suppressing light mixing between adjacent pixels.

In this embodiment, two or more different color filters overlap in the region in contact with the boundary between adjacent pixels in the first region DR1, and a black matrix 42 is formed in the second region DR2, as in the first embodiment. However, as described in the first embodiment, the opposing substrate in the second region may also not have a black matrix, and two or more different color filters may overlap in the region in contact with the boundary between adjacent pixels. This makes the structure of each pixel the same in the first region DR1 and the second region DR2, allowing images to be displayed with inconspicuous differences in display quality between the first region DR1 and the second region DR2.

Furthermore, the order in which the color filters are layered depends on the order in which they are formed, and the image capture device with display function disclosed herein is not limited to the specific structure described in this embodiment. For example, if the color filters are formed on the opposing substrate in the order of red filter 43R, blue filter 43B, and green filter 43G, the green filter 43G can be replaced with red filter 43R, red filter 43R with blue filter 43B, and blue filter 43B with green filter 43G in the structure described above.

(Third embodiment)
20 is a schematic cross-sectional view of an image pickup device with a display function of this embodiment. The image pickup device with a display function differs from the first embodiment in that it includes an edge-type backlight 70'.

The backlight 70' includes a chassis 71, a light guide plate 77, a display light-emitting element, and an infrared light-emitting element. The light guide plate 77 is disposed on the bottom 71a of the chassis 71. The backlight 70' may further include a reflective sheet 78 between the bottom 71a of the chassis 71 and the light guide plate 77.

The display light-emitting element 72 and the infrared light-emitting element 73 are mounted on a mounting substrate 74' and are arranged inside the chassis 71 so that the display light-emitting element 72 and the infrared light-emitting element 73 face the side surface 77c of the light guide plate 77. While the figure shows one display light-emitting element 72 and one infrared light-emitting element 73, the display light-emitting element 72 and the infrared light-emitting element 73 can be arranged on the side surface 77c of the light guide plate 77 depending on the required brightness.

The light guide plate 77 has a through-hole 77h at a position overlapping the first region DR1 in a plan view, and the lens barrel 65 of the infrared camera 60 is inserted into the through-hole 77h. The light shield 76 is also disposed within the through-hole 77h.

In the backlight 70', similar to the display light-emitting elements 72, infrared light-emitting elements 73 are arranged on the side surface 77c of the light guide plate 77. This allows the infrared light-emitting elements 73 to emit light from the display region DR and can be used as illumination light when capturing images.

Therefore, even if the backlight 70' is an edge type, as described in the first embodiment, the first region does not have a black matrix, so the effects of diffraction images on the image are suppressed, making it possible to obtain clear infrared images.

The infrared light emitting element 73 does not have to be positioned corresponding to the side surface 77c of the light guide plate, but may be positioned facing the main surface. For example, as shown in FIG. 21 , the infrared light emitting element 73 is mounted on the circuit board 62 of the infrared camera 60. In a plan view, through holes 78h' and 71h' are formed in the reflective sheet 78 and the bottom 71a of the chassis 71, respectively, at positions overlapping the infrared light emitting element 73. The through holes 78h' and 71h' are located at positions overlapping the infrared light emitting element 73 and the second region DR2 of the liquid crystal panel 50 in a plan view.

With this configuration, the infrared light emitting elements 73 are positioned opposite the main surface of the light guide plate 77, and infrared light can be emitted from the back of the liquid crystal panel 50 toward the outside. The illumination light for photographing the driver can be emitted from the vicinity of the periphery of the first region DR1. Therefore, even if the backlight is an edge-type, the number of infrared light emitting elements 73 used for illumination can be reduced by arranging the infrared light emitting elements 73 in a direct-type position.

(Fourth embodiment)
22 is an exploded perspective view of the main components of the liquid crystal panel of the image pickup device with a display function of this embodiment. The liquid crystal panel of the image pickup device with a display function of this embodiment has a different structure from the liquid crystal panel of the first embodiment.

22, the plurality of pixel electrodes 15 includes a plurality of first pixel electrodes 15A and a plurality of second pixel electrodes 15B. The first pixel electrodes 15A and the second pixel electrodes 15B are arranged alternately in the x-axis direction. That is, one of the plurality of first pixel electrodes 15A
One of the plurality of second pixel electrodes 15B is adjacent to another in the x-axis direction. Furthermore, adjacent first pixel electrode 15'A and second pixel electrode 15'B share one data line 14. From another perspective, the pixel electrodes 15 are arranged two-dimensionally in the x and y directions, so that an adjacent pair of first pixel electrode 15A and second pixel electrode 15B is arranged between a pair of data lines 14 adjacent to another in the x-axis direction.

The multiple scanning lines 12 also include multiple first scanning lines 12A and multiple second scanning lines 12B. Each of the multiple scanning lines 12 is associated with a pixel electrode 15 arranged in the x-axis direction, with the first scanning line 12A associated with a first pixel electrode 15A and the second scanning line 12B associated with a second pixel electrode 15B. Of the multiple scanning lines, the first scanning line 12A of one scanning line 12 is located at the top end of the pixel electrodes 15 arranged in the x-axis direction, and the multiple second scanning lines 12B are located at the bottom end. From another perspective, the pixel electrodes 15 are arranged two-dimensionally in the x and y directions, so one of the multiple first scanning lines 12A and one of the multiple second scanning lines 12B is located between a pair of pixel electrodes 15 adjacent in the y-axis direction.

The first pixel electrode 15'A and the second pixel electrode 15'B, which are arranged on either side of one data line 14, are scanned by different scanning lines. Specifically, the first pixel electrode 15'A is scanned by the first scanning line 12A via TFT-A, and the second pixel electrode 15'B is scanned by the second scanning line 12B via TFT-B.

Each data line 14 is located between a pair of first and second pixel electrodes (first pixel electrode 15'A and second pixel electrode 15'B) arranged in the x-axis direction and drives both of these pixel electrodes. In other words, one data line 14 is shared by the two pixels (pixel electrodes 15'A and 15'B) that sandwich it. Because the two pixels are different, different data signals must be supplied at different times. This doubles the total number of scan lines. In other words, two scan lines 12A and 12B are required to operate adjacent pixels in the x-axis direction (pixel electrodes 15'A and 15'B). Furthermore, because one data line is shared by two pixels, the writing time is also reduced by approximately half. However, the total number of data lines is also half that of a typical LCD panel. In other words, the data lines 14 are arranged at a pitch twice the pixel pitch in the x-axis direction.

As mentioned above, when capturing an image using infrared light through a black matrix, significant overlapping images are detected in the x-axis direction depending on the shape of the pixels. This is because the spacing between the diffraction images is inversely proportional to the slit spacing d, and the smaller the spacing of the black matrix, the larger the spacing between the diffraction images.

In the imaging device with display function disclosed herein, a black matrix is not formed in the first region of the liquid crystal panel, reducing the effects of diffraction images caused by the black matrix. However, as liquid crystal panels become higher resolution and the pixel pitch becomes smaller, the data lines made of metal, in addition to the black matrix, can also cause diffraction images. In this case, by adopting the structure of this embodiment and making the data line pitch twice the pixel pitch, the slit spacing can be doubled, preventing the spacing between diffraction images from becoming larger.

In other words, according to this embodiment, even when a high-resolution LCD panel is used, it is possible to prevent the spacing between diffraction images from widening and the image from becoming blurred.

Fifth Embodiment
23 and 24 are, respectively, a schematic cross-sectional view and a schematic plan view of a main portion of a liquid crystal panel of an image capture device with a display function of this embodiment. The image capture device with a display function of this embodiment includes an optical structure 180 having a different shape from that of the first embodiment. Furthermore, the image capture device with a display function of this embodiment does not include a light shielding body, and the liquid crystal panel does not have a black matrix throughout the entire display region DR. As described in the first embodiment, the first region DR1′ is defined as the region overlapping with the condenser lens 63 of the infrared camera 60 in a plan view, and the liquid crystal panel has a color filter but does not have a black matrix in the first region DR1′. The first region DR1′ is located on the optical path of light incident on the image capture element 61 of the infrared camera 60.

Specifically, the imaging device with display function of this embodiment comprises a liquid crystal panel 50 having a display region DR, an infrared camera 60 having a condenser lens 63, an imaging element 61, and a lens barrel 65 that supports the condenser lens 63 at a predetermined gap relative to the imaging element 61, a backlight 70 disposed on the rear surface of the liquid crystal panel 50, and an optical structure 180 disposed between the liquid crystal panel 50 and the backlight 70.

As described above, the optical structure 180 includes at least one optical sheet having an optical function. In this embodiment, as shown in FIG. 23, the optical structure 180 includes a brightness enhancement film 81 and a diffuser 182. The diffuser 182 has a first major surface 182a and a second major surface 182b. The first major surface 182a is located on the side of the bottom 71a of the backlight 70, and the second major surface 182b is located on the side of the liquid crystal panel 50.

The diffuser 182 has a recess 182d disposed in the first major surface 182a and a through-hole 182h located between the bottom surface of the recess 182d and the second major surface 182b. The opening area Sh of the through-hole 182h is smaller than the area Sd of the bottom surface of the recess 182d. It is also preferable that the depth Dh of the through-hole 182h is smaller (shallower) than the depth Dd of the recess 182d. In plan view, the through-hole 182h of the diffuser 182 overlaps with the lens barrel 65. The area of the through-hole 182h in plan view is also smaller than the area of the lens barrel 65. In other words, it is preferable that the entire through-hole 182h overlaps with the lens barrel 65 in plan view. Such a structure of the diffuser 182, particularly the depth Dh of the through-hole 182h and the depth Dd of the recess 182d, satisfying the above-mentioned relationship prevents infrared light that enters the condenser lens 63 at an angle through the through-hole 182h from being blocked by the diffuser 182, preventing the angle of view of the infrared camera from becoming narrow.

At least a portion of the diffuser 182 is disposed within the chassis 71 of the backlight 70. In this embodiment, the entire diffuser 182 is disposed within the chassis 71. In other words, the diffuser 182 is close to the bottom 71a of the chassis 71. Furthermore, at least a portion of the lens barrel 65 is located within the recess 182d of the diffuser 182. In particular, it is preferable that the condenser lens 63 supported by the lens barrel 65 be located within the recess 182d.

Light incident on the diffuser 182 from the display light-emitting elements 72 of the backlight 70 is repeatedly diffused within the diffuser 182 and then emitted from the second major surface 182b while diffusing, as indicated by the arrows. As described above, in a plan view, the through-hole 182h of the diffuser 182 overlaps with the lens barrel 65, and the area of the through-hole 182h is smaller than the area of the lens barrel 65. Therefore, even in the area where the lens barrel 65 and the diffuser 182 overlap in a plan view, light is emitted perpendicularly from the second major surface 182b of the diffuser 182. Furthermore, the light emitted from the second major surface 182b also travels obliquely and spreads above the through-hole 182h. In other words, within the diffuser 182, light is guided to the boundary with the through-hole 182h, where it is diffused near the boundary and emitted obliquely, passing through the liquid crystal panel 50 and reaching the viewer. Therefore, in a plan view, the decrease in brightness in the area of the display region DR that overlaps with the lens barrel 65 is suppressed, and the uniformity of the light emitted from the backlight 70 within the display region DR can be improved.

In particular, according to this embodiment, the area of the through-hole 182h can be made smaller than the area of the lens barrel 65, thereby increasing the area within the lens barrel 65 in a plan view from which light can be emitted perpendicularly from the second major surface 182b. Therefore, according to this embodiment, regardless of the cross-sectional area of the lens barrel 65 or the diameter of the condenser lens, the opening of the through-hole 182h can be made smaller, thereby reducing the area in the display region DR where brightness decreases.

Furthermore, by forming the recess 182d in the diffuser 182, it is easy to align the diffuser 182 with the lens barrel 65 that holds the condenser lens 63, etc., and misalignment can be suppressed even if the opening area of the through-hole 182h is small. In particular, if the alignment accuracy between the through-hole 182h and the lens barrel 65 is poor, it is necessary to enlarge the opening of the through-hole 182h to ensure the amount of light required for imaging. However, according to this embodiment, this design is not necessary. Therefore, it is possible to further reduce the opening area of the through-hole 182h and improve the uniformity of brightness within the display region DR.

Furthermore, if the diffuser 182 having the recess 182d and the through-hole 182h is constructed, for example, from two components, an air layer interface occurs between the two components within the diffuser 182. Because light is reflected at the air layer interface, the light transmittance from the first major surface 182a to the second major surface 182b may decrease, and the light distribution near the through-hole 182h and the recess 182d may become uneven. In contrast, by constructing the diffuser 182 from a single component, it is possible to suppress such a decrease in light transmittance and uneven light distribution, and increase the uniformity of brightness within the display region DR. Furthermore, since the diffuser 182 is a single component, assembly is easy.

In this embodiment, the infrared light emitting elements 73 irradiate the subject directly with infrared light without passing through the liquid crystal panel 50. For this reason, the image capture device with display function of this embodiment is equipped with a housing 185. The housing 185 has a holding portion 185d in the non-display region NR located outside the display region DR, and multiple infrared light emitting elements 73 are arranged in the holding portion 185d. Also, as in the first embodiment, the housing 185 holds the backlight 70 in a predetermined position relative to the liquid crystal panel 50.

With this configuration, the infrared light emitting element 73 is positioned in the non-display region NR, and the infrared light emitted from the infrared light emitting element 73 for photography reaches the subject directly without passing through the liquid crystal panel 50. Therefore, compared to when the infrared light emitting element 73 is positioned on the rear side of the liquid crystal panel 50 within the display region DR, infrared light is prevented from becoming stray light within the backlight 70 and entering the imaging element 61 of the infrared camera 60. This makes it possible to capture clear images. In particular, this effect can be achieved even without the light shield 76.

Figure 25 is a schematic cross-sectional view of the main parts of another example of an imaging device with a display function according to this embodiment. The diffuser 182 of the optical structure 180 includes a first diffuser plate 182A and a second diffuser plate 182B. The first diffuser plate 182A and the second diffuser plate 182B have a first through-hole 182Ah and a second through-hole 182Bh, respectively. The first through-hole 182Ah and the second through-hole 182Bh each have, for example, a simple cylindrical shape, and the opening area of the second through-hole 182Bh is larger than the opening area of the first through-hole 182Ah.

The first diffuser plate 182A and the second diffuser plate 182B are stacked so that the axis of the first through-hole 182Ah and the axis of the second through-hole 182Bh are aligned. Furthermore, the second diffuser plate 182B is closer to the bottom 71a of the backlight 70 than the first diffuser plate 182A.

By constructing the diffuser from two plate-shaped members in this way, the recesses and through-holes in the diffuser 182 can be formed more easily, reducing the manufacturing costs of the diffuser 182. Furthermore, because the diffuser 182 is constructed from two members, the optical properties of the first diffuser plate 182A and the second diffuser plate 182B can be made different, allowing the optical function of the entire diffuser to be adjusted. For example, material costs can be reduced by reducing the haze value of the second diffuser plate 182B.

In this embodiment, the infrared light emitting elements 73 are arranged in the non-display region NR, but as in the first embodiment, the infrared light emitting elements 73 may be arranged in the backlight 70. Figure 26 is a schematic plan view showing an example of the arrangement of multiple display light emitting elements 72 and multiple infrared light emitting elements 73 in the backlight 70.

A plurality of display light-emitting elements 72 and a plurality of infrared light-emitting elements 73 are arranged on the bottom 71a of the chassis 71. Specifically, for example, the plurality of display light-emitting elements 72 are arranged at equal intervals in the x-axis direction and the y-axis direction. Each of the plurality of infrared light-emitting elements 73 is arranged, for example, between four adjacent display light-emitting elements 72. In this embodiment, the plurality of infrared light-emitting elements 73 are arranged at equal intervals in the x-axis direction and the y-axis direction. The arrangement pitch of the infrared light-emitting elements 73 is greater than the arrangement pitch of the display light-emitting elements 72. For example, in this embodiment, the arrangement pitch of the infrared light-emitting elements 73 is four times the arrangement pitch of the display light-emitting elements 72. Furthermore, in this embodiment, the infrared light-emitting element 73 is arranged in the center of four adjacent infrared light-emitting elements 73. Furthermore, the lens barrel 65 is arranged between the display light-emitting elements 72 arranged at equal intervals and is arranged between four adjacent display light-emitting elements 72.

With this configuration, the infrared light-emitting elements are arranged in the backlight, allowing the frame area to be narrowed. Furthermore, by arranging multiple infrared light-emitting elements 73 at equal intervals, infrared light for photography can be emitted uniformly. Furthermore, by making the arrangement pitch of the infrared light-emitting elements larger than the arrangement pitch of the display light-emitting elements, the infrared light-emitting elements can be arranged at a greater distance from the focusing lens 63 of the infrared camera 60. This prevents infrared light emitted from the infrared light-emitting elements 73 from directly entering the infrared camera 60 as stray light. Furthermore, because the arrangement pitch of the display light-emitting elements 72 remains constant even around the lens barrel 65, a uniform display with little reduction in brightness can be obtained even around the lens barrel 65.

Sixth Embodiment
27 is a schematic cross-sectional view of the main parts of the image pickup device with a display function of this embodiment. The image pickup device with a display function of this embodiment differs from the fifth embodiment in that the optical structure 280 further includes a second diffuser 84.

The second diffuser 84 is disposed, for example, between the liquid crystal panel and the brightness enhancement film 81 or the diffuser 182 of the optical structure 280. The gap Sp1 between the second diffuser 84 and the liquid crystal panel 50 is preferably smaller than the gap Sp2 between the second diffuser 84 and the diffuser 182. In a plan view, the second diffuser 84 overlaps the entire first region DR1' and the entire second region DR2'.

The second diffuser 84 has a higher haze value for visible light than for infrared light. Furthermore, the second diffuser 84 has a lower rectilinear transmittance for visible light than for infrared light. In other words, the second diffuser 84 diffuses visible light more than infrared light. The second diffuser 84, which has such optical properties, can be constructed from a film, substrate, or the like, sandwiching a polymer-dispersed liquid crystal (PDLC) therebetween.

This embodiment differs from the fifth embodiment in that visible light from the backlight diffused by the diffuser 182 is diffused again by the second diffuser 84 immediately before entering the liquid crystal panel 50. In the fifth embodiment, the visible light spreading above the through-hole 182h is light traveling in an oblique direction, while the area other than the through-hole 182h contains light traveling in both an oblique direction and a vertical direction. In this embodiment, light traveling in an oblique direction above the through-hole 182h enters the second diffuser 84 and is diffused again, and is emitted from the second diffuser 84 in both vertical and oblique directions. Of course, in areas other than above the through-hole 182h, light that enters the second diffuser 84 is diffused again and is emitted from the second diffuser 84 in both vertical and oblique directions. In this way, by providing the second diffuser 84, the diffusion state of the light exiting the second diffuser 84 is consistent between above the through-hole 182h and other areas.

This structure further scatters visible light from the backlight, making the boundary between the first region DR1' and the second region DR2' less noticeable. In particular, when the liquid crystal panel 50 displays white or a high-brightness image, the decrease in brightness in the first region DR1' is suppressed, making the first region DR1' less noticeable. Meanwhile, the small haze value for infrared light allows infrared images to be captured with good resolution.

Furthermore, because gap Sp2 is larger than gap Sp1, as described with reference to FIG. 23, more light reaches above through-hole 182h, suppressing the decrease in brightness and differences in the diffusion state of light in first region DR1', and improving the uniformity of the light emitted from backlight 70 within display region DR.

Seventh Embodiment
In the imaging devices with display function according to the first to sixth embodiments, the backlight 70 is controlled to be constantly lit as the backlight of a typical liquid crystal panel, or to be periodically turned off to insert a black image display by pseudo-impulse driving. There are no particular limitations on the timing of operation of the infrared camera 60 and the infrared light-emitting element 73 for imaging. For example, the infrared light-emitting element 73 may be constantly lit to allow the infrared camera 60 to capture images constantly, or the infrared light-emitting element 73 may be constantly lit to allow the infrared camera 60 to capture images only for a predetermined period within one frame period.

In contrast, in the imaging device with display function of this embodiment, the timing of lighting the backlight 70 and the timing of lighting the infrared light-emitting element 73 are correlated. Figure 28 is a timing chart showing the operation timing of each part of the imaging device with display function of this embodiment. In Figure 28, (a) shows the scanning timing of the liquid crystal panel 50, (b) shows the transmittance of the liquid crystal panel, and (c) shows the timing of lighting the backlight 70. Also, (d) shows the timing of lighting the infrared light-emitting element 73, and (e) shows the timing of imaging by the infrared camera 60. (a) shows the position where the scanning line (gate line) is turned ON during one scanning period of the liquid crystal panel 50, and (b) shows the transmittance of the liquid crystal panel at the timing indicated by the circle in (a) when the entire liquid crystal panel 50 is displayed in a uniform neutral color. In the figure, the shades of black and white indicate differences in transmittance, with white indicating high transmittance and black indicating low transmittance. (c) and (d) show the timing when the backlight 70 and infrared light emitting element 73 are turned on and illuminated at a high level. (e) shows the timing when the infrared camera 60 is capturing an image at a high level. In each chart, the horizontal axis indicates the passage of time.

Generally, in a liquid crystal panel, during one scanning period, the scanning lines arranged in the column direction (vertical direction) are selected sequentially from top to bottom, and a voltage is applied to the selected scanning line. This turns on the switching element of the pixel connected to the selected scanning line, and charge accumulates between the pixel electrode and the opposing electrode. A voltage corresponding to the amount of charge is generated in the pixel electrode, and the liquid crystal in the liquid crystal layer is oriented in accordance with the voltage. As a result, light passes through that pixel at a specified transmittance.

The switching element then turns OFF, but ideally the accumulated charge would be maintained, so the voltage would not change and the light transmittance would remain constant. However, in reality, when the switching element turns OFF, the charge accumulated in the pixel gradually leaks out and the voltage on the pixel electrode drops. This causes the light transmittance to gradually decrease.

For this reason, as shown in (b), at timing S1 when the bottom end is scanned during one scanning period, the pixels connected to the top scanning line are charged at the very beginning of the scanning period, resulting in the smallest transmittance due to the greatest charge leakage. On the other hand, the pixels connected to the bottom end were charged immediately before, resulting in the smallest charge leakage and the highest transmittance.

In contrast, at times S2 to S4, when the scanning position of the scanning line is between the top and bottom edges, the previously scanned scanning line and the next scanned scanning line are adjacent to each other, so the pixel with the highest transmittance and the pixel with the lowest transmittance are adjacent to each other. The higher the transmittance of the liquid crystal panel 50, the higher the brightness of the liquid crystal panel 50 due to the backlight 70. For this reason, at times S2 to S4, the display area of the liquid crystal panel 50 exhibits streaky brightness unevenness (streaky unevenness) with the brightest and darkest areas adjacent to each other across the scanning position.

When the backlight 70 is always on, the scanning position of the scanning line moves sequentially from the top to the bottom during one scanning period, so the brightness unevenness described above is averaged out and not noticeable. However, if the backlight 70 is periodically turned off at a timing synchronized with one scanning period and the infrared light-emitting element is turned on during that period, streak-like unevenness will occur in specific positions. Furthermore, if the turning-off of the backlight 70 is not synchronized with one scanning period, the brightness distribution of the liquid crystal panel 50 will change from moment to moment. In particular, if there is a slight mismatch between the scanning period of the liquid crystal panel 50 and the blinking period of the backlight, beat noise will occur, in which the position of the streak-like unevenness moves (flows) at a constant speed at a frequency corresponding to that mismatch.

In the imaging device with display function of this embodiment, the backlight 70 is generally turned off when scanning of the liquid crystal panel 50 ends, the infrared light emitting element 73 is turned on, and imaging is performed by the infrared camera 60. For example, as shown in FIG. 28, the infrared camera 60 captures images in a period before and after the end of one scanning period of the liquid crystal panel 50. The infrared light emitting element 73 is turned on slightly earlier than the imaging period, and is turned off slightly after the end of the imaging period of the infrared camera 60. The backlight 70 is on while the infrared light emitting element 73 is off. In other words, the backlight 70 is off while the infrared light emitting element 73 is on.

The backlight 70 extinguishing cycle and the infrared light emitting element 73 illuminating cycle coincide with the scanning cycle of the liquid crystal panel 50. As described above, the timing of the backlight 70 extinguishing and the infrared light emitting element 73 illuminating, as well as the timing of the infrared camera 60 capturing images, generally coincide with the end of one scanning period of the liquid crystal panel 50, i.e., the timing when the bottom scanning line is scanned.

The backlight 70, infrared light-emitting element 73, and infrared camera 60 may also be controlled at the timing shown in Figures 29 to 31. In the example shown in Figure 29, the backlight 70 is turned off, the infrared light-emitting element 73 is turned on, and the infrared camera 60 takes an image when the bottom end of a scan line and the bottom portion of the multiple scan lines immediately preceding it are scanned. In the example shown in Figure 30, the backlight 70 is turned off, the infrared light-emitting element 73 is turned on, and the infrared camera 60 takes an image when the top end of a scan line and the top portion of the multiple scan lines immediately following it are scanned. In the example shown in Figure 31, a scanning line rest period is provided between scanning periods, and in the period after scanning of the liquid crystal panel 50 is completed and before the start of the next scan, the backlight 70 is turned off, the infrared light-emitting element 73 is turned on, and the infrared camera 60 takes an image.

By performing this type of control, the backlight 70 is turned off when the infrared camera 60 is capturing an image. This reduces the impact of visible light from the backlight 70 during capture, enabling the infrared camera 60 to capture a clear image. Specifically, even if the visible light blocking performance of the infrared transmission filter 64 of the infrared camera 60 is insufficient, visible light will not reach the image sensor 61, so a clear image can be captured without an increase in the black level of the captured image or a decrease in the S/N ratio.

Furthermore, by fixing the scanning position of the panel when the backlight is turned off, it is possible to suppress beat noise and other issues that can be caused by changes in brightness due to the turning off of the backlight 70. Furthermore, by turning off the backlight 70 approximately when scanning of the liquid crystal panel 50 ends, after scanning of the liquid crystal panel ends and before the next scan begins, or when scanning the upper or lower edge of the display area, it is possible to suppress the occurrence of streaks and other issues and reduce their impact on the image display.

Eighth Embodiment
32 is a schematic cross-sectional view of the main part of the image pickup device with a display function of this embodiment. The image pickup device with a display function of this embodiment differs from the sixth embodiment in that it further includes a half mirror 98.

The half mirror 98 is disposed in front of the liquid crystal panel 50. In this embodiment, the half mirror 98 is located between the cover glass 90 and the liquid crystal panel 50. The half mirror 98 covers the entire display region DR, and in a plan view, the half mirror overlaps the entire through-hole 182h of the diffuser 182.

The half mirror 98 preferably has a higher transmittance for infrared light than for visible light. For example, the transmittance of the half mirror 98 at a wavelength of 940 nm is preferably greater than the transmittance at a wavelength of 550 nm. A half mirror 98 with such optical properties can be constructed using a dielectric multilayer film.

With this configuration, the imaging device with display function of this embodiment also functions as a mirror. Therefore, it can be suitably used, for example, as a vehicle rearview mirror. Specifically, it can be used as an electronic mirror by displaying an image from a camera capturing an image of the area behind the vehicle on the LCD panel 50. It can also be used as a regular mirror, depending on the driver's choice, or if the power source driving the imaging device with display function is lost.

Furthermore, because the driver needs to look at the rearview mirror, it is unlikely that any obstacles will be placed between the driver and the rearview mirror. For this reason, the imaging device with display function of this embodiment, which is placed in the position of the rearview mirror, can reliably capture an image of the driver using the infrared camera 60, making it possible to appropriately monitor the driver's condition.

In addition, the half mirror 98 has high infrared transmittance, allowing for the acquisition of high-quality infrared images.

(Other forms)
The imaging device with a display function disclosed herein can be modified in various ways. First, the driving method of the liquid crystal panel is not limited to FFS; the liquid crystal panel may be driven using IPS or other driving methods. Furthermore, in this embodiment, the optical path of light passing through the first regions DR1 and DR1′ and incident on the imaging element 61 of the infrared camera 60 is linear; however, the optical path may be bent in a direction parallel to the rear surface 50b of the liquid crystal panel 50 by a mirror or the like. In this case, the infrared camera can be disposed on the side of the liquid crystal panel 50, thereby reducing the overall thickness of the imaging device with a display function. Furthermore, two or more of the first to eighth embodiments can be combined as long as no contradictions exist.

In addition, in the first to eighth embodiments, the imaging device with display function was equipped with an optical structure having a diffuser plate. However, if the display light-emitting elements and infrared light-emitting elements in the backlight are covered with a diffuser member or the like and uniform light is emitted from the backlight, the optical structure may not include a diffuser plate. In this case, the optical structure may not have a through-hole, and light that has passed through the first region may further pass through the optical structure and enter the imaging element. Furthermore, since the optical function of the optical structure is provided in the backlight, the imaging device with display function may not need to include an optical structure.

Furthermore, by including the backlight, optical structure, and infrared camera described above, the imaging device with display function of the fifth embodiment can suppress a decrease in brightness in the area of the liquid crystal panel where the infrared camera is located, even if the infrared camera is placed on the backlight side, making the presence of the infrared camera less noticeable. Such a configuration including a backlight, optical structure, and infrared camera can be called an imaging device with a light source for an liquid crystal panel, and achieves the effects described above.

Specifically, the imaging device with a light source for a liquid crystal panel disclosed in the fifth embodiment comprises a backlight having display light-emitting elements, an optical structure including a diffuser positioned to transmit light emitted from the display light-emitting elements, and an infrared camera having a condensing lens, an imaging element, and a lens barrel that supports the condensing lens at a predetermined gap relative to the imaging element, with at least a portion of the lens barrel positioned closer to the backlight than the diffuser, the diffuser having a through-hole that overlaps with the lens barrel in a planar view, and the area of the through-hole in a planar view is smaller than the area of the lens barrel.

This type of imaging device with a light source for an LCD panel can be used not only in display devices for instrument panels, but also in imaging devices with display functions that can display images without drawing attention to the presence of the imaging device. Furthermore, depending on the use of the images captured by the imaging device, or as long as the captured images can be subjected to appropriate image processing according to the use, the images captured by the infrared camera do not necessarily need to be clear. For this reason, the imaging device with a light source for an LCD panel of the fifth embodiment can be combined with an LCD panel with a black matrix arranged in front of it, and such a combination can also realize an imaging device with a display function that makes the presence of the infrared camera less noticeable.

The imaging device with display function disclosed herein can also be described as follows.

An imaging device with a display function according to a first configuration of the present disclosure includes:
An LCD panel,
an infrared camera having a condenser lens and an image sensor;
The backlight located on the back,
An imaging device with a display function,
the liquid crystal panel has a display area including a first area and a second area positioned so as to surround the first area in a plan view;
At least the imaging element of the infrared camera is disposed on an optical path of the light transmitted through the first region and the condenser lens;
The liquid crystal panel does not have a black matrix in at least the first region, and has color filters in the first region and the second region.

In the first configuration, the first region does not have a black matrix, which suppresses the effects of diffraction on the image and makes it possible to capture a clear infrared image. Furthermore, the second region is positioned to surround the first region, allowing images to be displayed in both the first and second regions. This means that the infrared camera can be placed on the back of the LCD panel, rather than at the edge. Therefore, for example, when using this imaging device with display function to photograph a driver, it is possible to monitor the driver's condition while providing a comfortable driving environment without the driver being aware of the presence of a camera (and without putting pressure on them).

An imaging device with a display function according to another first configuration of the present disclosure includes:
a liquid crystal panel having a display area;
an infrared camera having a condenser lens and an image sensor;
a backlight disposed on the rear surface;
An imaging device with a display function,
at least an imaging element of the infrared camera is disposed on a display area of the liquid crystal panel and on an optical path of light transmitted through the condenser lens;
The liquid crystal panel does not have a black matrix in the display area, but has a color filter.

The imaging device with display function according to the second configuration may be the first configuration, wherein the color filter of each pixel is in contact with the color filter of an adjacent pixel in the first region. By having the color filters of each pixel in contact with each other in the first region, leakage of light that does not pass through the filter is suppressed, even without a black matrix, and a correct color display image can be produced.

The image capture device with display function according to the third configuration is the first configuration, wherein the liquid crystal panel may have a black matrix in the second region that is arranged so as to overlap at least the boundary between adjacent pixels. By having a black matrix in the second region, light leakage can be suppressed.

The fourth configuration of the imaging device with display function is the first configuration, wherein the color filter of each pixel is in contact with the color filter of an adjacent pixel in 90% or more of the display area, which includes the entire first area and at least a part of the second area. Since the first area and the second area do not have a black matrix, the difference in visibility between the first area and the second area when viewing the screen can be reduced.

In the fifth configuration of the imaging device with display function, in the first configuration, the color filter may have at least three or more different monochrome filters, and two or more different monochrome filters may overlap in an area of each pixel in the first region where the pixel borders the boundary with an adjacent pixel. By overlapping two or more monochrome filters at the pixel boundary, the transmittance of visible light is reduced and light mixing between adjacent pixels is suppressed.

In the sixth configuration of the imaging device with display function, in the first configuration, the color filter may have at least three or more different monochrome filters, and two or more different monochrome filters may overlap in the area of each pixel in the entire first region and at least a part of the second region that borders the boundary with adjacent pixels.

In the seventh configuration of the imaging device with display function, in the first configuration, the color filter may have at least three or more different monochromatic filters, and the three or more different monochromatic filters may overlap in an area of each pixel in the first region where the pixel borders the boundary with an adjacent pixel. By overlapping three or more monochromatic filters at the pixel boundary, the transmittance of visible light is further reduced and light mixing between adjacent pixels is suppressed.

The eighth configuration of the imaging device with display function is the fourth configuration, wherein the color filter has at least three or more different monochrome filters, and the three or more different monochrome filters may overlap in the area of each pixel in the entire first region and at least a part of the second region that borders the boundary with adjacent pixels.

The ninth configuration of the imaging device with display function is the first configuration, wherein the infrared camera further includes a focusing lens positioned on the optical path between the liquid crystal panel and the imaging element, and the area of the first region may be equal to or larger than the aperture area of the focusing lens.

The imaging device with display function according to the tenth configuration is the first configuration, further comprising a first polarizing plate disposed in front of the liquid crystal panel and a second polarizing plate disposed between the liquid crystal panel and the backlight, and the first polarizing plate and the second polarizing plate may overlap the first region and the second region. Since the polarizing plate does not need to be processed, costs can be reduced. An image can be displayed in the first region in the same way as in the second region.

The imaging device with display function according to the eleventh configuration is the same as the first configuration, but further includes an optical structure including at least one optical sheet disposed between the second polarizing plate and the backlight, the optical structure having an optical structure through-hole in an area overlapping with the first area. Because the optical structure is not positioned in the optical path of the infrared camera, a clear image can be obtained.

The imaging device with display function according to the twelfth configuration is the eleventh configuration, and the opening area of the optical structure through-hole may be equal to or larger than the opening area of the condenser lens. This prevents the camera's field of view from being lost.

The imaging device with display function according to the thirteenth configuration may be the eleventh configuration, wherein the opening area of the optical structure through-hole is equal to or smaller than the area of the first region.

The imaging device with display function according to the fourteenth configuration may be the eleventh configuration, wherein the opening area of the optical structure through-hole is equal to or larger than the opening area of the lens, and the opening area of the optical structure through-hole is equal to or smaller than the area of the first region.

The imaging device with display function according to the fifteenth configuration is the ninth configuration, wherein the backlight includes a chassis having a bottom facing the display area and a plurality of display light-emitting elements arranged on the bottom, and the condenser lens may be located between the bottom of the chassis and the liquid crystal panel.

The imaging device with display function according to the sixteenth configuration is the fifteenth configuration, wherein the backlight further includes at least one infrared light-emitting element arranged on the bottom. With this configuration, infrared light for imaging can be emitted from directly in front of the driver. Furthermore, by arranging the element on the bottom, stray light can be prevented from entering the focusing lens.

The imaging device with display function according to the seventeenth configuration is the fifteenth configuration, wherein the backlight has a plurality of reflective surfaces respectively positioned between a plurality of display light-emitting elements, and further includes a partition structure disposed on the bottom of the chassis, and one of the plurality of reflective surfaces may be positioned between at least one infrared light-emitting element and the condenser lens.

The imaging device with display function according to the eighteenth configuration is the ninth configuration, wherein the backlight includes a chassis having a bottom facing the display area, a light guide plate disposed on the bottom, and display light-emitting elements disposed on the side of the light guide plate, and the condenser lens may be located between the bottom of the chassis and the liquid crystal panel.

The imaging device with display function according to the 19th configuration is the 18th configuration, wherein the backlight further includes infrared light-emitting elements arranged on the side surfaces of the light guide plate.

The imaging device with display function according to the twentieth configuration may be the 18th configuration, wherein the backlight further includes at least one infrared light-emitting element arranged opposite the main surface of the light guide plate.

The imaging device with display function according to the 21st configuration is the 14th or 18th configuration, wherein the infrared camera further includes a circuit board equipped with a drive circuit for driving the imaging element, the imaging element is mounted on the circuit board, the chassis has a chassis through-hole provided in a position overlapping the first region in a plan view, and the circuit board may be disposed outside the chassis so that the imaging element is located within the chassis through-hole. This configuration reduces the thickness of the backlight and prevents deterioration of the in-plane uniformity of the backlight.

The imaging device with display function according to the 22nd configuration is the 9th configuration, and the infrared camera may further include an infrared transmission filter arranged in the optical path and having a higher transmittance at a wavelength of 920 nm than at a wavelength of 550 nm. This suppresses stray visible light.

The imaging device with display function according to the 23rd configuration may be the 22nd configuration, but the infrared transmission filter may be located between the condenser lens and the imaging element. This allows stray light to be efficiently suppressed.

The imaging device with display function according to the 24th configuration is the 9th configuration, wherein the backlight is arranged within the chassis so as to surround the optical path, and may further include a cylindrical light shield that blocks infrared rays. This makes it possible to suppress stray infrared light.

The imaging device with display function according to the 25th configuration may be the 24th configuration, wherein the transmittance of the light blocking body at a wavelength of 920 nm is equal to or less than the transmittance at a wavelength of 550 nm. This makes it possible to suppress stray infrared light.

In the imaging device with display function according to the 26th configuration, in the 25th configuration, the light shielding body may transmit visible light. By transmitting visible light through the light shielding body, light emitted from the backlight can also reach the first region, preventing the first region from becoming dark.

An imaging device with a display function according to a twenty-seventh configuration is the first configuration,
The liquid crystal panel includes a TFT substrate, a counter substrate, and a liquid crystal layer disposed between the TFT substrate and the counter substrate,
The TFT substrate is
a plurality of scanning lines disposed in a display area, extending in a first direction and arranged in a second direction different from the first direction;
a plurality of data lines extending in a second direction and arranged in a first direction;
a plurality of switching elements respectively connected to one of the plurality of scanning lines and one of the plurality of data lines;
The liquid crystal display may further include a plurality of pixel electrodes connected to the plurality of switching elements, respectively, and arranged two-dimensionally in the first direction and the second direction.

The imaging device with display function according to the 28th configuration may be the 27th configuration, in which eight or more of each of the multiple scanning lines, multiple data lines, multiple switching elements, and multiple pixel electrodes are located within the first region of the liquid crystal panel.

The imaging device with display function of the 29th configuration is the 27th configuration, wherein the plurality of scanning lines, the plurality of data lines, the plurality of switching elements, and the plurality of pixel electrodes are located in a first region and a second region of the liquid crystal panel, respectively, and the area of the pixel electrodes in the first region may be in the range of 0.5 to 1.5 times the area of the pixel electrodes in the second region.

The imaging device with display function according to the 30th configuration is the 27th configuration, wherein the multiple scanning lines, multiple data lines, multiple switching elements, and multiple pixel electrodes are located in a first region and a second region of the liquid crystal panel, respectively, and the spacing between adjacent scanning lines in the first region may be in the range of 0.5 to 1.5 times the spacing between adjacent scanning lines in the second region.

The imaging device with display function according to the thirty-first configuration is the twenty-seventh configuration, wherein the multiple scanning lines, multiple data lines, multiple switching elements, and multiple pixel electrodes are located in a first region and a second region of the liquid crystal panel, respectively, and the spacing between adjacent data lines in the first region may be in the range of 0.5 to 1.5 times the spacing between adjacent data lines in the second region.

The imaging device with display function according to the 32nd configuration is the 27th configuration, wherein the multiple scanning lines, multiple data lines, multiple switching elements, and multiple pixel electrodes are located in a first region and a second region of the liquid crystal panel, respectively, and the spacing between adjacent switching elements in the first region may be in the range of 0.5 to 1.5 times the spacing between adjacent switching elements in the second region.

The imaging device with display function according to the thirty-third configuration is the twenty-seventh configuration, wherein the multiple scanning lines, multiple data lines, multiple switching elements, and multiple pixel electrodes are located in a first region and a second region of the liquid crystal panel, respectively; the area of the pixel electrodes in the first region is between 0.5 and 1.5 times the area of the pixel electrodes in the second region; the spacing between adjacent scanning lines in the first region is between 0.5 and 1.5 times the spacing between adjacent scanning lines in the second region; and the spacing between adjacent data lines in the first region is between 0.5 and 1.5 times the spacing between adjacent data lines in the second region. According to the twenty-eighth to thirty-first configurations, an integrated image or video can be displayed in the first and second regions without the need for special image processing.

The imaging device with display function according to the thirty-fourth configuration is the twenty-seventh configuration, wherein the plurality of pixel electrodes includes a plurality of first pixel electrodes and a plurality of second pixel electrodes, and one of the plurality of first pixel electrodes and one of the plurality of second pixel electrodes are adjacent in the first direction and may be disposed between a pair of data lines adjacent in the first direction. By reducing the number of data lines, even if the pixel pitch becomes smaller, the spacing between the data lines forming the diffraction grating is widened, thereby preventing the spacing between the diffraction images from widening and the image from becoming unclear.

The imaging device with display function according to the thirty-fifth configuration is the thirty-fourth configuration, wherein the plurality of scanning lines includes a plurality of first scanning lines and a plurality of second scanning lines, one of the plurality of first scanning lines and one of the plurality of second scanning lines are arranged between pixel electrodes adjacent in the second direction among the plurality of pixel electrodes, and the first pixel electrode and second pixel electrode arranged between an adjacent pair of data lines may be connected to the first scanning line and the second scanning line, respectively, via switching elements. This allows the number of data lines to be reduced.

In the imaging device with a display function according to the thirty-sixth configuration, in the first configuration, the liquid crystal panel may operate in normally black mode. This makes it possible to suppress light leakage when displaying black.

An imaging device with a display function according to a thirty-seventh configuration of the present disclosure includes:
a liquid crystal panel having a display area;
an infrared camera having a condenser lens, an image sensor, and a lens barrel that supports the condenser lens at a predetermined gap relative to the image sensor;
a backlight disposed on the rear surface of the liquid crystal panel;
an optical structure disposed between the liquid crystal panel and the backlight and including a diffuser;
Equipped with
The diffuser has through holes,
In a plan view, the through hole of the diffuser overlaps with the lens barrel,
The area of the through hole in the plan view is smaller than the area of the lens barrel.

This configuration allows light from the diffuser to enter the lens barrel area and also reduces the opening area of the through-hole. This reduces the area of the infrared camera, where brightness is likely to decrease, making the infrared camera less noticeable. It also improves the uniformity of the light emitted from the backlight within the display area.

The imaging device with display function according to the 38th configuration is the 37th configuration, wherein the diffuser has a first main surface located on the backlight side, a second main surface located on the liquid crystal panel side, and a recessed portion disposed in the first main surface, the through-hole is located between the bottom surface of the recessed portion and the second main surface, and a portion of the lens barrel is located within the recessed portion of the diffuser.

This configuration makes it easy to align the diffuser with the lens barrel that holds the focusing lens, and because the diffuser is a single component, assembly is also easy.

The imaging device with display function according to the thirty-ninth configuration may be the thirty-seventh configuration, further comprising at least one infrared light-emitting element arranged in a non-display area located outside the display area. This configuration prevents infrared light emitted from the infrared light-emitting element used for imaging from becoming stray light within the backlight and entering the infrared camera. This makes it possible to capture clear images.

The imaging device with display function according to the fortieth configuration may be the thirty-seventh configuration, wherein the backlight includes a chassis having a bottom facing the display area, and a plurality of display light-emitting elements and a plurality of infrared light-emitting elements arranged on the bottom.

With this configuration, the infrared light-emitting elements are placed in the backlight, allowing for a narrower frame area. Furthermore, by arranging multiple display light-emitting elements and multiple infrared light-emitting elements at equal intervals, infrared light for photography can be emitted uniformly. Furthermore, by making the arrangement pitch of the infrared light-emitting elements larger than the arrangement pitch of the display light-emitting elements, it is possible to arrange the infrared light-emitting elements at a greater distance from the infrared camera, preventing infrared light emitted from the infrared light-emitting elements from directly entering the infrared camera as stray light.

The imaging device with display function according to the 41st configuration may be the 37th configuration, wherein the diffuser includes a first diffuser plate and a second diffuser plate, the first diffuser plate and the second diffuser plate have a first through hole and a second through hole, respectively, the opening area of the second through hole is larger than the opening area of the first through hole, and the first diffuser plate and the second diffuser plate may be stacked so that the axis of the first through hole and the axis of the second through hole coincide with each other.

With this configuration, the diffuser can be formed more easily by constructing it from two plate-shaped members. Furthermore, by differentiating the optical properties of the first and second diffusers, the optical function of the entire diffuser can be adjusted. For example, material costs can be reduced by reducing the haze value of the second diffuser.

The imaging device with display function according to the 42nd configuration is the 37th configuration, wherein the optical structure further includes a second diffuser positioned between the liquid crystal panel and the diffuser, and the second diffuser may have a greater haze value for visible light than for infrared light.

With this configuration, the through-holes in the diffuser eliminate vertical diffusion of visible light from the backlight in the region above the through-holes, and only diffused light exiting obliquely from the area surrounding the through-holes in the diffuser is present. The second diffuser diffuses light emitted from the diffuser in both vertical and oblique directions, allowing visible light from the backlight to exit vertically in the region above the through-holes. Therefore, light emitted from the second diffuser exits vertically and obliquely in the region above the through-holes, just like in regions other than above the through-holes, eliminating any difference in the diffusion state of light between the through-holes and other regions. In other words, this structure effectively scatters visible light from the backlight, making the boundary between the first and second regions less noticeable. Furthermore, the haze value of the second diffuser for infrared light is smaller than that for visible light, enabling infrared images to be captured with good resolution. The imaging device with display function according to the 43rd configuration may be the 1st or 37th configuration, wherein the infrared camera captures images during at least part of the period when the backlight is off. With this configuration, imaging with the infrared camera is performed when the backlight is off, thereby suppressing the effect of visible light from the backlight on imaging and enabling the infrared camera to capture clear images.

The imaging device with display function of the 44th configuration may be the 43rd configuration, further comprising an infrared light-emitting element, and the backlight may be turned off when scanning of the liquid crystal panel is completed, after scanning of the liquid crystal panel is completed and before the next scan is started, or when scanning the upper or lower end of the display area.
This makes it possible to suppress beat noise and the like that may be caused by a change in brightness due to the backlight being turned off, and to suppress the influence on image display.

The imaging device with display function according to the forty-fifth configuration may be the thirty-seventh configuration, further comprising a half mirror disposed in front of the liquid crystal panel, and the entire through-hole of the diffuser may overlap with the half mirror in a plan view.

With this configuration, the imaging device with display function can also function as a mirror. Furthermore, by applying it to an in-vehicle rearview mirror, it is possible to monitor the driver without getting into any obstacles.

The image capture device with display function according to the 46th configuration is the 45th configuration, wherein the transmittance of the half mirror at a wavelength of 940 nm may be greater than the transmittance at a wavelength of 550 nm. With this configuration, better infrared images can be obtained.

The imaging device with a light source for a liquid crystal panel according to the 47th configuration of the present disclosure is any of the 36th to 46th configurations, in which the liquid crystal panel has a color filter on the optical path of light that passes through the through-holes of the diffuser and the condenser lens to reach the imaging element, and may not have a black matrix.

An imaging device with a light source for a liquid crystal panel according to a forty-eighth configuration of the present disclosure includes:
a backlight having a display light-emitting element;
an optical structure including a diffuser disposed at a position where light emitted from the display light emitting element passes through;
an infrared camera having a condenser lens, an image sensor, and a lens barrel that supports the condenser lens with a predetermined gap relative to the image sensor, with at least a portion of the lens barrel being located closer to the backlight than the diffuser;
Equipped with
The diffuser has through holes,
In a plan view, the through hole of the diffuser overlaps with the lens barrel,
The area of the through hole in the plan view is smaller than the area of the lens barrel.

This configuration reduces the area of the infrared camera where brightness is likely to decrease, providing an imaging device with a light source for an LCD panel that makes the infrared camera less noticeable.

The imaging device with a light source for a liquid crystal panel according to the 49th configuration is the 48th configuration, wherein the diffuser has a first main surface located on the backlight side, a second main surface located on the liquid crystal panel side, and a recessed portion disposed in the first main surface, the through-hole is located between the bottom surface of the recessed portion and the second main surface, and another portion of the lens barrel is located within the recessed portion of the diffuser.

10...TFT substrate, 11...substrate, 12...scanning line, 12A...first scanning line, 12B...second scanning line, 12b...gate electrode, 13...insulating layer, 14...data line, 14'...data line, 14s...source electrode, 15...pixel electrode, 15A...first pixel electrode, 15B...second pixel electrode, 16...insulating layer, 17...semiconductor layer, 18...drain electrode, 19...counter electrode, 19s...slit, 30...liquid crystal layer, 40...counter substrate, 41...substrate, 42...black matrix, 42x, 42y...portion of black matrix, 43...color filter, 43B...blue filter, 43G...green filter, 43R...red filter, 50...liquid crystal panel, 50a...front surface, 50b...rear surface, 60...infrared camera, 61...imaging element, 62...circuit board, 63...condensing lens, 64...infrared transmission filter , 65...lens barrel, 70, 70'...backlight, 71...chassis, 71a...bottom, 71h...chassis through-hole, 71h'...through-hole, 72...display light-emitting element, 73...infrared light-emitting element, 74, 74'...mounting substrate, 75...partition structure, 75r...reflective surface, 76...light-shielding body, 77...light guide plate, 77c...side surface, 77h...through-hole, 78...reflective sheet, 78h...through-hole, 80, 180, 280 ...Optical structure, 80h...Optical structure through-hole, 81...Brightness enhancement film, 81h...Through-hole, 82...Diffuser, 82h...Through-hole, 85, 185...Housing, 90...Cover glass, 91...First polarizer, 92...Second polarizer, 98...Half mirror, 101...Image capture device with display function, 182 Diffuser, 182A...First diffuser, 182B...Second diffuser, 182d...Recess, 182h...Through-hole

Claims (19)

An LCD panel,
an infrared camera having a condenser lens and an image sensor;
a backlight disposed on the rear surface of the liquid crystal panel;
An imaging device with a display function,
the liquid crystal panel has a display area including a first area and a second area positioned so as to surround the first area in a plan view;
at least an imaging element of the infrared camera is disposed on an optical path of light transmitted through the first region and the condenser lens,
the liquid crystal panel does not have a black matrix in at least the first region, and has color filters in the first region and the second region;
An imaging device with a display function capable of displaying color images in the first area and the second area . The imaging device with display function described in claim 1, wherein in the first region, the color filter of each pixel is in contact with the color filter of an adjacent pixel. The image capture device with display function described in claim 2, wherein the liquid crystal panel has a black matrix arranged in the second region so as to overlap at least the boundary between adjacent pixels. The image capture device with display function described in claim 2, wherein the color filter has at least three different monochrome filters, and two or more different monochrome filters overlap in the region of each pixel in the first region that borders the boundary with an adjacent pixel. The imaging device with display function described in claim 1, wherein the area of the first region is equal to or larger than the aperture area of the focusing lens. The backlight is
a chassis having a bottom facing the display area;
a plurality of display light-emitting elements disposed on the bottom;
2. The image pickup device with a display function according to claim 1, wherein the condenser lens is located between the bottom of the chassis and the liquid crystal panel. the infrared camera further includes a circuit board having a drive circuit for driving the image sensor;
the imaging element is mounted on the circuit board,
the chassis has a chassis through-hole provided at a position overlapping with the first region in a plan view,
The image pickup device with a display function according to claim 6 , wherein the circuit board is disposed outside the chassis so that the image pickup element is located inside the chassis through-hole. The imaging device with display function described in claim 1, wherein the infrared camera further includes an infrared transmission filter disposed on the optical path and having a higher transmittance at a wavelength of 920 nm than at a wavelength of 550 nm. The imaging device with display function described in claim 6, wherein the backlight is arranged within the chassis so as to surround the optical path and further includes a cylindrical light shield that blocks infrared rays. the liquid crystal panel includes a TFT substrate, a counter substrate, and a liquid crystal layer disposed between the TFT substrate and the counter substrate;
The TFT substrate is
a plurality of scanning lines disposed in the display area, extending in a first direction and arranged in a second direction different from the first direction;
a plurality of data lines extending in the second direction and arranged in the first direction;
a plurality of switching elements respectively connected to one of the plurality of scanning lines and one of the plurality of data lines;
a plurality of pixel electrodes connected to the plurality of switching elements, respectively, and arranged two-dimensionally in the first direction and the second direction; the plurality of scanning lines, the plurality of data lines, the plurality of switching elements, and the plurality of pixel electrodes are located in the first region and the second region of the liquid crystal panel, respectively;
2. The image pickup device with a display function according to claim 1, wherein the interval between adjacent scanning lines in the first region is in the range of 0.5 to 1.5 times the interval between adjacent scanning lines in the second region. a liquid crystal panel having a display area;
an infrared camera having a condenser lens, an imaging element, and a lens barrel that supports the condenser lens with a predetermined gap relative to the imaging element;
a backlight disposed on the rear surface of the liquid crystal panel;
an optical structure disposed between the liquid crystal panel and the backlight and including a diffuser;
An imaging device with a display function,
The diffuser is
a first main surface located on the backlight side;
a second main surface located on the liquid crystal panel side;
a recess disposed in the first major surface;
a through hole located between a bottom surface of the recess and the second main surface ;
and
the condenser lens is supported at a tip end side of the lens barrel, and a part of the tip end side of the lens barrel is located within the recess of the diffuser,
In a plan view, the through hole of the diffuser overlaps with the lens barrel,
an area of the through hole in the plan view is smaller than an area of the lens barrel;
An imaging device with a display function. the diffuser includes a first diffusion plate and a second diffusion plate, the first diffusion plate and the second diffusion plate have a first through hole and a second through hole, respectively, an opening area of the second through hole is larger than an opening area of the first through hole, and the first diffusion plate and the second diffusion plate are stacked so that an axis of the first through hole and an axis of the second through hole coincide with each other , whereby the first through hole and the second through hole respectively constitute the through hole and the recess .
The imaging device with a display function according to claim 11. The imaging device with display function described in claim 11, wherein the backlight comprises a chassis having a bottom facing the display area, and a plurality of display light-emitting elements and a plurality of infrared light-emitting elements arranged on the bottom. The imaging device with display function described in claim 11, wherein the optical structure further includes a second diffuser positioned between the liquid crystal panel and the diffuser, and the second diffuser has a higher haze value for visible light than for infrared light. The imaging device with display function described in claim 11, wherein the infrared camera captures images during at least a portion of the period when the backlight is off. 16. The imaging device with display function according to claim 15, further comprising an infrared light-emitting element, wherein the backlight is turned off when scanning of the liquid crystal panel ends, when scanning of the liquid crystal panel ends and before starting a next scan, or when scanning an upper end portion or a lower end portion of the display area. a half mirror disposed in front of the liquid crystal panel;
In a plan view, the through-hole of the diffuser entirely overlaps with the half mirror.
The imaging device with a display function according to claim 11. The transmittance of the half mirror at a wavelength of 940 nm is greater than the transmittance at a wavelength of 550 nm.
18. The imaging device with a display function according to claim 17 . 19. The imaging device with display function described in any one of claims 11 to 18, wherein the liquid crystal panel has a color filter and does not have a black matrix on the optical path of light that passes through the through hole of the diffuser and the focusing lens and reaches the imaging element.