JP4581409B2 - Optical display device, control program for optical display device, and control method for optical display device - Google Patents

Description

  The present invention relates to an apparatus, a program, and a method for controlling the light propagation characteristics of an optical system that modulates light from a light source via a plurality of light modulation elements, and in particular, realizes an increase in the luminance dynamic range and the number of gradations. And a light propagation characteristic control device, an optical display device, a light propagation characteristic control program, a control program for the optical display device, and a light propagation characteristic control suitable for simplifying the arithmetic processing and reducing the table size and generation time. The present invention relates to a method and a control method of an optical display device.

In recent years, LCD (Liquid Crystal Display), EL, plasma display, CRT (Cathode Ray Tube), projectors, and other optical display devices have seen remarkable improvements in image quality, and the resolution and color gamut have achieved performance that is almost comparable to human visual characteristics. It is being done. However, regarding the luminance dynamic range, the reproduction range is limited to about 1 to 10 ² [nit], and the number of gradations is generally 8 bits. On the other hand, human visual perception has a luminance dynamic range perceived at a time of about 10 ⁻² to 10 ⁴ [nit], and the luminance discrimination capability is about 0.2 [nit], which is the number of gradations. Is converted to 12 bits. Looking at the display image of the current optical display device through such visual characteristics, the narrowness of the luminance dynamic range is conspicuous, and in addition, the reality and power of the display image are insufficient due to the lack of gradation in the shadow part and highlight part. Will feel unsatisfactory.

  Further, in computer graphics (hereinafter abbreviated as CG) used in movies, games, etc., display data (hereinafter referred to as HDR (High Dynamic Range) display data) that represents a luminance dynamic range and gradation number close to human vision. The movement of pursuing the reality of depiction is being mainstream. However, since the performance of the optical display device that displays it is insufficient, there is a problem that the expressive power inherent in the CG content cannot be fully exhibited.

  Further, the next OS (Operating System) is scheduled to adopt a 16-bit color space, and the luminance dynamic range and the number of gradations are dramatically increased as compared with the current 8-bit color space. Therefore, it is desired to realize an optical display device that can make use of the 16-bit color space.

  Among optical display devices, projection display devices such as liquid crystal projectors and DLP projectors are capable of displaying on a large screen and are effective in reproducing the reality and power of display images. In this field, the following proposals have been made to solve the above problems.

  As a projection display device with a high dynamic range, for example, there is a technique disclosed in Patent Document 1, which includes a light source, a first light modulation element that modulates luminance in the entire wavelength region of light, and a wavelength region of light. Among these, each wavelength region of the RGB three primary colors is provided with a second light modulation element that modulates the luminance of the wavelength region, the light from the light source is modulated by the first light modulation element to form a desired luminance distribution, and its optical image Is imaged on the pixel surface of the second light modulation element, color-modulated, and then second-order modulated light is projected. Each pixel of the first light modulation element and the second light modulation element is individually controlled based on the first control value and the second control value determined from the HDR display data. As the light modulation element, a transmittance modulation element having a pixel structure or a segment structure whose transmittance can be controlled independently and capable of controlling a two-dimensional transmittance distribution is used. A typical example is a liquid crystal light valve. Further, a reflectance modulation element may be used instead of the transmittance modulation element, and a representative example thereof is DMD.

  Consider a case where a light modulation element having a dark display transmittance of 0.2% and a bright display transmittance of 60% is used. With a single light modulation element, the luminance dynamic range is 60 / 0.2 = 300. Since the conventional projection display apparatus corresponds to optically arranging light modulation elements having a luminance dynamic range of 300 in series, a luminance dynamic range of 300 × 300 = 90000 can be realized. The same idea holds for the number of gradations, and an 8-bit gradation light modulation element is optically arranged in series, whereby a gradation number exceeding 8 bits can be obtained.

  In addition, as a projection display device that realizes a high luminance dynamic range, for example, a projection display device disclosed in Non-Patent Document 1 and a display device disclosed in Patent Document 2 are known. .

In both the inventions described in Non-Patent Document 1 and Patent Document 2, LCD is used as the first light modulation element, and modifiable illumination such as LED or fluorescent lamp is used as the second light modulation element.
Helge Seetzen, Lorne A. Whitehead, Greg Ward, "A High Dynamic Range Display Using Low and High Resolution Modulators", SID Symposium 2003, pp. 1450-1453 (2003) Japanese Patent Laid-Open No. 2001-1000068 JP 2002-99250 A

The HDR display data is image data capable of realizing a high luminance dynamic range that cannot be realized by a conventional image format such as sRGB, and stores pixel values indicating pixel luminance levels for all pixels of the image. When the luminance level of the pixel p in the HDR display data is Rp, the transmittance of the pixel corresponding to the pixel p of the first light modulation element is T1, and the transmittance of the pixel corresponding to the pixel p of the second light modulation element is T2. The following expressions (1) and (2) hold.

Rp = Tp × Rs (1)
Tp = T1 × T2 × G (2)

However, in the above formulas (1) and (2), Rs is the luminance of the light source, G is the gain, and both are constants. Tp is a light modulation rate.

  Thus, for the pixel p, it is necessary to determine one of T1 and T2 and calculate the other of T1 and T2 by the above equations (1) and (2). Here, when the first light modulation element and the second light modulation element have the same resolution, the pixels of the first light modulation element and the pixels of the second light modulation element correspond one-to-one. It is relatively easy. However, when the first light modulation element and the second light modulation element have different resolutions, the pixel p1 of one pixel p1 of the first light modulation element overlaps with a plurality of pixels of the second light modulation element on the optical path. Therefore, when trying to obtain an accurate value as the transmittance T1 of the pixel p1, the average value and the like of the transmittance T2 of the plurality of overlapping pixels of the second light modulation element are calculated, and the calculated average value and the HDR are calculated. There has been a problem that the arithmetic processing becomes complicated, such as calculation by the above formulas (1) and (2) based on the display data.

  In the invention described in Non-Patent Document 1, only the fact that a high luminance dynamic range can be realized when two light modulation elements are used is conceptually explained. Based on the HDR display data, the first light modulation element and It has not been disclosed how to determine the control values (ie, T1 and T2) of each pixel of the second light modulation element. Therefore, when the first light modulation element and the second light modulation element have different resolutions, similarly, there is a problem that the arithmetic processing becomes complicated.

  On the other hand, in the invention described in Patent Document 2, since the number of gradation tables corresponding to the number of gradations of the backlight is held, an attempt to increase the number of gradations of the backlight is accompanied accordingly. There is a problem that the size of the gradation table and the time required to generate the gradation table increase.

  Therefore, the present invention has been made paying attention to such an unsolved problem of the conventional technique, and realizes an expansion of the luminance dynamic range and the number of gradations, simplifies the arithmetic processing, and the table. Providing Light Propagation Characteristic Control Device, Optical Display Device, Light Propagation Characteristic Control Program, Optical Display Device Control Program, Light Propagation Characteristic Control Method, and Optical Display Device Control Method Suitable for Reducing Size and Generation Time The purpose is to do.

[Invention 1] In order to achieve the above object, a light propagation characteristic control device of Invention 1 comprises:
A first light modulation element in which a plurality of pixels whose light propagation characteristics can be controlled independently is arranged in a matrix, and a plurality of pixels whose light propagation characteristics can be controlled independently in a matrix, and the first light modulation element A device applied to an optical system that modulates light from a light source via a second light modulation element having a different resolution from
Light propagation characteristic determining means for determining the light propagation characteristic of each pixel of the first light modulation element based on the light propagation characteristic of each pixel of the second light modulation element and display data; and a pixel array of the light modulation element Pixel value matrix conversion means for converting a pixel value matrix in which the pixel values of the pixels are arranged in a matrix to correspond to pixel value matrices of different sizes,
The pixel value matrix conversion means includes: a first pixel array arranged along a specific direction in a conversion source pixel value matrix; and a second pixel arranged along the specific direction in a conversion destination pixel value matrix. For the column, the pixel value V2n of the n-th pixel p2n of the second pixel column is the same as the first pixel column and the second pixel, assuming that the total length of the first pixel column and the second pixel column is the same. For each of the k pixels p1k of the first pixel column that overlaps the pixel p2n when the columns are overlapped, the pixel value V1k of the pixel p1k is set based on the degree of overlap of the pixel p2n and the pixel p1k in the length direction. Weighting is performed, and the weighting result is calculated as a total value for all of the pixels p1k.
The calculation of the pixel value V2n is performed for all the pixels in the second pixel column, and is further performed for all the pixel columns in the specific direction in the pixel value matrix of the conversion source,
The light propagation characteristic determination means performs conversion by the pixel value matrix conversion means at least once based on the light propagation characteristics of each pixel of the second light modulation element and the display data, thereby allowing the first light modulation element to The light propagation characteristics of each pixel are calculated.

  With such a configuration, the light value propagation characteristic determination means performs the conversion by the pixel value matrix conversion means at least once based on the light propagation characteristics and display data of each pixel of the second light modulation element, The light propagation characteristics of each pixel of the light modulation element are calculated. In this conversion, the pixel value V2n of the pixel p2n is weighted to the pixel value V1k of the pixel p1k based on the degree of overlap of the pixel p2n and the pixel p1k in the length direction for each pixel p1k. The sum is calculated for all of the pixels p1k. The pixel value V2n is calculated for all the pixels in the second pixel column, and further for all the pixel columns in a specific direction in the pixel value matrix of the conversion source.

  Thereby, since the light from the light source is modulated via the first light modulation element and the second light modulation element, an effect that a relatively high luminance dynamic range and gradation number can be realized is obtained. Similarly, the conversion process for the pixel columns arranged along the specific direction in the pixel value matrix is similarly performed for all the other pixel columns, and the entire conversion process for the pixel value matrix is performed at least once. Therefore, when the first light modulation element and the second light modulation element have different resolutions, the arithmetic processing for calculating the light propagation characteristics of each pixel of the first light modulation element is relatively simple as compared to the conventional case. The effect of becoming is also obtained. Furthermore, since it is not necessary to maintain the number of gradation tables corresponding to the number of gradations, even if the number of gradations is increased, the size of the gradation table and the generation time are greatly increased compared to the conventional case. The effect that there is no is also acquired.

  Here, the light propagation characteristic refers to a characteristic that affects the propagation of light, and includes, for example, light transmittance, reflectance, refractive index, and other propagation characteristics. Hereinafter, the optical display device of the invention 2 and 4, the light propagation characteristic control program of the invention 10, the control program of the optical display device of the invention 11 and 13, the light propagation characteristic control method of the invention 19, and the optical display device of the invention 20 and 22 The same control method is used.

  The light source may be any medium that generates light. For example, the light source may be a light source built in an optical system such as a lamp, or may be a sun or indoor light. It may be an external light source. The same applies to the light propagation characteristic control program of the tenth invention and the light propagation characteristic control method of the nineteenth invention.

[Invention 2] On the other hand, in order to achieve the above object, an optical display device of Invention 2 comprises:
A first light modulation element in which a light source and a plurality of pixels whose light propagation characteristics can be independently controlled are arranged in a matrix, and a plurality of pixels whose light propagation characteristics can be independently controlled are arranged in a matrix and the first A device for displaying an image by modulating light from the light source via the first light modulation element and the second light modulation element. And
Temporary light propagation characteristic deciding means for tentatively determining the light propagation characteristic of each pixel of the second light modulation element, and the first light modulation based on the light propagation characteristic and the display data tentatively decided by the light propagation characteristic tentative decision means A first light propagation characteristic determining means for determining a light propagation characteristic of each pixel of the element; and a control value of each pixel of the first light modulation element based on the light propagation characteristic determined by the first light propagation characteristic determining means. First control value determining means for determining, second light for determining light propagation characteristics of each pixel of the second light modulation element based on the light propagation characteristics determined by the first light propagation characteristic determining means and the display data Propagation characteristic determining means, second control value determining means for determining a control value of each pixel of the second light modulation element based on the light propagation characteristic determined by the second light propagation characteristic determination means, and the light modulation element The pixel value of the pixel corresponding to the pixel array of And a pixel value matrix conversion means for converting the pixel value matrix arranged in a matrix form in the pixel value matrix of different sizes,
The pixel value matrix conversion means includes: a first pixel array arranged along a specific direction in a conversion source pixel value matrix; and a second pixel arranged along the specific direction in a conversion destination pixel value matrix. For the column, the pixel value V2n of the n-th pixel p2n of the second pixel column is the same as the first pixel column and the second pixel, assuming that the total length of the first pixel column and the second pixel column is the same. For each of the k pixels p1k of the first pixel column that overlaps the pixel p2n when the columns are overlapped, the pixel value V1k of the pixel p1k is set based on the degree of overlap of the pixel p2n and the pixel p1k in the length direction. Weighting is performed, and the weighting result is calculated as a total value for all of the pixels p1k.
The calculation of the pixel value V2n is performed for all the pixels in the second pixel column, and is further performed for all the pixel columns in the specific direction in the pixel value matrix of the conversion source,
The first light propagation characteristic determining unit is configured to transmit the light propagation of the first light modulation element in units of pixels of the second light modulation element based on the light propagation characteristic temporarily determined by the light propagation characteristic temporary determination unit and the display data. Characteristics are calculated, and light propagation characteristics of each pixel of the first light modulation element are calculated by performing conversion by the pixel value matrix conversion means at least once based on the calculated light propagation characteristics. It is characterized by.

  With such a configuration, the light propagation characteristic provisional determination means provisionally determines the light propagation characteristic of each pixel of the second light modulation element. Next, the first light propagation characteristic determining means calculates the light propagation characteristic of the first light modulation element for each pixel of the second light modulation element based on the temporarily determined light propagation characteristic and display data, and calculates the calculated light. Conversion by the pixel value matrix conversion means is performed at least once based on the propagation characteristics, and the light propagation characteristics of each pixel of the first light modulation element are calculated. In this conversion, the pixel value V2n of the pixel p2n is weighted to the pixel value V1k of the pixel p1k based on the degree of overlap of the pixel p2n and the pixel p1k in the length direction for each pixel p1k. The sum is calculated for all of the pixels p1k. The pixel value V2n is calculated for all the pixels in the second pixel column, and further for all the pixel columns in a specific direction in the pixel value matrix of the conversion source.

  Next, the first control value determining means determines the control value of each pixel of the first light modulation element based on the determined light propagation characteristic of the first light modulation element. Then, the second light propagation characteristic determining means determines the light propagation characteristic of each pixel of the second light modulation element based on the determined light propagation characteristic and display data of the first light modulation element, and determines the second control value. The control value of each pixel of the second light modulation element is determined by the means based on the determined light propagation characteristic of the second light modulation element.

  Thereby, since the light from the light source is modulated via the first light modulation element and the second light modulation element, an effect that a relatively high luminance dynamic range and gradation number can be realized is obtained. Similarly, the conversion process for the pixel columns arranged along the specific direction in the pixel value matrix is similarly performed for all the other pixel columns, and the entire conversion process for the pixel value matrix is performed at least once. Therefore, when the first light modulation element and the second light modulation element have different resolutions, the arithmetic processing for calculating the light propagation characteristics of each pixel of the first light modulation element is relatively simple as compared to the conventional case. The effect of becoming is also obtained. Furthermore, since it is not necessary to maintain the number of gradation tables corresponding to the number of gradations, even if the number of gradations is increased, the size of the gradation table and the generation time are greatly increased compared to the conventional case. The effect that there is no is also acquired.

  Here, the second light propagation characteristic determining means determines the light propagation characteristic of each pixel of the second light modulation element based on the light propagation characteristic determined by the first light propagation characteristic determining means and the display data. Any configuration may be used, and the calculation or conversion is not limited to the light propagation characteristic itself determined by the first light propagation characteristic determination unit, but based on the light propagation characteristic determined by the first light propagation characteristic determination unit. And the light propagation characteristics of each pixel of the second light modulation element may be determined based on the calculation result or the conversion result. For example, since the control value determined by the first control value determining means is determined based on the light propagation characteristic determined by the first light propagation characteristic determining means, the second light propagation characteristic determining means determines the first control value determining The light propagation characteristics of each pixel of the second light modulation element can be determined based on the control value determined by the means and the display data. The same applies to the control program for the optical display device of the invention 4 and the optical display devices of the inventions 11 and 13.

[Invention 3] Furthermore, the optical display device of Invention 3 is the optical display device of Invention 2,
The first light propagation characteristic determining unit is configured to transmit the light propagation of the first light modulation element in units of pixels of the second light modulation element based on the light propagation characteristic temporarily determined by the light propagation characteristic temporary determination unit and the display data. Calculate the characteristics,
A direction corresponding to the column direction of the light modulation elements is the specific direction, and a pixel value matrix in which light propagation characteristics calculated in units of pixels of the second light modulation elements are arranged in a matrix as the pixel values is the conversion source. A pixel value matrix, a pixel value matrix corresponding to the size of the first light modulation element in the column direction is converted by the pixel value matrix conversion means as the pixel value matrix of the conversion destination,
The direction corresponding to the row direction of the light modulation element is the specific direction, the pixel value matrix converted by the pixel value matrix conversion means is the pixel value matrix of the conversion source, and the column direction and the row of the first light modulation element The pixel value matrix corresponding to the size of the direction is used as the pixel value matrix of the conversion destination to perform conversion by the pixel value matrix conversion means, thereby calculating the light propagation characteristics of each pixel of the first light modulation element. It is characterized by becoming.

  With such a configuration, the first light propagation characteristic determining means firstly determines the light propagation characteristic of the first light modulation element in units of pixels of the second light modulation element based on the temporarily determined light propagation characteristic and display data. Is calculated. Next, a pixel value matrix in which a direction corresponding to the column direction of the light modulation elements is defined as a specific direction and the light propagation characteristics calculated in units of pixels of the second light modulation elements are arranged as a pixel value as a pixel value is converted into pixel values. Conversion by the pixel value matrix conversion means is performed using the pixel value matrix corresponding to the size of the first light modulation element in the column direction as the pixel value matrix of the conversion destination. Then, a direction corresponding to the row direction of the light modulation element is set as a specific direction, a pixel value matrix converted by the pixel value matrix conversion unit is set as a conversion source pixel value matrix, and the column direction and the row direction of the first light modulation element are set. The pixel value matrix corresponding to the size is converted by the pixel value matrix conversion means using the pixel value matrix of the conversion destination, and the light propagation characteristics of each pixel of the first light modulation element are calculated.

  As a result, the column-direction conversion process is performed on the pixel value matrix configured by each pixel unit of the second light modulation element, and the row-direction conversion process is performed on the pixel value matrix obtained by the conversion process. Therefore, the effect that the light propagation characteristic of each pixel of the first light modulation element can be calculated relatively easily can be obtained.

[Invention 4] Furthermore, the optical display device of Invention 4 comprises:
A first light modulation element in which a light source and a plurality of pixels whose light propagation characteristics can be independently controlled are arranged in a matrix, and a plurality of pixels whose light propagation characteristics can be independently controlled are arranged in a matrix and the first A device for displaying an image by modulating light from the light source via the first light modulation element and the second light modulation element. And
Temporary light propagation characteristic deciding means for tentatively determining the light propagation characteristic of each pixel of the second light modulation element, and the first light modulation based on the light propagation characteristic and the display data tentatively decided by the light propagation characteristic tentative decision means A first light propagation characteristic determining means for determining a light propagation characteristic of each pixel of the element; and a control value of each pixel of the first light modulation element based on the light propagation characteristic determined by the first light propagation characteristic determining means. First control value determining means for determining, second light for determining light propagation characteristics of each pixel of the second light modulation element based on the light propagation characteristics determined by the first light propagation characteristic determining means and the display data Propagation characteristic determining means, second control value determining means for determining a control value of each pixel of the second light modulation element based on the light propagation characteristic determined by the second light propagation characteristic determination means, and the light modulation element The pixel value of the pixel corresponding to the pixel array of And a pixel value matrix conversion means for converting the pixel value matrix arranged in a matrix form in the pixel value matrix of different sizes,
The pixel value matrix conversion means includes: a first pixel array arranged along a specific direction in a conversion source pixel value matrix; and a second pixel arranged along the specific direction in a conversion destination pixel value matrix. For the column, the pixel value V2n of the n-th pixel p2n of the second pixel column is the same as the first pixel column and the second pixel, assuming that the total length of the first pixel column and the second pixel column is the same. For each of the k pixels p1k of the first pixel column that overlaps the pixel p2n when the columns are overlapped, the pixel value V1k of the pixel p1k is set based on the degree of overlap of the pixel p2n and the pixel p1k in the length direction. Weighting is performed, and the weighting result is calculated as a total value for all of the pixels p1k.
The calculation of the pixel value V2n is performed for all the pixels in the second pixel column, and is further performed for all the pixel columns in the specific direction in the pixel value matrix of the conversion source,
The second light propagation characteristic determination means performs the conversion by the pixel value matrix conversion means at least once based on the light propagation characteristics determined by the first light propagation characteristic determination means, thereby causing the pixels of the second light modulation element to The light propagation characteristic of the first light modulation element is calculated in units, and the light propagation characteristic of each pixel of the second light modulation element is calculated based on the calculated light propagation characteristic and the display data. It is characterized by.

  With such a configuration, the light propagation characteristic provisional determination means provisionally determines the light propagation characteristic of each pixel of the second light modulation element. Next, the light propagation characteristic of each pixel of the first light modulation element is determined by the first light propagation characteristic determination unit based on the temporarily determined light propagation characteristic and the display data, and is determined by the first control value determination unit. The control value of each pixel of the first light modulation element is determined based on the light propagation characteristics of the first light modulation element.

  Next, the conversion by the pixel value matrix conversion unit is performed at least once by the second light propagation characteristic determination unit based on the determined light propagation characteristic, and the light of the first light modulation element is obtained for each pixel of the second light modulation element. A propagation characteristic is calculated, and a light propagation characteristic of each pixel of the second light modulation element is calculated based on the calculated light propagation characteristic and display data. In this conversion, the pixel value V2n of the pixel p2n is weighted to the pixel value V1k of the pixel p1k based on the degree of overlap of the pixel p2n and the pixel p1k in the length direction for each pixel p1k. The sum is calculated for all of the pixels p1k. The pixel value V2n is calculated for all the pixels in the second pixel column, and further for all the pixel columns in a specific direction in the pixel value matrix of the conversion source.

  Then, the control value of each pixel of the second light modulation element is determined by the second control value determination means based on the determined light propagation characteristic of the second light modulation element.

  Thereby, since the light from the light source is modulated via the first light modulation element and the second light modulation element, an effect that a relatively high luminance dynamic range and gradation number can be realized is obtained. Similarly, the conversion process for the pixel columns arranged along the specific direction in the pixel value matrix is similarly performed for all the other pixel columns, and the entire conversion process for the pixel value matrix is performed at least once. Therefore, when the first light modulation element and the second light modulation element have different resolutions, the arithmetic processing for calculating the light propagation characteristics of each pixel of the second light modulation element is relatively simple compared to the conventional case. The effect of becoming is also obtained. Furthermore, since it is not necessary to maintain the number of gradation tables corresponding to the number of gradations, even if the number of gradations is increased, the size of the gradation table and the generation time are greatly increased compared to the conventional case. The effect that there is no is also acquired.

[Invention 5] Furthermore, the optical display device of Invention 5 is the optical display device of Invention 4,
The second light propagation characteristic determining means sets the direction corresponding to the column direction of the light modulation elements as the specific direction, and sets the light propagation characteristics determined for each pixel of the first light modulation element in the form of a matrix as the pixel values. Conversion by the pixel value matrix conversion means using the arrayed pixel value matrix as the conversion source pixel value matrix and the pixel value matrix corresponding to the size of the second light modulation element in the column direction as the conversion destination pixel value matrix And
The direction corresponding to the row direction of the light modulation element is the specific direction, the pixel value matrix converted by the pixel value matrix conversion means is the pixel value matrix of the conversion source, and the column direction and the row of the second light modulation element The pixel value matrix corresponding to the size of the direction is used as the pixel value matrix of the conversion destination and converted by the pixel value matrix conversion means, so that the light of the first light modulation element in units of pixels of the second light modulation element Calculate the propagation characteristics,
The light propagation characteristic of each pixel of the second light modulation element is calculated based on the calculated light propagation characteristic and the display data.

  In such a configuration, the second light propagation characteristic determining means first sets the direction corresponding to the column direction of the light modulation elements as the specific direction, and determines the light propagation characteristics determined for each pixel of the first light modulation element. Pixel value matrix conversion means having a pixel value matrix arranged in a matrix as pixel values as a source pixel value matrix and a pixel value matrix corresponding to the size of the second light modulation element in the column direction as a destination pixel value matrix Conversion by is performed. Next, the direction corresponding to the row direction of the light modulation element is set as a specific direction, the pixel value matrix converted by the pixel value matrix conversion means is set as a conversion source pixel value matrix, and the column direction and the row direction of the second light modulation element are set. The pixel value matrix corresponding to the size is converted by the pixel value matrix conversion means using the pixel value matrix of the conversion destination, and the light propagation characteristic of the first light modulation element is calculated for each pixel of the second light modulation element. Then, the light propagation characteristics of each pixel of the second light modulation element are calculated based on the calculated light propagation characteristics and display data.

  As a result, the column-direction conversion process is performed on the pixel value matrix configured by each pixel unit of the first light modulation element, and the row-direction conversion process is simply performed on the pixel value matrix obtained by the conversion process. Therefore, the effect that the light propagation characteristic of each pixel of the second light modulation element can be calculated relatively easily can be obtained.

  As a result of intensive studies, the present inventors have found that the following factors influence the deterioration of the image quality depending on how T1 and T2 are determined.

  When the first light modulation element and the second light modulation element have different resolutions, for one pixel p1 of the first light modulation element, the pixel p1 overlaps with a plurality of pixels of the second light modulation element on the optical path, and vice versa. In addition, for one pixel p2 of the second light modulation element, the pixel p2 may overlap with a plurality of pixels of the first light modulation element on the optical path. Here, when calculating the transmittance T1 for the pixel p1 of the first light modulation element, if the transmittance T2 of a plurality of overlapping pixels of the second light modulation element is determined, the average value of the transmittance T2 or the like is calculated. It is conceivable that the transmittance T1 is calculated by the above equations (1) and (2), assuming that the calculated average value and the like are regarded as the transmittance T2 of the pixel corresponding to the pixel p1 of the second light modulation element. However, since the average value or the like is regarded as the transmittance T2 of the second light modulation element, an error is inevitably generated there. This error occurs regardless of the order of determination, whether the transmittance T1 of the first light modulation element is determined first or the transmittance T2 of the second light modulation element is determined first. Of the first light modulation element and the second light modulation element, the one that determines the display resolution has a large visual influence, so it is better to minimize the error.

  Therefore, let us examine how the magnitude of the error changes depending on the order of determination. First, consider determining the transmittance T2 of the second light modulation element first. The transmittance T1 of the pixel p1 of the first light modulation element is calculated by calculating an average value or the like of the transmittance T2 of a plurality of overlapping pixels of the second light modulation element, and based on the calculated average value and the HDR display data. It can be calculated by (1) and (2). As a result, when viewed from the pixel p1 of the first light modulation element, the transmittance T1 has an error with respect to the transmittance T2 of a plurality of overlapping pixels of the second light modulation element, but the degree of error is an average value. This is the degree of error caused by statistical calculations such as. On the other hand, when viewed from the pixel p2 of the second light modulation element, the transmittance T2 can be obtained by calculating the average value or the like of the transmittance T1 of a plurality of overlapping pixels of the first light modulation element. On the other hand, a large error may occur that does not satisfy the above equations (1) and (2). This is because the reverse relationship is not necessarily established even if a relationship (a relationship satisfying the above formulas (1) and (2)) with a plurality of overlapping pixels of the second light modulation element is defined based on the pixel p1. It is thought to be caused by Therefore, there is a high possibility that the error of the transmittance T2 of the second light modulation element becomes larger.

  The same applies to the opposite case, and when the transmittance T1 of the first light modulation element is determined first, the error of the transmittance T1 of the first light modulation element is likely to be larger.

  From the above, from the viewpoint of improving the image quality, it is said that the influence of the error may be less when the transmittance is determined later, although the display resolution is determined among the first light modulation element and the second light modulation element. Conclusion is obtained.

[Invention 6] The optical display device of Invention 6 is the optical display device of any one of Inventions 2 to 5,
The second light modulation element is a light modulation element that determines display resolution.

  With such a configuration, since the light propagation characteristic of the second light modulation element that determines the display resolution is determined later, the influence of the error can be suppressed, and the possibility that the image quality deteriorates is further reduced. The effect that it can be also obtained.

[Invention 7] The optical display device of Invention 7 is the optical display device of any one of Inventions 2 to 6,
One of the first light modulation element and the second light modulation element is a specific wavelength region luminance modulation element that modulates the luminance of the specific wavelength region with respect to a plurality of different specific wavelength regions among the light wavelength regions,
The other of the first light modulation element and the second light modulation element is a full wavelength region luminance modulation element that modulates the luminance of light in the entire wavelength region.

  With such a configuration, the luminance of each specific wavelength region of light is modulated by one of the first light modulation element and the second light modulation element, and the other of the first light modulation element and the second light modulation element The luminance of the entire wavelength region of light is modulated.

  Accordingly, since only one light modulation element needs to be added to the conventional optical display device, an effect that the optical display device according to the present invention can be configured relatively easily is obtained.

  Here, the specific wavelength region luminance modulation element may have any configuration as long as the luminance of the specific wavelength region is modulated with respect to a plurality of different specific wavelength regions among the light wavelength regions. It may be composed of one specific wavelength region luminance modulation element, or may be composed of a plurality of specific wavelength region luminance modulation elements. In the former case, a typical example is a configuration in which a color filter of RGB three primary colors is provided on a liquid crystal light valve. In the latter case, a specific wavelength region luminance modulation element for modulating the luminance of the specific wavelength region may be provided for each specific wavelength region. A typical example is a configuration composed of liquid crystal light valves for each of the three primary colors RGB. The same applies to the optical display device of the invention 8, the control program of the optical display device of the inventions 16 and 17, and the control method of the optical display device of the inventions 25 and 26.

  In addition, the specific wavelength region is not limited to being set for each of the three primary colors RGB, but can be arbitrarily set as necessary. However, if it is set for each of the RGB primary colors, the existing liquid crystal light valve can be used as it is, which is advantageous in terms of cost. The same applies to the optical display device of the invention 8, the control program of the optical display device of the inventions 16 and 17, and the control method of the optical display device of the inventions 25 and 26.

Further, the luminance may be a physical radiance that does not consider human visual characteristics (Radiance = W / (sr · m ² )), or a luminance that considers human visual characteristics (luminance = cd / m). ² ) may be used as an indicator. The same applies to the optical display device of the invention 8, the control program of the optical display device of the inventions 16 and 17, and the control method of the optical display device of the inventions 25 and 26.

[Invention 8] Furthermore, the optical display device of Invention 8 is the optical display device of any one of Inventions 2 to 6,
The first light modulation element and the second light modulation element are specific wavelength region luminance modulation elements that modulate the luminance of the specific wavelength region with respect to a plurality of different specific wavelength regions among light wavelength regions. .

With such a configuration, the luminance of each specific wavelength region of light is modulated in two stages by the first light modulation element and the second light modulation element.
As a result, the luminance of each specific wavelength region of light can be independently modulated in two stages, so that the possibility of further degrading the image quality can be obtained.

[Invention 9] Furthermore, the optical display device of Invention 9 is the optical display device of any one of Inventions 2 to 8,
The second light modulation element has a higher resolution than the first light modulation element.

  With such a configuration, since the visual influence of the second light modulation element is increased, the influence of errors can be further suppressed, and the possibility that the image quality is deteriorated can be further reduced. An effect is obtained.

[Invention 10] On the other hand, in order to achieve the above object, an optical propagation characteristic control program according to Invention 10 includes:
A first light modulation element in which a plurality of pixels whose light propagation characteristics can be controlled independently is arranged in a matrix, and a plurality of pixels whose light propagation characteristics can be controlled independently in a matrix, and the first light modulation element A program applied to an optical system that modulates light from a light source via a second light modulation element having a resolution different from
Light propagation characteristic determining means for determining the light propagation characteristic of each pixel of the first light modulation element based on the light propagation characteristic and display data of each pixel of the second light modulation element, and a pixel array of the light modulation element A program for causing a computer to execute processing realized as pixel value matrix conversion means for converting a pixel value matrix in which the pixel values of the pixels are arranged in a matrix to correspond to pixel value matrices of different sizes,
The pixel value matrix conversion means includes: a first pixel array arranged along a specific direction in a conversion source pixel value matrix; and a second pixel arranged along the specific direction in a conversion destination pixel value matrix. For the column, the pixel value V2n of the n-th pixel p2n of the second pixel column is the same as the first pixel column and the second pixel, assuming that the total length of the first pixel column and the second pixel column is the same. For each of the k pixels p1k of the first pixel column that overlaps the pixel p2n when the columns are overlapped, the pixel value V1k of the pixel p1k is set based on the degree of overlap of the pixel p2n and the pixel p1k in the length direction. Weighting is performed, and the weighting result is calculated as a total value for all of the pixels p1k.
The calculation of the pixel value V2n is performed for all the pixels in the second pixel column, and is further performed for all the pixel columns in the specific direction in the pixel value matrix of the conversion source,
The light propagation characteristic determination means performs conversion by the pixel value matrix conversion means at least once based on the light propagation characteristics of each pixel of the second light modulation element and the display data, thereby allowing the first light modulation element to The light propagation characteristics of each pixel are calculated.

  With such a configuration, when the program is read by the computer and the computer executes processing according to the read program, the same operations and effects as those of the light propagation characteristic control device of the first aspect can be obtained.

[Invention 11] On the other hand, in order to achieve the above object, a control program for an optical display device according to Invention 11 includes:
A first light modulation element in which a light source and a plurality of pixels whose light propagation characteristics can be independently controlled are arranged in a matrix, and a plurality of pixels whose light propagation characteristics can be independently controlled are arranged in a matrix and the first An optical display device comprising: a second light modulation element having a resolution different from that of the light modulation element, and displaying an image by modulating light from the light source via the first light modulation element and the second light modulation element A program for controlling
Temporary light propagation characteristic deciding means for temporarily deciding the light propagation characteristic of each pixel of the second light modulation element, the first light modulation element based on the light propagation characteristic tentatively decided by the light propagation characteristic tentative decision means and display data First light propagation characteristic determining means for determining the light propagation characteristic of each pixel of the first, and determining the control value of each pixel of the first light modulation element based on the light propagation characteristic determined by the first light propagation characteristic determining means Second light propagation characteristic determination for determining the light propagation characteristic of each pixel of the second light modulation element based on the light propagation characteristic determined by the first control value determination means and the first light propagation characteristic determination means and the display data Means for determining a control value of each pixel of the second light modulation element based on the light propagation characteristic determined by the second light propagation characteristic determination means, and a pixel array of the light modulation element. Correspondingly, the pixel value of the pixel is A program for executing the processing implemented the pixel value matrix arranged in Rikusu shape as the pixel value matrix conversion means for converting different sizes pixel value matrix of the computer,
The pixel value matrix conversion means includes: a first pixel array arranged along a specific direction in a conversion source pixel value matrix; and a second pixel arranged along the specific direction in a conversion destination pixel value matrix. For the column, the pixel value V2n of the n-th pixel p2n of the second pixel column is the same as the first pixel column and the second pixel, assuming that the total length of the first pixel column and the second pixel column is the same. For each of the k pixels p1k of the first pixel column that overlaps the pixel p2n when the columns are overlapped, the pixel value V1k of the pixel p1k is set based on the degree of overlap of the pixel p2n and the pixel p1k in the length direction. Weighting is performed, and the weighting result is calculated as a total value for all of the pixels p1k.
The calculation of the pixel value V2n is performed for all the pixels in the second pixel column, and is further performed for all the pixel columns in the specific direction in the pixel value matrix of the conversion source,
The first light propagation characteristic determining unit is configured to transmit the light propagation of the first light modulation element in units of pixels of the second light modulation element based on the light propagation characteristic temporarily determined by the light propagation characteristic temporary determination unit and the display data. Characteristics are calculated, and light propagation characteristics of each pixel of the first light modulation element are calculated by performing conversion by the pixel value matrix conversion means at least once based on the calculated light propagation characteristics. It is characterized by.

  With such a configuration, when the program is read by the computer and the computer executes processing in accordance with the read program, the same operations and effects as those of the optical display device of aspect 2 are obtained.

[Invention 12] Furthermore, the control program for the optical display device of Invention 12 is the control program for the optical display device of Invention 11,
The first light propagation characteristic determining unit is configured to transmit the light propagation of the first light modulation element in units of pixels of the second light modulation element based on the light propagation characteristic temporarily determined by the light propagation characteristic temporary determination unit and the display data. Calculate the characteristics,
A direction corresponding to the column direction of the light modulation elements is the specific direction, and a pixel value matrix in which light propagation characteristics calculated in units of pixels of the second light modulation elements are arranged in a matrix as the pixel values is the conversion source. A pixel value matrix, a pixel value matrix corresponding to the size of the first light modulation element in the column direction is converted by the pixel value matrix conversion means as the pixel value matrix of the conversion destination,
The direction corresponding to the row direction of the light modulation element is the specific direction, the pixel value matrix converted by the pixel value matrix conversion means is the pixel value matrix of the conversion source, and the column direction and the row of the first light modulation element The pixel value matrix corresponding to the size of the direction is used as the pixel value matrix of the conversion destination to perform conversion by the pixel value matrix conversion means, thereby calculating the light propagation characteristics of each pixel of the first light modulation element. It is characterized by becoming.

  With such a configuration, when the program is read by the computer and the computer executes processing in accordance with the read program, the same operation and effect as those of the optical display device of aspect 3 can be obtained.

[Invention 13] The control program for the optical display device of Invention 13 is
A first light modulation element in which a light source and a plurality of pixels whose light propagation characteristics can be independently controlled are arranged in a matrix, and a plurality of pixels whose light propagation characteristics can be independently controlled are arranged in a matrix and the first An optical display device comprising: a second light modulation element having a resolution different from that of the light modulation element, and displaying an image by modulating light from the light source via the first light modulation element and the second light modulation element A program for controlling
Temporary light propagation characteristic deciding means for temporarily deciding the light propagation characteristic of each pixel of the second light modulation element, the first light modulation element based on the light propagation characteristic tentatively decided by the light propagation characteristic tentative decision means and display data First light propagation characteristic determining means for determining the light propagation characteristic of each pixel of the first, and determining the control value of each pixel of the first light modulation element based on the light propagation characteristic determined by the first light propagation characteristic determining means Second light propagation characteristic determination for determining the light propagation characteristic of each pixel of the second light modulation element based on the light propagation characteristic determined by the first control value determination means and the first light propagation characteristic determination means and the display data Means for determining a control value of each pixel of the second light modulation element based on the light propagation characteristic determined by the second light propagation characteristic determination means, and a pixel array of the light modulation element. Correspondingly, the pixel value of the pixel is A program for executing the processing implemented the pixel value matrix arranged in Rikusu shape as the pixel value matrix conversion means for converting different sizes pixel value matrix of the computer,
The pixel value matrix conversion means includes: a first pixel array arranged along a specific direction in a conversion source pixel value matrix; and a second pixel arranged along the specific direction in a conversion destination pixel value matrix. For the column, the pixel value V2n of the n-th pixel p2n of the second pixel column is the same as the first pixel column and the second pixel, assuming that the total length of the first pixel column and the second pixel column is the same. For each of the k pixels p1k of the first pixel column that overlaps the pixel p2n when the columns are overlapped, the pixel value V1k of the pixel p1k is set based on the degree of overlap of the pixel p2n and the pixel p1k in the length direction. Weighting is performed, and the weighting result is calculated as a total value for all of the pixels p1k.
The calculation of the pixel value V2n is performed for all the pixels in the second pixel column, and is further performed for all the pixel columns in the specific direction in the pixel value matrix of the conversion source,
The second light propagation characteristic determination means performs the conversion by the pixel value matrix conversion means at least once based on the light propagation characteristics determined by the first light propagation characteristic determination means, thereby causing the pixels of the second light modulation element to The light propagation characteristic of the first light modulation element is calculated in units, and the light propagation characteristic of each pixel of the second light modulation element is calculated based on the calculated light propagation characteristic and the display data. It is characterized by.

  With such a configuration, when the program is read by the computer and the computer executes processing according to the read program, the same operations and effects as those of the optical display device of the fourth aspect are obtained.

[Invention 14] Furthermore, the control program for the optical display device according to Invention 14 is the control program for the optical display device according to Invention 13,
The second light propagation characteristic determining means sets the direction corresponding to the column direction of the light modulation elements as the specific direction, and sets the light propagation characteristics determined for each pixel of the first light modulation element in the form of a matrix as the pixel values. Conversion by the pixel value matrix conversion means using the arrayed pixel value matrix as the conversion source pixel value matrix and the pixel value matrix corresponding to the size of the second light modulation element in the column direction as the conversion destination pixel value matrix And
The direction corresponding to the row direction of the light modulation element is the specific direction, the pixel value matrix converted by the pixel value matrix conversion means is the pixel value matrix of the conversion source, and the column direction and the row of the second light modulation element The pixel value matrix corresponding to the size of the direction is used as the pixel value matrix of the conversion destination and converted by the pixel value matrix conversion means, so that the light of the first light modulation element in units of pixels of the second light modulation element Calculate the propagation characteristics,
The light propagation characteristic of each pixel of the second light modulation element is calculated based on the calculated light propagation characteristic and the display data.

  With such a configuration, when the program is read by the computer and the computer executes processing according to the read program, the same operation and effect as those of the optical display device of the fifth aspect are obtained.

[Invention 15] Furthermore, the control program for the optical display device according to Invention 15 is the control program for an optical display device according to any one of Inventions 11 to 14,
The second light modulation element is a light modulation element that determines display resolution.

  With such a configuration, when the program is read by the computer and the computer executes processing according to the read program, the same operation and effect as those of the optical display device of the sixth aspect are obtained.

[Invention 16] Furthermore, the control program for an optical display device according to Invention 16 is the control program for an optical display device according to any one of Inventions 11 to 15,
One of the first light modulation element and the second light modulation element is a specific wavelength region luminance modulation element that modulates the luminance of the specific wavelength region with respect to a plurality of different specific wavelength regions among the light wavelength regions,
The other of the first light modulation element and the second light modulation element is a full wavelength region luminance modulation element that modulates the luminance of light in the entire wavelength region.

  With such a configuration, when the program is read by the computer and the computer executes processing according to the read program, the same operations and effects as those of the optical display device of the seventh aspect are obtained.

[Invention 17] Furthermore, the control program for the optical display device according to Invention 17 is the control program for an optical display device according to any one of Inventions 11 to 15,
The first light modulation element and the second light modulation element are specific wavelength region luminance modulation elements that modulate the luminance of the specific wavelength region with respect to a plurality of different specific wavelength regions among light wavelength regions. .

  With such a configuration, when the program is read by the computer and the computer executes processing according to the read program, the same operations and effects as those of the optical display device according to Aspect 8 are obtained.

[Invention 18] Furthermore, the control program for an optical display device according to Invention 18 is the control program for an optical display device according to any one of Inventions 11 to 17,
The second light modulation element has a higher resolution than the first light modulation element.

  With such a configuration, when the program is read by the computer and the computer executes processing according to the read program, the same operation and effect as those of the optical display device of the ninth aspect are obtained.

[Invention 19] On the other hand, in order to achieve the above object, the light propagation characteristic control method of Invention 19 includes:
A first light modulation element in which a plurality of pixels whose light propagation characteristics can be controlled independently is arranged in a matrix, and a plurality of pixels whose light propagation characteristics can be controlled independently in a matrix, and the first light modulation element A method applied to an optical system that modulates light from a light source via a second light modulation element having a different resolution from
A light propagation characteristic determining step for determining a light propagation characteristic of each pixel of the first light modulation element based on the light propagation characteristic and display data of each pixel of the second light modulation element; and a pixel array of the light modulation element. A pixel value matrix conversion step of converting a pixel value matrix in which the pixel values of the pixels are arranged in a matrix so as to correspond to a pixel value matrix of a different size,
The pixel value matrix conversion step includes: a first pixel column arranged along a specific direction in the conversion source pixel value matrix; and a second pixel arranged along the specific direction in the conversion destination pixel value matrix. For the column, the pixel value V2n of the n-th pixel p2n of the second pixel column is the same as the first pixel column and the second pixel, assuming that the total length of the first pixel column and the second pixel column is the same. For each of the k pixels p1k of the first pixel column that overlaps the pixel p2n when the columns are overlapped, the pixel value V1k of the pixel p1k is set based on the degree of overlap of the pixel p2n and the pixel p1k in the length direction. Weighting is performed, and the weighting result is calculated as a total value for all of the pixels p1k.
The calculation of the pixel value V2n is performed for all the pixels of the second pixel column, and is further performed for all the pixel columns in the specific direction in the pixel value matrix of the conversion source,
In the light propagation characteristic determination step, each pixel of the first light modulation element is performed by performing the pixel value matrix conversion step at least once based on the light propagation characteristic of each pixel of the second light modulation element and the display data. It is characterized by calculating the light propagation characteristic of

  Thereby, an effect equivalent to that of the light propagation characteristic control device of aspect 1 is obtained.

[Invention 20] On the other hand, in order to achieve the above object, a method for controlling an optical display device according to Invention 20 includes:
A first light modulation element in which a light source and a plurality of pixels whose light propagation characteristics can be independently controlled are arranged in a matrix, and a plurality of pixels whose light propagation characteristics can be independently controlled are arranged in a matrix and the first An optical display device comprising: a second light modulation element having a resolution different from that of the light modulation element, and displaying an image by modulating light from the light source via the first light modulation element and the second light modulation element A method of controlling
A light propagation characteristic provisionally determining step for provisionally determining a light propagation characteristic of each pixel of the second light modulation element; and the first light modulation based on the light propagation characteristic and display data provisionally determined in the light propagation characteristic provisional determination step. A first light propagation characteristic determining step for determining a light propagation characteristic of each pixel of the element; and a control value of each pixel of the first light modulation element based on the light propagation characteristic determined in the first light propagation characteristic determining step. A first control value determining step to be determined; a second light for determining a light propagation characteristic of each pixel of the second light modulation element based on the light propagation characteristic determined in the first light propagation characteristic determination step and the display data; A propagation characteristic determining step, a second control value determining step for determining a control value of each pixel of the second light modulation element based on the light propagation characteristic determined in the second light propagation characteristic determination step, and the light modulation element of In correspondence with the element array and a pixel value matrix conversion step of converting the pixel value matrix of the pixel values different pixel value matrix arranged in a matrix size of the pixel,
The pixel value matrix conversion step includes: a first pixel column arranged along a specific direction in the conversion source pixel value matrix; and a second pixel arranged along the specific direction in the conversion destination pixel value matrix. For the column, the pixel value V2n of the n-th pixel p2n of the second pixel column is the same as the first pixel column and the second pixel, assuming that the total length of the first pixel column and the second pixel column is the same. For each of the k pixels p1k in the first pixel column that overlaps the pixel p2n when the columns are overlapped, the pixel value V1k of the pixel p1k is set based on the degree of overlap of the pixel p2n and the pixel p1k in the length direction. Weighting is performed, and the weighting result is calculated as a summed value for all of the pixels p1k.
The calculation of the pixel value V2n is performed for all the pixels in the second pixel column, and is further performed for all the pixel columns in the specific direction in the pixel value matrix of the conversion source,
In the first light propagation characteristic determination step, the light propagation of the first light modulation element in units of pixels of the second light modulation element based on the light propagation characteristic provisionally determined in the light propagation characteristic provisional determination step and the display data. The characteristics are calculated, and the light propagation characteristics of each pixel of the first light modulation element are calculated by performing the pixel value matrix conversion step at least once based on the calculated light propagation characteristics.
Thereby, an effect equivalent to that of the optical display device of aspect 2 is obtained.

  Here, in the second light propagation characteristic determination step, the light propagation characteristic of each pixel of the second light modulation element is determined based on the light propagation characteristic determined in the first light propagation characteristic determination step and the display data. The method may be a method, and is not limited to the light propagation characteristic itself determined in the first light propagation characteristic determination step, but is calculated or converted based on the light propagation characteristic determined in the first light propagation characteristic determination step, and the calculation result Alternatively, the light propagation characteristics of each pixel of the second light modulation element may be determined based on the conversion result. For example, since the control value determined in the first control value determination step is determined based on the light propagation characteristic determined in the first light propagation characteristic determination step, the second light propagation characteristic determination step includes the first control value determination. Based on the control value and display data determined in the step, the light propagation characteristics of each pixel of the second light modulation element can be determined. The same applies to the control method of the optical display device of the invention 22 below.

[Invention 21] Furthermore, the control method of the optical display device of the invention 21 is the control method of the optical display device of the invention 20,
In the first light propagation characteristic determination step, the light propagation of the first light modulation element in units of pixels of the second light modulation element based on the light propagation characteristic provisionally determined in the light propagation characteristic provisional determination step and the display data. Calculate the characteristics,
A direction corresponding to the column direction of the light modulation elements is the specific direction, and a pixel value matrix in which light propagation characteristics calculated in units of pixels of the second light modulation elements are arranged in a matrix as the pixel values is the conversion source. The pixel value matrix is converted into a pixel value matrix corresponding to the size of the first light modulation element in the column direction, and the pixel value matrix conversion step is performed.
The direction corresponding to the row direction of the light modulation element is the specific direction, the pixel value matrix converted in the pixel value matrix conversion step is the pixel value matrix of the conversion source, and the column direction and the row of the first light modulation element A light propagation characteristic of each pixel of the first light modulation element is calculated by performing the pixel value matrix conversion step using the pixel value matrix corresponding to the size of the direction as the pixel value matrix of the conversion destination. To do.
Thereby, an effect equivalent to that of the optical display device of aspect 3 is obtained.

[Invention 22] Further, the control method of the optical display device of Invention 22 includes:
A first light modulation element in which a light source and a plurality of pixels whose light propagation characteristics can be independently controlled are arranged in a matrix, and a plurality of pixels whose light propagation characteristics can be independently controlled are arranged in a matrix and the first An optical display device comprising: a second light modulation element having a resolution different from that of the light modulation element, and displaying an image by modulating light from the light source via the first light modulation element and the second light modulation element A method of controlling
A light propagation characteristic provisionally determining step for provisionally determining a light propagation characteristic of each pixel of the second light modulation element; and the first light modulation based on the light propagation characteristic and display data provisionally determined in the light propagation characteristic provisional determination step. A first light propagation characteristic determining step for determining a light propagation characteristic of each pixel of the element; and a control value of each pixel of the first light modulation element based on the light propagation characteristic determined in the first light propagation characteristic determining step. A first control value determining step to be determined; a second light for determining a light propagation characteristic of each pixel of the second light modulation element based on the light propagation characteristic determined in the first light propagation characteristic determination step and the display data; A propagation characteristic determining step; a second control value determining step for determining a control value of each pixel of the second light modulation element based on the light propagation characteristic determined in the second light propagation characteristic determination step; and the light modulation element of In correspondence with the element array and a pixel value matrix conversion step of converting the pixel value matrix of the pixel values different pixel value matrix arranged in a matrix size of the pixel,
The pixel value matrix conversion step includes: a first pixel column arranged along a specific direction in the conversion source pixel value matrix; and a second pixel arranged along the specific direction in the conversion destination pixel value matrix. For the column, the pixel value V2n of the n-th pixel p2n of the second pixel column is the same as the first pixel column and the second pixel, assuming that the total length of the first pixel column and the second pixel column is the same. For each of the k pixels p1k of the first pixel column that overlaps the pixel p2n when the columns are overlapped, the pixel value V1k of the pixel p1k is set based on the degree of overlap of the pixel p2n and the pixel p1k in the length direction. Weighting is performed, and the weighting result is calculated as a total value for all of the pixels p1k.
The calculation of the pixel value V2n is performed for all the pixels of the second pixel column, and is further performed for all the pixel columns in the specific direction in the pixel value matrix of the conversion source,
In the second light propagation characteristic determination step, the pixel value matrix conversion step is performed at least once based on the light propagation characteristic determined in the first light propagation characteristic determination step, so that the second light propagation characteristic determination step is performed for each pixel of the second light modulation element. A light propagation characteristic of the first light modulation element is calculated, and a light propagation characteristic of each pixel of the second light modulation element is calculated based on the calculated light propagation characteristic and the display data.
Thereby, an effect equivalent to that of the optical display device of aspect 4 is obtained.

[Invention 23] Further, the control method of the optical display device of the invention 23 is the control method of the optical display device of the invention 22,
In the second light propagation characteristic determination step, a direction corresponding to the column direction of the light modulation elements is set as the specific direction, and the light propagation characteristics determined for each pixel of the first light modulation element are set as the pixel values in a matrix. The pixel value matrix conversion step is performed using the arrayed pixel value matrix as the conversion source pixel value matrix and the pixel value matrix corresponding to the size of the second light modulation element in the column direction as the conversion destination pixel value matrix. ,
The direction corresponding to the row direction of the light modulation element is the specific direction, the pixel value matrix converted in the pixel value matrix conversion step is the pixel value matrix of the conversion source, and the column direction and the row of the second light modulation element. By performing the pixel value matrix conversion step using the pixel value matrix corresponding to the size of the direction as the pixel value matrix of the conversion destination, the light propagation characteristics of the first light modulation element in units of pixels of the second light modulation element To calculate
A light propagation characteristic of each pixel of the second light modulation element is calculated based on the calculated light propagation characteristic and the display data.
Thereby, an effect equivalent to that of the optical display device of aspect 5 is obtained.

[Invention 24] Furthermore, the optical display device control method of the invention 24 is the optical display device control method of any of the inventions 20 to 23, wherein
The second light modulation element is a light modulation element that determines display resolution.
Thereby, an effect equivalent to that of the optical display device of aspect 6 is obtained.

[Invention 25] Further, the control method of the optical display device of the invention 25 is the control method of the optical display device of any one of the inventions 20 to 24,
One of the first light modulation element and the second light modulation element is a specific wavelength region luminance modulation element that modulates the luminance of the specific wavelength region with respect to a plurality of different specific wavelength regions among the light wavelength regions,
The other of the first light modulation element and the second light modulation element is a full wavelength region luminance modulation element that modulates the luminance of light in the entire wavelength region.
Thereby, an effect equivalent to that of the optical display device of aspect 7 is obtained.

[Invention 26] Further, the control method of the optical display device of the invention 26 is the control method of the optical display device of any of the inventions 20 to 24,
The first light modulation element and the second light modulation element are specific wavelength region luminance modulation elements that modulate the luminance of the specific wavelength region with respect to a plurality of different specific wavelength regions among light wavelength regions. .
Thereby, an effect equivalent to that of the optical display device of aspect 8 is obtained.

[Invention 27] Furthermore, an optical display device control method according to an invention 27 is the optical display device control method according to any one of the inventions 20 to 26, wherein
The second light modulation element has a higher resolution than the first light modulation element.
Thereby, an effect equivalent to that of the optical display device of aspect 9 is obtained.

  Embodiments of the present invention will be described below with reference to the drawings. FIGS. 1 to 13 illustrate the implementation of the light propagation characteristic control device, the optical display device, the light propagation characteristic control program, the optical display device control program, the light propagation characteristic control method, and the optical display device control method according to the present invention. It is a figure which shows a form.

  In this embodiment, a light propagation characteristic control device, an optical display device, a light propagation characteristic control program, an optical display device control program, a light propagation characteristic control method, and an optical display device control method according to the present invention are shown in FIG. As shown in FIG. 4, the projection display device 100 is applied.

  First, the configuration of the projection display device 100 will be described with reference to FIG.

  FIG. 1 is a block diagram illustrating a hardware configuration of the projection display apparatus 100.

  As shown in FIG. 1, the projection display device 100 includes a light source 10, a luminance modulation unit 12 that modulates the luminance of all wavelength regions of light incident from the light source 10, and a wavelength region of light incident from the luminance modulation unit 12. Among them, a color modulation unit 14 that modulates the luminance of each of the RGB three primary colors and a projection unit 16 that projects light incident from the color modulation unit 14 onto a screen (not shown).

  The luminance modulation unit 12 includes a liquid crystal light valve 30 in which a plurality of pixels whose transmittance can be controlled independently are arranged in a matrix, and two fly-eye lenses 32a and 32b. Then, the luminance in the entire wavelength region of the light from the light source 10 is modulated by the liquid crystal light valve 30, and the modulated light is emitted to the color modulation unit 14 via the fly-eye lenses 32a and 32b.

The color modulation unit 14 includes a plurality of liquid crystal light valves 40R, 40G, and 40B having a resolution higher than that of the liquid crystal light valve 30, in which a plurality of pixels whose transmittance can be controlled independently are arranged in a matrix. field lenses 42R, 42G, and 42B ₁ ~42B _3, 2 dichroic mirrors 44a, and 44b, 3 mirrors 46a, 46b, and 46c, is constituted by a dichroic prism 48. First, light the dichroic mirror 44a of the brightness modulator 12, as well as spectral red, green and blue RGB3 primary by 44b, the field lens 42R, 42G, liquid crystal light through the 42B ₁ ~42B ₃ and mirror 46a~46c The light enters the valves 40R to 40B. Then, the brightness of the RGB three primary colors is modulated by the liquid crystal light valves 40R to 40B, and the modulated RGB three primary colors are condensed by the dichroic prism 48 and emitted to the projection unit 16.

  The liquid crystal light valves 30, 40R to 40B include a pixel substrate and a glass substrate on which switching elements such as thin film transistors and thin film diodes for driving the pixel electrode are formed in a matrix, and a glass substrate on which a common electrode is formed over the entire surface. This is an active matrix type liquid crystal display element in which a TN liquid crystal is sandwiched between and a polarizing plate is disposed on the outer surface. The liquid crystal light valves 30, 40R to 40B operate in a normally white mode. That is, the white / bright (transmission) state is applied when no voltage is applied, and the black / dark (non-transmission) state is applied when the voltage is applied, and the gradation between them is analog controlled according to a given control value.

  Further, the projection display device 100 includes a display control device 200 (not shown) that controls the liquid crystal light valve 30 and the liquid crystal light valves 40R to 40B. Hereinafter, the liquid crystal light valves 40R to 40B are collectively referred to as color modulation light valves, and the liquid crystal light valve 30 is referred to as a luminance modulation light valve in order to distinguish it from the color modulation light valves. In the present embodiment, the color modulation light valve determines the display resolution (refers to the resolution perceived by the observer when the observer views the display image of the projection display device 100).

  Next, the configuration of the display control apparatus 200 will be described in detail with reference to FIGS.

  FIG. 2 is a block diagram illustrating a hardware configuration of the display control apparatus 200.

  As shown in FIG. 2, the display control device 200 reads out from the CPU 70 that controls the calculation and the entire system based on the control program, the ROM 72 that stores the control program of the CPU 70 in a predetermined area, and the ROM 72. It is composed of a RAM 74 for storing data and calculation results required in the calculation process of the CPU 70, and an I / F 78 that mediates input / output of data to / from an external device, and these are used for transferring data. They are connected to each other via a bus 79 which is a signal line so as to be able to exchange data.

  The I / F 78 is connected to an external network 199 as an external device, a light valve driving device 80 that drives the luminance modulation light valve and the color modulation light valve, a storage device 82 that stores data, tables, and the like as files. The signal line for connecting is connected.

  The storage device 82 stores HDR display data.

The HDR display data is image data capable of realizing a high luminance dynamic range that cannot be realized by a conventional image format such as sRGB, and stores pixel values indicating pixel luminance levels for all pixels of the image. Currently, it is used to synthesize CG objects into actual scenery, especially in the CG world. Although there are various image formats, there are many formats in which pixel values are stored in a floating-point format in order to realize a higher luminance dynamic range than conventional image formats such as sRGB. As values to be stored, physical radiance not considering human visual characteristics (Radiance = W / (sr · m ² )) or luminance considering human visual characteristics (luminance = cd / m ² ). It is also a feature that it is a value regarding. In the present embodiment, the HDR display data uses a format in which pixel values indicating radiance levels for each of the three primary colors of RGB are stored as floating point values for one pixel. For example, the value (1.2, 5.4, 2.3) is stored as the pixel value of one pixel.

  The HDR display data is generated based on a HDR image having a high luminance dynamic range and a captured HDR image. However, with current film cameras and digital still cameras, HDR images with a high luminance dynamic range in nature cannot be taken at a time. Therefore, one HDR image is generated from a plurality of photographed images whose exposure is changed by some method. For details of the method for generating HDR display data, see, for example, publicly known document 1 “PEDebevec, J. Malik,“ Recovering High Dynamic Range Radiance Maps from Photographs ”, Proceedings of ACM SIGGRAPH97, pp.367-378 (1997). It is published in.

  Further, the storage device 82 stores a control value registration table 400 in which control values of the luminance modulation light valve are registered.

  FIG. 3 is a diagram illustrating a data structure of the control value registration table 400.

  In the control value registration table 400, as shown in FIG. 3, one record is registered for each control value of the luminance modulation light valve. Each record includes a field in which the control value of the luminance modulation light valve is registered and a field in which the transmittance of the luminance modulation light valve is registered.

  In the example of FIG. 3, “0” is registered as the control value and “0.003” is registered as the transmittance in the first row record. This indicates that when the control value “0” is output to the luminance modulation light valve, the transmittance of the luminance modulation light valve is 0.3%. Note that FIG. 3 shows an example in which the number of gradations of the luminance modulation light valve is 4 bits (0 to 15 values), but in reality, there is a record corresponding to the number of gradations of the luminance modulation light valve. be registered. For example, when the number of gradations is 8 bits, 256 records are registered.

  The storage device 82 stores control value registration tables 420R, 420G, and 420B in which the control values of the color modulation light valves are registered for each color modulation light valve.

  FIG. 4 is a diagram illustrating a data structure of the control value registration table 420R.

  In the control value registration table 420R, as shown in FIG. 4, one record is registered for each control value of the liquid crystal light valve 40R. Each record includes a field in which the control value of the liquid crystal light valve 40R is registered and a field in which the transmittance of the liquid crystal light valve 40R is registered.

  In the example of FIG. 4, “0” is registered as the control value and “0.004” is registered as the transmittance in the first row record. This indicates that when the control value “0” is output to the liquid crystal light valve 40R, the transmittance of the liquid crystal light valve 40R becomes 0.4%. FIG. 4 shows an example in which the number of gradations of the color modulation light valve is 4 bits (0 to 15 values). However, in actuality, there is a record corresponding to the number of gradations of the color modulation light valve. be registered. For example, when the number of gradations is 8 bits, 256 records are registered.

  The data structure of the control value registration tables 420G and 420B is not particularly shown, but has the same data structure as the control value registration table 420R. However, the difference from the control value registration table 420R is that the transmittance corresponding to the same control value is different.

  Next, the configuration of the CPU 70 and the processing executed by the CPU 70 will be described.

  The CPU 70 is composed of a microprocessing unit (MPU) or the like, starts a predetermined program stored in a predetermined area of the ROM 72, and executes display control processing shown in the flowchart of FIG. 5 according to the program. .

  FIG. 5 is a flowchart showing the display control process.

  The display control process is a process of determining the control values of the luminance modulation light valve and the color modulation light valve based on the HDR display data, and driving the luminance modulation light valve and the color modulation light valve based on the determined control value. When executed in the CPU 70, as shown in FIG. 5, first, the process proceeds to step S100.

  In step S100, the HDR display data is read from the storage device 82.

  Next, the process proceeds to step S102, where the read HDR display data is analyzed, and the maximum value Rmax, the minimum value, the average value, and the like of the luminance level of each color component are calculated in consideration of a histogram of pixel values and a white point. This analysis result is for use in automatic image correction such as brightening a dark scene, darkening a scene that is too bright, or coordinating intermediate contrast, or for tone mapping.

  Next, the process proceeds to step S104, and tone mapping is performed on the luminance level of the HDR display data to the luminance dynamic range of the projection display device 100 based on the analysis result of step S102.

  FIG. 6 is a diagram for explaining tone mapping processing.

  As a result of analyzing the HDR display data, it is assumed that the minimum value of the luminance level included in the HDR display data is Smin and the maximum value is Smax. Further, it is assumed that the minimum value of the luminance dynamic range of the projection display device 100 is Dmin and the maximum value is Dmax. In the example of FIG. 6, since Smin is smaller than Dmin and Smax is larger than Dmax, HDR display data cannot be appropriately displayed as it is. Therefore, normalization is performed so that the histogram of Smin to Smax falls within the range of Dmin to Dmax.

  Details of tone mapping are described in, for example, publicly known document 2 “F. Drago, K. Myszkowski, T. Annen, N. Chiba,“ Adaptive Logarithmic Mapping For Displaying High Contrast Scenes ”, Eurographics 2003, (2003)”. It is posted.

  Next, the process proceeds to step S106, and the HDR image is resized (enlarged or reduced) in accordance with the resolution of the color modulation light valve. At this time, the HDR image is resized while maintaining the aspect ratio of the HDR image. Examples of the resizing method include an average value method, an intermediate value method, and a nearest neighbor method (nearest neighbor method).

  Next, the process proceeds to step S108, and based on the luminance level Rp of each pixel of the resized image and the luminance Rs of the light source 10, the light modulation rate Tp is calculated for each pixel of the resized image by the above equation (1).

Next, the process proceeds to step S110, where the luminance level of the pixel p of the resized image is Rp, the maximum luminance level Rmax, the luminance level of the pixel p of the color modulation light valve is n, and the coefficient corresponding to the number of gradations of the color modulation light valve The luminance level n is calculated by the following equations (3) and (4), where m is the gamma coefficient and γ is the gamma coefficient. This is performed for all three primary colors of RGB for all pixels of the color modulation light valve.

Rp = Rmax × (n / m) ^γ (3)
n = exp ((log (Rp) −log (Rmax)) / γ + log (m)) (4)

Then, the transmittance T2 of each pixel of the color modulation light valve is provisionally determined based on the calculated luminance level n. Since the brightness level n corresponds to the control value of the color modulation light valve, the transmittance corresponding to the brightness level n may be read from the control value registration tables 420R to 420B.

  Next, the process proceeds to step S112, and based on the calculated light modulation rate Tp, the provisionally determined transmittance T2 and the gain G, the transmission of the luminance modulation light valve in units of pixels of the color modulation light valve according to the above equation (2). The rate T1 ′ is calculated. Here, since the color modulation light valve is composed of the three liquid crystal light valves 40R to 40B, the transmittance T1 'is calculated for each of the three primary colors of RGB for the same pixel. On the other hand, since the luminance modulation light valve is composed of one liquid crystal light valve 30, the average value thereof is calculated as T1 'of the pixel.

  Next, the process proceeds to step S114, and the transmittance T1 of each pixel of the luminance modulation light valve is calculated by performing pixel value matrix conversion processing (described later) twice based on the transmittance T1 'calculated in step S112.

  Next, the process proceeds to step S116, and for each pixel of the luminance modulation light valve, a control value corresponding to the transmittance T1 calculated for that pixel is read from the control value registration table 400, and the read control value is controlled for that pixel. Determine as value. In the reading of the control value, the transmittance closest to the calculated transmittance T1 is searched from the control value registration table 400, and the control value corresponding to the transmittance found by the search is read. This search is performed using, for example, a binary search method, thereby realizing a high-speed search.

  Next, the process proceeds to step S118, and the pixel value matrix conversion process is performed twice based on the transmittance T1 calculated in step S114, thereby obtaining the transmittance T1 '' of the luminance modulation light valve in units of pixels of the color modulation light valve. Based on the calculated transmittance T ″, the light modulation rate Tp calculated in step S108, and the gain G, the transmittance T2 of each pixel of the color modulation light valve is calculated by the above equation (2).

  Next, the process proceeds to step S120, and for each pixel of the color modulation light valve, a control value corresponding to the transmittance T2 calculated for the pixel is read from the control value registration tables 420R to 420B, and the read control value is read from the pixel. Is determined as the control value. In the reading of the control value, the transmittance that most closely approximates the calculated transmittance T2 is searched from the control value registration tables 420R to 420B, and the control value corresponding to the transmittance found by the search is read. This search is performed using, for example, a binary search method, thereby realizing a high-speed search.

  Next, the process proceeds to step S122, the control values determined in steps S116 and S120 are output to the light valve driving device 80, the brightness modulation light valve and the color modulation light valve are each driven to project a display image, and a series of operations are performed. End the process and return to the original process.

  Next, the first transmittance determination process in step S114 will be described in detail with reference to FIG.

  FIG. 7 is a flowchart showing the first transmittance determination process.

  When the first transmittance determination process is executed in step S114, the process first proceeds to step S200 as shown in FIG.

  In step S200, the pixel value matrix corresponding to the vertical and horizontal sizes of the color modulation light valve is set as a conversion source pixel value matrix, and the number of vertical pixels of the conversion source pixel value matrix is M1v. When the number of pixels is M1h, an array type variable V1 [M1v] [M1h] capable of storing M1v × M1h pixel values is secured, and the transmittance T1 ′ calculated for each pixel of the color modulation light valve is obtained. The pixel value is stored in the variable V1 [0 to M1v-1] [0 to M1h-1].

  Next, the process proceeds to step S202, in which the pixel value matrix corresponding to the vertical size of the luminance modulation light valve and the horizontal size of the color modulation light valve is used as the conversion destination pixel value matrix, and the conversion destination pixel value When the number of pixels in the vertical direction of the matrix is M2v, an array type variable V2 [M2v] [M1h] capable of storing M2v × M1h pixel values is secured.

  Next, the process proceeds to step S204, where the variable Sp indicating the horizontal position to be converted in the conversion source pixel value matrix and the size ratio between the conversion source pixel value matrix and the conversion destination pixel value matrix are indicated. Each variable r is secured, “0” is set to the variable Sp, and M2v / M1v is set to the variable r.

  Next, the process proceeds to step S206 to execute a pixel value matrix conversion process, and the process proceeds to step S208 to determine whether or not the pixel value matrix conversion process has been completed for all the pixels in the conversion source pixel value matrix. When it is determined that the pixel value matrix conversion process has been completed for all the pixels (Yes), the process proceeds to step S210.

  In step S210, a pixel value matrix corresponding to the vertical size of the luminance modulation light valve and the horizontal size of the color modulation light valve is used as a conversion source pixel value matrix, and M2v × M1h pixel values can be stored. A variable array variable V1 [M1h] [M2v] (relationship with the transposed matrix in step S200) is secured, and V2 [0 to M2v-1] [0 to M1h obtained by the pixel value matrix conversion process in step S206. −1] is stored in a variable V1 [0 to M1h−1] [0 to M2v−1] by transposing the pixel value in the vertical and horizontal directions.

  Next, the process proceeds to step S212, in which the pixel value matrix corresponding to the vertical and horizontal sizes of the luminance modulation light valve is set as the pixel value matrix of the conversion destination, and the number of pixels in the horizontal direction of the pixel value matrix of the conversion destination is set. When M2h is set, an array type variable V2 [M2h] [M2v] (relationship matrix relationship with step S202) that can store M2v × M2h pixel values is secured.

  Next, the process proceeds to step S214, where “0” is set to the variable Sp and M2h / M1h is set to the variable r, the process proceeds to step S216, the pixel value matrix conversion process is executed, and the process proceeds to step S218. When it is determined whether the pixel value matrix conversion process has been completed for all pixels in the conversion source pixel value matrix, and when it is determined that the pixel value matrix conversion process has been completed for all pixels (Yes), a series of End the process and return to the original process.

  The pixel value of V2 [0 to M2h-1] [0 to M2v-1] obtained by the pixel value matrix conversion process in step S216 becomes the transmittance T1 of each pixel of the luminance modulation light valve. Thus, the transmittance T1 of each pixel of the luminance modulation light valve can be calculated by performing the pixel value matrix conversion process twice based on the transmittance T1 '.

  On the other hand, if it is determined in step S218 that the pixel value matrix conversion process has not been completed for all pixels in the conversion source pixel value matrix (No), the process proceeds to step S220, and the value of the variable Sp is set to “1”. The added value is set in the variable Sp, and the process proceeds to step S216.

  On the other hand, if it is determined in step S208 that the pixel value matrix conversion process has not been completed for all pixels in the conversion source pixel value matrix (No), the process proceeds to step S222, and the value of the variable Sp is set to “1”. The sum is set in the variable Sp, and the process proceeds to step S206.

  Next, the second transmittance determination process in step S118 will be described in detail with reference to FIG.

  FIG. 8 is a flowchart showing the second transmittance determination process.

  When the second transmittance determination process is executed in step S118, as shown in FIG. 8, first, the process proceeds to step S300.

  In step S300, a pixel value matrix corresponding to the vertical and horizontal sizes of the luminance modulation light valve is used as a conversion source pixel value matrix, and an array type variable V1 [M2v capable of storing M2v × M2h pixel values. ] [M2h] is secured, and the transmittance T1 of each pixel of the luminance modulation light valve calculated in step S114 is stored as a pixel value in the variable V1 [0 to M2v-1] [0 to M2h-1].

  Next, the process proceeds to step S302, where a pixel value matrix corresponding to the vertical size of the color modulation light valve and the horizontal size of the luminance modulation light valve is used as a conversion destination pixel value matrix, and M1v × M2h pieces of pixel value matrices are obtained. An array type variable V2 [M1v] [M2h] that can store pixel values is secured.

  Next, the process proceeds to step S304, in which the variable Sp indicating the horizontal position to be converted in the conversion source pixel value matrix and the size ratio between the conversion source pixel value matrix and the conversion destination pixel value matrix are indicated. Each variable r is secured, “0” is set to the variable Sp, and M1v / M2v is set to the variable r.

  Next, the process proceeds to step S306 to execute a pixel value matrix conversion process, and the process proceeds to step S308 to determine whether or not the pixel value matrix conversion process has been completed for all the pixels in the conversion source pixel value matrix. When it is determined that the pixel value matrix conversion process has been completed for all the pixels (Yes), the process proceeds to step S310.

  In step S310, a pixel value matrix corresponding to the vertical size of the color modulation light valve and the horizontal size of the luminance modulation light valve is used as a conversion source pixel value matrix, and M1v × M2h pixel values can be stored. Variable V1 [M2h] [M1v] (relationship with the transposed matrix in step S300) is secured, and V2 [0 to M1v-1] [0 to M2h obtained by the pixel value matrix conversion processing in step S306 is secured. −1] is stored in a variable V1 [0 to M2h−1] [0 to M1v−1] by transposing in the vertical and horizontal directions.

  Next, the process proceeds to step S312, where the pixel value matrix corresponding to the vertical and horizontal sizes of the color modulation light valve is used as the conversion destination pixel value matrix, and an array type that can store M1v × M1h pixel values. Variable V2 [M1h] [M1v] (relationship between transposed matrix and step S302) is secured.

  Next, the process proceeds to step S314, where “0” is set in the variable Sp, and M1h / M2h is set in the variable r. Then, the process proceeds to step S316, the pixel value matrix conversion process is performed, and the process proceeds to step S318. When it is determined whether the pixel value matrix conversion process has been completed for all pixels in the conversion source pixel value matrix, and when it is determined that the pixel value matrix conversion process has been completed for all pixels (Yes), a series of End the process and return to the original process.

  The pixel values of V2 [0 to M1h-1] [0 to M1v-1] obtained by the pixel value matrix conversion processing in step S316 are the luminance modulation light valve transmittance T1 '' in pixel units of the color modulation light valve. It becomes. In this way, by performing the pixel value matrix conversion process twice based on the transmittance T1, the transmittance T1 ″ of the luminance modulation light valve can be calculated for each pixel of the color modulation light valve. The subsequent processing is not particularly shown, but based on the calculated transmittance T ″, the light modulation rate Tp calculated in step S108, and the gain G, the transmission of each pixel of the color modulation light valve by the above equation (2). The rate T2 is calculated.

  On the other hand, when it is determined in step S318 that the pixel value matrix conversion process has not been completed for all the pixels in the conversion source pixel value matrix (No), the process proceeds to step S320, and the value of the variable Sp is set to “1”. The added value is set in the variable Sp, and the process proceeds to step S316.

  On the other hand, if it is determined in step S308 that the pixel value matrix conversion process has not been completed for all pixels in the conversion source pixel value matrix (No), the process proceeds to step S322, and the value of the variable Sp is set to “1”. The added value is set in the variable Sp, and the process proceeds to step S306.

  Next, the pixel value matrix conversion processing in steps S206, S216, S306, and S316 will be described in detail with reference to FIG.

  FIG. 9 is a flowchart showing pixel value matrix conversion processing.

  When the pixel value matrix conversion process is executed in steps S206, S216, S306, and S316, as shown in FIG. 9, first, the process proceeds to step S400.

  In step S400, the variable n1 for counting the number of the first element of the variable V1 [] [], the variable n2 for counting the number of the first element of the variable V2 [] [], and the pixel value matrix of the conversion source Variable L1 indicating the position to be converted, variable L2 indicating the position to be converted in the pixel value matrix of the conversion destination, variable Lb indicating the position where the conversion process has been completed, and variable dL indicating the addition coefficient are secured respectively. . Then, “0” is set in the variables n1, n2, and Lb, the value of the variable r is set in the variable L1, and “1” is set in the variable L2.

  Next, the process proceeds to step S402, where it is determined whether the value of the variable L1 is equal to the value of the variable L2, and when it is determined that the value of the variable L1 is not equal to the value of the variable L2 (Yes), step S404 is performed. When it is determined whether or not the value of the variable L2 is larger than the value of the variable L1, and it is determined that the value of the variable L2 is smaller than the value of the variable L1 (No), the process proceeds to step S406. .

  In step S406, the value obtained by subtracting the value of variable Lb from the value of variable L2 is set to variable dL, the process proceeds to step S408, the value of variable L2 is set to variable Lb, and the process proceeds to step S410.

  In step S410, the value of variable dL is multiplied by the value of variable V1 [n1] [Sp], and the result of addition of the value of variable V2 [n2] [Sp] is added to variable V2 [n2] [Sp]. In step S412, the value obtained by adding “1” to the value of the variable n2 is set in the variable n2, and the value obtained by adding “1” to the value of the variable L2 is set in the variable L2. Migrate to

  In step S414, it is determined whether or not the value of the variable Lb has reached the vertical end point of the conversion source pixel value matrix, and when it is determined that the value has reached the vertical end point of the conversion source pixel value matrix (Yes) ) Terminates a series of processes and returns to the original process.

  On the other hand, when it is determined in step S414 that the value of the variable Lb has not reached the vertical end point of the pixel value matrix of the conversion source (No), the process proceeds to step S402.

  On the other hand, when it is determined in step S404 that the value of the variable L2 is larger than the value of the variable L1 (Yes), the process proceeds to step S416, and the value obtained by subtracting the value of the variable Lb from the value of the variable L1 is changed to the variable dL. Then, the process proceeds to step S418, the value of the variable L1 is set to the variable Lb, and the process proceeds to step S420.

  In step S420, the value of the variable dL is multiplied by the value of the variable V1 [n1] [Sp], and the value obtained by adding the value of the variable V2 [n2] [Sp] to the multiplication result is the variable V2 [n2] [Sp]. Then, the process proceeds to step S422, where the value obtained by adding “1” to the value of the variable n1 is set as the variable n1, and the value obtained by adding the variable r to the value of the variable L1 is set as the variable L1, and the process proceeds to step S414. Transition.

  On the other hand, when it is determined in step S402 that the value of the variable L1 is equal to the value of the variable L2 (Yes), the process proceeds to step S424, and the value obtained by subtracting the value of the variable Lb from the value of the variable L2 is set to the variable dL. Then, the process proceeds to step S426, the value of the variable L2 is set to the variable Lb, and the process proceeds to step S428.

  In step S428, the value of variable dL is multiplied by the value of variable V1 [n1] [Sp], and the result of addition of the value of variable V2 [n2] [Sp] is added to variable V2 [n2] [Sp]. In step S430, the value obtained by adding “1” to the value of the variable n1 is set to the variable n1, the value obtained by adding the variable r to the value of the variable L1 is set to the variable L1, and the value of the variable n2 is set to “ The value obtained by adding “1” is set to the variable n2, the value obtained by adding “1” to the value of the variable L2 is set to the variable L2, and the process proceeds to step S414.

  Next, the operation of the present embodiment will be described with reference to FIGS.

  In the following, all of the color modulation light valves have a resolution of 18 horizontal pixels × 12 vertical pixels and a gradation number of 8 bits, and the luminance modulation light valves have a resolution of 15 horizontal pixels × 10 vertical pixels and an 8-bit resolution. An explanation will be given taking as an example the case of having the number of gradations.

  In the display control device 200, the HDR display data is read through steps S100 to S104, the read HDR display data is analyzed, and the luminance level of the HDR display data is determined based on the analysis result. Tone-mapped to 100 luminance dynamic range. Next, through step S106, the HDR image is resized in accordance with the resolution of the color modulation light valve.

  Next, through step S108, the light modulation rate Tp is calculated for each pixel of the resized image. For example, the light modulation rate Tp of the pixel p in the resized image is such that the luminance level Rp (R, G, B) of the pixel p is (1.2, 5.4, 2.3) and the luminance Rs (R, R, If (G, B) is (10000, 10000, 10000), then (1.2, 5.4, 2.3) / (10000, 10000, 10000) = (0.00012, 0.00054, 0.00023).

  FIG. 10 is a diagram showing a case where the transmittance T2 of the color modulation light valve is provisionally determined.

  Next, through step S110, the transmittance T2 of each pixel of the color modulation light valve is provisionally determined. When the pixels in the upper left four sections of the color modulation light valve are p21 (upper left), p22 (upper right), p23 (lower left), and p24 (lower right), the luminance level n of the pixel p21 corresponds to the pixel p21 in the resized image. The luminance level of the pixel to be calculated is calculated by the above formulas (3) and (4) with Rp. Then, the transmittance corresponding to the calculated luminance level n is read from the control value registration tables 420R to 420B, and the read transmittance is given to the transmittance T21 of the pixel p21 as shown in FIG. It is done. Similarly to the pixel p21, the transmittances T22 to T24 of the pixels p22 to p24 can be obtained by calculating the luminance level n using the above equations (3) and (4).

  FIG. 11 is a diagram illustrating a case where the transmittance T1 'of the luminance modulation light valve is calculated for each pixel of the color modulation light valve.

  Next, through step S112, the transmittance T1 'of the luminance modulation light valve is calculated for each pixel of the color modulation light valve. When attention is paid to the pixels p21 to p24, the transmittances T11 to T14 of the luminance modulation light valves corresponding thereto correspond to the light modulation rates of the pixels p21 to p24 as Tp1 to Tp4 and the gain G as “1” as shown in FIG. It can be calculated by the following formulas (5) to (8).

Calculate using actual numerical values. When Tp1 = 0.00012, Tp2 = 0.05, Tp3 = 0.03, Tp4 = 0.01, T21 = 0.1, T22 = 0.2, T23 = 0.3, T24 = 0.4, T11 = 0.0012 according to the following equations (5) to (8), T12 = 0.25, T13 = 0.1, and T14 = 0.025.

T11 = Tp1 / T21 (5)
T12 = Tp2 / T22 (6)
T13 = Tp3 / T23 (7)
T14 = Tp4 / T24 (8)

FIG. 12 is a diagram illustrating a case where the transmittance T1 of each pixel of the luminance modulation light valve is determined.

  Next, through step S114, the transmittance T1 of each pixel of the luminance modulation light valve is determined.

  First, as shown in FIGS. 12A and 12B, a pixel value matrix in which the transmittance T1 ′ calculated in units of pixels of the color modulation light valve is arranged in a matrix as pixel values through steps S200 to S208. Is a pixel value matrix of the conversion source, and a pixel value matrix conversion process is performed using the pixel value matrix corresponding to the vertical size of the luminance modulation light valve and the horizontal size of the color modulation light valve as the conversion destination pixel value matrix. Done. In the pixel value matrix conversion process, the first pixel column arranged along the vertical direction in the pixel value matrix of the conversion source and the second pixel column arranged along the vertical direction in the pixel value matrix of the conversion destination are converted. As a target, the pixel value V2n of the nth pixel p2n in the second pixel column is calculated as follows. The pixel value V2n is k pixels in the first pixel column that overlaps the pixel p2n when the first pixel column and the second pixel column are overlapped on the assumption that the total length of the first pixel column and the second pixel column is the same. For each of p1k, weighting according to the degree to which the pixel p2n and the pixel p1k overlap in the length direction is performed on the pixel value V1k of the pixel p1k, and the weighting result is calculated as a summed value for all of the pixels p1k. The The pixel value V2n is calculated for all the pixels in the second pixel column through steps S400 to S430, and further for all the pixels in the conversion source pixel value matrix. In the example of FIGS. 12A and 12B, the resolution of the vertical direction of the pixel matrix is converted from 12 sections to 10 sections.

  Next, as shown in FIGS. 12B and 12C, the pixel value matrix of the conversion destination obtained by the pixel value matrix conversion process through steps S210 to S218 is set as the pixel value matrix of the conversion source this time. Pixel value matrix conversion processing is performed using a pixel value matrix corresponding to the vertical and horizontal sizes of the luminance modulation light valve as a conversion destination pixel value matrix. In the pixel value matrix conversion process, the first pixel column arranged along the horizontal direction in the pixel value matrix of the conversion source and the second pixel column arranged along the horizontal direction in the pixel value matrix of the conversion destination are converted. As a target, the pixel value V2n of the nth pixel p2n in the second pixel column is calculated as follows. The pixel value V2n is k pixels in the first pixel column that overlaps the pixel p2n when the first pixel column and the second pixel column are overlapped on the assumption that the total length of the first pixel column and the second pixel column is the same. For each of p1k, weighting according to the degree to which the pixel p2n and the pixel p1k overlap in the length direction is performed on the pixel value V1k of the pixel p1k, and the weighting result is calculated as a summed value for all of the pixels p1k. The The pixel value V2n is calculated for all the pixels in the second pixel column through steps S400 to S430, and further for all the pixels in the conversion source pixel value matrix. In the example of FIGS. 12B and 12C, the resolution of the horizontal direction of the pixel matrix is converted from 18 sections to 15 sections.

  The pixel value matrix of the conversion destination obtained by the second pixel value matrix conversion process is the transmittance T1 of each pixel of the luminance modulation light valve.

  Next, through step S116, for each pixel of the luminance modulation light valve, a control value corresponding to the transmittance T1 calculated for that pixel is read from the control value registration table 400, and the read control value is It is determined as a pixel control value. For example, when the transmittance T15 of the pixel p11 of the luminance modulation light valve is calculated as “0.1008”, referring to the control value registration table 400, “0.09” is the closest approximation as shown in FIG. Therefore, “8” is read from the control value registration table 400 as the control value of the pixel p11.

  FIG. 13 is a diagram illustrating a case where the transmittance T2 of each pixel of the color modulation light valve is determined.

  Next, through step S118, the transmittance T2 of each pixel of the color modulation light valve is determined.

  First, as shown in FIGS. 13A and 13B, through steps S300 to S308, a pixel value matrix in which the transmittance T1 of each pixel of the luminance modulation light valve is arranged as a pixel value as a pixel value is converted into a conversion source. The pixel value matrix conversion process is performed using the pixel value matrix corresponding to the vertical size of the color modulation light valve and the horizontal size of the luminance modulation light valve as the pixel value matrix of the conversion destination. In the pixel value matrix conversion process, the first pixel column arranged along the vertical direction in the pixel value matrix of the conversion source and the second pixel column arranged along the vertical direction in the pixel value matrix of the conversion destination are converted. As a target, the pixel value V2n of the nth pixel p2n in the second pixel column is calculated as follows. The pixel value V2n is k pixels in the first pixel column that overlaps the pixel p2n when the first pixel column and the second pixel column are overlapped on the assumption that the total length of the first pixel column and the second pixel column is the same. For each of p1k, weighting according to the degree to which the pixel p2n and the pixel p1k overlap in the length direction is performed on the pixel value V1k of the pixel p1k, and the weighting result is calculated as a summed value for all of the pixels p1k. The The pixel value V2n is calculated for all the pixels in the second pixel column through steps S400 to S430, and further for all the pixels in the conversion source pixel value matrix. In the examples of FIGS. 13A and 13B, the resolution of the vertical direction of the pixel matrix is converted from 10 sections to 12 sections.

  Next, as shown in FIGS. 13B and 13C, the pixel value matrix of the conversion destination obtained by the pixel value matrix conversion process through steps S310 to S318 is set as the pixel value matrix of the conversion source this time, Pixel value matrix conversion processing is performed using a pixel value matrix corresponding to the vertical and horizontal sizes of the color modulation light valve as a conversion destination pixel value matrix. In the pixel value matrix conversion process, the first pixel column arranged along the horizontal direction in the pixel value matrix of the conversion source and the second pixel column arranged along the horizontal direction in the pixel value matrix of the conversion destination are converted. As a target, the pixel value V2n of the nth pixel p2n in the second pixel column is calculated as follows. The pixel value V2n is k pixels in the first pixel column that overlaps the pixel p2n when the first pixel column and the second pixel column are overlapped on the assumption that the total length of the first pixel column and the second pixel column is the same. For each of p1k, weighting according to the degree to which the pixel p2n and the pixel p1k overlap in the length direction is performed on the pixel value V1k of the pixel p1k, and the weighting result is calculated as a summed value for all of the pixels p1k. The The pixel value V2n is calculated for all the pixels in the second pixel column through steps S400 to S430, and further for all the pixels in the conversion source pixel value matrix. In the example of FIGS. 13B and 13C, the resolution of the horizontal direction of the pixel matrix is converted from 15 sections to 18 sections.

  Then, the pixel value matrix of the conversion destination obtained by the second pixel value matrix conversion process becomes the transmittance T1 ″ of the luminance modulation light valve calculated for each pixel of the color modulation light valve. Thereafter, based on the calculated transmittance T ″, light modulation rate Tp, and gain G, the transmittance T2 of each pixel of the color modulation light valve is calculated by the above equation (2).

  Next, through step S120, for each pixel of the color modulation light valve, a control value corresponding to the transmittance T2 calculated for the pixel is read from the control value registration tables 420R to 420B, and the read control value is read out. Is determined as the control value of the pixel. For example, when the transmittance T28 is calculated as “0.0842” for the pixel p24 of the liquid crystal light valve 40R, referring to the control value registration table 420R, “0.07” is the closest value as shown in FIG. Therefore, “7” is read from the control value registration table 420R as the control value of the pixel p24.

  Then, through step S122, the determined control value is output to the light valve driving device 80. As a result, the luminance modulation light valve and the color modulation light valve are driven to project a display image.

  In this way, in the present embodiment, the transmittance T2 of each pixel of the color modulation light valve is provisionally determined, and luminance modulation is performed in units of pixels of the color modulation light valve based on the provisionally determined transmittance T2 and HDR display data. The transmittance T1 ′ of the light valve is calculated, and the transmittance T1 of each pixel of the luminance modulation light valve is calculated by performing pixel value matrix conversion processing twice based on the calculated transmittance T1 ′. .

  Thereby, since the light from the light source 10 is modulated through the luminance modulation light valve and the color modulation light valve, a relatively high luminance dynamic range and number of gradations can be realized. Similarly, the conversion process for the pixel column in one direction in the pixel value matrix is similarly performed for all the other pixel columns, and the entire conversion process for the pixel value matrix only needs to be performed twice. When the bulb and the color modulation light valve have different resolutions, the arithmetic processing for calculating the transmittance T1 of each pixel of the luminance modulation light valve becomes relatively simple as compared with the conventional case. Furthermore, since it is not necessary to maintain the number of gradation tables corresponding to the number of gradations, even if the number of gradations is increased, the size of the gradation table and the generation time are greatly increased compared to the conventional case. There is no.

  Further, in this embodiment, the pixel value matrix conversion process is performed twice based on the determined transmittance T1, thereby calculating the transmittance T1 '' of the luminance modulation light valve for each pixel of the color modulation light valve. Based on the transmittance T1 ″ and the HDR display data, the transmittance T2 of each pixel of the color modulation light valve is calculated.

  As a result, the conversion process for the pixel column in one direction in the pixel value matrix is similarly performed for all the other pixel columns, and the entire conversion process for the pixel value matrix only needs to be performed twice. When the light valve and the color modulation light valve have different resolutions, the arithmetic processing for calculating the transmittance T2 of each pixel of the color modulation light valve becomes relatively simple as compared with the conventional case.

  Further, in the present embodiment, the color modulation light valve is a light modulation element that determines display resolution.

  As a result, since the transmittance T2 of the color modulation light valve that determines the display resolution is determined later, the influence of errors can be suppressed, and the possibility that the image quality is deteriorated can be further reduced.

  Further, in the present embodiment, a luminance modulation light valve is used as the first-stage light modulation element, and a color modulation light valve is used as the second-stage light modulation element.

  Thus, since only one light modulation element needs to be added to the conventional projection display device, the projection display device 100 can be configured relatively easily.

  In the above-described embodiment, the brightness modulation light valve is the first light modulation element of the inventions 1 to 5, 7, 9 to 14, 16, 18 to 23, 25 or 27, or the entire wavelength region of the inventions 7, 16 or 25. Corresponding to the luminance modulation element, the color modulation light valve corresponds to the second light modulation element of the invention 1 to 7, 9 to 16, 18 to 25 or 27, or the specific wavelength region luminance modulation element of the invention 7, 16 or 25. is doing. Step S110 corresponds to the light propagation characteristics provisional determination means of Inventions 2 to 4, 11 to 13, or the light propagation characteristics provisional determination steps of Inventions 20 to 22, and Steps S112 and S114 correspond to the light of Inventions 1 or 10. This corresponds to the propagation characteristic determining means, the first light propagation characteristic determining means of the inventions 2 to 4, 11 to 13, the first light propagation characteristic determining step of the inventions 20 to 22, or the light propagation characteristic determining step of the invention 19.

  Moreover, in the said embodiment, step S116 respond | corresponds to the 1st control value determination means of the invention 2, 4, 11 or 13, or the 1st control value determination step of the invention 20 or 22, and step S118 is the invention 2 4, 5, 11, 13, or 14, the second light propagation characteristic determination means, or the second light propagation characteristic determination step of the invention 20, 22, or 23. Step S120 corresponds to the second control value determining means of the invention 2, 4, 11, or 13, or the second control value determining step of the invention 20 or 22, and steps S400 to S430 are the invention 1 to 5, 10 of the invention. This corresponds to the pixel value matrix conversion means of 14 to 14, or the pixel value matrix conversion step of the inventions 19 to 23.

  In the above embodiment, the pixel value matrix conversion process is performed twice to calculate the transmittance T1 of each pixel of the luminance modulation light valve. However, the luminance modulation light valve and the color modulation light valve When the number of pixels in the vertical direction or the horizontal direction is the same, the transmittance T1 of each pixel of the luminance modulation light valve can be calculated by performing the pixel value matrix conversion process once.

  In the above embodiment, the pixel value matrix conversion process is performed twice to calculate the transmittance T1 ″ of the luminance modulation light valve in units of pixels of the color modulation light valve. When the number of pixels in the vertical direction or the horizontal direction of the bulb and the color modulation light valve is the same, the transmittance T1 ′ of the luminance modulation light valve in units of pixels of the color modulation light valve by performing the pixel value matrix conversion process once. 'Can be calculated.

  In the above embodiment, since the luminance modulation light valve is composed of one liquid crystal light valve 30, one control value registration table 400 is prepared, and luminance modulation is performed based on the control value registration table 400. Although the configuration is such that the control value of each pixel of the light valve is determined, the present invention is not limited to this, and control value registration tables 400R, 400G, and 400B are prepared for each of the three primary colors of RGB, and the luminance is based on the control value registration tables 400R to 400B. The control value of each pixel of the modulation light valve can be determined. Since the luminance modulation light valve modulates the luminance in the entire wavelength region of light, the transmittance of light having typical wavelengths is registered in the control value registration table 400. However, the respective transmittances of the RGB three primary colors are not necessarily registered transmittances.

  Therefore, for the luminance modulation light valve, strictly, the transmittance corresponding to the control value is measured for each of the three primary colors RGB, and the control value registration tables 400R to 400B are configured. Next, the transmittance T1 of each pixel of the luminance modulation light valve is determined for each of the RGB three primary colors, and the transmittance closest to the transmittance T1 calculated for R is searched from the control value registration table 400R, and the search is performed. A control value corresponding to the transmitted transmittance is read. Similarly, corresponding control values are read from the control value registration tables 400G and 400B based on the transmittance T1 calculated for G and the transmittance T1 calculated for B. Then, the average value of the control values read for the same pixel of the luminance modulation light valve is calculated as the control value of that pixel.

  As a result, the control value of each pixel of the luminance modulation light valve becomes a relatively appropriate value with respect to the transmittance of each of the RGB primary colors of the pixel of the color modulation light valve that overlaps the pixel on the optical path. The possibility of doing so can be further reduced.

  In the above embodiment, the color modulation light valve is configured as a light modulation element that determines display resolution. However, the present invention is not limited thereto, and the luminance modulation light valve is configured as a light modulation element that determines display resolution. You can also. In this case, the transmittance T1 of each pixel of the luminance modulation light valve is determined after determining the transmittance T1 of each pixel of the color modulation light valve (the transmittance of the light modulation element determined previously is T1). The transmittance of the light modulation element to be determined later is T2.) Further, similarly to the above, the control value registration tables 400R to 400B are prepared for each of the three primary colors of RGB, and the control value of each pixel of the luminance modulation light valve is determined based on the control value registration tables 400R to 400B. You can also.

  Specifically, the transmittance T2 of each pixel of the luminance modulation light valve is determined for each of the RGB three primary colors, and the transmittance that most closely approximates the transmittance T2 calculated for R is searched from the control value registration table 400R. The control value corresponding to the transmittance searched out is read out. Similarly, the corresponding control value is read from the control value registration tables 400G and 400B based on the transmittance T2 calculated for G and the transmittance T2 calculated for B. Then, the average value of the control values read for the same pixel of the luminance modulation light valve is calculated as the control value of that pixel.

  As a result, the control value of each pixel of the luminance modulation light valve becomes a relatively appropriate value with respect to the transmittance of each of the RGB primary colors of the pixel of the color modulation light valve that overlaps the pixel on the optical path. The possibility of doing so can be further reduced.

  In the above-described embodiment, the projection display apparatus 100 includes the liquid crystal light valve 30 as a luminance modulation light valve. However, the present invention is not limited to this, and as shown in FIG. 14, liquid crystal light valves 40R to 40B. In addition, liquid crystal light valves 30R, 30G, and 30B may be provided on the incident side. In this case, the light modulation unit that determines the display resolution may be any one of the liquid crystal light valves 30R to 30B and the liquid crystal light valves 40R to 40B.

  FIG. 14 is a block diagram illustrating a hardware configuration when the projection display apparatus 100 is configured by providing a luminance modulation light valve and a color modulation light valve for each of the three primary colors of RGB.

  Thereby, since the brightness | luminance for every RGB primary color can be modulated independently in two steps, possibility that an image quality will deteriorate can further be reduced.

  In this case, the liquid crystal light valves 30R to 30B and 40R to 40B are the first light modulation element of the invention 8, 17 or 26, the second light modulation element of the invention 8, 17 or 26, or the invention 8, 17 or 26, respectively. It corresponds to a specific wavelength region luminance modulation element.

  In the above embodiment, the projection display device 100 is configured by optically connecting the luminance modulation unit 12 and the color modulation unit 14 directly. However, the present invention is not limited to this, and as shown in FIG. A relay lens 50 may be provided between the unit 12 and the color modulation unit 14. In this case, the light modulation unit that determines the display resolution may be either the luminance modulation unit 12 or the color modulation unit 14.

  FIG. 15 is a block diagram showing a hardware configuration when the projection display device 100 is configured by providing the relay lens 50 between the luminance modulation unit 12 and the color modulation unit 14.

  Thereby, the image of the luminance modulation light valve can be accurately mapped to the color modulation light valve, so that the imaging accuracy can be improved.

  In the above-described embodiment, the projection display device 100 is configured by providing the color modulation unit 14 on the emission side of the luminance modulation unit 12. However, the present invention is not limited to this, and as shown in FIG. It is also possible to provide a luminance modulation unit 12 on the emission side. In this case, in order to improve the imaging accuracy, it is preferable to provide the relay lens 50 between the color modulation unit 14 and the luminance modulation unit 12. Further, the light modulation unit that determines the display resolution may be either the color modulation unit 14 or the luminance modulation unit 12.

  FIG. 16 is a block diagram illustrating a hardware configuration when the projection display apparatus 100 is configured by providing the luminance modulation section 12 on the emission side of the color modulation section 14.

  Further, in the above embodiment, the projection display device 100 is configured with the color modulation unit 14 as a three-plate type (a method in which color modulation is performed by the three liquid crystal light valves 40R to 40B). As shown in FIG. 4, the color modulation unit 14 can be configured as a single plate type (a system in which color modulation is performed by one liquid crystal light valve 40). A single-plate color modulation light valve can be configured by providing a color filter on a liquid crystal light valve, for example. In this case, it is preferable to provide a relay lens 50 between the luminance modulation unit 12 and the color modulation unit 14 in order to improve imaging accuracy. Further, the light modulation unit that determines the display resolution may be either the luminance modulation unit 12 or the color modulation unit 14.

  FIG. 17 is a block diagram showing a hardware configuration when the projection display device 100 is configured as a single plate type.

  Moreover, in the said embodiment, although the projection type display apparatus 100 comprised the luminance modulation part 12 and the color modulation part 14, it is not restricted to this, As shown in FIG. A single-plate projection display device 310 that modulates luminance, a light-projecting Fresnel lens 312 that receives projection light from the single-plate projection display device 310, a light-emitting element for each of the three primary colors of RGB provided on the emission side of the Fresnel lens 312 It can also be configured as a projection display system 300 including a color modulation panel 314 that modulates luminance. In this case, the light modulation unit that determines the display resolution may be either the single-plate projection display device 310 or the color modulation panel 314.

  FIG. 18 is a block diagram illustrating a hardware configuration of the projection display system 300.

  Further, in the above embodiment, the projection display device 100 is configured to include the luminance modulation unit 12 and the color modulation unit 14. However, the present invention is not limited to this, and as shown in FIG. A three-plate projection display device 320 that modulates luminance, a light-projecting Fresnel lens 312 that receives projection light from the three-plate projection display device 320, a light-emitting wavelength region provided on the emission side of the Fresnel lens 312 It can also be configured as a projection display system 300 including a luminance modulation panel 324 that modulates luminance. In this case, the light modulation unit that determines the display resolution may be either the three-plate projection display device 320 or the luminance modulation panel 324.

  FIG. 19 is a block diagram illustrating a hardware configuration of the projection display system 300.

  Further, in the above embodiment, the projection display device 100 is configured to include the luminance modulation unit 12 and the color modulation unit 14, but the present invention is not limited to this, and as shown in FIG. A luminance modulation panel 412 provided on the emission side of the light 410 and modulating the luminance of the entire wavelength region of light; and a color modulation panel 414 provided on the emission side of the luminance modulation panel 412 and modulating the luminance of light for each of the three primary colors of RGB. The display 400 can also be configured. In this case, the light modulation unit that determines the display resolution may be either the luminance modulation panel 412 or the color modulation panel 414.

  FIG. 20 is a block diagram illustrating a hardware configuration of the display 400.

  Thus, various variations are conceivable as the configurations of the first light modulation element and the second light modulation element. The variations of the configuration of the first light modulation element and the second light modulation element, including the configurations of FIGS. 1, 14 to 20, are summarized as follows. It is assumed that the second light modulation element determines the display resolution and has a high resolution.

(1) A single-plate luminance modulation light valve is used as the second light modulation element, a three-plate color modulation light valve is used as the first light modulation element, and the second light modulation element is provided on the light source 10 side. (Configuration of FIGS. 1, 15, 18 and 20) Thereby, the manufacturing cost can be reduced as compared with the configuration of (2).

(2) A single-plate type luminance modulation light valve is used as the first light modulation element, a three-plate type color modulation light valve is used as the second light modulation element, and the first light modulation element is provided on the light source 10 side. (Configuration of FIGS. 1, 15, 18 and 20) Thereby, image quality can be improved as compared with the configuration of (1).

(3) A three-plate color modulation light valve is used as the second light modulation element, a single-plate luminance modulation light valve is used as the first light modulation element, and the second light modulation element is provided on the light source 10 side. (Configuration of FIGS. 16 and 19) Thereby, the image quality can be improved as compared with the configuration of (4).

(4) A three-plate color modulation light valve is used as the first light modulation element, a single-plate luminance modulation light valve is used as the second light modulation element, and the first light modulation element is provided on the light source 10 side. (Structure of FIG. 16 and FIG. 19) Thereby, compared with the structure of (3), manufacturing cost can be reduced.

(5) A three-plate color modulation light valve is used as the second light modulation element, a three-plate color modulation light valve is used as the first light modulation element, and the second light modulation element is provided on the light source 10 side. (Configuration of FIG. 14) Thereby, the image quality can be improved as compared with the configurations of (2) and (3).

(6) A three-plate color modulation light valve is used as the first light modulation element, a three-plate color modulation light valve is used as the second light modulation element, and the first light modulation element is provided on the light source 10 side. (Configuration of FIG. 14) Thereby, the image quality can be improved as compared with the configurations of (2) and (3).

(7) A single-plate luminance modulation light valve is used as the second light modulation element, a single-plate color modulation light valve is used as the first light modulation element, and the second light modulation element is provided on the light source 10 side. (Structure of FIG. 17) Thereby, compared with the structure of (8), manufacturing cost can be reduced.
(8) A single-plate luminance modulation light valve is used as the first light modulation element, a single-plate color modulation light valve is used as the second light modulation element, and the first light modulation element is provided on the light source 10 side. (Configuration of FIG. 17) Thereby, the image quality can be improved as compared with the configuration of (7).

(9) A single-plate color modulation light valve is used as the second light modulation element, a single-plate luminance modulation light valve is used as the first light modulation element, and the second light modulation element is provided on the light source 10 side. Thereby, the image quality can be improved as compared with the configuration of (10).

(10) A single plate type color modulation light valve is used as the first light modulation element, a single plate type luminance modulation light valve is used as the second light modulation element, and the first light modulation element is provided on the light source 10 side. Thereby, compared with the structure of (9), manufacturing cost can be reduced.

(11) A single-plate color modulation light valve is used as the second light modulation element, a three-plate color modulation light valve is used as the first light modulation element, and the second light modulation element is provided on the light source 10 side. Thereby, compared with the structure of (12), manufacturing cost can be reduced.

(12) A single-plate color modulation light valve is used as the first light modulation element, a three-plate color modulation light valve is used as the second light modulation element, and the first light modulation element is provided on the light source 10 side. Thereby, the image quality can be improved as compared with the configuration of (11).

(13) A three-plate color modulation light valve is used as the second light modulation element, a single-plate color modulation light valve is used as the first light modulation element, and the second light modulation element is provided on the light source 10 side. Thereby, the image quality can be improved as compared with the configuration of (14).

(14) A three-plate color modulation light valve is used as the first light modulation element, a single-plate color modulation light valve is used as the second light modulation element, and the first light modulation element is provided on the light source 10 side. Thereby, compared with the structure of (13), a manufacturing cost can be reduced.

(15) A single-plate color modulation light valve is used as the second light modulation element, a single-plate color modulation light valve is used as the first light modulation element, and the second light modulation element is provided on the light source 10 side. Thereby, compared with the structure of (9), an image quality can be improved.

(16) A single-plate color modulation light valve is used as the first light modulation element, a single-plate color modulation light valve is used as the second light modulation element, and the first light modulation element is provided on the light source 10 side. Thereby, compared with the structure of (9), an image quality can be improved.

(17) A single-plate luminance modulation light valve is used as the second light modulation element, a single-plate luminance modulation light valve is used as the first light modulation element, and the second light modulation element is provided on the light source 10 side. Thereby, compared with the structure of (10), a manufacturing cost can be reduced.

(18) A single-plate luminance modulation light valve is used as the first light modulation element, a single-plate luminance modulation light valve is used as the second light modulation element, and the first light modulation element is provided on the light source 10 side. Thereby, compared with the structure of (10), a manufacturing cost can be reduced.

  In the above embodiment, the control values of the luminance modulation light valve and the color modulation light valve are determined based on the HDR display data. However, when the normal 8-bit RGB image data for each color is used, The RGB image data of 0 to 255 is not a physical quantity of luminance but a relative value of 0 to 255. Therefore, in order to display the display device of the present invention based on normal RGB image data, the physical luminance Rp to be displayed or the transmittance Tp of the entire display device must be determined from the normal RGB image. .

  FIG. 21 shows the data structure of the input value registration table 440. As shown in FIG.

  Therefore, by using the input value registration table 440 of FIG. 21, it is possible to convert an input value of 0 to 255 of a normal RGB image into a physical transmittance Tp, and the transmittance Tp of this table. It is possible to easily change the display appearance (gradation characteristics) of a normal RGB image depending on the setting method. Since the transmittance Tp in this table is Tp in the above equation (2), if this value is determined, the same processing as in the above embodiment is performed thereafter, whereby the transmittance of a plurality of light modulation elements is obtained. T1 and T2 are determined and can be displayed.

  FIG. 22 is a diagram showing the data structure of the input value registration table 460.

  The input value registration table 460 in FIG. 22 uses the luminance Rp instead of the transmittance Tp. Since the luminance Rp in this table is Rp in the above equation (1), once this value is determined, the same processing as in the above embodiment is performed thereafter, thereby transmitting the transmittance T1 of the plurality of light modulation elements. , T2 is determined and can be displayed.

In the above embodiment, for each pixel of the color modulation light valve, the weighted average value of the transmittance T1 determined for the pixel of the luminance modulation light valve that overlaps the pixel on the optical path is calculated, and the average value is calculated. The transmittance T2 of the pixel is calculated based on the control value, but the present invention is not limited to this. For each pixel of the color modulation light valve, the control value determined for the pixel of the luminance modulation light valve that overlaps the pixel on the optical path Based on the above, the transmittance T1 _table corresponding to the control value is read from the control value registration table 400, the weighted average value of the read transmittance T1 _table is calculated, and the transmittance T2 of the pixel is calculated based on the average value. Can also be configured to calculate.

  In the above embodiment, the average value of the transmittance T1 ′ calculated for each of the three primary colors of RGB for the same pixel is calculated as T1 ′ of the pixel. However, the present invention is not limited to this, and the transmittance T1 'Can be calculated as it is for each of the three primary colors of RGB, and in step S114, the average value of the transmittance T1 calculated for each of the three primary colors of RGB for the same pixel can be calculated as T1 of that pixel.

  In the above embodiment, for each pixel of the color modulation light valve, the weighted average value of the transmittance T1 determined for the pixel of the luminance modulation light valve that overlaps the pixel on the optical path is calculated, and the average value is calculated. Based on this, the transmittance T2 of the pixel is calculated. However, the present invention is not limited to this, and for each pixel of the color modulation light valve, the transmittance determined for the pixel of the luminance modulation light valve that overlaps the pixel on the optical path. The maximum value, the minimum value, or the average value of T1 can be calculated, and the transmittance T2 of the pixel can be calculated based on the calculated value.

  In the above embodiment, the luminance modulation light valve and the color modulation light valve are used to modulate the luminance of light in two stages. However, the present invention is not limited to this, and two sets of luminance modulation light valves are used. It can also be configured to modulate the luminance of light in two steps.

  In the above embodiment, the liquid crystal light valves 30, 40R to 40B are configured using active matrix liquid crystal display elements. However, the present invention is not limited to this, and the liquid crystal light valves 30, 40R to 40B are passive matrix type liquid crystal display elements. A liquid crystal display element and a segment type liquid crystal display element can also be used. An active matrix type liquid crystal display element has an advantage that precise gradation display can be performed, and a passive matrix type liquid crystal display element and a segment type liquid crystal display element have an advantage that they can be manufactured at low cost.

  In the above-described embodiment, the projection display device 100 is configured by providing the transmissive light modulation element. However, the present invention is not limited to this, and the luminance modulation light valve or the color modulation light valve is a reflection type light such as DMD. A modulation element can also be used. In this case, the reflectance is determined based on the HDR display data.

  Further, in the above embodiment, for the sake of simplicity, the light modulation element having a small number of pixels and the number of gradations is used. However, even when a light modulation element having a large number of pixels and the number of gradations is used, Processing can be performed in the same manner as in the embodiment.

  In the above embodiment, the gain G = 1.0 is set for the sake of simplicity, but the gain G is not 1.0 depending on the hardware configuration. In consideration of the actual calculation cost, it is preferable to register the control value and the transmittance in the control value registration table in a manner including the influence of the gain G.

  Further, in the above embodiment, when executing the processing shown in the flowcharts of FIGS. 5, 7, 8 and 9, the case where the control program stored in advance in the ROM 72 is executed has been described. However, the present invention is not limited to this, and the program may be read from the storage medium storing the program showing these procedures into the RAM 74 and executed.

  Here, the storage medium is a semiconductor storage medium such as RAM or ROM, a magnetic storage type storage medium such as FD or HD, an optical reading type storage medium such as CD, CDV, LD, or DVD, or a magnetic storage type such as MO. / Optical reading type storage media, including any storage media that can be read by a computer regardless of electronic, magnetic, optical, or other reading methods.

  In the above embodiment, the light propagation characteristic control device, the optical display device, the light propagation characteristic control program, the optical display device control program, the light propagation characteristic control method, and the optical display device control method according to the present invention are provided. As shown in FIG. 1, the present invention is applied to the projection display device 100. However, the present invention is not limited to this, and can be applied to other cases without departing from the gist of the present invention.

2 is a block diagram showing a hardware configuration of a projection display apparatus 100. FIG. 3 is a block diagram illustrating a hardware configuration of a display control device 200. FIG. 6 is a diagram illustrating a data structure of a control value registration table 400. FIG. It is a figure which shows the data structure of the control value registration table 420R. It is a flowchart which shows a display control process. It is a figure for demonstrating a tone mapping process. It is a flowchart which shows a 1st transmittance | permeability determination process. It is a flowchart which shows a 2nd transmittance | permeability determination process. It is a flowchart which shows a pixel value matrix conversion process. It is a figure which shows the case where the transmittance | permeability T2 of a color modulation light valve is provisionally determined. It is a figure which shows the case where the transmittance | permeability T1 'of a brightness | luminance modulation light valve is calculated per pixel of a color modulation light valve. It is a figure which shows the case where the transmittance | permeability T1 of each pixel of a brightness | luminance modulation light valve is determined. It is a figure which shows the case where the transmittance | permeability T2 of each pixel of a color modulation light valve is determined. It is a block diagram which shows the hardware constitutions at the time of providing the brightness | luminance modulation | alteration light valve and the color modulation | alteration light valve for every three primary colors of RGB, and comprising the projection type display apparatus 100. FIG. 2 is a block diagram showing a hardware configuration when a projection type display device 100 is configured by providing a relay lens 50 between a luminance modulation section 12 and a color modulation section 14. FIG. FIG. 3 is a block diagram showing a hardware configuration when a projection display device 100 is configured by providing a luminance modulation unit 12 on the emission side of a color modulation unit 14. It is a block diagram which shows the hardware constitutions at the time of comprising the projection type display apparatus 100 as a single plate type. 2 is a block diagram showing a hardware configuration of a projection display system 300. FIG. 2 is a block diagram showing a hardware configuration of a projection display system 300. FIG. 4 is a block diagram showing a hardware configuration of a display 400. FIG. It is a figure which shows the data structure of the input value registration table. It is a figure which shows the data structure of the input value registration table 460.

Explanation of symbols

DESCRIPTION OF SYMBOLS 100 ... Projection type display apparatus, 10 ... Light source, 12 ... Luminance modulation part, 30 ... Liquid crystal light valve, 32a, 32b ... Fly eye lens, 14 ... Color modulation part, 40, 40R-40B ... Liquid crystal light valve, 42R, 42G , 42B _{1 to} 42B ₃ ... field lenses, 44a, 44b ... dichroic mirrors, 46a-46c ... mirrors, 48 ... dichroic prisms, 16 ... projection unit, 70 ... CPU, 72 ... ROM, 74 ... RAM, 78 ... I / F , 79 ... Bus, 80 ... Light valve drive device, 82 ... Storage device, 199 ... Network, 400, 400R to 400G, 420R to 420G ... Control value registration table, 30R to 30B ... Liquid crystal light valve, 50 ... Relay lens, 300 ... Projection display system, 310 ... Single-plate projection display device, 312 ... Fresnel lens, 314 ... color modulation panel, 320 ... three-plate projection display device, 324 ... luminance modulation panel, 400 ... display, 410 ... backlight, 412 ... luminance modulation panel, 414 ... color modulation panel, 440, 460 ... input Value registration table

Claims (12)

A first light modulation element in which a light source and a plurality of pixels whose light propagation characteristics can be independently controlled are arranged in a matrix, and a plurality of pixels whose light propagation characteristics can be independently controlled are arranged in a matrix and the first A device for displaying an image by modulating light from the light source via the first light modulation element and the second light modulation element. And
Temporary light propagation characteristic deciding means for tentatively determining the light propagation characteristic of each pixel of the second light modulation element, and the first light modulation based on the light propagation characteristic and the display data tentatively decided by the light propagation characteristic tentative decision means A first light propagation characteristic determining means for determining a light propagation characteristic of each pixel of the element; and a control value of each pixel of the first light modulation element based on the light propagation characteristic determined by the first light propagation characteristic determining means. First control value determining means for determining, second light for determining light propagation characteristics of each pixel of the second light modulation element based on the light propagation characteristics determined by the first light propagation characteristic determining means and the display data Propagation characteristic determining means, second control value determining means for determining a control value of each pixel of the second light modulation element based on the light propagation characteristics determined by the second light propagation characteristic determining means, and the first light pixel array of modulating elements and the second light modulator device In correspondence with the pixel value matrix conversion means for converting the pixel value matrix of the pixel values different pixel value matrix arranged in a matrix size of the pixel,
The pixel value matrix conversion means includes: a first pixel array arranged along a specific direction in a conversion source pixel value matrix; and a second pixel arranged along the specific direction in a conversion destination pixel value matrix. For the column, the pixel value V2n of the n-th pixel p2n of the second pixel column is the same as the first pixel column and the second pixel, assuming that the total length of the first pixel column and the second pixel column is the same. For each of the k pixels p1k of the first pixel column that overlaps the pixel p2n when the columns are overlapped, the pixel value V1k of the pixel p1k is set based on the degree of overlap of the pixel p2n and the pixel p1k in the length direction. Weighting is performed, and the weighting result is calculated as a total value for all of the pixels p1k.
The calculation of the pixel value V2n is performed for all the pixels in the second pixel column, and is further performed for all the pixel columns in the specific direction in the pixel value matrix of the conversion source,
The first light propagation characteristic determining unit is configured to transmit the light propagation of the first light modulation element in units of pixels of the second light modulation element based on the light propagation characteristic temporarily determined by the light propagation characteristic temporary determination unit and the display data. Characteristics are calculated, and light propagation characteristics of each pixel of the first light modulation element are calculated by performing conversion by the pixel value matrix conversion means at least once based on the calculated light propagation characteristics. An optical display device. In claim 1 ,
The first light propagation characteristic determining unit is configured to transmit the light propagation of the first light modulation element in units of pixels of the second light modulation element based on the light propagation characteristic temporarily determined by the light propagation characteristic temporary determination unit and the display data. Calculate the characteristics,
A direction corresponding to the column direction of the first light modulation element and the second light modulation element is the specific direction, and light propagation characteristics calculated in units of pixels of the second light modulation element are arranged in a matrix as the pixel values. The converted pixel value matrix is used as the conversion source pixel value matrix, and the pixel value matrix corresponding to the size of the first light modulation element in the column direction is used as the conversion destination pixel value matrix. Done
The direction corresponding to the row direction of the first light modulation element and the second light modulation element is the specific direction, the pixel value matrix converted by the pixel value matrix conversion unit is the pixel value matrix of the conversion source, and the first Each pixel of the first light modulation element is converted by the pixel value matrix conversion means using the pixel value matrix corresponding to the size in the column direction and the row direction of the one light modulation element as the pixel value matrix of the conversion destination. An optical display device characterized by calculating the light propagation characteristics of the optical display device. A first light modulation element in which a light source and a plurality of pixels whose light propagation characteristics can be independently controlled are arranged in a matrix, and a plurality of pixels whose light propagation characteristics can be independently controlled are arranged in a matrix and the first A device for displaying an image by modulating light from the light source via the first light modulation element and the second light modulation element. And
Temporary light propagation characteristic deciding means for tentatively determining the light propagation characteristic of each pixel of the second light modulation element, and the first light modulation based on the light propagation characteristic and the display data tentatively decided by the light propagation characteristic tentative decision means A first light propagation characteristic determining means for determining a light propagation characteristic of each pixel of the element; and a control value of each pixel of the first light modulation element based on the light propagation characteristic determined by the first light propagation characteristic determining means. First control value determining means for determining, second light for determining light propagation characteristics of each pixel of the second light modulation element based on the light propagation characteristics determined by the first light propagation characteristic determining means and the display data Propagation characteristic determining means, second control value determining means for determining a control value of each pixel of the second light modulation element based on the light propagation characteristics determined by the second light propagation characteristic determining means, and the first light pixel array of modulating elements and the second light modulator device In correspondence with the pixel value matrix conversion means for converting the pixel value matrix of the pixel values different pixel value matrix arranged in a matrix size of the pixel,
The pixel value matrix conversion means includes: a first pixel array arranged along a specific direction in a conversion source pixel value matrix; and a second pixel arranged along the specific direction in a conversion destination pixel value matrix. For the column, the pixel value V2n of the n-th pixel p2n of the second pixel column is the same as the first pixel column and the second pixel, assuming that the total length of the first pixel column and the second pixel column is the same. For each of the k pixels p1k of the first pixel column that overlaps the pixel p2n when the columns are overlapped, the pixel value V1k of the pixel p1k is set based on the degree of overlap of the pixel p2n and the pixel p1k in the length direction. Weighting is performed, and the weighting result is calculated as a total value for all of the pixels p1k.
The calculation of the pixel value V2n is performed for all the pixels in the second pixel column, and is further performed for all the pixel columns in the specific direction in the pixel value matrix of the conversion source,
The second light propagation characteristic determination means performs the conversion by the pixel value matrix conversion means at least once based on the light propagation characteristics determined by the first light propagation characteristic determination means, thereby causing the pixels of the second light modulation element to The light propagation characteristic of the first light modulation element is calculated in units, and the light propagation characteristic of each pixel of the second light modulation element is calculated based on the calculated light propagation characteristic and the display data. An optical display device. In claim 3 ,
The second light propagation characteristic determination means sets the direction corresponding to the column direction of the first light modulation element and the second light modulation element as the specific direction, and determines the light propagation determined for each pixel of the first light modulation element A pixel value matrix in which characteristics are arranged in a matrix as the pixel values is used as the conversion source pixel value matrix, and a pixel value matrix corresponding to the size of the second light modulation element in the column direction is used as the conversion destination pixel value matrix. As a conversion by the pixel value matrix conversion means,
The direction corresponding to the row direction of the first light modulation element and the second light modulation element is the specific direction, the pixel value matrix converted by the pixel value matrix conversion unit is the pixel value matrix of the conversion source, and the first The pixel value matrix corresponding to the size in the column direction and the row direction of the two light modulation elements is converted by the pixel value matrix conversion means as the pixel value matrix of the conversion destination, whereby the pixel unit of the second light modulation element To calculate the light propagation characteristics of the first light modulation element,
An optical display device, wherein light propagation characteristics of each pixel of the second light modulation element are calculated based on the calculated light propagation characteristics and the display data. In any of claims 1 to 4 ,
The optical display device, wherein the second light modulation element is a light modulation element that determines display resolution. In any of claims 1 to 5 ,
One of the first light modulation element and the second light modulation element is a specific wavelength region luminance modulation element that modulates the luminance of the specific wavelength region with respect to a plurality of different specific wavelength regions among the light wavelength regions,
The other of the first light modulation element and the second light modulation element is an all-wavelength region luminance modulation element that modulates the luminance of all the wavelength regions of light. In any of claims 1 to 5 ,
The first light modulation element and the second light modulation element are specific wavelength region luminance modulation elements that modulate the luminance of the specific wavelength region with respect to a plurality of different specific wavelength regions among light wavelength regions. Optical display device. In any one of Claims 1 thru | or 7 ,
The optical display device, wherein the second light modulation element has a higher resolution than the first light modulation element. A first light modulation element in which a light source and a plurality of pixels whose light propagation characteristics can be independently controlled are arranged in a matrix, and a plurality of pixels whose light propagation characteristics can be independently controlled are arranged in a matrix and the first An optical display device comprising: a second light modulation element having a resolution different from that of the light modulation element, and displaying an image by modulating light from the light source via the first light modulation element and the second light modulation element A program for controlling
Temporary light propagation characteristic deciding means for temporarily deciding the light propagation characteristic of each pixel of the second light modulation element, the first light modulation element based on the light propagation characteristic tentatively decided by the light propagation characteristic tentative decision means and display data First light propagation characteristic determining means for determining the light propagation characteristic of each pixel of the first, and determining the control value of each pixel of the first light modulation element based on the light propagation characteristic determined by the first light propagation characteristic determining means Second light propagation characteristic determination for determining the light propagation characteristic of each pixel of the second light modulation element based on the light propagation characteristic determined by the first control value determination means and the first light propagation characteristic determination means and the display data Means, second control value determining means for determining a control value of each pixel of the second light modulation element based on the light propagation characteristic determined by the second light propagation characteristic determination means, and the first light modulation element and pair to the pixel arrangement of the second optical modulation element A program for executing a process to be implemented as the pixel value matrix conversion means for converting the pixel value matrix having an array of pixel values of the pixels in a matrix by the pixel value matrix of different sizes in the computer,
The pixel value matrix conversion means includes: a first pixel array arranged along a specific direction in a conversion source pixel value matrix; and a second pixel arranged along the specific direction in a conversion destination pixel value matrix. For the column, the pixel value V2n of the n-th pixel p2n of the second pixel column is the same as the first pixel column and the second pixel, assuming that the total length of the first pixel column and the second pixel column is the same. For each of the k pixels p1k of the first pixel column that overlaps the pixel p2n when the columns are overlapped, the pixel value V1k of the pixel p1k is set based on the degree of overlap of the pixel p2n and the pixel p1k in the length direction. Weighting is performed, and the weighting result is calculated as a total value for all of the pixels p1k.
The calculation of the pixel value V2n is performed for all the pixels in the second pixel column, and is further performed for all the pixel columns in the specific direction in the pixel value matrix of the conversion source,
The first light propagation characteristic determining unit is configured to transmit the light propagation of the first light modulation element in units of pixels of the second light modulation element based on the light propagation characteristic temporarily determined by the light propagation characteristic temporary determination unit and the display data. Characteristics are calculated, and light propagation characteristics of each pixel of the first light modulation element are calculated by performing conversion by the pixel value matrix conversion means at least once based on the calculated light propagation characteristics. A control program for an optical display device. A first light modulation element in which a light source and a plurality of pixels whose light propagation characteristics can be independently controlled are arranged in a matrix, and a plurality of pixels whose light propagation characteristics can be independently controlled are arranged in a matrix and the first An optical display device comprising: a second light modulation element having a resolution different from that of the light modulation element, and displaying an image by modulating light from the light source via the first light modulation element and the second light modulation element A program for controlling
Temporary light propagation characteristic deciding means for temporarily deciding the light propagation characteristic of each pixel of the second light modulation element, the first light modulation element based on the light propagation characteristic tentatively decided by the light propagation characteristic tentative decision means and display data First light propagation characteristic determining means for determining the light propagation characteristic of each pixel of the first, and determining the control value of each pixel of the first light modulation element based on the light propagation characteristic determined by the first light propagation characteristic determining means Second light propagation characteristic determination for determining the light propagation characteristic of each pixel of the second light modulation element based on the light propagation characteristic determined by the first control value determination means and the first light propagation characteristic determination means and the display data Means, second control value determining means for determining a control value of each pixel of the second light modulation element based on the light propagation characteristic determined by the second light propagation characteristic determination means, and the first light modulation element and pair to the pixel arrangement of the second optical modulation element A program for executing a process to be implemented as the pixel value matrix conversion means for converting the pixel value matrix having an array of pixel values of the pixels in a matrix by the pixel value matrix of different sizes in the computer,
The pixel value matrix conversion means includes: a first pixel array arranged along a specific direction in a conversion source pixel value matrix; and a second pixel arranged along the specific direction in a conversion destination pixel value matrix. For the column, the pixel value V2n of the n-th pixel p2n of the second pixel column is the same as the first pixel column and the second pixel, assuming that the total length of the first pixel column and the second pixel column is the same. For each of the k pixels p1k of the first pixel column that overlaps the pixel p2n when the columns are overlapped, the pixel value V1k of the pixel p1k is set based on the degree of overlap of the pixel p2n and the pixel p1k in the length direction. Weighting is performed, and the weighting result is calculated as a total value for all of the pixels p1k.
The calculation of the pixel value V2n is performed for all the pixels in the second pixel column, and is further performed for all the pixel columns in the specific direction in the pixel value matrix of the conversion source,
The second light propagation characteristic determination means performs the conversion by the pixel value matrix conversion means at least once based on the light propagation characteristics determined by the first light propagation characteristic determination means, thereby causing the pixels of the second light modulation element to The light propagation characteristic of the first light modulation element is calculated in units, and the light propagation characteristic of each pixel of the second light modulation element is calculated based on the calculated light propagation characteristic and the display data. A control program for an optical display device. A first light modulation element in which a light source and a plurality of pixels whose light propagation characteristics can be independently controlled are arranged in a matrix, and a plurality of pixels whose light propagation characteristics can be independently controlled are arranged in a matrix and the first An optical display device comprising: a second light modulation element having a resolution different from that of the light modulation element, and displaying an image by modulating light from the light source via the first light modulation element and the second light modulation element A method of controlling
A light propagation characteristic provisionally determining step for provisionally determining a light propagation characteristic of each pixel of the second light modulation element; and the first light modulation based on the light propagation characteristic and display data provisionally determined in the light propagation characteristic provisional determination step. A first light propagation characteristic determining step for determining a light propagation characteristic of each pixel of the element; and a control value of each pixel of the first light modulation element based on the light propagation characteristic determined in the first light propagation characteristic determining step. A first control value determining step to be determined; a second light for determining a light propagation characteristic of each pixel of the second light modulation element based on the light propagation characteristic determined in the first light propagation characteristic determination step and the display data; A propagation characteristic determining step, a second control value determining step for determining a control value of each pixel of the second light modulation element based on the light propagation characteristic determined in the second light propagation characteristic determining step, and the first light Modulator And and a pixel value matrix conversion step of converting into the second light modulator is allowed to the pixel value matrix of the pixel values the pixel value matrix of different size arranged in a matrix of the pixel corresponding to the pixel arrangement of the elements,
The pixel value matrix conversion step includes: a first pixel column arranged along a specific direction in the conversion source pixel value matrix; and a second pixel arranged along the specific direction in the conversion destination pixel value matrix. For the column, the pixel value V2n of the n-th pixel p2n of the second pixel column is the same as the first pixel column and the second pixel, assuming that the total length of the first pixel column and the second pixel column is the same. For each of the k pixels p1k of the first pixel column that overlaps the pixel p2n when the columns are overlapped, the pixel value V1k of the pixel p1k is set based on the degree of overlap of the pixel p2n and the pixel p1k in the length direction. Weighting is performed, and the weighting result is calculated as a total value for all of the pixels p1k.
The calculation of the pixel value V2n is performed for all the pixels of the second pixel column, and is further performed for all the pixel columns in the specific direction in the pixel value matrix of the conversion source,
In the first light propagation characteristic determination step, the light propagation of the first light modulation element in units of pixels of the second light modulation element based on the light propagation characteristic provisionally determined in the light propagation characteristic provisional determination step and the display data. An optical display device that calculates characteristics and calculates the light propagation characteristics of each pixel of the first light modulation element by performing the pixel value matrix conversion step at least once based on the calculated light propagation characteristics Control method. A first light modulation element in which a light source and a plurality of pixels whose light propagation characteristics can be independently controlled are arranged in a matrix, and a plurality of pixels whose light propagation characteristics can be independently controlled are arranged in a matrix and the first An optical display device comprising: a second light modulation element having a resolution different from that of the light modulation element, and displaying an image by modulating light from the light source via the first light modulation element and the second light modulation element A method of controlling
A light propagation characteristic provisionally determining step for provisionally determining a light propagation characteristic of each pixel of the second light modulation element; and the first light modulation based on the light propagation characteristic and display data provisionally determined in the light propagation characteristic provisional determination step. A first light propagation characteristic determining step for determining a light propagation characteristic of each pixel of the element; and a control value of each pixel of the first light modulation element based on the light propagation characteristic determined in the first light propagation characteristic determining step. A first control value determining step to be determined; a second light for determining a light propagation characteristic of each pixel of the second light modulation element based on the light propagation characteristic determined in the first light propagation characteristic determination step and the display data; A propagation characteristic determining step, a second control value determining step for determining a control value of each pixel of the second light modulation element based on the light propagation characteristic determined in the second light propagation characteristic determining step, and the first light Modulator And and a pixel value matrix conversion step of converting into the second light modulator is allowed to the pixel value matrix of the pixel values the pixel value matrix of different size arranged in a matrix of the pixel corresponding to the pixel arrangement of the elements,
The pixel value matrix conversion step includes: a first pixel column arranged along a specific direction in the conversion source pixel value matrix; and a second pixel arranged along the specific direction in the conversion destination pixel value matrix. For the column, the pixel value V2n of the n-th pixel p2n of the second pixel column is the same as the first pixel column and the second pixel, assuming that the total length of the first pixel column and the second pixel column is the same. For each of the k pixels p1k of the first pixel column that overlaps the pixel p2n when the columns are overlapped, the pixel value V1k of the pixel p1k is set based on the degree of overlap of the pixel p2n and the pixel p1k in the length direction. Weighting is performed, and the weighting result is calculated as a total value for all of the pixels p1k.
The calculation of the pixel value V2n is performed for all the pixels of the second pixel column, and is further performed for all the pixel columns in the specific direction in the pixel value matrix of the conversion source,
In the second light propagation characteristic determination step, the pixel value matrix conversion step is performed at least once based on the light propagation characteristic determined in the first light propagation characteristic determination step, so that the second light propagation characteristic determination step is performed for each pixel of the second light modulation element. An optical display device that calculates a light propagation characteristic of the first light modulation element and calculates a light propagation characteristic of each pixel of the second light modulation element based on the calculated light propagation characteristic and the display data Control method.

Images