JP4665699B2 - Image input / output device, mask control device, and mask control method - Google Patents

Description

  The present invention relates to an image input / output device including an input / output panel, and a mask control device and a mask control method applied thereto.

  Conventionally, various techniques have been proposed as an imaging apparatus having an object imaging function. For example, the present applicant has proposed a display device including a display unit having a display function for displaying an image and an imaging function (detection function) for imaging (detecting) an object in Patent Document 1.

JP 2004-127272 A

  If the display device is used as an imaging device, a captured image can be obtained. However, in Patent Document 1, all of the captured images are sent to the subsequent processing unit.

  Therefore, the data of all image areas must be processed in the subsequent apparatus, and the processing becomes heavy.

  The present invention has been made in view of such problems, and an object of the present invention is to provide an image input / output that can reduce the burden of post-processing on a captured image obtained from an input / output panel having a display function and an imaging function. An apparatus, a mask control device, and a mask control method are provided.

An image input / output device according to the present invention includes an input / output panel having an image display function for displaying an image, and an imaging function for imaging an object using light from the image displayed by the display function, and the input / output panel. A mask control unit that masks a portion other than a part of the captured image or the planned image when performing the imaging function of the panel, and the mask control unit includes the brightness, hue, and Based on at least one of the color brightness values, mask information indicating a non-mask target portion to be excluded from the mask processing target is generated .

  Here, the “mask” means that the portion is covered, invalidated, ignored, or not treated as a target. The “captured image” means the entire screen image that is actually captured (captured), whereas the “captured image” is supposed to be captured if no measures are taken. It means the whole screen image.

Your name, the "brightness", for example, red, green, means that the brightness obtained by integrating each color component, such as blue, the "hue", for example, red, green, the color sensation represented by such blue It means an attribute and a scaled version thereof, and “color brightness” means the brightness of each color such as red, green, and blue.

An image input / output panel having an input / output panel having an image display function for displaying an image and an imaging function for imaging an object using light from an image displayed by the display function. be one that is applied to the apparatus, when performing an imaging function of the input and output panel includes a mask control means for masking the non-portion of the captured image or captured target image, the mask control unit, input Based on at least one of the luminance, hue, and color brightness of the image displayed on the output panel, mask information indicating a non-mask target portion to be excluded from the mask processing target is generated .

The mask control method of the present invention uses an input / output panel having an image display function for displaying an image and an imaging function for imaging an object using light from an image displayed by the display function. When the imaging function of the input / output panel is executed, a portion other than a portion of the captured image or the scheduled image to be captured is masked , and the brightness, hue, and Based on at least one of the color brightness values, mask information indicating a non-mask target portion to be excluded from the mask processing target is generated .

In the image input / output device, the mask control device, and the mask control method of the present invention, an input / output panel having a display function and an imaging function for imaging an object using light from a display image displayed by the display function, An object is imaged. Further, when the imaging function of the input / output panel is executed, a portion other than a part of the captured image or the scheduled imaging image is masked. Further, in such a mask, a mask indicating a non-mask target portion to be excluded from the mask processing target based on at least one of the brightness, hue, and color brightness of the image displayed on the input / output panel. Information is generated.

  According to the image input / output device, the mask control device or the mask control method of the present invention, when executing the imaging function of the input / output panel having the display function and the imaging function, other than a part of the captured image or the scheduled imaging image Therefore, it is possible to reduce the burden of post-processing on the captured image obtained from the input / output panel having the display function and the imaging function.

  Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.

[First Embodiment]
FIG. 1 shows the configuration of an image input / output device (image input / output device 1) according to a first embodiment of the present invention.

  The image input / output device 1 includes an input / output panel 10, a display signal holding control unit 22, a display signal driver 23, a display side scanner 24, an imaging signal selection scanner 31, an imaging signal receiver 32, and a mask control unit. 5 and displays an image based on the image data on the input / output panel 10 and also makes use of light from the display image to contact or approach the input / output panel 10 (imaging target objects 15A and 15B described later) ) And the captured image obtained by imaging is corrected.

  The input / output panel 10 includes, for example, an organic or inorganic EL (ElectroLuminescence) display or LCD (Liquid Crystal Display) in which a plurality of pixels 11 are arranged in a matrix over the entire surface, and performs line sequential operation as described later. While displaying an image such as a predetermined figure or character. Each pixel 11 is composed of, for example, a display imaging cell CWR including one display imaging element, and each pixel has both a display function and an imaging function as will be described later.

  Here, the details of the configuration of the input / output panel 10 will be described with reference to FIGS.

  FIG. 2 shows an example of a planar configuration of the input / output panel 10, where a total of (m × n) pixels 11 are arranged in a matrix form, with m in the horizontal line direction and n in the vertical line direction. It is assumed that This input / output panel 10 supplies (m × n) pixels 11 and display imaging cells CWR11 to CWRmn included in each pixel, and m data supplies connected according to the number of the pixels 11. It has a line DW (DW1 to DWm) and a data read line DR (DR1 to DRm), and n display gate lines G (G1 to Gn) and a switching line S (S1 to Sn).

  The data supply line DW is connected to the display signal driver 23, the data readout line DR is connected to the imaging signal receiver 32, the display gate line G is connected to the display side scanner 24, and the switching line S is connected to the imaging signal selection scanner 31. It is connected. In addition, one data supply line DW, one data read line DR, one display gate line G, and one switching line S are connected to each display imaging cell CWR. In addition, for example, one vertical data display line CW11, CWR12,..., CWR1n are connected in common to one data supply line DW1 and one data read line DR1, for example, one horizontal line display imaging cell CWR11. , CWR21,..., CWRm1, one display gate line G and one switching line S are connected in common. An arrow Y in the figure indicates the scanning direction of the display gate line G and the switching line S.

  FIG. 3 schematically shows an example of the arrangement configuration of the display imaging cells CWR in the input / output panel 10 in a cross-sectional view, and corresponds to the cross section taken along the line AA in FIG.

  The input / output panel 10 includes a pair of transparent substrates 12A and 12B and a plurality of display imaging cells CWR (CW21, CW22, CW23, and the like) disposed between the transparent substrates 12A and 12B and separated from each other by a partition wall 13. CW24, CW25, ...). Each display imaging cell CWR includes, for example, an organic EL element as the display imaging element EL, and emits display light LW. In addition, about the other layer in a general organic electroluminescent display part, it is not illustrated and description is abbreviate | omitted.

  FIG. 4 shows a circuit configuration of the display imaging cell CWR in the input / output panel 10.

  The display imaging cell CWR includes a display imaging element EL, a capacitor C, a resistor R, and a data supply line DW and one end of the capacitor C according to a selection signal supplied from the display gate line G. From the switch SW1 that selectively conducts, the switch SW2 that selectively conducts between the other end of the capacitor and one end of the display imaging element EL according to the switching signal supplied from the switching line S, and the switching line S as well. A switch SW3 that selectively conducts between one end of the display imaging element EL and the data readout line DR according to the supplied switching signal is provided, and the other end of the display imaging element EL is grounded. One end of the resistor R is connected to the data read line DR, and the other end of the resistor R is connected to the ground or a negative bias point (not shown).

  Here, the operation of each component during the display operation and the imaging operation will be specifically described. First, the display operation and the imaging operation are performed using the following characteristics of the display imaging element EL. That is, for example, an organic EL element or an LED element, which is configured as the display imaging element EL in this embodiment, emits light when a forward bias voltage is applied, but receives a light and current when a reverse bias voltage is applied. It has the property of generating.

  Therefore, during the display operation, the switches SW1 and SW2 are turned on and the switch SW3 is turned off in accordance with the selection signal supplied from the display gate line G and the switching signal supplied from the switching line S. A forward bias voltage is applied to the display image sensor EL. Then, the capacitor C is charged from the data supply line DW through the path I1 so as to emit light having a luminance corresponding to the display signal, and a current flows through the display imaging element EL through the path I2 based on the charged charge. Then, the display operation is performed.

  On the other hand, during the imaging operation, according to the switching signal supplied from the switching line S, the switches SW2 and SW3 are turned off and the switch SW2 is turned on, whereby a reverse bias voltage is applied to the display imaging element EL. The Then, in the display imaging element EL, an imaging operation is performed by supplying a current corresponding to the amount of received light to the data readout line DR through a path I3.

  When neither the display operation nor the imaging operation is performed, the switches SW1 to SW3 are all off, and the data supply line DW and the data readout line DR are disconnected from the display imaging element EL, respectively. It has come to be. The resistor R connected to the data read line DR is for causing a potential difference at both ends based on the current supplied to the data read line DR through the path I3 and outputting this as an imaging signal. is there.

  The display signal holding control unit 22 outputs a display signal (display image data Din1) supplied from the outside of the image input / output device 1 (for example, a CPU (Central Processing Unit) not shown) for each screen (for each frame display). ) Is stored and held in a frame memory composed of, for example, an SRAM (Static Random Access Memory). The display signal holding control unit 22 also plays a role of controlling the display signal driver 23, the display side scanner 24, and the imaging signal selection scanner 31 to operate in conjunction with each other. Specifically, the display timing control signal 41 for the display-side scanner 24, the imaging timing control signal 42 for the imaging signal selection scanner 31, and the control signal and frame for the display signal driver 23. The display signals for one horizontal line based on the display signals for one screen held in the memory are each output.

  The display-side scanner 24 selects the display imaging cell CWR to be displayed according to the display timing control signal 41 output from the display signal holding control unit 22. The display signal driver 23 supplies display data to the display imaging cell CWR that is a display driving target in accordance with a display signal for one horizontal line output from the display signal holding control unit 22.

  The imaging signal selection scanner 31 selects the display imaging cell CWR to be imaged driving according to the imaging timing control signal 42 output from the display signal holding control unit 22. The imaging signal selection scanner 31 also outputs an imaging block control signal 43 to the imaging signal receiver 32, and also plays a role of controlling the operation of the part contributing to these imaging operations.

  The imaging signal receiver 32 acquires an imaging signal for one horizontal line output from each display imaging cell CWR in accordance with the imaging block control signal 43 output from the imaging signal selection scanner 31.

  Here, with reference to FIG. 5 and FIG. 6, an operation of imaging an object in contact with or close to the image input / output apparatus 1 having such a configuration will be described.

  FIG. 5 is a cross-sectional view showing an example of processing for imaging an imaging target object in the image input / output device 1 of FIG. 1, and the same components as those shown in FIG. The description will be omitted as appropriate.

  When the imaging target object 15A such as a finger is brought into contact with or close to the input / output panel 10, the display light LW1 from the display imaging cell CWR (here, the display imaging cell CWR23) is reflected by the imaging target object 15A. . Here, in the display imaging element EL, it is necessary to perform display operation and imaging operation in a time-sharing manner, and it is impossible to receive reflected light with the display imaging element while emitting display light with a certain display imaging element. Therefore, when the display light emitted from the display image sensor of a certain horizontal line is received by the display image sensor of another horizontal line to which the reverse bias voltage is applied, the imaging target object 15A can be imaged. For example, as shown in FIG. 5, the reflected light LR1 is incident on a display imaging cell on a horizontal line close to the display imaging cell CWR23, such as CWR24 and CWR25, but the position is far from the display imaging cell CWR23. The reflected light does not enter the display imaging cell on the horizontal line. Therefore, since an imaging signal can be obtained only from the display imaging cell CWR whose position is close to a certain imaging target object 15A, in this image input / output device 1, an image is emitted from the display imaging cell CWR on the horizontal line that is being driven for display. Timing driving is performed so that the light reflected by the target object 15A is received by the display imaging cell CWR on the horizontal line adjacent to the horizontal line. In this way, an imaging signal is output from the display imaging cell CWR in the vicinity of the imaging target object 15A, while no imaging signal is output from other areas, so the imaging target object 15A is placed on the input / output panel 10. Which region is located is detected, and an imaging operation can be performed.

  Further, as shown in FIG. 6, by performing such display driving and imaging driving sequentially for each horizontal line (line sequential driving), the imaging target object 15 </ b> A is displayed while displaying an image on the entire input / output panel 10. Can be imaged. In FIG. 6, reference numerals P2, P3, P8, and P9 represent the positions of lines being scanned, reference numerals 61, 61A, and 61B represent display areas, and reference numeral 63 represents an imaging area.

  Returning to the description of FIG. 1, the mask control unit 5 masks (performs mask processing) other than a part of the imaging signal (imaging data Dout1) output from the imaging signal receiver 32, and this actual mask. It has a mask processing unit 51 that performs processing.

  The mask processing unit 51 receives mask data Dm (mask information) indicating a non-mask target portion to be excluded from the mask processing target separately from the display image data Din 1 from the outside of the image input / output device 1. Then, the masking data Dout1 is masked using the mask data Dm, and the masked imaging data Dout2 is output to the outside of the image input / output device 1 (for example, a subsequent image processing device not shown). Further, the contents of the mask data Dm input from the outside are associated with the display image data Din1 displayed on the input / output panel 10 in advance. Details of this mask processing will be described later.

  Next, mask processing by the mask control unit 5 (specifically, the mask processing unit 51) of the present embodiment will be described with reference to FIGS. Here, FIG. 7 shows a mask process according to the present embodiment in a flowchart, and FIG. 8 shows an aspect of this mask process.

  Here, for example, in the situation shown in FIG. 8A, that is, when a display image based on the display image data Din1 is displayed on the input / output panel 10 of the image input / output device 1, the display image is displayed. Description will be made under the situation where the user's fingertip (imaging target object 15B) is placed on the portion of the button “3”.

  First, the mask processing unit 51 associates display image data Din1 displayed on the input / output panel 10 in advance with the content thereof, specifically, a mask-excluded portion to be excluded from the mask processing target. Dm (see, for example, FIG. 8B) is input from the outside of the image input / output device 1 (step S101 in FIG. 7).

  Next, the mask processing unit 51 inputs imaging data Dout1 captured by the imaging function of the input / output panel 10 from the imaging signal receiver 32 based on the display image data Din1 displayed on the input / output panel 10 ( Step S102).

  Next, the mask processing unit 51 masks portions other than the non-mask target portion 71 of the mask data Dm shown in FIG. 8B in the imaging data Dout1 (step S103). Then, as described above, since this non-maskable portion is associated with the display image data Din1 displayed on the input / output panel 10 in advance, the image by the masked imaging data (masked imaging data Dout2) is used. The (masked captured image 72) is, for example, as shown in FIG. That is, only the non-mask target portion 71 in the captured image is valid (the portion indicated by reference numeral 72A in FIG. 8C), while other portions are masked and become invalid data. Further, as shown in FIG. 8A, on the display screen of the input / output panel 10, the imaging target object 15B (in this case, the user's fingertip) is positioned at the button portion “3”. The part of the imaging target object 15B is imaged. The imaging data Dout1 is masked in this way, and the imaging data after being masked (masked imaging data Dout2) is output to the outside of the image input / output device 1 (for example, a subsequent image processing device not shown). (Step S104).

  Finally, the mask processing unit 51 determines whether or not to end such mask processing by, for example, control by the user (step S105). If it is determined that the mask process is not yet finished (step S105: N), the process returns to step S102 and the processes of steps S102 to S104 are repeated. On the other hand, when it is determined that the mask process is to be ended (step S105: Y), the entire mask process is ended.

  As described above, in the present embodiment, when executing the imaging function of the input / output panel 10 having the display function and the imaging function, a part of the captured image (imaging data Dout1), that is, the mask of the mask data Dm. Since portions other than the non-target portion 71 are masked, it is possible to perform appropriate mask control on an image at the time of imaging obtained from an input / output panel having a display function and an imaging function. Therefore, the imaging data Dout1 can be masked and output as masked imaging data Dout2, so that, for example, when an image processing apparatus is connected to the subsequent stage, the data amount of imaging data to be supplied is It is possible to reduce the data amount of only the non-mask target portion 71, and it is possible to reduce the processing load in the subsequent stage.

  In addition, since the non-maskable portion 71 of the mask data Dm is associated with the display image data Din1 displayed on the input / output panel 10 in advance, mask processing is performed according to the display image based on the display image data Din1. It can be performed.

  Further, since the mask data Dm is acquired from the outside of the image input / output device 1, it is compared with the second embodiment in which the mask data Dm is created in the image input / output device 1 as will be described later. Thus, the burden of mask processing can be reduced.

  Next, some modifications of the present embodiment will be described. In order to simplify the description, the same parts as those in the first embodiment will be described below with the same reference numerals.

[Modification 1]
In the first embodiment, the case where the image input / output device 1 inputs the display image data Din1 and the mask data Dm separately from the outside has been described. However, in the present modification, the display image data Din1 is input. A case in which the mask data Dm and the mask data Dm are input together will be described.

  FIG. 9 shows the overall configuration of the image input / output device 1 according to this modification. This image input / output apparatus 1 is the same as the image input / output apparatus 1 according to the first embodiment shown in FIG. 1, except that a data input unit 52 is provided on the input side of the display signal holding control unit 22.

  The data input unit 52 inputs input data Din in which the display image data Din1 and the mask data Dm are integrated from the outside of the image input / output device 1, and the input data Din is input to the display image data Din1 and the mask data. Dm and output to the display signal holding control unit 22 or the mask processing unit 51, respectively.

  Here, the input transfer rate of the input data Din is, for example, twice the input transfer rate of the display image data Din1 described in the first embodiment. Therefore, even when the input data Din includes both the display image data Din1 and the mask data Dm and the amount of data is, for example, double, as a result, it is equivalent to the case of the first embodiment. The input data Din can be input with a transfer time of.

  As described above, in the present modification, the data input unit 52 inputs the input data Din in which the display image data Din1 and the mask data Dm are integrated at a transfer rate twice that in the first embodiment, for example. In addition, the input data Din is separated into display image data Din1 and mask data Dm and output to the display signal holding control unit 22 or the mask processing unit 51, respectively. Thus, the number of data wiring lines 1 and the outside can be reduced, and in addition to the effects of the first embodiment, the apparatus configuration can be further simplified.

[Modification 2]
In the first embodiment, the case where the mask control unit 5 that performs the mask process is provided in the image input / output apparatus 1 has been described. However, in the present modification, the mask control unit 5 is configured to perform image input / output. A case will be described in which the device 1 is provided separately (outside the image input / output device 1).

  FIG. 10 illustrates the overall configuration of the image input / output device 1 according to this modification. The image input / output device 1 is the image input / output device 1 according to the first embodiment shown in FIG. 1 except that the mask control unit 5 is provided separately from the image input / output device 1. .

  Specifically, the mask control unit 5 of the present embodiment inputs the imaging data Dout1 from the image input / output device 1 (specifically, the imaging signal receiver 32), and the image input / output device 1 and the mask control unit. 5, the mask data Dm is input from the outside. The mask controller 5 in this case corresponds to a specific example of “mask controller” in the present invention.

  As described above, in this modification, the mask control unit 5 is provided separately from the image input / output device 1, so the image input / output device 1 with the mask control unit 5 built-in described in the first embodiment. Thus, the same effects as those of the first embodiment can be obtained for the conventional input / output panel without newly developing (without newly purchasing for the user).

[Modification 3]
In the second modification, the case where the mask control unit 5 is provided separately from the image input / output device 1 has been described. However, in this modification, the mask control unit 5 in this case includes the above-described first modification. A case where the data input unit 52 described is provided will be described.

  FIG. 11 shows the overall configuration of the image input / output device 1 according to this modification. This image input / output device 1 is provided with a mask control unit 5 separately from the image input / output device 1 in the image input / output device 1 according to the first embodiment shown in FIG. In the control unit 5, a data input unit 52 is provided on the input side of the mask processing unit 51.

  Specifically, the data processing unit 52 in the mask control unit 5 inputs the above-described input data Din from the outside of the image input / output device 1 and the mask control unit 5 and uses the input data Din as display image data Din1. The data is separated into mask data Dm and output to the display signal holding control unit 22 in the image input / output device 1 or the mask processing unit 51 in the mask control unit 5, respectively.

  As described above, in this modification, the mask control unit 5 is provided separately from the image input / output device 1, and the data input unit 52 is provided on the input side of the mask processing unit 51 in the mask control unit 5. Since it is provided, in addition to the effects in the first embodiment, it is possible to further obtain the effects of both the first and second modifications.

[Modification 4]
In the first embodiment and the first to third modifications, the case where the mask control unit 5 performs mask processing on the imaging data Dout1 captured by the imaging function of the input / output panel 10 has been described. In the modification, a case will be described in which mask processing is performed on an image to be captured when the imaging function is executed by the input / output panel.

  FIG. 12 shows the overall configuration of the image input / output device 1 according to this modification. The image input / output device 1 includes an input / output panel 10A with a mask function having a pixel 11A with a mask function capable of performing mask processing as described above for each pixel instead of the input / output panel 10. ing. The input / output panel 10A with a mask function has the same configuration as that of the input / output panel 10 except that the mask process can be performed for each pixel.

  In the input / output panel 10A with a mask function, mask data Dm is input for each pixel 11A with a mask function from the outside of the image input / output device 1, and an image to be captured when the imaging function is executed, Mask processing similar to that of the mask control unit 5 is performed. Specifically, when the pixel 11A with mask function is the non-mask target portion 71, the data of the image to be captured at that pixel is output as it is as the captured image, while the pixel 11A with mask function is not mask target. If it is not the portion 71, that is, if it is a portion to be masked, the data of the image to be captured at that pixel is invalidated (for example, the data is set to “0” in agreement) and output. ing.

  As described above, in this modification, the input / output panel 10A with the mask function having the mask function-equipped pixels 11A capable of performing the mask process for each pixel is provided, and the imaging function is provided for each pixel 11A with the mask function. Because the masking process is performed on the scheduled imaging image at the time of execution, the captured image data can be already masked at the time of the captured image data output from the input / output panel with mask function 10A.

[Second Embodiment]
Next, a second embodiment of the present invention will be described.

  In the first embodiment and the modification thereof, the case where the mask data Dm for performing the mask processing is input from the outside of the image input / output device 1 has been described. However, in this modification, the mask data Dm is input. Is generated in the image input / output device 1.

  FIG. 13 illustrates the overall configuration of the image input / output device 1 according to the present embodiment. This image input / output device 1 is configured such that a mask generation unit 53 is provided in the mask control unit 5 in the image input / output device 1 according to the first embodiment shown in FIG.

  The mask generation unit 53 generates mask data Dm based on the contents of the display image data Din1 input from the outside of the image input / output device 1, and outputs the mask data Dm to the mask processing unit 51. Specifically, the mask generation unit 53 generates mask data Dm based on at least one of the luminance, hue, and color brightness of the image displayed on the input / output panel 10. Luminance means the brightness of each color component such as red, green, and blue, for example. Hue means the color sense attribute expressed by, for example, red, green, blue, and the like. It means what is scaled, and the color brightness means the brightness of each color such as red, green, and blue.

  For example, a case where an image as shown in FIG. 14 is displayed on the input / output panel 10 based on the display image data Din1 will be described.

  At this time, for example, when the mask data Dm is created based on the luminance of the image, the created mask data Dm is as shown in FIG. 15, for example.

  On the other hand, for example, when the mask data Dm is created based on the hue (white) of the image, the created mask data Dm is as shown in FIG. 16A, for example. When the mask data Dm is created based on the hue (pink) of the image, the created mask data Dm is as shown in FIG. 16B, for example.

  In this way, in the mask generation unit 53, based on the contents of the display image data Din1 input from the outside of the image input / output device 1, according to various indexes such as the luminance, hue, and color brightness of the display image, Mask data Dm is created as needed.

  As described above, in the present embodiment, the mask generation unit 53 creates the mask data based on the content of the display image data Din1 input from the outside of the image input / output device 1, so that, for example, the display image Even if the content of the data Din1 changes one by one, it is possible to cope with it, and in addition to the effect in the first embodiment, the content of the mask data Dm such as the non-mask target portion 71 is always displayed in this manner. It can be associated with the image data Din1.

  In addition, since the mask data Dm is generated according to various indexes such as the brightness, hue, and color brightness of the display image, various values can be obtained from one display image according to the use of the masked imaging data Dout2. Mask data Dm can be created.

  Furthermore, since the mask data Dm is created in the image input / output device 1, the number of data wirings between the image input / output device 1 and the outside can be reduced. In addition to the effects of the first embodiment, The apparatus configuration can be further simplified.

  Although the present invention has been described with reference to the first and second embodiments and modifications thereof, the present invention is not limited to these embodiments and the like, and various modifications can be made.

  For example, the configurations described in the above embodiments and the like may be combined. In the above-described embodiment and the like, the case where the input / output panel 10 is configured by the display imaging element EL having both the display function and the imaging function has been described. However, a display element having a display function (for example, a liquid crystal element or LED ( The input / output panel may be configured by separately providing an element having an imaging function (for example, a photodiode or a CCD (Charge Coupled Device)).

1 is a block diagram illustrating an overall configuration of an image input / output device according to a first embodiment of the present invention. It is a top view showing the structure of the input-output panel shown in FIG. It is sectional drawing which represents typically an example of the arrangement configuration of the display imaging cell in an input-output panel. It is a circuit diagram showing the structure of the display imaging cell shown in FIG. FIG. 2 is a schematic cross-sectional view illustrating an example of a process for imaging an imaging target object in the image input / output device illustrated in FIG. 1. It is a schematic diagram showing an example of a line sequential display operation and a line sequential imaging operation in the input / output panel. It is a flowchart showing the correction process by the mask control part which concerns on 1st Embodiment. It is a schematic diagram for demonstrating the mask process which concerns on 1st Embodiment. It is a block diagram showing the whole structure of the image input / output device which concerns on the modification 1 of 1st Embodiment. It is a block diagram showing the whole structure of the image input / output device and mask control apparatus which concern on the modification 2 of 1st Embodiment. It is a block diagram showing the whole structure of the image input / output device and mask control apparatus which concern on the modification 3 of 1st Embodiment. It is a block diagram showing the whole structure of the image input / output device which concerns on the modification 4 of 1st Embodiment. It is a block diagram showing the whole structure of the image input / output device which concerns on 2nd Embodiment. It is a schematic diagram for demonstrating the mask process which concerns on 2nd Embodiment. It is a schematic diagram for demonstrating the mask process which concerns on 2nd Embodiment. It is a schematic diagram for demonstrating the mask process which concerns on 2nd Embodiment.

Explanation of symbols

  DESCRIPTION OF SYMBOLS 1 ... Image input / output device 10, 10A ... Input / output panel, 11 ... Pixel, 12A, 12B ... Transparent substrate, 13 ... Partition, 15A, 15B ... Object to be imaged, 22 ... Display signal holding control unit, 23 ... Display signal Driver 24... Display side scanner 31. Imaging signal selection scanner 32. Imaging signal receiver 41. Display timing control signal 42. Imaging timing control signal 43. Imaging block control signal 5. Mask control unit 51. Mask processing unit, 52... Data input unit, 53... Mask generation unit, 61, 61A, 61B... Display region, 63 .. imaging region, 71. DW ... data supply line, DR ... data readout line, G ... display gate line, S ... switching line, LW, LW1 to W4 ... display light, LR1 to LR4 ... reflected light, EL ... Indicating image sensor, C ... capacitor, R ... resistor, SW1, SW2, SW3 ... switch, I1 ... display signal current path, I2 ... imaging signal current path, Y ... scan direction, P2, P3, P8, P9 ... during scanning The position of the horizontal line.

Claims (4)

An input / output panel having an image display function for displaying an image and an imaging function for imaging an object using light from the image displayed by the display function;
A mask control means for masking a portion other than a part of the captured image or the planned image when performing the imaging function of the input / output panel ;
The mask control means generates mask information indicating a non-mask target portion to be excluded from mask processing based on at least one of brightness, hue, and color brightness of an image displayed on the input / output panel. image input-output device to be. The mask control unit, for each pixel of the input and output panel, you mask other than a portion of the captured target image
Image input and output apparatus according to 請 Motomeko 1. Mask control device applied to an image input / output device having an input / output panel having an image display function for displaying an image and an imaging function for imaging an object using light from an image displayed by the display function Because
When performing the imaging function of the input / output panel, comprising: a mask control means for masking other than a part of the captured image or the scheduled imaging image ;
The mask control means generates mask information indicating a non-mask target portion to be excluded from mask processing based on at least one of brightness, hue, and color brightness of an image displayed on the input / output panel. mask control device for. A mask control method using an input / output panel having an image display function for displaying an image and an imaging function for imaging an object using light from an image displayed by the display function,
When performing the imaging function of the input / output panel, masking other than a part of the captured image or the scheduled imaging image ,
When this masking is performed, mask information indicating a non-mask target portion to be excluded from the mask processing target is generated based on at least one of the luminance, hue, and color brightness of the image displayed on the input / output panel. mask control method.

Images