JP6523908B2 - Code reader, code reading method, and program - Google Patents

Description

  The present invention relates to a code reader and the like for reading a code.

  As a prior art, a color two-dimensional code has been known which encodes information according to the color or density or luminance of each of a plurality of two-dimensionally arranged cells (see, for example, Patent Document 1).

JP 2003-178277 A (page 1, FIG. 1, etc.)

  However, in the conventional code reader and the like, there is a problem that the code can not be read properly depending on the environment at the time of shooting.

  For example, in a conventional code reader or the like, the code may be properly read by, for example, the light falling on the code being inappropriate depending on the environment in which the color two-dimensional code or the code such as a bar code is arranged. There was a problem that it might not be possible. For example, when there is little light falling on the place where the code is placed, there is a problem that the code can not be detected from the image obtained by capturing the code and the code can not be read.

  Further, for example, when the code is a color code, there is a problem that the color of light falling on the color code can not appropriately recognize each color constituting the color code, and the code can not be read. For example, in an environment illuminated with a halogen lamp (for example, in a tunnel etc.), there is a problem that the color code can only be seen as an orangeish monochrome image, and each color of the color code can not be properly recognized. .

  Also, for example, when using a code projected using an apparatus for projecting an image or the like as a code to be read, the code is appropriately read by ambient light of a projected place, setting of an apparatus for projecting, etc. There is a problem that there are cases where you can not

  The present invention has been made to solve the problems as described above, and it is an object of the present invention to provide a code reader capable of properly reading a code.

  The code reader according to the present invention detects a region including one or more codes to obtain a photographed image, detects the one or more codes in the photographed image, and detects the code from the one or more codes. Code reading comprising an acquisition unit for acquiring associated information, an output unit for outputting information acquired by the acquisition unit, and a control unit for controlling an environment for acquiring a photographed image according to the photographed image It is an apparatus.

  According to this configuration, the code can be appropriately read by controlling the environment for acquiring the photographed image according to the photographed image.

  In the code reading device according to the present invention, the code reading device further includes an illumination unit for emitting light to the area photographed by the imaging unit, and the control unit controls the illumination unit to the imaging area according to the photographed image. It is a code reader that controls the light to be emitted.

  According to this configuration, the code can be read appropriately by controlling the light emitted to the imaging region according to the captured image.

  Further, in the code reading device according to the present invention, in the code reading device, when the acquisition unit can not acquire the information corresponding to the code from the photographed image, the control unit illuminates according to the information acquired from the photographed image. The unit is a code reader that controls light emitted to the imaging region.

  According to this configuration, when the information corresponding to the code can not be acquired from the photographed image, the code can be read appropriately by controlling the light emitted by the illumination unit. In addition, when the code can be read, it is possible to suppress the power consumption and speed up the process by not performing the illumination.

  Further, in the code reading device according to the present invention, in the code reading device, the control unit acquires one or more parameters from the photographed image, and the light emitted from the lighting unit to the photographing region according to the acquired parameters. Is a code reader that controls

  With this configuration, it is possible to appropriately control the light emitted by the illumination unit using the parameters acquired from the captured image.

  Further, in the code reading device according to the present invention, in the code reading device, the control unit acquires a parameter related to the light amount from the captured image, and the illumination unit irradiates the imaging region according to the acquired parameter. It is a code reader that controls the amount of light.

  According to this configuration, the light amount of the light emitted by the illumination unit can be appropriately controlled using the parameter related to the light amount acquired from the photographed image, and the code can be read appropriately.

  Further, in the code reader according to the present invention, in the code reader, the illumination unit can change the color of light to be emitted, and the control unit acquires and acquires parameters relating to the color of light from the captured image. It is a code reader which controls the color of the light which an illumination part irradiates to a photography field according to a parameter.

  With this configuration, it is possible to appropriately control the color of the light emitted by the illumination unit using the parameter related to the color of the light acquired from the photographed image, and the code can be read appropriately.

  Further, in the code reading device according to the present invention, in the code reading device, the control unit is a code reading device that controls a shutter speed at the time of shooting by the shooting unit according to a shot image.

  With this configuration, the exposure time at the time of shooting can be appropriately controlled, and the code can be read appropriately.

  Further, in the code reading device according to the present invention, in the code reading device, the shooting unit shoots a projected image which is an image of a region including one or more codes shot and acquired and projected by the projection device. The control unit is a code reading device that controls the projection of the image by the projection device according to the captured image.

  According to this configuration, the projection image to be photographed can be appropriately controlled, and the code can be read appropriately.

  According to the code reader and the like according to the present invention, the code can be read properly.

Block diagram of code reader in Embodiment 1 of the present invention Flow chart for explaining the operation of the same code reader The perspective view seen from the front side (Drawing 3 (a)) and the perspective view seen from the back side (Drawing 3 (b)) in order to show the photography situation of the same code reading device The figure which shows an example of the computer system which implement | achieves the color code reader Block diagram of code reader in Embodiment 2 of the present invention Flow chart for explaining the operation of the same code reader Block diagram of code reading device and projection device in the third embodiment of the present invention Flow chart for explaining the operation of the same code reader A schematic diagram for explaining the code reader and the projector

  Hereinafter, embodiments of the code reader and the like will be described with reference to the drawings. In addition, since the component which attached the same code in embodiment performs the same operation | movement, description for the second time may be abbreviate | omitted.

Embodiment 1
FIG. 1 is a block diagram of a code reader 1 according to the present embodiment.

  The code reading device 1 includes an imaging unit 101, an illumination unit 102, an acquisition unit 103, a control unit 104, and an output unit 105.

  The code reader 1 is a device for reading a code. The code reading device may be a dedicated device for reading a code, or may be a general-purpose device having other functions. For example, the code reading apparatus may be considered as a so-called multi-functional mobile phone such as a smart phone, a tablet type terminal, a portable information terminal such as a mobile phone provided with a camera or the like.

  The imaging unit 101 captures an area including one or more codes to obtain a captured image. For example, the imaging unit 101 may acquire a captured image obtained by capturing an area including two or more codes in one image. The imaging unit 101 is, for example, a camera provided with an imaging device such as a CCD or a CMOS. The photographing unit 101 may be a video camera or a digital still camera. The photographed image is usually a moving image, but may be a still image, or may be a series of plural still images or the like photographed at predetermined time intervals. Also, the captured image may be considered as one or more frame images constituting a moving image. Two or more frame images may or may not be consecutive. For example, two or more frame images may be two or more frame images acquired by separating a predetermined number of frame images. Further, the number of pixels of the photographed image photographed by the photographing unit 101, the file format of the photographed image transmitted by the photographing unit 101, the compression method, and the like do not matter. Further, the timing at which the imaging unit 101 captures a captured image does not matter. The photographing unit 101 may be considered as a driver or the like that controls an external camera or the like.

  The photographing unit 101 may be considered as a so-called multi-functional mobile phone such as a so-called smartphone, a tablet type terminal, a camera such as a mobile phone, or the like.

  One or more codes are codes associated with information. The information associated with the code is, for example, information read from the code. The information associated with one or more codes is, for example, an identifier of the code. The information associated with one or more codes is, for example, information associated with an identifier of an article or service. That the information associated with the code is associated with the identifier of the article or service may be, for example, that the information associated with the code itself is the identifier of the article or service. The information associated with the code may be associated with the identifier of the article or service. For example, the information read out from the code and the article identifier are managed in correspondence with each other by storing in advance the information having the information read out from the code and the article identifier in association with each other. Can.

  One or more codes are arranged (for example, attached or printed) on, for example, the surface of an article or its package, a menu indicating a service, or the like. The code is, for example, a two-dimensional code. One or more cords may be arranged in the vicinity of the position where the article corresponding to this cord is arranged. For example, the one or more cords may be a cord arranged (for example, attached) on a shelf or a pallet on which the article corresponding to the cord is arranged, a partition plate partitioning the article, or the like.

  The code may be anything that can be identified, for example, a barcode, a two-dimensional barcode, a QR code (registered trademark), a color code, a character string, and a number string. The code is, for example, information readable using an optical device. The code is preferably a code that can be identified by the shape, color, pattern of a figure excluding a character string or a number string, or a combination thereof. The code is preferably a color code which is a two-dimensional code having an arrangement of colors as information for identification. The color code may be called, for example, a chameleon code, a color barcode, or a color two-dimensional code.

  In the following, in the present embodiment, an example will be described in which the information acquired by the acquisition unit 103 described later from the code is a code identifier which is an identifier of the code. The code identifier is, for example, a character string corresponding to a code, a number string, or a combination of a character string and a number string.

  The illumination unit 102 emits light to the area to be photographed by the photographing unit 101. The illumination unit 102 has, for example, a driver or the like for adjusting the on / off of the illumination, the light amount of the illumination, and the like. In addition, the illumination unit 102 generally includes one or more light sources (not shown). However, the illumination unit 102 does not include a light source, and a driver or the like may emit light using a light source (not shown) outside the illumination unit 102 or the like. The light emitted from the illumination unit 102 is controlled by a control unit 104 described later. The illumination unit 102 may be considered as a flash or illumination of a so-called smart phone or other multifunctional mobile phone, a tablet type terminal, a mobile phone or the like. As a result, the lighting unit 102 only needs to be able to emit light to the area photographed by the photographing unit 101.

  The illumination unit 102 can change, for example, the amount of light to be emitted (hereinafter, referred to as light amount). For example, it is preferable that the illumination unit 102 be capable of adjusting the amount of light to be emitted by controlling the operating current according to a control signal or the like output from the control unit 104. Further, the amount of light to be emitted may be changed as a result by switching between illuminations with different amounts of light emitted or changing the number of light sources used for the illumination. The amount of light emitted may be considered as the intensity of the light. Also, instead of the light amount, the illuminance of light may be considered.

  The illumination unit 102 can change, for example, the color of light to be emitted. For example, the color of light emitted by the illumination unit 102 is controlled by the control unit 104. The illumination unit 102 may be capable of changing the color of light to be emitted with any configuration. The illumination unit 102 has, for example, two or more light sources (not shown) emitting different colors, and the color of the light to be irradiated can be changed by individually controlling the light amounts output from these light sources. It is a thing. For example, the illumination unit 102 can control the light amount individually, a light source for emitting R (red) light, a light source for emitting G (green) light, and a light source for emitting B (blue) light. The color of the light to be irradiated can be changed by individually controlling the light amount of each light source. Controlling the light intensity is a concept that also includes turning on and off the light. In addition, the illumination unit 102 may control the color of light by, for example, coloring light emitted from one or more light sources by transmitting a color filter and outputting the light. For example, light output from a plurality of light sources may be output through color filters of different colors, and the color of light may be controlled by changing the output of each light source. Also, for example, light output from a plurality of light sources is output by passing through a liquid crystal filter (not shown) and a different color filter (not shown), respectively, and the control unit 104 outputs The color of light to be emitted may be controlled by switching transmission and non-transmission of light of each liquid crystal filter individually according to a control signal or the like. For example, light of different colors may be emitted by switching transmission of light individually and changing the combination of light emitted from each color filter. The different color filters are, for example, R, G, B color filters.

  The acquisition unit 103 performs processing for detecting one or more codes in the captured image acquired by the imaging unit 101. Then, the acquisition unit 103 acquires, from the detected one or more codes, information associated with the codes. For example, the acquisition unit 103 acquires a code identifier as the information associated with the code.

  The detection of the code by the acquisition unit 103 may be considered as detecting an image of the code or an area of the code. For example, when the captured image is a moving image, the acquisition unit 103 binarizes the frame image acquired by the imaging unit 101 and performs pattern matching, processing of detecting a feature amount, or the like to obtain the shape such as the outer frame of the code. It recognizes and detects the area | region where the code | cord | chord in the picked-up image is arrange | positioned. Then, an image of the detected code is acquired. The same applies to the case where the photographed image is a still image. Note that the acquisition unit 103 may acquire images of a plurality of codes from one captured image. In addition, the acquisition unit 103 may appropriately correct the shape of the acquired code image. It is to be noted that processing for detecting a code from a photographed image and acquiring a code identifier is a well-known technology, and thus detailed description will be omitted here.

  For example, when the code can not be detected in the captured image, the acquisition unit 103 may output information indicating that the code can not be detected to the control unit 104 described later. For example, when the captured image is a moving image, information indicating that the code could not be detected is output if the code can not be detected within a predetermined time after the detection of the code is started. It is good.

  A process of acquiring information associated with one or more codes, for example, a code identifier, from the one or more codes detected from the captured image, for example, the processing performed by the acquisition unit 103 from the one or more codes is a known technique. Here, the detailed description is omitted.

  For example, when the information associated with the code can not be acquired from the code detected from the captured image, the acquiring unit 103 outputs information indicating that the code can not be acquired to the control unit 104 described later. May be If the information associated with the code can not be acquired from the detected code, for example, in the case where the code is a color code, the area in which the code is arranged can be detected. This is the case, for example, when the color to be configured can not be determined. For example, when the captured image is a moving image, the acquisition unit 103 corresponds to the code when the information associated with the code can not be acquired within the time designated in advance after the detection of the code is started. Information indicating that the attached information could not be acquired may be output.

  The acquiring unit 103 further transmits an item corresponding to one or more code identifiers acquired above from a plurality of pieces of information having code identifiers stored in advance in a storage unit (not shown) and the like, and identifiers of the articles or services. Alternatively, the identifier of the service may be acquired.

  Note that, for example, in the case of a two-dimensional code having a color array such as a color code as identification information, even if a plurality of codes exist in one captured image, a code identifier etc. It is known that there is one that can obtain information corresponding to the code. Therefore, by using such a code, it is possible to obtain information such as a code identifier for each of a plurality of codes in one shot image.

  If, for example, one or more codes are detected for one captured image, or if information corresponding to this code can be obtained from the detected code, the acquiring unit 103 thereafter, for the same captured image, The detection of the code or the acquisition of the information corresponding to the code may not be performed.

  The control unit 104 controls the light emitted from the illumination unit 102 to the imaging region according to the information acquired by the acquiring unit 103 from the captured image. For example, the control unit 104 controls the amount of light emitted by the illumination unit 102 and the color of the light. The control of the illumination unit 102 by the control unit 104 is performed, for example, by outputting a control signal or the like to the illumination unit 102.

  The control unit 104 acquires, for example, one or more parameters from the captured image acquired by the imaging unit 101, and controls the light emitted from the illumination unit 102 to the imaging region according to the acquired parameter. The parameter acquired by the control unit 104 may be any parameter. The parameter acquired by the control unit 104 is, for example, a parameter having a correspondence relationship with the state of light being irradiated to the imaging region.

  The parameters acquired by the control unit 104 from the photographed image are, for example, parameters related to the light amount. The control unit 104 acquires, for example, a parameter related to the light amount from the captured image, and controls the light amount of the light emitted to the imaging region by the illumination unit 102 according to the acquired parameter. The parameter relating to the light quantity may be considered as a parameter relating to the light intensity. The parameter related to the light amount is, for example, a parameter that can determine the light amount of the light irradiated to the imaging region as a result. The parameter related to the light amount of the illumination is, for example, a parameter of a photographed image having a correspondence with the light amount of the illumination. The parameter relating to the light quantity is, for example, a parameter of lightness or luminance of the whole captured image or a part thereof. The parameter of lightness or luminance is, for example, the lightness or luminance of one or more pixels constituting the entire captured image or a part thereof, a representative value such as an average value or a median value thereof, or a maximum value or a minimum value. Further, the parameter relating to the light quantity may be, for example, the value of one or more channels such as R channel, G channel, B channel, etc. of the whole or part of the photographed image, or its representative value, maximum value or minimum value etc. Good.

  For example, the control unit 104 acquires a parameter related to the light amount, and controls the light amount of the light emitted to the imaging region by the illumination unit 102 when the acquired parameter satisfies a predetermined condition. The condition designated in advance is, for example, a condition relating to the amount of light for judging that the code can not be read properly from the photographing area. The condition designated in advance is, for example, the condition that the parameter related to the light quantity is less than or equal to the first threshold, or the condition that it is greater than or equal to the second threshold (however, the first threshold is smaller than the second threshold) And so on).

  The control unit 104 may cause the illumination unit 102 to illuminate the imaging region, for example, when it is determined that the acquired parameter relating to the light amount satisfies the condition designated in advance. At this time, for example, the control unit 104 may cause the illumination unit 102 to illuminate the imaging area with a light amount designated in advance. In addition, the threshold value mentioned above can be suitably changed according to the environment etc. in which the code reader 1 is utilized. In addition, as the optimal value of the threshold, for example, it is preferable to set a value obtained according to an experimental result, an experience value, or the like. The same applies to the other threshold values described below.

  Further, for example, the control unit 104 may control the light emitted by the illumination unit 102 so that the parameter does not satisfy the condition designated in advance. For example, when the captured image captured by the imaging unit 101 is a moving image, or the captured image captured by the imaging unit 101 is a still image, and a new captured image is captured each time the control unit 104 performs lighting control. In such a case, the light amount emitted by the illumination unit 102 may be feedback-controlled until the parameter related to the light amount acquired from the photographed image does not satisfy the condition designated in advance. For example, the control unit 104 causes the lighting unit 102 to emit light of a predetermined light amount when the parameter related to the light amount acquired from the photographed image satisfies the predetermined condition, and then the frame photographed by the photographing unit 101 For the image and still image, acquire the parameter related to the light quantity again, and obtain from the captured image that the illumination unit 102 is irradiated with the light quantity of light different from the previous light quantity when the acquired parameter value satisfies the condition It may be repeated until the parameter relating to the amount of light does not satisfy the condition designated in advance. The feedback control is a known technique, and thus the detailed description is omitted here.

  In addition, the control unit 104 performs illumination such that, for example, as the shortage of the light amount indicated by the value of the parameter regarding the light amount of the illumination increases, the light amount of the light irradiated to the imaging region continuously or stepwise increases. The unit 102 may be controlled.

  In addition, the light controlled according to the parameter regarding the light quantity of illumination is white light normally. However, light other than white light may be used.

  The parameters acquired by the control unit 104 from the captured image may be, for example, parameters related to the color of light. For example, the control unit 104 acquires a parameter related to the color of light from the captured image, and controls the color of light emitted to the imaging region by the illumination unit 102 according to the acquired parameter.

  The parameter relating to the color of light is, for example, a parameter that can eventually determine the color of light emitted to the imaging region. The parameter relating to the color of light is, for example, a parameter of a photographed image having a correspondence with the color of light irradiated to the photographing region. The parameters relating to the color of light include, for example, values of hue, hue and saturation, or values of hue, saturation and lightness parameters, representative values such as average values and median values, or the like of at least a part of the captured image. The maximum value, the minimum value, etc. Further, parameters relating to the color of light are, for example, values of one or more color channels such as R channel, G channel, B channel, etc. of the whole captured image or a part of it, representative values, maximum values, minimum values, etc. It may be. The value of each color channel is, for example, the value of the lightness of the pixels that make up each color channel. When the image mode of the photographed image is the CMYK mode or the like, each color channel may be the CMYK channel. In addition, the parameter relating to the color of light may be the value of the hue of each pixel in at least a partial area of the captured image, preferably in all the areas. The value of the hue is, for example, the value of H (hue) of each pixel when the photographed image in the RGB mode or the like acquired by the photographing unit 101 is changed to the HSL mode.

  The control unit 104 acquires, for example, a parameter relating to the color of light from the captured image, and controls the color of light emitted to the imaging region by the illumination unit 102 when the acquired parameter satisfies a predetermined condition. Do. The condition designated in advance is, for example, a condition relating to the color of light for determining that the code can not be properly read from the photographing area. The condition designated in advance is a condition indicating that the photographed image has a color bias.

  For example, the predesignated condition has a width of a predesignated value in the distribution of hue values of each pixel which is a parameter of the color of light acquired from at least a part (preferably all) in the captured image The condition is that the continuous hue region includes pixels in a ratio equal to or greater than a predetermined threshold value in at least some of the pixels (for example, pixels in a ratio of 90% or more). The width of the hue value can be indicated by, for example, a value (e.g., "20" or the like) when the entire width of continuous colors constituting the hue circle is "360". For example, in the distribution of hue values of each pixel, which is a parameter of the color of light acquired from the photographed image, the control unit 104 is an area of continuous hue having a width of a value designated in advance, It is determined whether or not there is an area including pixels of a ratio equal to or more than a predetermined threshold value in all the pixels. When such a region is detected, the control unit 104 determines that color deviation exists in at least a part of the captured image, and the color corresponding to the range of the hue of the detected region is within the captured image. It is judged that the color is biased. Note that the width of the hue value described above can be appropriately changed in accordance with the environment in which the code reading device 1 is used. Further, as the optimum value of the width of this value, for example, it is preferable to set a value obtained according to an experimental result, an experience value, or the like.

  Further, the condition designated in advance may be, for example, a condition that the representative value or the maximum value of each color channel of the photographed image is equal to or less than the threshold value. In this case, for example, it can be determined that the color corresponding to the color channel below the threshold value is missing or lacking from the captured image.

  For example, when the control unit 104 determines that the acquired parameter relating to the light color satisfies the condition designated in advance, the control unit 104 causes the illumination unit 102 to capture the shooting area with light of a color determined according to the light color parameter. Make it light. For example, on the basis of the range of hues of a color biased in the captured image, the control unit 104 acquires colors according to the process of determining whether or not the above-described conditions are satisfied. Light may be emitted to the illumination unit 102. Alternatively, the control unit 104 may cause the illumination unit 102 to emit light of a color that is complementary to the color in the range of the hue. For example, in the case where the illumination unit 102 has a plurality of light sources (not shown) that emit different colors, the light of the desired color is transmitted to the illumination unit 102 by individually controlling the outputs of the light sources of different colors. Output The light of the desired color may be considered as light of a color in the desired hue range. Also, instead of light sources of different colors, light sources that emit light through filters of different colors may be used.

  Further, for example, as described above, when it is determined that the color corresponding to one or more color channels is missing from the captured image as described above, it is determined that the color is missing. The light of the color indicated by the color channel may be irradiated to the illumination unit 102. For example, when it is determined that the color corresponding to the R channel is missing from the captured image, the illumination unit 102 may be caused to emit red light which is a color corresponding to the R channel determined to be missing. Good.

  Further, for example, the control unit 104 may control the color of the light emitted by the lighting unit 102 so that the parameter related to the light color does not satisfy the condition designated in advance. For example, when the captured image captured by the imaging unit 101 is a moving image, or the captured image captured by the imaging unit 101 is a still image, and a new captured image is captured each time the control unit 104 performs lighting control. In such a case, the amount of light emitted by the illumination unit 102 may be feedback-controlled so that the parameter related to the color of light acquired from the captured image does not satisfy the condition designated in advance. For example, when the parameter related to the color of light acquired from the captured image satisfies the condition designated in advance, the control unit 104 causes the illuminating unit 102 to emit light of a color corresponding to the condition to the illuminating unit 102, and then capturing In the frame image and the still image captured by the unit 101, a parameter related to the color of light is acquired again, and when the acquired parameter value satisfies the condition, light of a color corresponding to the condition is further transmitted to the illumination unit 102. Irradiation may be repeated until a parameter related to the color of light acquired from the captured image satisfies a predetermined condition. The feedback control is a known technique, and thus the detailed description is omitted here.

  The control unit 104 may appropriately control the light amount of the illumination according to the combination of these parameters using two or more different parameters relating to the light amount. Further, the control unit 104 may control the color of the illumination light as appropriate according to a combination of these parameters, using two or more different parameters relating to the color of light. The control unit 104 may appropriately control the light of the illumination according to a combination of one or more parameters regarding the light amount of the illumination and one or more parameters regarding the color of the light. Further, the control unit 104 determines whether or not the condition regarding the combination of two or more conditions designated in advance is satisfied with respect to the parameter related to one light quantity, and the combination of the determination results is appropriately determined. You may control the light quantity of illumination. The same applies to the color of light.

  Note that there is no limitation on the timing or trigger of the control unit 104 controlling the light emitted by the illumination unit 102 according to the information acquired from the captured image. For example, the control unit 104 may perform control of light emitted by the illumination unit 102 as described above at predetermined or predetermined timing designated in advance. In addition, for example, when the imaging unit 101 first acquires a captured image (for example, a frame image of the captured image), the control unit 104 performs control of light to be applied according to the information acquired from the captured image. You may

  Further, when the acquisition unit 103 can not detect the code from the photographed image, the control unit 104 controls the light emitted from the illumination unit 102 to the photographing region according to the information acquired from the photographed image. May be For example, the control unit 104 controls the light emitted by the illumination unit 102 using the parameters acquired from the captured image. For example, the control unit 104 may perform control using parameters relating to the light amount as described above, may perform control using parameters relating to the color of light, or may perform both of them.

  The output unit 105 outputs the information acquired by the acquisition unit 103. For example, the output unit 105 transmits the code identifier acquired by the acquisition unit 103 to a server apparatus (not shown) or the like for processing the code identifier.

  When the output unit 105 can not acquire the information associated with the code from the captured image, the output unit 105 may output information indicating that effect. For example, as information indicating that, display of a character string or image indicating a code reading error, or sound may be performed.

  Further, the output unit 105 may display the photographed image photographed by the photographing unit 101 on a monitor or the like (not shown).

  The term "output" as used herein is a concept including display on a display, sound output, transmission to an external device, storage in a recording medium, delivery of processing results to another processing device or other program, and the like.

  The output unit 105 may or may not include an output device such as a monitor or communication means. The output unit 105 can be realized by driver software of an output device, or driver software of an output device and an output device.

  Next, an example of the operation of the code reader 1 will be described with reference to the flowchart of FIG.

  (Step S101) The imaging unit 101 starts imaging of the imaging area. Here, the case where the photographed image acquired by the photographing unit 101 by photographing is a moving image will be described as an example. Here, at first, the illumination of the imaging region by the illumination unit 102 is not performed.

  (Step S102) The acquiring unit 103 acquires one frame image from the photographed image acquired in step S101. For example, the acquisition unit 103 acquires the latest frame image. For example, in the case where the process of step S102 is performed immediately after steps S108 and S109 described later, the acquiring unit 103 acquires frame images captured after these steps S108 and S109. If the captured image is not a moving image, for example, the imaging unit 101 may capture and acquire a new still image or the like in this step. In this case, in the subsequent processing, this still image may be used instead of the frame image.

  (Step S103) The acquiring unit 103 performs processing for detecting one or more codes from the frame image acquired in step S102, and determines whether or not the code has been detected. For example, the acquisition unit 103 detects the outline of the code and acquires an image of the code. If it can be detected, the process proceeds to step S104. If it is not detected, the process proceeds to step S106.

  (Step S104) The acquiring unit 103 performs a process of reading, from the code, information associated with the code, for example, a code identifier. When the information associated with the code can be read, the process proceeds to step S105. When the information can not be read, the process proceeds to step S106.

  (Step S105) The output unit 105 outputs the information acquired in step S104. Then, the process ends.

  (Step S106) The control unit 104 determines whether a predetermined time has elapsed since the start of imaging. If it has not elapsed, the process proceeds to step S107. If it has elapsed, the process proceeds to step S110.

  (Step S107) The control unit 104 acquires parameters from the frame image acquired in step S102. For example, the control unit 104 acquires a parameter related to the light amount. In addition, the control unit 104 acquires parameters related to the color of light.

  (Step S108) The control unit 104 determines whether or not the parameter acquired in step S107 satisfies the condition designated in advance. For example, the control unit 104 determines whether the parameter related to the light amount acquired in step S107 satisfies the condition corresponding to the parameter related to the light amount. Further, for example, the control unit 104 determines whether the parameter regarding the color of light acquired in step S107 satisfies the condition corresponding to the parameter regarding the color of light. If the control unit 104 determines that one of the conditions satisfies the condition, the control unit 104 determines that the parameter acquired in step S107 satisfies the condition specified in advance, and if none of the conditions is satisfied, the control unit 104 is specified in advance. It may be determined that the condition is not satisfied. If the condition specified in advance is satisfied, the process proceeds to step S109. If the condition is not satisfied, the process returns to step S102. For example, if the parameter acquired in step S107 does not satisfy the condition designated in advance, the process returns to step S102, for example, the code can not be detected simply because the code does not appear in the captured image, camera shake, etc. As a result, when it is not possible to detect a code or read out information from a code because the captured image is not clear, it is possible to perform processing for detecting a code from the captured image and acquiring information again.

  (Step S109) The control unit 104 controls the illumination of light by the illumination unit 102 in accordance with the determination result of step S108. For example, the proof control unit 104 outputs a control signal corresponding to the determination result to the proof unit 102. For example, in step S108, when the parameter related to the light amount satisfies the condition designated in advance in step S108, the control unit 104 controls the illumination unit 102 to change the light amount to be irradiated such that the condition is not satisfied. . In addition, when the parameter relating to the color of light satisfies the condition designated in advance, the illumination unit 102 is controlled so that the color of the light to be emitted is changed such that the condition is not satisfied. Alternatively, these controls may be combined. The control of the illumination unit 102 to change the amount of light or the color of light may be control of on / off of light emission by the illumination unit 102. In response to this control, the illumination unit 102 emits light to the imaging region. Then, the process returns to step S102.

  (Step S110) The output unit 105 performs an error output indicating that the information associated with the code can not be acquired from the captured image. Then, the process ends.

  In the above process, when a plurality of codes are detected in step S103, for example, in step S104 or the like, the acquiring unit 103 performs a process of reading out information corresponding to the codes individually from each code. Just do it.

  Hereinafter, the specific operation of the code reader 1 in the present embodiment will be described. Note that values such as threshold values used in the following specific examples are values for convenience of explanation, and may not necessarily be suitable for actual reading of a code.

  FIG. 3 is a perspective view (FIG. 3A) as viewed from the front side of the code reader and a perspective view as viewed from the back side to show the situation in which the code is captured by the code reader 1. 3 (b). Here, the case where the code reader 1 is realized using a so-called smart phone will be described as an example. On the back side of the code reader 1, a video camera which is a photographing unit 101 and an illumination unit 102 are provided. Here, the illumination unit 102 has an R (red) light source, a G (green) light source, and a B (blue) light source (not shown), and the light emitted from these light sources is It is assumed that it can be individually controlled. On the front of the code reader 1, a monitor 105 a for displaying a photographed image or the like photographed by the photographing unit 101 is provided. Here, the case where the code 200 which is the shooting target of the shooting unit 101 is a color code will be described as an example. Here, as an example, a configuration in which a rectangular pattern having a maximum of eight colors of light blue, purple, yellow, green, red, blue, and orange is arranged in a two-dimensional manner in three rows and nine columns on a black background The case of using what you have will be described. However, in this specific example, the shape of the color code or the like does not matter. For example, the color code may be an annular color code or the like.

  It is assumed that the user shoots a color code with the shooting unit 101 on the back of the code reader 1 facing the code. At this time, by default, the lighting unit 102 does not perform lighting.

  The photographing unit 101 photographs a photographing area in which a color code is arranged, and acquires a photographed image which is a moving image.

  The acquisition unit 103 acquires a frame image from the moving image acquired by the imaging unit 101 and performs processing of detecting a color code. For example, the acquisition unit 103 detects an outline or the like of a color code to detect an area of the color code. The process of detecting a color code is a well-known technique, and thus the detailed description is omitted here.

  If a color code is detected, the acquisition unit 103 reads an array of colors constituting the detected color code. A process of reading an array of colors from a color code and acquiring information (for example, a code identifier) corresponding to the array of read colors is a well-known technology, and thus the detailed description is omitted here. In addition, when reading out an array of colors from a color code, the shape of the image of the color code detected above may be appropriately corrected.

  The output unit 105 outputs the information acquired by the acquisition unit 103 from the color code. For example, the acquired information is transmitted to a server apparatus (not shown) designated in advance.

  Here, if the acquisition unit 103 can not detect a color code from the frame image, the control unit 104 acquires, from the frame image, the average value of the lightness of the pixels constituting the frame image as a parameter related to the light amount. For example, it is assumed that the acquired average value is "20". Here, it is assumed that the range of values that each pixel of the frame image can take as lightness is “0” to “255”, and the smaller the value, the lower the lightness of the pixel, that is, the darker.

  The control unit 104 determines whether or not the condition is satisfied that the average value of the lightness of the pixels acquired above is equal to or less than a threshold value specified in advance for the average value of lightness. For example, assuming that the threshold value is “100”, the control unit 104 determines that the average value of the lightness satisfies the condition.

  Further, the control unit 104 acquires, from the frame image, the hue value for each of all the pixels constituting the frame image as a parameter related to the color of light.

  The control unit 104 determines whether the condition for the color of light is satisfied, using the acquired parameter. Specifically, first, the control unit 104 creates a histogram of the hue of the frame image using the values of the hues of all the pixels of the frame image. In this histogram, for example, the number of pixels is summed up for each hue value, and the summed values are arranged so that the hue values become continuous values. Then, in this histogram, the number of pixels included in the range of hues having a width of a value specified in advance is totaled to calculate the ratio of the total number of pixels, and whether the ratio is equal to or more than the threshold value Perform processing to determine whether or not. Then, the same processing is repeated by moving the hue range having the width of the value designated in advance by the minimum value of the hue value.

  For example, assuming that the width of the value designated in advance is “30”, at first, the number of pixels whose hue value is in the range from “1” to “30” is acquired, and Calculate the ratio to all pixels. Then, it is determined whether or not the calculated ratio is equal to or more than a threshold value for the hue designated in advance. If the calculated ratio is equal to or greater than the threshold, the value indicating the range of the hue is associated with the value of the ratio and temporarily stored in a storage unit or the like (not shown). If it is below the threshold, it does not store temporarily. Furthermore, the hue range is shifted by one, the number of pixels in the range of “2” to “31” is acquired, the ratio with respect to the total number of pixels is calculated, and it is determined whether it is the threshold or more. After that, the same processing is repeated by shifting the range of hue.

  Then, for all the ranges of hue, when the above processing is completed, it is determined whether or not a combination of a value indicating the range of hue and a ratio is stored in the storage unit (not shown). Is stored, a value indicating the range of hues having the largest ratio is obtained. When only one value indicating the hue range is stored, a value indicating the hue range may be acquired. When the value indicating the range of the hue can be acquired, the control unit 104 determines that the condition for the color of light is satisfied. Here, it is assumed that the threshold is “90%” and “23” to “52” can be obtained as values indicating the range of hue values, and the control unit 104 determines that the condition is satisfied. Here, it is assumed that the range of possible hue values of each pixel of the frame image is “0” to “359”.

  As described above, the control unit 104 determines that the condition regarding the light amount is satisfied, so here, the control unit 104 determines to cause the illumination unit 102 to perform illumination at a light amount designated in advance by default or the like.

  Further, since the control unit 104 determines that the condition for the color of light is satisfied as described above, the control unit 104 determines that the illumination unit 102 should be illuminated with light of a color corresponding to the hue range acquired above. Do. The illumination unit 102 first calculates the median value “37.5” of the hue range “23” to “52” acquired above. Then, the HSL having this value as the hue (H) value, the saturation (S) as the previously designated value (for example, 100), and the luminance (L) as the previously designated value (for example, 50%) Convert a color represented by a value to an RGB value. A known technique can be used as a process for converting the color represented by such HSL values into the color represented by RGB values. Then, the complementary color of the acquired RGB value is acquired. For example, complementary RGB values can be obtained by subtracting the component values of each of R, G, and B from the sum of the maximum value and the minimum value of the current RGB values. It does not matter how to obtain the complementary color. Since the process of acquiring the complementary color is a known technique, the detailed description is omitted here. The control unit 104 determines to cause the illumination unit 102 to emit light of a color corresponding to the acquired RGB value.

  The control unit 104 controls the illumination unit 102 to cause the illumination unit 102 to emit the light of the color determined as described above, which is the light having the predetermined light amount determined above. For example, the control unit 104 controls the R, G, and B indicated by the RGB values of complementary colors acquired above for the R-color light source, the G-color light source, and the B-color light source of the illumination unit 102. It is light of the light quantity corresponding to the ratio of the value of, and light is emitted such that the value obtained by combining the light quantities of the lights emitted from the respective light sources becomes the light quantity designated in advance.

  As a result, the code 200 to be photographed is illuminated with light having the light amount and the color determined by the control unit 104 by the light emitted by the illumination unit 102.

  The acquisition unit 103 acquires a frame image from the captured image captured by the imaging unit 101 immediately after the illumination described above, and detects a code in the acquired frame image. If a code is detected, the information associated with the code is read and output as described above.

  Here, if the code can not be detected, the control unit 104 acquires a parameter related to the light amount from the frame image as described above, and determines whether or not the same pre-specified condition as described above is satisfied. If the condition is satisfied, it is determined that the light amount is illuminated with a light amount which is larger than the light amount determined and irradiated as described above by a previously designated value. For example, it is decided to illuminate with a light quantity which is 10% more than the light quantity determined and irradiated as described above. If it is determined that the condition is not satisfied, it is determined to illuminate with the same amount of light as the amount of light determined immediately before.

  Further, the control unit 104 acquires a parameter related to the color of light from the frame image as described above, and determines whether this parameter satisfies the condition related to the color of light as described above. If so, as described above, it is decided to illuminate the code with the complementary color determined using the parameters relating to the color of the light. If not satisfied, it is decided to illuminate with the light of the color determined immediately before.

Then, the control unit 104 controls the illumination unit 102 to illuminate the code with the light determined above, and repeats the same process as described above until information can be obtained from the code.
Note that if information corresponding to the color code can not be acquired from the photographed image when a predetermined time or more has elapsed from the start of photographing by the photographing unit 101, for example, the color code can not be detected, or If the corresponding information can not be acquired from the code, the output unit 105 displays on the monitor 105 a that the information can not be acquired from the code, and ends the process of reading the code.

  As a result, the illumination unit 102 can capture an appropriately illuminated code, and can appropriately read the code.

  In the above, when the code can not be detected from the frame image, the light emitted from the illumination unit 102 is controlled, but from the code detected from the frame image, the information associated with the code can not be read out. In the case, for example, even when the color constituting the color code can not be determined, the amount of light emitted by the illumination unit 102 or the color of the light may be determined in the same manner as described above.

  Further, in the above, when the condition regarding the light amount is satisfied, the light of the light amount designated in advance is irradiated, but for example, the control unit 104 is configured to calculate the average value of the lightness of the pixels constituting the frame image. The value of the light quantity corresponding to the average value of the lightness obtained from the current frame image is obtained from the information stored in advance in the storage unit etc. not shown corresponding to the value range and the value of the light quantity of light to be irradiated. It is also possible to cause the illumination unit 102 to emit light of the acquired light quantity. Also, the average value of lightness values obtained from the current frame image is substituted into a previously prepared relational expression indicating the relationship between the average value of lightness values of the pixels constituting the frame image and the value of the light quantity of light to be irradiated. The value of the light quantity to be irradiated corresponding to the current frame image may be acquired.

  In the above-described specific example, the control unit 104 controls the light emitted from the illumination unit 102 when the information corresponding to the code can not be acquired from the frame image. However, in the present invention, the control unit Before the acquiring unit 103 detects a code from the frame image, the parameter 104 acquires a parameter relating to the light amount, a parameter relating to the color of light, etc. from the frame image, and uses the acquired parameter to pre-specified conditions. It is judged whether the condition is satisfied or not, and in the case where the condition is satisfied, a frame image obtained by photographing the code illuminated by the controlled light by controlling the light quantity and the color of the light etc. With respect to the above, the acquisition unit 103 may perform processing of detecting a code or processing of acquiring information corresponding to the code from the detected code.

  As described above, according to the present embodiment, it is possible to provide a code reader capable of appropriately reading a code by controlling the light irradiated to the code according to the information acquired from the photographed image.

  In the above embodiment, the control unit 104 acquires one or more parameters from the captured image acquired by the imaging unit 101, and the illumination unit 102 irradiates the imaging region according to the acquired parameters. Although the example of controlling the light has been described, in the present invention, the control unit 104 may control the light emitted to the imaging region by the illumination unit 102 in accordance with the captured image. The light to be irradiated may be controlled as in the example described above, or the light to be irradiated may be controlled in accordance with the photographed image by processing other than the example described above. For example, instead of acquiring a parameter and controlling light to be irradiated according to the acquired parameter, as described above, information indicating that the code can not be read from the captured image output from the acquiring unit 103 is displayed. If accepted, the control unit 104 may perform feedback control of the light emitted by the illumination unit 102 until the code becomes readable. For example, until the code can be read from the photographed image, the light amount and the color of the light emitted by the illumination unit 102 may be changed in stages, and the code may be photographed each time it is changed. Reading the code here may be considered as detection of the code, may be considered as acquisition of information from the code, or may be considered as both of them.

Second Embodiment
In the first embodiment, the control unit 104 controls the illumination. However, in the present embodiment, the control unit controls the shutter speed and the imaging position of the imaging unit. An example will be described.

  FIG. 5 is a block diagram of the code reader 2 in the present embodiment.

  The code reading device 2 includes an imaging unit 101, an illumination unit 102, an acquisition unit 103, a control unit 204, and an output unit 105. The imaging unit 101, the illumination unit 102, the acquisition unit 103, and the output unit 105 are the same as in the first embodiment, and thus detailed description will be omitted here. Here, for example, it is assumed that the photographing unit 101 can change the shutter speed. The shutter speed may be considered as the exposure time. In addition, the illumination unit 102 may be omitted if the illumination is not necessary at the time of photographing the code.

  The control unit 204 controls the shutter speed at the time of shooting by the shooting unit 101 according to the shot image acquired by the shooting unit 101. The control unit 204 controls an environment for acquiring a captured image, for example, by controlling a shutter speed. The shutter speed may be considered, for example, as the exposure time. The control of the shutter speed means, for example, a shutter speed determined based on the result of photometry performed using the shutter speed immediately before, the default shutter speed, and a sensor for photometry (not shown). It is changing from etc. and not changing according to the measurement result. The control of the shutter speed is, for example, to increase or decrease the shutter speed, or to set the shutter speed suitable for the photographed image. That the control unit 20 controls the shutter speed means, for example, outputting a control signal for controlling the shutter speed, an instruction, and the like to the photographing unit 101.

  The control unit 204 controls, for example, the shutter speed at the time of shooting by the shooting unit 101 so as to obtain a shot image in which the code can be read. Usually, the shutter speed of the photographing unit 101 such as a camera is set to any value of a plurality of predetermined shutter speeds. For example, the control unit 204 sets the shutter speed according to the photographed image. It may be controlled to become faster or slower one by one. In addition, the control unit 204 uses the correspondence table in which the range of parameter values related to lightness stored in advance in a storage unit (not shown) and the like and the optimal shutter speed are associated with the value of the parameter related to lightness acquired from the photographed image. The corresponding shutter speed may be acquired as the shutter speed after change. The shutter speed of the imaging unit 101 may be continuously changeable. In this case, for example, the control unit 204 substitutes the parameter relating to the lightness acquired from the photographed image into a previously prepared arithmetic expression for calculating the shutter speed using the parameter relating to the lightness as an argument. You may calculate the speed. Parameters related to lightness will be described later.

  The photographed image photographed by the photographing unit 101 may be a still image or a moving image. In the case of a moving image, the shutter speed is, for example, a shutter speed at the time of capturing a frame image constituting the moving image. Further, the control unit 20 controls, for example, a shutter speed at the time of shooting a frame image thereafter, in accordance with one or more frame images shot by the shooting unit 101. When the imaging unit 101 captures a still image, the still image may be captured again after changing the shutter speed.

  For example, the control unit 204 controls the shutter speed at the time of shooting by the shooting unit 101 according to the information acquired by the acquisition unit 103 from the photographed image. For example, when information indicating that the code could not be detected is received from the captured image output from the acquisition unit 103, the control unit 204 may perform feedback control of the shutter speed at the time of shooting. For example, the shutter speed may be changed stepwise until the code is detected from the photographed image, and photographing may be performed each time the shutter speed is changed. Although the change of the shutter speed in this case is usually to lower the shutter speed, it may be to increase it.

  For example, the control unit 204 acquires one or more parameters from the captured image acquired by the imaging unit 101, and controls the shutter speed according to the acquired parameters. Here, one or more parameters are, for example, parameters used when controlling the shutter speed, and in order to distinguish from the parameters used when controlling the light described in the first embodiment, the shutter parameters You may call it The parameter acquired by the control unit 204 is, for example, a parameter having a correspondence relationship with the exposure amount at the time of shooting.

  The parameters acquired by the control unit 204 from the captured image are, for example, parameters related to the lightness of the captured image. The parameters relating to lightness may be considered as parameters relating to luminance and illuminance. The parameter relating to the lightness may be a statistical value of lightness of the photographed image (for example, an average value, a median, a median, a maximum value, a minimum value, etc.) or a gamma value of the photographed image. It may be a histogram of The control unit 204 acquires, for example, a parameter related to lightness from a photographed image, and controls the shutter speed at the time of photographing according to the acquired parameter. The parameter relating to lightness is, for example, a parameter that can eventually determine the shutter speed suitable for shooting. The shutter speed suitable for photographing is, for example, a shutter speed capable of photographing a photographed image capable of identifying a color of a color code. If the area in which the code is arranged can be recognized in the photographed image, the parameter acquired from the photographed image by the control unit 204 is a part of the photographed image, for example, an area in which the code in the photographed image is arranged. The parameter may be a parameter related to the brightness of the image, or may be a parameter related to the entire brightness. Further, the parameter relating to lightness is, for example, a parameter of lightness for one or more channels such as R channel, G channel, B channel, etc. of the whole captured image or a part thereof, eg representative value of lightness of one or more channels It may be a maximum value, a minimum value, or the like, or may be a parameter of lightness of an image obtained by grayscaleting a captured image.

  For example, the control unit 204 acquires a parameter (for example, a parameter related to lightness), and controls the shutter speed when the acquired parameter satisfies a predetermined condition. The conditions specified in advance are conditions for parameters for controlling the shutter speed. The condition designated in advance is, for example, a condition relating to lightness for determining that the code can not be properly read from the photographing area. The condition designated in advance is, for example, a condition that a parameter related to lightness (for example, an average value of lightness of a photographed image, etc.) is equal to or less than a first threshold, or a condition that is equal to or higher than a second threshold (however, Is a value smaller than the second threshold) and the like. In the present embodiment, when the lightness is high, that is, when the lightness value is high, it indicates that the photographed image is bright, and when the lightness is low, that is, when the lightness value is low, the photographed image is It shall indicate that it is dark.

  The control unit 204 changes the shutter speed of the photographing unit 101, for example, when it is determined that the acquired parameter (for example, the parameter related to lightness) satisfies the condition designated in advance. For example, when the parameter related to the lightness acquired from the captured image is equal to or less than the first threshold, the control unit 204 slows the shutter speed. For example, when the lightness acquired from the photographed image is darker than the lightness indicated by the first threshold, the shutter speed is decreased to increase the exposure time. For example, the shutter speed is decreased by j steps (j is an integer of 1 or more). Also, for example, when the parameter related to the lightness acquired from the captured image is equal to or greater than the second threshold, the control unit 204 increases the shutter speed. For example, when the lightness acquired from the photographed image is brighter than the lightness indicated by the second threshold, the shutter speed is increased to reduce the exposure time. For example, the shutter speed is increased by k steps (k is an integer of 1 or more). The first threshold and the second threshold described above can be changed as appropriate according to the environment in which the code reader 1 is used. In addition, as the optimal value of the threshold, for example, it is preferable to set a value obtained according to an experimental result, an experience value, or the like. The same applies to the other threshold values described below. The control unit 204 may use only one of the first threshold and the second threshold.

  In addition, the control unit 204 may control the shutter speed, for example, so that the parameter (for example, the parameter related to the lightness) does not satisfy the condition designated in advance. For example, when the captured image captured by the imaging unit 101 is a moving image, or the captured image captured by the imaging unit 101 is a still image, a new captured image is generated each time the control unit 204 performs shutter speed control. In the case of shooting or the like, the shutter speed may be feedback-controlled until the parameter acquired from the shot image does not satisfy the condition designated in advance. For example, the control unit 204 captures a captured image at a shutter speed or the like specified in advance, and thereafter acquires parameters relating to the light amount for frame images and still images captured by the capturing unit 101, and the acquired parameter values If the conditions are satisfied, shooting at a shutter speed different from the previous shutter speed, for example, a slow shutter speed may be repeated until the parameter related to the light quantity acquired from the photographed image does not satisfy the condition designated in advance. . The feedback control is a known technique, and thus the detailed description is omitted here.

  Note that, for example, the control unit 204 has a large shortage of lightness indicated by the value of the parameter related to lightness (for example, an absolute value of a difference between the parameter and the first threshold when the parameter is equal to or less than the first threshold). Accordingly, the photographing unit 101 may be controlled to decrease the shutter speed by the amount of change that increases continuously or gradually. Similarly, the control unit 204 determines, for example, the excess of lightness indicated by the value of the parameter related to lightness (for example, the absolute value of the difference between the parameter and the second threshold when the parameter is equal to or greater than the second threshold). The imaging unit 101 may be controlled to increase the shutter speed by the amount of change that increases continuously or stepwise as the size increases.

  The control unit 204 may appropriately control the shutter speed according to a combination of two or more parameters acquired from the photographed image. In addition, the control unit 204 determines whether or not the combination of two or more conditions specified in advance is satisfied with respect to the parameter relating to one light quantity, and the combination of the determination results is appropriately determined. You may control the shutter speed.

  When the photographing position of the photographing unit 101 is controllable, the control unit 204 may control the photographing position by the photographing unit 101 according to the photographed image acquired by the photographing unit 101. The control unit 204 may control an environment for acquiring a captured image, for example, by controlling the imaging position. For example, the control unit 204 may control the position of the photographing unit 101 at the time of photographing so as to obtain a photographed image in which the code can be read. Controlling the position of the imaging unit 101 may be controlling the position of the code reader 2 having the imaging unit 101. The position of the imaging unit 101 is a position in the space where the imaging unit 101 is disposed, and is a concept including the orientation of the imaging unit 101 and the like.

  For example, when the imaging unit 101, specifically, the code reading device 2 having the imaging unit 101 is attached to a so-called drone (not shown) such as an unmanned vehicle or an unmanned aerial vehicle, the control unit 204 By controlling the position of the drone by outputting a control signal or the like, the imaging position by the imaging unit 101 is controlled. For example, if the presence of a color code is not recognized in the image shot by the shooting unit 101 or if the color code information can not be read, the presence of the color code is recognized or the color code information can be read, Change the position and orientation of the drone. The manner of movement of the drone before, after, left or right when the presence of the color code can not be recognized or when information of the color code can not be acquired may be specified in advance or may be randomly determined. Also, the drone may move starting from the position once designated by the control of the user or the like.

  For example, in the image photographed by the photographing unit 101, the control unit 204 recognizes an object or region in which the color code is arranged by pattern matching or the like, and can not recognize the presence of the color code in the image of the object or region. In this case, for example, the drone is controlled to move the drone back and forth, up and down, left and right, until the presence of the color code is recognized. The movement here is a concept including rotation. Moving the drone may be considered as moving a portion where the photographing unit 101 of the drone is installed.

  For example, when an object or area in which a color code is arranged is designated in advance, the control unit 204 performs pattern matching on the object or area in which the color code is arranged in the image captured by the imaging unit 101. If the color code can not be recognized in the image of the object or area, for example, the drone is controlled to display the part where the photographing unit 101 of the drone is installed until the color code is recognized. , Move close to the object or area or move along the object or area.

  For example, when the presence of a color code is recognized in an image captured by the imaging unit 101, but the color code information can not be acquired, specifically, when the color code information can not be read, the control unit 204 The drone may be controlled to bring the drone closer to the color code whose presence is recognized. Also, in the photographed image, the outline of the color code, the apex of the outer circumference, etc. are detected, and the detected outline or the position of the apex has a drone so that the position thereof has a predetermined shape, for example, a rectangular shape. You may control the position of.

  Instead of using a drone or the like, the code reader 2 may be installed on a crane whose position can be freely controlled so that the control unit 204 of the code reader 2 controls the crane or the like.

  Note that there is no limitation on the shutter speed, the timing at which the imaging position is changed, the trigger, or the like. For example, the control unit 204 may perform control of the shutter speed as described above at predetermined or predetermined timing designated in advance. Further, for example, when the photographing unit 101 acquires a photographed image (for example, a frame image of the photographed image or the like), the control unit 204 may control the shutter speed according to the photographed image. Further, the control unit 204 may control the shutter speed according to the captured image when the acquisition unit 103 can not detect the code from the captured image. For example, the control unit 204 controls the shutter speed using a parameter acquired from a captured image.

  The control unit 204 can be realized by, for example, an MPU, a memory, or the like. The processing procedure of the control unit 204 is realized by, for example, software, and the software is stored in a storage medium such as a ROM. However, it may be realized by hardware (a dedicated circuit).

  Next, an example of the operation of the code reader 2 will be described with reference to the flowchart of FIG. In the figure, the same reference numerals as in FIG. 2 denote the same or corresponding processing steps, and the detailed description will be omitted here. Here, in the processing steps of the same reference numerals as those in FIG. 2, the processing performed by the control unit 104 is assumed to be performed by the control unit 204 here.

  (Step S207) The control unit 204 acquires a parameter used when controlling the shutter speed from the frame image acquired in step S102. For example, the control unit 104 acquires a parameter related to lightness.

  (Step S208) The control unit 204 determines whether the parameter acquired in step S207 satisfies one or more conditions specified in advance for controlling the shutter speed. If the condition is satisfied, the process proceeds to step S209. If the condition is not satisfied, the process returns to step S102.

  (Step S209) The control unit 204 controls the shutter speed. For example, the control unit 204 outputs, to the photographing unit 101, an instruction to change the setting of the shutter speed at the time of photographing. Then, the process returns to step S102, and the photographing unit 101 performs photographing at the changed shutter speed.

  Hereinafter, the specific operation of the code reader 2 in the present embodiment will be described. Note that values such as threshold values used in the following specific examples are values for convenience of explanation, and may not necessarily be suitable for actual reading of a code.

  It is assumed that a schematic diagram showing a situation in which the code is photographed using the code reader 2 is the same as FIG.

  The process of capturing the shooting area where the shooting unit 101 arranges the color code and obtaining a shot image, the process of detecting a color code from the shot image, and obtaining information from the detected color code, etc. The detailed example is omitted here because it is similar to the specific example of the first aspect.

  Here, in the frame image of the photographed image obtained by photographing the photographing area in which the color code photographed by the photographing unit 101 is arranged, the acquiring unit 103 performs the color code from the frame image as in the specific example of the first embodiment. Is not detected or information can not be acquired from the color code, the control unit 204 acquires the average value of the lightness values of the pixels constituting the frame image as . For example, it is assumed that the acquired average value is "20". Here, it is assumed that the range of values that each pixel of the frame image can take as lightness is “0” to “255”, and the smaller the value, the lower the lightness of the pixel, that is, the darker.

  The control unit 204 determines whether or not the condition that the average value of the lightness of the pixels acquired above is equal to or less than a first threshold value specified in advance for the average value of lightness is satisfied. For example, assuming that the first threshold is “100”, the control unit 204 determines that the average value of the brightness satisfies the condition. As described above, since the control unit 204 determines that the first condition for the lightness is satisfied, the control unit 204 changes the shutter speed, which is the default shutter speed of 1/125 seconds, to a shutter speed that is one step slower than the shooting unit 101. Output the instruction. Specifically, an instruction to set the shutter speed to 1/60 seconds, which is one step slower, is output. The control unit 204 may simply transmit, to the photographing unit 101, an instruction to slow the shutter speed by one step. Here, it is assumed that the shutter speed that can be set in the photographing unit 101 is any of a plurality of shutter speeds. In the multiple shutter speeds, when the shutter speed is decreased by one step, the light amount received by the imaging unit 101, for example, the light amount received by an imaging device (not shown) is doubled.

  The photographing unit 101 photographs an area in which the code 200 to be photographed is disposed at the shutter speed instructed by the control unit 024. By delaying by one step, the exposure amount can be doubled, and it becomes possible to take a picture more properly than before the change, that is, take a picture in which the color code is easy to read. The acquisition unit 103 acquires a frame image captured by the imaging unit 101, and detects a code in the acquired frame image. If a code is detected, the information associated with the code is read and output as described above.

  Here, if a code can not be detected, the control unit 204 obtains a parameter relating to brightness from the frame image as described above, and determines whether the parameter satisfies a predetermined threshold value or less. If the condition is satisfied, the shutter speed is decreased by one step. If the condition is not satisfied, code detection from the frame image or acquisition of code information is performed again without changing the shutter speed. Do.

  Then, the control unit 204 repeats the same process as described above until information can be obtained from the code.

  Note that if information corresponding to the color code can not be acquired from the photographed image when a predetermined time or more has elapsed from the start of photographing by the photographing unit 101, for example, the color code can not be detected, or If the corresponding information can not be acquired from the code, the output unit 105 displays on the monitor 105 a that the information can not be acquired from the code, and ends the process of reading the code.

  As a result, the shutter speed can be changed according to the photographed image, and the code can be photographed appropriately, and the code can be read appropriately.

  In the above, when the code can not be detected from the frame image, the shutter speed is controlled. However, when the information corresponding to the code can not be read out from the code detected from the frame image, for example, Even when the color constituting the code can not be determined, the shutter speed may be changed as described above.

  Further, in the above, when the control unit 204 determines that the average value of the lightness of the pixels acquired above is not less than the first threshold, the control unit 204 determines the average value of the lightness of the pixels acquired above It is determined whether the condition that the average value of lightness is equal to or more than the second threshold specified in advance is satisfied, and if it is determined that the condition is satisfied, the control unit 204 increases the shutter speed by one step. You may

  As described above, according to the present embodiment, it is possible to change the shutter speed at the time of photographing a code according to the information acquired from the photographed image, and to provide a code reader capable of appropriately reading the code. Can. In particular, by controlling the shutter speed in accordance with the captured image, it is different from the control for capturing a beautiful image as in a general camera, the image is captured such that the color code can be read from the captured image As described above, the shutter speed can be controlled, and the color code can be read accurately.

  In the above description, the control unit 204 controls the shutter speed at the time of shooting by the shooting unit 101. However, in the present invention, the control unit 204 controls the shooting condition at the time of shooting by the shooting unit 101. What is necessary is just to change. The change of the photographing condition is the change of the shutter speed, the aperture, the light receiving sensitivity, etc. or the combination of two or more of them. The change of the photographing condition in this case is, for example, a change of the photographing condition such that a photographed image obtained by photographing a color code which enables accurate reading of information can be obtained. For example, when the photographing unit 101 is capable of changing the aperture and the light receiving sensitivity, instead of increasing the shutter speed, the aperture may be narrowed according to the photographed image, and the light receiving sensitivity is lowered. May be The same applies to the reverse.

Third Embodiment
In the first embodiment, the control unit 104 controls the illumination. However, in the present embodiment, the control unit of the code reading apparatus displays the code to be photographed. The case of performing control will be described. In this embodiment, in particular, a case where a device for displaying a code to be photographed is a projection device provided outside the code reading device will be described as an example.

  FIG. 7 is a block diagram showing the code reader 3 and the projection device 5 in the third embodiment.

  The code reading device 3 includes an imaging unit 301, an illumination unit 102, an acquisition unit 103, a control unit 304, and an output unit 105. The illumination unit 102, the acquisition unit 103, and the output unit 105 are the same as those in the first embodiment, and thus the detailed description will be omitted here. In addition, the illumination unit 102 may be omitted if the illumination is not necessary at the time of photographing the code.

  The projection device 5 includes a projection imaging unit 501, a projection unit 502, and a reception unit 503.

  The projection device 5 is a device that captures an area including one or more codes, acquires a captured image, and projects the acquired captured image. The projector 5 is, for example, a projector such as a camera having a configuration for capturing an image for projection, and a projector connected to a configuration for capturing an image for projection.

  The projection imaging unit 501 captures an area including one or more codes to obtain a captured image. The configuration of the projection imaging unit 501 is the same as that of the imaging unit 101, and thus the detailed description is omitted here. Here, in order to distinguish the photographed image photographed by the projection photographing unit 501 from the photographed image photographed by the photographing unit 101, it is called a projected photographed image.

  The projection unit 502 projects the projected and photographed image acquired by the projection and photographing unit 501. It does not matter where the projection unit 502 projects the projected photographed image. It is preferable that the projection unit 502 be capable of adjusting the light quantity at the time of projection and the color of the light to be projected. For example, in the case where the projection unit 502 uses light in which light of three primary colors is overlapped for projection, the color of light to be irradiated can be changed by individually adjusting the light amounts of the light of three primary colors. It is good. In addition, the color of the light to be irradiated may be changed by irradiating the light through a color filter that can change the color. The configuration in which the projection unit 502 projects the projected and photographed image is the same as the configuration in which a normal projector projects an image, and thus the detailed description is omitted here.

  The projection unit 502 is, for example, an image by the projection device 5 received by the reception unit 503 described later from the control unit 204 of the code reader 3, that is, a projection-captured image according to a control signal for controlling projection of the projection-captured image. Control when projecting. Specifically, in accordance with the control signal, the projection unit 502 adjusts a projected image which is an image obtained by projecting the projected photographed image. The adjustment of the projection image includes, for example, increase or decrease of the light quantity of light to be projected, change of color of the light to be projected, adjustment of color of the projection photographed image used for projection, for example, adjustment of saturation, brightness, color tone, etc. And so on. The adjustment of the projection image may be considered as adjusting parameters or the like when projecting the projection image, or adjusting the image quality of the projection image. For example, when the control signal received by the reception unit 503 includes an instruction to increase the light amount, the projection unit 502 changes the light amount for projecting the projected photographed image according to the instruction. When the received control signal includes an instruction to change the color of the projection image, the projection unit 502 changes the color of the light to be irradiated to change the color of the projection image. Alternatively, the projection image may be changed by performing image processing to change the color of the projection-captured image according to the control signal and projecting the changed projection-captured image. When changing the color of the projected and captured image, the projection unit 502 may include a processor such as an MPU or GPU, a memory, or the like, and may include a circuit dedicated to image processing.

  The receiving unit 503 receives a control signal transmitted by the control unit 204 of the code reader 3. The control signal received by the receiving unit 503 is a signal that controls the projection of the image by the projection device 5.

  The imaging unit 301 captures a projection image which is an image projected by the projection device 5. The imaging unit 301 has the same configuration as the imaging unit 101 except that the projection image is captured. The projection image is an image obtained by projecting the photographed image obtained by photographing the area including the one or more codes by the projection device 5. Since the projection image is obtained by projecting an image obtained by capturing a code, the captured image obtained by capturing this projected image is also an image obtained by capturing a code.

  The control unit 304 controls the projection of the image by the projection device 5 in accordance with the photographed image acquired by the photographing unit 101. The projection of the image by the projection device 5 is the projection of the photographed image obtained by photographing the area including one or more codes by the projection device 5. Controlling the projection is, for example, transmitting a control signal for controlling the projection to the projection device 5. The transmission of the control signal may be performed by wireless communication or may be performed by wired communication. The control unit 304 may have, for example, communication means for performing communication. Alternatively, the control unit 304 may transmit a control signal to the projection device 5 via a transmission unit (not shown) or the like.

  For example, as described in the first embodiment, when the control unit 304 receives information indicating that the code can not be read from the captured image output by the acquisition unit 103, the control unit 304 can By transmitting a control signal for controlling the projection of the image to the projection device 5, feedback control of the projection of the image by the projection device is performed so that the code can be read from the image obtained by capturing the projection image projected by the projection device You may For example, until the code is detected from the captured image, a control signal for changing the amount of light projected by the projection device 5 and the color of light in stages is transmitted to the projection device 5, and each time transmission is performed It is also possible to take a picture. The change of the light quantity here is, for example, an increase or a decrease of the light quantity to be projected.

  In addition, as described in the first embodiment, the control unit 304 acquires one or more parameters from the captured image, and controls the projection of the image by the projection device 5 according to the acquired parameters. Good. The parameters acquired by the control unit 304 from the photographed image are, for example, the same parameters as the parameters acquired by the control unit 104 described in the first embodiment, and the control unit 304 performs the same processing as the control unit 104. Get one or more parameters.

  For example, the control unit 304 acquires light amount and color information associated with the values of one or more parameters from a storage unit (not shown) and the like, and projects the image with the acquired light amount and color light. Control signal is transmitted to the projection device 5.

  Further, the control unit 304 may control the projection of the image by the projection device 5 when, for example, one or more parameters acquired from the captured image satisfy a predetermined condition. For example, the control unit 304 acquires, for example, a parameter related to the light amount from the captured image, and controls the light amount when the projection device 5 projects an image when the acquired parameter satisfies a predetermined condition. As the conditions designated in advance, the same conditions as the conditions of the first embodiment described above can be used. The condition designated in advance is, for example, a condition relating to the light amount for judging that the code can not be properly read from the photographing area. The condition designated in advance is, for example, the condition that the parameter related to the light quantity is less than or equal to the first threshold, or the condition that it is greater than or equal to the second threshold (however, the first threshold is smaller than the second threshold) And so on). Further, for example, when the control unit 304 satisfies the condition designated in advance, the control similar to the control performed by the control unit 104 on the illumination unit 102 in the first embodiment is applied to the projection device 5. You should do it. For example, in the first embodiment, when it is determined that the light amount of the illumination performed by the illumination unit 102 is increased when it is determined that the parameter relating to the light amount satisfies the condition specified in advance, in the present embodiment, When it is determined that the parameters relating to the color of light satisfy the same condition, control may be performed to increase the amount of light projected by the projection device 5. However, the amount of light to be increased may be different.

  In addition, the control unit 304 may control, for example, the projection of the image by the projection device 5 so that the parameter does not satisfy the condition designated in advance. For example, when the captured image captured by the imaging unit 301 is a moving image, or the captured image captured by the imaging unit 301 is a still image, a new captured image is captured each time the control unit 304 performs lighting control. In such a case, the light amount when the projection device 5 projects an image may be feedback-controlled until the parameter related to the light amount acquired from the photographed image does not satisfy the condition designated in advance. For example, the control unit 304 transmits, to the projection device 5, a control signal to increase the light amount of light projected by the projection device 5 when the parameter related to the light amount acquired from the captured image satisfies the condition designated in advance. Furthermore, for the frame image and the still image captured by the imaging unit 301, a control signal for acquiring the parameter related to the light amount again and increasing the light amount of the light projected by the projection device 5 when the value of the acquired parameter satisfies the condition The process of transmitting may be repeated until the parameter related to the light amount acquired from the photographed image does not satisfy the condition designated in advance. The feedback control is a known technique, and thus the detailed description is omitted here.

  Note that, for example, the control unit 304 controls the projection device 5 so that the light amount of light projected by the projection device 5 increases continuously or in stages as the shortage of the light amount indicated by the value of the parameter related to the light amount increases. You may In addition, for example, the control unit 304 controls the projection device 5 so that the light amount of light projected by the projection device 5 decreases continuously or in stages as the excess of the light amount indicated by the value of the parameter related to the light amount increases. You may

  The parameters acquired by the control unit 304 from the captured image may be parameters related to the color of light as described above. For example, the control unit 304 acquires a parameter related to the color of light from the captured image, and controls the color of light projected by the projection device 5 according to the acquired parameter.

  For example, the control unit 304 acquires a parameter related to the color of light from the captured image, and controls the color of light projected by the projection device 5 when the acquired parameter satisfies a predetermined condition. Regarding the conditions designated in advance, the same conditions as the conditions for the parameters regarding the color of light in the above-mentioned Embodiment 1 can be used. Further, for example, when the control unit 304 satisfies the condition designated in advance, the control similar to the control performed by the control unit 104 on the illumination unit 102 in the first embodiment is applied to the projection device 5. You should do it. For example, in the first embodiment, when it is determined that the parameter relating to the color of light satisfies the condition specified in advance, it is assumed that the control to intensify the intensity of the specific color of the illumination performed by the illumination unit 102 is performed. In the embodiment, when it is determined that the parameters relating to the color of light satisfy the same condition, control may be performed to intensify the intensity of a specific color of light projected by the projection device 5. However, the extent to which the intensity of a specific color is increased may be different from that of the first embodiment.

  Further, for example, the control unit 304 may control the projection of the image by the projection device 5 so that the parameter related to the color of light does not satisfy the condition designated in advance. For example, similarly to the above, the projection of the image performed by the projection device 5, specifically, the change of the color of the light to be projected may be feedback-controlled.

  The control unit 304 may appropriately control the projection of the image by the projection device 5 according to a combination of two or more different parameters acquired from the captured image.

  In addition, according to the information acquired from the photography picture, control part 304 does not ask timing, a trigger, etc. which control projection by projection device 5. For example, the control unit 304 may perform control at every predetermined or indefinite timing designated in advance. Also, for example, when the imaging unit 101 first acquires a captured image (for example, a frame image of the captured image), the control unit 304 may perform control in accordance with the information acquired from the captured image. .

  In addition, when the acquisition unit 103 can not detect the code from the photographed image, the control unit 304 may control the projection by the projection device 5 according to the information acquired from the photographed image. For example, when the acquisition unit 103 can not detect the code from the captured image, the control unit 304 controls the projection by the projection device 5 using the parameter acquired from the captured image.

  Next, an example of the operation of the code reader 3 will be described with reference to the flowchart of FIG. In the figure, the same reference numerals as in FIG. 2 denote the same or corresponding processing steps, and the detailed description will be omitted here. In addition, in the process step of the same code | symbol as FIG. 2, the control part 304 shall perform the process which the control part 104 was performing here.

  (Step S309) The control unit 304 controls the projection of the image by the projection device 5 in accordance with the parameter acquired in step S207. For example, the control unit 304 transmits, to the projection device 5, a control signal for controlling the projection. Then, the process returns to step S102.

  Hereinafter, an example of the operation of the projection device 5 will be briefly described. The projection photographing unit 501 photographs an area in which the code is arranged, and acquires a projection photographed image. The projection unit 502 sequentially switches and displays the projected and photographed images acquired by the projection and photographing unit 501. The receiver 503 receives the control signal transmitted from the code reader 3. The projection unit 501 controls the projection of the projected and photographed image in accordance with the control signal received by the reception unit 503. For example, the light amount to be projected is changed according to the control signal, or the color of the light to be projected is changed according to the control signal.

  Hereinafter, specific examples of the present embodiment will be described.

  FIG. 9 is a schematic view showing a situation in which the code reader 3 captures a projection image projected by the projection device 5.

  The projection photographing unit 301 of the projection device 5 photographs an area in which the color code 200 is arranged, and acquires a projection photographed image. The projected and photographed image acquired here is assumed to be a moving image. The projection unit 302 of the projection device 5 projects, for example, the projected and photographed image photographed by the projection and photographing unit 301 on a wall or a screen (not shown). The projection image 50 is displayed on a wall, a screen or the like by this projection. Here, it is assumed that the projection unit 302 performs projection with a light amount designated in advance by default.

  When the user captures a projected image 50 with the capturing unit 301 of the code reader 3, the capturing unit 301 acquires a captured image that is a moving image.

  A process of detecting a color code from a captured image acquired by the imaging unit 101 and acquiring information from the detected color code is the same as the specific example of the first embodiment, and thus the detailed description is omitted here. Do.

  Here, in the frame image of the photographed image obtained by photographing the photographing region in which the color code photographed by the photographing unit 101 is arranged, the acquiring unit 103 can not detect the color code as in the specific example of the first embodiment. If the information can not be acquired from the color code, the control unit 304 acquires, from the frame image which is the photographed image, the average value of the lightness of the pixels constituting the frame image as a parameter related to the light amount.

  As in the specific example of the first embodiment, does the control unit 304 satisfy the condition that the lightness average value of the pixels acquired above is equal to or less than a first threshold value specified in advance for the lightness average value? Decide whether or not. Here, it is assumed that the control unit 304 determines that the average value of the lightness satisfies the condition.

  Further, as in the specific example of the first embodiment, the control unit 304 obtains, from the frame image, the hue value for each of all the pixels constituting the frame image as a parameter relating to the color of light. Then, the control unit 304 performs processing similar to that of the specific example of the first embodiment to determine whether the acquired parameter relating to the color satisfies the condition regarding the light color. Here, it is assumed that the control unit 304 determines that the parameter related to the color satisfies the condition.

  As described above, since the control unit 304 determines that the condition regarding the light amount is satisfied, the control unit 304 determines that the light amount used for the projection is increased by a predetermined value with respect to the projection device 5 here.

  In addition, since the control unit 304 determines that the condition regarding the color of light is satisfied as described above, it determines to perform projection with light of a color corresponding to the range of the hue acquired above to the control device 5 Do. Here, the determination of the corresponding color is performed in the same manner as the determination of the color of the illumination in the specific example of the first embodiment.

  Then, in accordance with the above determination, the control unit 304 performs wireless communication with a control signal for increasing the light quantity by a predetermined value and a control signal for performing projection with the light of the color determined above. , To the projection device 5.

  When the receiving unit 503 of the projecting device 5 receives the control signal transmitted from the control unit 304 of the code reading device 3, the projecting unit 502 controls the light to be projected according to the received control signal. Specifically, the amount of light to be projected is increased according to a control signal for increasing the amount of light by a previously designated value, and according to a control signal for performing projection with light of the color determined above, Change the color of light to be projected. The image captured by the projection imaging unit 501 is newly projected by the light thus changed.

  Here, when the code can not be detected from the captured image captured by the imaging unit 301 and the projection image projected by the changed light is further detected, the control unit 304 determines the parameter related to the light amount from the frame image as described above. To obtain parameters relating to color and color, determine whether these parameters satisfy the conditions facilitated in advance for each, control the projection by the projection device 5, and if the conditions are not satisfied, the projection device The code detection from the frame image and the acquisition of code information are performed again without controlling the projection by 5.

  Then, the control unit 304 repeats the same process as described above until information can be obtained from the code.

  Note that if information corresponding to the color code can not be acquired from the photographed image when a predetermined time or more has elapsed from the start of photographing by the photographing unit 101, for example, the color code can not be detected, or If the corresponding information can not be acquired from the code, the output unit 105 displays on the monitor 105 a that the information can not be acquired from the code, and ends the process of reading the code.

  As a result, the projection by the projection device 5 can be controlled according to the photographed image, and the code can be photographed properly, and the code can be read appropriately.

  Further, in the above, when it is determined by the control unit 304 that the average value of the lightness of the pixels acquired above is not less than the first threshold, the control unit 304 determines the average value of the lightness of the pixels acquired above It is determined whether or not the condition that the average value of lightness is equal to or more than the second threshold specified in advance is satisfied, and the control unit 204 determines that the condition is satisfied. The amount of light may be reduced.

  As mentioned above, according to this embodiment, according to the information acquired from a photography picture, projection of a picture which picturized a code by a projection device can be controlled, and a code reader which can read a code appropriately is provided. can do.

  In each of the above-described embodiments, the control unit controls illumination, shooting conditions such as shutter speed, and the projection apparatus. However, in the present invention, the control unit acquires a photographed image. What is necessary is to control the environment of The control of the environment for acquiring a photographed image may be, for example, the control of the internal environment of the code reading apparatus at the time of photographing or the control of the external environment. The control of the environment for acquiring the photographed image may be, for example, control of the setting of the photographing unit at the time of photographing, control of illumination as described above, control of display of a code to be photographed, etc. It is a match. Specifically, the control of the setting of the photographing unit is one or more of the control of the setting of the shutter speed, the aperture, the sensitivity, and the like as described above. The control of display of the code to be imaged is, for example, control of an apparatus or the like for displaying the code of the object to be imaged, and more specifically, control of the projection apparatus as described above.

  In the above embodiments, each process (each function) may be realized by centralized processing by a single device (system), or realized by distributed processing by a plurality of devices. It may be done.

  In each of the above embodiments, the code reader is a stand-alone unit. However, the code reader may be a stand-alone unit or a server unit in a server / client system. In the latter case, the imaging unit 101 receives an input of a captured image through a communication line, and the illumination unit 102 transmits information for illuminating the imaging area through the communication line. .

  In each of the above embodiments, each component may be configured by dedicated hardware, or a component that can be realized by software may be realized by executing a program. For example, each component can be realized by a program execution unit such as a CPU reading and executing a software program recorded on a recording medium such as a hard disk or a semiconductor memory. At the time of execution, the program execution unit may execute the program while accessing a storage unit (for example, a recording medium such as a hard disk or a memory).

  The software for realizing the code reader in each of the above embodiments is the following program. That is, this program detects a computer from an imaging unit that captures an area including one or more codes and acquires a captured image, detects one or more codes in the captured image, and detects one or more codes from the detected code. And an output unit that outputs the information acquired by the acquisition unit, and a control unit that controls an environment for acquiring the photographed image according to the photographed image. It is a program.

  In the above program, the function realized by the program does not include the function that can be realized only by hardware. For example, functions that can be realized only by hardware such as an acquisition unit that acquires information and an output unit that outputs information, such as a modem or an interface card, are not included in the functions that the above program realizes.

  Moreover, the computer that executes this program may be singular or plural. That is, centralized processing may be performed, or distributed processing may be performed.

  FIG. 4 is a diagram showing an example of a computer system 900 that implements the color code reader according to the above embodiment by executing the above program. The above embodiments can be realized by computer hardware and a computer program executed thereon.

  In FIG. 4, a computer system 900 is connected to an MPU (Micro Processing Unit) 911, a program such as a boot-up program, an application program, a system program, a ROM 912 such as a flash memory for storing data, and the MPU 911 The ROM 913 temporarily stores instructions of the application program, and also includes a RAM 913 for providing a temporary storage space, a touch panel 914, a wireless communication module 915, and a bus 916 interconnecting the MPU 911, the ROM 912 and the like. Note that instead of the wireless communication module 915, a wired communication module may be provided. Further, instead of the touch panel 914, a display and an input device such as a mouse or a keyboard may be provided.

  A program that causes the computer system 900 to execute the function of the color code reader according to the above embodiment may be stored in the ROM 912 via the wireless communication module 915. The program is loaded into the RAM 913 upon execution. The program may be loaded directly from the network.

  The program may not necessarily include the operating system (OS) that causes the computer system 900 to execute the function of the color code reader according to the above embodiment, a third party program, or the like. The program may include only portions of instructions that invoke appropriate functions or modules in a controlled manner to achieve a desired result. It is well known how computer system 900 operates, and detailed description is omitted.

  It goes without saying that the present invention is not limited to the above embodiments, and various modifications are possible, which are also included in the scope of the present invention.

  As described above, the code reading apparatus and the like according to the present invention are suitable as an apparatus and the like for reading a code, and particularly useful as a code reading apparatus and the like provided with illumination.

1, 2, 3 Code reading device 5 Projection device 101, 301 Imaging unit 102 Illumination unit 103 Acquisition unit 104, 204, 304 Control unit 105 Output unit 105a Monitor 200 Code

Claims (6)

An imaging unit that captures an area including one or more codes and acquires a captured image;
An acquisition unit that detects one or more codes in the captured image and acquires information associated with the codes from the detected one or more codes;
An output unit that outputs the information acquired by the acquisition unit;
A control unit configured to control an environment for acquiring the photographed image according to the photographed image ;
And a lighting unit that emits light to the area photographed by the photographing unit.
The illumination unit is capable of changing the color of light to be emitted,
The code is a color code,
The control unit acquires, from the captured image, a range of hues of a color that is biased in the captured image as a parameter related to the color of light, and the illumination unit is configured to the imaging area according to the acquired parameter. A code reader that controls the color of light to be emitted to a color outside the acquired hue range. Wherein, when the acquisition unit can not acquire the information corresponding to the code from the captured image, the code of claim 1, wherein said illumination unit controls the light irradiated to the imaging area reading apparatus . The control unit, from said captured image, obtains a parameter related to the amount of light, according to the obtained parameters, according to claim 1, wherein said illumination unit controls the amount of light irradiated to the imaging area Code reader. The code reader according to any one of claims 1 to 3 , wherein the control unit controls a shutter speed at the time of photographing by the photographing unit according to the photographed image. A code reading method performed using an imaging unit, an acquisition unit, an output unit, a control unit, and an illumination unit ,
A photographing step in which the photographing unit photographs an area including one or more codes and acquires a photographed image;
An acquisition step in which the acquisition unit detects one or more codes in the captured image and acquires information associated with the codes from the detected one or more codes;
An output step of outputting the information acquired in the acquisition step by the output unit;
A control step of controlling an environment for acquiring the photographed image according to the photographed image ;
And an illumination step of illuminating the area to be photographed in the photographing step.
The code is a color code,
The lighting step can change the color of the light to be irradiated,
The control step acquires, from the captured image, a range of hues of a color that is biased in the captured image as a parameter related to the color of light, and the lighting step is performed on the captured area according to the acquired parameter. The code reading method which controlled the color of the light to irradiate to the color out of the range of the acquired hue . Computer,
An imaging unit that captures an area including one or more codes and acquires a captured image;
An acquisition unit that detects one or more codes in the captured image and acquires information associated with the codes from the detected one or more codes;
An output unit that outputs the information acquired by the acquisition unit;
A control unit configured to control an environment for acquiring the photographed image according to the photographed image ;
The illumination unit is configured to function as an illumination unit that emits light to an area photographed by the imaging unit.
The code is a color code,
The illumination unit is capable of changing the color of light to be emitted,
The control unit acquires, from the captured image, a range of hues of a color that is biased in the captured image as a parameter related to the color of light, and the illumination unit is configured to the imaging area according to the acquired parameter. A program that controls the color of light to be emitted to a color outside the acquired hue range .

Images