JP7375261B2 - Code processing device, code processing method, and program - Google Patents

Description

Article 30, Paragraph 2 of the Patent Act applies From November 27th to November 29th, 2020 Exhibited at the "1st Kansai Logistics Exhibition" sponsored by the Kansai Logistics Exhibition Executive Committee

The present invention relates to a code processing device and the like.

As a conventional technique, a technique is known in which a two-dimensional code area is specified from an image and information coded by the two-dimensional code is identified (for example, see Patent Document 1).

Japanese Patent Application Publication No. 2001-195536 (Page 1, Figure 1, etc.)

However, in the conventional technology, the information that can be read from the code is usually predetermined for each code, and the user easily adds desired information to the code when arranging the code. The problem was that I couldn't do it.

The present invention has been made to solve the above-mentioned problems, and it is an object of the present invention to provide a code processing device etc. that can easily add desired information to the code when arranging the code. purpose.

The code processing device of the present invention includes an image reception unit that receives a captured image of one or more codes, a code detection unit that detects a code from the captured image received by the image reception unit, and one or more codes detected by the code detection unit. a reading acquisition unit that acquires information by reading the code; and an angle information acquisition unit that acquires the angle at which one or more codes detected by the code detection unit are arranged and acquires information corresponding to the acquired angle; The code processing device includes an output unit that outputs information acquired by a reading acquisition unit regarding one or more codes detected by the code detection unit, and information corresponding to an angle acquired by the angle information acquisition unit.

With this configuration, desired information can be easily added to the code depending on the angle at which the code is arranged.

Further, in the code processing device of the present invention, the angle information acquisition unit in the code processing device is capable of acquiring three or more different angles as the angle at which the code is arranged, and stores information corresponding to each of the acquired angles. You may also obtain it.

With this configuration, three or more pieces of desired information can be added to the code depending on the angle at which the code is placed.

Further, in the code processing device of the present invention, in the code processing device, the image reception unit further includes a reference object indicating a direction as a reference of the angle when the angle information acquisition unit acquires the angle at which the code is arranged. The angle information acquisition section receives the photographed image, and determines the angle between the direction indicated by the reference object in the photographed image and the direction indicating the specific orientation of the code, as the angle at which the code detected by the code detection section is arranged. A relative angle may also be obtained.

With this configuration, it is possible to specify the direction that serves as a reference for the angle at which the code is arranged in the real space where the code is arranged.

Further, in the code processing device of the present invention, the reference object may be a code indicating a reference direction.

With this configuration, it is possible to easily specify the reference direction of the angle at which the code is arranged by placing the reference code in the real space where the code is arranged.

Further, in the code processing device of the present invention, in the code processing device, the image receiving unit is a plate on which a code is arranged, and the photographed image is a photographed image of one or more plates in which the direction of the code can be visually recognized. It may also be possible to accept .

With this configuration, the user can easily grasp the orientation of the cord when arranging the cord at a desired angle.

Further, in the code processing device of the present invention, in the code processing device, the angle information acquisition unit detects the angle at which each code is arranged in units of 90 degrees, and as information corresponding to 90 degrees and 270 degrees, The same information may be acquired.

With this configuration, when placing the code, angles that are difficult for the user to distinguish can be treated as substantially the same angle, and errors in information specification due to the angle at which the code is placed can be reduced.

According to the code processing device and the like according to the present invention, desired information can be easily added to the code when arranging the code.

Block diagram of a code processing device according to an embodiment of the present invention Flowchart explaining the operation of the code processing device A diagram showing an example of the code processing device and a progress management board on which the code is placed. Diagrams for explaining the codes used in the code processing device (FIGS. 4(a) and 4(b)) Diagram showing a photographed image acquired by the code processing device Diagram showing the reading management table of the code processing device Diagram showing the angle management table of the code processing device Diagram showing the acquisition information management table of the code processing device A diagram showing an example of the configuration of a computer system according to an embodiment of the present invention.

Embodiments of the code processing device and the like will be described below with reference to the drawings. Note that in the embodiments, constituent elements with the same reference numerals perform similar operations, and therefore, repeated explanation may be omitted.

(Embodiment)
FIG. 1 is a block diagram of a code processing device 1 in this embodiment.

The code processing device 1 includes an image reception section 100, a photographing section 101, a code detection section 102, a reading acquisition section 103, an angle information acquisition section 104, an output section 105, a reading information storage section 106, and an angle information storage section 107.

The code processing device 1 may be, for example, a personal computer, a portable information processing terminal such as a multifunctional mobile phone such as a so-called smartphone, a tablet terminal, or a PDA (Personal Digital Assistant). It may be a dedicated device that processes images etc., or it may be a server or the like.

The image reception unit 100 receives a photographed image of one or more codes. The photographed image is, for example, an image obtained by photographing an area in which one or more codes are arranged. The one or more codes here are codes from which the angle of arrangement is to be obtained, as will be described later. Hereinafter, for convenience of explanation, the code whose placement angle is to be obtained will be referred to as a target code to distinguish it from other codes. In other words, the captured images accepted by the image receiving unit 100 are images of one or more target codes. The photographed image may be an image obtained by photographing one or more other codes together with one or more target codes. As the other code, for example, a code similar to the code that can be used as the target code can be used. The target code may be any code as long as it can be distinguished from other codes based on information obtained by reading the code. For example, the target code may be a code in which information such as an identifier read from the code matches one of the information readable from one or more target codes prepared in advance. Further, the target code may be, for example, a code having information indicating that the information obtained by reading the code is a predetermined target code. Further, the target code may be, for example, a code in which information generated using information obtained by reading the code, such as a hash value, serves as information indicating that the code is the target code. Alternatively, the target code may be a code that has a different code system, type, etc. from other codes.

The photographed images may be still images, moving images, or continuous still images. The number of pixels of the captured image does not matter. The data format or file format of the captured image does not matter. Further, the photographed image may be a color image or a monochrome image. However, when using a color code as a code in a photographed image, the photographed image usually needs to be a color image.

The code such as the target code here is a code that can read information, for example, a code that can read corresponding information from a photographed image. The code is, for example, a code represented by an image or the like other than a character string. For example, the code may be a color code such as a Chameleon code (registered trademark), a QR code (registered trademark), a barcode, or another code. Preferably, the code here is a code that can be read simultaneously using a photographed image. Hereinafter, in this embodiment, the case where the target code is a color code will be mainly described.

The target code photographed in the photographed image is preferably a code whose arrangement angle can be freely set or a code whose arrangement angle can be freely changed. The angle at which the target code is arranged will be described later.

The target code photographed in the photographed image is preferably a code that can be detachably attached to a desired region of a desired surface by the user. The target code photographed in the photographed image is, for example, a code arranged on a plate. For example, the target code is a code printed on a plate or a code affixed to the plate. The shape, size, color, material, etc. of the plate on which the target code is placed does not matter. Usually, one code is placed on one plate. However, a plurality of codes may be arranged on one plate. The plate on which the target code is placed has, for example, a magnetic material, a hook-and-loop fastener, an adsorption surface, an adhesive surface, etc., and is a plate that can be removably attached to a board such as a whiteboard, a wall surface, a paper surface, etc. . Since the plate is removable, the target cord arranged on the plate can be removably attached to a desired area. For example, the image receiving unit 100 may receive one or more captured images of one or more plates on which the target code is arranged.

It is preferable that the image receiving unit 100 receives, for example, a photographed image of one or more plates on which a target code is arranged, and the orientation of the target code can be visually recognized. The direction of the target code is, for example, the direction of the target code, such as up, down, left, or right. The orientation of the target code here is the orientation of the target code that the angle information acquisition unit 104 acquires using the target code in the captured image, as will be described later. Being able to visually recognize the orientation of the target code means, for example, that the user can visually determine the orientation of the target code. For example, a plate that allows the direction of the target code to be visually recognized has information that allows the direction of the target code to be visually recognized on the surface where the target code is placed, at a position adjacent to the target code. It is a plate. Information that allows the direction of the target code to be visually recognized is, for example, one or more characters or marks as described below.

For example, a plate on which the orientation of the target code can be visually recognized is a plate on which one or more characters are arranged, and the orientation of the characters corresponds to the orientation of the target code. For example, a plate on which the direction of the target code can be visually recognized is a plate in which characters are arranged adjacent to the target code, and the direction from the bottom to the top of the target code is the one in which the characters are arranged adjacent to each other. The direction from the bottom to the top of the target code matches the direction from the bottom to the top, and the direction from the right to the left of the target code matches the direction from the right to the left of the adjacent characters.

In addition, a plate on which the direction of the target code can be visually recognized is, for example, a plate on which one or more marks other than letters that can visually indicate the direction are arranged, and this mark indicates It may be a plate whose orientation corresponds to a specific orientation of the target code. This mark may be, for example, an arrow or an isosceles triangle mark.

Furthermore, a plate on which the direction of the target code can be visually recognized is, for example, a plate on which one or more marks are arranged adjacent to the target code on the surface where the target code is arranged, and The plate may be such that the direction from the code to this mark corresponds to a specific orientation of the target code. The direction from the target code to the mark is, for example, the length direction of a line segment connecting the target code to the mark at the shortest distance. A plate on which the direction of the target code can be visually recognized is, for example, a plate in which a mark is placed above the target code, and the direction from the bottom of the target code to the top is the direction from the target code to the mark. This is a matching plate. A plate on which the direction of the target code can be visually recognized is, for example, a plate in which a mark is placed on the right side of the target code, and the direction toward the right of the target code matches the direction from the target code toward the mark. That's the plate. The mark here may be of any size or shape, and may be a portion of the plate that is colored. Further, the mark here may be one or more characters.

Note that the above mark may be one or more protrusions or recesses. By using protrusions or recesses as marks, the orientation of the target code can be recognized even by touching it with the hand.

In addition, information such as letters and marks placed on the plate to make it possible to visually recognize the orientation of the target code as described above is placed on the back side of the plate, which is different from the front side where the target code is placed. You can leave it there. Even if these marks and characters are placed on the back side of the plate, the user can still grasp the orientation of the target code by looking at the back side of the plate when placing the plate. If one or more characters placed on the plate are character strings related to user privacy or corporate confidentiality, the character strings are placed on the back side of the plate from the viewpoint of privacy protection and security. It is preferable. The character string related to privacy is, for example, information regarding the user's name and the like. Character strings related to company secrets include, for example, project names, work names, new product names, and the like. It does not matter whether the character string placed on the plate is information that can be read from the target code. Further, it does not matter whether the character string placed on the plate is information related to information that can be read from the target code.

Further, the plate that allows the direction of the target code to be visually recognized may be a plate having a shape that visually indicates the direction of the target code. For example, the plate may have a shape in which the width of the plate becomes narrower toward a specific direction of the target code, or a shape in which a plurality of unevenness or the like is formed on the side of the target code located in a specific direction.

Note that the plate in which the orientation of the target code can be visually recognized may be such that the target code itself arranged thereon can be a code that allows the orientation of the target code to be visually recognized. For example, a part of the target code may have an arrangement that indicates the direction of the target code. For example, a part of the target code may include an image such as an arrow indicating the direction of the target code. Further, when the target code is a color coat, the arrangement of colors in a part of the target code may be an arrangement indicating the direction of the target code. For example, in a plate where the orientation of the target code can be visually recognized, the target code is a color code in which multiple cells are arranged on a matrix, and the target code is placed on the side located in a specific direction. It may also be a plate on which a color code is arranged in which the color of the cell is a specific color. In this case, the direction in which the side made up of cells of this specific color is located is the specific direction of the target code.

By making the orientation of the target code visually recognizable, the user can recognize the specific orientation of the target code, and the user can arrange the target code at a desired angle.

Note that although the case where the target code is arranged on a plate has been described here, the target code may be printed on a film, a sheet, or the like. Even in such a case, as described above, information that allows the orientation of the target code to be visually recognized may be placed near where the target code is placed, and the shape of the film, etc. , it may be a shape that allows the orientation of the target code to be recognized. Further, the target code may be placed on the surface of the article, the packaging material of the article, or the like. The arrangement here may be pasting or printing. In this case, it is preferable that the orientation of the article or the like matches the orientation indicated by the target code. Further, the target code may be a code displayed on a monitor or the like.

The photographed image may be, for example, a photographed image of a table showing the implementation status of the work, a work management table, etc., in which one or more target codes are removably arranged. The arrangement of the target code here may be considered, for example, as the arrangement of a plate, a sheet, etc., on which the target code is arranged. Further, the work image may be an image of a product display shelf, a bookshelf, etc., on which one or more target codes are arranged. However, the photographed images are not limited to these images.

The image reception unit 100 is configured to receive an image obtained by further photographing a reference object indicating a reference direction of this angle when an angle information acquisition unit 104 (described later) obtains the angle at which the target code is arranged. It's okay. A photographed image obtained by further photographing the reference object is an image obtained by photographing one or more object codes and the reference object, and is a photographed image that includes both the one or more object codes and the reference image. The angle at which the target code is arranged will be described later. The reference object may be, for example, a ruled line displayed on the surface on which the target code is arranged, and the direction in which this ruled line extends may be determined to be the direction serving as the above-mentioned reference. Further, the reference object may be, for example, a shelf board of a display shelf that extends in the horizontal direction and on which items with codes affixed to the upper surface are arranged, and the direction in which this shelf board extends is defined as above. It may be determined that the direction is the reference direction. Further, the reference object may be a code (hereinafter referred to as a reference code) indicating a direction that is a reference for an angle. In other words, the image reception unit 100 may receive an additional photographed image of the reference code. A photographed image obtained by further photographing a reference code is an image obtained by photographing one or more target codes and one or more reference codes, and is a photographed image that also includes one or more target codes and one or more reference images. . In this case, the direction indicated by this reference code may be considered as the direction that serves as the angle reference. The reference code is preferably information indicating that the information read from the code is the reference code. The direction indicated by the reference code may be, for example, a direction indicating a specific orientation of the reference code (for example, rightward, upward direction, etc.), or may be a longitudinal direction, a lateral direction, or the like of the reference code. The reference code may be arranged on a plate or the like similarly to the above-mentioned target code. The reference code may indicate a direction that serves as a reference angle using a plurality of reference codes. For example, the angle reference direction may be a direction that connects the centers of two reference cords, or a direction perpendicular to the connecting direction. Note that in a normal code, since the direction of the code is detected when reading the code, the process of detecting a specific direction of the code using the code is a known technique, and the explanation thereof will be omitted here.

The reception of a photographed image here may be the reception of photographic information photographed by a photographing section 101 described later, which has a photographing section similar to the photographing section 101 described below provided outside the code processing device 1. It may also be the reception of photographed images transmitted via a wired or wireless communication line from a photographing device (not shown), etc., and read from a recording medium (not shown) such as an optical disk, magnetic disk, or semiconductor memory. It may also be possible to accept a photographed image that has been taken. How the image receiving unit 100 receives captured images is not limited to the above.

In this embodiment, as an example, a case will be described where the code processing device 1 includes the photographing section 101 and the image receiving section 100 receives a photographed image taken by the photographing section 101. When the code processing device 100 receives a photographed image from a photographing section or the like provided externally, the code processing device 1 does not need to have the photographing section 101 such as a camera to be described later. For example, when the image receiving unit 100 receives a photographed image taken with a camera included in a so-called smartphone or the like and transmitted from the smartphone, the photographing unit 101 described later may be omitted.

The image reception unit 100 may be considered as an interface or the like for accepting captured images. The image reception unit 100 is realized by, for example, a device driver for receiving and reading captured images, menu screen control software, and the like.

The photographing unit 101 acquires a photographed image. For example, the photographing unit 101 acquires a photographed image by photographing an area in which one or more codes are arranged. The one or more codes here are target codes. For example, the imaging unit 101 obtains a photographed image by photographing an area where one or more plates on which target codes are arranged are arranged. This plate is, for example, a plate that allows the direction of the target code to be visually recognized as described above. The image photographed by the photographing section 101 is the photographed image as described above in relation to the image receiving section 100. Note that the imaging unit 101 may obtain a photographed image by photographing an area in which one or more target codes and a reference object are arranged. Furthermore, in addition to one or more target codes, the imaging unit 101 may acquire a photographed image by photographing an area in which one or more codes other than the target code are arranged. One or more codes other than this target code may include a reference code.

The photographing unit 101 is usually realized by a digital camera, an optical scanner, a line sensor, or the like.

The code detection unit 102 detects one or more codes from the captured image received by the image reception unit 100. Detecting a code from a photographed image means, for example, detecting an image of the code within the photographed image. Detecting an image of the code may be detecting a region of the code. The code that the code detection unit 102 detects from the captured image is a code that includes one or more target codes. For example, the code detection unit 102 may detect all codes in the photographed image, or may detect only some codes including one or more target codes. When the captured image uses a reference code as a reference object, it is preferable that the code detection unit 102 also detects this reference code. Since the process of detecting one or more codes from a photographed image is a known technique, detailed explanation will be omitted here.

The reading acquisition unit 103 reads one or more codes detected by the code detection unit 102 and acquires information. The one or more codes read here are target codes. The information that the reading acquisition unit 103 acquires by reading the target code (hereinafter referred to as read information) may be, for example, information that is directly read from the target code, and is associated with information such as an identifier read from the target code. The information may be stored in a storage unit (not shown). If one or more codes detected by the code detection unit 102 include a code other than the target code, the code other than the target code may also be read. For example, if one or more codes detected by the code detection unit 102 include a reference code, the reading acquisition unit 103 may also read the reference code. The read information may be any information. In the following, the reading acquisition unit 103 reads the target code to acquire an identifier, and searches for reading information associated with this identifier from a plurality of different reading management information stored in the reading information storage unit 106. This will be explained by taking as an example the case where the data is acquired by . The reading management information is information that includes an identifier read from the target code and reading information. Note that since the process of reading the code is a known technique, a detailed explanation will be omitted here.

The angle information acquisition unit 104 acquires the angle at which one or more codes detected by the code detection unit 102 are arranged, and acquires information corresponding to the acquired angle (hereinafter referred to as angle correspondence information). The one or more codes whose angles are acquired by the angle information acquisition unit 104 here are one or more target codes. The angle at which the target code is arranged may be considered, for example, as an angle indicating the orientation of the target code. The angle at which the target code is arranged is, for example, the angle at which the target code is arranged within the captured image. The angle at which the code is arranged is, for example, the angle between a direction indicating a specific orientation of the target code and a direction that is a reference for the angle. The direction indicating a specific orientation of the target code is, for example, a predetermined direction that can be specified in the code, and is a direction parallel to the surface of the code. The direction indicating the specific orientation of the target code is, for example, upward, rightward, leftward, downward, or the like of the target code. Note that when the angle information acquisition unit 104 acquires an angle indicated by the longitudinal direction or the lateral direction of the subject code as the angle at which the subject code is arranged, the direction indicating the specific orientation of the subject code is, for example, It may be in the longitudinal direction or in the lateral direction.

In the following description, the angle acquired by the angle information acquisition unit 104 will be limited to a range of 0 to 360 degrees for convenience of explanation. However, the angle range is not limited to this range, and may be in a range other than this, for example, from -180 degrees to 180 degrees. When using ranges other than the above, angles, angle ranges, etc. in the following description etc. may be appropriately converted and read as corresponding values. For example, a description of an angle of 350 degrees may be replaced with a description of an angle of -10 degrees.

First, a process in which the angle information acquisition unit 104 acquires the angle at which one or more target codes detected by the code detection unit 102 are arranged will be described. The angle information acquisition unit 104 acquires, for example, a direction indicating a specific orientation of one or more target codes detected by the code detection unit 102. For example, in order to identify the orientation of the target code, the angle information acquisition unit 104 detects the upper, lower, left, and right sides of the target code using one or more dots or cells arranged within the target code, and detects the detected upper, lower, left, and right directions. may be used to obtain a direction indicating a specific orientation. The direction here is, for example, a direction within a captured image. Obtaining a direction may be considered to be obtaining information indicating the direction. For example, in a color code where cells are arranged in a matrix, the top, bottom, left and right sides of the color code are detected, and the direction from the cell in the lower left corner to the cell in the lower right corner, or from the cell in the upper left corner to the cell in the upper right corner, is detected. , it may be detected as the right direction, which is a direction indicating a specific direction. Similarly, the direction from the cell in the lower left corner to the cell in the upper left corner may be detected as the upward direction.

Further, for example, the angle information acquisition unit 104 uses the images of one or more target codes detected by the code detection unit 102 to detect a coordinate system within the image of the target code, and uses this coordinate system to determine a specific target code. A direction indicating the orientation (for example, right direction, upward direction, etc.) may be specified. The direction indicating the specific orientation may be the direction indicated by one coordinate axis of the coordinate system. The coordinate system in the image of the target code is, for example, a two-dimensional coordinate system detected from the arrangement direction of dots, cells, bars, etc. that constitute the target code. However, the specification of the direction indicating the specific orientation of the target code described above is just one example, and the process is not limited to the above process.

The angle information acquisition unit 104 acquires the angle that the direction indicating the specific orientation of the target code acquired above makes with respect to the direction that is the reference angle. For example, a predetermined direction of the captured image may be used as the direction that serves as the reference angle. The predetermined direction of the photographed image is the right direction, left direction, upward direction, or downward direction of the photographed image. The predetermined direction of the photographed image may be the longitudinal direction or the lateral direction of the photographed image. The predetermined direction of the captured image can be obtained from the captured image. For example, the target code is arranged at an angle that the direction indicating the specific orientation of the target code in the captured image acquired by the angle information acquisition unit 104 regarding the target code above makes with respect to a predetermined direction in the captured image. Get it as the angle. For example, as described above, the angle information acquisition unit 104 may direct the direction from the lower left corner cell to the lower right corner cell of the color code in the photographed image to the right direction of the target code, which is a direction indicating a specific orientation of the target code. , and the angle that this direction makes with respect to the right direction of the photographed image (for example, the direction from the left side to the right side of the photographed image) may be acquired as the angle at which the target code is arranged.

Furthermore, the reference direction of the angle used when specifying the angle at which the target code is arranged may be the direction indicated by the reference target described above. That is, the angle information acquisition unit 104 determines the angle at which the target code detected by the code detection unit 102 is arranged, based on the relative relationship between the direction indicated by the reference object in the photographed image and the direction indicating the specific orientation of the target code. It is also possible to obtain a specific angle.

For example, when the reference object is a ruled line, a shelf board, etc., the angle information acquisition unit 104 performs image recognition processing, etc. to detect these reference objects in the photographed image, and detects the direction in which the reference object extends ( For example, the direction in which a ruled line or shelf board extends is detected. If the direction in which the reference object extends is to the left or right of the photographed image, the direction in which the reference object extends from the left to the right of the photographed image is obtained as the right direction, and the direction from right to left is obtained as the left direction. You may. Note that when the direction in which the reference object extends is the up-down direction, the upward direction and the downward direction may be determined by performing a process in which the above-mentioned left and right are read as up and down. For example, if the angle between the extending direction of the reference object obtained above and the horizontal direction of the photographed image is not between 45 degrees and 135 degrees, the direction in which the reference object extends is considered to be the left and right of the photographed image, and the angle is 45 degrees. If the angle is between 135 degrees and 135 degrees, the direction in which the reference object extends may be considered to be above and below the photographed image.

Furthermore, when the reference object is a reference code, the direction that serves as the reference for the angle may be a predetermined direction specified in this reference code. For example, the angle information acquisition unit 104 acquires an angle formed by a predetermined direction specified in one or more target codes and a predetermined direction specified in the reference code. The process of specifying the predetermined direction in the reference code is the same as the process of specifying the predetermined direction in the target code, so the explanation will be omitted here.

The direction that serves as the reference for the angle indicated by the reference object such as the reference code is preferably a direction parallel to or perpendicular to the vertical direction or height direction of the surface on which the object code is arranged. For example, when the target code is placed on a plane other than a horizontal plane, such as a wall surface, the reference direction indicated by the reference target is preferably a horizontal direction or a direction perpendicular to the horizontal direction.

Note that the angle that the angle information acquisition unit 104 acquires for one or more target codes is not limited to the angle in the captured image, and may also acquire the angle at which the target code is arranged in real space. The angle at which the target code is arranged in real space is, for example, the angle at which the target code is arranged in the plane in which the target code is arranged in real space. For example, the captured image received by the image reception unit 100 is corrected by projective transformation so that it becomes an image corresponding to an image captured from a direction perpendicular to the target code, and the corrected captured image is corrected by the target code. By specifying the angle at which the target code is arranged, the angle at which the target code is arranged in real space may be obtained. In this case, for example, the direction that serves as a reference for the angle indicated by the reference object is also acquired from the corrected captured image. Corrections for captured images include, for example, making corrections such that one or more codes in the captured image have a shape with the same aspect ratio as the original code, or changing the direction indicated by the reference object to the width and width of the captured image. This is a correction to match a predetermined direction such as a direction or a vertical direction. In addition, using virtual reality technology, etc., we acquire from the captured image the direction that indicates the specific orientation of the target code in real space and the direction that serves as a reference for the angle at which the target code is arranged. The angle at which the target code is arranged in real space may be obtained using the following method. For example, by using virtual reality technology, it is possible to obtain the direction of real space, etc. from the code in the captured image. The angle reference direction may be a horizontal direction or a vertical direction in real space, or may be a direction indicated by a reference object in real space.

The angle information acquisition unit 104 is capable of acquiring three or more different angles at which the target code is arranged, and preferably acquires information corresponding to each of the acquired angles. For example, the angle information acquisition unit 104 is capable of acquiring three or more different angles, and it is preferable that the information acquired corresponding to the different angles be mutually different information. For example, it is preferable that the angle information acquisition unit 104 acquires one of three or more different angles as the angle at which the target code is arranged, and acquires information corresponding to the acquired angle.

Note that the minimum unit of angle in which the target code acquired by the angle information acquisition unit 104 is arranged may be 1 degree, 10 degree, or 45 degree. , may be in units of 90 degrees, and the unit does not matter. The smallest unit of angle is, for example, an angle within a range of greater than 0 degrees and less than or equal to 180 degrees. For example, the angle information acquisition unit 104 may round down fractions of angles that are less than the minimum unit, may round up fractions of angles that are less than the minimum unit, and may round up fractions of angles that are greater than or equal to an arbitrary threshold value that are less than the minimum unit. Fractions of angles may be rounded down. Preferably, this threshold value is about half the minimum unit.

Next, a process in which the angle information acquisition unit 104 acquires angle correspondence information regarding the angle at which the target code acquired above is arranged will be described. For example, the angle information acquisition unit 104 associates the acquired target code with the angle at which it is arranged from a plurality of angle correspondence information stored in the angle information storage unit 107 or the like in correspondence with different angles. Detect and obtain angle correspondence information. Among the plurality of angle correspondence information stored in association with different angles, a plurality of angles may be associated with one angle correspondence information. As the plurality of angle correspondence information stored in association with different angles, for example, a plurality of angle correspondence information stored in correspondence with angle ranges may be used. In this case, the angle information acquisition unit 104 detects and acquires angle correspondence information associated with the range of angles including the angle at which the target code acquired by the angle information acquisition unit 104 is located from a storage unit (not shown). do. The ranges of the plurality of angles here are usually preferably ranges of angles that do not have mutually overlapping portions (i.e., angles), but may overlap. For example, if the angle at which the target code is arranged is the angle of an overlapping part, information corresponding to each of the overlapping values may be acquired.

The angle correspondence information may be any information. For example, the angle correspondence information may be information indicating whether the user corresponding to the corresponding target code is at work or not, or information indicating whether the user is entering the office. Further, the angle correspondence information may be information indicating whether the process, work, etc. corresponding to the corresponding target code has not been authenticated, is in the process of being authenticated, or has been authenticated. The user corresponding to the target code is, for example, the user indicated by the user identifier, which is read information read from the target code. The process or work corresponding to the target code is, for example, the process or work indicated by the process identifier or work identifier that is read information read from the target code. The process identifier is, for example, a process name or a character string assigned to the process. The work identifier is, for example, a work name or a character string assigned to the work.

For example, the angle information acquisition unit 104 acquires the angle at which each target code is arranged in units of 90 degrees for one or more target codes detected by the code detection unit 102, and stores the angle information in the angle information storage unit 107. The angle correspondence information associated with the angle acquired for each target code may be acquired from the angle correspondence information stored in association with angles in units of 90 degrees. In this case, the angle information acquisition unit 104 may acquire the same angle correspondence information as the angle correspondence information corresponding to 90 degrees and 270 degrees. In particular, if the target code is set so that the angle at which it is placed is 0 degrees when the top and bottom of the target code match the top and bottom of the captured image, and the target code is visually When the target code is placed on a visually recognizable plate, the angle information acquisition unit 104 determines whether the angle at which the target code detected by the code detection unit 102 is placed is 90 degrees or 270 degrees. The same angle correspondence information may be acquired from time to time.

For example, in the above case, the target code is placed at an angle of 0 degrees, and the target code is placed with the plate rotated 180 degrees (the plate is placed upside down). The difference in the angle at which the code is placed can be visually recognized relatively easily, but there are cases where the target code is rotated 90 degrees from the 0 degree position, and when the target code is rotated 90 degrees with the plate and - In many cases, it is difficult to immediately visually distinguish the difference in the angle at which the target code is arranged compared to when the target code is arranged rotated by 90 degrees. For example, it is difficult to immediately distinguish whether the upper part of the plate is located on the left or the right, in which case the target code is rotated by 90 degrees. Therefore, if the angle at which the target code is placed is 90 degrees and the angle at which it is placed at 270 degrees, and different information is obtained for each case, it is possible for the user to place the target code in the wrong rotation direction. There is a possibility that unintended information may be obtained by For this reason, assuming that the angle correspondence information obtained when the target code is placed at an angle of 90 degrees and 270 degrees is the same information, if the angle at which the target code is placed is 90 degrees and 270 degrees, By not distinguishing between the two, it is possible to prevent incorrect angle correspondence information from being acquired due to an error in the angle at which the target code is placed.

It does not matter how the angle information acquisition unit 104 acquires the same angle correspondence information as the angle correspondence information corresponding to 90 degrees and 270 degrees. For example, in the angle correspondence information stored in the angle information storage unit 107 in association with angles in units of 90 degrees, by making 90 degrees and 270 degrees correspond to the same angle correspondence information, , the same angle correspondence information may be acquired as the angle correspondence information corresponding to 90 degrees and 270 degrees. Further, even when the acquired angle is 270 degrees, the angle information acquisition unit 104 may read out the angle correspondence information stored in association with 90 degrees. Further, when the angle at which the target code is arranged is 270 degrees, 90 degrees may be acquired as the angle at which the target code is arranged.

Note that the angle information acquisition unit 104 acquires the angle at which each target code is arranged in units of 90 degrees for one or more target codes detected by the code detection unit 102, and also acquires the angle at which each target code is arranged in units of 90 degrees and 270 degrees. The same angle correspondence information is acquired as the angle correspondence information corresponding to 0 degrees and 180 degrees, and the same angle correspondence information that is different from the information corresponding to 90 degrees and 270 degrees is acquired as the angle correspondence information corresponding to 0 degrees and 180 degrees. Information may also be acquired. In this case, for example, the angle information acquisition unit 104 only needs to be able to acquire either 0 degrees or 90 degrees as the angle at which the target code is arranged. As a direction to be used as a reference, a direction in which the top and bottom or left and right cannot be identified, such as a longitudinal direction or a lateral direction (however, if the target code, photographed image, etc. has a longitudinal direction) may be acquired.

In the following, the angle information acquisition unit 104 converts the angle correspondence information corresponding to the angle at which the target code is arranged into the angle or range of angles at which the target code stored in the angle information storage unit 107 is arranged. , angle correspondence information, and the like, will be described by taking as an example a case where the angle management information is acquired by searching or the like.

Note that the process by which the angle information acquisition unit 104 acquires the angle at which the target code is arranged is not limited to the above process. For example, the angle at which the target code is arranged may be obtained by pattern matching such as the shape of the target code. For example, if the target code has a longitudinal direction, the shape of the target code in the captured image is closer to either the case where the angle at which it is arranged is 0 degrees or the case where it is arranged at 90 degrees. It is also possible to determine the angle by pattern matching and obtain the angle determined to be close.

The output unit 105 outputs the reading information acquired by the reading acquisition unit 103 and the angle correspondence information acquired by the angle information acquisition unit 104 for one or more target codes detected by the code detection unit 102. For example, the output unit 105 outputs the information acquired by the reading acquisition unit 103 and the information corresponding to the angle acquired by the angle information acquisition unit 104 in association with each other for each code.

Further, the output unit 105 may also output information read by the reading acquisition unit 103 from codes other than the target code. For example, information read from a code other than the target code placed at a position corresponding to the target code may be output in association with the read information and angle correspondence information acquired for the target code.

Note that the output unit 105 may acquire and output information corresponding to the combination of the reading information acquired by the reading acquisition unit 103 and the angle correspondence information acquired by the angle information acquisition unit 104 from a storage unit (not shown). good. In this case, one or more combinations of information acquired by the reading acquisition unit 103 and information corresponding to the angle acquired by the angle information acquisition unit 104 are associated with information corresponding to this combination in a storage unit (not shown). From this information, the information corresponding to the combination of the information acquired by the reading acquisition unit 103 and the information corresponding to the angle acquired by the angle information acquisition unit 104 is detected and output. Bye.

Note that the output unit 105 outputs the device identifier (not shown) of the code processing device 1 that transmits these information and the user identifier of the user who uses the code processing device 1 to the read information and angle correspondence information. They may be output (for example, transmitted) in association with each other. The device identifier is, for example, a unique character string assigned to the code processing device 1, a serial number of the code processing device 1, a MAC address of the code processing device 1, or the like. The user identifier is a character string assigned to the user, the user's employee number, the user's e-mail address, or the like.

Output here means displaying on a monitor, etc., projecting using a projector, printing on a printer, outputting sound, sending to an external device, storing on a recording medium, sending to other processing devices or other programs, etc. This concept includes the delivery of processing results.

The output unit 105 may or may not include an output device such as a monitor and a speaker. The output unit 105 can be realized by output device driver software, output device driver software and the output device, or the like.

The reading information storage unit 106 stores one or more pieces of reading management information. The reading management information is information that includes an identifier read from the code and reading information. The read information storage unit 106 is preferably a non-volatile recording medium, but it can also be realized by a volatile recording medium. This also applies to other storage units.

The angle information storage unit 107 stores one or more pieces of angle management information. The angle management information is information including one or more angles at which the code is arranged and angle correspondence information. The two or more angles included in one angle correspondence information may be a range of angles. That is, the angle management information may be information including an angle range and angle correspondence information.

Next, an example of the operation of the code processing device 1 will be described using the flowchart of FIG.

(Step S100) The photographing unit 101 determines whether to photograph an area in which one or more target codes are arranged. For example, the imaging unit 101 determines to perform imaging if it receives an operation to perform imaging from the user via an operation receiving unit (not shown), and determines not to perform imaging if it does not. If photographing is to be performed, the process proceeds to step S101, and if not, the process is returned to step S100.

(Step S101) The photographing unit 101 photographs a region in which one or more target codes are arranged, and obtains a photographed image. The photographing unit 101 may photograph an area in which a code including one or more codes other than the target code, such as a reference code, in addition to the one or more target codes is further arranged. Note that the photographing unit 101 may appropriately perform correction such as projective transformation on the photographed image so that it becomes an image corresponding to an image photographed from a photographing direction perpendicular to the target code. The photographing direction is, for example, the optical axis direction of a lens (not shown) of the photographing unit 101, for example.

(Step S102) The image receiving unit 100 receives the photographed image acquired by the photographing unit 101.

(Step S103) The code detection unit 102 detects one or more target codes from the captured image received in step S102. If the photographed image is an image in which codes other than the target code, such as a reference code, are also photographed, the code detection unit 102 also detects codes other than these target codes.

(Step S104) The reading acquisition unit 103 reads one or more target codes detected in step S103 and acquires reading information. For example, the reading acquisition unit 103 reads each target code, acquires an identifier corresponding to the target code, and transfers the reading information corresponding to the acquired identifier to a plurality of reading management information stored in the reading information storage unit 106. Get from. Whether or not the code is a target code can be determined based on information such as an identifier read from the code, for example. For example, if the information read from a code matches one of the information that can be read from one or more pre-specified target codes, or if the information read from a code is a predetermined target code. A code can be determined to be a target code if the code has information indicating that the code is a target code, or if information such as a hash value generated using information obtained by reading the code is a value indicating that the code is a target code. Note that if the identifier read from the code by the reading acquisition unit 103 is the identifier of the reference code, this code is detected as the reference code. Whether or not it is a reference code can be determined, for example, by making the same determination as whether or not it is a target code. Information may also be read from codes other than the target code and reference code. Note that the reading acquisition unit 103 may read the detected code every time the code detection unit 102 detects one code.

(Step S105) The reading acquisition unit 103 stores the reading information acquired for each target code in step S104 in a storage unit (not shown) in association with the target code detected in step S103. The accumulation here may be temporary memory. Information read from codes other than the target code may also be stored in association with each code.

(Step S106) The angle information acquisition unit 104 determines whether the reference code was detected in step S104. If the reference code is detected, the process proceeds to step S107; if not detected, the process proceeds to step S108.

(Step S107) The angle information acquisition unit 104 uses the reference code detected in step S104 to acquire a reference direction for acquiring the angle at which the target code is arranged. The reference direction is, for example, a direction indicating a specific orientation of the reference code. This direction is, for example, a direction within the photographed image. Then, the process advances to step S109.

(Step S108) The angle information acquisition unit 104 acquires a reference direction for acquiring the angle at which the target code is arranged from the photographed image without using an image of the reference target or the like. For example, the right direction of the photographed image, that is, the direction from the left side to the right side of the photographed image, or the positive direction of the x-axis set in a normal photographed image is acquired as the reference direction.

(Step S109) The angle information acquisition unit 104 assigns 1 to the counter m.

(Step S110) The angle information acquisition unit 104 determines whether there is an m-th target code among the target codes detected in the photographed image. If there is, the process advances to step S111; if not, the process advances to step S116.

(Step S111) The angle information acquisition unit 104 acquires, for the m-th target code, a predetermined direction specified in this target code. The direction here is, for example, a direction within a captured image.

(Step S112) The angle information acquisition unit 104 uses the predetermined direction specified in the m-th target code acquired in step S111 and the reference direction acquired in step S107 or step S108 to Get the angle at which the th target code is placed. For example, obtain the angle formed by these two directions.

(Step S113) The angle information acquisition unit 104 uses the angle acquired in step S112 to acquire angle correspondence information corresponding to the m-th target code. For example, the angle information acquisition unit 104 searches the angle information storage unit 107 for angle management information having an angle that matches the angle acquired in step S112 or a range of angles that includes the acquired angle, and Obtain angle correspondence information included in the information.

(Step S114) The angle information acquisition unit 104 accumulates the angle correspondence information acquired in step S113. For example, the angle information acquisition unit 104 associates the angle correspondence information acquired in step S113 with the read information corresponding to the m-th target code in a storage unit (not shown) that has accumulated the read information in step S105. Accumulate (eg, add).

(Step S115) The angle information acquisition unit 104 increments the value of the counter m by 1. Then, the process returns to step S110.

(Step S116) The output unit 105 outputs the reading information and angle correspondence information acquired for the target code in step S104 and step S113. For example, the reading information and angle correspondence information accumulated in association with each code in step S105 and step S114 are output. Note that the output unit 105 may also output information read regarding codes other than the target code in step S104. Then, the process ends.

Note that if it is determined in step S106 that there is no reference code, a reference object such as a ruled line may be detected from the photographed image, and the reference direction may be obtained using this reference object.

Hereinafter, the specific operation of the code processing device 1 in this embodiment will be explained by giving an example.

FIG. 3 is a diagram for explaining the code processing device 1 of the present embodiment, and is a diagram showing an example of the code processing device 1 and a progress management board 30 on which the target code to be photographed by the code processing device 1 is arranged. It is. It is assumed that the progress management board 30 is a board on which target codes are placed for managing the progress status of work of a plurality of users working in a certain department of a company. Here, an example in which the progress management board 30 is hung on a wall will be described.

FIGS. 4A and 4B are diagrams for explaining target codes placed on the progress management board 30.

The progress management board 30 is a board made of a ferromagnetic material such as iron to which a magnet or the like can be detachably attached. A so-called magnetic sheet plate having a code arranged on its surface is removably attached to the progress management board 30. Here, it is assumed that a plurality of plates 31a to 31e, each having a plurality of target codes 32a to 32e arranged thereon, are attached to the progress management board 30. It is assumed that the identifiers read from each of the target codes 32a to 32e are associated with a work name. Note that when each of the plates 31a to 31e is referred to without distinction, they may be simply referred to as plate 31. Further, when each of the target codes 32a to 32e is called without distinguishing them, they may be simply called the target code 32. The target code 32 is assumed to be a rectangular color code in which square cells of a plurality of colors are arranged vertically and horizontally at desired intervals, as shown in FIG. 4(a). It is assumed that the plate 31 also has a rectangular shape, and the longitudinal direction of the plate 31 coincides with the longitudinal direction of the target code 32. On each plate 31 arranged so that the longitudinal direction is the left-right direction, a character string 33 representing the work name corresponding to the object code 32 is arranged to the right of the area where the object code 32 is arranged. It is assumed that the vertical direction and horizontal direction of this character string 33 match the vertical direction and horizontal direction of the target code 32 arranged on the same plate 31. It is assumed here that the direction of each plate 31 from the target code 32 toward the character string is the right direction of the plate 31 and the target code 32.

In addition to the plates 31a to 31e, a plate 35 having a reference code 34 arranged on its surface is detachably attached to the progress management board 30. It is assumed that the reference code 34 is also a color code similar to the target code 32.

On the progress management board 30, the names of multiple users are arranged from top to bottom on the left side of the surface, and the name of the work each user is responsible for is displayed to the right of each user's name. It is assumed that one of the plates 31a to 31e on which the associated target codes 32a to 32e are arranged is arranged. As a result, the names and plates 31a to 31e corresponding to multiple users are arranged in order from the top, and depending on the order in which the target codes 32 are arranged from the top, the target code 32 corresponds to which user. Assume that it is possible to determine whether there is a Further, it is assumed that a horizontally extending ruled line 38 is placed between the user names.

For example, when a plurality of users return home after their working hours, they attach a plate 31 on which the name of the work they have performed is placed next to each user's name on the progress management board 30. . At this time, if the performed work is not completed, the plate 31 on which the corresponding work name is arranged is attached so that the right side of the plate 31 faces the right side of the progress management board 30. Further, when the work is completed, the plate 31 is attached so that the right side of the plate 31 faces upward of the progress management board 30. In this case, the user placing the plate 31d mistakenly placed the plate 31d so that the right side was facing upward, to indicate that the work was completed, but the right side was facing downward. Suppose you installed it like this.

When a plate 31 indicating that a task has been completed is placed on the progress management board 30, the administrator of multiple users can check whether the task indicated by the task name placed on each plate 31 has been completed or not. Check whether or not. And if done, leave the plate alone. If it is determined that the work is not completed, the plate 31 is reattached to the progress management board 30 so that the right side of the plate 31 faces to the left.

It is assumed that FIG. 3 shows the progress management board 30 in a state in which such confirmation work and the like have been completed.

It is assumed that the administrator photographs the progress management board 30 using the code processing device 1 after confirming the above. When photographing, it is assumed that the upper side of the progress management board 30 is positioned above the photographed image. Here, it is assumed that the code processing device 1 is a so-called smartphone having a camera as the photographing section 101. It is assumed that a lens (not shown) of the photographing section 101 is provided on the back side of the code processing device 1.

FIG. 5 is a diagram showing a photographed image 40 obtained by photographing the progress management board 30 by the photographing unit 101. It is assumed that the photographed image 40 is an image whose longitudinal direction is the vertical direction.

FIG. 6 is a diagram showing a reading management table that manages the reading management information stored in the reading information storage unit 106. The read management table has attributes of "identifier" and "information". The "identifier" is an identifier corresponding to the identifier read from the target code. "Information" indicates read information, and here indicates the work name. Each record (row) of the reading management table indicates each piece of reading management information.

The image receiving unit 100 receives the photographed image 40 shown in FIG. 5 acquired by the photographing unit 101. The code detection unit 102 detects the target code 32 and the reference code 34 in the captured image 40. Here, the target codes 32a to 32e and the reference code 34 are detected in the photographed image 40.

The reading acquisition unit 103 reads the target code detected by the code detection unit 102 and acquires an identifier. First, a code whose identifier indicating that it is a standard code is read is determined to be a standard code. Next, for each identifier read from the target code 32 other than the reference code, the work name, which is the corresponding read information, is acquired from the read management information stored in the read information storage section 106. For example, in the read management table shown in FIG. , acquired as read information corresponding to each target code 32. The acquired reading information is stored in a storage unit (not shown) in association with each target code 32. Here, the value of the arrangement order from the top in the captured image of the target code 32 whose identifier has been read is obtained, and the read information is stored in association with the obtained arrangement order value.

For example, the reading acquisition unit 103 reads the target code 32a placed at the top of the captured image 40 other than the reference code 34, and acquires the identifier. Assuming that the acquired identifier is "J002", the reading acquisition unit 103 further detects a record (row) whose "identifier" value is "J002" in the reading management table shown in FIG. Get the "Packaging" value of "Information" of the record. Then, it is stored in a storage unit (not shown) in association with the value "1" indicating the arrangement order from the top of the target code 32a. Further, when the reading acquisition unit 103 reads the second target code 32b from the top and acquires the identifier "J004", the value of "identifier" in the reading management table shown in FIG. 6 is changed to "J004". From the record (row) that is, obtain the "sort" which is the value of "information". Then, it is stored in a storage unit (not shown) in association with the value "2" indicating the arrangement order from the top of the target code 32b. Similar processing is performed for all of the target codes detected above.

FIG. 7 is a diagram showing an angle management table for managing angle management information stored in the angle information storage unit 107. The angle management table has attributes of "angle" and "correspondence information." "Angle" corresponds to the angle at which the target code is arranged, and here, a value in units of 90 degrees within a range of 0 degrees or more and less than 360 degrees is stored. "Correspondence information" is angle correspondence information, and here, a value indicating the progress of the work is stored.

Next, the angle information acquisition unit 104 detects the longitudinal direction of the reference code 34 from the reference code 34, and in the detected longitudinal direction, the direction toward the right side of the photographed image 40 is detected when detecting the angle. Obtained as the right direction, which is the reference direction. An arrow 44 in FIG. 5 indicates a reference direction. The longitudinal direction of the reference code 34 is, for example, a direction parallel to the side with the largest number of cells of the code 34 arranged in a matrix so that the colored cells are rectangular. Note that the right direction may be obtained by detecting the up, down, left and right directions of the reference code 34.

Next, the angle information acquisition unit 104 detects the right direction, which is a direction indicating a specific orientation of the target code 32, for each of the target codes 32 other than the reference code 34 among the codes detected by the code detection unit 102. Then, the angle formed by the right direction of the detected target code 32 and the right direction of the reference code 34, which is the reference direction of the angle indicated by the arrow 44 obtained from the reference code 34 above, is obtained. Then, the angle correspondence information corresponding to the acquired angle is acquired using the angle management table shown in FIG. 7, and the acquired angle correspondence information is associated with the corresponding target code and stored in a storage unit (not shown). . Here, as in the case of read information, the value of the arrangement order from the top in the photographed image 40 of the target code 32 whose arranged angle has been obtained is obtained, and the value of the arrangement order is correlated with the obtained arrangement order value. Accumulate angle correspondence information.

For example, the angle information acquisition unit 104 detects the right direction, which is a direction indicating a specific orientation of the target code 32a, for the target code 32a placed at the top in the photographed image 40. An arrow 42a indicates the right direction of the detected target code 32a. Then, the angle between the right direction of the target code 32a and the right direction of the reference code 34, which is the reference direction indicated by the reference code 34, is obtained in units of 90 degrees. First, the angle information acquisition unit 104 acquires the angle that the right direction of the target code 32a indicated by the arrow 42a makes with respect to the right direction of the photographed image. Similarly, the angle that the right direction indicated by the arrow 44 of the reference code 34 makes with respect to the right direction of the photographed image is obtained. Then, the rightward angle of the reference code 34 is subtracted from the rightward angle of the target code 32a. The value obtained by the subtraction is appropriately converted into a value of 0 degrees or more and less than 360 degrees, with the right direction of the reference code 34 being 0 degrees. Further, the angle in units of 90 degrees that is closest to the angle obtained by the subtraction is acquired as the angle at which the target code 32a is arranged. For example, if the angle obtained by subtraction is greater than or equal to 0 degrees and less than 45 degrees, "0 degrees" will be obtained; if the angle obtained by subtraction is greater than or equal to 45 degrees and less than 135 degrees, "90 degrees" will be obtained; If it is less than 315 degrees, "180 degrees" is acquired; if it is 225 degrees or more and less than 315 degrees, "270 degrees" is acquired; if it is 315 degrees or more and less than 360 degrees, "0 degrees" is acquired. Here, for example, if the angle obtained by subtraction is "10 degrees", the value is greater than or equal to 0 degrees and less than 45 degrees, so "0 degrees" is obtained as the angle at which the target code 32a is arranged. .

The angle information acquisition unit 104 searches for records (rows) in which the value of "angle" is "0 degree" acquired above in the angle management table shown in FIG. 7, that is, the detected record by searching for angle management information. The value of "correspondence information" "in progress" is acquired as the angle correspondence information corresponding to the angle at which the target code 32a is arranged. Then, the acquired angle correspondence information is stored in a storage unit (not shown) in association with a value "1" indicating the arrangement order from the top of the target code 32a. Here, among the reading information stored in association with the arrangement order of the target code 32 above, the reading information stored in association with the value "1" indicating the same arrangement order is Accumulate information.

Similarly, the angle information acquisition unit 104 detects the right direction from the target code 32b placed second from the top other than the reference code 34 in the photographed image 40. An arrow 42b indicates the right direction of the target code 32b detected by the angle information acquisition unit 104. Then, the angle in units of 90 degrees between the right direction of the target code 32a and the right direction of the reference code 34, which is the reference direction indicated by the reference code 34, is obtained. Here, if "90 degrees" is acquired as the angle at which the target code 32b is arranged, the angle information acquisition unit 104 determines that the value of "Angle" in the angle management table shown in FIG. 7 is "90 degrees". "Work completed" which is the value of the "correspondence information" of the record (row) is acquired as the angle correspondence information corresponding to the angle at which the target code 32b is arranged. Then, the obtained angle correspondence information is stored in a storage unit (not shown) in association with the value "2" indicating the arrangement order from the top of the target code 32b. Here, the angle correspondence information is stored in association with the read information stored in association with the value "2" indicating the same arrangement order.

Similar processing is performed for all of the target codes detected above. For example, for the third target code 32c from the top, the direction indicated by the arrow 42c is detected as the right direction, 180 degrees is obtained as the angle at which the target code 32c is arranged, and the angle correspondence information corresponding to this is obtained. A certain "work incomplete" is acquired and stored in a storage unit (not shown) in association with the value "3" indicating the arrangement order from the top of the target code 32c.

For example, for the fourth target code 32d from the top, the direction indicated by the arrow 42d is detected as the right direction, 270 degrees is obtained as the angle at which the target code 32d is arranged, and the angle corresponding to this is obtained. The information "work incomplete" is acquired and stored in a storage unit (not shown) in association with the value "4" indicating the arrangement order from the top of the target code 32d.

For example, for the fifth target code 32e from the top, the direction indicated by the arrow 42e is detected as the right direction, 0 degrees is obtained as the angle at which the target code 32e is arranged, and the angle correspondence information corresponding to this is obtained. "Work in progress" is acquired and stored in a storage unit (not shown) in association with the value "5" indicating the arrangement order from the top of the target code 32e.

Note that here, the angle correspondence information acquired for the target code 32b whose arranged angle is 90 degrees and the angle correspondence information acquired about the target code 32d whose arranged angle is 270 degrees are the same information. The work is complete.'' For example, if information that allows the user to visually recognize the orientation of the target code 32, such as a character string 33 placed adjacent to the target code 32, is provided, the user will need information that visually indicates this orientation. From this, it can be easily determined whether the top of the plate 31 on which the target code 32 is placed is facing either the top or bottom of the progress management board 30. It is difficult to immediately determine whether the display is tilted or tilted 90 degrees to the left. For example, the placement of the target code 32b and the placement of the target code 32d often feel like the same 90-degree placement to the user, and when placing the target code 32, it is difficult to distinguish between them. difficult to do. For this reason, the user mistakenly placed the plate 31 on which the target code 32 for the completed work, which should originally be placed with the right side facing the top of the progress management board 30, was placed with the right side facing downward. It is conceivable that you may end up placing the However, as in this specific example, the same angle correspondence information is obtained whether the angle at which the target code 32 is arranged is 90 degrees or 270 degrees. By not distinguishing between 90 degrees and 270 degrees, the user may mistakenly place the completed work with the right side facing upwards on the progress management board 30. Even if the code 32 is placed with the right side facing downward, information indicating that the work is completed is obtained as in the case where the code 32 is placed with the right side facing upward. be able to. Note that by not distinguishing between 90 degrees and 270 degrees, in this specific example, it is possible to obtain substantially three different angles as the angles at which the target code 32 is arranged.

FIG. 8 shows the correspondence between the reading information acquired by the reading acquisition unit 103 that has the corresponding target codes 32 stored in a storage unit (not shown) in the same arrangement order, and the angle correspondence information acquired by the angle information acquisition unit 104. This is an acquired information management table that is managed by The reading information managed by this acquisition information management table is the reading information accumulated by the reading acquisition unit 103 as described above, and the angle correspondence information managed by this acquisition information management table is the reading information accumulated by the angle information acquisition unit 104 as described above. This is the angle correspondence information. The acquisition information management table has attributes of "order", "reading", and "angle correspondence".

As shown in FIG. 8, when reading information and angle correspondence information are acquired for all the target codes 32 detected by the code detection unit 102, the output unit 105 converts the acquired reading information and angle correspondence information into these information. is output in association with the target code 32 corresponding to . Here, the value of the arrangement order of the target code 32 and the value of the arrangement order from the top of the user names arranged on the right side of the progress management board 30 are the same as the value of the arrangement order of the target code 32. When outputting the read information and the angle correspondence information stored in correspondence with the target code 32 in one arrangement order, , the name information corresponding to this arrangement order is read out and output in association with each other. As a result, for example, the read information and angle correspondence information of a record (row) whose "order" is "1" in the acquired information management table in FIG. 8 are arranged on the right side of the progress management board 30. Among the user names, the first name from the top is output in correspondence, and for the read information and angle correspondence information of the record (row) whose "order" in the acquisition information management table is "2": , among the names of the users on the right side of the progress management board 30, the second name from the top is output in association.

The output unit 105 transmits, for example, information in which the reading information, the angle correspondence information, and the user's name corresponding to the target code 32 are associated with each other to a server device (not shown) that manages the user's progress status. . From the output information, it is possible to understand, for example, the name of the work the user is doing (for example, packing, sorting, etc.) and the progress status of this work (for example, work in progress, work completed, etc.).

In the above specific example, a case has been described in which a character string is arranged in the target code 32 as information that allows the orientation to be visually recognized. However, as shown in FIG. 4(b), instead of the character string, On the upper side of the plate 31 above the target code 32, a band-shaped mark 36 or the like may be arranged along the upper side.

Further, in the above description, the case where the angle at which the target code 32 is arranged is acquired in units of 90 degrees has been described as an example, but as described above, the unit of acquiring the angle is not limited. For example, a value indicating the difference between the angle formed by a pre-specified direction acquired for the target code 32 and a reference direction acquired from the reference code 34 etc. is used as the angle at which the target code 32 is arranged. Good too. Further, as in the case where such an angle difference is used, the value of the angle at which the target code 32 acquired by the angle information acquisition unit 104 is arranged is different from 90 degrees, etc., but is in fine units such as 1 degree. In such cases, the angle management information is preferably information including an angle range and angle correspondence information. Then, when the angle information acquisition unit 104 acquires the angle at which the target code 32 is arranged, it searches for angle management information having a range of angles that include this angle, and searches for angle management information that has an angle range that includes this angle. Information may also be acquired.

Further, in the above specific example, the reference code 34 is used to detect the reference direction of the angle at which the target code 32 is arranged, but one or more ruled lines extending in the horizontal direction are used as the reference target. 38 may be detected, and the direction in which the ruled line 38 extends may be used to detect a direction that serves as a reference for the angle, for example, the right direction or the left direction.

In addition, in the above specific example, an example was explained in which the name of the user corresponding to the target code 32 is obtained by using the arrangement order from the top of the target code 32. By placing codes different from the target code 32 associated with the user's name, etc. in the direction (for example, to the left) that corresponds to the target code 32, use these codes. The corresponding user's name, etc. may also be acquired. Note that, similar to the process of identifying the target code 32, these codes may be identified with respect to the code 32 and the reference code 34 using information read from the code.

As described above, according to the present embodiment, in addition to the information obtained by reading the target code, information corresponding to the angle at which the target code is placed can be obtained from the captured image, so when placing the target code, Desired information can be easily added to the target code.

In each of the above embodiments, each process (each function) may be realized by being centrally processed by a single device (system), or may be realized by being distributed by multiple devices. may be done.

Further, in each of the above embodiments, a case has been described in which the code processing device is a standalone device, but the code processing device may be a standalone device or a server device in a server/client system. In the latter case, the output unit and reception unit will accept input via a communication line and output a screen.

Further, in each of the embodiments described above, each component may be configured by dedicated hardware, or components that can be realized by software may be realized by executing a program. For example, each component can be realized by a program execution unit such as a CPU reading and executing a software program recorded on a recording medium such as a hard disk or a semiconductor memory. At the time of execution, the program execution section may execute the program while accessing a storage section (for example, a recording medium such as a hard disk or a memory).

Note that the software that implements the code processing device in each of the above embodiments is the following program. In other words, this program connects a computer to an image reception section that receives a captured image of one or more codes, a code detection section that detects a code from the captured image received by the image reception section, and one code detected by the code detection section. a reading acquisition section that reads the above codes and acquires information; and an angle information acquisition section that acquires the angle at which one or more codes detected by the code detection section are arranged and acquires information corresponding to the acquired angle. , is a program for functioning as an output unit that outputs information acquired by the reading acquisition unit regarding one or more codes detected by the code detection unit, and information corresponding to the angle acquired by the angle information acquisition unit.

Note that in the above program, the functions realized by the program do not include functions that can only be realized by hardware. For example, functions that can only be realized by hardware such as a modem or an interface card in an acquisition unit that acquires information, an output unit that outputs information, etc. are not included in the functions that are realized by the above program.

Further, the number of computers that execute this program may be one or more. That is, centralized processing or distributed processing may be performed.

FIG. 9 is a diagram showing an example of a computer system 900 that executes the program described above to realize the code processing device according to the embodiment described above. The above embodiments can be implemented by computer hardware and a computer program executed on the computer hardware.

In FIG. 9, a computer system 900 is connected to an MPU (Micro Processing Unit) 911, a ROM 912 such as a flash memory in which programs such as a boot-up program, application programs, system programs, and data are stored, and the MPU 911. It includes a RAM 913 that temporarily stores instructions of an application program and provides a temporary storage space, a touch panel 914, a wireless communication module 915, and a bus 916 that interconnects the MPU 911, ROM 912, and the like. Note that instead of the wireless communication module 915, a wired communication module may be provided. Further, instead of the touch panel 914, a display and an input device such as a mouse or a keyboard may be provided.

A program that causes the computer system 900 to execute the functions of the code processing device according to the embodiment described above may be stored in the ROM 912 via the wireless communication module 915. The program is loaded into RAM 913 during execution. Note that the program may be loaded directly from the network.

The program does not necessarily need to include an operating system (OS) or a third party program that causes computer system 900 to execute the functions of the code processing device according to the above embodiment. A program may include only those portions of instructions that call appropriate functions or modules in a controlled manner to achieve desired results. How computer system 900 operates is well known and will not be described in detail.

It goes without saying that the present invention is not limited to the above-described embodiments, and that various modifications can be made, and these are also included within the scope of the present invention.

As described above, the code processing device or the like according to the present invention is suitable as a device for reading code information, and is particularly useful as a device for reading code information from a photographed image.

1 Code processing device 100 Image receiving section 101 Photographing section 102 Code detecting section 103 Reading acquisition section 104 Angle information acquisition section 105 Output section 106 Reading information storage section 107 Angle information storage section

Claims (7)

an image reception unit that accepts captured images of one or more codes;
a code detection unit that detects a code from the captured image received by the image reception unit;
a reading acquisition unit that reads one or more codes detected by the code detection unit and acquires information;
an angle information acquisition unit that acquires an angle at which one or more codes detected by the code detection unit is arranged, and acquires information corresponding to the acquired angle;
an output unit that outputs information acquired by the reading acquisition unit regarding one or more codes detected by the code detection unit and information corresponding to the angle acquired by the angle information acquisition unit ,
The image receiving unit further receives a captured image of a reference object indicating a reference direction of an angle when the angle information obtaining unit obtains the angle at which the code is arranged;
The angle information acquisition unit determines, as the angle at which the code detected by the code detection unit is arranged, a relative angle between a direction indicated by a reference object in the captured image and a direction indicating a specific orientation of the code. Code processing device to obtain . The code processing device according to claim 1, wherein the angle information acquisition unit is capable of acquiring three or more different angles at which the code is arranged, and acquires information corresponding to each of the acquired angles. 3. The code processing device according to claim 1 , wherein the reference object is a code indicating the reference direction. 4. The image receiving unit according to any one of claims 1 to 3 , wherein the image receiving unit receives a photographed image of one or more plates on which a code is arranged, and the direction of the code can be visually recognized. Code processing device. 5. The code processing device according to claim 4 , wherein the angle information acquisition unit detects the angle at which each code is arranged in units of 90 degrees, and acquires the same information as information corresponding to 90 degrees and 270 degrees. A code processing method performed using an image reception unit, a code detection unit, a reading acquisition unit, an angle information acquisition unit, and an output unit, the code processing method comprising:
an image reception step in which the image reception unit receives a captured image of one or more codes;
a code detection step in which the code detection unit detects a code from the captured image received in the image reception step;
a reading acquisition step in which the reading acquisition unit reads one or more codes detected in the code detection step to acquire information;
an angle information acquisition step in which the angle information acquisition unit acquires an angle at which one or more codes detected in the code detection step are arranged, and acquires information corresponding to the acquired angle;
an output step in which the output unit outputs information acquired in the reading acquisition step and information corresponding to the angle acquired in the angle information acquisition step regarding one or more codes detected in the code detection step; ,
The image receiving step receives a photographed image of a reference object indicating a reference direction of the angle when the angle at which the code is arranged is obtained in the angle information obtaining step;
The angle information acquisition step determines, as the angle at which the code detected in the code detection step is arranged, the relative angle between the direction indicated by the reference object in the captured image and the direction indicating the specific orientation of the code. How to process the code to get . computer,
an image reception unit that accepts captured images of one or more codes;
a code detection unit that detects a code from the captured image received by the image reception unit;
a reading acquisition unit that reads one or more codes detected by the code detection unit and acquires information;
an angle information acquisition unit that acquires an angle at which one or more codes detected by the code detection unit is arranged, and acquires information corresponding to the acquired angle;
Functioning as an output unit that outputs information acquired by the reading acquisition unit regarding one or more codes detected by the code detection unit and information corresponding to the angle acquired by the angle information acquisition unit ,
The image receiving unit further receives a captured image of a reference object indicating a reference direction of an angle when the angle information obtaining unit obtains the angle at which the code is arranged;
The angle information acquisition unit determines, as the angle at which the code detected by the code detection unit is arranged, a relative angle between a direction indicated by a reference object in the captured image and a direction indicating a specific orientation of the code. Program to obtain .

Images