JP6722438B2 - Information processing apparatus, information processing method, and program - Google Patents

Description

The present invention relates to an information processing device or the like that creates information for managing articles.

As a conventional technology, a storage location information database is constructed based on the read data of the barcode label attached to the storage location of each product that was read by the barcode reader at the time of storage and is attached to each product. It is known that a product information database is constructed based on the read data of the barcode label. (For example, refer to Patent Document 1).

Japanese Unexamined Patent Publication No. 2000-90180 (page 1, FIG. 1, etc.)

However, in the conventional technology, the product information database, the storage information database, and the like are created by individually reading the barcode labels attached to the products and the storage areas. There is a problem that information for management cannot be easily created.

The present invention has been made to solve the above problems, and an object of the present invention is to provide an information processing device and the like that can easily create information for managing the location of an article.

The information processing device of the present invention corresponds to one or more object codes that are codes arranged on an object and that are associated with an object identifier that is an identifier of this object, and a location identifier that is a location identifier. The attached display object and a captured image reception unit that receives a captured image that is a captured image, and one or more objects that are associated with one or more object codes in the captured image received by the captured image reception unit, respectively. An identifier, an identifier acquisition unit that acquires a location identifier associated with a display object in a captured image, one or more object identifiers acquired by the identifier acquisition unit, and a location identifier acquired by the identifier acquisition unit are associated with each other. And an identifier output unit that outputs the information.

With this configuration, it is possible to easily create information for managing the location of the article.

Further, in the information processing device of the present invention, in the information processing device, the display object is a location code that is a code associated with a location identifier, and the identifier acquisition unit is within the captured image received by the captured image reception unit. The information processing apparatus acquires a place identifier associated with the place code of.

With such a configuration, by arranging the place code at the place where the article exists, the information for managing the place where the article exists can be easily created. Further, by using the place code, the place reading accuracy can be improved.

Also, in the information processing apparatus of the present invention, in the information processing apparatus, the identifier acquisition unit is associated with an identifier indicating that the code in the captured image received by the captured image reception unit is an object code. In the information processing apparatus, the object identifier is acquired from the code, and the location identifier is acquired from the code when the object identifier is associated with the identifier indicating the location code.

With this configuration, the object identifier and the location identifier can be separately acquired using the information obtained by reading the code.

Further, in the information processing apparatus of the present invention, in the information processing apparatus, the identifier acquisition unit may select a location identifier or an object identifier from the code according to the position where the code is arranged in the captured image received by the captured image reception unit. Is an information processing device that acquires

With this configuration, the object identifier and the place identifier can be separately obtained according to the place where the code is arranged.

Further, in the information processing device of the present invention, in the information processing device, the display object has a character string indicating a location identifier, and the identifier acquisition unit recognizes the character string in the captured image received by the captured image reception unit. An information processing apparatus that obtains a location identifier by doing so.

With this configuration, the object identifier can be obtained from the code, the location identifier can be obtained from the character string, and the object identifier and the location identifier can be obtained separately.

Further, in the information processing apparatus of the present invention, in the information processing apparatus, one captured image received by the captured image reception unit is captured by a plurality of groups including one or more object codes and one display object. The identifier acquisition unit, based on the object code and the display object in the captured image, one or more object identifiers associated with one or more object codes for each set of a plurality of sets, and Of the one place identifier associated with the display object of, the identifier output unit, the identifier acquisition unit from the one or more object code and one display object included in the same set in one captured image, The information processing apparatus outputs one or more acquired object identifiers and one location identifier in association with each other.

With this configuration, it is possible to output the object identifier and the location identifier in association with each other.

According to the information processing apparatus and the like according to the present invention, it is possible to easily create information for managing the location of an article.

Block diagram of an information processing apparatus according to an embodiment of the present invention Flowchart explaining the operation of the information processing apparatus A schematic diagram showing a part of a bookshelf for explaining the operation of the information processing apparatus (FIG. 3A), and a diagram showing a color code (FIG. 3B). FIG. 4 is a diagram showing a captured image (FIG. 4A) and a diagram showing one or more regions where a code, an object code and a display object are arranged, for explaining the information processing apparatus (FIG. 4A). The figure which shows the book management table of the same information processing equipment The figure which shows the place management table of the same information processing equipment The figure which shows the object place management table of the same information processing equipment The figure which shows the picked-up image for explaining the same information processing apparatus (FIG. 8A), and the figure which shows the image of an object code and a character string. The figure which shows the object place management table of the same information processing equipment The figure which shows an example of the external appearance of the computer system in embodiment of this invention. The figure which shows an example of a structure of the computer system

Hereinafter, embodiments of an information processing apparatus and the like will be described with reference to the drawings. It should be noted that, in the embodiments, the components denoted by the same reference numerals perform the same operation, and thus the repetitive description may be omitted.

(Embodiment)
FIG. 1 is a block diagram of the information processing device 1 according to the present embodiment.

The information processing device 1 includes a photographed image reception unit 101, a photographing device 102, an identifier acquisition unit 103, an identifier storage unit 104, and an identifier output unit 105.

The captured image receiving unit 101 receives a captured image in which one or more object codes and a display object associated with a location identifier are captured. The object code is a code arranged on the object, and is a code associated with the object identifier of the object on which the object code is arranged. The code is a one-dimensional code such as a barcode, a two-dimensional code such as a QR code (registered trademark), or a color code. The color code is, for example, a code in which an array of a plurality of colors is associated with arbitrary information. The color code may be called a color barcode or a chameleon code, for example. The information associated with the code can be read from the code. The information associated with the code is, for example, a code identifier. The code may be thought of as, for example, a pattern image that represents information. Note that the code is associated with the object identifier means that, for example, the information read from the code may be the object identifier, and the identifier of the code read from the code is associated with the object identifier. It may be that you are. The same applies to the case where the code described later is associated with the location identifier. Since the color code is a known technique, detailed description thereof is omitted here. For the color code, refer to Patent Document 2 below, for example. Patent Document 2: Japanese Patent Application Laid-Open No. 2010-033034 (page 1, FIG. 1, etc.).

The object may be any object as long as the object code can be arranged. For example, the object is an article. For example, the object is a product or a product. The object identifier is an identifier of the object. The object identifier is, for example, a name of the object, a name, a manufacturing number assigned to the object, or a character string such as a product number or a product number. This character string may include numbers and symbols.

The placement of the object code on the object means, for example, that the object code is attached to the object or that the object code is printed or drawn on the object. The sticking of the object code on the object may mean, for example, that a sticker or a sheet on which the object code is printed is stuck on the object.

The display object is, for example, a character string composed of one or more characters associated with the location identifier. The character here is a concept including numbers and symbols. The character string that is the display object may be a character string that indicates a location identifier. Further, the display object may be a previously designated image such as a mark recognizable by the image recognition processing. Further, the display object may be, for example, a code associated with the location identifier. Hereinafter, the code associated with the location identifier will be referred to as a location code.

The place identifier is a place identifier. The location identifier is, for example, information that can identify the location. The location identifier is the name of the location where the object in which the object code is placed exists, or a character string assigned to the location. The location identifier may be coordinates or the like.

The location here is, for example, a location where an object exists. The location here may be a region or a single point. For example, the place may be a section such as a shelf where the object exists, or a room where the object exists.

The display object is usually arranged at a place where the object exists. The place where the display object is arranged is usually the place indicated by the location identifier associated with the display object. The place here may be, for example, a storage such as a shelf or a locker. In addition, the place may be a floor or a stand such as a room or a warehouse where the object exists. Also, the existence of an object may be considered as a concept including hanging of an object, for example, and the place where the object exists is a hanger or a hook to which the object is hung, or a wall to which these are attached. It may be a ceiling or the like. The location indicated by the location identifier associated with one or more display objects in one captured image is, for example, a location where an object in which one or more object codes are arranged in the same captured image exists.

For example, the display object is arranged on the top plate or partition plate of the shelf in which the object is stored, the front surface of the shelf plate, or the like. Further, the display object may be arranged on the floor or wall surface of the area where the object exists, the ceiling, a plate provided in the area, a sign, or the like. The arrangement of the display object may be, for example, sticking the display object, or drawing or writing the display object. Alternatively, a display device (not shown) such as a liquid crystal panel that displays a display object may be installed.

The captured image is, for example, an area in which one or more objects in which the object code is arranged and one or more display objects associated with the location identifier of the place in which the one or more objects exist are arranged. It is an image taken so that the code is taken.

The one captured image received by the captured image reception unit 101 may be, for example, one or two or more object codes and one or more captured images of the displayed object, and two or more object codes arranged in different locations. It may be a photographed image in which two or more display objects individually associated with the location identifiers of the different locations are captured, and one or more object codes and two or more display objects associated with the same location identifier. The captured image may be a captured image.

The one captured image received by the captured image receiving unit 101 may be, for example, an image in which a plurality of sets each including one or more object codes and one display object are captured. That is, one captured image may be an image in which a plurality of sets each including one or more object codes and one display object are captured.

The captured image receiving unit 101 receives, for example, a captured image captured by the image capturing apparatus 102 included in the information processing apparatus 1. Note that the captured image receiving unit 101 is captured by an image capturing apparatus (not shown) similar to the image capturing apparatus 102 provided outside the information processing apparatus 1 or an information processing apparatus (not shown) including the image capturing apparatus. The captured image transmitted by the above may be received. Further, the captured image receiving unit 101 may be a unit for receiving captured images captured by a capturing device (not shown) or the like and accumulated in a storage medium or the like. The photographed image may be considered as an image photographed by the photographing device 102 or the like having one or more object code images and one or more display object images, for example. In the following description of the present embodiment, an example is given in which the captured image receiving unit 101 receives a captured image captured by the image capturing apparatus 102.

One captured image received by the captured image receiving unit 101 may be a still image or a moving image. In addition, one captured image may be one or more frame images forming a moving image. The one captured image received by the captured image receiving unit 101 may be a color image, a grayscale image, or a binary image. However, when the object code or the like is a color code, the captured image is a color image.

The acceptance here means acceptance of information input from the photographing device 102 or the like, reception of information transmitted from a photographing device or the like (not shown) via a wired or wireless communication line, an optical disk, a magnetic disk, a semiconductor memory. Is a concept including acceptance of a captured image read from a recording medium such as. The captured image receiving unit 101 can be realized by a device driver such as an input unit, a receiving unit, a reading unit, or control software for a menu screen.

The image capturing device 102 captures a captured image. The image capturing device 102 is a camera such as a still camera or a video camera having an image sensor such as CCD or CMOS, or a scanner having a line sensor or the like. When the captured image receiving unit 101 receives a captured image captured by a device other than the capturing device 102, the capturing device 102 may be omitted.

The identifier acquisition unit 103 is associated with one or more object identifiers respectively associated with one or more object codes in the captured image received by the captured image reception unit 101 and display objects in the captured image. And the location identifier that was obtained.

For example, the identifier acquisition unit 103 detects the object code in the captured image and acquires the object identifier associated with the detected object code. The process of detecting an object code in an image and acquiring the object identifier associated with this object code is performed by detecting a one-dimensional code, a two-dimensional code, a color code, etc. from a still image or a moving image and corresponding to the detected code. Since it is publicly known as a process of acquiring information such as an attached identifier, detailed description thereof will be omitted here. Further, when the captured image includes images of a plurality of object codes, each object code may be detected and information corresponding to each detected object code may be acquired. For example, the process of detecting a plurality of color codes from one image and acquiring corresponding information is a known technique. This also applies to the place code.

The identifier acquisition unit 103 also detects a display object in the captured image and acquires a location identifier associated with the detected display object, for example. For example, when the display object is a location code, the identifier acquisition unit 103 detects the location code in the captured image and associates it with the detected location code, as in the case of detecting the object code. Get an identifier. Further, for example, when the display object is a character string, the identifier acquisition unit 103 detects an image of the character string that is the display object in the captured image, and acquires the character string from the detected character string image by character recognition. Thus, the location identifier corresponding to the character string that is the display object may be acquired. A process of detecting an image of a character string in a still image or a moving image and acquiring the character string from this image is known as a technique such as OCR, and thus detailed description thereof is omitted here. Further, for example, when the display object is a pre-designated image such as a mark, the identifier acquisition unit 103 sets the pre-designated image such as the mark that is the display object in the captured image to one or more pre-designated images. It is also possible to detect the location identifier associated with the detected image by performing pattern matching or the like using the image or information about the feature amount acquired from the one or more images. Since the pattern matching is a known technique, detailed description thereof will be omitted here.

For example, when the object code and the display object can be detected separately in the captured image, the identifier acquisition unit 103 separately detects the object code and the display object from the captured image, and is associated with the detected object code. The object identifier and the location identifier associated with the detected display object may be acquired. Further, the identifier acquisition unit 103, for example, detects the object code and the display object without distinguishing them from the captured image, acquires the identifiers corresponding to the detected object code and the display object, and acquires the acquired identifier. By distinguishing between the object identifier and the location identifier, one or more object identifiers respectively associated with one or more object codes in the captured image, and a location associated with the display object in the captured image. The identifier and may be acquired.

The case where the object code and the display object can be distinguished and detected in the captured image is, for example, the case where the display object is a character string or an image designated in advance. Further, the case where the object code and the display object can be distinguished and detected in the captured image is, for example, a case where the display object is a location code and a code different from the object code, or the display object is In the case of a location code, if the location where the location code is placed in the captured image is different from the object code, or if the location code is placed in a different direction than the object code is placed. If there is. Codes of different types are codes of different systems and codes of different shapes and sizes. The codes having different systems are, for example, two combinations of a one-dimensional code, a two-dimensional code, and a color code. The code having a different shape is, for example, a code having a different shape in the area where the code is arranged. The codes having different shapes may be considered as codes having different recognizable frame shapes in the area where the codes are arranged. The codes having different sizes may be codes having different sizes, or may be codes having different sizes such as a frame provided in the code. The code that is arranged at a different position in the captured image is, for example, a code that is arranged in a different region in the captured image. The different regions are, for example, a region on the upper side and a region on the lower side with respect to the height position designated in advance in the captured image. The cords arranged in different directions are, for example, both cords having a rectangular shape and arranged in different longitudinal directions.

Hereinafter, the process in which the identifier acquisition unit 103 acquires the object identifier and the location identifier will be described with six examples.

(1) When the display object is a character string or an image designated in advance The identifier acquisition unit 103 detects and detects one or more object codes in the captured image received by the captured image reception unit 101, for example. One or more object identifiers respectively corresponding to one or more object codes are acquired. Detecting the object code in the captured image may be considered as detecting an image of the object code in the captured image. This also applies to other codes. As one or more object codes in the captured image, for example, different types of codes, such as a combination of a one-dimensional code and a color code, may be mixed. In this case, the identifier acquisition unit 103 may sequentially detect each type of code and acquire the corresponding object identifier.

If the display object is a character string, the identifier acquisition unit 103 recognizes the character string in the captured image received by the captured image reception unit 101 and acquires the location identifier. The identifier acquisition unit 103 detects an image of a character string by using a character recognition technique such as OCR in a captured image, performs character recognition processing to acquire the character string, and corresponds to this character string. Get the location identifier. Acquiring the location identifier corresponding to the character string means acquiring the character string as the location identifier when the recognized and acquired character string is a location identifier, or the location associated with the recognized and acquired character string. This is a concept that includes obtaining an identifier from a storage unit (not shown). If the display object is a predesignated image, one or more predesignated images are detected in the captured image by pattern matching, and the location identifier associated with the detected predesignated image is determined. All you have to do is get it.

The order in which the identifier acquisition unit 103 acquires the object identifier and the location identifier does not matter.

(2) When the displayed object is a location code and the object identifier and the location identifier are distinguished from the identifier acquired for the code The identifier acquisition unit 103 has, for example, two or more in the captured image received by the captured image reception unit 101. If the detected code is associated with an identifier indicating that it is an object code, the object identifier is acquired from the code and associated with an identifier that indicates a location code. If so, get the location identifier from the code.

The identifier acquisition unit 103 detects two or more codes in the captured image received by the captured image reception unit 101, for example. The identifier acquisition unit 103 detects, for example, an object code and a place code in the captured image without making a distinction. For example, the identifier acquisition unit 103 detects the type of code used as the object code and the type of code used as the place code in the captured image. For example, when the object code and the location code are the same type of code, the identifier acquisition unit 103 detects the same type of code in the captured image. If the object code and the location code are different types of code, the identifier acquisition unit 103 detects the different types of codes. The same type of code here may be two or more types of the same type of code.

The identifier acquisition unit 103 acquires, for example, an identifier corresponding to the detected code, and determines whether the acquired identifier is an identifier indicating an object code. For example, a character string (for example, a specific number such as “0”) indicating an object code may be arranged in advance at a predetermined position in the identifier, for example, at the beginning or the end. If this character string is detected at a predetermined position in the acquired identifier, it is determined that the acquired identifier is an identifier indicating an object code. The character string here is a concept including one character. If the number of characters of the identifier indicating the object code and the number of characters of the identifier indicating the location code are different, it is determined whether or not the number of characters of the identifier obtained from the code matches the number of characters of the object code, and if they match, this You may judge that an identifier is an identifier of an object code. Further, when the acquired identifier matches any one of one or more object identifiers designated in advance, the acquired identifier may be determined as an identifier indicating an object code.

When the detected code is associated with an identifier indicating that it is an object code, the identifier acquisition unit 103 acquires the object identifier corresponding to this identifier. For example, the identifier acquisition unit 103 may acquire the detected identifier as an object identifier, or may acquire the object identifier associated with the detected identifier from a storage unit (not shown) or the like by detection.

Further, the identifier acquisition unit 103 acquires, for example, an identifier corresponding to each of the detected codes, and determines whether the acquired identifier is an identifier indicating a location code. In this process, for example, in the process of determining whether or not it is an identifier indicating the above object code, it is determined whether the identifier acquired from the detected code has a character string indicating that it is a location code ( For example, it may be determined whether or not there is a specific number such as "1" in the first digit of the identifier), whether it matches the number of characters of the identifier indicating the location code, or a predetermined number is specified. It can be realized by determining whether any one of the one or more place identifiers matches.

When the detected code is associated with an identifier indicating that it is a location code, the identifier acquisition unit 103 acquires a location identifier corresponding to this identifier. For example, the identifier acquisition unit 103 may acquire the detected identifier as a location identifier, or may acquire the location identifier associated with the detected identifier from a storage unit (not shown) or the like.

In addition, when the code detected from the captured image is limited to the object code and the location code, such as when shooting a range where only the object code and the location code are arranged, the detected code is the object code. When the code is not associated with the identifier indicating that, the code can be determined to be the location code. Therefore, in such a case, the processing of (2) acquires the object identifier from the code when each detected code is associated with an identifier indicating that it is an object code, and It may be considered as a concept including a process of acquiring the location identifier from the code when it is not associated with the identifier indicating the code.

Similarly, in the case where the code detected from the captured image is limited to the object code and the location code, the processing of (2) is performed by associating each detected code with an identifier indicating that it is a location code. In this case, the concept may include a process of acquiring the location identifier from the code and acquiring the object identifier from the code when the location identifier is not associated with the identifier indicating the location code.

The processing here is particularly effective when the place code and the object code are the same type of code, for example, when both are color codes.

Note that the identifier acquisition unit 103 may acquire an identifier corresponding to each code each time one code is detected, or may acquire an identifier corresponding to each code after detecting all the codes. ..

(3) When the display object is a location code, and the object code and the location code are identified by the position where the code in the captured image is arranged An object identifier and a place identifier are acquired from the two or more codes according to the position where the object is located. The position where the code is arranged here may be considered as a position where the code is arranged with respect to the captured image, or may be considered as a relative position between the codes.

For example, the identifier acquisition unit 103 detects two or more codes in the captured image as in the case of (2) above. The identifier acquisition unit 103 detects, for example, an object code and a place code in the captured image without making a distinction. For example, the identifier acquisition unit 103 detects the type of code used as the object code and the type of code used as the place code in the captured image. Then, the identifier corresponding to each detected code is acquired.

The identifier acquisition unit 103 distinguishes the detected code into an object code and a place code that is a display object, for example, according to the position where the detected code is arranged. For example, the identifier acquisition unit 103 distinguishes the detected code into an object code and a location code based on the position of the detected code in the captured image. For example, the identifier acquisition unit 103 uses the detected code to specify a predetermined height position in the captured image (for example, 3 of the height of the captured image when the bottom of the captured image is used as the height reference). A code located in an area equal to or more than the height position (which is one-half) is determined to be an object code, and a code located in an area less than a predetermined height position is determined to be a location code. Further, among the codes detected in the captured image, the code located on the lowermost side of the captured image or the code located on the uppermost side of the captured image may be determined as the place code. That is, the code may be divided into an object code and a location code based on the relative position of the code in the captured image. The order in which the identifier acquisition unit 103 determines the object code and the place code does not matter.

Then, the identifier acquisition unit 103 acquires the identifier acquired from the code determined to be the object code as the object identifier, and acquires the identifier acquired from the code determined to be the location code as the location identifier.

After detecting the code in the captured image, after determining whether each detected code is an object code or a location code, the object code is identified by the object code, and the location code is identified by the location identifier. It may be acquired.

This process is particularly effective when the place code and the object code are the same type of code, for example, when both are color codes.

The position of the code is, for example, the center of the code or the position of one point of the outline of the code. For example, if the code is rectangular, it is the position of a particular corner, such as the upper left or lower right of the code. The position of the code is represented by coordinates, for example. The position of the code may be the position of a particular corner of the smallest rectangle that encloses the code. The same applies to the position of the display object.

(4) When the displayed object is a location code and the object code and the location code are different codes The identifier acquisition unit 103, for example, in the captured image received by the captured image reception unit 101, displays the object code and the displayed object. And the place code which is respectively detected. For example, when the object code and the location code are different types of codes, the identifier acquisition unit 103 detects one or more types of codes used as the object code in the captured image, The location code is detected by detecting the code and detecting one or more types of codes used as the location code in the captured image. For example, when the object code and the location code are different systems, specifically, when the object code is a color code and the location code is a bar code, the object code is detected by detecting the color code from the captured image. Then, the place code is detected by detecting the barcode from the captured image. Then, the identifier acquisition unit 103 acquires the object identifier corresponding to the object code, and acquires the place identifier corresponding to the place code.

When the object code and the location code are codes having different shapes (for example, a circular code, a rectangular code, etc.), the identifier acquisition unit 103, for example, in the captured image, the shape and the location of the object code. The shape of the code is detected by pattern matching, the object identifier is acquired from the code having the shape of the detected object code, and the location identifier is acquired from the code having the shape of the detected location code. Good.

When the object code and the location code are different in size, the identifier acquisition unit 103 compares the sizes of the codes detected in the captured image with each other, and the detected code is large or small in size. Based on the difference in size between the object code and the location code, which are determined in advance, one of the two divided codes is determined as the object code and the other is determined as the location code. The object identifier may be acquired and the location identifier may be acquired from the location code.

The order in which the identifier acquisition unit 103 detects the object code and the place code does not matter. Further, the identifier acquisition unit 103 acquires an object identifier corresponding to this code each time one object code is detected, and acquires a location identifier corresponding to this code each time one location code is detected. Alternatively, the object identifiers corresponding to the respective codes may be acquired after detecting all the object codes, and the location identifiers corresponding to the respective codes may be acquired after detecting all the location codes.

(5) When the displayed object is a location code and the orientations of the object code and the location code are different, the identifier acquisition unit 103 detects two or more codes in the captured image received by the captured image reception unit 101. To do. The code to be detected is preferably one type of code used as an object code and a place code. Then, the identifier acquisition unit 103 acquires information indicating, for example, the orientation of each code detected in the captured image (for example, whether it is arranged so as to be vertically long or horizontally long). The information indicating the orientation is, for example, the inclination of the side of the smallest rectangle surrounding the detected code (however, the side having the inclination of 0 to 90 degrees), the vector, or the like. The information indicating the direction may be the inclination of a previously designated line segment set for the detected code. Further, when the detected code is a rectangle, it is the inclination or vector of the long side. When the detected code is circular, it is the inclination or vector of a straight line connecting the read start position of the code and the circular center of the code. Then, depending on whether the inclination is closer to the different first threshold value or the second threshold value, the code is classified into an object code and a location code, an object identifier is obtained from the object code, and the location code is obtained. Get the location identifier. For example, the object identifier is acquired from the code close to the first threshold value (eg, 0 degrees), and the location identifier is acquired from the code close to the second identifier (eg, 90 degrees). In addition, when the code is detected in advance, the identifier corresponding to the code is acquired, and if one code is determined to be the object code, the identifier acquired from this code is acquired as the object identifier, and the one When the code is determined to be the location code, the identifier obtained from this code may be obtained as the location identifier.

(6) When one captured image is an image obtained by capturing a plurality of sets each including one or more object codes and one display object, the processes (1) to (5) described above are, for example, captured images. This is a particularly preferable process when the one captured image received by the reception unit 101 is an image in which one or more object codes and one or more display objects associated with one location identifier are captured. When the one captured image received by the image reception unit 101 is an image obtained by capturing a plurality of sets each including one or more object codes and one display object, the identifier acquisition unit 103 determines, for example, the captured image. From the object code and the display object in, for each set of multiple sets, one or more object identifiers associated with one or more object code, and one location identifier associated with one display object May be acquired.

For example, the identifier acquisition unit 103 detects the object code and the display object in one captured image received by the captured image reception unit 101, as in the case of (1) to (5) above. Further, the identifier acquisition unit 103 detects a plurality of areas in which at least a part of the detected object code and display object are arranged in the captured image. Then, an object identifier corresponding to the one or more object codes and a location identifier corresponding to the display object are acquired for each set of the one or more object codes or the display objects arranged in each of the plurality of regions. As a result, the identifier acquisition unit 103 acquires an object identifier and a location identifier for each set of a plurality of sets including the object code and the display object from the object code and the display object in the captured image. be able to.

For example, the identifier acquisition unit 103 detects, for example, a plurality of areas in which one or more pairs of object codes and display objects are arranged. Each area that constitutes a plurality of areas is, for example, an image having a straight or curved contour that divides the captured image in the vertical, horizontal, or diagonal directions, or in the captured image in the vertical, horizontal, or diagonal directions. An area surrounded by a predetermined shape such as an extending stripe shape, an image having a predetermined color or design, or the like, or an area surrounded by the contour and one or more sides of the captured image.

For example, the identifier acquisition unit 103 performs pattern matching in a captured image, detection of a region of a designated color, or the like to detect an image as described above, and the image is separated by one or more detected images, or Detect an area surrounded by one or more images. Further, for example, when an image extending in a stripe shape is detected, the captured image may be divided into areas in which the area where the image is arranged is extended in the extending direction of the stripe. Regions in the captured image that are separated or enclosed by these images may be considered as regions that are separated or enclosed by the outline of the image. The contour can be acquired, for example, by performing contour extraction on the image. In addition, the identifier acquisition unit 103 detects one or more by performing area detection or the like using a value difference between values of adjacent pixels (for example, a luminance value, a hue value, etc.) that is common in normal image processing. The area may be detected. Region detection may be considered as a process for detecting a region by contour extraction. Then, an object identifier corresponding to the one or more object codes and a place identifier corresponding to the display objects are acquired for each set of the one or more object codes or the display objects arranged in each detected region.

Detecting an area means acquiring information such as the contour information of the area and the coordinates of a plurality of pixels located in the area. For example, the striped image extending in the vertical direction of the above-mentioned photographed image is an image corresponding to the front part of the partition plate of the shelf in which the articles are stored, and is divided in the vertical direction by the contour of the image of the partition plate. The plurality of areas that are respectively provided and have the object code and the display object are the plurality of areas that the identifier acquisition unit 103 detects.

The identifier acquisition unit 103 performs contour extraction or the like using a difference in luminance value or the like in the captured image without detecting the predesignated image as described above, so that the outline surrounded by the extracted contour is extracted. Alternatively, two or more areas may be detected, and the area including the object code or the display object in the detected contour may be detected as the plurality of areas.

It should be noted that the identifier acquisition unit 103 detects one or more areas including the object code in the captured image by the same processing as described above, and the object code arranged in each area and the area corresponding to each area in advance. The display object arranged at the designated position (for example, the lower side or the upper side) may be detected as a set of one or more object codes and one display object described above.

When the contour extraction or the image shape detection is performed, binarization processing may be appropriately performed on the captured image.

When the display object is a location code, as in the case of (2) above, after detecting the code in the captured image, a plurality of regions are detected in advance in the captured image, and each detected region is detected. Each time, the object identifier and the location identifier may be acquired from the code included in the area, as in the above (2) to (5). In addition, after detecting a plurality of regions in the captured image in advance, the code arranged in the region is detected for each region in the detected captured image, as in the case of (2) above. The object identifier and the place identifier may be acquired from the detected code.

In addition, the identifier acquisition unit 103 uses the distance between the object code and the display object in the captured image as follows, for each group having one or more object codes and one display object, the object identifier and the location. The identifier and may be acquired.

For example, the identifier acquisition unit 103 displays the object code and the display object such as the place code in one captured image received by the captured image reception unit 101, as in the case of (1) to (5) above. If a plurality of display objects are detected in the captured image, the distance on the captured image to each display object is calculated for each object code in the captured image, and the display object with the closest distance is For each of the two or more display objects detected from the captured image, it is considered that the display object belongs to the same group as the object code, and one location identifier corresponding to the display object and one or more that belong to the same group as the display object. One or more article identifiers respectively corresponding to the article codes may be acquired.

If necessary, the identifier acquisition unit 103 may determine that the code for which the object identifier is acquired is the object code and the code for which the location code is acquired is the location code. In addition, the identifier acquisition unit 103 corresponds to this article code among the display objects such as the place code in which the direction in which the article code is arranged is a direction designated in advance, for example, a downward direction or an upward direction. The display object having the shortest distance may be determined to be the display object belonging to the same group as the one article code.

Here, the distance between the object code and the display object in the captured image is, for example, the distance between the position of the object code and the position of the display object. For example, the distance between the object code and the display object is, for example, the distance between the coordinates indicating the positions of the object code and the display object.

The image in which a plurality of groups including one or more object codes and one display object described above is captured is a plurality of groups including one or more object codes and one display object. You can think of it as an image. Further, the display objects belonging to different groups here are preferably display objects associated with different place identifiers, but may be associated with the same place identifier.

The identifier storage unit 104 stores one or more object identifiers and location identifiers in association with each other. For example, the identifier storage unit 104 stores information having an associated object identifier and location identifier. The location identifier and the object identifier associated with this location identifier are accumulated in the identifier storage unit 104 by the identifier output unit 105 described later, for example.

The identifier storage unit 104 is preferably a non-volatile recording medium, but can also be realized by a volatile recording medium. The same applies to other storage units.

The identifier output unit 105 outputs the one or more object identifiers acquired by the identifier acquisition unit 103 from the captured image and the location identifier acquired by the identifier acquisition unit 103 in association with each other. The identifier output unit 105 outputs, for example, one location identifier acquired from the same captured image in association with each of one or more object identifiers acquired from the captured image by the identifier acquisition unit 103.

For example, in the case where one captured image received by the captured image receiving unit 101 is an image in which a plurality of groups including one or more object codes and one display object are captured, the identifier output unit 105 , One or more object identifiers respectively acquired by the identifier acquisition unit 103 from one or more object codes and one display object included in the same set in one captured image are associated with one location identifier. You may make it output. For example, the identifier output unit 105 is configured such that the identifier output unit 105 includes one or more object codes and one display object included in all or some of the plurality of sets in one captured image. One or more object identifiers and one location identifier respectively acquired by the identifier acquisition unit 103 from the above may be output in association with each other. Note that, for example, to output two or more object identifiers and one location identifier in association with each other means that one piece of information having a set of two or more object identifiers and one location identifier is output. Alternatively, it may be that two or more pieces of information each having two or more object identifiers and one place identifier are acquired.

Note that the identifier output unit 105 may output one or more object identifiers and location identifiers stored in association with the identifier storage unit 104, and such output is also the object identifier acquired by the identifier acquisition unit 103. It may be considered that the and the location identifier are output in association with each other.

The output here is normally stored in a recording medium, etc., but is displayed on a display, projected using a projector, printed on a printer, transmitted to an external device, another processing device, another program, etc. It is a concept that includes delivery of processing results to the. Further, the identifier output unit 105 may appropriately perform two or more different outputs, for example, accumulation, transmission, and display.

For example, the identifier output unit 105 may store one or more object identifiers acquired from the captured image and the location identifier acquired by the identifier acquisition unit 103 in the identifier storage unit 104 in association with each other. If a combination of the same object identifier and location identifier has already been stored, it may not be stored to prevent duplication.

Next, an example of the operation of the information processing device 1 will be described with reference to the flowchart of FIG.

(Step S101) The image capturing apparatus 102 determines whether or not to capture an image of the object code and the display object. For example, the image capturing apparatus 102 determines that the image capturing is to be performed when an unillustrated receiving unit or the like receives an instruction to perform image capturing from a user or the like via an input device or the like. When taking a picture, the photographing apparatus 102 photographs the object code and the display object to acquire a photographed image, outputs the acquired photographed image to the photographed image receiving unit 101, and proceeds to step S102. If shooting is not performed, the process returns to step S101.

(Step S102) The captured image receiving unit 101 receives the captured image captured in step S101.

(Step S103) The identifier acquisition unit 103 detects the object code and the display object in the captured image received in step S102. When the display object is a character string or a predesignated image, the identifier acquisition unit 103 individually detects the object code and the display object, for example. When the display object is the location code and the same type of code as the object code, the identifier acquisition unit 103 detects the object code and the display object that is the location code without making a distinction, for example. Further, when the display object is a place code and is a code of a type different from the object code, the identifier acquisition unit 103 individually performs the detection of the object code and the detection of the display object, for example.

(Step S104) The identifier acquisition unit 103 detects one or more areas in which the object code and the display object are arranged in the captured image received in step S102. For example, in a captured image, an image of a predetermined color or shape is detected, and two or more areas separated by the image are detected. Further, it is determined whether or not each of the detected areas includes the object code and the display object detected in step S103, and the included area is detected as one or more areas in which the object code and the display object are arranged. To do. When such an image is not detected, the entire captured image may be detected as one area. If the object code and the displayed object are detected without being distinguished from each other, the area including the detected code may be detected. Further, in this case, the identifier acquisition unit 103 may eventually detect an area that includes only one of the object code and the place code that is the display object.

(Step S105) The identifier acquisition unit 103 acquires an object identifier and a location identifier for each of the one or more areas detected in step S104. For example, in step S103, when the location code and the display object are detected separately, the object identifier is acquired from the object code of each area, and the location identifier is acquired from the display object. If the location code and the location code that is the display object are not detected separately, and if the detected code is associated with an identifier indicating that it is an object code, the object identifier is detected from the detected code. If the acquired code is associated with an identifier indicating that the code is a location code, the location identifier is acquired from the detected code. If the location code and the location code that is the display object are not detected separately, the object identifier or the location identifier may be acquired from the detected code according to the position of the detected code.

(Step S106) The identifier output unit 105 stores the object identifier and the location identifier acquired for each area in Step S105 in association with each other in the identifier storage unit 104.

In addition, although the case where the identifier output unit 105 stores the object identifier and the location identifier in association with each other has been described with reference to FIG. 2, the identifier output unit 105 may perform an output other than the storage. Further, the identifier output unit 105 may output at least one or more of the object identifier and the location identifier that are accumulated in association with the identifier storage unit 104.

Note that in the flowchart of FIG. 2, the processing is ended by powering off or interruption for aborting the processing.

Hereinafter, a specific operation of the information processing device 1 according to the present embodiment will be described with an example.

(Specific example 1)
Here, a case where the object identifier and the location identifier are acquired by the processing described in (2) and (6) above will be described as an example.

FIG. 3 is a schematic diagram (FIG. 3A) showing a part of a bookshelf 30 in which a plurality of books 31 that are a plurality of objects are stored, and a color code for explaining the operation of the information processing apparatus 1. It is a figure (FIG.3(b)) which shows an example.

It is assumed that the object code 301 is attached to the spine of each book 31. As the object code 301, a color code as shown in FIG. 3B is used here. This color code is a code in which a plurality of colors are arranged on a matrix. For example, this color code is also called a chameleon code. Here, it is assumed that the identifier read from the object code 301 is the object identifier. Here, the object code 301 attached to each book 31 is associated with, for example, different object identifiers.

It is assumed that a place code 302, which is a display object, is attached to the front surface of the shelf plate 33 of the bookcase 30. The location code 302 is assumed to be the same color code as the object code 301, that is, the color code as shown in FIG. It is assumed that each place code 302 is associated with a place identifier indicating the place of the book 31 stored on the attached shelf board 33. The place code 302 attached to the front surface of the shelf plate 33 within the range divided by the partition plate 32 indicates the place of the books stored on the shelf plate 33 within the range divided by the partition plate 32. Assume that it is associated with the location identifier. Here, as an example, it is assumed that the front surface of the partition plate 32 is painted in a color different from that of the front surfaces of the other parts of the bookcase 30, for example, orange. Here, it is assumed that this color is a color that is not used in the color code. Further, it is assumed that the color is different from the color of the front surface of the shelf board 33. Note that this color may be any color that is not used in the color code.

It is assumed that the user uses the image capturing device 102 of the information processing device 1 to capture an image of a part of the bookshelf 30 illustrated in FIG. 3A from the front side. It is assumed that the captured image is a color still image.

FIG. 4 is a diagram (FIG. 4A) showing a captured image captured by the image capturing apparatus 102, and a code detected in the captured image, and one or more areas in which the object code and the display object are arranged. It is a figure (FIG.4(b)) which shows.

When the image capturing apparatus 102 acquires the captured image 40 as shown in FIG. 4A, the captured image receiving unit 101 receives this captured image from the image capturing apparatus 102.

The identifier acquisition unit 103 detects a color code in the captured image received by the captured image reception unit 101, that is, the captured image 40 shown in FIG. Here, it is assumed that a plurality of color codes 401a to 401i are detected as shown in FIG. Here, it is assumed that the object code 301 and the location code 302 are the same color code, and they are detected without being distinguished. Since the process of detecting a plurality of color codes from the same image is a known technique as disclosed in the above-mentioned Patent Document 2 and the like, detailed description thereof will be omitted here.

The identifier acquisition unit 103 further detects the partition plate 32 in the captured image 40 shown in FIG. Here, the partition plate 32 is detected by detecting the area in the photographed image in which the orange image, which is the front color of the partition plate 32, is arranged. Then, the detected area is detected in the vertical direction as an area for dividing the captured image 40 up to the upper and lower ends of the captured image 40, and in the captured image 40, a plurality of areas separated by this area are detected. Detect the area. Here, as shown in FIG. 4B, a region 402 in which the region where the partition plate 32 is arranged is enlarged is detected, and a first region 403 and a second region 404 divided by this region are detected. Is detected in the captured image.

The identifier acquisition unit 103 may detect an area in which an image having a stripe shape extending in the vertical direction is arranged instead of detecting the orange area. In this case, the partition plate 32 may have any color.

The identifier acquisition unit 103 determines whether or not two or more of the color codes detected above are arranged in each of the first area 403 and the second area 404. Here, if it is arranged, the identifier acquisition unit 103 arranges the object code 301 and the place code 302, which is the display object, in both the first area 403 and the second area 404. It is determined that the area is a certain area, and information indicating each area, for example, contour information is acquired. When two or more color codes are not detected, the information on the area is not acquired.

FIG. 5 is a book management table that manages object identifiers and book identifiers, which are book identifiers corresponding to the object identifiers, in association with each other. The book management table has attributes “object ID” and “book ID”. The “object ID” is an object identifier, and here, as an example, the identifier read from the object code is the object identifier. The “book ID” is a book identifier, and here is an international standard book number assigned to the book. However, the book identifier may be any information that can identify the book such as the title of the book.

FIG. 6 is a place management table that manages the correspondence relationship between the place identifier and the information indicating the place where the book corresponding to the place identifier exists. The place management table has attributes "place ID" and "place information". The “location ID” is a location identifier, and here, as an example, the identifier read from the location code is the location identifier. The “location information” is information indicating the location of the book 31, which is an object, and here, one of the symbols “A” to “P” assigned to each of the plurality of bookcases 30 and each bookcase 30. It is assumed that the information is a combination of numerical values sequentially assigned to a plurality of areas set in the above.

The identifier acquisition unit 103 acquires the identifiers corresponding to the color codes 401a to 401d and 401h detected in the first area 403 among the color codes detected above. Since the process of acquiring the identifier associated with the color code from the color code is known, the description thereof is omitted here. Then, among the identifiers obtained from the respective color codes, it is sequentially determined whether or not there is a match with any of the attribute values of “object ID” in the book management table of FIG. 5, and the matching identifier is acquired as the object identifier. .. For example, the identifiers “11202241”, “11202242”, “11202243”, and “112202244” acquired from the color codes 401a, 401b, 401c, and 401d are any of the attribute values of “object ID” in the book management table in FIG. If they match with one, the identifier acquisition unit 103 acquires these identifiers as object identifiers and temporarily stores them in a storage medium (not shown) or the like.

Further, the identifier acquisition unit 103 sequentially determines whether or not there is an identifier acquired from each color code that matches any of the attribute values of “location ID” in the location management table of FIG. As a location identifier. For example, if the identifier “10115013” acquired from the color code 401h matches with one of the attribute values of the “location ID” in the location management table of FIG. 5, the identifier acquisition unit 103 acquires this identifier as the location identifier. Then, it is temporarily stored in a storage medium (not shown).

Then, the identifier output unit 105 associates the plurality of object identifiers acquired by the identifier acquisition unit 103 for the first area 403 with the one object identifier acquired for the first area 403, and stores it in the identifier storage unit 104. accumulate.

Similarly, the identifier acquisition unit 103 also acquires an identifier for each of the color codes 401e to 401g and 401i detected in the second area 404, and the attribute value of “object ID” in the book management table in FIG. The identifier that matches any of the above is acquired as the object identifier, and the identifier that matches any of the attribute values of the “object ID” in the place management table of FIG. 6 is acquired as the place identifier.

Then, the identifier output unit 105 associates the plurality of object identifiers acquired by the identifier acquisition unit 103 with respect to the second area 404 with the one object identifier acquired with respect to the second area 404, and stores it in the identifier storage unit 104. accumulate.

FIG. 7 is an object location management table that manages object identifiers and location identifiers stored in association with each other in the identifier storage unit 104. The “object ID” and the “location ID” in the object location management table correspond to the “object ID” and the “location ID” in FIGS. 5 and 6.

In this way, the object identifier of the object code attached to the book 31 and the place identifier attached to the shelf 30 where the book 31 is present can be associated with each other using one captured image, and It is possible to easily acquire the information that associates a certain book 31 with its existing location.

(Specific example 2)
In the above-mentioned specific example 1, depending on whether the identifier obtained from the code detected from each area is the identifier indicating the object code or the place code (specifically, Has described the case where the object identifier or the location identifier is obtained from each code depending on whether it is the object identifier or the location identifier). In this specific example, the position of the code detected from each area is described. An example of acquiring the object identifier or the location identifier from each code will be described.

The procedure until the color code is detected and the first area 403 and the second area 404 are detected from the captured image is the same as in the first specific example.

The identifier acquisition unit 103 detects the lowest color code in the captured image among the color codes detected in the first area 403. As the position of the color code, for example, the lowest position (coordinates) of the detected color code is used. For example, in FIG. 4B, the color code 401h is detected as the lowest color code. Then, the identifier “10115013” acquired from the color code 401h located at the lowermost position is acquired as the location identifier. Further, the identifiers respectively acquired from the other color codes 401a to 401d are acquired as the object identifiers.

Then, the identifier output unit 105 associates the plurality of object identifiers acquired by the identifier acquisition unit 103 for the first area 403 with the one object identifier acquired for the first area 403, and stores it in the identifier storage unit 104. accumulate.

Then, the same processing is performed for the color code detected in the second area 404.

In this way, the process of comparing the color code identifier with the object identifier or the place identifier can be omitted.

(Specific example 3)
In this specific example, a case where the display object is a character string indicating a location identifier will be described. Here, an example will be described in which a character string that is an attribute value of “location information” in FIG. 6 is used as a location identifier.

FIG. 8 is a diagram showing a photographed image 80 of the bookshelf shown in FIG. 3, in which a character string 802 indicating a place identifier is arranged instead of the place code, which is taken by the image capturing apparatus 102 (FIG. 8A). 9A and 9B are diagrams illustrating object codes 801a to 801g detected in a captured image, and character string images 801h and 801i detected in the captured image 80.

For example, in the bookshelf shown in FIG. 3, the bookshelf in which the character string 802 indicating the place identifier is arranged instead of the place code is photographed by using the photographing device 102, and a photographed image 80 as shown in FIG. Is acquired.

The captured image receiving unit 101 receives a captured image 80 as shown in FIG.

The identifier acquisition unit 103 detects the color code in the captured image 80 received by the captured image reception unit 101 to detect the object code 801a to 801g, which is a color code, and acquires the object identifier corresponding to each object code. To do. In addition, the identifier acquisition unit 103 detects character string images 801h and 801i by performing character recognition processing such as OCR in the captured image 80, and acquires a character string corresponding to each of them. For example, the character string “A4” is acquired from the image 801h, and the character string “A5” is acquired from the image 801i.

Further, the identifier acquisition unit 103 detects the first area 403 and the second area 404 in the captured image 80, as in the above-described specific example 1.

The identifier acquisition unit 103 stores the object identifiers acquired from the object codes 801a to 801d located in the first area 403 and the character string “A4” acquired from the image 801h of the character string located in the first area 403. The identifier output unit 105 associates these with each other and stores them in the identifier storage unit 104.

Similarly, the identifier acquisition unit 103 acquires the object identifiers obtained from the object codes 801e to 801g located in the first area 403 and the character string “obtained from the image 801i of the character string located in the first area 403. A5” is acquired, and the identifier output unit 105 stores these in the identifier storage unit 104 in association with each other.

FIG. 9 is an object location management table that manages object identifiers and location identifiers stored in association with each other in the identifier storage unit 104. The “object ID” of the object location management table is the location identifier read from the location code, and the “location ID” is the location identifier acquired by character recognition from the image of the character string.

In the case of this processing, there is no need for processing for determining which of the object identifier and the location identifier can be acquired from the code detected in the captured image.

(Specific Example 4)
In this specific example 4, by detecting the first area 403 and the second area 404 in the specific example 3, one or more objects are set for each object code and display object group included in each area. Instead of obtaining a pair of an identifier and a location identifier, one or more pairs of object codes and display objects are detected based on the distance between each object code and the display object, and one or more object identifiers and locations for this set A pair with an identifier is acquired.

The identifier acquisition unit 103 detects the object codes 801a to 801g, which are color codes, from the captured image 80 shown in FIG. 8A, acquires the object identifier corresponding to each object code, and performs character recognition processing such as OCR. By performing the processing, the processing of detecting the image 801h and 801i of the character string that is the display object and acquiring the corresponding character strings is the same as in the above-described third specific example.

The identifier acquisition unit 103 determines, for each of the object codes 801a to 801g detected in the captured image 80, the image of the character string located closest in the captured image 80 as the image of the detected character string 801h and 801i. Detect from inside. For example, it is assumed that the image 801h is detected as the image of the character string closest to the object codes 801a to 801d. Further, it is assumed that the image 801i is detected as the image of the character string closest to the object codes 801e to 801g.

The identifier output unit 105 associates the object identifier acquired from each object code with the location identifier acquired from the image of the character string close to each object code, and accumulates them in the identifier storage unit 104. For example, the object identifier “11202241” acquired for the object code 801a and the “A4” acquired from the character string image 801h are stored in association with each other. Further, the object identifier “11202242” acquired for the object code 801b and the “A4” acquired from the image 801h of the character string are stored in association with each other. Further, the object identifier “11202245” acquired for the object code 801e and the “A5” acquired from the image 801h of the character string are stored in association with each other. In this way, the same object location management table as in FIG. 9 can be obtained.

As described above, also in this specific example, as a result, for each set of one display object in the captured image and one or more object codes in the same captured image that is the display object closest to this display object. One or more display identifiers and one object identifier can be acquired and output (here, stored). Further, without detecting an area in which one or more pairs of object codes and location codes are arranged, the object identifier and the location identifier are respectively extracted from each of the plurality of pairs of one or more object codes and location codes. You can get a set.

As described above, according to the present embodiment, it is possible to easily create information for managing the location of an article. For example, by photographing an object (for example, a book) in which the object code is placed in a state in which the place code is placed, the object identifier of the object and the place identifier of the place in which the object exists are captured. Correspondence becomes possible.

In each of the above embodiments, each process (each function) may be realized by centralized processing by a single device (system), or by distributed processing by a plurality of devices. May be done.

Further, although cases have been described with the above embodiments where the information processing device is a stand-alone device, the information processing device may be a stand-alone device or a server device in a server/client system. In the latter case, the output unit and the reception unit receive an input or output a screen via the communication line.

Further, in each of the above-described embodiments, each component may be configured by dedicated hardware, or a component that can be implemented by software may be implemented by executing a program. For example, each component can be realized by a program execution unit such as a CPU reading and executing a software program recorded in a recording medium such as a hard disk or a semiconductor memory. At the time of execution, the program execution unit may execute the program while accessing a storage unit (for example, a recording medium such as a hard disk or a memory).

The software that realizes the information processing device in each of the above-described embodiments is the following program. That is, this program causes the computer to store one or more object codes, which are codes arranged in an object and are associated with an object identifier that is the identifier of the object, and a location identifier that is a location identifier. The associated display object and a captured image receiving unit that receives a captured image that is a captured image, and one or more object codes associated with one or more object codes in the captured image received by the captured image receiving unit, respectively. An identifier acquisition unit that acquires an object identifier and a location identifier associated with a display object in a captured image, one or more object identifiers acquired by the identifier acquisition unit, and a location identifier acquired by the identifier acquisition unit are associated with each other. It is a program for functioning as an identifier output unit that is attached and output.

In the above program, in the transmitting step for transmitting information and the receiving step for receiving information, the processing performed by hardware, for example, the processing performed by the modem or the interface card in the transmitting step (only performed by hardware) Processing that is not denied) is not included.

In the above program, the function realized by the program does not include the function realized only by hardware. For example, a function that can be realized only by hardware such as a modem or an interface card in an acquisition unit that acquires information and an output unit that outputs information is not included in the functions realized by the program.

Moreover, the computer that executes this program may be a single computer or a plurality of computers. That is, centralized processing may be performed or distributed processing may be performed.

FIG. 10 is a schematic diagram showing an example of the external appearance of a computer that executes the above program and realizes the information processing apparatus according to the above embodiment. The above embodiment can be realized by computer hardware and a computer program executed on the computer hardware.

In FIG. 10, a computer system 900 includes a computer 901 including a CD-ROM (Compact Disk Read Only Memory) drive 905, a keyboard 902, a mouse 903, and a monitor 904.

FIG. 11 is a diagram showing the internal configuration of the computer system 900. In FIG. 11, a computer 901 is connected to an MPU (Micro Processing Unit) 911, a ROM 912 for storing a program such as a boot-up program, and an MPU 911 in addition to a CD-ROM drive 905, and an instruction of an application program. A RAM (Random Access Memory) 913 that temporarily stores and provides a temporary storage space, a hard disk 914 that stores application programs, system programs, and data, and a bus 915 that interconnects the MPU 911, ROM 912, and the like. Prepare It should be noted that the computer 901 may include a network card (not shown) that provides a connection to the LAN.

A program that causes the computer system 900 to execute the functions of the information processing apparatus according to the above-described embodiments may be stored in the CD-ROM 921, inserted into the CD-ROM drive 905, and transferred to the hard disk 914. Alternatively, the program may be transmitted to the computer 901 via a network (not shown) and stored in the hard disk 914. The program is loaded into the RAM 913 when it is executed. The program may be loaded directly from the CD-ROM 921 or the network.

The program does not necessarily have to include an operating system (OS) that causes the computer 901 to execute the functions of the information processing apparatus according to the above-described embodiment, a third-party program, or the like. The program may include only a part of an instruction that calls an appropriate function (module) in a controlled manner to obtain a desired result. How the computer system 900 operates is well known and will not be described in detail.

Needless to say, the present invention is not limited to the above-described embodiments, and various modifications can be made, which are also included in the scope of the present invention.

As described above, the information processing apparatus or the like according to the present invention is suitable as an apparatus or the like for creating information for managing articles, and particularly as an apparatus or the like for creating information for managing articles by using a code. It is useful.

1 Information Processing Device 101 Photographed Image Receiving Unit 102 Photographing Device 103 Identifier Acquisition Unit 104 Identifier Storage Unit 105 Identifier Output Unit

Claims (5)

One or more object codes that are codes arranged on an object and that are associated with an object identifier that is the identifier of the object, and a location code that is a code associated with a location identifier that is a location identifier. And a captured image reception unit that receives a captured image that is a captured image,
Identifier acquisition that acquires one or more object identifiers respectively associated with one or more object codes in the captured image received by the captured image reception unit and a location identifier associated with the location code in the captured image Department,
An identifier output unit that outputs the one or more object identifiers acquired by the identifier acquisition unit and the location identifier acquired by the identifier acquisition unit in association with each other,
The identifier acquisition unit detects a code in the captured image accepted by the captured image acceptance unit without distinguishing between the object code and the location code, and the position where the detected code is located in the captured image. An information processing apparatus that distinguishes a detected code into a location code and an object code, acquires a location identifier from the code determined to be the location code, and acquires an object identifier from the code determined to be the object code. The one captured image received by the captured image receiving unit is an image obtained by capturing a plurality of sets each including one or more object codes and one location code,
The identifier acquisition unit, based on the object code and the location code in the captured image, for each set of the plurality of sets, one or more object identifiers associated with one or more object codes, and one location code. And one location identifier associated with
The identifier output unit, in one captured image, one or more object identifiers respectively acquired by the identifier acquisition unit from one or more object codes and one location code included in the same set, and one location identifier , claim 1 Symbol placement of the information processing apparatus for outputting in association with. The information processing apparatus according to claim 1, wherein the identifier acquisition unit distinguishes the code into an object code and a location code based on the relative positions of the plurality of codes in the captured image. An information processing method performed by using an information processing device including an image reception unit, an identifier acquisition unit, and an identifier output unit,
The photographed image accepting unit associates with one or more object codes that are codes arranged on an object and are associated with an object identifier that is an identifier of the object, and a location identifier that is a location identifier. A location code that is a generated code, and a captured image reception step that receives a captured image that is a captured image,
The identifier acquisition unit, one or more object identifiers respectively associated with one or more object codes in the captured image received in the captured image receiving step, and a location identifier associated with the location code in the captured image An identifier acquisition step for acquiring and
The identifier output unit comprises an identifier output step of outputting one or more object identifiers acquired in the identifier acquisition step and the location identifier acquired in the identifier acquisition step in association with each other,
The identifier acquisition step detects a code without distinguishing between an object code and a place code in the captured image received in the captured image receiving step, and a position where the detected code is arranged in the captured image. An information processing method that distinguishes the detected code into a location code and an object code according to the above, acquires a location identifier from the code determined to be the location code, and acquires an object identifier from the code determined to be the object code. Computer,
One or more object codes that are codes arranged on an object and that are associated with an object identifier that is the identifier of the object, and a location code that is a code associated with a location identifier that is a location identifier. And a captured image reception unit that receives a captured image that is a captured image,
Identifier acquisition that acquires one or more object identifiers respectively associated with one or more object codes in the captured image received by the captured image reception unit and a location identifier associated with the location code in the captured image Department,
The identifier acquisition unit is caused to function as an identifier output unit that outputs the one or more object identifiers acquired by the identifier acquisition unit in association with the location identifier acquired by the identifier acquisition unit,
The identifier acquisition unit detects a code in the captured image accepted by the captured image acceptance unit without distinguishing between the object code and the location code, and the position where the detected code is located in the captured image. A program that distinguishes the detected code into a location code and an object code according to the above, acquires a location identifier from the code determined to be the location code, and acquires an object identifier from the code determined to be the object code.

Images