JP6430601B2 - Information reader and sorting system - Google Patents

Description

  Embodiments described herein relate generally to an information reading apparatus and a sorting system.

  Conventionally, when acquiring a photographed image for OCR (Optical Character Recognition) or video coding for reading a destination of a courier, the upper surface of the courier is measured based on the result of measuring the shape of the courier object. There is a method of acquiring a captured image developed into a planar image by correcting according to the position of the side surface.

JP2013-103162A

However, when the creation of a corrected image fails, the developed planar image may be distorted, and in addition to automatic recognition by OCR, video coding that humans recognize and input may be impossible. It was.
The problem to be solved by the present invention is to provide an information reading device, a sorting system, and an information reading method capable of improving the reading rate.

  The information reading apparatus according to the embodiment includes a first imaging unit, a second imaging unit, a recognition unit, an information presentation unit, an input information acquisition unit, and a result output unit. The first photographing unit outputs a first photographed image obtained by photographing the object with the line sensor. The second photographing unit outputs a second photographed image obtained by photographing the object with an area sensor. The recognition unit recognizes display information associated with the object based on the first photographed image. The image presentation unit transmits at least the second photographed image to the display unit when the recognition unit cannot recognize the display information. The input information acquisition unit acquires input information input corresponding to the captured image transmitted from the image presentation unit to the display unit. The result output unit outputs the recognition result of the recognition unit or the input information acquired by the input information acquisition unit as a reading result of the display information. The recognition unit recognizes the display information of the first notation associated with the object based on the first photographed image and cannot recognize the display information of the first notation. In addition, the display information of the second notation associated with the object is recognized.

It is a block diagram which shows an example of schematic structure of the division system which concerns on 1st Embodiment. It is a flowchart which shows an example of the division process by 1st Embodiment. It is a flowchart which shows the detailed example of a recognition process. The 1st example of a display of the picked-up image displayed on a display part is shown. The 2nd display example of the picked-up image displayed on a display part is shown. It is a block diagram which shows an example of schematic structure of the sorting system which concerns on 2nd Embodiment. It is a flowchart which shows an example of the failure diagnosis process by 2nd Embodiment.

Hereinafter, the present embodiment will be described with reference to the drawings.
<First Embodiment>
FIG. 1 is a configuration diagram illustrating an example of a schematic configuration of a sorting system 10 according to the present embodiment.
The sorting system 10 shown in FIG. 1 is an example of a system that sorts home delivery services according to delivery destinations. For example, the articles to be delivered by courier are collected by the delivery company to the article sorting center via the primary receiving place brought in by the sender. In this article sorting center, sorting processing is performed in which articles are placed on a transport mechanism such as a conveyor or a roller and transported to a sorting destination corresponding to a delivery destination. In the example shown in this figure, an article 20 (20-1, 20-2, 20-3, etc.) to which a form (delivery slip) 21 (21a, 21b, 21c, 21d, etc.) on which delivery destination information is written is pasted. However, it is conveyed by the conveyor 31 (belt conveyor) to the sorting destination according to each delivery destination.

In this example, the form 21 on which the delivery destination information is described is pasted on the article 20, but the present invention is not limited to this. For example, a tag on which the delivery destination information is described is connected to the article 20. Alternatively, the delivery destination information may be printed (printed) on the article 20. That is, the delivery destination information only needs to be associated with the article 20 as the target object as display information.
Further, the delivery destination information described in the form 21 may be character information such as an address as the second notation, or identification information (for example, a numeric string) in which the delivery destination is coded. , Barcode, etc.).

The sorting system 10 includes a transport unit 30, an information reading device 100, a sorting processing unit 200, an information input device 300, and a storage unit 400.
The transport unit 30 includes a conveyor 31 and a transport driving unit 32 that drives the conveyor 31. And the conveyance part 30 drives the conveyor 31 based on the instruction | indication from the classification | category process part 200 with the articles | goods 20 currently loaded on the conveyor 31, and is set to the delivery destination of several predetermined division | segmentation destinations. Transport to the appropriate sorting destination.

The information reading apparatus 100 includes two systems of scanners 1 and 2 and a reading processing unit 110.
The scanner 1 and the scanner 2 are imaging devices that take images in order to read the delivery destination of the form 21 attached to the article 20. Here, each of the two systems of the scanner 1 and the scanner 2 includes a plurality of photographing devices, and is configured to photograph the article 20 placed on the conveyor 31 from multiple directions. Each scanner may shoot from one direction, but since there are many cases where it is not known in which direction of the article 20 the delivery destination information is described, it is often necessary to take an image from multiple directions. It is effective for reading. Therefore, in this embodiment, it is assumed that the respective scanners are arranged so as to photograph the upper surface and both side surfaces (the left and right side surfaces in the conveying direction of the conveyor 31) of the article 20.

  In FIG. 1, the positions of the scanner 1 and the scanner 2 with respect to the article 20 are separately illustrated, but this is illustrated separately to indicate that the scanner 1 and the scanner 2 are different systems. However, this does not indicate that the photographing directions of the scanner 1 and the scanner 2 with respect to the article 20 are different. For example, each of the plurality of scanners 2 is installed in a pair in the vicinity of each of the plurality of scanners 1. Note that the number and position of the scanner 1 and the scanner 2 installed may be arbitrarily configured.

Further, the scanner 1 and the scanner 2 capture images by using different image capturing methods (for example, sensing methods).
The scanner 1 is a scanner that captures an image for recognizing a delivery destination by OCR. For example, the scanner 1 is a line scan type scanner that captures an image using a line sensor.
An image photographed by a line scan type scanner is an image obtained by measuring the shape of an object with a laser or the like and performing correction according to the shape at the time of line scan. In this way, since the focus is corrected according to the shape, and a high-pixel image is obtained by configuring many pixels for one line, generally a high-quality image can be acquired, This image is easy to use for OCR and the like. On the other hand, since the correction of the image depends on the shape measured by a laser or the like, the corrected image may not be normally created if there is a problem with the shape measurement. In addition, the shooting range of the target is also the part where it is determined that the target exists based on the measurement result of the shape, so if there is a problem with the shape measurement, the target cannot be shot properly There is also.

On the other hand, the scanner 2 is a scanner that captures an image for a person to visually recognize a delivery destination. For example, the scanner 2 is an area scan type scanner that captures an image using an area sensor.
The area scan type scanner is the same as that used for general photography. The shooting range is an area within the shooting field of view taken at a certain time. To determine the shooting timing, the time obtained from the transmission sensor and the conveyance speed may be used, or the range of the target object is specified using the distance sensor, and shooting is performed at the timing when the target object enters the shooting field of view. May be. Further, the presence of an object in the captured image may be confirmed by image processing. Compared with the line scan method, this area scan method cannot perform focus correction or the like according to the position, and therefore, an image that is not optimal as a captured image recognized by OCR is often acquired. On the other hand, this area scan method does not require image correction like the line scan method, so it is possible to prevent an image from being normally created due to a correction failure, and an image that can be visually recognized by humans. It can be acquired with high probability.

  As described above, in this embodiment, when the delivery destination of the article 20 is recognized (automatic recognition) from the photographed image by OCR or the like, an image photographed by the line scan type scanner 1 is used, and a person is identified from the photographed image. When the delivery destination of the article 20 is recognized visually, an image taken by the area scan type scanner 2 is used.

The reading processing unit 110 includes an image acquisition unit 111 (acquisition unit), a recognition unit 112, an image presentation unit 113, an input information acquisition unit 114, and a result output unit 115.
The image acquisition unit 111 is a photographed image obtained by photographing the article 20 that is the object, and is a photographed image (first photographed image) photographed by the scanner 1 and a photographed image (second photographed image) photographed by the scanner 2. ) And get. That is, the image acquisition unit 111 acquires the first captured image and the second captured image generated by different generation processes. In addition, the image acquisition unit 111 stores the acquired captured image in the image storage unit 410 included in the storage unit 400.

  The recognition unit 112 recognizes the delivery destination information of the form 21 attached to the article 20 based on the photographed image photographed by the scanner 1. For example, the recognition unit 112 recognizes character information as delivery destination information from the photographed image photographed by the scanner 1 by OCR. The recognizing unit 112 may recognize encoded delivery destination information (numerical string, barcode, etc.) from the captured image captured by the scanner 1. In addition, the recognition unit 112 may recognize the delivery destination information of the form 21 attached to the article 20 based on the photographed image photographed by the scanner 2. Further, the recognition unit 112 may recognize a barcode obtained by encoding the delivery destination information using an external device (not shown) provided with a laser or the like.

  When the recognition unit 112 cannot recognize the delivery destination information, the image presenting unit 113 reads the captured image captured by the scanner 1 and the captured image captured by the scanner 2 from the image storage unit 410 and sends them to the information input device 300. The information is displayed on the display unit 310 included in the information input device 300. Note that the image presentation unit 113 may display only the captured image captured by the scanner 2 on the display unit 310 provided in the information input device 300. That is, the image presentation unit 113 causes the display unit 310 to display at least a captured image captured by the scanner 2.

  The input information acquisition unit 114 acquires, from the information input device 300, input information input corresponding to the captured image displayed on the display unit 310 by the image presentation unit 113. For example, an operator who operates the information input device 300 selects a captured image captured by the scanner 1 or a captured image captured by the scanner 2 displayed on the display unit 310, and visually checks the selected captured image, thereby delivering the delivery destination information. And the recognized delivery destination information is input from the operation unit 320 of the information input device 300. The information input device 300 transmits the input information input from the operation unit 320 to the reading processing unit 110. Then, the input information acquisition unit 114 of the reading processing unit 110 acquires the input information input from the operation unit 320 (that is, the delivery destination information input by the operator) from the information input device 300.

  The information input device 300 has information that can identify whether the captured image selected by the operator to read the delivery destination information is the captured image captured by the scanner 1 or the captured image captured by the scanner 2. The included selection information may be stored in the selection information storage unit 420 included in the storage unit 400. Further, the input information acquisition unit 114 may receive this selection information from the information input device 300 and store it in the selection information storage unit 420. The selection information may be stored in the selection information storage unit 420 by the information input device 300. Further, the storage location of the selection information described above may be a storage medium provided in the information input device 300 or a storage medium provided in another device (for example, the information reading device 100).

  The result output unit 115 outputs the recognition result of the recognition unit 112 or the input information acquired by the input information acquisition unit 114 to the sorting processing unit 200 as a reading result of the delivery destination information. That is, when the recognition unit 112 recognizes the delivery destination information, the result output unit 115 sets the recognition result as the delivery destination information read result, and when the recognition unit 112 cannot recognize the delivery destination information, The input information input by the operator by viewing the captured image is taken as the result of reading the delivery destination information.

The sorting processing unit 200 identifies the sorting destination of the article 20 based on the delivery destination information of the article 20 read by the information reading device 100, and the sorting unit 200 sends the article 20 to the identified sorting destination. And give instructions. For example, the sorting processing unit 200 includes a sorting unit 210 and a transport control unit 220. When the sorting unit 210 obtains the reading result of the delivery destination information from the information reading device 100, the sorting unit 210 selects the sorting destination of the article 20 among a plurality of predetermined sorting destinations based on the obtained reading result (delivery destination information). Identify.
Here, the plurality of predetermined division destinations are division destinations divided for each delivery route based on the area of the delivery destination, and are stored in the storage unit 400, for example.
The conveyance control unit 220 transmits to the conveyance unit 30 instruction information that instructs the article 20 to be conveyed to the sorting destination specified by the sorting unit 210.

(Operation of classification processing)
Next, with reference to FIG. 2, the operation of the sorting process performed in the sorting system 10 according to the present embodiment will be described. FIG. 2 is a flowchart illustrating an example of the sorting process according to the present embodiment. This figure shows the basic flow of the process of sorting the courier goods 20 according to the delivery destination in the sorting system 10 shown in FIG. For example, the articles 20 collected by the delivery company via the primary receiving place are placed on the conveyor 31 and the sorting process is started.

  First, the information reading apparatus 100 executes processing for reading the delivery destination information described in the form 21 attached to the article 20. Specifically, each of the two series of scanners, the scanner 1 and the scanner 2, photographs the article 20 being carried on the conveyor 31 and outputs the photographed photographed image. The image acquisition unit 111 acquires captured images output from the scanner 1 and the scanner 2 and stores the acquired captured images in the image storage unit 410. At this time, the image acquisition unit 111 stores the image captured by the scanner 1 and the image captured by the scanner 2 in the image storage unit 410 so as to be distinguishable (for example, in association with identification information) (step S10).

  Next, the recognizing unit 112 reads a captured image obtained by the scanner 1 acquired by the image acquiring unit 111 from the image storage unit 410 and recognizes delivery destination information described in the form 21 attached to the article 20 from the captured image. Processing is performed (step S20). For example, the recognition unit 112 recognizes character information as delivery destination information from an image captured by the scanner 1 by OCR. Note that the recognition unit 112 may recognize a barcode as delivery destination information from the image captured by the scanner 1. Further, the recognition unit 112 may recognize a barcode obtained by encoding the delivery destination information using an external device (not shown) provided with a laser or the like.

Next, the recognizing unit 112 determines whether or not the delivery destination information has been recognized, that is, whether or not the recognition has succeeded (step S30).
When it is determined in step S30 that the recognition has succeeded (step S30: YES), the result output unit 115 acquires the recognition result from the recognition unit 112 and outputs the recognition result of the delivery destination information of the article 20 to the classification processing unit 200. (Step S50).

On the other hand, when the recognition unit 112 cannot recognize the delivery destination information, it is determined in step S30 that the recognition has failed. If it is determined in step S30 that the recognition has failed (step S30: NO), the process proceeds to a video coding process (step S40) in which the operator visually recognizes and reads the delivery destination information.
In the process of step S40, first, the image presentation unit 113 reads the image captured by the scanner 1 and the image captured by the scanner 2 from the image storage unit 410 and sends them to the information input device 300, and the display provided in the information input device 300 is provided. The data is displayed on the part 310 (step S41).

  Next, the operator selects a photographed image that can visually recognize the delivery destination information of the article 20 from the photographed image by the scanner 1 and the photographed image by the scanner 2 displayed on the display unit 310 (step S42). . Thereby, the display unit 310 displays the selected captured image in an enlarged manner. At this time, the information input device 300 causes the selection information storage unit 420 to store selection information including information that can identify whether the selected captured image is an image captured by the scanner 1 or an image captured by the scanner 2. May be.

  Subsequently, the operator recognizes and reads the delivery destination information of the article 20 from the captured image enlarged and displayed on the display unit 310, and inputs the read delivery destination information from the operation unit 320. The information input device 300 transmits the input information input from the operation unit 320 to the reading processing unit 110. Then, the input information acquisition unit 114 of the reading processing unit 110 acquires the input information input from the operation unit 320 (that is, the delivery destination information input by the operator) from the information input device 300 (step S43).

  And the result output part 115 outputs the input information which the input information acquisition part 114 acquired with respect to the classification | category process part 200 as a reading result of the delivery destination information of the articles | goods 20 (step S50). As described above, when the recognition unit 112 recognizes the delivery destination information, the information reading apparatus 100 outputs the recognition result as the delivery destination information read result, and the recognition unit 112 cannot recognize the delivery destination information. In this case, the input information input by the operator by viewing the captured image is output as the delivery destination information reading result.

  The sorting processing unit 200 identifies the sorting destination of the article 20 based on the reading result of the delivery destination information output from the information reading device 100, and sends the sorting 20 to the carrying unit 30 so that the article 20 is transported to the identified sorting destination. An instruction is given (step S60). In response to this instruction, the conveyance unit 30 conveys the article 20 to the specified sorting destination.

(Details of recognition processing)
Next, the operation of the recognition process executed by the information reading apparatus 100 will be described in detail with reference to FIG.
FIG. 3 is a flowchart showing a detailed example of the recognition process in step S20 shown in FIG.
Here, in addition to the function that the information reading apparatus 100 recognizes the delivery destination information based on the character information by the OCR process, the barcode which encoded the delivery destination information using an external device (not shown) provided with a laser or the like. It has a function to recognize In addition, it is assumed that the form 21 attached to the article 20 includes a barcode as delivery destination information and character information (such as an address).

  First, the recognition unit 112 acquires a barcode recognition result as delivery destination information from an external device (step S21). The recognition unit 112 determines whether or not the barcode has been successfully recognized based on the acquired recognition result (step S22). If it is determined in step S22 that the barcode recognition has failed (step S22: NO), the recognition unit 112 reads out the image (OCR image) taken by the scanner 1 from the image storage unit 410 (step S23). Then, barcode image recognition processing is performed on the read photographed image (step S24).

  The recognition unit 112 determines whether or not the barcode has been successfully recognized based on the result of the barcode image recognition processing (step S25). If it is determined in step S25 that barcode recognition has failed (step S25: NO), the recognition unit 112 recognizes character information (such as an address) as delivery destination information from the image captured by the scanner 1 by OCR. Recognition processing is performed (step S26).

  Next, the recognition unit 112 determines whether or not the character information (such as an address) has been successfully recognized by OCR (step S27). If it is determined in step S27 that recognition of character information by OCR has failed (step S27: NO), the recognition unit 112 outputs information indicating that the recognition has failed, and ends the recognition process (step S27). S28). Then, the process proceeds to video coding processing (step S40 in FIG. 2) in which the operator visually recognizes and reads the delivery destination information.

  On the other hand, if it is determined in step S22 that the barcode recognition has succeeded (step S22: YES), if it is determined in step S25 that the barcode recognition has succeeded (step S25: YES), or step S27. If it is determined that the recognition of the character information by OCR is successful (step S27: YES), the recognition unit 112 outputs a recognition result to the result output unit 115 as information indicating that the recognition is successful, and performs a recognition process. Is finished (step S28).

  In the example shown in FIG. 3, the barcode recognition process by the external device, the barcode recognition process based on the photographed image, and the character information (address etc.) recognition process based on the photographed image are performed in this order. Although the example which performs a process was demonstrated, there is no restriction | limiting in this order, You may replace.

  Moreover, although it demonstrated as a recognition process which recognizes barcode and character information (address etc.), it is not restricted to this, It is good also as a recognition process which recognizes one of barcode and character information (address etc.). . Furthermore, there may be a configuration in which there is no recognition processing (recognition processing that the information reading apparatus 100 automatically recognizes) that the recognition unit 112 recognizes these barcodes and character information (such as an address). Processing may be performed.

(Description of video coding process)
Next, a display example of a photographed image displayed on the display unit 310 in the video coding process (step S40 in FIG. 2) in which the operator visually recognizes and inputs the delivery destination information will be described.

  FIG. 4 shows a first display example of the captured image displayed on the display unit 310. FIG. 4 shows a display example of the display unit 310 when both the scanner 1 and the scanner 2 are functioning normally, and the recognition unit 112 cannot recognize the delivery destination information. Here, the case where the scanner 1 is functioning normally but the recognition unit 112 cannot recognize the delivery destination information satisfies, for example, the image quality that can be recognized by the OCR because the image is taken with the focus slightly deviated. If not. In such a case, even if recognition by OCR fails, the operator may be able to visually recognize and read.

The display example indicated by the reference numeral 310a is an example of a display screen displayed on the display unit 310 in step S41 of FIG. 2, and a photographed image by the scanner 1 and a photographed image by the scanner 2 are displayed. Here, a photographed image (reference A) of the upper surface of the article 20 photographed by the scanner 1, a photographed image (reference B) of the right side, a photographed image (reference C) of the left side, and the article 20 photographed by the scanner 2. A photographed image (symbol D) on the upper surface, a photographed image (symbol E) on the right side, and a photographed image (symbol F) on the left side are displayed side by side. Note that the image captured by the scanner 1 is a high-quality image whose shape has been corrected for an image captured by the line scan method.
On the other hand, the image captured by the scanner 2 is an image without shape correction that is captured by the area scan method.

  In the example shown in FIG. 4, both the photographed image by the scanner 1 and the photographed image by the scanner 2 are normally photographed. Therefore, the operator selects, for example, a photographed image (symbol A) on the upper surface by the scanner 1 that should be selected at a normal time with high image quality (corresponding to step S42 in FIG. 2). The selection method may be a method by key input or a method of selecting on the screen by a mouse operation. A photographed image (reference A) on the upper surface of the selected scanner 1 is enlarged and displayed as indicated by reference numeral 310b. The video coding process is completed when the operator inputs the delivery destination information visually confirmed based on the enlarged image.

  The selection information storage unit 420 included in the storage unit 400 includes selection information including information that can identify whether the selected captured image is a captured image captured by the scanner 1 or a captured image captured by the scanner 2. Is remembered. The selection information and the captured image described above may be combined and stored in the storage unit 400 or the storage medium described above. Here, the stored captured image may be an image that has been subjected to compression or partial cropping in order to reduce the storage capacity. Further, depending on the selected photographed image (for example, when an image to be selected at normal time when there is no abnormality in the scanner 1 is selected), saving of the image may be omitted.

  FIG. 5 shows a second display example of the captured image displayed on the display unit 310. FIG. 5 shows a display example of the display unit 310 in a case where an abnormality has occurred in a photographed image by the scanner 1 and the recognition unit 112 cannot recognize the delivery destination information.

In the display example indicated by reference numeral 310c, similarly to the display example indicated by reference numeral 310a in FIG. 4, a photographed image by the scanner 1 and a photographed image by the scanner 2 obtained by photographing the upper surface, the right side surface, and the left side surface of the article 20 are arranged. It is displayed. 4 differs from the display example indicated by reference numeral 310a in FIG. 4 in that an abnormality has occurred in the captured image (reference numeral A) on the upper surface of the article 20 photographed by the scanner 1 (for example, the correction process has failed) and is normal. It is a point that is not an image photographed.
It is difficult for the operator to visually recognize the delivery destination information even when the photographed image (symbol A) on the upper surface of the article 20 photographed by the scanner 1 is selected. For this reason, a photographed image (symbol D) on the upper surface by the scanner 2 is selected. A photographed image (symbol D) on the upper surface of the selected scanner 2 is enlarged and displayed as denoted by reference numeral 310d. The video coding process is completed when the operator inputs the delivery destination information visually confirmed based on the enlarged image.

  It should be noted that when selecting a photographed image, selection information is stored in the same manner as when the scanner 1 shown in FIG. 4 is normal. When the selected photographed image is also stored, in addition to the method for reducing the storage capacity described above, the photographed image of the surface corresponding to the surface of the photographed image by the selected scanner 2 among the images photographed by the scanner 1. It is also possible to save only. That is, in the example shown in this figure, since the upper surface photographed image (symbol D) by the scanner 2 is selected, only the upper surface photographed image (symbol A) by the scanner 1 may be stored.

  As described above, the information reading apparatus 100 according to the present embodiment is a captured image (an example of a first captured image) of an article 20 (an example of an object) captured by the scanner 1 (an example of a first imaging unit). And a photographed image (an example of the second photographed image) of the article 20 photographed by the scanner 2 (an example of the second photographing unit), and the delivery destination information (the article 20) based on the photographed image by the scanner 1 When it is not possible to recognize an example of display information), at least a photographed image by the scanner 2 is displayed, and the operator can visually input the delivery destination information.

Thus, for example, even when the image captured by the automatic recognition scanner 1 is broken due to a failure in correction processing, the operator visually reads and inputs the delivery destination information from the image captured by the scanner 2. can do.
As described above, the information reading apparatus 100 according to the present embodiment can improve the reading rate of the delivery destination information because the operator can check the image captured by another type of scanner even when the automatic recognition fails. .

  Further, the sorting system 10 according to the present embodiment sorts the articles 20 based on the result of reading the delivery destination information by the information reading device 100 described above. Thereby, the sorting system 10 according to the present embodiment can improve the efficiency of the sorting process.

  In the present embodiment, the processing up to the courier service can be performed independently. Further, the system configuration shown in FIG. 1 is representative, and each component may be configured integrally with the same computing device, or may be configured separately in different computing devices. Moreover, it is good also as a structure by which each component is connected via a communication network.

  Further, in the present embodiment, it is desirable that the two systems of scanners shoot using a different sensing method (in this embodiment, a line scan method and an area scan method) for the shooting range of the object. If the same type of sensing method is not used, even if an image that cannot be used to visually confirm the shipping address information (such as an address) is acquired by one sensing method, the shipping address information (such as an address) is correctly detected using the other sensing method. This is because the possibility that the operator can input the delivery destination information (address, etc.) by visual confirmation increases.

  Moreover, the usage example of the captured image captured by the line scan method and the captured image captured by the area scan method is merely an example, and is not limited thereto. For example, a photographed image photographed by the area scan method may be used for automatic recognition by OCR or the like.

Further, the sensing method of the two scanners of the scanner 1 and the scanner 2 may be the same method. For example, both the scanner 1 and the scanner 2 may be an area scan method. In that case, it is desirable that the captured image captured by the scanner 1 has a higher resolution than the captured image captured by the scanner 2.
Further, both the scanner 1 and the scanner 2 may be a line scan method. Further, the scanner 2 may be omitted, and only the scanner 1 may be provided. In this case, the corrected image of the image captured by the line scan type scanner 1 is used as a captured image used for automatic recognition by OCR or the like, and the uncorrected image is used as a captured image for visual confirmation by the operator. May be. That is, in this embodiment, one of the captured images generated by different generation processes is used for at least automatic recognition by OCR or the like, and at least the other captured image for visual confirmation by the operator (photographing used for video coding processing). Image).

  Further, in the present embodiment, the configuration including two systems of scanners has been described as an example. However, a configuration including three or more systems of scanners may be used, and the same processing as the processing according to the above embodiment may be easily expanded. Can do.

  The storage unit 400 illustrated in FIG. 1 may be provided in any of the information reading device 100, the sorting processing unit 200, or the information input device 300, or may be provided separately. The storage unit 400 may be connected to the information reading device 100, the sorting processing unit 200, or the information input device 300 via a communication network.

  In the present embodiment, the example in which the information reading apparatus 100 is applied to the processing for reading the delivery destination information of the courier in the sorting system 10 has been described. However, the information reading apparatus 100 may be applied to other systems. Since the information reading apparatus 100 according to the present embodiment can improve the reading efficiency of display information associated with an object, the information reading apparatus 100 can be applied to various systems that use the reading result of display information. Processing efficiency can be improved. For example, the present invention may be applied to a system that reads and stores serial numbers of a large number of banknotes, or may be applied to a system that collates read serial numbers.

<Second Embodiment>
Next, a second embodiment will be described. The configuration of the sorting system according to the present embodiment is different from the sorting system 10 according to the first embodiment in that the diagnostic device 500 is provided.
FIG. 6 is a configuration diagram illustrating an example of a schematic configuration of the sorting system 10A according to the present embodiment.
In FIG. 6, components corresponding to those in FIG. 1 are denoted by the same reference numerals, and description thereof is omitted.

The diagnostic apparatus 500 includes a failure diagnosis unit 510 and a warning display unit 520 (an example of a warning unit), and diagnoses a scanner failure.
The failure diagnosis unit 510 indicates whether the photographed image selected by the video coding process in which the operator visually recognizes and reads the delivery destination information is the photographed image by the scanner 1 or the photographed image by the scanner 2. A failure of the scanner 1 is diagnosed based on the selection information. That is, the failure diagnosis unit 510 selects any one of the captured image captured by the scanner 1 and the captured image captured by the scanner 2 when the input information is input by the operator in the information input device 300. On the basis of the selection information indicating whether or not, a failure in the process of generating a captured image by the scanner 1 is diagnosed.

  The warning display unit 520 outputs a warning display when the failure diagnosis unit 510 diagnoses that there is a suspicion of failure in the process of generating a captured image by the scanner 1.

Next, a first example and a second example will be described as specific examples of the failure diagnosis method.
(First example of failure diagnosis method)
The failure diagnosis unit 510 generates a photographed image by the scanner 1 when the ratio of selection of the photographed image by the scanner 2 is equal to or higher than a preset ratio among a plurality of selection information stored in the selection information storage unit 420. Diagnose that the process is suspected of malfunctioning (ie, abnormal).

For example, it is assumed that the number of times a photographed image by the scanner 1 is selected is 3500 times, and the number of times a photographed image by the scanner 2 is selected is 15 times. The selection ratio of the scanner 2 at this time is
15 ÷ (3500 + 15) ≒ 0.0043
It becomes.
If the ratio that is determined to be abnormal is set to a specified value of 0.2 or more, in this case, the selection ratio of the scanner 2 is less than the specified value of 0.2, so that it is determined to be normal.

On the other hand, for example, it is assumed that the number of times the scanner 1 is selected for the photographed image on the right side is 250 times, and the number of times the scanner 2 is selected is 200 times. The selection ratio of the scanner 2 at this time is
200 / (250 + 200) ≈0.4444
It becomes.
If the ratio for determining an abnormality is set to a specified value of 0.2 or more, in this case, the selection ratio of the scanner 2 is set to a specified value of 0.2 or more, so it is determined that the scanner 1 is suspected of being abnormal. Is done.

(Second example of failure diagnosis method)
The failure diagnosis unit 510 uses the scanner 1 when the number of times the image taken by the scanner 2 is selected is greater than or equal to a preset number based on a plurality of selection information stored in the selection information storage unit 420. It is diagnosed that there is a suspicion of failure in the process of generating a captured image (that is, abnormality). For example, if the specified value of the number of times a photographed image is selected by the scanner 2 is set to 100 or more, it is determined as abnormal when the number of times a photographed image is selected by the scanner 2 is 100 or more (for example, 200). Alternatively, when the number of selections exceeds 100, it is determined to be abnormal.

(Operation of fault diagnosis processing)
Next, the operation of the failure diagnosis process according to the present embodiment will be described with reference to FIG.
FIG. 7 is a flowchart illustrating an example of a failure diagnosis process according to the present embodiment.

  First, the failure diagnosis unit 510 acquires a plurality of selection information stored in the selection information storage unit (step S110). This indicates that a plurality of selection information stored during the video coding process for each article 20 of the courier is accumulated. As described above, the selection information includes information that can identify the captured image selected by the video coding process (step S40 in FIG. 2) with which scanner.

  Next, the failure diagnosis unit 510 diagnoses a failure in the process of generating a captured image by the scanner 1 by analyzing the acquired plurality of selection information. For example, the failure diagnosis is performed by the first or second example of the failure diagnosis method described above (step S120).

  Subsequently, the diagnostic apparatus 500 outputs a diagnostic result (step S130) and ends the diagnostic process. For example, if it is determined in step S120 that there is a suspicion of failure in the process of generating a captured image by the scanner 1, the warning display unit 520 displays a warning display for notifying that there is an abnormality. If it is diagnosed that there is no suspicion of failure in the process of generating a captured image by the scanner 1, the warning display unit 520 may display that there is no abnormality.

  When the warning display due to abnormality is performed as described above, specifically, the number of the scanner suspected of abnormality and the installation location are displayed on a display device (for example, the warning display unit 520) attached to the sorting system 10A. May be displayed as a warning. Alternatively, when communication is possible with a maintenance center or the like, system information (for example, “Kawasaki Processing Base No. 3”), scanner information (for example, “the right side camera of the scanner 1”), a corresponding image (for example, the camera 1) , “A group of captured images of the scanner 1 that has not been selected”) may be transmitted. When the operator or maintenance staff receives the notification, the operator or the maintenance staff may directly check the status of the corresponding scanner, or refer to the captured image group of the scanner that was not selected during the video coding process and capture the suspected malfunction. It is also possible to visually check the image. Since the mechanism allows visual confirmation of the photographed image, for example, the photographed image is blurred because the shape cannot be detected, some pixels of the line sensor are broken, or the lighting is turned off. It is possible to immediately confirm any failure such as whether it is dark and invisible.

  Further, when displaying a photographed image of a scanner suspected of malfunctioning, the visual confirmation work may be made efficient by using an image display tool or the like. If the scanner itself has a failure display function, a failure display instruction signal may be sent to the scanner itself to display the failure display. Regarding the warning display, it is only necessary for the operator or maintenance personnel to be aware of the suspicion of failure, so the warning (notification) method by display is an example, and the warning (notification) method is not limited to display. . For example, instead of the warning display, a warning sound or a voice output of a warning message may be used.

As described above, the sorting system 10A according to the present embodiment is based on whether the photographed image selected by the operator when reading the delivery destination information is the photographed image by the scanner 1 or the photographed image by the scanner 2. The failure diagnosis of the scanner 1 is performed. For example, the sorting system 10 </ b> A diagnoses that the scanner 1 is suspected of malfunctioning when the ratio and the number of times that images taken by the scanner 2 are selected increase.
As described above, since the sorting system 10A according to the present embodiment can diagnose a failure of the scanner 1 based on the selection history of the captured image by the operator, it is possible to suppress the processing from being continued while leaving the failure. be able to. Further, since a captured image can be confirmed immediately when a failure occurs in the scanner 1, it is possible to grasp the failure state and speed up the response to the failure.

  In the above-described embodiment, the configuration example in which the diagnosis apparatus 500 having a configuration different from the configuration for performing the classification processing such as the information reading device 100, the classification processing unit 200, and the information input device 300 performs the failure diagnosis processing has been described. Any one of the information reading device 100, the classification processing unit 200, and the information input device 300 may perform a failure diagnosis process. That is, any of the information reading device 100, the classification processing unit 200, and the information input device 300 may include a configuration corresponding to the failure diagnosis unit 510 or the warning display unit 520.

  As mentioned above, although some embodiment of this invention was described, these embodiment is shown as an example and is not intending limiting the range of invention. These embodiments can be implemented in various other forms, and various omissions, replacements, and changes can be made without departing from the spirit of the invention. These embodiments and modifications thereof are included in the scope and gist of the invention and are also included in the invention described in the claims and the equivalents thereof.

  The information reading apparatus 100 or the sorting system 10 (10A) described above has a computer inside. Then, a program for realizing the functions of the information reading apparatus 100 or the sorting system 10 (10A) is recorded on a computer-readable recording medium, and the program recorded on the recording medium is read by the computer system. The processing by the information reading apparatus 100 or the sorting system 10 (10A) described above may be performed by executing. Here, the “computer system” includes an OS and hardware such as peripheral devices. Further, the “computer system” may include a plurality of computer devices connected via a network including a communication line such as the Internet, WAN, LAN, and dedicated line. The “computer-readable recording medium” refers to a storage device such as a flexible medium, a magneto-optical disk, a portable medium such as a ROM and a CD-ROM, and a hard disk incorporated in a computer system. Furthermore, the “computer-readable recording medium” holds a program for a certain period of time, such as a volatile memory (RAM) inside a computer system that becomes a server or a client when the program is transmitted via a network. Including things. The program may be for realizing a part of the functions described above. Furthermore, what can implement | achieve the function mentioned above in combination with the program already recorded on the computer system, what is called a difference file (difference program) may be sufficient.

  In addition, some or all of the functions described above may be realized as an integrated circuit such as an LSI (Large Scale Integration). Each function described above may be individually made into a processor, or a part or all of them may be integrated into a processor. Further, the method of circuit integration is not limited to LSI, and may be realized by a dedicated circuit or a general-purpose processor. In addition, when an integrated circuit technology that replaces LSI appears due to the advancement of semiconductor technology, an integrated circuit based on the technology may be used.

DESCRIPTION OF SYMBOLS 1 Scanner (1st imaging | photography part), 2 Scanner (2nd imaging | photography part) 10, 10A Sorting system, 20 articles | items, 21 forms, 30 conveyance parts, 31 conveyors, 32 conveyance drive parts, 1
00 information reading device, 110 reading processing unit, 111 image acquisition unit (acquisition unit), 112 recognition unit, 113 image presentation unit, 114 input information acquisition unit, 115 result output unit, 200 sorting processing unit, 210 sorting unit, 220 transport Control unit, 300 information input device, 310 display unit, 320 operation unit, 400 storage unit, 410 image storage unit, 420 selection information storage unit,
500 diagnostic device, 510 diagnostic processing unit, 520 warning display unit (warning unit)

Claims (7)

A first photographing unit that outputs a first photographed image obtained by photographing a target with a line sensor;
A second photographing unit that outputs a second photographed image obtained by photographing the object with an area sensor;
A recognition unit for recognizing display information associated with the object based on the first captured image;
An image presentation unit that transmits at least the second captured image to the display unit when the recognition unit cannot recognize the display information;
An input information acquisition unit for acquiring input information input corresponding to a captured image transmitted by the image presentation unit to the display unit;
A result output unit that outputs the recognition result of the recognition unit or the input information acquired by the input information acquisition unit as a read result of the display information;
The recognizing unit recognizes the display information of the first notation associated with the object based on the first captured image, and when the display information of the first notation is unrecognizable, Recognizing the display information in a second notation associated with the object;
Information reader. The information reading apparatus according to claim 1, wherein the first notation is identification information obtained by encoding a delivery destination, and the second notation is character information of the delivery destination. The first photographed image is a photographed image after performing a specific correction process on the photographed image obtained by photographing the object,
The information reading apparatus according to claim 1, wherein the second captured image is an image in which the specific correction processing is not performed on a captured image obtained by capturing the target object. A plurality of the first photographing units installed at different positions,
The information reading apparatus according to any one of claims 1 to 3, further comprising: A plurality of the second photographing units installed at different positions,
The information reading apparatus according to claim 1, further comprising: An information reading apparatus according to any one of claims 1 to 5,
Based on a result of reading the display information by the information reading device, a sorting unit that identifies a sorting destination of the object among a plurality of predetermined sorting destinations;
A transport unit for transporting the object to the sorting destination identified by the sorting unit;
A sorting system comprising:   A sorting system comprising an information reading device and an information input device,
  The information reader is
  A first photographing unit that outputs a first photographed image obtained by photographing a target with a line sensor;
  A second photographing unit that outputs a second photographed image obtained by photographing the object with an area sensor;
  A recognition unit for recognizing display information associated with the object based on the first captured image;
  An image presentation unit that transmits the first captured image and the second captured image to the information input device when the recognition unit cannot recognize the display information;
  An input information acquisition unit for acquiring input information input corresponding to the captured image transmitted to the information input device;
  A result output unit that outputs the recognition result of the recognition unit or the input information acquired by the input information acquisition unit as a read result of the display information;
  The information input device includes:
  Of the first photographed image and the second photographed image transmitted from the information reader, the selected photographed image is enlarged and displayed.
  Transmitting input information input corresponding to the captured image enlarged and displayed on the display unit to the information reading device;
  Classification system.

Images