JP6852544B2 - Programs, information processing equipment, and systems - Google Patents

Description

The present invention relates to a program of an information processing device that processes read data.

For example, Patent Document 1 discloses a multifunction device that scans a document on which a barcode is recorded with a scanner to generate scan data, analyzes the barcode contained in the scan data, and executes processing according to the analysis result. ing. And Patent Document 1 describes that a desired processing result can be obtained only by randomly placing a plurality of manuscripts on a manuscript stand.

Japanese Unexamined Patent Publication No. 2007-081650

A user who uses the multifunction device described in Patent Document 1 needs to attach a barcode for executing a desired process to a manuscript and then place the manuscript on a manuscript stand. However, the barcode can determine the meaning and content only after image processing is performed by a predetermined algorithm, and it is extremely difficult for the user to determine the meaning and content at first glance. That is, the technique of Patent Document 1 has a problem that the work load of the user for confirming whether or not an appropriate barcode is attached to the manuscript is heavy.

The present invention has been made in view of the above circumstances, and an object of the present invention is to provide a technique for reducing a user's workload when a server is made to process read data based on information held by an information holding image. ..

Various disclosures are made herein. The program, which is one of the disclosure examples, can be executed by a computer having a memory and a communication interface. The program causes the computer to execute an acquisition process for acquiring read data. The scanned data is a scan in which a document in which at least one of a plurality of character strings, each of which corresponds to one of a plurality of items, and a plurality of visually distinguishable marks is recorded, is connected to the computer. This is the data read and generated by the device. The program performs a detection process for detecting one of the plurality of marks in the scanned image indicated by the scanned data acquired in the acquisition process, and the memory in association with each of the plurality of marks. Of the plurality of item information that is stored and each indicates one of the plurality of items, the corresponding item information corresponding to the one mark detected by the detection process is read from the memory, and the read process is performed. An extraction process for extracting the character string corresponding to the item indicated by the corresponding item information read by the read process from the read image by the first algorithm, and an information holding for holding the character string extracted by the extraction process. The computer is made to execute a generation process for generating an image. The information holding image is an image in a format in which the character string can be extracted by the second algorithm. The program obtains the read image and output data including the information holding image in order to cause a server capable of executing the process by the second algorithm to analyze the read image according to the character string held by the information holding image. The computer is made to execute a transmission process of transmitting to the server through the communication interface.

Since the user only needs to add a desired mark among a plurality of visually distinguishable marks to the manuscript, it is easier to determine whether or not the mark added to the manuscript is appropriate as compared with the case of adding a barcode. Can be confirmed. On the other hand, the server can analyze the read image according to the character string held by the information holding image as in the conventional case. That is, according to the above configuration, the workload of the user can be reduced without changing the processing of the existing server.

FIG. 1 is a block diagram of the system 100 according to the embodiment. FIG. 2 is a diagram showing an example of an item list stored in the memory 62. FIG. 3 is a sequence diagram showing an outline of processing of the system 100. FIG. 4 is a flowchart of the barcode composition process. 5A and 5B are examples of invoices 110 and 120 read by the scanner 10. FIG. 5A shows the invoice 110 with the mark 111 added, and FIG. 5B shows the invoice 120 with the mark 121 added. .. FIG. 6 is an example of an edit scan image shown by the edit scan data generated by the barcode composition process, in which (A) is an example in which the mark 111 is replaced with the barcode image 112, and (B) is the mark 121. Is replaced with the barcode image 122.

Hereinafter, embodiments of the present invention will be described with reference to the drawings as appropriate. It goes without saying that the embodiments described below are merely examples of the present invention, and the embodiments of the present invention can be appropriately changed without changing the gist of the present invention.

FIG. 1 is a schematic view of the system 100 according to the present embodiment. The system 100 shown in FIG. 1 is composed of one or more scanners 10, a relay server 50, and analysis servers 80A and 80B (these may be collectively referred to as "analysis server 80"). ing. The scanner 10, the relay server 50, and the analysis server 80 can communicate with each other via the communication network 101. Specific examples of the communication network 101 are not particularly limited, but may be, for example, the Internet, a wired LAN, a wireless LAN, or a combination thereof.

The scanner 10 is hardware that reads an image recorded on a document set on a contact glass or an ADF and generates scan data indicating the image. Further, the scanner 10 can transmit the generated scan data to an external device (for example, a relay server 50) connected through the communication network 101. The scanner 10 is an example of a reading device. However, the specific example of the scanning device is not limited to the scanner 10, and may be a camera that captures an image recorded on a document and generates captured data. The scan data and the photographed data are examples of the scanned data, and the images shown by the scan data and the photographed data are examples of the scanned images.

As shown in FIG. 1, the relay server 50 mainly includes a display 53, an input I / F 54, a communication I / F 55, a CPU 61, a memory 62, and a communication bus 63. The components constituting the relay server 50 are connected to each other through the communication bus 63. The relay server 50 may be, for example, a PC.

The display 53 is a liquid crystal display, an organic EL display, or the like, and includes a display screen for displaying various information. The input I / F 54 is a user interface that accepts input operations by the user. Specifically, the input I / F 54 is a keyboard, a mouse, a touch sensor superimposed on the display 53, or a combination thereof.

The communication I / F 55 is an example of a communication interface capable of communicating with an external device through the communication network 101. That is, the relay server 50 transmits various information to the external device through the communication I / F55, and receives various information from the external device through the communication I / F55. The specific configuration of the communication I / F 55 is not particularly limited, but for example, it is a LAN interface to which a LAN cable is attached / detached, or an antenna that transmits / receives a wireless signal conforming to Wi-Fi (registered trademark).

The CPU 61 controls the overall operation of the relay server 50. The CPU 61 reads various programs described later from the memory 62 and executes them based on various information input through the input I / F 54, various information received from the external device through the communication I / F 55, and the like. The CPU 61 and the memory 62 form an example of the controller.

The memory 62 stores the OS 64 and the server program 65. The server program 65 may be a single program or a collection of a plurality of programs. Further, the memory 62 stores data or information necessary for executing the server program 65. The memory 62 is composed of, for example, a RAM, a ROM, an EEPROM, an HDD, a portable storage medium such as a USB memory attached to and detached from the relay server 50, a buffer included in the CPU 61, or a combination thereof.

The memory 62 may be a computer-readable storage medium. A computer-readable storage medium is a non-transitory medium. In addition to the above examples, the non-transitory medium also includes a recording medium such as a CD-ROM or a DVD-ROM. The non-transitory medium is also a tangible medium. On the other hand, an electric signal that carries a program downloaded from a server on the Internet is a computer-readable signal medium, which is a kind of computer-readable medium, but is a storage that can be read by a non-transitory computer. Not included in the medium.

The memory 62 can store, for example, the item list shown in FIG. The item list contains one or more item records. The item record is registered in the item list through the input I / F 54 by, for example, the administrator of the relay server 50. The item record includes, for example, color information, item information, and server ID. That is, the memory 62 stores a plurality of sets of item information and server IDs in association with each of the plurality of colors constituting the mark. In other words, the memory 62 stores a plurality of sets of item information and server IDs in association with each of the plurality of marks.

The color information is information indicating the colors (for example, red, yellow, and blue) of the marks 111 and 121, which will be described later. The item record may include shape information indicating the shape of the mark in addition to the color information or in place of the color information. The item information is information indicating items (for example, date, transfer destination, expense item, billing amount) included in a manuscript (for example, an invoice) described later. The server ID is information that identifies the analysis servers 80A and 80B. In the present embodiment, the analysis server 80A is identified by the server ID "server A", and the analysis server 80B is identified by the server ID "server B". The server ID may be, for example, an IP address or a URL.

The analysis server 80 analyzes the image data received from the relay server 50. The image data received by the analysis server 80 includes barcode images 112 and 122, for example, as shown in FIG. Then, the analysis server 80 extracts the information held by the barcode images 112 and 122, and analyzes the image data based on the extracted information. Further, "analysis of image data" is, for example, classification of image data, aggregation of information contained in image data, or a combination thereof. The specific operation of the analysis server 80 will be described later.

The barcode images 112 and 122 are examples of information-holding images that hold information. Further, the barcode images 112 and 122 are images in a format in which information can be extracted by a predetermined image processing algorithm. The image processing algorithm for extracting information from the barcode images 112 and 122 is an example of the second algorithm. However, the information held by the barcode images 112 and 122 cannot be extracted at first glance by the user, and requires image processing by a computer. Further, the specific example of the information holding image is not limited to the barcode, and may be a QR code (registered trademark), Data Matorix, or the like. In other words, the information holding image may be an image representing a so-called two-dimensional bar code.

[Operation of system 100]
The operation of the system 100 according to the present embodiment will be described with reference to FIGS. 3 and 4.

The flowchart of the present specification basically shows the processing of the CPU 61 according to the instruction described in the program. That is, the processing of "judgment", "extraction", "selection", "calculation", "decision", "specification", "control", "acquisition", "acceptance", etc. in the following description is the processing of the CPU 61. Represents. The processing by the CPU 61 also includes hardware control via the OS 64. Note that "acquisition" is used in a concept that does not require a request. That is, the process of receiving data without the CPU 61 requesting is also included in the concept of "the CPU 61 acquires the data". Further, the "data" in the present specification is represented by a bit string that can be read by a computer. Then, data having the same substantial meaning and contents but different formats are treated as the same data. The same applies to "information" in the present specification.

First, considering the case where the system 100 shown in FIG. 1 is introduced into a company, scanners 10 are installed at each of a plurality of bases (for example, branch offices and stores), and the relay server 50 and the analysis server 80 are head offices or data centers. Will be installed in. Then, the relay server 50 receives the scan data from the scanner 10 at each base, executes the bar code synthesis process shown in FIG. 4 on the received scan data, and the scan data edited by the bar code synthesis process ( Hereinafter, it is referred to as “edit scan data”) to be transmitted to the analysis server 80. In the present embodiment, an example will be described in which the scanner 10 reads the invoices 110 and 120 shown in FIG. 5, generates the edit scan data shown in FIG. 6, and causes the analysis server 80 to analyze the generated edit scan data. ..

Invoices 110 and 120 are examples of manuscripts including a plurality of character strings, each of which corresponds to one of a plurality of items, and marks 111 and 121. However, specific examples of the manuscript are not limited to the invoices 110 and 120, and may be, for example, an estimate, a shipping slip, minutes, a daily report, or the like. The item refers to the type of information (for example, date, billing amount, expense item, consumption tax, transfer destination) included in the invoices 110 and 120. The character string is the information corresponding to each item (for example, "April 10, 2017", "¥ 270,000", "Application fee", "¥ 20,000", "Bank A, Branch B, Ordinary xxxxxx". Etc.) itself. That is, the invoices 110 and 120 include different character strings (“April 10, 2017”, “April 22, 2017”) associated with a common item (eg, date).

In addition, the correspondence between items and character strings may or may not be specified in the invoices 110 and 120. As an example, the character string "billing amount" representing the item "billing amount" and the character string "¥ 270,000" representing the amount are described adjacent to each other in the left-right direction, so that the character string "¥ 270," 000 ”is associated with the item“ billing amount ”. The character string representing the item may have a plurality of patterns such as "expense item", "billing item", and the like. As another example, the character string "April 10, 2017" is not associated with the character string representing the item "date", but the format of the character string (for example, 4 digits [year] 2 digits [ Month] Two digits [day]) and the position of the character string in the invoice 110 (for example, the upper right corner) are associated with the item "date".

The marks 111 and 121 are figures having a predetermined shape (for example, rectangle, circle, triangle, trapezoid) filled with one of a plurality of colors (for example, red, yellow, blue, green, and purple). is there. That is, the marks 111 and 121 may be any figures that can be easily visually distinguished by the user. The marks added to the document may have the same shape but different colors, may have the same color but different shapes, or may have different colors and shapes.

The marks 111 and 121 are added to the invoices 110 and 120 by the user at the site where the scanner 10 is installed. The marks 111 and 121 may be, for example, drawn on the invoices 110 and 120 with a pen or the like, or may be stickers or the like attached to the invoices 110 or 120. That is, the marks 111 and 121 are figures that are not added to the invoices 110 and 120 when they are issued by the issuer.

Which mark is to be added to which manuscript is determined in advance by the administrator of the relay server 50, and may be distributed as a manual to each base. As an example, marks of different colors (eg, red, yellow) may be added to each issuer of invoices 110, 120 (eg, "ABC Patent Office", "XYZ Trading"). As another example, a mark having a different shape (for example, rectangle, triangle) may be added for each type of manuscript (for example, invoice, daily report). Further, the mark may be added to a predetermined position in the invoices 110 and 120, or may be added to an arbitrary position in the invoices 110 and 120. Further, a plurality of marks may be added to one original document.

For example, the user of the site where the scanner 10 is installed adds the marks 111 and 121 to the invoices 110 and 120 that arrived at the site according to the manual, and attaches the invoices 110 and 120 with the marks 111 and 121 to the scanner 10. Let me read it. The scanner 10 reads the images recorded on the invoices 110 and 120 and generates scan data (S11). Then, the scanner 10 transmits the scan data generated in S11 to the relay server 50 connected through the communication network 101 (S12). The process of S11 is an example of a reading process, and the process of S12 executed by the scanner 10 is an example of a first transmission process.

As an example, the user places the invoice 110 shown in FIG. 5 (A) on the contact glass, causes the scanner 10 to perform a reading process, and then contacts the invoice 120 shown in FIG. 5 (B). It may be placed on glass and the scanner 10 may perform a reading process. In this case, the scanner 10 separately transmits the scan data including the scan image read from the invoice 110 and the scan data including the scan image read from the invoice 120 to the relay server 50.

As another example, the user may set the invoices 110 and 120 in the ADF and have the scanner 10 perform the reading process. In this case, the scanner 10 reads claims 110 and 120 in order, and transmits scan data including the two scan images read from the invoices 110 and 120 to the relay server 50. That is, the scan data includes scanned images read from one or more originals. In the present embodiment, the following processing will be described on the premise that the scan data includes the scan images read from the invoices 110 and 120, respectively.

Next, the server program 65 of the relay server 50 receives scan data from the scanner 10 through the communication I / F 55 (S12). Then, the server program 65 temporarily stores the scan data received from the scanner 10 in the memory 62. The process of S12 is an example of an acquisition process or a reception process. Further, the server program 65 executes a barcode synthesis process on the scan data received in S12 (S13). The barcode composition process is a process of synthesizing the barcode images 112 and 122 generated based on the marks 111 and 121 into the scanned image. The details of the barcode composition processing will be described with reference to FIG.

First, the server program 65 reads the scan image read from the invoice 110 from the memory 62 among the plurality of scan images included in the scan data received in S12. Then, the server program 65 detects the mark 111 included in the read scanned image (S21). When the mark 111 is added to a predetermined position on the invoice 110, the server program 65 may detect the mark 111 from the pixel value at that position. On the other hand, when the mark 111 is added to an arbitrary position on the invoice 110, the server program 65 may detect the mark 111 by scanning each pixel constituting the scanned image. The process of S21 is an example of the detection process.

Next, the server program 65 determines whether or not the mark 111 is detected in S21 (S22). Then, the server program 65 specifies the color of the mark 111 (that is, red) according to the determination that the mark 111 is detected in S21 (S22: Yes). Then, the server program 65 reads the item record including the color information indicating the specified red color from the item list shown in FIG. 2 (S23). That is, the server program 65 reads the item information indicating the items “date” and “transfer destination” and the server ID “server A” from the memory 62. The item information included in the item record read in S23 is an example of the corresponding item information, and the server ID is an example of the corresponding server ID. The process of S23 is an example of the read process.

Next, the server program 65 has the character strings "April 10, 2017" corresponding to the corresponding items "date" and "transfer destination" indicated by the corresponding item information read in S23, "Bank A B branch ordinary XXXXX". Is extracted from the scanned image read from the invoice 110 (S24). That is, the server program 65 specifies the position of the character string corresponding to the corresponding item “date” in the scanned image. Then, the server program 65 extracts the text format character string “April 10, 2017” from the position in the scanned image corresponding to the corresponding item “date” by using the OCR technique. The same applies to the extraction method of the character string "A bank B branch ordinary XXXXX" corresponding to the corresponding item "transfer destination". The OCR technique is an example of the first algorithm. The process of S24 is an example of the extraction process.

Next, the server program 65 generates a barcode image 112 holding the character strings “April 10, 2017” and “Bank A, Branch B, Ordinary XXXXX” extracted in S24 (S25). The barcode image 112 is an image in a format in which a character string can be extracted by the second algorithm. Since the method of generating the barcode image 112 from the character string extracted in S24 is already well known, the description thereof will be omitted. The process of S24 is an example of the generation process.

Next, the server program 65 synthesizes the barcode image 112 generated in S24 at the position of the mark 111 of the scanned image read from the invoice 110 (S26). That is, the server program 65 overwrites the mark 111 of the scanned image with the barcode image 112 as shown in FIGS. 5 (A) and 6 (A). Then, the server program 65 temporarily stores the edit scan data indicating the scan image (hereinafter, referred to as “edit scan image”) in which the barcode image 112 is combined in the memory 62. The process of S26 is an example of a synthesis process. The edit scan data is an example of output data.

Next, the server program 65 determines whether or not the processes S21 to S26 have been executed for all the scanned images included in the scan data received in S12 (S27). Then, the server program 65 reads the scanned image from the memory 62 in response to the determination that the processes S21 to S26 have not been executed for the scanned image read from the invoice 120 (S27: Yes). , S21 to S26 are executed. As a result, as shown in FIG. 6B, the edit scan data indicating the edit scan image in which the barcode image 122 holding the character string “personal computer fee” corresponding to the corresponding item “expense item” is combined is stored in the memory. It is temporarily stored in 62.

That is, the server program 65 executes the processes S21 to S26 for each of the plurality of scanned images included in the scan data. However, the server program 65 executes the processing after S27 without executing the processing of S23 to S26 for the scanned image according to the fact that the mark cannot be detected from the scanned image to be processed (S22: No). To do. Then, the server program 65 ends the barcode composition process in response to the determination that the processes S21 to S26 have been executed for all the scanned images included in the scan data (S27: none).

The mark 111 is an example of the first mark, and the item information and the server ID associated with the red color constituting the mark 111 are examples of the first item information and the first server ID, and the items indicated by the first item information. The “date” and “transfer destination” are examples of the first item, and the analysis server 80A identified by the first server ID “server A” is an example of the first server. Further, the mark 121 is an example of the second mark, and the item information and the server ID associated with yellow constituting the mark 121 are examples of the second item information and the second server ID, and are shown by the second item information. The item "expense item" is an example of the second item, and the analysis server 80B identified by the second server ID "server B" is an example of the second server.

Next, returning to FIG. 3, the server program 65 transmits the edit scan data generated by the barcode synthesis process to the analysis server 80 through the communication I / F 55 (S14). The process of S14 executed by the relay server 50 is an example of the transmission process and the second transmission process. More specifically, the server program 65 transmits the edit scan data indicating the edit scan image shown in FIG. 6A to the analysis server 80A identified by the server ID “server A” read in S23. Further, the server program 65 transmits the edit scan data indicating the edit scan image shown in FIG. 6B to the analysis server 80B identified by the server ID “server B” read in S23. That is, the server program 65 transmits the corresponding edit scan data to the analysis server 80 identified by the server ID read in S23 among the plurality of analysis servers 80A and 80B.

Next, the analysis server 80A receives the edit scan data indicating the edit scan image shown in FIG. 6A from the relay server 50 (S14). Next, the analysis server 80A extracts the barcode image 112 from the edit scan image indicated by the edit scan data. Next, the analysis server 80A extracts the character strings “April 10, 2017” and “Bank A B branch ordinary XXXXX” held by the extracted barcode image 112 using the second algorithm. Then, the analysis server 80A analyzes the edit scan image indicated by the edit scan data according to the extracted character string (S15).

The analysis server 80A stores (that is, classifies) the edit scan data common to the issue date "April 2017" and the transfer destination "A bank B branch ordinary XXXXX" in the same folder in the server memory, for example. You may. Further, the analysis server 80A extracts the character string "¥ 270,000" corresponding to the item "billing amount" from the edited scan image shown in the edited scan data, and sets the billing amount indicated by the extracted character string for each folder. It may be totaled (ie, aggregated).

Further, the analysis server 80B receives the edit scan data indicating the edit scan image shown in FIG. 6B from the relay server 50 (S14). Next, the analysis server 80B extracts the barcode image 122 from the edit scan image indicated by the edit scan data. Next, the analysis server 80B extracts the character string “personal computer fee” held by the extracted barcode image 122 by using the second algorithm. Then, the analysis server 80B analyzes the edit scan image indicated by the edit scan data according to the extracted character string (S15). The analysis server 80B may, for example, store edit scan data including common expense items in the same folder in the server memory.

[Action and effect of the embodiment]
If the above-mentioned processing of the system 100 is to be realized by omitting the relay server 50, the user at each base needs to add the barcode images 112 and 122 to the invoices 110 and 120 and have the scanner 10 read them. .. However, since it is difficult for the user to distinguish the barcode images 112 and 122 at first glance, when the above operations are performed together, the barcode image 122 is erroneously added to the invoice 110 and the barcode image is displayed. Even if 112 is mistakenly added to invoice 120, it is difficult to notice the error. Then, if the analysis server 80 analyzes the scanned image read from the invoices 110 and 120 to which the erroneous barcode images 112 and 122 are added, an appropriate analysis result cannot be obtained.

Therefore, according to the above embodiment, the user at the site where the scanner 10 is installed can add a desired mark to the invoices 110 and 120 among the plurality of marks 111 and 121 that can be easily visually distinguished. Good. As a result, the user can easily confirm whether or not the marks 111 and 121 added to the invoices 110 and 120 are appropriate as compared with the case where the barcode images 112 and 122, which are difficult to distinguish visually, are added. it can. On the other hand, the analysis server 80 can analyze the edited scan image according to the character strings held by the barcode images 112 and 122 as in the conventional case. That is, according to the above embodiment, the work load of the user at each base can be reduced without changing the processing of the existing analysis server 80.

Further, according to the above embodiment, since the edit scan data is transmitted to the analysis server 80 identified by the server ID corresponding to the marks 111 and 121, the edit scan data can be stored without increasing the workload of the user. It can be analyzed by a desired analysis server 80. Further, according to the above embodiment, not only one type of manuscript (for example, an invoice) but also a plurality of types of manuscripts (for example, an invoice, a quotation, and a daily report) may be collectively read by the scanner 10. An appropriate barcode image is added by the relay server 50 and transmitted to an appropriate analysis server 80. As a result, the workload of the users at each site is further reduced.

Further, the position where the barcode images 112 and 122 are combined is not limited to the positions of the marks 111 and 121, and may be a predetermined position where the analysis server 80 can extract. Further, the barcode images 112 and 122 may be transmitted to the analysis server 80 in association with the scanned image without being combined with the scanned image. Further, the barcode synthesis process is not limited to being executed by the relay server 50, and may be executed by the CPU of the scanner 10. That is, the "reading device connected to the computer" is not limited to the relay server 50 and the scanner 10 connected through the communication network 101, but may be the CPU and the scanner 10 connected by the internal bus. In this case, the CPU may acquire the scan data output by the scanner in S12 through the internal bus.

Further, in the relay server 50 of the above embodiment, an example has been described in which various processes stored in the memory 62 are executed by the CPU 61 to realize each process executed by the controller of the present invention. However, the configuration of the controller is not limited to this, and a part or all of the controller configuration may be realized by hardware such as an integrated circuit.

Further, the present invention can be realized not only as a relay server 50 but also as a program for causing the relay server 50 to execute a process. Then, the program may be recorded and provided on a non-transitory recording medium. The non-transitory recording medium may include a memory mounted on a server that can be connected to the relay server 50 through the communication network 101, in addition to a CD-ROM, a DVD-ROM, and the like. Then, the program stored in the memory of the server may be distributed through a communication network 101 such as the Internet as information or a signal indicating the program.

10 ... Scanner 50 ... Relay server 55 ... Communication I / F
61 ... CPU
62 ... Memory 65 ... Server programs 80A, 80B ... Analysis server

Claims (11)

A program that can be executed by a computer that has memory and a communication interface.
The program causes the computer to execute an acquisition process for acquiring read data, and the read data contains a plurality of character strings, each of which corresponds to one of a plurality of items, and a plurality of visually distinguishable marks. Data generated by reading a document in which at least one of them is recorded by a reading device connected to the computer.
The program
A detection process for detecting one of the plurality of marks in the scanned image indicated by the scanned data acquired in the acquisition process, and a detection process for detecting one of the plurality of marks.
Corresponding item corresponding to the one mark detected by the detection process among the plurality of item information which is stored in the memory in association with each of the plurality of marks and each indicates one of the plurality of items. Read processing to read information from the memory and
An extraction process of extracting the character string corresponding to the item indicated by the corresponding item information read by the read process from the read image by the first algorithm, and
The computer is made to execute a generation process for generating an information holding image that holds the character string extracted by the extraction process, and the information holding image is an image in a format in which the character string can be extracted by a second algorithm. ,
The program obtains the read image and output data including the information holding image in order to cause a server capable of executing the process by the second algorithm to analyze the read image according to the character string held by the information holding image. A program that causes the computer to execute a transmission process of transmitting data to the server through a communication interface. The program
In the read process, among the plurality of server IDs stored in the memory in association with each of the plurality of marks and each of which identifies one of the plurality of servers, the mark detected in the detection process is used. Further read the corresponding corresponding server ID from the memory,
Claim 1 in which the output data is transmitted through the communication interface to the server identified by the corresponding server ID read in the read process among the plurality of servers capable of communicating through the communication interface in the transmission process. The program described in. The program
In the acquisition process, the scanning data including the plurality of scanned images corresponding to the images recorded on one original is acquired from the scanner, which is the scanning device capable of sequentially scanning the plurality of documents.
The program according to claim 2, wherein the computer executes the detection process, the read process, the extraction process, the generation process, and the transmission process for each of the plurality of scanned images included in the scanned data. The memory is
The first item information indicating the first item and the first server ID that identifies the first server are stored in association with the first mark.
The second item information indicating the second item and the second server ID that identifies the second server are stored in association with the second mark.
The program
In the acquisition process, the read data including the first read image and the second read image is acquired, and the read data is acquired.
In response to the detection of the first mark from the first scanned image in the detection process,
The read process of reading the first item information and the first server ID corresponding to the first mark from the memory, and
The extraction process for extracting the first character string corresponding to the first item indicated by the first item information from the first scanned image, and the extraction process.
The generation process for generating the first information holding image that holds the first character string, and
The transmission process of transmitting the first output data including the first read image and the first information holding image to the first server identified by the first server ID through the communication interface is executed on the computer. Let me
In response to the detection of the second mark from the second scanned image in the detection process,
The read process of reading the second item information and the second server ID corresponding to the second mark from the memory, and
The extraction process for extracting the second character string corresponding to the second item indicated by the second item information from the second scanned image, and the extraction process.
The generation process for generating the second information holding image that holds the second character string, and
The computer executes the transmission process of transmitting the second output data including the second scanned image and the second information holding image to the second server identified by the second server ID through the communication interface. The program according to claim 3. The program causes the computer to execute a compositing process of synthesizing the information-retaining image generated in the generation process with the scanned image.
The program according to any one of claims 1 to 4, wherein in the transmission process, the output data indicating the read image obtained by synthesizing the information holding image in the synthesis process is transmitted to the server through the communication interface. The program according to claim 5, wherein the program synthesizes the information holding image at the position of the mark included in the read image in the synthesis process. The program according to any one of claims 1 to 6, wherein the program receives the read data from the reader connected through the communication network through the communication interface in the acquisition process. The program according to any one of claims 1 to 7, wherein the mark is a figure having a predetermined shape filled with one of a plurality of colors. Memory and
Communication interface and
An information processing device equipped with a controller
The controller executes a reception process of acquiring read data from the reader through the communication interface, and the read data is visually distinguishable from a plurality of character strings, each of which corresponds to one of a plurality of items. This is data generated by reading a document in which at least one of a plurality of marks is recorded by the reading device.
The controller
A detection process for detecting one of the plurality of marks in the scanned image indicated by the scanned data received in the reception process, and a detection process for detecting one of the plurality of marks.
Corresponding item corresponding to the one mark detected by the detection process among the plurality of item information which is stored in the memory in association with each of the plurality of marks and each indicates one of the plurality of items. Read processing to read information from the memory and
An extraction process of extracting the character string corresponding to the item indicated by the corresponding item information read by the read process from the read image by the first algorithm.
A generation process for generating an information-retaining image that holds the character string extracted by the extraction process is executed, and the information-holding image is an image in a format in which the character string can be extracted by the second algorithm.
The controller outputs the output data including the read image and the information holding image in order to cause a server capable of executing the process by the second algorithm to analyze the read image according to the character string held by the information holding image. An information processing device that executes transmission processing to be transmitted to the server through a communication interface. A system including a reading device and an information processing device including a memory, a communication interface, and a controller.
The reading device is
A scanning process for generating scanned data by scanning a document in which at least one of a plurality of character strings, each corresponding to one of a plurality of items, and a plurality of visually distinguishable marks is recorded.
The first transmission process of transmitting the read data generated in the read process to the information processing device connected through the communication network is executed.
The controller of the information processing device
A reception process for receiving read data from the reader through the communication interface, and
A detection process for detecting one of the plurality of marks in the scanned image indicated by the scanned data received in the reception process, and a detection process for detecting one of the plurality of marks.
Corresponding item corresponding to the one mark detected by the detection process among the plurality of item information which is stored in the memory in association with each of the plurality of marks and each indicates one of the plurality of items. Read processing to read information from the memory and
An extraction process of extracting the character string corresponding to the item indicated by the corresponding item information read by the read process from the read image by the first algorithm.
A generation process for generating an information-retaining image that holds the character string extracted by the extraction process is executed, and the information-holding image is an image in a format in which the character string can be extracted by the second algorithm.
The controller outputs the output data including the read image and the information holding image in order to cause a server capable of executing the process by the second algorithm to analyze the read image according to the character string held by the information holding image. A system that executes transmission processing to be transmitted to the server through a communication interface. In the scanning process, the scanning device reads a plurality of documents in order to generate the scanning data including the plurality of scanned images.
The system according to claim 10, wherein the controller executes the detection process, the read process, the extraction process, the generation process, and the transmission process for each of the plurality of scanned images included in the scanned data. ..

Images