JP6938952B2 - Mobile terminal device and serial code extraction program - Google Patents

Description

The present invention relates to a mobile terminal device, a serial code extraction program, and a server device.

Conventionally, for example, there is a technique of capturing an image including a serial code with a CCD (Charge-Coupled Device) camera to acquire image data, and recognizing the serial code in the acquired image data by OCR (Optical Character Recognition) (OCR (Optical Character Recognition)). For example, see Patent Document 1).
However, in the technique described in Patent Document 1, when numbers and characters around the serial code are mixed in the image data of the serial code, not only the serial code but also these numbers and characters are recognized. It was difficult to properly extract the code.

JP-A-2015-233212

Focusing on the above points, an object of the present invention is to provide a mobile terminal device, a serial code extraction program, and a server device capable of appropriately extracting a serial code.

In order to solve the above problems, one aspect of the present invention is to (a) an information storage unit that stores predetermined serial code format information, and (b) an image including an image including the serial code. Mobile communication including a photographing unit for acquiring data and (c) a serial code extracting unit for extracting a part matching the format information stored in the information storage unit as a serial code from the image data acquired by the photographing unit. The gist is that it is a terminal.

In still another aspect of the present invention, the mobile terminal device is (a) an image data acquisition unit that acquires image data acquired by the photographing unit, and (b) an information storage unit of the mobile terminal device from the acquired image data. The gist is that it is a serial code extraction program that functions as a serial code extraction unit that extracts a part that matches the predetermined serial code format information stored in the data as a serial code.

Yet another aspect of the present invention includes (a) a code storage unit that stores a plurality of predetermined serial codes, and (b) a code receiving unit that receives a serial code transmitted from a mobile terminal device. (C) A code determination unit that determines whether the serial code received by the code receiving unit matches any of a plurality of serial codes stored in the code storage unit, and (d) a code determination unit that matches. The gist is that the server device includes a predetermined operation execution unit that performs a predetermined predetermined operation only when it is determined to be the same.

According to the present invention, it is possible to provide a mobile terminal device, a serial code extraction program, and a server device capable of appropriately extracting a serial code even if numbers and characters other than the serial code are mixed in the image data. ..

It is a block diagram which shows the structure of the campaign execution system which concerns on embodiment. It is a block diagram which shows the internal structure of a mobile communication terminal. It is a figure which shows the format information of a serial code. It is a block diagram which shows the functional structure realized by the mobile terminal apparatus. It is a block diagram which shows the internal structure of an OCR server apparatus. It is a block diagram which shows the functional structure realized by the OCR server apparatus. It is a block diagram which shows the internal structure of a campaign server device. It is a figure which shows the serial code and the flag which the code storage part stores. It is a figure which shows the point stored in the point storage part, and the user ID. It is a block diagram which shows the functional structure realized by a campaign server device. It is a figure which shows the image which is displayed on the image display part. It is a flowchart which shows the serial code extraction process. It is a figure which shows the symbol group extracted by the OCR server apparatus. It is a figure which shows the serial code extracted from the symbol group. It is a flowchart which shows the symbol group extraction process. It is a flowchart which shows the point giving process. It is a timing chart which shows the operation of the campaign assist system 1.

Hereinafter, embodiments of the present invention will be described with reference to the drawings.
In the present embodiment, the present invention is applied to a campaign assistance system that assists a sales promotion campaign for promoting sales of a product, which is performed by using a serial code attached to the product.
The embodiments shown below exemplify devices and methods for embodying the technical idea of the present invention, and the technical idea of the present invention includes the shape, structure, arrangement, and the like of components. Is not specified as the following. The technical idea of the present invention may be modified in various ways within the technical scope specified by the claims stated in the claims.

(composition)
As shown in FIG. 1, the campaign auxiliary system 1 includes a mobile terminal device 2, an OCR server device 3, and a server device (hereinafter, also referred to as “campaign server device”) 4. The mobile terminal device 2, the OCR server device 3, and the campaign server device 4 have established a communication path 5 capable of transmitting and receiving various data to and from each other using a mobile phone network, the Internet, or the like.
The mobile terminal device 2 is a terminal device owned by an applicant for a sales promotion campaign. For example, a smartphone can be adopted. As shown in FIG. 2, the mobile terminal device 2 includes a data transmission / reception unit 20 capable of transmitting / receiving data between the OCR server device 3 and the processor 24 and between the campaign server device 4 and the processor 24, and a mobile terminal. An imaging unit 21 (for example, a CCD camera) that photographs the back direction of the device 2 to acquire image data, and an image display unit 22 (for example, a liquid crystal display with a touch panel) that displays an image based on a command from the processor 24. To be equipped. Further, it includes an information storage unit 23 that stores predetermined serial code format information, and a processor 24 that performs various arithmetic processes according to a program using each of these units 20 to 23. The data transmission / reception unit 20, the photographing unit 21, the image display unit 22, the information storage unit 23, and the processor 24 are connected to each other by a bus 25 so that various data can be exchanged.

Here, as the predetermined serial code format information, for example, the number of digits of the serial code, the number of lines of the serial code, and the type of symbol (number, alphabet) used for the serial code can be adopted. In the example of FIG. 3, the predetermined serial code format information is that the number of digits of the serial code is 7, the number of lines of the serial code is 2, and the types of symbols used in the serial code are numbers 1 to 9. Is used.
Further, as shown in FIG. 4, the processor 24 causes the mobile terminal device 2 to function as an image data acquisition unit 24a, a serial code extraction unit 24b, a serial code transmission unit 24c, and a display control unit 24d. Further, the serial code extraction unit 24b causes the mobile terminal device 2 to function as an image data transmission unit 24e, a symbol group reception unit 24f, and an extraction execution unit 24g.

The OCR server device 3 is a server device that provides an OCR processing service on the Internet. For example, a server device using Google's Cloud Vision API can be adopted. As shown in FIG. 5, the OCR server device 3 stores a data transmission / reception unit 30 that enables data transmission / reception between the mobile terminal device 2 and the OCR server device 3 and various information used for OCR processing. It includes an information storage unit 31 and a processor 32 that uses the data transmission / reception unit 30 and the information storage unit 31 to perform various arithmetic processes according to a program. The data transmission / reception unit 30, the information storage unit 31, and the processor 32 are connected to each other by a bus 33 so that various data can be exchanged. Further, as shown in FIG. 6, the processor 32 functions as an image data receiving unit 32a, an OCR processing executing unit 32b, and a symbol group transmitting unit 32c.

The campaign server device 4 is a server device that provides various services such as determination of a serial code. As shown in FIG. 7, the campaign server device 4 stores a data transmission / reception unit 40 that enables data transmission / reception between the mobile terminal device 2 and the campaign server device 4, and a plurality of predetermined serial codes. The code storage unit 41, the point storage unit 42 that stores points in association with the user of the mobile terminal device 2, the data transmission / reception unit 40, the code storage unit 41, and the point storage unit 42 are used to perform various arithmetic processes according to a program. The processor 43 is provided. A regular serial code is used as the plurality of predetermined serial codes. Further, as shown in FIG. 8, the code storage unit 41 stores a flag indicating whether or not each serial code has been used in correspondence with each of the plurality of serial codes (regular serial codes). In the example of FIG. 8, the field value of the flag is set to "1" when the flag is set, and the field value of the flag is set to "0" when the flag is not set. Further, as shown in FIG. 9, the point storage unit 42 stores the points given to each user in correspondence with each of the user IDs of the plurality of users. The data transmission / reception unit 30, the code storage unit 41, the point storage unit 42, and the processor 43 are connected to each other by a bus 44 so that various data can be exchanged. Further, as shown in FIG. 10, the processor 43 includes a code receiving unit 43a, a code determining unit 43b, a predetermined operation executing unit 43c, an invalid code notification signal transmitting unit 43d, a used code notification signal transmitting unit 43e, and a flag setting unit 43f. Functions as.

(Serial code extraction process)
Next, the serial code extraction process executed by the processor 24 will be described. In the serial code extraction process, as shown in FIG. 11A, the WEB page for campaign application is displayed on the image display unit 22, and the characters "capture and input the serial code" on the displayed WEB page are displayed. It is executed when the touch operation is detected by the image display unit 22 (touch panel).
As shown in FIG. 12, first, in step S101, the image data acquisition unit 24a activates the photographing unit 21 so that the back direction of the mobile terminal device 2 can be photographed. As a result, the user of the mobile terminal device 2, that is, the person who inputs the serial code, directs the back direction of the mobile terminal device 2 toward the serial code and touch-operates the image display unit 22 to operate FIG. 11 (b). ), The serial code is taken and the image data is acquired. Then, when the image data is acquired, the image data acquisition unit 24a acquires the acquired image data. In the example of FIG. 11B, numbers and characters around the serial code are also reflected in the image data.

Subsequently, in step S102, the image data transmission unit 24e transmits the image data acquired in step S101 to the OCR server device 3 via the data transmission / reception unit 20. As a result, the OCR server device 3 executes OCR processing on the transmitted image data, and as shown in FIG. 13, extracts a symbol group consisting of various symbols such as characters and numbers included in the image data. In the example of FIG. 13, the symbols are mixed with peripheral numbers and characters as well as the serial code.
Subsequently, the process proceeds to step S103, and the symbol group receiving unit 24f is put into a standby state until the extraction result (symbol group) is transmitted from the OCR server device 3. Then, when the symbol group is transmitted, the symbol group receiving unit 24f receives the transmitted symbol group via the data transmitting / receiving unit 20.

Subsequently, in step S104, the extraction execution unit 24g extracts a portion of the symbol group received in step S103 that matches the format information stored in the information storage unit 23 as a serial code. As a result, as shown in FIG. 14, the serial code portion is extracted from the symbol group extracted by the OCR server device 3. In the example of FIG. 14, a 7-digit and 2-line number string “6885394 7550180” is extracted from the symbol group shown in FIG. 13 based on the format information shown in FIG. Therefore, even if a symbol group other than the serial code is mixed in the image data, the serial code can be appropriately extracted.

Subsequently, in step S105, the serial code transmission unit 24c transmits the serial code extracted in step S104 to the campaign server device 4 via the data transmission / reception unit 20. A user ID is added to the serial code transmitted to the campaign server device 4. As a result, the campaign server device 4 performs operations for the sales promotion campaign, such as determination of the serial code and point addition, based on the transmitted serial code.
Subsequently, the process proceeds to step S106, and the display control unit 24d is put into a standby state until a signal is transmitted from the campaign server device 4. Examples of the signal include a signal for notifying that the serial code is invalid, a signal for notifying that the serial code is used, and a signal for notifying the storage point. Then, when the signal is transmitted, the display control unit 24d receives the transmitted signal via the data transmission / reception unit 20, and responds to the received signal as shown in FIGS. 11C to 11E. After displaying the image on the image display unit 22, the serial code extraction process is terminated. In the example of FIG. 11 (c), the image display unit 22 displays an image notifying that the serial code is invalid, and in the example of FIG. 11 (d), the image display unit 22 is used. An image notifying that the serial code has been completed is displayed, and in the example of FIG. 11E, an image notifying the accumulation point is displayed on the image display unit 22.

(Symbol group extraction process)
Next, the symbol group extraction process executed by the OCR server device 3 will be described.
The symbol group extraction process is executed when image data is transmitted from the mobile terminal device 2.
As shown in FIG. 15, first, in step S201, the image data receiving unit 32a receives the image data transmitted from the mobile terminal device 2 via the data transmitting / receiving unit 30.
Subsequently, in step S202, the OCR processing execution unit 32b executes OCR processing on the image data received in step S201, and as shown in FIGS. 11B and 13, the symbol group included in the image data is displayed. Extract. In the OCR process, the symbol group is extracted in a text format.
Subsequently, in step S203, the symbol group transmission unit 32c transmits the symbol group extracted in step S202 to the mobile terminal device 2 of the image data transmission source via the data transmission / reception unit 30, and then the symbol group extraction. End the process. As a result, the mobile terminal device 2 extracts the serial code portion from the received symbol group (text) as shown in FIG.

(Point award processing)
Next, the point awarding process executed by the campaign server device 4 will be described.
The point awarding process is executed when the serial code is transmitted from the mobile terminal device 2.
As shown in FIG. 16, first, in step S301, the code receiving unit 43a receives the serial code transmitted from the mobile terminal device 2 via the data transmitting / receiving unit 40.
Subsequently, in step S302, the code determination unit 43b matches the serial code received in step S301 with a plurality of serial codes stored in the code storage unit 41, that is, one of the regular serial codes. Determine if it is. Then, if it is determined that any of the above is met (Yes), it is determined that the serial code is legitimate, and the process proceeds to step S304. On the other hand, if it is determined that none of them match (No), it is determined that the serial code is not a legitimate serial code, and the process proceeds to step S303.

In step S303, after the invalid code notification signal transmission unit 43d transmits a signal notifying that the serial code is invalid to the mobile terminal device 2 that transmits the serial code via the data transmission / reception unit 40, this point is given. End the process. As a result, the "predetermined predetermined operation" described later, that is, the addition of points and the reporting of accumulated points are not performed.
On the other hand, in step S304, as shown in FIG. 8, the code determination unit 43b refers to the field value stored in the code storage unit 41, and refers to the serial code determined to match in step S302 with respect to the serial code. Determines if a flag has been set to indicate that has been used (whether the field value is "1"). Then, if it is determined that the flag is not set (Yes), it is determined that the serial code is not used, and the process proceeds to step S305. On the other hand, if it is determined that the flag is set (No), it is determined that the serial code has been used, and the process proceeds to step S306.

In step S305, the used code notification signal transmission unit 43e transmits a signal notifying that the serial code is used to the mobile terminal device 2 that transmits the serial code via the data transmission / reception unit 40, and then this is performed. End the point granting process. As a result, the "predetermined predetermined operation" described later, that is, the calculation and reporting of the accumulation points are not performed.
On the other hand, in step S306, the flag setting unit 43f uses the serial code for the serial code determined to match in step S302 among the plurality of serial codes stored in the code storage unit 41. Set a flag to indicate that it has been done. Specifically, as shown in FIG. 8, it corresponds to the serial code (serial code received in step S301) determined to match in step S302 from the records stored in the code storage unit 41. Change the field value of "Flag" of the record to be recorded to "1".

Subsequently, in step S307, as shown in FIG. 9, the predetermined operation execution unit 43c adds the user ID added to the serial code received in step S301 among the points stored in the point storage unit 42. Is associated with, that is, a predetermined predetermined point (for example, 10 points) is added to the point stored in association with the user of the mobile terminal device 2. Then, after transmitting a signal for notifying the added points to the mobile terminal device 2 of the serial code transmission source via the data transmission / reception unit 40, the point awarding process is terminated.

(Operation and others)
Next, the operation of the campaign assist system 1 of the present embodiment will be described.
First, the user of the mobile terminal device 2 operates the mobile terminal device 2, accesses the WEB page for campaign application as shown in FIG. 11A, and displays the "serial code" displayed on the image display unit 22. It is assumed that the characters "shoot and input" are touch-operated. Then, as shown in FIG. 17, the mobile terminal device 2 activates the photographing unit 21 and is ready to photograph the back direction of the mobile terminal device 2 (step S401). Subsequently, it is assumed that the user of the mobile terminal device 2, that is, the person who inputs the serial code, directs the back direction of the photographing unit 21 toward the serial code and touches the image display unit 22. Then, as shown in FIG. 11B, the mobile terminal device 2 captures an image including the serial code, acquires image data (step S402), and transmits the acquired image data to the OCR server device 3 ( Step S403). In the example of FIG. 11B, the image data shows the peripheral numbers and characters as well as the serial code.

When the image data is transmitted from the mobile terminal device 2, the OCR server device 3 receives the transmitted image data (step S404), performs OCR processing on the received image data, and extracts a symbol group included in the image data. (Step S405). As a result, as shown in FIG. 13, a symbol group consisting of various symbols such as surrounding characters and numbers is extracted together with the serial code. Subsequently, the OCR server device 3 transmits the extracted symbol group (serial code + other data such as numbers and characters) to the mobile terminal device 2 that is the source of the image data (step S406).
When the symbol group is transmitted from the OCR server device 3, the mobile terminal device 2 extracts a portion of the transmitted symbol group that matches the format information stored in the information storage unit 23 as a serial code ( Step S407). In the example of FIG. 14, when the format information of 7 digits in FIG. 3 and representing the number string of 2 lines is used, "6885394 7550180" is extracted as a serial code from the symbol group of FIG. Subsequently, the mobile terminal device 2 transmits the extracted serial code to the campaign server device 4 (step S408). At that time, a user ID (for example, "0001") is added to the serial code.

As described above, according to the mobile terminal device 2 according to the present embodiment, the serial code portion is extracted from the symbol group extracted by the OCR server device 3. Therefore, even if a symbol group other than the serial code is mixed in the image data, the serial code can be appropriately extracted.
When the serial code is transmitted from the mobile terminal device 2, the campaign server device 4 receives the transmitted serial code (step S409), and the received serial code is a plurality of serials stored in the code storage unit 41. It is determined whether any of the codes is matched (step S410). In the example of FIG. 8, since "6885394 7550180" is stored as a regular serial code in the code storage unit 41, it is assumed that the received serial code matches the serial code stored in the code storage unit 41. It is judged. Subsequently, whether the campaign server device 4 refers to the field value stored in the code storage unit 41 and sets a flag indicating that the serial code has been used for the serial code determined to match. Is determined (step S411). In the example of FIG. 9, since the field value of the "flag" of the record corresponding to the serial code "6885394 7550180" stored in the code storage unit 41 is "0", the flag is not set and it is used. It is determined that it is not a serial code. Subsequently, the campaign server device 4 indicates that the serial code has been used for the serial code determined to match among the plurality of serial codes stored in the code storage unit 41. (Change the field value of the field "flag" from "0" to "1").

Subsequently, the campaign server device 4 corresponds to the points stored in the point storage unit 42 to which the user ID added to the received serial code is associated, that is, the user of the mobile terminal device 2. A predetermined point (10 points) is added to the points stored separately (step S412). In the example of FIG. 9, since 10 points are added to the point field value "100" of the record corresponding to the user ID "0001" stored in the point storage unit 42, the point field value becomes "110". Can be rewritten. Subsequently, the campaign server device 4 transmits a signal for notifying the points after addition to the mobile terminal device 2 that is the source of the serial code (step S413).
When a signal is transmitted from the campaign server device 4, the mobile terminal device 2 causes the image display unit 22 to display an image that notifies the point based on the transmitted signal (step S414).
As described above, according to the campaign assistance system 1 according to the present embodiment, the serial code can be used to assist the sales promotion campaign for promoting the sales of the product, and the serial code can be used. It is possible to promote the purchase of the granted product.

(Effect of this embodiment)
(1) In the mobile terminal device 2 according to the present embodiment, a portion matching the format information stored in the information storage unit 23 is extracted as a serial code from the image data acquired by the photographing unit 21. Therefore, even if numbers and characters other than the serial code are mixed in the image data, the serial code can be appropriately extracted.
(2) Further, in the mobile terminal device 2 according to the present embodiment, the image data acquired by the photographing unit 21 is transmitted to the OCR server device 3 that performs OCR processing to extract the symbol group included in the image data, and is transmitted to the OCR server. The extracted symbol group is received from the device 3. Therefore, the processing load of the mobile terminal device 2 can be reduced, and the mobile terminal device 2 can be realized by a device having a low processing capacity.

(3) Further, in the mobile terminal device 2 according to the present embodiment, the format information including the number of digits of the serial code is used. Therefore, the serial code can be relatively easily extracted from the symbol group included in the image data.
(4) Further, in the mobile terminal device 2 according to the present embodiment, the format information including the number of lines of the serial code is used. Therefore, the serial code can be relatively easily extracted from the symbol group included in the image data.
(5) Further, in the mobile terminal device 2 according to the present embodiment, the format information including the type of the symbol used for the serial code is used. Therefore, the serial code can be relatively easily extracted from the symbol group included in the image data.

(6) Further, in the serial code extraction method according to the present embodiment, the step of acquiring the image data acquired by the photographing unit 21 by the mobile terminal device 2 and the mobile terminal device 2 from the acquired image data are used. A step of extracting a portion corresponding to the predetermined serial code format information stored in the information storage unit 23 of 2 as a serial code is included. Therefore, even if numbers and characters other than the serial code are mixed in the image data, the serial code can be appropriately extracted.
(7) Further, in the serial code extraction program according to the present embodiment, the mobile terminal device 2 is used as a mobile terminal from the image data acquisition unit 24a for acquiring the image data acquired by the photographing unit 21 and the acquired image data. The portion of the device 2 that matches the predetermined serial code format information stored in the information storage unit 23 is made to function as the serial code extraction unit 24b that extracts the serial code. Therefore, even if numbers and characters other than the serial code are mixed in the image data, the serial code can be appropriately extracted.

(8) Further, the campaign server device 4 according to the present embodiment receives the serial code transmitted from the mobile terminal device 2, and the received serial code is a plurality of serial codes stored in the code storage unit 41. It is determined whether any of them matches, and only when it is determined that they match, a predetermined predetermined operation is performed. As a result, when an invalid serial code is transmitted, it is not necessary to perform a predetermined operation (giving points, etc.).
(9) Further, when the code determination unit 43b determines that the campaign server device 4 according to the present embodiment does not match, the campaign server device 4 transmits a signal notifying that the serial code is invalid to the mobile terminal device 2. I tried to do it. As a result, it is possible to notify the user of the mobile terminal device 2 from which the serial code is transmitted that the serial code is invalid.

(10) Further, when the campaign server device 4 according to the present embodiment determines that the serial code stored in the code storage unit 41 determined to match the received serial code is flagged, it is predetermined. The operation (giving points) of is not performed. As a result, when the used serial code is transmitted, the predetermined operation is not performed.
(11) Further, the campaign server device 4 according to the present embodiment sends a signal to notify that the serial code has been used when the code determination unit 43b determines that the flag has been set. I tried to send to 2. As a result, it is possible to notify the user of the mobile terminal device 2 of the transmission source that the serial code has been used.

(12) Further, the campaign server device 4 according to the present embodiment adds a predetermined predetermined point to the points stored in association with the user of the mobile terminal device 2 as a predetermined operation. .. This can motivate the sending of the serial code and promote the purchase of the product to which the serial code is attached.
(13) In the present embodiment, the campaign server device 4 shows an example in which points are added as a predetermined operation, but other configurations may be adopted. For example, as a predetermined operation, a winning lottery may be performed based on the serial code received by the code receiving unit 43a. Specifically, for example, a random number value is acquired each time a serial code is received, and if the acquired random number value is a predetermined predetermined value, it is a hit, and if it is not a predetermined value, it is a loss. Further, for example, the serial code may be associated with either "hit" or "missing", and each time the serial code is received, it may be determined whether the serial code is a "hit" serial code. This can motivate the sending of the serial code for the purpose of winning, and promote the purchase of the product to which the serial code is attached.

(14) Further, in the predetermined operation execution method according to the present embodiment, the step of receiving the serial code transmitted from the mobile terminal device 2 by the campaign server device 4 and the serial code received by the campaign server device 4 are predetermined. A step of determining whether or not the serial code matches any of the plurality of serial codes, a step of performing a predetermined predetermined operation only when the campaign server device 4 is determined to match, and a step of performing a predetermined operation. Was made to include. As a result, when an invalid serial code is transmitted, it is possible to avoid performing a predetermined operation.
(15) Further, in the predetermined operation execution program according to the present embodiment, the campaign server device 4 is predetermined by the code receiving unit 43a for receiving the serial code transmitted from the mobile terminal device 2 and the received serial code. As a code determination unit 43b that determines whether or not the serial code matches any of the plurality of serial codes, and as a predetermined operation execution unit 43c that performs a predetermined predetermined operation only when it is determined that the serial codes match. Made it work. As a result, when an invalid serial code is transmitted, it is possible to avoid performing a predetermined operation.

(Modification example)
(1) Although the example in which the OCR process is executed by the OCR server device 3 is shown in the present embodiment, another configuration may be adopted. For example, it may be configured to be executed by the mobile terminal device 2.

1 Campaign auxiliary system, 2 Mobile terminal device, 3 OCR server device, 4 Campaign server device, 5 Communication path, 20 Data transmission / reception unit, 21 Imaging unit, 22 Image display unit, 23 Information storage unit, 24 Processor, 24a Image data acquisition Unit, 24b serial code extraction unit, 24c serial code transmission unit, 24d display control unit, 24e image data transmission unit, 24f symbol group reception unit, 24g extraction execution unit, 25 bus, 30 data transmission / reception unit, 31 information storage unit, 32 Processor, 32a image data receiver, 32b OCR processing execution unit, 32c symbol group transmission unit, 33 bus, 40 data transmission / reception unit, 41 code storage unit, 42 point storage unit, 43 processor, 43a code receiver unit, 43b code determination unit , 43c Predetermined operation execution unit, 43d Illegal code notification signal transmission unit, 43e Used code notification signal transmission unit, 43f flag setting unit, 44 bus

Claims (4)

An information storage unit that stores predetermined serial code format information,
A shooting unit that shoots an image including a serial code and acquires image data,
A serial code extraction unit that extracts a portion matching the format information stored in the information storage unit as a serial code from the image data acquired by the photographing unit is provided .
The format information is a mobile terminal device including the number of lines of a serial code and the number of digits of each line. The serial code extraction unit
An image data transmission unit that transmits the image data acquired by the imaging unit to an OCR server device that performs OCR processing on the image data and extracts a symbol group included in the image data.
A symbol group receiving unit that receives the symbol group extracted from the OCR server device, and
The first aspect of claim 1 is provided with an extraction execution unit that extracts a portion of the symbol group received by the symbol group receiving unit that matches the format information stored in the information storage unit as a serial code. The mobile terminal device described. It said format information further mobile terminal device according to claim 1 or 2, characterized in that it comprises a kind of symbols used in the serial code. Mobile terminal device,
Image data acquisition unit that acquires image data acquired by the shooting unit,
And, from the acquired image data, a portion-information storage unit of the mobile terminal apparatus meets a predetermined format information of serial codes stored, to function as a serial code extraction unit that extracts as a serial code Rutotomoni ,
The format information is a serial code extraction program characterized by including the number of lines of the serial code and the number of digits of each line.

Images