JP7467075B2 - Information processing device and program - Google Patents

Description

An embodiment of the present invention relates to an information processing device.

When delivering a package, it is necessary to keep a record of the delivery of the package. For example, when handing over a package from one person to another, the delivery of the package is recorded by signing or stamping the package at the time of handing over.

However, for example, in a delivery method in which a package is delivered to a specified location rather than handed over from person to person (so-called package drop service), there is an issue that it is difficult to sign or stamp as described above.

JP 2014-215795 A

The problem that this invention aims to solve is to provide an information processing device that stores records of package deliveries.

An information processing device according to one embodiment includes a communication interface and a processor. The communication interface acquires a captured image including a luggage image, which is an image for identifying luggage, and a location image, which is an image for identifying a location. The processor acquires luggage information from the luggage image, acquires location information from the location image, and records a composite image in which the luggage information and the location information are combined with the captured image on a recording medium.

FIG. 1 is an explanatory diagram for explaining an example of the configuration of an information recording system according to an embodiment. FIG. 2 is a diagram for explaining an example of package delivery in an information recording system according to an embodiment. FIG. 3 is an explanatory diagram for explaining an example of the operation of an information processing device of an information recording system according to an embodiment. FIG. 4 is an explanatory diagram for explaining an example of a delivery record according to an embodiment. FIG. 5 is an explanatory diagram for explaining an example of a delivery record according to an embodiment.

Hereinafter, an embodiment will be described with reference to the drawings.
FIG. 1 is an explanatory diagram for explaining an example of the configuration of an information recording system 1 according to an embodiment.

The information recording system 1 is a system that records when a package is delivered (generating and storing a delivery record). The delivery record is information that indicates that the package has been delivered to a specified location. The information recording system 1 includes, for example, a server device 11 and an information processing device 12. The server device 11 and the information processing device 12 are connected via a network 13.

The server device 11 records the information supplied from the information processing device 12. For example, the server device 11 includes a system controller 21 and a communication interface 22.

The system controller 21 performs various controls on the server device 11. The system controller 21 includes a processor 23 and a memory 24.

The processor 23 includes a computing element (e.g., a CPU) that executes calculations. The processor 23 executes various operations by executing programs stored in the memory 24.

Memory 24 stores programs and data used in the programs.

The communication interface 22 is an interface for communicating with other devices. The communication interface 22 of the server device 11 communicates with the information processing device 12, for example, via the network 13.

The information processing device 12 generates and stores delivery records. The information processing device 12 includes a system controller 31, a communication interface 32, a display 33, an operation interface 34, and a camera 35.

The system controller 31 controls the information processing device 12. The system controller 31 includes, for example, a processor 41 and a memory 42.

The processor 41 is a computing element that executes arithmetic processing. The processor 41 is, for example, a CPU. The processor 41 may also include, for example, a CPU and a GPU. The processor 41 performs various processes based on data such as programs stored in the memory 42. The processor 41 functions as a control unit that can execute various operations by executing the programs stored in the memory 42.

The memory 42 is a storage medium that stores programs and data used in the programs. The memory 42 also functions as a working memory. That is, the memory 42 temporarily stores data being processed by the processor 41, programs being executed by the processor 41, and the like.

The communication interface 32 is an interface for communicating with other devices. For example, the communication interface 32 communicates with the server device 11 via the network 13.

The display 33 is a display device that displays a screen in response to a video signal input from the system controller 31 or a display control unit such as a graphics controller (not shown). For example, various screens of the information processing device 12 are displayed on the display 33.

The operation interface 34 is connected to an operation member (not shown). The operation interface 34 supplies an operation signal corresponding to the operation of the operation member to the system controller 31. The operation member is, for example, a touch sensor, a numeric keypad, a power key, a paper feed key, various function keys, or a keyboard. The touch sensor obtains information indicating a specified position within a certain area. The touch sensor is configured as a touch panel integral with the display 33, and inputs a signal indicating a touched position on the screen displayed on the display 33 to the system controller 31.

The camera 35 is an imaging device that includes an optical system and an imaging element. The camera 35 converts the light focused by the optical system into an image (image data) using the imaging element. The camera 35 supplies the captured image to the system controller 31. Note that the information processing device 12 may be configured to include a communication interface that receives images captured by the camera 35, rather than including the camera 35.

Next, an example of parcel delivery will be described.
FIG. 2 is an explanatory diagram for explaining an example in which a delivery person (an operator of the information processing device 12) delivers a parcel 53 to be delivered, which is placed at an outgoing location 51, to an incoming location 52. In FIG.

The delivery location 51 is the location where the parcel 53 to be delivered is placed.

The luggage 53 is configured so that luggage information can be acquired from its appearance. For example, the luggage 53 is configured so that the first two-dimensional code 54 can be read.

The parcel information includes information such as "parcel identification information," "item name," and "delivery address." The parcel information may also include information about the "shipper."

"Luggage identification information" is unique identification information set for each piece of luggage 53.

"Item name" is information indicating the contents of the luggage 53.

"Destination" is information indicating the destination of the package 53.

"Shipper" is information indicating the sender of the package 53.

The first two-dimensional code 54 is information converted into a two-dimensional image based on a predetermined standard. The first two-dimensional code 54 is generated based on, for example, luggage information. That is, the first two-dimensional code 54 includes luggage information. The first two-dimensional code 54 is generated based on, for example, a Quick Response (QR) Code (registered trademark), a Computer Purpose (CP) Code (registered trademark), DataMatrix (registered trademark), or any other standard.

The loading location 52 is a location where the parcel 53 to be delivered is scheduled to be placed. The loading location 52 is configured so that location information can be acquired from the exterior. For example, the loading location 52 is configured so that the second two-dimensional code 55 can be read. Specifically, the description will be given assuming that a piece of paper with the second two-dimensional code 55 printed on it is attached to the loading location 52.

Location information includes information such as "location identification information" and "address."

"Location identification information" is unique identification information for each pre-defined location (address).

An "address" is information used to identify (recognize) a location.

The second two-dimensional code 55 is a code in which information is converted into a two-dimensional image based on a predetermined standard. The second two-dimensional code 55 is generated based on, for example, location information. That is, the second two-dimensional code 55 includes location information. The second two-dimensional code 55 is generated based on, for example, a Quick Response (QR) Code (registered trademark), a Computer Purpose (CP) Code (registered trademark), DataMatrix (registered trademark), or any other standard.

The delivery person receives the package 53 at the take-out location 51 and moves the package 53 to the take-in location 52. The delivery person places the package 53 near the location at the take-out location 51 where the second two-dimensional code 55 is displayed. Furthermore, the delivery person operates the information processing device 12 to generate a delivery record.

Figure 3 is a flowchart illustrating an example of the operation of the information processing device 12 for generating and storing delivery records.

When a delivery person performs a predetermined operation using the operation interface 34, the processor 41 of the information processing device 12 reads out a program for generating a delivery record (delivery record application) from the memory 42 and executes it (ACT 11).

The processor 41 executes the delivery record application, and when it is launched, it activates the camera 35 (ACT 12).

The camera 35 acquires a captured image (ACT 13). For example, when a delivery person performs a predetermined operation using the operation interface 34, the camera 35 releases the shutter and acquires the captured image. The camera 35 supplies the acquired captured image to the system controller 31.

The camera 35 may also be configured to capture images sequentially at a predetermined cycle while activated, and acquire the captured images. That is, the captured images may be through images that are generated sequentially at a predetermined cycle by the image sensor of the camera 35. In this case, the camera 35 also sequentially supplies the captured images (through images) to the system controller 31. In this case, the processor 41 of the system controller 31 can perform a live view display in which the captured images (through images) are sequentially displayed on the display.

For example, the delivery person aims the camera 35 of the information processing device 12 so as to capture an image of the package 53 placed near the location where the second two-dimensional code 55 of the delivery location 51 is indicated. In this case, the delivery person aims the camera 35 so that both the first two-dimensional code 54 of the package 53 and the second two-dimensional code 55 of the delivery location 51 are within the frame. As a result, the camera 35 supplies the system controller 31 with a captured image that shows both the first two-dimensional code 54 of the package 53 and the second two-dimensional code 55 of the delivery location 51.

The processor 41 reads a luggage image from the captured image provided by the camera 35 (ACT 14). The processor 41 also reads a location image from the captured image provided by the camera 35 (ACT 15).

The luggage image is an image for identifying the luggage 53. At the very least, the luggage image needs to be an image for obtaining luggage information. For example, the luggage image is a first two-dimensional code 54 that includes luggage information. That is, the processor 41 detects and reads the first two-dimensional code 54 attached to the luggage 53 as a luggage image from within the captured image. The processor 41 decodes the detected first two-dimensional code 54 and obtains the luggage information used to generate the first two-dimensional code 54 (ACT 16).

The first two-dimensional code 54 may not be generated based on the baggage information, but may be generated based on the baggage identification information. In this case, the baggage information is stored in advance in the memory 42 of the information processing device 12, the server device 11, or another device that can be connected via the network 13, in a state associated with the baggage identification information. When the processor 41 detects the first two-dimensional code 54 from the captured image, it decodes the detected first two-dimensional code 54 to obtain the baggage identification information. Furthermore, the processor 41 obtains the baggage information associated with the obtained baggage identification information from the memory 42 of the information processing device 12, the server device 11, or another device that can be connected via the network 13.

The luggage image in the captured image may be any image that can at least identify the luggage 53. For example, the luggage image may be an image of the exterior of the luggage 53. In this case, the processor 41 detects an image of an area in the captured image in which the luggage 53 appears as the luggage image. The processor 41 then acquires luggage information based on the detected luggage image from a database in which information to be compared with the luggage image is associated with the luggage information. The information to be compared with the luggage image is, for example, a feature (such as a local feature) that has been generated in advance based on an image of the exterior of the luggage 53.

The location image is an image for identifying the location where the luggage 53 is placed. At the very least, the location image needs to be an image for acquiring location information. For example, the location image is a second two-dimensional code 55 including location information. That is, the processor 41 detects and reads the second two-dimensional code 55 shown at the loading location 52 where the luggage 53 is placed from within the captured image as a location image. The processor 41 decodes the detected second two-dimensional code 55 and acquires the location information used to generate the second two-dimensional code 55 (ACT 17).

The second two-dimensional code 55 may not be generated based on the location information, but may be generated based on the location identification information. In this case, the location information is stored in advance in the memory 42 of the information processing device 12, the server device 11, or another device that can be connected via the network 13 in a state associated with the location identification information. When the processor 41 detects the second two-dimensional code 55 from the captured image, the processor 41 decodes the detected second two-dimensional code 55 to obtain the location identification information. Furthermore, the processor 41 obtains the location information associated with the obtained location identification information from the memory 42 of the information processing device 12, the server device 11, or another device that can be connected via the network 13.

The location image in the captured image may be any image that can at least identify the loading location 52 where the luggage 53 is placed. For example, the location image may be an image that depicts the external features of the loading location 52. In this case, the processor 41 detects an image obtained by excluding the area in which the luggage 53 is captured from the captured image as the location image. The processor 41 further acquires location information based on the detected location image from a database in which information to be compared with the location image is associated with the location information. The information to be compared with the location image is, for example, a feature (such as a local feature) that has been generated in advance based on an image that depicts the external features of the loading location 52.

When the processor 41 acquires the luggage information and location information, it generates a composite image 61 shown in FIG. 4 and displays it on the display 33 (ACT 18).

FIG. 4 is an explanatory diagram for explaining an example of the composite image 61. As shown in FIG.
The composite image 61 is an image in which a captured image, baggage information, and location information are displayed.

The processor 41 generates an object for displaying the luggage information (luggage information display object) 62 based on the luggage information acquired in ACT 16. The luggage information display object 62 is an image in which the luggage information is displayed in a visible state. The luggage information display object 62 is, for example, an object for displaying the luggage information in Augmented Reality (AR) by superimposing it on the captured image.

The processor 41 also generates an object for displaying the location information (location information display object) 63 based on the location information acquired in ACT 17. The location information display object 63 is an image in which the location information is displayed in a visible state. The location information display object 63 is, for example, an object for displaying the location information in Augmented Reality (AR) by superimposing it on the captured image.

The processor 41 displays the baggage information display object 62 and the location information display object 63 in an overlay on the captured image acquired in ACT 13, generating the composite image 61 of FIG. 4. For example, the processor 41 displays the baggage information display object 62 near the position where the baggage image was detected in the captured image, and displays the location information display object 63 near the position where the location image was detected in the captured image. Furthermore, the processor 41 displays a save button 64 on the display 33.

The processor 41 determines whether to save the composite image 61 (ACT 19). If the save button 64 is selected, the processor 41 determines to save the composite image 61. If the processor 41 determines not to save the composite image 61 (ACT 19, NO), the processor 41 proceeds to ACT 13 and performs the processes of ACT 13 to ACT 18 using the next captured image. This allows the processor 41 to AR-display the baggage information display object 62 and the location information display object 63 in the live view display.

When the processor 41 determines to save the composite image 61 (ACT 19, YES), it acquires time information and device information (ACT 20). For example, the processor 41 acquires time information from a clock function (not shown) of the information processing device 12 or via the communication interface 32. The processor 41 also acquires device information stored in the memory 42 of the information processing device 12. Furthermore, the processor 41 may acquire location information acquired by a GPS function (not shown) of the information processing device 12.

The processor 41 stores the composite image 61, the time information, and the device information (ACT 21). For example, the processor 41 stores the composite image 61, the time information, and the device information in the memory 42 of the information processing device 12. In another example, the processor 41 stores the composite image 61, the time information, and the device information in a recording medium connected via a recording medium interface (not shown) provided in the information processing device 12. In another example, the processor 41 supplies the composite image 61, the time information, and the device information to the server device 11 connected via the communication interface 32 and the network 13, and causes them to be stored. The processor 41 stores the composite image 61, the time information, and the device information in association with each other. In another example, the processor 41 may store the composite image 61, the time information, and the device information in different recording media.

Furthermore, the processor 41 may acquire location information using a GPS function (not shown) provided in the information processing device 12, and store the acquired composite image 61, time information, and device information in association with the acquired composite image 61, time information, and device information.

Furthermore, the processor 41 calculates a hash value (ACT 22). For example, the processor 41 calculates a hash value (image-specific information) based on the composite image 61. Also, for example, the processor 41 may calculate the hash value based on the composite image 61, time information, and/or device information.

The processor 41 stores the calculated hash value (ACT 23). For example, the processor 41 stores the hash value in a storage medium separate from the composite image 61. Specifically, the processor 41 stores the composite image 61, the time information, and the device information in the memory 42 of the information processing device 12, and stores the hash value in the memory 24 of the server device 11.

For example, the processor 41 may be configured to store the composite image 61 and the hash value using a blockchain. In this case, the processor 41 supplies the composite image 61 and the hash value to a server (a blockchain server) that registers the blockchain, and requests that they be stored using the blockchain. For example, the blockchain server may be the server device 11, or another server.

As described above, the information processing device 12 acquires a captured image including a luggage image, which is an image for identifying the luggage, and a location image, which is an image for identifying the location. The processor 41 of the information processing device 12 acquires luggage information from the luggage image, acquires location information from the location image, and generates a composite image 61 by combining the captured image with a display based on the luggage information and the location information. The processor 41 records the generated composite image 61 on a recording medium. With this configuration, in a delivery method in which luggage is delivered to a specified location rather than handing over luggage from person to person, it is possible to save a delivery record (composite image 61) including the delivered luggage, the delivery location (place of entry), luggage information based on the image of the luggage, and location information based on the delivery location. This allows the information processing device 12 to save a record of the delivery of the luggage even when it is difficult to sign or stamp it.

In the above embodiment, a piece of paper on which the second two-dimensional code 55 including location information is printed is attached to the loading location 52, but the present invention is not limited to this configuration. The second two-dimensional code 55 may be displayed in any manner at the loading location 52. For example, as in the example of FIG. 5, the second two-dimensional code 55 may be displayed on a display 71 provided at the loading location 52.

Furthermore, if a display 71 is provided at the delivery location 52, a second two-dimensional code 55 generated sequentially based on location information and time information that changes over time may be displayed on the display 71. That is, if the location image is configured as an image displayed on the display 71, it may be configured to further include information indicating the time. With this configuration, the information processing device 12 can obtain time information from the second two-dimensional code 55 as the location image.

In the above embodiment, the information processing device 12 is described as being configured to generate and store the composite image 61 as a delivery record, but is not limited to this configuration. The information processing device 12 may be configured to generate video data in which the package information display object 62 and the location information display object 63 are displayed in AR as a delivery record, and store the video data as a delivery record. This makes it more difficult to tamper with the data.

Although several embodiments of the present invention have been described, these embodiments are presented as examples and are not intended to limit the scope of the invention. These novel embodiments can be implemented in various other forms, and various omissions, substitutions, and modifications can be made without departing from the gist of the invention. These embodiments and their modifications are included in the scope and gist of the invention, and are included in the scope of the invention and its equivalents described in the claims.

1...information recording system, 11...server device, 12...information processing device, 13...network, 21...system controller, 22...communication interface, 23...processor, 24...memory, 31...system controller, 32...communication interface, 33...display, 34...operation interface, 35...camera, 41...processor, 42...memory.

Claims (7)

a communication interface for acquiring captured images including a baggage image for identifying the baggage and a location image for identifying the location where the baggage is placed ;
a processor that acquires luggage information based on the luggage image acquired through the communication interface from a database in which information to be compared with the luggage image is associated with luggage information, acquires location information based on the location image acquired through the communication interface from a database in which information to be compared with the location image is associated with location information, and records a composite image obtained by combining the captured image with the luggage information and the location information on a recording medium as a delivery record ;
An information processing device comprising: the luggage image is a first two-dimensional code generated based on luggage information,
the location image is a second two-dimensional code generated based on location information,
The information processing device according to claim 1 , wherein the processor combines the package information obtained by decoding a first two-dimensional code and the location information obtained by decoding a second two-dimensional code with the captured image. The information processing device according to claim 1, wherein the processor identifies the luggage image, obtains luggage information based on the identification result, identifies the location image, and obtains location information based on the identification result. The information processing device according to claim 1 , wherein the location image displayed on the display further includes information indicating a time. The information processing apparatus according to claim 1 , wherein the processor generates image-specific information based on the composite image, and records the generated image-specific information on a recording medium separate from the composite image. A computer of an information processing device having a communication interface for acquiring captured images including a baggage image for identifying a baggage and a location image for identifying a location where the baggage is placed,
acquiring luggage information based on the luggage image acquired through the communication interface from a database in which information to be compared with the luggage image is associated with the luggage information;
acquiring location information based on the location image acquired through the communication interface from a database in which information to be compared with the location image is associated with the location information;
recording a composite image obtained by combining the captured image with the package information and the location information on a recording medium as a delivery record;
A program that can execute. the luggage image is a first two-dimensional code generated based on luggage information,
the location image is a second two-dimensional code generated based on location information,
The computer includes:
The program according to claim 6, further capable of synthesizing the luggage information obtained by decoding the first two-dimensional code and the location information obtained by decoding the second two-dimensional code into the captured image.