JP7053064B2 - Luggage reception system and luggage reception method - Google Patents

Description

This disclosure relates to a baggage reception system and a baggage reception method.

Convenience stores and other stores provide delivery reception services as part of their services. At this time, the store measures the parcel and calculates the charge at the time of delivery reception according to the reception standard and the charge standard of each delivery company. Specifically, the clerk receives the delivery object from the customer and measures the size. Then, the clerk inputs the information into the POS (Point of sale) terminal from the form on which the carrier, the delivery type, the delivery destination, etc. are described, calculates the charge, and performs the settlement.

For the clerk, measuring the size of the luggage is complicated and time-consuming. On the other hand, for example, Patent Document 1 discloses a technique of photographing a luggage and measuring the size.

JP-A-2015-194424

However, in the technique described in Patent Document 1, it is necessary to attach a reference label having a known size to a rectangular parallelepiped-shaped baggage in advance.

The purpose of the present disclosure is to measure the size of the baggage, reduce the burden on the clerk, and input the baggage information incorrectly even if the baggage is not affixed with a reference label whose size is known in advance. The purpose is to provide a baggage receiving system and a baggage receiving method that can be prevented.

The luggage receiving system according to the first aspect of the present disclosure is arranged at a position where a rectangular-shaped luggage placed on a mounting table can be photographed substantially from directly above, and the luggage is photographed with the luggage. A baggage measuring device having a depth sensor for acquiring a distance, a control unit for calculating the size of the baggage based on the data acquired from the depth sensor, an image pickup device, an information acquisition device, and a settlement device. The information acquisition device acquires information on the delivery of the baggage by image recognition of the image acquired by the image pickup device, and the baggage measuring device is based on the information on the size of the baggage and the delivery of the baggage. The delivery charge of the baggage is calculated, the settlement device setstles the delivery fee of the baggage, and the control unit captures the previously described stand without a mounting object with the depth sensor in advance to obtain a background depth image. It is stored as data, the depth sensor is controlled, the baggage placed on the above-mentioned stand is photographed from substantially directly above, and the depth image data of the baggage is acquired, and the depth image data of the baggage is obtained. The data of the luggage in the depth image data of the luggage is specified by comparison with the background depth image data, and the data of the distance from the depth sensor to the upper surface of the luggage in the depth image data of the luggage and the background of the luggage. The height of the baggage is calculated based on the data of the distance from the depth sensor to the upper surface of the above-mentioned table in the depth image data, and the depth image of the baggage is obtained by image recognition of the image acquired by the image pickup device. The position of the first apex located on the leftmost side in the data, the position of the second apex located on the rightmost side in the depth image data of the baggage, and the position on the uppermost side in the depth image data of the baggage. Or the position of the third apex located on the lowermost side, and the first apex, the second apex, and the third apex in the space with the center of the depth sensor as the origin. The two-dimensional coordinates of the depth sensor, the viewing angle of the depth sensor, the distance data of the first apex, the second apex, and the third apex from the depth sensor, respectively, and the sensor element of the depth sensor. The first apex and the second apex are obtained based on the number of the first apex, the second apex, and the position data of the sensor element of the depth sensor corresponding to the first apex, the second apex, and the third apex, respectively. The length of the first side between the first and third vertices, and the second and third vertices, based on the two-dimensional coordinates of the vertices and the third vertices. Of the second side between the vertices It calculates the length and outputs the calculated result.

In the baggage receiving method according to the second aspect of the present disclosure, the baggage measuring device having an image pickup device is arranged at a position where a rectangular parallelepiped-shaped baggage mounted on a mounting table can be substantially photographed from directly above. Luggage measurement that calculates the size of the baggage using a depth sensor that photographs the baggage and acquires the distance to the baggage, and calculates the delivery charge of the baggage based on the information on the size of the baggage and the delivery of the baggage. It is a baggage receiving method including a step, an information acquisition step in which the information acquisition device acquires information regarding the delivery of the baggage, and a settlement step in which the settlement device settles the delivery fee of the baggage.

In the baggage measurement step, the previously described pedestal without an object is photographed in advance by the depth sensor and stored as background depth image data, the depth sensor is controlled, and the previously described pedestal is placed on the previously described pedestal. The baggage is photographed from substantially directly above to acquire the depth image data of the baggage, and the data of the baggage in the depth image data of the baggage is specified by comparing the depth image data of the baggage with the background depth image data. Then, based on the data of the distance from the depth sensor to the upper surface of the luggage in the depth image data of the luggage and the data of the distance from the depth sensor to the upper surface of the above-mentioned pedestal in the background depth image data of the luggage. Then, the height of the baggage is calculated, and by image recognition of the image acquired by the image pickup device, the position of the first apex located on the leftmost side in the depth image data of the baggage and the depth image data of the baggage. The position of the second apex located on the rightmost side and the position of the third apex located on the uppermost side or the lowermost side in the depth image data of the baggage are specified, and the depth is said. The two-dimensional coordinates of the first apex, the second apex, and the third apex in the space with the center of the sensor as the origin are the viewing angle of the depth sensor and the first apex, the first apex, respectively. The data on the distances of the second apex and the third apex from the depth sensor, the number of sensor elements of the depth sensor, and the first apex, the second apex, and the third apex, respectively. Obtained based on the position data of the sensor element of the depth sensor corresponding to the apex, and based on the two-dimensional coordinates of the first apex, the second apex, and the third apex, the first apex. The length of the first side between the third apex and the third apex and the length of the second side between the second apex and the third apex are calculated, and the calculated result is output. Then, in the information acquisition step, the information acquisition device acquires information regarding the delivery of the package by image recognition of the image acquired by the image pickup device.

With this disclosure, even if a standard label whose size is known is not affixed to the baggage in advance, the size of the baggage can be measured, the burden on the clerk can be reduced, and the input error of the baggage information can be prevented. It is possible to provide a luggage reception system and a luggage reception method that can be used.

It is a functional block diagram which shows one configuration example of the baggage measuring apparatus which concerns on Embodiment 1. FIG. It is a schematic diagram which shows one configuration example of the baggage measuring apparatus which concerns on Embodiment 2. It is a functional block diagram which shows the baggage measuring apparatus of FIG. It is a flow diagram for demonstrating an example of the baggage measurement processing in the baggage measuring apparatus of FIG. It is a schematic diagram for demonstrating an example of the vertex detection processing in the baggage measurement processing of FIG. It is a figure which shows an example of the coordinate system used in the vertex detection processing in the baggage measurement processing of FIG. It is a schematic diagram for demonstrating an example of the vertex detection process in the baggage measurement process of FIG. 4 based on the field of view of a depth sensor. It is a schematic diagram for demonstrating an example of the vertex detection process in the baggage measurement process of FIG. 4 based on the field of view of a depth sensor. It is a schematic diagram for demonstrating an example of the vertex detection process in the baggage measurement process of FIG. 4 based on the field of view of a depth sensor. It is a schematic diagram for demonstrating an example of the vertex detection process in the baggage measurement process of FIG. 4 based on the field of view of a depth sensor. It is a schematic diagram which shows one configuration example of the baggage receiving system including the baggage measuring device which concerns on Embodiment 3. FIG. It is a flow diagram for demonstrating an example of the baggage measurement processing in the baggage measuring apparatus of FIG. It is a figure which shows an example of the hardware composition of the baggage measuring apparatus.

Hereinafter, embodiments will be described with reference to the drawings. In the embodiment, the same or equivalent elements are designated by the same reference numerals, and duplicate description is omitted.

<Embodiment 1>
FIG. 1 is a functional block diagram showing a configuration example of a luggage measuring device according to the first embodiment.
As shown in FIG. 1, the baggage measuring device 1 according to the present embodiment has a control unit 1a and a depth sensor 1b. The baggage measuring device 1 is configured to use the depth sensor 1b and to calculate (measure) the size of the baggage based on the data acquired by the depth sensor 1b. The control unit 1a can take charge of this calculation.

The depth sensor 1b is arranged at a position where a rectangular parallelepiped-shaped luggage placed on a mounting table can be simultaneously photographed (detectable) from directly above, and the luggage is photographed (detected) to acquire the distance from the luggage. .. The depth sensor 1b can be a TOF (Time Of Flight) type sensor, but may be another measurement method such as a pattern irradiation method. Further, infrared rays and the like can be used for measurement, but the measurement is not limited to this. Of course, directly above may be substantially directly above.

Further, although not shown in FIG. 1, the luggage measuring device 1 according to the present embodiment can have the above-mentioned mounting table. In this case, the depth sensor 1b can be attached to this mounting table, and of course, the depth sensor 1b is attached so that the image pickup unit such as a lens is located at a position where the image can be taken from directly above the luggage. This mounting table is a table on which a rectangular parallelepiped-shaped load photographed by the depth sensor 1b is placed, and the shape is not limited, but at least the mounting surface is basically flat.

The control unit 1a calculates the size of the cargo based on the data acquired from the depth sensor 1b. For example, the control unit 1a can be realized by an integrated circuit (IC). Further, the control unit 1a can also be realized by, for example, a CPU (Central Processing Unit), a working memory, a non-volatile storage device that stores a program, or the like.

A specific size calculation process in the control unit 1a will be described.
The control unit 1a captures a mounting table without a mounting object with the depth sensor 1b in advance and stores it as background depth image data. The control unit 1a can have a storage device for this storage. The storage device for storing the background depth image data and the storage device for storing the above program can be the same storage device.

Further, the control unit 1a controls the depth sensor 1b, photographs the luggage placed on the mounting table from directly above, and acquires the depth image data of the luggage. Then, the control unit 1a specifies the luggage data (data of the portion corresponding to the luggage) in the depth image data of the luggage by comparing the depth image data of the luggage with the background depth image data.

Further, the control unit 1a uses the data of the distance from the depth sensor 1b to the upper surface of the luggage in the depth image data of the luggage and the data of the distance from the depth sensor 1b to the upper surface of the mounting table in the background depth image data of the luggage. Based on this, the height of the luggage is calculated.

Further, the control unit 1a specifies the positions of the first to third vertices as follows. The first vertex is the vertex located on the leftmost side in the depth image data of the cargo. The second vertex is the vertex located on the rightmost side in the depth image data of the cargo. The third vertex is the vertex located on the uppermost side or the lower side in the depth image data of the cargo, and it may be determined in advance whether to adopt the upper side or the lower side.

The control unit 1a obtains the two-dimensional (planar) coordinates of the first vertex in the space with the center of the depth sensor 1b as the origin as follows. That is, the control unit 1a has the viewing angle of the depth sensor 1b, the data of the distance from the depth sensor 1b of the first apex, the number of sensor elements of the depth sensor 1b, and the depth sensor 1b corresponding to the first apex. The two-dimensional coordinates of the first vertex are obtained based on the position data of the sensor element of.

Similarly, the control unit 1a obtains the two-dimensional coordinates of the second vertex and the third vertex in the space with the center of the depth sensor 1b as the origin as follows. That is, the control unit 1a has the viewing angle of the depth sensor 1b, the data of the distance from the depth sensor 1b of the second apex, the number of sensor elements of the depth sensor 1b, and the depth sensor 1b corresponding to the second apex. The two-dimensional coordinates of the second vertex are obtained based on the position data of the sensor element of. Further, the control unit 1a includes the viewing angle of the depth sensor 1b, the data of the distance from the depth sensor 1b of the third apex, the number of sensor elements of the depth sensor 1b, and the depth sensor 1b corresponding to the third apex. Based on the position data of the sensor element of the above, the two-dimensional coordinates of the third vertex are obtained.

Then, the control unit 1a calculates the length of the first side and the length of the second side based on the two-dimensional coordinates of the first vertex, the second vertex, and the third vertex. The calculated result is output. Here, the first side refers to the side between the first vertex and the third vertex, and the second side refers to the side between the second vertex and the third vertex. The result can be displayed on a separately provided display unit, and can be printed by a separately connected printing device. As in this example, the output method of the result does not matter.

According to the luggage measuring device 1 according to the present embodiment, the height of the rectangular parallelepiped luggage and the lengths of the remaining two sides can be calculated by using the depth sensor 1b, so that the size of the luggage is known in advance. It is possible to measure the size of luggage even if a certain reference label is not affixed.

<Embodiment 2>
The second embodiment will be described mainly on the differences from the first embodiment with reference to FIGS. 2 to 10, but various examples described in the first embodiment can be applied. FIG. 2 is a schematic diagram showing a configuration example of the luggage measuring device according to the second embodiment, and FIG. 3 is a functional block diagram showing the luggage measuring device of FIG.

As shown in FIG. 2, the baggage measuring device according to the present embodiment includes a tablet terminal 10 including a control unit 1a, a depth sensor 11 as an example of the depth sensor 1b, and a mounting table (loading platform) to which the depth sensor 11 is attached. 12 can have.

The tablet terminal 10 is connected to the depth sensor 11 by wire or wirelessly, and can communicate with the depth sensor 11. The tablet terminal 10 can have a communication interface or the like for such a connection. The tablet terminal 10 may be a device called a mobile PC (Personal Computer), or may be a device such as a stationary PC or a mobile phone (including a device called a smartphone). good.

The baggage measuring device shown in FIG. 2 is, for example, a device that measures the size of the baggage P to be delivered by the depth sensor 11, and is installed in a section of the store in order to reduce the work of the clerk of the baggage reception shop. Can be left. Luggage can be delivered to home. Further, the parcel delivery store is not limited to the parcel delivery collection center operated by the parcel delivery company, but may be a store that undertakes the parcel delivery reception business such as a convenience store.

For example, the customer places the cargo P to be delivered on the mounting table 12, confirms the size displayed on the tablet terminal 10 of the customer, makes a payment at the POS terminal in the store, and hands the cargo to the clerk. It is possible to carry out delivery reception work in a good condition. At that time, the customer installs the above program (application software) on his / her tablet terminal 10. Then, the customer starts the measurement by pressing the software key for starting the measurement mounted on the software while the software is activated and the luggage P is placed on the mounting table 12. be able to. In addition, before the settlement, the delivery address and the name can be input from the software, so that the amount according to the delivery distance can be settled. It should be noted that the payment can also be made electronically on the customer's tablet terminal 10.

Of course, in the delivery receiving business, the store may confirm the size of the baggage P placed by the customer or the clerk on the tablet terminal 10 of the store.

Next, the measurement of the luggage in the present embodiment will be described.
The depth sensor 11 can be a device that can acquire the distance information of the captured range for each pixel (that is, for each sensor element). The depth sensor 11 acquires the distance from the plane with the depth sensor 11 as the origin to the object. The plane with the depth sensor as the origin is a plane orthogonal to the camera axis with the shooting direction of the depth sensor as the camera axis (sensor axis).

As shown in FIG. 2, the depth sensor 11 is a depth sensor installed directly above (directly above) so that the upper surface (see FIG. 5) of the luggage (rectangular parallelepiped) P mounted on the mounting table 12 can be photographed. Obtain the distance to the luggage P. The distance to the luggage P can include at least the distance to each of the first to third vertices. Here, it is assumed that the luggage P is a rectangular parallelepiped. Therefore, the fact that it is installed directly above means that it is installed so that it can be photographed from a direction perpendicular to the plane of the mounting table 12. Of course, directly above may be substantially directly above. If the luggage P is not a rectangular parallelepiped, it may be dealt with by, for example, outputting an error.

The depth sensor 11 can be mounted on the mounting table 12 via the sensor mounting portion 13, for example. The sensor mounting portion 13 can include, for example, a support column 13a installed vertically on the mounting table 12 and a sensor mounting member 13b installed on the upper end of the support column 13a. The sensor mounting member 13b may also be provided with a mechanism for sliding the depth sensor 11 so that the horizontal position of the depth sensor 11 (distance from the support column 13a) can be changed. Further, the support column 13a can be provided with a mechanism capable of changing the height thereof, whereby the height of the depth sensor 11 can be changed.

As shown in FIG. 3, the tablet terminal 10 has a depth processing unit 21, a background depth unit 22, a vertex detection unit 23, a length calculation unit (measurement unit or calculation unit) 24, as functional units corresponding to the control unit 1a. It can also have an output unit 25 such as a screen output unit. These functional units 21 to 25 can be realized by the CPU of the control unit 1a executing the above software.

The depth processing unit 21 acquires and stores data from the depth sensor 11. The background depth unit 22 stores data acquired by photographing a state in which nothing is placed on the mounting table 12 in advance. The vertex detection unit 23 identifies the data of the luggage and specifies the positions of the first to third vertices. Therefore, the vertex detection unit 23 compares the depth information stored in the background depth unit 22 with the depth information in the state where the load is present, extracts the changed portion, and extracts the vertex information (first to third) from the extracted data. Information indicating the vertices of) is detected.

The length calculation unit 24 calculates the distance between the vertices (that is, the length of the first side and the length of the second side) from the information detected by the vertex detection unit 23, and the output unit 25 outputs the result. give. The output unit 25 outputs the result calculated by the length calculation unit 24 (that is, the measurement result of the luggage) to the outside, and also outputs information related to the operation and the like. The output unit 25 can be, for example, a display unit of the tablet terminal 10. The output unit 25 may be a communication interface for outputting the measurement result to, for example, a printing device for printing on a cover page to be attached to the package P.

Next, an operation example of the luggage measuring device according to the present embodiment will be described with reference to FIGS. 4 to 10. FIG. 4 is a flow chart for explaining an example of the baggage measurement process in the baggage measuring device of FIG. FIG. 5 is a schematic diagram for explaining an example of the vertex detection process in the baggage measurement process of FIG. 4, and FIG. 6 is a diagram showing an example of a coordinate system used in the vertex detection process in the baggage measurement process of FIG. .. 7 to 10 are schematic views for explaining an example of the vertex detection process in the baggage measurement process of FIG. 4 based on the field of view of the depth sensor.

First, the vertex detection unit 23 uses the change in depth (distance to the object) to detect the object (baggage P), so that the background data (background depth image data) is stored in advance. Confirm (step S1). If NO in step S1, that is, if the background depth image data is not saved, the apex detection unit 23 controls the depth sensor 11 and acquires the background depth data from the background depth unit 22 (step S2). Save the background depth image data (step S3). Here, an example of starting the measurement of the baggage P with a change in depth as a trigger will be described, but for example, an operation of a customer (or a clerk) can be used as a trigger.

The vertex detection unit 23 acquires depth data from the depth sensor 11 (step S4). The vertex detection unit 23 determines whether or not the depth has changed from the background depth image data in the acquired data, and thus whether or not the luggage P has been placed on the mounting table 12 (whether or not the luggage P has been detected). Is determined (step S5).

When the depth changes, the vertex detection unit 23 determines that the luggage P is placed on the mounting table 12, and extracts the point where the depth has changed from the background depth of the depth sensor 11. The changed point is the point where the luggage P exists. Then, the apex detection unit 23 detects the apex of the load (object) P from the changed points (step S6). In step S6, first, three vertices A, B, and C as shown in FIG. 5 can be determined based on the depth image data regarding the load P extracted from the depth change of the depth sensor 11. The vertices A, B, and C refer to the first vertex, the second vertex, and the third vertex, respectively. In this example, an example of detecting the uppermost vertex as the third vertex is given.

Further, the three vertices A, B, and C may be detected by image recognition by capturing an image of the luggage P with a camera (capturing the same area as the shooting area of the depth sensor 11) to acquire an image. In this camera, the depth sensor 11 may be a depth sensor with a camera (also referred to as a depth camera), or may be a camera provided separately from the depth sensor 11. As described above, the baggage measuring device according to the present embodiment further includes an image pickup device such as a camera, and the vertex detection unit 23 determines the first to third vertices by image recognition of the image acquired by the image pickup device. You may try to specify. By superimposing the luggage area in the depth image of the depth sensor 11 and the luggage area in the camera image, it is possible to know which point the three vertices in the camera image correspond to in the depth image of the depth sensor 11. It is possible.

Further, when the vertex detection unit 23 cannot detect three vertices from the depth change, it may output an error as described above, but the display unit of the tablet terminal 10 may correct the position of the luggage P. The prompting message may be displayed together with the image of the luggage P. Examples of this message include a message prompting movement or rotation so that the upper surface of the luggage P can be photographed. Note that this display unit can be an example of the output unit 25, and such display control can be carried out by a part of the control unit 1a of FIG. Further, in this case, although not shown, the vertex detection unit 23 and the output unit 25 are connected in FIG. 3.

As described above, when the vertex detection unit 23 captures the image of the luggage P on the mounting table 12 and displays the image of the luggage P on the display unit, and cannot specify at least one of the vertices A to C of the luggage P, A message prompting the correction of the loading state of the luggage P may be displayed on the display unit. Further, the vertex detection unit 23 automatically detects the other side (lowermost side in this example) when the predetermined side (for example, the uppermost side) cannot be detected for the third vertex. May be good.

Further, the image of the luggage P may be displayed on the display unit even when all of the vertices A to C are detected. That is, the baggage measuring device according to the present embodiment can have an image pickup device such as a camera in the depth sensor 11 (or separately from the depth sensor 11), and the image of the baggage P captured by the image pickup device can be captured by the tablet terminal 10. It can also be configured to be displayed on the display unit of.

Here, an example of the determination process for determining the three vertices of the load P will be described with reference to FIG. The depth sensor 11 is installed so as to obtain an image of the upper surface of the luggage P as shown in FIG. As described above, the depth sensor 11 acquires the distance from the plane with the depth sensor 11 as the origin to the object. Therefore, the vertex detection unit 23 can obtain actual distance data from the depth sensor 11 at a certain point in the photographing region (depth image) of the depth sensor 11. Further, the vertex detection unit 23 receives data from the depth sensor 11 indicating which sensor element (which pixel) a certain point in the imaging region (depth image) of the depth sensor 11 corresponds to (which pixel), that is, the depth sensor of a certain point. It is possible to obtain position data in the shooting area (depth image) of.

The apex detection unit 23 compares the distance data when the luggage P is not loaded with the distance data when the luggage P is loaded, so that the luggage P is located anywhere in the photographing area of the depth sensor. You can get if it is located. As a result, the vertex detection unit 23 can specify the distance data from the plane with the depth sensor 11 as the origin at each point of the cargo P. Then, the vertex detection unit 23 can determine the point located on the leftmost side as the vertex A, the point located on the rightmost side as the vertex B, and the point located on the uppermost side as the vertex C. The vertices A, B, and C do not have to be determined in the above order.

When the luggage P is placed so that one side of the upper surface of the luggage P is parallel to the Y axis (see FIG. 6) of the depth sensor 11, the luggage P parallel to the Y axis (see FIG. 6). The lower end of one side of the upper surface can be a vertex A, the upper end can be a vertex C, and the other end of one side extending from the vertex C can be a vertex B.

Following step S6, the length calculation unit 24 measures the size of the luggage P (step S7). A method of measuring the size of the luggage P in step S7, that is, calculating the actual dimensions of the height, the side AC, and the side BC will be described.

First, the height of the luggage P is the distance data from the depth sensor 11 to the upper surface of the luggage P in the depth image data of the luggage P, and the depth sensor 11 to the upper surface of the mounting table 12 in the background depth image data of the luggage P. Calculated based on the distance data from. The distance from the depth sensor 11 to the upper surface of the luggage P and the distance from the depth sensor 11 to the upper surface of the mounting table 12 are obtained from the data of the depth sensor 11.

Next, a method of calculating the actual dimensions of the side AC and the side BC will be described.
As shown in FIG. 6, the center of the depth sensor 11 is the origin, the camera axis direction is the Z axis, the direction on the same plane as the Z axis is the X axis, and the X axis and the Z axis are orthogonal to the Z axis. The orthogonal direction is the Y axis.

In order to calculate the actual dimensions of the sides AC and BC, the plane (two-dimensional) coordinates of the upper surfaces of the luggage P in the space of the X-axis, Y-axis, and Z-axis, that is, the points A. , B, C It is necessary to specify the two-dimensional coordinates excluding the height direction coordinates. Let the plane coordinates of the points A, B, and C be A (Xa, Ya), B (Xb, Yb), and C (Xc, Yc).

A method of calculating Xa and Ya, which are the plane coordinates of the point A, will be described with reference to FIGS. 7 to 10.
Assuming that the viewing angle of the depth sensor 11 in the X-axis direction is θx (degrees), the actual distance X _amaxp to the edge of the image at the point A can be calculated from the following equation as can be seen from FIGS. 7 and 9. Here, Za is the distance from the depth sensor 11 to the upper surface of the luggage P.
X _amaxp = Za × tan (θx / 2)

Further, assuming that the viewing angle of the depth sensor 11 in the Y-axis direction is θy (degrees), the actual distance Y _amaxp to the edge of the image at the point A can be calculated from the following equation as can be seen from FIGS. 8 and 10. ..
Y _amaxp = Za × tan (θy / 2)

Here, it is assumed that the resolution of the depth image is 640pixel in the X-axis direction and 480pixel in the Y-axis direction. In this case, as illustrated in FIG. 6, in the X-axis direction, No. 0-No. 639 pixels (sensor elements) are arranged, and No. 639 pixels (sensor elements) are arranged in the Y-axis direction. 0-No. This means that 479 pixels (sensor elements) are arranged. That is, in this case, the number of sensor elements in the X-axis direction and the number of sensor elements in the Y-axis direction are 640 and 480, respectively. In the following, an example in which the resolutions in the X-axis and Y-axis directions of the depth image are set to 640pixel and 480pixel, respectively, will be described. However, the respective resolutions (number of sensor elements) Xnmr and Ynmr are the depths to be used. It depends on the sensor 11.

X _amaxp corresponds to the distance from the origin (center of the image) to the 640th pixel (No. 639), and Y _amaxp is the distance from the origin (center of the image) to the 480th pixel (No. 479). Corresponds to.

The position data in the photographing region (depth image) of the depth sensor 11 at the point A, that is, which pixel the point A corresponds to is obtained from the data of the depth sensor 11. Therefore, assuming that the positions of the pixels (sensor elements) on the X-axis and Y-axis of the point A are (No. Xa-pixel, No. Ya-pixel), Xa and Ya can be calculated from the following equations.

Xa = ΔXa × ((Xa-pixel) -640/2)
Ya = ΔYa × ((Ya-pixel) -480/2)

Here, ΔXa is the rate of change for each pixel (sensor element) in the X direction at the point A, which is obtained by (Equation) ΔXa = X _amaxp / (640/2). Further, ΔYa is the rate of change for each pixel (sensor element) in the Y direction at the point A, which is obtained by (Equation) ΔYa = _Yamaxp / (480/2).

Similarly, Xb and Yb at point B and Xc and Yc at point C can be calculated.
Then, the length of the side AC can be calculated by the following formula.
√ ((Xc-Xa) ² + (Yc-Ya) ² )
Similarly, the length of the side BC can be calculated by the following formula.
√ ((Xc-Xb) ² + (Yc-Yb) ² )

Following step S7, the output unit 25 outputs the measurement result of the size of the luggage P obtained from the length calculation unit 24 (step S8). As described above, the output of the measurement result includes, for example, displaying the measurement result on the screen of the tablet terminal 10, printing the measurement result from a printer (not shown), and discharging the measurement result. As another example, the output unit 25 can also transmit the measurement result to another device (POS terminal or the like) (not shown).

According to the present embodiment described above, since the baggage measuring device having the effect of the first embodiment is installed in a store or the like, the baggage can be measured inexpensively, efficiently and easily. Therefore, according to the present embodiment, it is possible to reduce the work of retail stores and the like, and it is also possible for the customer to accept the delivery package by himself / herself. In recent years, with the increase in online shopping and transactions between individuals, the use of delivery services by general users has increased, so that the effect of this embodiment is beneficial.

<Embodiment 3>
The third embodiment will be described with reference to FIGS. 11 and 12, focusing on the differences from the second embodiment including its effects. However, various examples described in the first and second embodiments can be applied to the third embodiment. FIG. 11 is a schematic diagram showing a configuration example of a luggage receiving system including the luggage measuring device according to the third embodiment, and FIG. 12 is a flow chart for explaining an example of luggage measurement processing in the luggage measuring device of FIG. Is.

As shown in FIG. 11, the parcel receiving system according to the present embodiment is a system that accepts the parcel P to be delivered, and includes the parcel measuring device described in the second embodiment and a settlement device for settling the delivery fee. be able to. The settlement device may be an electronic money reader / writer (R / W) 10b or another device as illustrated below. The checkout device may also include a server device separately connected to the network.

Further, the luggage measuring device according to the present embodiment has a weight scale 14 in the mounting table 12. The weight scale 14 measures the weight of the luggage P and outputs the result to the self-POS terminal 10a. Here, the self-POS terminal 10a is a part of the baggage measuring device in the present embodiment, and is an example of a terminal provided in place of the tablet terminal 10.

Further, the baggage receiving system according to the present embodiment can be provided with an image pickup device exemplified by a camera, and will be described below with reference to an example provided with a depth sensor 11a with a camera as shown in FIG. The self-POS terminal 10a controls the camera of the depth sensor 11a with a camera to capture an image of a slip (invoice, etc.) containing delivery information related to delivery, which is attached to the package P, and prints the information related to the delivery of the package P. It can be acquired by recognition processing or the like.

Then, the self-POS terminal 10a can calculate the delivery charge of the luggage P based on the size and weight of the luggage P and the information regarding the delivery of the luggage P, and output the delivery charge to the electronic money R / W10b. can. Then, the electronic money R / W10b setstles the delivery charge of the package P.

As described above, the baggage receiving system according to the present embodiment can measure the weight not only by the size of the baggage but also by the weight scale 14, and recognizes the information of the slip attached to the baggage P in characters. It differs from the second embodiment in that the delivery fee is calculated and the payment is made with electronic money. An operation example of the baggage measuring device in the baggage receiving system (hereinafter referred to as the system) according to the present embodiment will be described with reference to FIG.

The self-POS terminal 10a measures the luggage P on the mounting table 12 while controlling the depth sensor 11a with a camera in its control unit, and outputs the measurement result. In this operation example, in step S4 of the operation example of FIG. 4, in addition to measuring the size of the luggage P, the weight of the luggage P is also measured (step S14). The other procedures are the same, and steps S11 to 13 and S15 to S18 in FIG. 12 correspond to steps S1 to 3 and S5 to S8 in FIG. 4, respectively. However, in step S15, it may be determined that the luggage P has been detected when the weight is detected by the weight scale 14.

Below, in this system, after measuring the size and weight of the baggage P, until the delivery fee is settled, an example thereof will be briefly described.

The customer places the baggage P to which the slip is attached so that the slip is included in the shooting range in order to read the character information by the depth sensor 11a with a camera. That is, the customer puts the luggage P as if the slip is attached to the upper surface that can be photographed. The character information on the slip may be read by a camera separate from the depth sensor. In this system, it is possible to perform character recognition processing from image data taken by the depth sensor 11a with a camera to acquire information on the shipping destination and shipping method of the package P. It should be noted that the information on the shipping source of the package P (that is, the customer's information) may be acquired.

Generally, the shipping fee for a package is calculated based on information on the size of the package, the shipping address (distance to the shipping address), and the shipping method. In this system, the depth sensor 11a with a camera and the weight scale 14 measure the size and weight of the luggage, and the destination and the shipping method can be read from the depth sensor 11a with a camera. Then, in this system, based on the read information, the delivery charge of the package can be determined by referring to the charge table stored in advance in the self-POS terminal 10a.

After that, the customer pays the charge with the electronic money R / W10b connected to the self-POS terminal 10a. A customer's IC card or tablet terminal with an IC card function can be used for payment. After the payment is made, the receipt and the store copy slip are output from the printing device installed in the store, and the customer hands the baggage and the store copy slip to the clerk.

In the above explanation, it was decided to settle with electronic money, but instead of this, even if a change machine having a bill handling device and a coin handling device is connected to the self-POS terminal, payment can be made with cash. good. Further, both an electronic money R / W and a change machine may be provided.

As described above, according to the present embodiment, as in the first and second embodiments, it is possible not only to measure the size of the luggage but also to measure the size of the luggage even if the reference label having a known size is not attached to the luggage in advance. Since the settlement is also performed by the customer, the burden on the clerk can be reduced. Further, according to the present embodiment, it is not necessary to manually input the destination, delivery date, delivery method, etc. of the package, so that it is possible to prevent an input error of such information.

Further, although it is decided to provide the self-POS terminal 10a operated by the customer, it may be a POS terminal operated by a clerk. In this case, the settlement device can also be a POS terminal. Further, in this system, an example of providing a weight scale 14 for measuring the weight of the luggage P is given, but if the weight of the luggage is not related to the delivery charge, the weight scale 14 may not be provided.

Further, in this system, the size of the luggage P is calculated by the self-POS terminal 10a, but the size of the luggage P is calculated by the customer's tablet terminal in the second embodiment, and the luggage is transferred from the tablet terminal to the self-POS terminal 10a. You may want to send size data. For this transmission, the tablet terminal may be configured to be communicable with the depth sensor 11 (and the weight scale 14) and the self-POS terminal 10a.

Further, the package receiving system according to the present embodiment may be provided with another type of information acquisition device for acquiring delivery information, for example, a short-range wireless communication device, instead of the image pickup device. If such a short-range wireless communication device is provided and a readable medium such as an RFID (radio frequency identifier) tag is attached to the baggage P, delivery information can be obtained.

<Other embodiments>
[A]
In the first embodiment, the function of the control unit 1a of the baggage measuring device 1 shown in FIG. 1 has been described, but it is sufficient that this function can be realized as the baggage measuring device 1. Similarly, in the second and third embodiments, the functions of the functional units 21 to 25 shown in FIG. 3 have been described, but it is sufficient if these functions can be realized as a baggage measuring device.

[B]
The baggage measuring device according to the first to third embodiments may have the following hardware configuration. FIG. 13 is a diagram showing an example of the hardware configuration of the luggage measuring device according to the first to third embodiments. The same applies to the other embodiment [a].

The luggage measuring device 100 shown in FIG. 13 has an input / output interface 103 for a processor 101, a memory 102, a depth sensor 1b (11), and the like. The function of the control unit 1a or the function of the function units 21 to 25 in the baggage measuring device described in the first to third embodiments is realized by the processor 101 reading and executing the program stored in the memory 102. As described above, this program can be a program for causing the processor 101 to function as the control unit 1a. Further, this program may include a program for realizing at least one function of the functional units 21 to 25.

In the above example, the program can be stored and supplied to the computer using various types of non-transitory computer readable medium. Non-temporary computer-readable media include various types of tangible storage media. Examples of non-temporary computer-readable media include magnetic recording media (eg, flexible disks, magnetic tapes, hard disk drives), magneto-optical recording media (eg, magneto-optical disks). Further, this example includes a CD-ROM (Read Only Memory), a CD-R, and a CD-R / W. Further, this example includes semiconductor memories (eg, mask ROM, PROM (Programmable ROM), EPROM (Erasable PROM), flash ROM, RAM (Random Access Memory)). The program may also be supplied to the computer by various types of transient computer readable medium. Examples of temporary computer readable media include electrical, optical, and electromagnetic waves. The temporary computer-readable medium can supply the program to the computer via a wired communication path such as an electric wire and an optical fiber, or a wireless communication path.

[C]
Further, as illustrated by exemplifying the procedure of the baggage measuring method in the baggage measuring device in the various embodiments described above, the present disclosure also adopts a form as a baggage measuring method for calculating the baggage size using the above-mentioned depth sensor. obtain. Further, it can be said that the above-mentioned program is a program for causing a computer to execute the above-mentioned baggage measurement method.

The present disclosure is not limited to each of the above embodiments, and can be appropriately modified without departing from the spirit. Further, the present disclosure may be carried out by appropriately combining the respective embodiments.

1,100 Luggage measuring device 1a Control unit 1b, 11 Depth sensor 11a Depth sensor with camera 10 Tablet terminal 10a Self POS terminal 10b Electronic money reader / writer (R / W)
12 Mounting stand 13 Sensor mounting part 13a Strut 13b Sensor mounting member 14 Weighing scale 21 Depth processing part 22 Background depth part 23 Vertex detection part 24 Length calculation part 25 Output part 101 Processor,
102 memory,
103 I / O interface,

Claims (5)

A rectangular parallelepiped-shaped luggage placed on a mounting table is placed at a position where it can be photographed from substantially directly above, and a depth sensor that photographs the luggage and acquires a distance from the luggage, and a depth sensor that acquires the distance from the luggage. A baggage measuring device having a control unit for calculating the size of the baggage based on data, an image pickup device, and the like.
Information acquisition device and
With a checkout device,
Equipped with
The information acquisition device acquires information regarding the delivery of the package by image recognition of the image acquired by the image pickup device.
The package measuring device calculates the delivery charge of the package based on the size of the package and the information regarding the delivery of the package.
The settlement device setstles the delivery fee of the package,
The control unit
The previously described stand without an object is photographed in advance with the depth sensor and stored as background depth image data.
The depth sensor is controlled to photograph the luggage placed on the above-mentioned pedestal from substantially directly above to acquire the depth image data of the luggage, and the depth image data of the luggage and the background depth image data are combined. By comparison, the data of the baggage in the depth image data of the baggage is specified, and the data of the baggage is specified.
Based on the data of the distance from the depth sensor to the upper surface of the luggage in the depth image data of the luggage and the data of the distance from the depth sensor to the upper surface of the above-mentioned pedestal in the background depth image data of the luggage. Calculate the height of the baggage and
By image recognition of the image acquired by the image pickup apparatus, the position of the first vertex located on the leftmost side in the depth image data of the luggage and the second vertex located on the rightmost side in the depth image data of the luggage. And the position of the third vertex located at the uppermost side or the lowermost side in the depth image data of the baggage.
The two-dimensional coordinates of the first vertex, the second vertex, and the third vertex in the space with the center of the depth sensor as the origin are the viewing angle of the depth sensor and the first vertex, respectively. , The distance data of the second vertex and the third vertex from the depth sensor, the number of sensor elements of the depth sensor, and the first vertex, the second vertex, and the second vertex, respectively. Obtained based on the position data of the sensor element of the depth sensor corresponding to the apex of 3.
The length of the first side between the first vertex and the third vertex, and the length of the first side, based on the two-dimensional coordinates of the first vertex, the second vertex, and the third vertex. The length of the second side between the second vertex and the third vertex is calculated, and the calculated result is output.
Moreover, the control unit is
When the imaging direction of the depth sensor is the Z axis, the direction orthogonal to the Z axis is the X axis, and the direction orthogonal to the X axis and the Z axis is the Y axis. Based on the viewing angle of the depth sensor in the X-axis direction and the distance data of the first apex, the second apex, and the third apex in the Z-axis direction, the first apex, respectively. , The actual distance from the Z-axis in the X-axis direction to the image edge at the second apex and the third apex, the viewing angle in the Y-axis direction of the depth sensor, and the first apex, the first apex. From the Z-axis of the first apex, the second apex, and the third apex, respectively, based on the data of the distances of the second apex and the third apex in the Z-axis direction. Find the actual distance to the edge of the image
Based on the actual distance from the Z-axis in the X-axis direction to the image edge at the first apex, the second apex, and the third apex, and the number of sensor elements in the X-axis direction of the depth sensor. , The first apex, the second apex, and the change rate of the actual distance in the X-axis direction for each sensor element at the first apex, the second apex, and the third apex, respectively, and the first apex, the second apex, and the second apex. Based on the actual distance from the Z-axis in the Y-axis direction to the image edge at the third apex and the number of sensor elements in the Y-axis direction of the depth sensor, the first apex and the second apex, respectively. , And the rate of change of the actual distance in the Y-axis direction for each sensor element at the third apex.
Based on the position of the sensor element in the X-axis direction of the first vertex, the second vertex, and the third vertex, and the rate of change of the actual distance in the X-axis direction for each sensor element, respectively. The X-axis of the first vertex, the second vertex, and the third vertex is obtained, and the sensor element of the first vertex, the second vertex, and the third vertex in the Y-axis direction. Based on the position and the rate of change of the actual distance in the Y-axis direction for each sensor element, the Y coordinates of the first vertex, the second vertex, and the third vertex are obtained, respectively, and the first vertex is obtained. The two-dimensional coordinates of the vertex, the second vertex, and the third vertex are used.
Moreover, the control unit is
Based on the distance data of the first apex from the depth sensor, the Z coordinate of the first apex is set to Za, the viewing angle of the depth sensor in the X-axis direction is set to θx, and the sensor element in the X-axis direction. When the number of is Xnmr, the rate of change of the actual distance in the X-axis direction for each sensor element at the first apex is ΔXa.
ΔXa = Za × tan (θx / 2) / (Xnmr / 2)
Asked at
When the viewing angle of the depth sensor in the Y-axis direction is θy and the number of sensor elements in the Y-axis direction is Ynmr, the rate of change of the actual distance in the Y-axis direction of each sensor element at the first apex ΔYa. Formula
ΔYa = Za × tan (θy / 2) / (Ynmr / 2)
Asked at
When the X coordinate of the first vertex is Xa and the position of the sensor element in the X-axis direction of the first vertex is Xa-pixel, the X coordinate of the first vertex is expressed by the equation.
Xa = ΔXa × ((Xa-pixel) -Xnmr / 2)
Asked at
When the Y coordinate of the first vertex is Ya and the position of the sensor element in the Y-axis direction of the first vertex is Ya-pixel, the Y coordinate of the first vertex is expressed as an equation.
Ya = ΔYa × ((Ya-pixel) -Ynmr / 2)
Asked at
Similarly, the X coordinate and the Y coordinate of the second vertex and the third vertex are obtained.
Luggage reception system. It also has a display
The control unit causes the image pickup device to image the luggage on the above-mentioned table, displays an image of the luggage on the display unit, and displays the image of the luggage on the first apex, the second apex, and the first apex of the luggage. When at least one of the vertices of 3 cannot be specified, a message prompting the correction of the loading state of the luggage is displayed on the display unit.
The luggage reception system according to claim 1 . In addition, it has the above-mentioned stand,
The depth sensor is attached to the above-mentioned pedestal.
The luggage reception system according to claim 1 or 2 . Further, a weighing scale is provided in the above-mentioned stand, the weight of the luggage is measured, and the result is output.
The baggage reception system according to any one of claims 1 to 3 . A baggage measuring device having an image pickup device is arranged at a position where a rectangular parallelepiped-shaped baggage placed on a mounting table can be photographed from substantially directly above, and the baggage is photographed to obtain a distance from the baggage. A baggage measurement step that calculates the size of the baggage using a sensor and calculates the delivery fee of the baggage based on the information on the size of the baggage and the delivery of the baggage.
An information acquisition step in which the information acquisition device acquires information regarding the delivery of the package, and
The settlement step in which the settlement device setstles the delivery charge of the package, and
It is a luggage reception method equipped with
The baggage measurement step
The previously described stand without an object is photographed in advance with the depth sensor and stored as background depth image data.
The depth sensor is controlled to photograph the luggage placed on the above-mentioned pedestal from substantially directly above to acquire the depth image data of the luggage, and the depth image data of the luggage and the background depth image data are combined. By comparison, the data of the baggage in the depth image data of the baggage is specified, and the data of the baggage is specified.
Based on the data of the distance from the depth sensor to the upper surface of the luggage in the depth image data of the luggage and the data of the distance from the depth sensor to the upper surface of the above-mentioned pedestal in the background depth image data of the luggage. Calculate the height of the baggage and
By image recognition of the image acquired by the image pickup apparatus, the position of the first vertex located on the leftmost side in the depth image data of the luggage and the second vertex located on the rightmost side in the depth image data of the luggage. And the position of the third vertex located at the uppermost side or the lowermost side in the depth image data of the baggage.
The two-dimensional coordinates of the first vertex, the second vertex, and the third vertex in the space with the center of the depth sensor as the origin are the viewing angle of the depth sensor and the first vertex, respectively. , The distance data of the second vertex and the third vertex from the depth sensor, the number of sensor elements of the depth sensor, and the first vertex, the second vertex, and the second vertex, respectively. Obtained based on the position data of the sensor element of the depth sensor corresponding to the apex of 3.
The length of the first side between the first vertex and the third vertex, and the length of the first side, based on the two-dimensional coordinates of the first vertex, the second vertex, and the third vertex. The length of the second side between the second vertex and the third vertex is calculated, and the calculated result is output.
In the information acquisition step, the information acquisition device acquires information regarding the delivery of the package by image recognition of the image acquired by the image pickup device.
The baggage measurement step
When the imaging direction of the depth sensor is the Z axis, the direction orthogonal to the Z axis is the X axis, and the direction orthogonal to the X axis and the Z axis is the Y axis. Based on the viewing angle of the depth sensor in the X-axis direction and the distance data of the first apex, the second apex, and the third apex in the Z-axis direction, the first apex, respectively. , The actual distance from the Z-axis in the X-axis direction to the image edge at the second apex and the third apex, the viewing angle in the Y-axis direction of the depth sensor, and the first apex, the first apex. From the Z-axis of the first apex, the second apex, and the third apex, respectively, based on the data of the distances of the second apex and the third apex in the Z-axis direction. Find the actual distance to the edge of the image
Based on the actual distance from the Z-axis in the X-axis direction to the image edge at the first apex, the second apex, and the third apex, and the number of sensor elements in the X-axis direction of the depth sensor. , The first apex, the second apex, and the change rate of the actual distance in the X-axis direction for each sensor element at the first apex, the second apex, and the third apex, respectively, and the first apex, the second apex, and the second apex. Based on the actual distance from the Z-axis in the Y-axis direction to the image edge at the third apex and the number of sensor elements in the Y-axis direction of the depth sensor, the first apex and the second apex, respectively. , And the rate of change of the actual distance in the Y-axis direction for each sensor element at the third apex.
Based on the position of the sensor element in the X-axis direction of the first vertex, the second vertex, and the third vertex, and the rate of change of the actual distance in the X-axis direction for each sensor element, respectively. The X-axis of the first vertex, the second vertex, and the third vertex is obtained, and the sensor element of the first vertex, the second vertex, and the third vertex in the Y-axis direction. Based on the position and the rate of change of the actual distance in the Y-axis direction for each sensor element, the Y coordinates of the first vertex, the second vertex, and the third vertex are obtained, respectively, and the first vertex is obtained. The two-dimensional coordinates of the vertex, the second vertex, and the third vertex are used.
Moreover, the baggage measurement step is
Based on the distance data of the first apex from the depth sensor, the Z coordinate of the first apex is set to Za, the viewing angle of the depth sensor in the X-axis direction is set to θx, and the sensor element in the X-axis direction. When the number of is Xnmr, the rate of change of the actual distance in the X-axis direction for each sensor element at the first apex is ΔXa.
ΔXa = Za × tan (θx / 2) / (Xnmr / 2)
Asked at
When the viewing angle of the depth sensor in the Y-axis direction is θy and the number of sensor elements in the Y-axis direction is Ynmr, the rate of change of the actual distance in the Y-axis direction of each sensor element at the first apex ΔYa. Formula
ΔYa = Za × tan (θy / 2) / (Ynmr / 2)
Asked at
When the X coordinate of the first vertex is Xa and the position of the sensor element in the X-axis direction of the first vertex is Xa-pixel, the X coordinate of the first vertex is expressed by the equation.
Xa = ΔXa × ((Xa-pixel) -Xnmr / 2)
Asked at
When the Y coordinate of the first vertex is Ya and the position of the sensor element in the Y-axis direction of the first vertex is Ya-pixel, the Y coordinate of the first vertex is expressed as an equation.
Ya = ΔYa × ((Ya-pixel) -Ynmr / 2)
Asked at
Similarly, the X coordinate and the Y coordinate of the second vertex and the third vertex are obtained.
Luggage reception method.

Images