JP7600703B2 - Manual Scanning Devices and Systems - Google Patents

Description

The present invention relates to a manual scanning device and system that captures information displayed on the surface of a scanning object by manual scanning.

A pen-shaped manual scanning device (pen scanner) is a device in which a user holds the housing of the manual scanning device as if holding a pen, scans the surface of an object to be scanned, and captures information (e.g., characters, figures, etc.) displayed on the surface of the object to be scanned.

As a related technique, for example, Patent Document 1 discloses a pen-type scanner that can read information on the surface of a scanned object with high accuracy by suppressing the effects of the way the housing is held and misalignment in the scanning direction. The pen-type scanner in Patent Document 1 houses an image sensor and a mirror in the housing. Furthermore, the pen-type scanner in Patent Document 1 detects the attitude of the housing and its inclination relative to the scanning surface, and automatically adjusts the inclination of the mirror based on the detection results.

JP 2007-184694 A

However, in the pen scanner of Patent Document 1, light from the surface of the object to be scanned enters the housing from one end of the housing, so the user cannot visually confirm the area to be scanned on the object to be scanned during scanning. In other words, because the user's field of vision is blocked by the housing, the user cannot visually confirm the area to be scanned during manual scanning. Therefore, even with the pen scanner of Patent Document 1, manual scanning cannot be performed with the same sensation as drawing a line with a pen.

Specifically, even with the pen-type scanner of Patent Document 1, when performing manual scanning in an environment where manual scanning is easy, for example, when performing manual scanning of a printed material placed on a desk indoors, manual scanning can be performed well, and the area to be scanned can be captured with high accuracy.

However, when performing manual scanning in an environment where manual scanning is difficult, for example when performing manual scanning on a printed material placed in an unstable location outdoors, unless the user can easily visually confirm the area to be scanned, manual scanning will not be successful and the area to be scanned will not be captured with high accuracy.

For example, when a police officer is enforcing a traffic violation law and manually scans a specific area (scanning area) on a traffic ticket while riding a motorcycle, if the police officer cannot visually confirm the specific area, the manual scan will not work well and the specific area will not be captured with sufficient accuracy.

One aspect of the invention is to provide a manual scanning device and system that improves the convenience of manual scanning.

In order to achieve the above object, a manual scanning device in one aspect comprises:
An imaging unit that captures an image of a scanning target area of a scanning target object;
An irradiation unit that irradiates the scanning target area with light for marking;
An adjustment unit that adjusts the scanning target area and the position of the marking;
The present invention is characterized by having the following.

In order to achieve the above object, a system according to one aspect includes:
An imaging unit that captures an image of a scanning target area of a scanning target object;
An irradiation unit that irradiates the scanning target area with light for marking;
An adjustment unit that adjusts the scanning target area and the position of the marking;
A detection unit that detects contact with the scanning object;
a manual scanning device having a
an information processing device having a correction unit that corrects distortion of a scanning target area image corresponding to the scanning target area included in image data based on coordinates of a mark image corresponding to a mark added by the marking included in the image data;
The present invention is characterized by having the following.

One aspect is that it can improve the convenience of manual scanning.

FIG. 1 is a diagram for explaining an example of a manual scanning device. FIG. 2 is a diagram for explaining the relationship between manual scanning and a scanning target area. FIG. 3 is a diagram for explaining the relationship between the scanning target area and the marks. FIG. 4 illustrates an example of a system having a manual scanning device. FIG. 5 is a diagram for explaining the correction of image data. FIG. 6 is a diagram for explaining the first modified example. FIG. 7 is a diagram for explaining the second modification.

Hereinafter, the embodiments will be described with reference to the drawings. In the drawings described below, elements having the same or corresponding functions are denoted by the same reference numerals, and repeated description of such elements may be omitted.

(Embodiment)
The configuration of a manual scanning device in this embodiment will be described with reference to Fig. 1. Fig. 1 is a diagram for explaining an example of a manual scanning device.

[Device configuration]
First, the structure of the housing 1 of the manual scanning device 10 will be described.
Manual scanning device 10 has a housing 1 shaped to allow a user to perform manual scanning as if drawing a line with a pen. An optical inlet/outlet part 2 is provided on the exterior side of housing 1. Optical inlet/outlet part 2 is provided with an opening 3. Also, one end of housing 1 (the tip on the side of the object to be scanned during scanning) has a contact part 4.

The housing 1 houses inside it a scanning function (circuit) used for manual scanning. It is desirable for the housing 1 to be, for example, pen-shaped as shown in FIG. 1. However, the shape of the housing 1 is not limited to the pen shape as shown in FIG. 1.

The light input/output unit 2 is a mechanism for inputting light for imaging the scanning area of the scanning object shown in FIG. 1 into the housing 1, and for outputting light for marking the scanning area of the scanning object from the inside of the housing 1 to the outside of the housing 1.

The object to be scanned is, for example, a medium such as paper. Information (for example, text, figures, etc.) can be printed or written manually on the surface of the object to be scanned.

The scanning target area is, for example, the area (imaging range) that is scanned when a user performs manual scanning.

Marking the area to be scanned means displaying a mark on the surface of the object to be scanned to help the user understand the area to be scanned.

The light input/output unit 2 also has an adjustment mechanism inside that adjusts the position of the area to be scanned, to make it easier for the user to grasp the area to be scanned. The adjustment mechanism will be described later.

Furthermore, the optical input/output unit 2 is a mechanism for protecting the circuits and other components installed inside the housing 1 from direct contact by the user from the outside.

In the example of Figure 1, the light input/output unit 2 is used on the Z-axis side of the exterior side of the housing 1 (opposite the object to be scanned) when performing manual scanning, but the position of the light input/output unit 2 when in use is not limited to the position shown in Figure 1.

The opening 3 is provided to allow light for imaging the area to be scanned to enter the housing 1 and to allow light for marking the area to be scanned to exit the housing 1.

A transparent panel may be attached to cover the opening 3 to prevent dust and other foreign matter from entering the housing 1 from the outside through the light input/output section 2. The panel may be made of, for example, glass or plastic with high transmittance.

The contact part 4 is a mechanism that comes into contact with the object to be scanned during scanning and serves as the point of action. The point of action corresponds to, for example, the tip of a pen. By using the contact part 4, manual scanning can be performed with the sensation of drawing a line with a pen. The shape and material of the contact part 4 are determined by the object to be scanned and the environment in which the manual scanning device 10 is used.

Figure 2 is a diagram to explain the relationship between manual scanning and the scanning target area. In the example of Figure 2, the user moves the manual scanning device 10 in the direction indicated by the dotted arrow to scan a printed object such as a "violation notice." In this case, as shown in Figure 2, the scanning target area 21 is set on the scanning target, and the scanning target area 21 also moves in accordance with the movement of the manual scanning device 10.

Next, the internal structure of the housing 1 of the manual scanning device 10 will be described.
An imaging unit 11, an irradiation unit 12, an adjustment unit 13, and a processing unit 14 are provided inside the housing 1. In manual scanning, the irradiation unit 12 irradiates and applies light to a scanning target area, and the imaging unit 11 captures the reflected light via the adjustment unit 13, thereby performing scanning.

The imaging unit 11 captures an image of the scanning target area of the scanning target object. Specifically, the imaging unit 11 receives reflected light with an imaging element, converts information contained in the received light into an electrical signal, and outputs it to the processing unit 14. The imaging element is, for example, a CCD (Charge Coupled Device). Furthermore, the imaging unit 11 starts imaging when the contact unit 4 comes into contact with the scanning target object. Note that the imaging unit 11 may receive reflected light via a focusing lens.

The irradiation unit 12 irradiates the scanning target area with light for marking. Specifically, the irradiation unit 12 starts irradiation when the contact unit 4 comes into contact with the scanning target. The light-emitting element of the irradiation unit 12 is, for example, an LED (light emitting diode). The light color, color rendering, and illuminance of the light-emitting element are determined by experiments, simulations, etc.

Figure 3 is a diagram for explaining the relationship between the scanning target area and the mark. The example of A in Figure 3 is an example in which light is irradiated onto the entire range 31 corresponding to the scanning target area to perform marking. In A in Figure 3, the scanning target area is irradiated with the amount of light required for imaging. However, the shape of the scanning target area is not limited to a rectangle, and may be any shape that allows the scanning target area to be grasped.

In the example of B in FIG. 3, light is irradiated onto the range corresponding to the area to be scanned, and marks 32a, 32b, 32c, and 32d may also be placed at the four corners of the range. Note that, although the example of B in FIG. 3 shows an example in which four cross-shaped marks 32a to 32d are placed at the four corners of the range to be scanned, the shape and number of marks are not limited to those in B in FIG. 3.

An optical system for displaying the mark in the scanning target area will now be described.
(1) Using four highly directional LEDs and a lens, the light emitted from the LEDs is converted into spot-shaped light and is irradiated onto the object to be scanned.

(2) Using a single highly directional LED and a beam splitter, the optical path of the light emitted from the LED is separated and the separated light is irradiated onto the scanning object.

(3) Using a laser and a beam splitter, the laser light emitted from the laser is split and the split laser light is irradiated onto the object to be scanned. For example, the split laser light is irradiated onto four points on the object to be scanned.

(4) A diffraction grating (DOE) may be used to project cross-shaped or spot-shaped light onto the object to be scanned at four points on the object.

The adjustment unit 13 is an adjustment mechanism for adjusting the scanning target area and the position of the marking. Specifically, the adjustment unit 13 is an optical system that adjusts the optical path of the reflected light from the scanning target area of the scanning target object and causes the reflected light to be received by the imaging unit 11.

The adjustment unit 13 is an optical system that adjusts the optical path of the light irradiated from the irradiation unit 12 and irradiates the scanning target area. The adjustment unit 13 has optical components, such as mirrors and prisms, that can adjust the optical path.

The processing unit 14 executes control processing of the imaging unit 11 and the irradiation unit 12. Specifically, when the processing unit 14 detects that the contact unit 4 has come into contact with the scanning object, it controls the imaging unit 11 and the irradiation unit 12 to start the imaging process and the irradiation process.

The processing unit 14 performs image processing based on the electrical signal output from the imaging unit 11, and generates image data corresponding to the area to be scanned.

The processing unit 14 may change the illuminance of the area to be scanned depending on the environment in which the manual scanning device 10 is used. That is, the processing unit 14 may change the amount of light emitted from the irradiation unit 12 based on the electrical signal output from the imaging unit 11.

The processing unit 14 may be, for example, a central processing unit (CPU), a programmable device such as a field-programmable gate array (FPGA), or a circuit incorporating one or more of these.

In this way, in this embodiment, when performing manual scanning, marking the area to be scanned makes it easier for the user to visually grasp the area to be scanned, thereby improving the convenience of manual scanning. In addition, by providing contact portion 4, manual scanning can be performed with the feeling of drawing a line with a pen.

[System configuration]
The configuration of a system having the manual scanning device 10 in this embodiment will be described more specifically with reference to Fig. 4. Fig. 4 is a diagram showing an example of a system having a manual scanning device.

As shown in FIG. 4, the system includes a manual scanning device 10 and an information processing device 40. The manual scanning device 10 includes an imaging unit 11, an irradiation unit 12, an adjustment unit 13, a processing unit 14, a detection unit 15, and a communication unit 16. The information processing device 40 includes a communication unit 41 and a correction unit 42.

The manual scanning device 10 will now be described.
The imaging unit 11, the irradiation unit 12, the adjustment unit 13, and the processing unit 14 have already been described, so the description thereof will be omitted.

The detection unit 15 is a sensor that is housed inside the housing 1 and detects that the contact unit 4 has come into contact with the scanning object. Specifically, when the detection unit 15 detects that the contact unit 4 has come into contact with the scanning object, it outputs information indicating that contact has occurred to the processing unit 14.

The communication unit 16 is housed inside the housing 1 and transmits image data to the information processing device 40. Specifically, the communication unit 16 acquires image data generated by the processing unit 14 and transmits the image data to the information processing device 40 via wired or wireless communication.

The information processing device 40 will be described.
The information processing device 40 is, for example, an information processing device such as a CPU, a programmable device such as an FPGA, a GPU, or a circuit equipped with any one or more of them, a server computer, a personal computer, or a mobile terminal.

The communication unit 41 receives image data transmitted from the communication unit 16. Specifically, the communication unit 41 receives image data transmitted from the communication unit 16 via wired or wireless communication. The received image data may be stored in a storage unit inside the information processing device 40, or may be stored in a storage device provided outside the information processing device 40.

The correction unit 42 corrects the image of the scanning target area based on the image data. Specifically, the correction unit 42 corrects the distortion of the scanning target area image corresponding to the scanning target area included in the image data based on a mark image corresponding to the mark added by the marking included in the image data.

The distortion of the captured image of the scanned area varies depending on the degree of inclination of the scanned object and the manual scanning device 10. For example, when performing character recognition using OCR (Optical character recognition), character recognition cannot be performed accurately if the image is distorted, so the distortion must be corrected.

Figure 5 is a diagram for explaining the correction of image data. For example, when marks 32a to 32d are marked as in Figure 3B, image data is created as shown in Figure 5A. Then, the image of "November" and mark images 51a, 51b, 51c, and 51d in Figure 5A, which correspond to "November" and marks 32a, 32b, 32c, and 32d in Figure 3B, are distorted as shown in Figure 5A.

In such a case, the correction unit 42 calculates the inclination of the image using the coordinates of the mark images 51a to 51d on the image, and corrects the image data based on the calculated inclination to generate image data as shown in FIG. 5B.

When there is no mark image, the boundary of the area to be scanned is detected from the image data by image processing, and the image data is corrected based on the inclination of the detected boundary. Light is irradiated onto the image corresponding to the area to be scanned in the image data. Therefore, the color of the area to be scanned differs from that of other areas, making it possible to detect the boundary between the area to be scanned and other areas.

The function of the correction unit 42 may be provided in the manual scanning device 10. In that case, the processing unit 14 is made to execute the correction process.

(Variation 1)
Modification 1 will be described. Fig. 6 is a diagram for explaining modification 1. In the example of Fig. 1, the light inlet/outlet 2 is provided on the front side, but the light inlet/outlet 61 may be provided at a position other than the front side, as in the manual scanning device 60 of Fig. 6. However, depending on the position of the light inlet/outlet 61, the mounting positions of the imaging unit 11, the irradiation unit 12, and the adjustment unit 13 and the optical system are adjusted so that the scanning target area and the marking position are in the same positions as when the light inlet/outlet 2 is provided on the front side.

Here, a position other than the front is one that allows the user to visually confirm the area to be scanned during scanning and does not impede marking and imaging.

(Variation 2)
Modification 2 will now be described. Fig. 7 is a diagram for explaining modification 2. In manual scanning device 70 shown in modification 2, a positioning section 71 for positioning a user's finger at a predetermined position is provided on the side of housing 1 in addition to light input/output section 61 in order to prevent the user's finger from blocking the optical path. In addition, auxiliary sections 72 and 73 for stabilizing the user's fingers are provided on housing 1 of manual scanning device 70.

The positioning unit 71 is a mechanism for positioning the user's finger in a position that allows the user to visually confirm the area to be scanned during scanning and does not impede marking and imaging. Specifically, the positioning unit 71 is provided in a position opposite to the position where the light input/output unit 61 is provided, as shown in FIG. 7. Also, as shown in FIG. 7, the shape of the positioning unit 71 is a streamlined shape that protrudes from the side of the housing 1.

The auxiliary parts 72 and 73 are attached to either the light input/output part 61 or the placement part 71. In the example of FIG. 7, they are provided in the mesh range. The auxiliary parts 72 and 73 are sheets made of a material such as rubber or silicone.

However, the shapes of the placement portion 71 and the auxiliary portions 72 and 73 are not limited to those shown in FIG. 7. It is sufficient that the user's finger can be placed in a position that does not block the optical path and further stabilizes the user's finger.

[Effects of this embodiment]
As described above, according to this embodiment, when performing manual scanning, the user can easily visually grasp the scanning target area by marking the scanning target area, thereby improving the convenience of manual scanning. Furthermore, by providing the contact portion 4, manual scanning can be performed with the feeling of drawing a line with a pen.

As described above, the present invention can improve the convenience of manual scanning. The present invention is useful in fields that require manual scanning.

REFERENCE SIGNS LIST 1 Housing 2, 61 Light input/output section 3 Opening 4 Contact section 10, 60, 70 Manual scanning device 11 Imaging section 12 Irradiation section 13 Adjustment section 14 Processing section 15 Detection section 16 Communication section 40 Information processing device 41 Communication section 42 Correction section 71 Placement section 72, 73 Auxiliary section

Claims (5)

An imaging means for imaging a scanning target area of a scanning target object;
An irradiation means for irradiating the scanning target area with light for marking;
An adjustment means for adjusting the scanning target area and the position of the marking;
a correction means for correcting distortion of a scanning target area image corresponding to the scanning target area included in image data based on a mark image corresponding to a mark added by the marking included in the image data;
A manual scanning device having a 2. The manual scanning device of claim 1,
The housing that houses the irradiation means and the adjustment means includes:
A detection means for detecting contact with the scanning object;
a positioning means for positioning the user's finger at a position where the user can visually confirm the scanning target area during scanning and where the finger does not interfere with the imaging and the marking;
A manual scanning device having a 3. A manual scanning device according to claim 2 ,
A manual scanning device, wherein the housing is pen-shaped. An imaging means for imaging a scanning target area of a scanning target object;
An irradiation means for irradiating the scanning target area with light for marking;
An adjustment means for adjusting the scanning target area and the position of the marking;
A detection means for detecting contact with the scanning object;
a manual scanning device having a
an information processing device having a correction means for correcting distortion of a scanning target area image corresponding to the scanning target area included in image data based on a mark image corresponding to a mark added by the marking included in the image data;
A system having 5. The system of claim 4 ,
The manual scanning device comprises:
a positioning means for positioning the user's finger at a position where the user can visually confirm the scanning target area during scanning and where the user's finger is not obstructed from the marking and the imaging;
system.

Images