JP5697148B2 - Mouse scanner system - Google Patents

Description

  The present invention relates to a mouse scanner system capable of synchronizing image data and position data or sound data by superimposing position data or sound data of the image on captured image data.

  In recent years, image information such as paper is continuously read and digitized, and as a scanner that outputs it as image data on the screen, the image sensor is taken into the mouse. Mouse scanners that recognize position information have been developed.

  For example, an invention has been proposed in which image information to be read and position information of the sensor are output as serial data to an interface unit by a sensor mounted on a mouse scanner (see Patent Document 1).

WO00 / 26851

  By the way, in the mouse scanner, it is necessary to simultaneously recognize the capture of the image information from the paper surface and the position information of the mouse, and if a deviation occurs at the time of recognition, an error occurs in the synthesized data output to the screen, Affects scanning accuracy. In particular, when the processing speeds of the image information and the position information are different, a position error corresponding to the speed difference also occurs in the output data of the image data and the position data. This error is noticeable when scanning at high speed with a mouse scanner.

  In addition, in order to suppress this error, there is a method of increasing the processing speed of the image information and the position information itself, but if high-capacity advanced image processing is executed, it is not expected to increase the scanning speed. On the contrary, troubles occur when the mouse scanner is used.

  The present invention has been proposed in order to solve the above-described problems, and its purpose is to simultaneously acquire image information to be scanned and position information of the image and read the image information. An object of the present invention is to provide a mouse scanner system capable of suppressing an error between image information and position information by superimposing position data corresponding to position information on a predetermined pixel in image data and distributing it as one signal.

  Further, the present invention provides a single synthesized data by superimposing the voice data on predetermined pixels in the image data, and the character recognition processing based on the character data in the synthesized data and the character data converted from the voice data, Another object of the present invention is to provide a mouse scanner system capable of improving the recognition rate.

In order to achieve the above object, the present invention is provided with a scanner function in a pointing device of the personal computer that performs image processing on the image data read by the optical system and displays it on a screen by transmitting it to the personal computer. An image sensor having a mouse scanner and a control device that controls image processing of the mouse scanner, wherein the mouse scanner captures image information existing in an arbitrary region as image data. An image pickup means for outputting a pixel clock and a synchronization signal, a position sensor for taking position information of an image of the image information as position data, and an operation of a shutter of the image pickup means detected from the pixel clock and the synchronization signal on the position sensor as a reference A latch circuit for latching the position data captured Ri, and said in the image data on the screen pixels that are not displayed on the personal computer, to write the position data latched by said latch circuit write no-data writing unit It is characterized by having.

In particular, the control device of the present invention, the sync signal and pixel clock from the imaging unit, a shutter timing detecting means for detecting a timing at which the shutter is open, the shutter of the image pickup means detected by the shutter timing detecting means Latch means for instructing the latch circuit to latch the position data at the opening timing, and a connection to the data writing unit are connected to pixels not displayed on the screen of the personal computer in the image data. Switching means for giving a command to switch from the image sensor side to the position sensor side at a corresponding predetermined timing, and the data writing unit switches the connection to the position sensor side by the switching means. And in the image data of the personal computer The pixels that do not appear on the face, and writes the position data latched by said latch circuit.

The present invention also provides a mouse scanner provided in a pointing device of the personal computer, and a mouse function that performs image processing on the image data read by the optical system and displays it on a screen by transmitting it to the personal computer. A mouse scanner system that controls image processing of the scanner, wherein the mouse scanner scans image information existing in an arbitrary area and captures the audio information as image data. a voice reader to read the data, a latch circuit for latching the voice data read by the voice reader, the pixels which are not displayed on the screen of the personal computer in the image data, which is latched by the latch circuit Write the audio data It possesses a Mude over data writing unit, wherein the image data includes character data, and recognizes the character data the character recognition processing unit from the image data captured by the image sensor, wherein through the latch circuit A text conversion unit that converts voice data read from the voice reading unit into text data, character data recognized by the character recognition processing unit, and character data converted by the text conversion unit are collated and matched character data And a collation unit that outputs the data to the personal computer .

  The pixels that are not displayed on the screen of the personal computer in the image data are either the blanking interval, the portion of the effective display interval that is not displayed on the screen, the even field or the odd field in which the display image is not superimposed. .

  According to the above aspect, by writing the read position data to pixels that are not displayed on the screen in the image data, it is possible to generate image data that is a one-pair signal as synthesized data. Until the demodulation, it can be processed as image data itself. Thereby, since image data and position data can be read synchronously, a position error due to a shift between the two data can be suppressed.

  Further, even when there is time in image processing, since there is no deviation between the read image data and the position data, there is no problem in the processing for joining the images after the composite data is generated. That is, if position data can be written in image data in a blanking interval or the like to obtain one image data, there will be no problem in processing speed thereafter.

  According to the present invention as described above, it is possible to generate image data as a pair signal as composite data by writing the read position data to a predetermined pixel not displayed on the screen in the image data. As a result, it is possible to process the image data itself until the demodulation, thereby ensuring a synchronism between the image data and the position data, and a mouse scanner system capable of suppressing a position error due to a deviation between the two data. Can be provided.

  Also, the audio data read simultaneously with the image data is written to the predetermined pixels in the image data as described above, and then the character data in the image data and the character data converted from the audio data are collated. As a result, the synchronism between the read image data and audio data can be ensured, and the recognition of character data can be remarkably improved.

1 is a block diagram showing an example of the overall configuration of a mouse scanner system according to a first embodiment of the present invention. The block diagram which shows the structural example of the control part which concerns on the 1st Embodiment of this invention. The flowchart which shows the effect | action of the mouse scanner system which concerns on embodiment of this invention which concerns on 1st Embodiment of this invention. The figure which shows the relationship between image data, the position data, the switching timing of a data writing part, and synthetic data of the mouse scanner system which concerns on the 1st Embodiment of this invention The block diagram which shows the example of whole structure of the mouse scanner system which concerns on the 2nd Embodiment of this invention. The block diagram which shows the structural example of the control part which concerns on the 2nd Embodiment of this invention. The flowchart which shows the effect | action of the mouse scanner system which concerns on 2nd Embodiment of this invention which concerns on embodiment of this invention.

[This embodiment]
[1. First Embodiment]
Next, a mouse scanner system according to a first embodiment for carrying out the present invention will be described with reference to FIGS.

[1.1. Constitution]
[1.1.1. overall structure]
The mouse scanner according to this embodiment is an apparatus in which a mouse functioning as a pointing device is integrated with a scanner function that scans image information and position information of the image with an optical system and outputs the image data. The overall configuration of the mouse scanner system taking into account the configuration of the control unit that controls various functions of the mouse scanner will be described below with reference to FIG.

  As shown in FIG. 1, this mouse scanner system holds an image sensor 10 that captures image information such as paper, a position sensor 20 that detects position information of the image information, and position data detected by the position sensor 20. A latch unit 30, a data writing unit 40 that writes position data held through the latch unit 30 to the image data captured by the image sensor 10 and outputs combined data, and a control unit 50 that controls various functions. It is configured.

  Similar to a general mouse scanner, a CCD (CHARGE Coupled Devices) camera, which is a fixed image sensor, is used for the image sensor 10 and outputs analog image data, a pixel clock, and a synchronization signal. The position sensor 20 built in the mouse scanner detects the position information of the image information to be photographed by the CCD camera in real time, and outputs the position data to the latch unit 30 as a 32-bit parallel signal, for example.

  The latch unit 30 is a latch circuit that holds position data that is constantly detected by the position sensor 20 based on a latch command signal from the control unit 50, and for taking the position data into the image data as analog data. It transmits to the data writing part 40.

  The data writing unit 40 is connected to the image sensor 10 and the position sensor 20 indirectly through the latch unit 30. By switching the connection source between the image sensor 10 side and the position sensor 20 side, the image sensor 10. Is a circuit for writing the position data captured by the position sensor 20 to a predetermined pixel of the image data captured from the image sensor, and an analog changeover switch such as a multiplexer or a mixer is used. The data writing unit 40 outputs composite data generated based on data read by the image sensor 10 and the position sensor 20 to a personal computer having a screen.

  Here, the predetermined pixel corresponding to the portion of the image data that is not displayed on the screen of the personal computer is a blanking interval, an even field / odd field in which no image is superimposed, or an effective display interval on the screen. This corresponds to a portion that is not displayed.

  A blanking interval is a so-called horizontal or vertical blanking interval, and is a non-use period that is a non-image portion inserted at the head of an analog signal such as an NTSC signal. In the case of the NTSC signal, the vertical blanking interval is from the first (1H, 263H) to the 21st (21H, 284H) of the scanning lines. An even field / odd field in which no image is superimposed is an unused field that is an even or odd field in one frame of an unused image. In this case, all unused fields are replaced with position data. Is possible.

  For example, if the position data is written as the brightness of the pixel, the brightness of the pixel is restored as the position data. If the position data is written as the pixel color, the color of the pixel is Restore as data.

  Further, the data writing unit 40 switches the connection source from the image sensor 10 side to the position sensor 20 side at a predetermined writing timing of the position data with respect to the image data. Thus, the output target is switched between image data read by the image sensor 10 or synthesized data in which the position data read by the position sensor 20 is written in the image data.

  Although not shown, the composite data output from the data writing unit 40 is transmitted to a personal computer having a display screen and the like, and is displayed on the screen by being restored.

[1.1.2. Control unit]
Next, a specific configuration of the control unit 50 will be described with reference to FIG.
As shown in FIG. 2, the control unit 50 first acquires a pixel clock and a synchronization signal of image data read by the image pickup device 10 that is a CCD camera, thereby detecting a shutter timing at which the shutter of the image pickup device 10 opens. Shutter timing detection means 51 is provided.

  In addition, the control unit 50 includes a latch command unit 52 that instructs the latch unit 30 to latch the position data detected by the position sensor 20 at the shutter timing detected by the shutter timing detection unit 51. Yes. Specifically, the latch command means 52 sends a latch command signal and a pixel signal at the shutter timing to the latch unit 30 to instruct the latch unit 30 to latch the position data.

  The control unit 50 also includes a switching command unit 53 that commands the data writing unit 40 to switch the connection source between the image sensor 10 side and the position sensor 20 side. Specifically, the output target is the image data read by the image sensor 10 at a predetermined writing timing of the position data with respect to the image data, or the position data read by the position sensor 20 is superimposed on the image data. A command is given to the data writing unit 40 so as to switch whether to use the combined data. The specific writing process of the position data to the specific image data in the data writing unit 40 is described in [1.2. It will be described in the item of [Action].

[1.2. Effect]
Next, in the mouse scanner system according to the first embodiment having the above-described configuration, an operation of scanning image information such as a paper surface will be described below with reference to a flowchart of FIG.

  First, the image sensor 10 reads image information such as a paper surface by an optical system (S301), transmits image data that is the read analog video signal to the data writing unit 40, and also outputs a pixel clock of the image data. A synchronization signal is transmitted to the control unit 50. At the same time, the position sensor 20 detects the position information of this image and reads it as position data (for example, a 32-bit parallel signal) (S302).

  Here, the shutter timing detection means 51 of the control unit 50 detects the shutter timing at which the shutter of the image sensor 10 that is a CCD camera opens based on the pixel clock and the synchronization signal of the image data transmitted from the image sensor 10. (S303). When the shutter timing at which the shutter is opened is detected through the shutter timing detection means 51 (YES in S303), the latch command means 52 of the control section 50 causes the latch section 30 to send the shutter timing latch command signal and the image data. By transmitting a pixel signal of a specific pixel for replacement (corresponding to a predetermined pixel not displayed on the screen) to the position data, the latch unit 30 uses the position data acquired through the position sensor 20 at the shutter timing. Latch (S304).

  In the control unit 50, simultaneously with the transmission of the latch command signal and the pixel signal to the latch unit 30 by the latch command unit 52, the switching command unit 53 performs the data writing unit at a predetermined writing timing of the position data with respect to the image data. 40, the switching signal is transmitted so that the connection source of the analog signal is switched from the image sensor 10 side to which the image data is sent to the position sensor 20 side to which the position data is sent. By receiving this switching signal, the data writing unit 40 switches the connection source from which the analog signal is transmitted from the image sensor 10 side to the latch unit 30 on the position sensor 20 side (S305).

  Here, the predetermined writing timing of the position data to the image data refers to a blanking interval specified based on a time from a synchronization signal sent from the image sensor 10 in the read image data, and an image superimposed. This corresponds to a portion that is not displayed on the screen of the personal computer described above, such as a portion that is not displayed on the screen in the effective display section. Therefore, the switching command means 53 of the control unit 50 counts the clock from the synchronization signal received from the image sensor 10, and determines the connection source as the image sensor 10 at the timing of a specific pixel corresponding to a blanking interval, an unused field, or the like. A switching signal from the side to the position sensor 20 side is transmitted to the data writing unit 40.

  Thereby, in the data writing unit 40, the connection source is switched from the image sensor 10 side to the position sensor 20 side at a predetermined writing timing, so that the position data is written to a specific pixel not displayed on the screen in the image data. Note that the position data is written in the form of light / dark data or color data for a specific pixel such as a blanking interval.

  Then, by switching the connection source to the position sensor 20 side by the data writing unit 40, composite data that is one image signal in which the position data is written to the specific pixel of the image data is transmitted to the personal computer, It is displayed on the screen by being restored (S306).

  Here, an example of writing position data to the image data by the data writing unit 40 when the image data read by the image sensor 10 is an NTSC image signal will be described. That is, since it is necessary to specify a predetermined pixel to which position data is written based on the time from the vertical synchronization signal and the horizontal synchronization signal of the image data read by the image sensor 10, the predetermined data is counted by some clock. The position data is written into the image data at a specific timing corresponding to the pixel.

  For example, when the position data is represented by 8 bits and the total number of pixels of the image is 300,000, the pixel numbers for writing the position data specified as corresponding to the blanking interval are 0, 100, 200, 300. , 400, 500, 600, 700, the control unit 50 starts counting the clock from the synchronizing signal of the image data and becomes each of the above pixels, and at the same time, each pixel through the data writing unit 40 Write the bit corresponding to. Note that the writing itself is performed by preparing a voltage corresponding to black if the bit to be written is 0 and white if it is 1 and switching the image data to a monochrome equivalent voltage at the timing to be written.

  In such a mouse scanner system that scans image information such as paper, image data read by the image sensor 10, position data latched through the latch unit 30, and connection source switching timing in the data writing unit 40 And the composite data output by the data writing unit 40 are as shown in FIG. As shown in FIG. 4C, at the data writing unit 40, the connection is switched from the image sensor 10 side to the position sensor 20 side, and at the same time, the position data latched by the latch unit 30 (see FIG. 4B). The combined data as shown in FIG. 4D is output by being written in the image data (see FIG. 4A).

  In fact, since the clock may not be synchronized with the image, the present invention also applies to some pixels before and after the specific pixel, which is a predetermined timing for writing the position data to the image data. An embodiment for writing the same position data is provided. As a result, even when the position data write location is slightly shifted, it is possible to decipher when the position data is decomposed. In the relationship diagram of image data, position data, switching timing, and composite data in FIG. 4, the range of the position data write location is expanded to about ± 10 pixels of the specified pixels.

  According to the first embodiment as described above, the read position data is written in predetermined pixels or the like that are not displayed on the screen of the personal computer in the image data, so that the image data that is a pair of signals is synthesized data. Can be processed as image data itself until demodulation, thereby ensuring the synchronism between the image data and the position data and suppressing the position error due to the deviation between the two data. A mouse scanner system can be provided.

[2. Second Embodiment]
[2.1. Constitution]
Next, the configuration of the mouse scanner system according to the second embodiment of the present invention will be described below with reference to FIGS. FIG. 5 is a block diagram showing an example of the overall configuration of the mouse scanner system according to the second embodiment, and FIG. 6 is a block diagram showing an example of the configuration of the control unit according to the second embodiment.

  As shown in FIG. 5, in the mouse scanner system according to the second embodiment, in addition to the configuration according to the first embodiment, the voice reading unit 60 that reads voice information, and the voice data read by the voice reading unit 60 The voice reading unit 60 is connected to the data writing unit 40 via the latch unit 70.

  In the data writing unit 40 according to the second embodiment, the audio data held by the reading latch unit 70 by the audio reading unit 60 is added to the predetermined pixel portion of the image data captured by the image sensor 10. Has a writing function. That is, the data writing unit 40 writes the audio data read by the audio reading unit 60 in the area where the position data has been written in the first embodiment with respect to the image data.

  Furthermore, in the second embodiment, the OCR processing unit 80 that extracts character data from the combined data of the image data and the voice data by the data writing unit 40 and performs character recognition processing, and the combined data from the data writing unit 40 A text conversion unit 90 that extracts voice data from the text and converts it into character data; and character data verification that determines whether the character data recognized by the OCR processing unit 80 matches the character data converted by the text conversion unit 90 Part 100.

  The voice reading unit 60 is not limited in configuration as long as it can read voice information and convert it into voice data, and generally uses a microphone or the like. Further, the OCR processing unit 80 extracts a character image of the image data from the combined data by the data writing unit 40, and performs, for example, pattern matching for matching the character image with a predetermined character pattern set in advance. By doing so, one or more character data having high similarity are recognized.

  The text conversion unit 90 has a function of extracting voice data from the synthesized data by the data writing unit 40 and converting the voice data into character data that is text data. The character data collation unit 100 collates the one or more character data similar candidates subjected to the character recognition processing by the OCR processing unit 80 with one or more similar candidates converted to the character data by the text conversion unit 90. Output character data that matches.

  Further, as shown in FIG. 6, the configuration of the control unit 50 replaces the object to be written in the image data from the position data to the audio data. However, as in the first embodiment, the shutter timing detection means 51, the latch command Means 52 and switching command means 53 are provided, and in addition to this, the following means are provided.

  That is, the control unit 50 includes the character recognition processing command means 54 that issues a character recognition processing execution command to the OSR processing unit 80, and the combined data generated by the data writing unit 40 for the text conversion unit 90. The text conversion command means 55 for giving a command to convert the voice data into text, the character data recognized by the OCR processing unit 80 for the character data verification unit 100 and the character data converted by the text conversion unit 90 are verified. And a collation command means 56 for issuing a collation command. The detailed description is given in [2.2. [Action] is omitted in this section.

[2.2. Action]
Next, in the mouse scanner system according to the second embodiment having the above-described configuration, an operation of scanning characters from image information such as a paper surface, simultaneously reading voice information, and collating the two will be described with reference to FIG. This will be described below with reference to the flowchart of FIG.

  First, as in the first embodiment, the image sensor 10 reads image information including text information such as paper on the optical system (S701), and reads the image data that is the read analog video signal as the data writing unit 40. In addition, the pixel clock and the synchronization signal of the image data are transmitted to the control unit 50. At the same time, the voice reading unit 60 detects the read voice information corresponding to the character information in the image and reads it as voice data (S702).

  Here, the shutter timing detection means 51 of the control unit 50 detects the shutter timing at which the shutter of the image sensor 10 that is a CCD camera opens based on the pixel clock and the synchronization signal of the image data transmitted from the image sensor 10. (S703). When the shutter timing at which the shutter opens is detected through the shutter timing detection means 51 (YES in S703), the latch command means 52 of the control unit 50 causes the latch signal to be sent to the latch signal of the shutter timing and the image data. By transmitting a pixel signal of a specific pixel for writing audio data (corresponding to a predetermined pixel not displayed on the screen), the latch unit 70 acquires the audio acquired through the audio reading unit 60 at the shutter timing. Data is latched (S704).

  In the control unit 50, simultaneously with the transmission of the latch signal and the pixel signal to the latch unit 70 by the latch command unit 52, the switching command unit 53 performs the data writing unit 40 at a predetermined writing timing of the audio data with respect to the image data. On the other hand, the switching signal is transmitted so that the connection source of the analog signal is switched from the imaging element 10 side to which the image data is sent to the voice reading unit 60 side to which the voice data is sent. By receiving this switching signal, the data writing unit 40 switches the connection source from which the analog signal is transmitted from the image sensor 10 side to the latch unit 70 on the voice reading unit 60 side (S705). In other words, the data writing unit 40 switches the connection source to the voice reading unit 60 side, and thereby, the synthesized data which is one image signal in which the voice data is written to a predetermined pixel such as a blanking interval of the image data. Generate.

  Note that the predetermined writing timing and writing mode of the audio data to the image data are the same as the writing timing and writing mode of the position data in the first embodiment, and thus description thereof is omitted.

  Then, the character recognition processing command means 54 of the control unit 50 transmits an execution command for character recognition processing to the OSR processing unit 80 (S706), and the data writing unit 40 generates the OSR processing unit 80. A character image of image data is extracted from the combined data, and pattern matching is performed on the character image, thereby recognizing one or more character data having high similarity.

  Further, the text conversion command means 55 of the control unit 50 instructs the text conversion unit 90 to convert the speech data in the synthesized data generated by the data writing unit 40 to text (S707). The conversion unit 90 extracts voice data from the synthesized data by the data writing unit 40 and converts the voice data into character data that is text data.

  The control unit 50 receives the character recognition processing completion command from the OCR processing unit 80 and receives the text conversion completion command from the text conversion unit 90. A collation command is transmitted to the unit 100 so as to collate the character data recognized by the OCR processing unit 80 and the character data text-converted by the text conversion unit 90 (S708).

  As a result, the character data collating unit 100 obtains one or more similar candidates of character data subjected to character recognition processing by the OCR processing unit 80 and one or more similar candidates converted to character data by the text converting unit 90. Search for matching character data by matching. Then, the character data determined to be matched by the character data collating unit 110 is output to the personal computer and displayed on the screen by being restored (S709).

  In the second embodiment as described above, the audio data read simultaneously with the image data is written to predetermined pixels similar to the above in the image data, and then from the character data and the audio data in the image data. Since the converted character data can be collated, it is possible to ensure the synchronism between the read image data and the sound data. Only the recognition processing for the read character data or the character data converted from the sound data to text is recognized. Character data recognition can be significantly improved compared to processing alone.

[3. Other Embodiments]
Note that the present invention is limited to the above-described configuration in which synthesized data is generated by writing position data or voice data to image data in a mouse scanner, and character recognition processing and text conversion of voice data are performed. Instead, the embodiment includes, for example, an embodiment in which processing such as data writing is executed on the center side only by reading image data, position data, and audio data on the mouse scanner side using cloud computing.

  Specifically, the mouse scanner has only a function of reading image data, position data, and audio data, and the center side receives the read image data or the like via wireless or wired communication means. Write processing of position data or voice data to image data by the data writing unit 40, character recognition processing by the OCR processing unit 80, text conversion processing of voice data by the text conversion unit 90, and characters by the character data matching unit 100 Data matching processing is performed. Then, output data is transmitted to the mouse scanner side according to the collation result of the character data from the center side, and displayed on the screen of the personal computer on the mouse scanner side.

  Further, the present invention is limited to an embodiment in which position data or audio data is written in the form of light / dark data or color data to predetermined pixels that are not displayed on the screen of a personal computer in the image data as described above. Instead, an embodiment is also included in which the position data is written to the image data with a modulation that makes it inconspicuous. Specifically, the modulation that is inconspicuous is as follows.

  That is, if the even field and the odd field to which the image to be used is assigned are interlaced, the same pixel position in each field is adjacent on the screen. Here, if information opposite to the brightness and color written in the even field is written in the odd field, it becomes difficult to see when adjacent to each other, so modulation that makes it inconspicuous to write position data in this inconspicuous part It corresponds to.

  In order to increase the certainty, the images assigned to the even field and the odd field are exactly the same, and the difference between them is only the location where the position data is written. When decomposing data, it is possible to eliminate the need for a counter on the decomposition side.

DESCRIPTION OF SYMBOLS 10 ... Image sensor 20 ... Position sensor 30 ... Latch part 40 ... Data writing part 50 ... Control part 51 ... Shutter timing detection means 52 ... Latch command means 53 ... Switching command means 54 ... Character recognition process command means 55 ... Text conversion command Means 56 ... Collation command means 60 ... Voice reading unit 70 ... Latch unit 80 ... OCR processing unit 90 ... Text conversion unit 100 ... Character data collation unit

Claims (9)

A mouse scanner provided in the pointing device of the personal computer, which controls the image processing of the mouse scanner and a scanner function that performs image processing on the image data read by the optical system and displays it on the screen by sending it to the personal computer A mouse scanner system having a control device,
The mouse scanner is
An image sensor that captures image data existing in an arbitrary region as image data by scanning, and an image pickup unit that outputs a pixel clock and a synchronization signal;
A position sensor that captures position information of the image of the image information as position data;
A latch circuit that latches the position data captured by the position sensor with reference to an operation of a shutter of the imaging means detected from the pixel clock and the synchronization signal;
A data writing unit that writes the position data latched by the latch circuit to pixels that are not displayed on the screen of the personal computer in the image data;
A mouse scanner system comprising: The controller is
Shutter timing detection means for detecting the opening timing of the shutter based on the synchronization signal and the pixel clock from the imaging means;
Latch means for instructing the latch circuit to latch the position data at a timing when the shutter of the imaging means detected by the shutter timing detection means opens;
Switching means for giving a command to switch the connection to the data writing unit from the image sensor side to the position sensor side at a predetermined timing corresponding to pixels not displayed on the screen of the personal computer in the image data; Have
When the connection is switched to the position sensor side by the switching unit, the data writing unit outputs the position data latched by the latch circuit to pixels not displayed on the screen of the personal computer in the image data. 2. The mouse scanner system according to claim 1, wherein writing is performed. A mouse scanner equipped with a pointing device of the personal computer, which performs image processing on the image data read by the optical system and displays the image on the screen by sending it to the personal computer;
A control device for controlling image processing of the mouse scanner;
A mouse scanner system comprising:
The mouse scanner is
An image sensor that scans image information existing in an arbitrary area and captures it as image data;
A voice reading unit that reads voice information as voice data;
A latch circuit for latching the voice data read by the voice reading unit;
A data writing unit that writes the audio data latched by the latch circuit to pixels that are not displayed on the screen of the personal computer in the image data;
Have
The image data includes character data,
A character recognition processing unit for recognizing character data from the image data captured by the image sensor;
A text conversion unit that converts voice data read from the voice reading unit through the latch circuit into character data;
A collation unit that collates the character data recognized by the character recognition processing unit and the character data converted by the text conversion unit, and outputs matching character data to the personal computer;
A mouse scanner system comprising: The controller is
Shutter timing detection means for detecting the timing at which the shutter is opened based on a synchronization signal and a pixel clock from an imaging means including the image sensor;
Latch means for instructing the latch circuit to latch the audio data at a timing when the shutter of the imaging means detected by the shutter timing detection means opens;
Switching means for issuing a command to switch the connection to the data writing unit from the image sensor side to the voice reading unit side at a predetermined timing corresponding to pixels not displayed on the screen of the personal computer in the image data. And having
When the connection is switched to the voice reading unit by the switching unit, the data writing unit is configured to store the voice data latched by the latch circuit in pixels that are not displayed on the screen of the personal computer in the image data. The mouse scanner system according to claim 3, wherein: The controller is
Character recognition means for issuing a character recognition command to the character recognition processing unit;
Text conversion means for issuing a text conversion command to the text conversion unit;
When the character recognition processing is executed in the character recognition processing unit, and when the text conversion processing is executed in the text conversion unit, a collation unit that issues a collation command of character data to the collation unit, and
The said collation part collates the character data recognized by the said character recognition process part, and the character data converted by the said text conversion part, if the collation instruction | command is sent by the said collation means. The described mouse scanner system.   The data writing unit writes the position data or audio data latched by the latch circuit into pixels that are not displayed on the screen of the personal computer in the image data in the form of light / dark data or color data. The mouse scanner system according to claim 1 or 3. The mouse scanner system according to claim 6, wherein the data writing unit converts the position data, which is the color data, into a corresponding color data numerical value and writes it into image data.   Pixels that are not displayed on the screen of the personal computer in the image data are either a blanking interval, a portion of the effective display interval that is not displayed on the screen, an even field or an odd field in which no display image is superimposed. The mouse scanner system according to any one of claims 1 to 7. The mouse scanner system according to claim 1, wherein the personal computer includes the control device.

Images