JP6135050B2 - Data processing device, display device, and control method for data processing device - Google Patents

Description

  The present invention relates to a data processing device that outputs image data, a display device, and a control method for the data processing device.

  2. Description of the Related Art Conventionally, in a system including a display device such as a projector, when a user performs a position input operation using a device such as an electronic pen, a system that detects a designated position and performs drawing or the like is known (for example, a patent) Reference 1). In the system described in Patent Document 1, the display device detects a position indicated by the pointing rod, and a computer connected to the display device generates a drawing image based on the detected pointing position. The display device is configured to display a drawing image generated by a computer.

JP 2011-028629 A

As in the system described in Patent Document 1, in a system that performs drawing based on a position input operation instruction position, if the time from when the user operates to display an image becomes long, the user feels uncomfortable. There is a concern that the feeling of operation will be reduced. For this reason, there has been a demand for a technique that enables a drawn image to be displayed within a short time after the user performs an operation.
The present invention has been made in view of the above-described circumstances. In a configuration in which drawing is performed based on a position indicated by a user's operation, the time from when the operation is performed until the rendered image is displayed is determined. It is an object to provide a data processing device, a display device, and a data processing device control method that can be shortened.

In order to solve the above-described problems, the present invention provides a data processing device that outputs image data, a coordinate acquisition unit that acquires input coordinates, and an image that is drawn based on the input coordinates acquired by the coordinate acquisition unit And an output unit that outputs image data of an image drawn by the drawing unit, and the output unit is similar to the drawing unit based on the input coordinates acquired by the coordinate acquisition unit. The superimposing process is performed so as to superimpose the rendered image on the image output by the rendering means to generate and output superimposed image data, and execute the superimposing process based on a predetermined condition. It is characterized by this.
According to the present invention, when any one of a drawing unit that performs drawing and an output unit that outputs image data performs drawing, data of an image drawn based on input coordinates is output. For this reason, the time until the data of the rendered image is output can be shortened according to the faster processing speed of the rendering unit and the output unit. Thereby, for example, when an image is displayed based on the image data output by the data processing apparatus, the time until the drawing image is displayed can be shortened.

Further, according to the present invention, in the data processing apparatus, the coordinate acquisition unit and the output unit are configured by a first processing device, and the drawing unit is provided independently of the first processing device. It is comprised by the processing device of.
ADVANTAGE OF THE INVENTION According to this invention, time until a drawn image is displayed can be shortened with the capability of the side by which the drawing process is quick among several processing devices. In addition, when the process of inputting input coordinates to the second processing device and the process of outputting an image from the second processing device to the first processing device takes time, the first processing device draws first. Since the image data is output, there is no delay until the rendered image is displayed, and the image data can be output promptly.

Further, according to the present invention, in the data processing apparatus, the output unit executes the superimposition process for a predetermined time after the coordinate acquisition unit acquires the input coordinates, and thereafter, other than the image drawn by the drawing unit. The image data is output without superimposing the images.
According to the present invention, after a predetermined time has elapsed, after the image drawn by the drawing means is input to the output means, an image that is not superimposed is output. For this reason, even if the image becomes unclear due to the superimposition process, the image can be quickly switched to a clear image, so that a reduction in image quality can be avoided. Moreover, the timing which complete | finishes a superimposition process can be determined appropriately.

In the data processing apparatus according to the aspect of the invention, the output unit performs the superimposition process after the coordinate acquisition unit acquires input coordinates, and the output unit draws the image drawn by the drawing unit. The superposition processing is stopped when it is detected that the same image as the image is included.
According to the present invention, after it is detected that an image drawn by the drawing means is input to the output means, an image that is not superimposed is output. For this reason, even if the image becomes unclear due to the superimposition process, the image can be quickly switched to a clear image, so that a reduction in image quality can be avoided. Moreover, the timing which complete | finishes a superimposition process can be determined appropriately.

In order to solve the above problems, a display device of the present invention includes a display unit that displays an image, an input detection unit that detects a position input operation and acquires input coordinates, and an input acquired by the input detection unit. A drawing means for drawing an image based on coordinates, an output means for outputting image data of an image drawn by the drawing means, and a display for displaying an image by the display means based on the image data output by the output means Control means, and the output means performs drawing in the same manner as the drawing means based on the input coordinates acquired by the input detection means, and superimposes the drawn image on the image output by the drawing means Then, it is configured to execute a superimposing process for generating and outputting superimposed image data, and the superimposing process is executed based on a predetermined condition.
According to the present invention, when one of the drawing means for drawing and the output means for outputting image data draws, the drawn image is displayed based on the input coordinates. Among them, the time taken to display the drawn image can be shortened according to the fast processing speed.

In order to solve the above problems, a control method for a data processing apparatus according to the present invention is a control method for a data processing apparatus that outputs image data, and includes a coordinate acquisition unit that acquires input coordinates, and the coordinate acquisition unit. Based on a predetermined condition, a data processing device having a drawing means for drawing an image based on the acquired input coordinates and an output means for outputting image data of the image drawn by the drawing means is controlled. Then, the output unit performs drawing in the same manner as the drawing unit based on the input coordinates acquired by the coordinate acquisition unit, and generates the superimposed image data by superimposing the drawn image on the image output by the drawing unit. And executing a superimposition process to be output.
According to the present invention, when any one of a drawing unit that performs drawing and an output unit that outputs image data performs drawing, data of an image drawn based on input coordinates is output. For this reason, the time until the data of the rendered image is output can be shortened according to the faster processing speed of the rendering unit and the output unit. Thereby, in the process which draws an image based on an input coordinate, time until it displays the drawn image can be shortened.

In order to solve the above problems, a control method for a data processing apparatus according to the present invention includes a main processor and a sub processor, wherein the main processor acquires coordinate acquisition means for acquiring input coordinates, and an image drawn by the sub processor. Output means for outputting the image data, and the sub-processor has a drawing means for drawing an image based on the input coordinates acquired by the coordinate acquisition means. The main processor performs drawing in the same manner as the drawing unit based on the input coordinates acquired by the coordinate acquiring unit based on a predetermined condition, and the drawn unit outputs the drawn image. It is characterized in that a superimposing process for generating and outputting superimposed image data by superimposing on an image is executed.
According to the present invention, when one of the main processor and the sub processor performs drawing, image data drawn based on the input coordinates is output. For this reason, the time until the data of the drawn image is output can be shortened according to the faster processing speed of the main processor and the sub processor. In addition, even if it takes time to transmit input coordinates and drawn images between the main processor and the sub processor, the data of the image drawn by the main processor is output first, so the drawn image There is no delay until the image is displayed, and the rendered image data can be output quickly.

  ADVANTAGE OF THE INVENTION According to this invention, the time until it displays the image drawn based on the input coordinate can be shortened.

It is a figure which shows the structure of the projection system which concerns on embodiment of this invention. It is a functional block diagram which shows the structure of the principal part of a projector. It is explanatory drawing which shows the drawing process which a projector performs. It is a flowchart which shows operation | movement of a projector.

Embodiments to which the present invention is applied will be described below with reference to the drawings.
FIG. 1 is a diagram showing a configuration of a projection system 1 according to an embodiment to which the present invention is applied. The projection system 1 is configured by connecting a PC (personal computer) 100 which is an external device independent from the projector 10 to a projector 10 installed above a screen SC.
The projector 10 (display device, data processing device) projects an image based on image data input from the PC 100 as an image output device onto a screen SC as a projection surface. The projector 10 is a short focus type, and is installed immediately above the screen SC and projects an image obliquely downward.

The projector 10 can project not only an image based on the image data transmitted from the PC 100 but also an image generated in the projector 10 as described later on the screen SC.
The projector 10 can project whether the image data received from the PC 100 is still image data or moving image (video) data. The screen SC is not limited to a flat plate fixed to a wall surface, and the wall surface itself can be used as the screen SC.

In the projection system 1, an operation can be performed using the indicator 70 on the screen SC on which the projector 10 projects an image. The indicator 70 is, for example, a pen-type device, and the user uses the shaft portion 71 in his hand and presses the tip against the screen SC. An operation switch 72 for detecting a pressing operation is provided at the tip of the indicator 70. When the user presses the tip of the indicator 70 against the screen SC, the operation switch 72 is turned on. The user performs a position input operation by pressing the tip of the indicator 70 against the screen SC at an arbitrary position on the screen SC.
As will be described later, the projector 10 has a function of detecting the position of the indicator 70 on the screen SC. When the user performs a position input operation, the position where the tip of the indicator 70 is in contact with the screen SC is detected as the indication position.

The projection system 1 functions as an interactive whiteboard system that receives a position input operation performed by the user using the indicator 70 and reflects this operation on the projection image. Specifically, when the position input operation performed by the user is detected, the projection system 1 draws a picture such as a straight line, a curve, or a polygon according to the designated position, and projects the drawn figure onto the screen SC. The projection system 1 can draw an image so as to overlap the projected image in a state where any image is projected on the screen SC, and starts drawing the image after shifting to a state where no image is projected. You can also. In addition, the image drawn by this function can be saved as image data, and only the drawn image can be saved as image data, and together with the projected image projected on the screen SC at the time of drawing. It can also be saved as a single image data.

  Here, the projection system 1 generates an image in accordance with the indication position of the indicator 70 and projects the function by the projector 10 in either the “PJ mode” executed by the projector 10 or the “PC mode” executed by the PC 100. Is also feasible. In the “PJ mode”, the projector 10 detects the indication position of the indicator 70, generates an image according to the detected indication position, and projects it on the screen SC.

A toolbar 201 is projected on the screen SC together with the projected image. On the toolbar 201, a plurality of function buttons 204 and the like for causing the projector 10 to execute various functions are arranged. When the position overlapping with any one of the function buttons 204 is instructed by the operation of the indicator 70, the projector 10 executes the function assigned to the corresponding function button 204. In the example of FIG. 1, a drawing mode switching button 202 and a PC operation mode switching button 203 are arranged on the tool bar 201. The drawing mode switching button 202 is a button for instructing switching to an operation mode (drawing mode) in which drawing is performed by operating the indicator 70, and the PC operation mode switching button 203 uses the indicator 70 as a pointing device of the PC 100. This is a button for instructing switching to the PC operation mode. When the indicator 70 can be used, the tool bar 201 is always projected on the projection image in a superimposed manner or independently.
As described above, in the projection system 1, an operation for drawing graphics such as the drawn images 210 and 211 and an operation for the PC 100 can be performed by an operation using the indicator 70.

FIG. 2 is a functional block diagram showing the main configuration of the projector 10 that constitutes the projection system 1.
The projector 10 includes an input interface (not shown) through which image data D is input from an external device such as a PC 100, a video playback device, or a DVD playback device. This interface includes, for example, a wired or wireless USB interface, a wired or wireless LAN interface, a VGA terminal to which an analog video signal is input, a DVI (Digital Visual Interface) terminal to which digital image data is input, NTSC, PAL, SECAM, etc. An S video terminal to which a composite video signal is input, an RCA terminal to which a composite video signal is input, a D terminal to which a component video signal is input, an HDMI connector conforming to the HDMI (registered trademark) standard, and the like are provided. The projector 10 projects an image on the screen SC based on the image data D input from this interface.

The projector 10 includes a projection unit 20 that forms an optical image, and a main processor 11 (first processing device) that processes image data. The main processor 11 is connected to a sub processor 40 (second processing device) that draws graphics such as the drawn images 210 and 211 in response to the operation of the indicator 70.
In addition to the units shown in FIG. 2, the projector 10 includes a non-volatile storage unit that non-volatilely stores a program executed by the main processor 11 and the sub processor 40 and data to be processed, and the main processor 11 and the sub processor 40 execute. A work memory that temporarily stores programs to be processed and data to be processed, a frame memory that holds images projected by the projection unit 20 in units of frames, and an operation detection that detects an operation of the operation panel 19 and an operation by a remote controller (not shown) , An imaging unit that captures an image for detecting the position of the indicator 70 on the screen SC, and the like are omitted here.

The projection unit 20 (display means) includes an illumination optical system 21, a light modulation device 22, and a projection optical system 23. The illumination optical system 21 includes a light source including a xenon lamp, an ultra high pressure mercury lamp, an LED (Light Emitting Diode), a laser light source, and the like. Further, the illumination optical system 21 may include a reflector for guiding the light emitted from the light source to the light modulation device 22 and an auxiliary reflector, and a lens group (not shown) for enhancing the optical characteristics of the projection light, a polarizing plate, Or you may provide the light control element etc. which reduce the light quantity of the light which the light source emitted on the path | route which reaches the light modulation apparatus 22. FIG.
The light modulation device 22 includes, for example, three transmissive liquid crystal panels corresponding to the three primary colors of RGB, and generates image light by modulating light transmitted through the liquid crystal panel. The light from the illumination optical system 21 is separated into three color lights of RGB, and each color light enters each corresponding liquid crystal panel. The color light modulated by passing through each liquid crystal panel is combined by a combining optical system such as a cross dichroic prism and emitted to the projection optical system 23.

  The projection optical system 23 is a zoom lens that enlarges / reduces the projected image and adjusts the focus, a zoom adjustment motor that adjusts the degree of zoom, a focus adjustment motor that adjusts the focus, and directs the projection light toward the screen SC. A concave mirror that reflects the light. The projection optical system 23 performs zoom adjustment and focus adjustment of the image light modulated by the light modulation device 22, guides the light passing through the lens group in the direction of the screen SC by the concave mirror, and forms an image on the screen SC. The projection unit 20 is connected to a projection optical system drive unit 26 that drives each motor provided in the projection optical system 23 and a light source drive unit 24 that drives a light source provided in the illumination optical system 21. The specific configuration of the projection optical system 23 is not limited to the above example. For example, by using a configuration that does not use a mirror including a concave mirror, the light modulated by the light modulation device 22 is projected onto the screen SC by a lens and imaged. It is also possible to make it.

Image data D output from the PC 100 is input to the main processor 11. The main processor 11 temporarily stores the image input unit 12 that acquires the image data D, the image adjustment unit 13 that processes the image data D acquired by the image input unit 12, and the image data processed by the image adjustment unit 13. The image holding unit 14 that outputs the image data at a predetermined timing, an image based on the image data output from the image holding unit 14, a superimposition processing unit 15 that performs a process of superimposing on an overlay image described later, and a superimposition processing unit 15. And an image processing unit 16 that draws an image in a frame unit on a frame memory (not shown) based on the image processed by the above and outputs the image to the light modulation device driving unit 25. With the function of the superimposition processing unit 15, the main processor 11 functions as an output unit and a display control unit.
The image adjustment unit 13 performs resolution conversion processing for converting the resolution of the image data D acquired by the image input unit 12 in accordance with the resolution of the liquid crystal panel included in the light modulation device 22, and processing for converting the frame rate of the image data D. Etc.

In addition, the main processor 11 includes a coordinate detection unit 30 that detects an operation of the indicator 70 performed on the screen SC based on captured image data captured by an imaging unit (not shown). The coordinate detection unit 30 (input detection means, coordinate acquisition means) calculates and outputs the indicator detection unit 31 that detects the position of the indicator 70 from the captured image data, and the coordinates of the position detected by the indicator detection unit 31. And a coordinate calculation unit 32.
The indicator 70 includes a light emitting unit such as an infrared LED that outputs an infrared signal, a control circuit that controls light emission of the infrared LED, and a power source. Depending on the operation state (ON / OFF) of the operation switch 72, the indicator 70 Send. For this reason, the indicator 70 at the time of operation can be image | photographed by image | photographing the screen SC using the image pick-up element which receives infrared light.
Then, the coordinate calculation unit 32 calculates the coordinates of the position where the tip of the indicator 70 is pointing on the screen SC, that is, the coordinates of the indicated position. The coordinates calculated by the coordinate calculation unit 32 are, for example, coordinates based on an area (projection area) on which the projection unit 20 projects a projection image on the screen SC.

A branch output unit 33 that branches and outputs the coordinates calculated by the coordinate calculation unit 32 is connected to the coordinate detection unit 30. The output destination of the branch output unit 33 is the drawing processing unit 17 included in the main processor 11 and the sub processor 40. The branch output unit 33 outputs the calculated coordinates to the drawing processing unit 17 and the sub processor 40 every time the coordinate calculation unit 32 calculates the coordinates. Here, the coordinates output to the drawing processor 17 and the coordinates output to the sub processor 40 are the same coordinates.
The drawing processing unit 17 performs processing for drawing a graphic such as the drawing images 210 and 211 (FIG. 1) based on the coordinates input from the branch output unit 33. An overlay image holding unit 18 that temporarily holds an image drawn by the drawing processing unit 17 and outputs the image to the superimposition processing unit 15 at a predetermined timing is connected to the drawing processing unit 17.
The superimposition processing unit 15 acquires image data for one frame from the image holding unit 14 and develops an image in a memory (not shown) based on the image data for one frame. In addition, the superimposition processing unit 15 acquires a drawing image from the overlay image holding unit 18 and overwrites the image expanded in the memory, thereby expanding the superimposed image in the memory. Then, the superimposition processing unit 15 outputs the image developed in the memory to the image processing unit 16 and causes the projection unit 20 to project the image.

  On the other hand, the sub processor 40 draws a graphic such as the drawing images 210 and 211 based on the coordinates input from the branch output unit 33 of the main processor 11 and the branch output unit 33. A transmission unit 42 that acquires input coordinates and transmits the coordinates to the drawing application 41, a synchronization control unit 43 that performs processing for synchronizing drawing conditions and the like with the main processor 11, and image data of an image drawn by the drawing application 41 And an image output unit 44 for outputting to the main processor 11. That is, the sub processor 40 is a processor for performing drawing based on the coordinates calculated by the coordinate detection unit 30 and outputting the drawn image to the main processor 11.

  In addition to the image data D described above, image data of a drawing image is input from the sub processor 40 to the image input unit 12 included in the main processor 11. The image input unit 12 superimposes the image data D and the image data input from the sub processor 40, and outputs the image data of the superimposed image to the image adjustment unit 13. The image data is subjected to resolution conversion processing, frame rate conversion processing, and the like in the image adjustment unit 13 and output to the image holding unit 14 in the same manner as when the image data D is input alone.

When drawing is performed in response to an operation by the indicator 70, the projector 10 calculates the coordinates of the indicated position of the indicator 70 by the coordinate detection unit 30, and executes the drawing by the sub processor 40 based on the coordinates. Then, the projector 10 superimposes the drawn image drawn by the sub processor 40 on the image based on the image data D input from the PC 100 and projects the image on the screen SC by the function of the projection unit 20.
In the projector 10, for example, when an operation of moving the indicator 70 at a high speed is performed, the drawn image may follow the operation of the indicator 70 with a delay. That is, this is a case where the timing of generating and projecting the drawn image is delayed with respect to the operation of the indicator 70. The factor is that the delay caused by the bandwidth limitation of the bus connecting the main processor 11 and the sub processor 40 or the image input unit 12 and the image adjustment unit 13 for the image data of the drawing image generated by the sub processor 40. There can be a delay caused by performing the process.

Thus, the projector 10 performs drawing so as to follow the operation of the indicator 70 by the sub processor 40, while the drawing processor 17 also performs drawing in the main processor 11. The drawn image drawn by the drawing processing unit 17 is input to the superimposition processing unit 15 via the overlay image holding unit 18. Since the superimposition processing unit 15 superimposes the image input to the image input unit 12 and the image rendered by the rendering processing unit 17, the image data D, the rendering image rendered by the sub-processor 40, and the rendering processing unit 17. The drawn image drawn by is superimposed and projected.
Here, the process in which the drawing processing unit 17 performs drawing and projects the drawn image is affected by the bandwidth of the bus connecting the main processor 11 and the sub processor 40 and the processing time by the image input unit 12 and the image adjustment unit 13. Not receive. For this reason, the image drawn by the drawing processing unit 17 is projected earlier than the drawing image drawn by the sub processor 40 is projected.

FIG. 3 is an explanatory diagram showing the state of the drawing process executed by the projector 10.
In FIG. 3, a sub processor drawing image (second image) 101 is an image drawn by the sub processor 40 and input to the superimposition processing unit 15, and a main processor drawing image (first image) 102 is drawn. It is an image drawn by the processing unit 17 and input to the superimposition processing unit 15. The superimposed image 103 is an image generated by the superimposition processing unit 15 through the superimposition process.
As described above, the main processor drawing image 102 is input to the superimposition processing unit 15 earlier than the sub processor drawing image 101. For this reason, for example, immediately after the coordinate detection unit 30 detects the operation of the indicator 70 and calculates the coordinates, as shown in FIG. 3, the main processor drawn image 102 has a graphic along the entire locus of the indicator 70. In the sub processor drawing image 101, the image 111 in the middle of drawing a part of the trajectory is drawn.
The factors that the main processor 11 included in the sub processor drawing image 101 is drawing are as follows, for example. A delay in drawing by the drawing application 41 due to a delay in outputting coordinates from the branch output unit 33 to the transmission unit 42, a transmission delay until image data of an image drawn by the drawing application 41 is input to the image input unit 12, The frame output from the image holding unit 14 is delayed by several frames from the frame output from the overlay image holding unit 18 due to processing delay of the image input unit 12 and the image adjustment unit 13.

  When the superimposition processing unit 15 superimposes the sub processor drawing image 101 input from the image holding unit 14 and the main processor drawing image 102 input from the overlay image holding unit 18, a superimposed image 103 is generated. The superimposed image 103 includes an image 113 corresponding to the entire locus of the indicator 70 to be drawn. That is, even when the image 111 of the sub processor drawing image 101 is in the middle of drawing, the superimposition processing unit 15 generates the image 113 in a state where drawing is completed. Therefore, the image 113 is projected on the screen SC following the operation of the indicator 70 without delay.

  As described above, the projector 10 has a configuration in which, even if a delay occurs in the process in which the sub processor 40 draws and projects an image, the main processor 11 performs the drawing and transmits the signal through a path that does not easily cause the delay. By overlapping and projecting the image drawn by the sub processor 40 and the image drawn by the main processor 11, the image can be drawn and projected without delay.

  Moreover, it is preferable that the attribute of the image 111 drawn by the drawing application 41 and the attribute of the image 112 drawn by the drawing processing unit 17 are the same. The image attributes include line width, line color, line end point shape, color when the figure is filled, etc., when the drawn image is composed of figures including straight lines and / or curves. The synchronization control unit 43 and the drawing processing unit 17 included in the sub processor 40 mutually transmit and receive information on the attributes of the image to be drawn after the coordinates are input from the branch output unit 33 or at predetermined time intervals. , Match each other's attributes. Thereby, the projector 10 can draw an image having the same attribute in the drawing application 41 and the drawing processing unit 17.

Here, the operation in which the overlay image holding unit 18 outputs the drawing image of the drawing processing unit 17 to the superimposition processing unit 15 is temporary until the drawing image of the sub processor 40 has drawn the entire drawing image. Operation. For example, the image 111 in the sub-processor rendered image 101 shown in FIG. 3 becomes like the image 112 when time elapses even when transmission delay or processing delay occurs. Thereafter, it is not necessary to superimpose the main processor drawing image 102 on the sub processor drawing image 101. In addition, the image 111 in the sub processor drawing image 101 and the image 112 in the main processor drawing image 102 do not always coincide with each other. For example, when an interpolation process or a correction process is performed in the process of converting the resolution, deformation or a color change may occur at the boundary between the figure and the background. In this case, there is a concern that the image quality may be slightly deteriorated, such as the overlapping portion of the image 111 and the image 112 becomes unclear by superimposing the sub processor drawn image 101 and the main processor drawn image 102. For this reason, it is preferable that the frequency and execution time of the process of superimposing the sub processor drawn image 101 and the main processor drawn image 102 be minimized.
Therefore, every time the coordinate detection unit 30 detects the coordinates of the indicator 70, the projector 10 inputs the drawing image of the drawing processing unit 17 to the superimposition processing unit 15, and then passes the predetermined time from the overlay image holding unit 18. The drawing image input to the superimposition processing unit 15 is stopped. As a result, of the sub processor drawing image 101 and the main processor drawing image 102, only the sub processor drawing image 102 is output to the superimposition processing unit 15, so that only the sub processor drawing image 102 is displayed.

  Further, the projector 10 operates when the image 111 included in the sub processor drawing image 101 and the image 112 included in the main processor drawing image 102 are substantially the same due to the operation of the overlay image holding unit 18 or the superimposition processing unit 15. May be configured not to perform superimposition processing. In this case, the image 111 and the image 112 are detected and compared, and the superimposition process is stopped if they match at a portion exceeding a predetermined threshold. Also in this case, only the sub processor drawing image 102 of the sub processor drawing image 101 and the main processor drawing image 102 is displayed.

FIG. 4 is a flowchart showing the operation of the projector 10, and in particular, a process for drawing in accordance with the operation of the indicator 70 will be described. 4A shows the operation of the secondary processor 40, and FIG. 4B shows the operation of the main processor 11.
The main processor 11 acquires the image data D input from the PC 100, and starts projection through processing by the image input unit 12 and the image adjustment unit 13 (step S21). The coordinate detection unit 30 starts detecting the operation of the indicator 70 (step S22) and waits until an operation is detected (step S23).

  When the indicator detection unit 31 detects an operation by the indicator 70 (step S23; Yes), the coordinate detection unit 30 obtains the coordinates of the position detected by the coordinate calculation unit 32 (step S24). The coordinate calculation unit 32 outputs the calculated coordinates to the branch output unit 33, and the branch output unit 33 outputs the coordinates to the drawing processing unit 17 and the transmission unit 42 (step S25).

  When the transmission unit 42 acquires the coordinates output from the branch output unit 33 (step S11), the sub processor 40 starts drawing processing. The sub processor 40 synchronizes the attribute of the image with the drawing processing unit 17 by the synchronization control unit 43 (step S12), executes the drawing (step S13), and inputs image data of the drawn image from the image output unit 44. It outputs to the part 12 (step S14). Note that the sub processor 40 is performing drawing based on the coordinates acquired by the transmission unit 42, that is, even before the drawing is completed, or a cycle according to the frame rate of the light modulation device 22 or shorter. The drawn image is output to the image input unit 12 at a cycle. For this reason, for example, when it takes a time corresponding to two frames or more to complete drawing, image data in the middle of drawing is output to the image input unit 12.

  The drawing processing unit 17 of the main processor 11 synchronizes the attributes of the image with the synchronization control unit 43 (step S26), and executes drawing based on the coordinates input from the branch output unit 33 (step S27). After the start, the drawn image is output to the overlay image holding unit 18 at a cycle matching the frame rate of the light modulator 22 or at a shorter cycle. The overlay image holding unit 18 outputs the image data to the superimposition processing unit 15 at a cycle matching the frame rate of the light modulation device 22 or at a shorter cycle. The superimposition processing unit 15 receives the image input from the overlay image holding unit 18. And the image input from the image holding unit 14 are superimposed and the superimposed image is projected by the projection unit 20 (step S28).

The superimposition processing unit 15 stops the superimposition processing when the time from the start of the superimposition processing reaches a predetermined time or when the drawing image drawn by the sub processor 40 substantially matches the drawing image of the drawing processing unit 17. . That is, the superimposition processing unit 15 determines whether or not a predetermined time has elapsed since the start of the superimposition processing (step S29). When the predetermined time has elapsed (step S29; Yes), the process proceeds to step S31 described later. . If the predetermined time has not elapsed (step S29; No), the image input from the image holding unit 14 and the image input from the overlay image holding unit 18 are compared to determine whether they match. (Step S30). Here, when the difference between the drawn images exceeds a predetermined ratio (step S30; No), the operation of the projector 10 returns to step S23.
If the drawn images match at a predetermined ratio or more (step S30; Yes), the superimposition processing unit 15 proceeds to step S31.

  In step S <b> 31, the superimposition processing unit 15 stops the superimposition (overlay) process and causes the projection unit 20 to project only the image input from the image holding unit 14. Thereafter, the main processor 11 determines whether or not the detection of the operation by the indicator 70 is to be terminated (step S32). When the operation detection is continued (step S323; No), the process returns to step S23. Further, if there is an input operation or the like for instructing the end of the operation of the indicator 70 (step S32; Yes), this process ends.

  As described above, the projector 10 according to the embodiment to which the invention is applied includes an image based on the coordinate detection unit 30 that calculates the coordinates of the designated position designated by the indicator 70 and the coordinates output by the coordinate detection unit 30. And a main processor 11 including a superimposition processor 15 that outputs image data of an image drawn by the drawing application 41. The main processor 11 includes a drawing process. The unit 17 performs drawing in the same manner as the drawing application 41 based on the coordinates calculated by the coordinate detection unit 30, superimposes the drawing image on the image output from the drawing application 41, and generates and outputs superimposed image data The process is configured to be executable, and the superimposition process is executed based on a predetermined condition. As a result, when either the sub processor 40 or the main processor 11 performs drawing, a drawn image drawn based on the input coordinates is output and projected onto the screen SC. For this reason, it is possible to shorten the time until the drawing image is output in accordance with the higher processing speed of the main processor 11 and the sub processor 40.

The projector 10 includes a main processor 11 and a sub processor 40 which are a plurality of processing devices provided independently. The main processor 11 constitutes a coordinate detection unit 30 and a superimposition processing unit 15, and the sub processor 40 draws. The application 41 is configured. For this reason, the time required to display a drawn image can be shortened by the ability of either the main processor 11 or the sub processor 40 on which the drawing process is faster.
Further, the main processor 11 executes a superimposition process for a predetermined time after the coordinate detection unit 30 calculates the coordinates and the branch output unit 33 outputs the coordinates, and thereafter, another image is added to the output image of the image holding unit 14. Since the image is output without superimposing, the frequency and execution time of the superimposition processing can be minimized.
Further, in the main processor 11, after the coordinate detection unit 30 calculates the coordinates and the branch output unit 33 outputs the coordinates, the drawing image of the sub processor 40 includes the same image as the drawing image of the drawing processing unit 17. Since the superimposition process is stopped at this time, the frequency and execution time of the superimposition process can be minimized.

  The above-described embodiment is merely an example of a specific mode to which the present invention is applied, and the present invention is not limited. The present invention can be applied as a mode different from the above-described embodiment. For example, in the above-described embodiment, the configuration in which the coordinates of the indicated position are obtained by receiving infrared light emitted from the indicator 70 has been described as an example. However, captured image data captured by an imaging element that receives visible light is captured. The coordinates of the designated position may be obtained by processing. Further, for example, a pressure-sensitive or capacitive touch panel that detects a touch operation may be arranged, and the coordinates of the operation position on the touch panel may be obtained.

  In the above embodiment, the light modulation device 22 that modulates the light emitted from the light source has been described by taking as an example a configuration using three transmissive liquid crystal panels corresponding to RGB colors. However, the present invention is not limited to this. For example, a configuration using three reflective liquid crystal panels may be used, or a combination of one liquid crystal panel and a color wheel, and three digital mirror devices (DMD). You may comprise by the system using a DMD system etc. which combined one digital mirror device and the color wheel. Here, when only one liquid crystal panel or DMD is used as the light modulation device, a member corresponding to a combining optical system such as a cross dichroic prism is unnecessary. In addition to the liquid crystal panel and the DMD, any light modulation device capable of modulating light emitted from the light source can be employed without any problem.

Furthermore, the display device of the present invention is not limited to a projector that projects an image on the screen SC, but is displayed on a liquid crystal monitor or a liquid crystal television that displays an image / image on a liquid crystal display panel, or on a PDP (plasma display panel). Self-luminous such as a monitor device or a television receiver for displaying an image / image on an organic EL display panel called a monitor device or a television receiver, an OLED (Organic light-emitting diode), an OEL (Organic Electro-Luminescence), etc. Various display devices such as a type display device are also included in the image display device of the present invention. In this case, a liquid crystal display panel, a plasma display panel, and an organic EL display panel correspond to the display means.
Each of the functional units included in the main processor 11 and the sub processor 40 illustrated in FIG. 2 is realized as hardware or software by the main processor 11 and the sub processor 40. It is not limited. For example, specifically, the main processor 11 and the sub processor 40 may be configured to implement each functional unit by executing a predetermined program. Further, for example, the main processor 11 and the sub processor 40 may be configured as a PLD (Programmable Logic Device), and logic blocks may be formed so as to correspond to the respective functional units illustrated in FIG. 2 may be provided in the main processor 11 and the sub processor 40 as hardware. In addition, specific detailed configurations of other parts of the projection system 1 can be arbitrarily changed without departing from the spirit of the present invention. In the configuration of the above embodiment, the indicator 70 is not limited to a rod-shaped or pen-shaped one. Furthermore, for example, it is also possible to employ a configuration in which the projector 10 detects the indicated position using a user's finger as an indicator.

  DESCRIPTION OF SYMBOLS 1 ... Projection system, 10 ... Projector (data processing apparatus, display device), 11 ... Main processor (output means, 1st processing device), 12 ... Image input part, 13 ... Image adjustment part, 14 ... Image holding part, DESCRIPTION OF SYMBOLS 15 ... Superimposition process part (display control means), 16 ... Image processing part, 17 ... Drawing process part, 18 ... Overlay image holding part, 19 ... Operation panel, 20 ... Projection part (display means), 30 ... Coordinate detection part ( (Input detection means, coordinate acquisition means), 31 ... indicator detection section, 32 ... coordinate calculation section, 33 ... branch output section, 40 ... sub-processor (second processing device), 41 ... drawing application (drawing means), 42 ... Transmission unit, 43 ... Synchronization control unit, 44 ... Image output unit, 70 ... Indicator, 100 ... PC, 101 ... Sub processor drawing image, 102 ... Main processor drawing image, 10 ... superimposed image, 111, 112, 113 ... image, 210, 211 ... drawn image, SC ... screen (projection surface).

Claims (6)

A data processing device for outputting image data,
Coordinate acquisition means for acquiring input coordinates;
Drawing means for drawing an image based on the input coordinates acquired by the coordinate acquisition means;
Output means for outputting image data of an image drawn by the drawing means,
The output means performs drawing in the same manner as the drawing means based on the input coordinates acquired by the coordinate acquisition means, and generates superimposed image data by superimposing the drawn image on an image output by the drawing means. And executing the superimposition process based on a predetermined condition.
The output means executes the superimposition process for a predetermined time after the coordinate acquisition means acquires the input coordinates, and then outputs image data without superimposing another image on the image drawn by the drawing means. ,
A data processing apparatus.   The coordinate acquisition unit and the output unit are configured by a first processing device, and the drawing unit is configured by a second processing device provided independently of the first processing device. The data processing apparatus according to claim 1.   The output unit performs the superimposition process after the coordinate acquisition unit acquires input coordinates, and detects that the image drawn by the drawing unit includes the same image as the image drawn by the output unit. 3. The data processing apparatus according to claim 1, wherein the superimposing process is stopped. Display means for displaying an image;
Input detecting means for detecting a position input operation and acquiring input coordinates;
Drawing means for drawing an image based on the input coordinates acquired by the input detection means;
Output means for outputting image data of an image drawn by the drawing means;
Display control means for displaying an image by the display means based on the image data output by the output means,
The output means performs drawing in the same manner as the drawing means based on the input coordinates acquired by the input detection means, and generates superimposed image data by superimposing the drawn image on an image output by the drawing means. And executing the superimposition process based on a predetermined condition.
The output means executes the superimposition process for a predetermined time after the input detection means acquires the input coordinates, and then outputs image data without superimposing another image on the image drawn by the drawing means. ,
A display device. A control method for a data processing apparatus that outputs image data,
Coordinate acquisition means for acquiring input coordinates;
Drawing means for drawing an image based on the input coordinates acquired by the coordinate acquisition means;
Controlling a data processing apparatus having output means for outputting image data of an image drawn by the drawing means;
Based on a predetermined condition, the output unit performs drawing in the same manner as the drawing unit based on the input coordinates acquired by the coordinate acquisition unit, and superimposes the drawn image on the image output by the drawing unit. To generate the superimposed image data and output it,
Executing the superimposition process for a predetermined time after the coordinate acquisition means acquires the input coordinates, and thereafter outputting image data without superimposing another image on the image drawn by the drawing means;
A method for controlling a data processing apparatus. It has a main processor and sub processor,
The main processor includes coordinate acquisition means for acquiring input coordinates, and output means for outputting image data of an image drawn by the sub processor,
The sub processor is a control method of a data processing apparatus configured to include a drawing unit that draws an image based on input coordinates acquired by the coordinate acquisition unit,
The main processor performs drawing in the same manner as the drawing unit based on the input coordinates acquired by the coordinate acquisition unit based on a predetermined condition, and superimposes the drawn image on the image output by the drawing unit. To generate the superimposed image data and output it,
Executing the superimposition process for a predetermined time after the coordinate acquisition means acquires the input coordinates, and thereafter outputting image data without superimposing another image on the image drawn by the drawing means;
A method for controlling a data processing apparatus.

Images