JP6019979B2 - Information processing apparatus, image processing program, and projection system - Google Patents

Description

  The present invention relates to an information processing apparatus, an image processing program, and a projection system.

  Conventionally, a line, a character, or a picture can be drawn electronically by moving a pointing position on a projection image projected on a projection surface such as a screen by a projection device such as a projector by using a pointing device such as an electronic pen. Technology is known. The pointing position is calibrated based on the operation of moving the pointing mark (pointer) along the polygon projected on the projection plane and the sensor values of various sensors in the pointing device measured during the operation. The technique to do is disclosed (refer patent document 1).

  However, the above-described conventional technique has a problem that the operability of drawing using a pointing device is not preferable. For example, the conventional technique merely draws a pointing mark at a pointing position in accordance with the operation of the pointing device by the user. If the user loses sight of the pointing mark, the operability is lowered.

  The present invention has been made in view of the above, and an object of the present invention is to provide an information processing apparatus, an image processing program, and a projection system that can improve the operability of drawing using a pointing device. .

In order to solve the above-described problems and achieve the object, an information processing apparatus according to the present invention includes a projection distance representing a distance from a projection plane onto which a projection image is projected by the projection apparatus to the projection apparatus, and a projection distance from the projection plane. State change information representing information for changing the state of the instruction image in association with the instruction device distance representing the distance to the instruction device for operating the instruction image representing the instruction position in the projection image. Included in the device information , a state processing unit for specifying the state change information from the state change storage unit to store, the preset projection distance, and the instruction device distance included in the device information related to the instruction device An image generation unit that generates the projection image in which the instruction image corresponding to the specified state change information is arranged at the specified position.

In addition, the image processing program according to the present invention includes a projection distance representing a distance from a projection plane onto which the projection image is projected by the projection apparatus to the projection apparatus, and an indication position in the projection image from the projection plane. A state change storage unit that stores state change information representing information for changing the state of the instruction image in association with an instruction device distance representing a distance to the instruction device for operating the instruction image representing And specifying the state change information from the preset projection distance in the computer and the pointing device distance included in the device information related to the pointing device, and the pointing position included in the device information. to, to perform the step of generating the projection image placing the instruction image in accordance with the state change information identified

The projection system according to the present invention is a projection system having an instruction device, an information processing apparatus, and a projection apparatus, wherein the instruction device indicates an instruction position in a projection image projected on a projection surface. A detection unit configured to detect device information related to the pointing device for manipulating an image, wherein the information processing apparatus includes a projection distance representing a distance from the projection plane to the projection apparatus; A state change storage unit that stores state change information that represents information for changing the state of the instruction image in association with the instruction device distance that represents the distance to the device , the projection distance that is set in advance, and the device from said instruction device distance included in the information, the state processing unit for identifying the status change information, the pointed position included in the device information, it is identified And an image generating unit configured to generate the projection image placing the instruction image in accordance with the status change information, the projection device has a projection unit for projecting the generated the projection image on the projection surface.

  According to one aspect of the present invention, the operability of drawing using a pointing device can be improved.

FIG. 1 is a diagram illustrating an example of an application image of the projection system according to the first embodiment. FIG. 2 is a diagram illustrating a configuration example of the projection system according to the first embodiment. FIG. 3 is a functional block diagram illustrating a configuration example of the information processing apparatus according to the first embodiment. FIG. 4 is a diagram illustrating information held by the display position detection unit. FIG. 5 is a diagram illustrating an example of information stored in the state change rate storage unit according to the first embodiment. FIG. 6 is a sequence diagram illustrating an example of a processing flow by the projection system according to the first embodiment. FIG. 7 is a flowchart illustrating an example of the flow of image processing according to the first embodiment. FIG. 8 is a functional block diagram illustrating a configuration example of the information processing apparatus according to the second embodiment. FIG. 9 is a diagram for explaining an example of an acceleration pattern according to the second embodiment. FIG. 10 is a sequence diagram illustrating an example of a processing flow by the projection system according to the second embodiment. FIG. 11 is a flowchart illustrating an example of the flow of image processing according to the second embodiment. FIG. 12 is a functional block diagram illustrating a configuration example of the information processing apparatus according to the third embodiment. FIG. 13 is a diagram for explaining an example of a coordinate displacement pattern according to the third embodiment. FIG. 14A is a diagram illustrating an example of a coordinate displacement pattern according to Embodiment 3. FIG. 14B is a diagram illustrating an example of a coordinate displacement pattern according to Embodiment 3. FIG. 15 is a sequence diagram illustrating an example of a process flow by the projection system according to the third embodiment. FIG. 16 is a flowchart illustrating an example of the flow of image processing according to the third embodiment. FIG. 17 is a diagram for explaining the projection plane occupation ratio of the pointing marks. FIG. 18 is a diagram illustrating an example of information (1) stored in the state change rate storage unit when the state change rate is controlled according to the projection plane occupation ratio. FIG. 19 is a diagram illustrating an example of information (2) stored in the state change rate storage unit when the state change rate is controlled according to the projection plane occupation ratio. FIG. 20 is a diagram illustrating a case where the pointing mark is transmitted. FIG. 21 is a diagram for explaining a temporary state change of the pointing mark.

  Embodiments of an information processing apparatus, an image processing program, and a projection system according to the present invention will be described below with reference to the accompanying drawings. In addition, this invention is not limited by the following embodiment. Moreover, each embodiment can be combined suitably as long as the content is not contradicted.

(Embodiment 1)
[Application image of projection system]
An application image of the projection system according to Embodiment 1 will be described with reference to FIG. FIG. 1 is a diagram illustrating an example of an application image of the projection system according to the first embodiment.

  As illustrated in FIG. 1, the projection system includes a pointing device, a projection apparatus, and an information processing apparatus. Among these, the pointing device is, for example, a pen-type device operated by the user. The projection apparatus is a projector that projects a projection image on a projection surface such as a screen. The information processing apparatus is, for example, a PC (Personal Computer) that generates a projection image in which a pointing mark is arranged at a pointing position. In the example of FIG. 1, the projection apparatus and the information processing apparatus are connected by wire.

Further, the projection size “S (= h × w)” representing the size of the projection plane can be obtained from the width “w (width)” of the projection plane and the height “h (height)” of the projection plane. However, the projection size “S” can also be obtained according to the distance “l” from the projection plane. In general, the installation position of the projection apparatus is adjusted before the presentation starts, and the installation position of the projection apparatus is rarely changed during the presentation. From this, the projection size “S” can be obtained according to the distance “l ₂ ” if the distance “l ₂ ” from the projection surface to the projection apparatus is determined. In FIG. 1, “S∽l” indicates that the projection size “S” is obtained according to the distance “l” from the projection plane.

In addition, the pointing device operated by the user exists at a position where the distance from the projection plane is “l ₁ ”. The distance “l ₁ ” from the projection plane to the pointing device is different from the distance “l ₂ ” from the projection plane to the projection apparatus, and may vary with the movement of the user. In addition, the movement of the user is one of the factors that cause the pointing mark to be lost. For example, it is considered that the possibility of losing sight of the pointing mark increases as the user moves away from the projection plane. As other factors, there are communication connection status, light adjustment, diverted line of sight, and the like.

  For these reasons, in the following embodiment, a projection system that improves the operability of drawing using a pointing device by changing the state of a pointing mark according to the situation will be described.

[System configuration]
The configuration of the projection system according to Embodiment 1 will be described with reference to FIG. FIG. 2 is a diagram illustrating a configuration example of the projection system according to the first embodiment. As illustrated in FIG. 2, the projection system 1 includes a pointing device 10, a projection device 20, and an information processing device 100. Each device is connected by a cable or various wireless communications.

  The pointing device 10 detects device information related to its own device that operates a pointing mark representing a designated position in a projection image projected onto a projection plane. The device information is, for example, a pointing position on the projection plane, a distance from the projection plane to the pointing device 10, and the like. Then, the pointing device 10 transmits the detected device information to the information processing apparatus 100 via the projection apparatus 20. The pointing device 10 is an example of an “instruction device”, the pointing mark is an example of an “instruction image”, and the pointing position is an example of an “instruction position”.

  The information processing apparatus 100 specifies state change information representing information for changing the state of the pointing mark based on the device information received from the pointing device 10. Regarding the change in the state of the pointing mark, for example, an enlargement process is appropriately performed so that the user does not lose sight of the pointing mark and the operability is not impaired. That is, the state change information is information indicating the enlargement ratio of the pointing mark as one aspect. Then, the information processing apparatus 100 generates a projection image in which a pointing mark corresponding to the specified state change information is arranged at the pointing position included in the device information. Thereafter, the information processing apparatus 100 transmits the generated projection image to the projection apparatus 20. The projection device 20 projects the projection image received from the information processing device 100 onto the projection plane. The detailed configuration and processing of each device will be described later.

[Device Configuration According to Embodiment 1]
Next, the configuration of the information processing apparatus 100 according to Embodiment 1 will be described with reference to FIG. FIG. 3 is a functional block diagram illustrating a configuration example of the information processing apparatus 100 according to the first embodiment. In addition to the information processing apparatus 100, FIG. 3 also illustrates the pointing device 10 and the projection apparatus 20.

As illustrated in FIG. 3, the pointing device 10 includes a display position detection unit 11 and a distance information detection unit 12. The display position detection unit 11 detects a pointing position that is a display position of a pointing mark in a projection image projected on the projection plane. Then, the display position detection unit 11 acquires the device distance from the distance information detection unit 12, and sends device information including the acquired device distance and the detected pointing position to the information processing apparatus 100 via the projection device 20. Send. FIG. 4 is a diagram for explaining information held by the display position detection unit 11. As shown in FIG. 4, the display position detection unit 11 recognizes the two-dimensional coordinates on the projection plane and holds the coordinate information of the pointing position of the pointing mark. The example of FIG. 4 represents the case where the coordinates of the pointing position of the pointing mark are (x ₁ , y ₁ ) on the projection plane as the xy coordinates.

  The distance information detection unit 12 detects a device distance representing a distance from the projection plane to the pointing device 10. The device distance is an example of “instruction device distance”. Such device distance detection may be obtained by reflection of the beam output or a camera capable of measuring the distance may be used, and other known techniques may be used.

  The projection device 20 includes an operation determination unit 21 and a projection unit 22. The operation determination unit 21 receives device information from the pointing device 10 and determines whether or not the operation of the pointing device 10 is a drawing mode indicating a mode for drawing on the projection plane. Then, the operation determination unit 21 transmits the device information and the mode determination result to the information processing apparatus 100. The projection unit 22 projects the projection image received from the information processing apparatus 100 onto a projection surface such as a screen. The details of the drawing mode will be described in the second and subsequent embodiments.

  The information processing apparatus 100 includes a reception unit 110, a state change rate storage unit 120, a state processing unit 130, and an image generation unit 140. The reception unit 110 receives device information from the pointing device 10 via the projection device 20. More specifically, the reception unit 110 receives device information including a pointing position and a device distance.

The state change rate storage unit 120 associates the projection distance “l ₂ ” representing the distance from the projection plane to the projection device 20 and the device distance “l ₁ ” with information for changing the state of the pointing mark. The state change information to be represented is stored. The state change rate storage unit 120 is an example of a “state change storage unit”. FIG. 5 is a diagram illustrating an example of information stored in the state change rate storage unit 120 according to the first embodiment. In the example illustrated in FIG. 5, for convenience of explanation, only the state change rate when the projection distance is “l ₂ = 10” is illustrated, but there are also state change rates at other locations.

For example, as illustrated in FIG. 5, the state change rate storage unit 120 stores the state change rate “R ₂₀ ” in association with the projection distance “l ₂ = 10” and the device distance “l ₁ = 20”. . Further, as described above, if the projection distance “l ₂ ” is known, the projection size “S” is also known. In the example of FIG. 5, when the projection distance is “l ₂ = 10”, the projection size is “S = S ₁₀ ”. That is, for the item of the projection size “S”, a specific value is input in advance from the specifications of the projection device 20 or the like. Then, the projection size “S” is determined according to the separately input projection distance “l ₂ ”. In other words, when the projection distance is “l ₂ = 10”, any of the state change rates existing in the column of the projection distance “l ₂ = 10” is used no matter what pointing device 10 is used. Is adopted. The state change rate is, for example, an enlargement rate, and may be individually input according to the device distance, or may be obtained by calculation using an arbitrary calculation formula with the distance ratio as a parameter. For example, as the device distance increases, the enlargement rate as the state change rate is increased. The enlargement ratio is a value with respect to the default size of the pointing mark.

The state processing unit 130 specifies state change information based on the device information received by the receiving unit 110. More specifically, the state processing unit 130 acquires the corresponding state change rate from the state change rate storage unit 120 based on the projection distance “l ₂ ” included in the device information received by the receiving unit 110. Thus, the state change rate is specified. At this time, the state processing unit 130 checks the history of the projection distance "l _2", does not perform the acquisition of the status change rate if there is no change in projection distance "l _2". This is because there is no need to change the state of the pointing mark if there is no change in the projection distance “l ₂ ”. Further, if the projection distance “l ₂ ” is changed, the state processing unit 130 updates the history of the projection distance “l ₂ ”.

The image generation unit 140 generates a projection image in which a pointing mark corresponding to the state change information specified by the state processing unit 130 is arranged at the pointing position included in the device information received by the reception unit 110. More specifically, assuming that the projection distance is “l ₂ = 10”, the device distance is “l ₁ = 20”, and the coordinates of the pointing position (x ₁ , y ₁ ), the image generation unit 140 uses the coordinates (x ₁ , y A projection image is generated in which a pointing mark enlarged according to the state change rate “R ₂₀ ” is arranged at the position ₁ ). Then, the image generation unit 140 transmits the generated projection image to the projection device 20.

[Processing sequence between apparatuses according to Embodiment 1]
Next, the flow of processing by the projection system 1 according to Embodiment 1 will be described using FIG. FIG. 6 is a sequence diagram illustrating an example of a processing flow by the projection system 1 according to the first embodiment.

  As shown in FIG. 6, when receiving a user operation (step S101), the display position detection unit 11 requests a device distance from the distance information detection unit 12 (step S102). The distance information detection unit 12 detects the device distance and notifies the display device detection unit 11 of the detected device distance (step S103). Further, the display position detection unit 11 detects the pointing position on the projection plane, and transmits device information including the coordinate information on the projection plane of the detected pointing position and the notified device distance to the projection apparatus 20 ( Step S104). In addition, the operation determination unit 21 receives device information and transmits the received device information to the information processing apparatus 100 (step S105).

  In addition, the reception unit 110 receives the device information, notifies the state processing unit 130 of the device distance included in the device information (step S106), and the coordinate generation information of the pointing position included in the device information. (Step S107). The state processing unit 130 checks the device distance history to determine whether or not there is a change in the notified device distance (step S108). Then, when there is a change in the device distance, the state processing unit 130 acquires a state change rate corresponding to the device distance from the state change rate storage unit 120 (step S109).

  Subsequently, the state processing unit 130 notifies the image generation unit 140 of the acquired state change rate (step S110). Thereafter, the state processing unit 130 updates the device distance history (step S111). In addition, the image generation unit 140 generates a projection image in which a pointing mark corresponding to the state change rate notified from the state processing unit 130 is arranged at the position of the coordinate information of the pointing position notified from the reception unit 110 (Step S1). S112). Then, the image generation unit 140 transmits the generated projection image to the projection device 20 (step S113). Thereby, the projection part 22 receives a projection image, and projects the received projection image on a projection surface (step S114).

[Image Processing Flow According to Embodiment 1]
Next, the flow of image processing according to the first embodiment will be described with reference to FIG. FIG. 7 is a flowchart illustrating an example of the flow of image processing according to the first embodiment. Note that image processing mainly refers to processing by the information processing apparatus 100.

  As shown in FIG. 7, when device information is received from the pointing device 10 via the projection device 20 by the receiving unit 110 (step S201: Yes), the state processing unit 130 checks the history of device distance. Then, it is determined whether or not the device distance included in the device information has changed (step S202). Further, when the device information is not received (step S201: No), the reception unit 110 is in a state of waiting for reception of the device information.

  If the device distance has changed (step S202: Yes), the state processing unit 130 acquires the state change rate corresponding to the device distance from the state change rate storage unit 120 (step S203). At this time, the state processing unit 130 updates the device distance history. Subsequently, the image generation unit 140 generates a projection image in which a pointing mark that reflects the state change rate acquired by the state processing unit 130 is arranged at the coordinate position of the pointing position included in the device information (step S204). . On the other hand, when the state processing unit 130 determines that there is no change in the device distance (step S202: No), the image generation unit 140 generates a projection image by a normal process (step S205).

[Effects of Embodiment 1]
As described above, the information processing apparatus 100 generates a projection image in which the size of the pointing mark is changed in accordance with the device distance representing the distance from the projection surface to the pointing device 10, so that drawing using the pointing device is performed. The operability can be improved.

(Embodiment 2)
In the first embodiment, the case where the state of the pointing mark is changed according to the device distance has been described. However, the state of the pointing mark can be changed according to the acceleration information of the pointing device. Therefore, in the second embodiment, a case will be described in which the state of the pointing mark is changed according to the acceleration information of the pointing device.

[Apparatus configuration according to Embodiment 2]
The configuration of the information processing apparatus according to the second embodiment will be described with reference to FIG. FIG. 8 is a functional block diagram illustrating a configuration example of the information processing apparatus according to the second embodiment. In addition to the information processing apparatus 200, FIG. 8 also illustrates the pointing device 10a and the projection apparatus 20. In the second embodiment, the same components as those in the first embodiment are denoted by the same reference numerals, and detailed description of the same components may be omitted. In the second embodiment, functions, configurations, and processes other than the acceleration detection unit 13, the reception unit 210, the state processing unit 230, the image generation unit 240, the acceleration determination unit 250, and the mode management unit 260 described below are described in the first embodiment. It is the same.

  As illustrated in FIG. 8, the pointing device 10 a includes a display position detection unit 11, a distance information detection unit 12, and an acceleration detection unit 13. The acceleration detector 13 is an acceleration sensor that detects the acceleration of the pointing device 10a. The acceleration detection unit 13 detects acceleration and sequentially notifies the display position detection unit 11 of the detected acceleration as acceleration information. The display position detection unit 11 acquires acceleration information from the acceleration detection unit 13, and transmits device information including the acquired acceleration information and the detected pointing position to the information processing apparatus 200 via the projection device 20. Note that the display position detection unit 11 may also transmit the device distance to the information processing apparatus 200 as one piece of device information, as in the first embodiment. In the second embodiment, description will be made assuming that the device information is pointing position and acceleration information.

  The projection device 20 includes an operation determination unit 21 and a projection unit 22. The operation determination unit 21 receives device information from the pointing device 10a and determines whether or not the operation of the pointing device 10a is a drawing mode indicating a mode for drawing on the projection plane. Such a drawing mode is set by pressing the button of the pointing device 10a or the like. If the drawing mode is selected, a line is drawn on the projection surface. If the drawing mode is not selected, an operation for designating a predetermined position on the projection surface is performed.

  The information processing apparatus 200 includes a reception unit 210, a state change rate storage unit 120, a state processing unit 230, an image generation unit 240, an acceleration determination unit 250, and a mode management unit 260. The receiving unit 210 receives device information from the pointing device 10a via the projection device 20. More specifically, the receiving unit 210 receives device information including the pointing position and acceleration information from the projection device 20 and mode information indicating whether or not the drawing mode is set.

  The acceleration determination unit 250 determines whether or not the acceleration information of the pointing device 10a within a certain time matches a predetermined acceleration pattern. The predetermined time is, for example, within 2 seconds. FIG. 9 is a diagram for explaining an example of an acceleration pattern according to the second embodiment. As shown in FIG. 9, in the acceleration pattern, the acceleration “α” is repeated a prescribed number of times in the order of “α = 0”, “α> 0”, “α <0”, “α = 0” within 2 seconds. It is a pattern. That is, the acceleration determination unit 250 determines that the acceleration information within 2 seconds matches the acceleration pattern when the locus of the projection plane within 2 seconds is shown on the left side of FIG. Then, the acceleration determination unit 250 notifies the state processing unit 230 of the determination result. As a result, the processing described later changes the state of the pointing mark as shown on the right side of FIG. 9 and erases the trace drawn within a fixed time when not in the drawing mode.

  The state processing unit 230 specifies state change information corresponding to the projection size when the acceleration determination unit 250 determines that the acceleration information of the pointing device 10a within a certain period of time matches the acceleration pattern. More specifically, the state processing unit 230 receives a determination result from the acceleration determination unit 250. Then, when the determination result is a determination that matches the acceleration pattern, the state processing unit 230 acquires the projection size from the state change rate storage unit 120 and calculates a state change rate suitable for the acquired projection size. Identify the rate of state change. The state change rate is, for example, an enlargement rate. That is, the state change rate as the enlargement rate may be set to a larger value as the projection size is larger in order to obtain a state change rate suitable for the projection size.

The mode management unit 260 manages the current mode based on the mode determination result received by the reception unit 210. The image generation unit 240 generates a projection image in which a pointing mark corresponding to the state change rate specified by the state processing unit 230 is arranged at the pointing position included in the device information received by the reception unit 210. More specifically, the image generation unit 240 generates a projection image in which a pointing mark enlarged according to the state change rate is arranged at the position of the coordinate (x ₁ , y ₁ ) of the pointing position. However, the image generation unit 240 acquires the current mode from the mode management unit 260, and generates a projection image in which the drawn locus is deleted when the acquired mode is not the drawing mode. That is, when the acceleration information of the pointing device 10a matches the acceleration pattern instead of the drawing mode, the user has operated the pointing device 10a to confirm the pointing position. To do. Even in the drawing mode, it is possible to set the locus to be deleted in advance. Then, the image generation unit 240 transmits the generated projection image to the projection device 20.

[Processing sequence between apparatuses according to Embodiment 2]
Next, the flow of processing by the projection system 1 according to Embodiment 2 will be described with reference to FIG. FIG. 10 is a sequence diagram illustrating an example of a processing flow by the projection system 1 according to the second embodiment.

  As shown in FIG. 10, when receiving a user operation (step S301), the display position detector 11 requests acceleration information from the acceleration detector 13 (step S302). The acceleration detection unit 13 detects the acceleration of the pointing device 10a, and notifies the display position detection unit 11 of the detected acceleration as acceleration information (step S303). Further, the display position detection unit 11 detects the pointing position on the projection plane, and transmits device information including the coordinate information on the projection plane of the detected pointing position and the notified acceleration information to the projection apparatus 20 ( Step S304). In addition, the operation determination unit 21 receives device information and transmits the received device information to the information processing apparatus 200 (step S305).

  In addition, the reception unit 210 receives the device information, notifies the acceleration determination unit 250 of the acceleration information included in the device information (step S306), and outputs the pointing position coordinate information included in the device information as the image generation unit 240. (Step S307). The acceleration determination unit 250 determines whether or not the acceleration information notified from the reception unit 210 matches the acceleration pattern (step S308). Then, the acceleration determination unit 250 notifies the state processing unit 230 of the determination result (step S309).

  When the determination result matches the acceleration pattern, the state processing unit 230 acquires the projection size from the state change rate storage unit 120 (step S310). Then, the state processing unit 230 calculates a state change rate suitable for the acquired projection size (step S311). Thereafter, the state processing unit 230 notifies the image generation unit 240 of the calculated state change rate (step S312).

  The image generation unit 240 makes an acquisition request for the current mode to the mode management unit 260 (step S313). The mode management unit 260 notifies the image generation unit 240 of the current mode as a response to the acquisition request (step S314). In addition, the image generation unit 240 generates a projection image in which a pointing mark corresponding to the state change rate notified from the state processing unit 230 is arranged at the position of the coordinate information of the pointing position notified from the reception unit 210 (step) S315). At this time, if the current mode is not the drawing mode, the image generation unit 240 generates a projection image in which the drawn locus is deleted. Then, the image generation unit 240 transmits the generated projection image to the projection device 20 (step S316). Thereby, the projection unit 22 receives the projection image and projects the received projection image on the projection plane (step S317).

[Image Processing Flow According to Second Embodiment]
Next, the flow of image processing according to the second embodiment will be described with reference to FIG. FIG. 11 is a flowchart illustrating an example of the flow of image processing according to the second embodiment. Note that image processing mainly refers to processing by the information processing apparatus 200.

  As shown in FIG. 11, when device information is received from the pointing device 10a via the projection device 20 by the receiving unit 210 (step S401: Yes), whether or not the acceleration determining unit 250 has received acceleration information. Is determined (step S402). At this time, when it is determined that the acceleration information is received by the acceleration determination unit 250 (step S402: Yes), the time measurement is started (step S403) and the measurement of the acceleration is started (step S404). In addition, when the reception unit 210 has not received device information (step S401: No), the reception unit 210 waits for reception of the device information. When the acceleration determination unit 250 determines that acceleration information is not received (step S402: No), the process of step S401 is executed again.

  Here, when a fixed time such as 2 seconds has not elapsed since the start of time measurement (step S405: No), the acceleration determination unit 250 compares the acceleration information with the acceleration pattern (step S406). At this time, when it is determined by the acceleration determination unit 250 that the acceleration pattern matches (step S407: Yes), the state processing unit 230 calculates a state change rate suitable for the projection size (step S408). If a certain time such as 2 seconds has elapsed from the start of time measurement (step S405: Yes), the certain time has passed without the acceleration information matching the acceleration pattern. Is executed again. If it is determined that the acceleration information does not match the acceleration pattern (step S407: No), the process of step S405 is executed again, and the acceleration information and the acceleration pattern are compared until a certain time elapses. Executed.

  Further, the image generation unit 240 acquires the current mode from the mode management unit 260, and determines whether or not the current mode is a drawing mode (step S409). Then, when the current mode is not the drawing mode (step S409: No), the image generation unit 240 reflects the state change rate calculated by the state processing unit 230 on the coordinates of the pointing position included in the device information. A projection image in which the pointing marks are arranged is generated (step S410). Note that the projection image generated at this time is a projection image from which the locus has been deleted. On the other hand, when the current mode is the drawing mode (step S409: Yes), the image generation unit 240 generates a projection image by normal processing (step S411).

[Effects of Embodiment 2]
As described above, the information processing apparatus 200 sets the projection size when the acceleration information of the pointing device 10a within a certain time matches the acceleration pattern that appears when the user operates to recognize the pointing position. Accordingly, a projection image in which the size of the pointing mark is changed is generated, so that the operability of drawing using a pointing device can be improved.

(Embodiment 3)
In the first embodiment, the case where the state of the pointing mark is changed according to the device distance has been described. However, the state of the pointing mark can be changed according to the coordinate displacement of the pointing position. In the third embodiment, a case where the state of the pointing mark is changed according to the coordinate displacement of the pointing position will be described.

[Apparatus configuration according to Embodiment 3]
The configuration of the information processing apparatus according to the third embodiment will be described with reference to FIG. FIG. 12 is a functional block diagram illustrating a configuration example of the information processing apparatus according to the third embodiment. In FIG. 12, in addition to the information processing apparatus 300, the pointing device 10 and the projection apparatus 20 are also illustrated. In the third embodiment, the same components as those in the first or second embodiment are denoted by the same reference numerals, and detailed description of the same components may be omitted. In the third embodiment, functions, configurations, and processes other than the reception unit 310, the state processing unit 330, the image generation unit 340, and the coordinate displacement determination unit 370 described below are the same as those in the first or second embodiment.

  As illustrated in FIG. 12, the information processing device 300 includes a reception unit 310, a state change rate storage unit 120, a state processing unit 330, an image generation unit 340, a mode management unit 260, and a coordinate displacement determination unit 370. Have The receiving unit 310 receives device information from the pointing device 10 via the projection device 20. More specifically, the reception unit 310 receives device information including a pointing position from the projection device 20 and mode information indicating whether or not the drawing mode is set.

  The coordinate displacement determination unit 370 acquires the pointing position from the reception unit 310, and the coordinate displacement information indicating the displacement of the coordinate of the pointing position on the projection plane of the pointing device 10 within a certain time matches the predetermined coordinate displacement pattern. It is determined whether or not to do. The predetermined time is, for example, within 2 seconds. FIG. 13 is a diagram for explaining an example of a coordinate displacement pattern according to the third embodiment. 14A and 14B are diagrams illustrating examples of coordinate displacement patterns according to the third embodiment. As shown in the left side of FIG. 13 and FIG. 14A, the coordinate displacement pattern has a coordinate displacement “dx” of “dx: +++ 0−” and a coordinate displacement “dy” of “dy: +++ 0” within 2 seconds. “-” Is a pattern that is repeated multiple times. That is, the coordinate displacement in which dx monotonously increases (or monotonically decreases) and dy monotonously decreases (or monotonically increases) within a certain time is repeated.

  Similarly, as shown in the right side of FIG. 13 and FIG. 14B, the coordinate displacement pattern has a coordinate displacement “dx” of “dx: +++ 0−−” and a coordinate displacement “dy” of “dy: within 2 seconds. It is a pattern that is repeated multiple times as “−0 + +”. That is, the coordinate displacement in which dx is monotonously increased from monotonically decreasing (or monotonically decreasing to monotonically increasing) and dy is monotonically decreasing to monotonically increasing (or monotonically increasing to monotonically decreasing) within a certain time is repeated.

  That is, the coordinate displacement determination unit 370 matches the coordinate displacement information within 2 seconds with the coordinate displacement pattern when the locus of the projection plane within 2 seconds is shown on the left side of FIG. 13 or the right side of FIG. Judged as having done. Then, the coordinate displacement determination unit 370 notifies the determination result to the state processing unit 330. As a result, the processing described later changes the state of the pointing mark as shown in the lower part of FIG. 13 and erases the trace drawn within a predetermined time when not in the drawing mode.

  When the coordinate displacement determination unit 370 determines that the coordinate displacement information of the pointing device 10 within a certain period of time matches the coordinate displacement pattern, the state processing unit 330 specifies a state change rate corresponding to the projection size. More specifically, the state processing unit 330 acquires the projection size from the state change rate storage unit 120 when the determination result is a determination that matches the coordinate displacement pattern, and the state change rate suitable for the acquired projection size. The state change rate is specified by calculating. The state change rate is, for example, an enlargement rate. That is, the state change rate as the enlargement rate may be set to a larger value as the projection size is larger in order to obtain a state change rate suitable for the projection size.

The image generation unit 340 generates a projection image in which a pointing mark corresponding to the state change rate specified by the state processing unit 330 is arranged at the pointing position included in the device information received by the reception unit 310. More specifically, the image generation unit 340 generates a projection image in which a pointing mark enlarged according to the state change rate is arranged at the coordinate (x ₁ , y ₁ ) of the pointing position. However, the image generation unit 340 acquires the current mode from the mode management unit 260, and when the acquired mode is not the drawing mode and the coordinate displacement information of the pointing device 10 matches the coordinate displacement pattern, the user Since the pointing device 10 has been operated to confirm the pointing position, the trajectory up to that point is deleted. Even in the drawing mode, it is possible to set the locus to be deleted in advance. Then, the image generation unit 340 transmits the generated projection image to the projection device 20.

[Processing sequence between apparatuses according to Embodiment 3]
Next, the flow of processing by the projection system 1 according to Embodiment 3 will be described with reference to FIG. FIG. 15 is a sequence diagram illustrating an example of a processing flow by the projection system 1 according to the third embodiment.

  As shown in FIG. 15, when receiving a user operation (step S501), the display position detection unit 11 detects a pointing position on the projection plane, and displays device information including coordinate information on the projection plane of the detected pointing position. It transmits with respect to the projection apparatus 20 (step S502). In addition, the operation determination unit 21 receives device information and transmits the received device information to the information processing apparatus 300 (step S503).

  In addition, the reception unit 310 receives the device information, notifies the coordinate information of the pointing position included in the device information to the coordinate displacement determination unit 370 (step S504), and also notifies the image generation unit 340. (Step S505). The coordinate displacement determination unit 370 confirms the history of coordinate displacement up to that point in consideration of the coordinate information notified from the reception unit 310, and determines whether the coordinate information matches the coordinate displacement pattern (step S506). Then, the coordinate displacement determination unit 370 notifies the determination result to the state processing unit 330 (step S507). In addition, the coordinate displacement determination unit 370 updates the coordinate displacement history (step S508).

  The state processing unit 330 acquires the projection size from the state change rate storage unit 120 when the pattern matches the coordinate displacement pattern (step S509). Then, the state processing unit 330 calculates a state change rate suitable for the acquired projection size (step S510). Thereafter, the state processing unit 330 notifies the image generation unit 340 of the calculated state change rate (step S511).

  The image generation unit 340 makes an acquisition request for the current mode to the mode management unit 260 (step S512). The mode management unit 260 notifies the image generation unit 340 of the current mode as a response to the acquisition request (step S513). In addition, the image generation unit 340 generates a projection image in which a pointing mark corresponding to the state change rate notified from the state processing unit 330 is arranged at the position of the coordinate information of the pointing position notified from the reception unit 310 (step S514). At this time, if the current mode is not the drawing mode, the image generation unit 340 generates a projection image in which the drawn locus is deleted. Then, the image generation unit 340 transmits the generated projection image to the projection device 20 (step S515). Thereby, the projection unit 22 receives the projection image and projects the received projection image on the projection plane (step S516).

[Image Processing Flow According to Embodiment 3]
Next, the flow of image processing according to the third embodiment will be described with reference to FIG. FIG. 16 is a flowchart illustrating an example of the flow of image processing according to the third embodiment. Note that image processing mainly refers to processing by the information processing apparatus 300.

  As illustrated in FIG. 16, when the reception unit 310 receives device information from the pointing device 10 via the projection device 20 (step S601: Yes), the coordinate displacement determination unit 370 determines whether there is a coordinate displacement. Is determined (step S602). At this time, when the coordinate displacement determination unit 370 determines that there is a coordinate displacement (step S602: Yes), time measurement is started (step S603) and measurement of the coordinate displacement is started (step S604). Further, when the receiving unit 310 has not received device information (step S601: No), the receiving unit 310 waits for receiving device information. If the coordinate displacement determination unit 370 determines that there is no coordinate displacement (step S602: No), the process of step S601 is executed again.

  Here, when a certain time such as 2 seconds has not elapsed since the start of time measurement (step S605: No), the coordinate displacement determination unit 370 compares the coordinate displacement information including the history with the coordinate displacement pattern (step S605). S606). At this time, when it is determined by the coordinate displacement determination unit 370 that the coordinate displacement pattern matches (step S607: Yes), the state processing unit 330 calculates a state change rate suitable for the projection size (step S608). If a certain time such as 2 seconds has elapsed from the start of timekeeping (step S605: Yes), the certain time has passed without the coordinate displacement information matching the coordinate displacement pattern, and therefore step S601. The process is executed again. If it is determined that the coordinate displacement information does not match the coordinate displacement pattern (step S607: No), the process of step S605 is executed again, and the coordinate displacement information and the coordinate displacement pattern are kept until a certain time elapses. A comparison with is performed.

  In addition, the image generation unit 340 acquires the current mode from the mode management unit 260 and determines whether or not the current mode is a drawing mode (step S609). Then, when the current mode is not the drawing mode (step S609: No), the image generation unit 340 reflects the state change rate calculated by the state processing unit 330 on the position of the pointing position coordinate included in the device information. A projection image in which the pointing mark is placed is generated (step S610). Note that the projection image generated at this time is a projection image from which the locus has been deleted. On the other hand, when the current mode is the drawing mode (step S609: Yes), the image generation unit 340 generates a projection image by normal processing (step S611).

[Effects of Embodiment 3]
As described above, the information processing apparatus 300 performs projection when the coordinate displacement information of the pointing device 10 within a certain time matches the coordinate displacement pattern that appears when the user operates to recognize the pointing position. Since the projection image in which the size of the pointing mark is changed according to the size is generated, the operability of the drawing using the pointing device can be improved.

(Embodiment 4)
The embodiment of the projection system 1 having the information processing apparatus 100, the information processing apparatus 200, and the information processing apparatus 300 according to the present invention has been described so far, but in various different forms other than the above-described embodiment. It can be implemented. Therefore, different embodiments will be described with respect to (1) pointing mark projection plane occupancy, (2) pointing mark state change, (3) configuration, and (4) program.

(1) Projection plane occupancy ratio of pointing mark In the first to third embodiments, if the distance is large or a large size according to the distance from the projection plane to the pointing device or the size of the projection size, the enlargement ratio The case where the state change rate is set to a large value has been described. In the present invention, the state change rate can be further controlled so that the size of the pointing mark is appropriate. The state change rate is controlled according to the projection mark occupation ratio of the pointing mark.

FIG. 17 is a diagram for explaining the projection plane occupation ratio of the pointing marks. As shown in FIG. 17, the projection plane occupancy rate is a projection size “S” determined from a projection distance input in advance, and a pointing mark size “S ′” dynamically determined by a change in the state of the pointing mark. The ratio is “S ′ / S (S _ratio )”. A process for controlling the state change rate according to the projection plane occupation rate will be described below.

  FIG. 18 is a diagram illustrating an example of information (1) stored in the state change rate storage unit 120 when the state change rate is controlled according to the projection plane occupation ratio. In the example shown in FIG. 18, when a predetermined threshold is provided for the projection plane occupancy determined for each projection size and the projection plane occupancy is equal to or greater than the predetermined threshold, the state change rate when the projection plane occupancy is less than the predetermined threshold is This represents a case where state change rates with different regulations are stored.

For example, if the predetermined threshold value of the projection plane occupancy is set to “S _{ratio-critical} = 50”, the projection plane occupancy becomes “S ′ / S ₁₀ = 0.5” or more from the point in time. The rate of change of state at the shaded area is adopted. For example, when the projection distance is “l ₂ = 10”, that is, the projection size is “S = S ₁₀ ”, and the device distance is “l ₁ = 20”, the state change rate is “R ′”. ₂₀ ". “R ′ ₂₀ ” is a value different from “R ₂₀ ”, and for example, “R ′ ₂₀ <R ₂₀ ”. That is, if the pointing mark is enlarged too much, the operability of the pointing device 10 by the user may be deteriorated. Therefore, the deterioration of the operability is suppressed by making the enlargement rate gentler than before. .

  FIG. 19 is a diagram illustrating an example (2) of information stored in the state change rate storage unit 120 when the state change rate is controlled in accordance with the projection plane occupation ratio. In the example illustrated in FIG. 19, when a predetermined threshold is provided for the projection plane occupancy determined for each projection size and the projection plane occupancy is equal to or greater than the predetermined threshold, the state change rate when the projection plane occupancy is less than the predetermined threshold is This represents a case where state change rates with different regulations are stored.

For example, if the predetermined threshold value of the projection plane occupancy is set to “S _{ratio-critical} = 50”, the projection plane occupancy becomes “S ′ / S ₁₀ = 0.5” or more from the time point shown in FIG. The rate of change of state at the shaded area is adopted. That is, for example, when the projection distance is “l ₂ = 10”, that is, when the projection size is “S = S ₁₀ ”, and the device distance is “l ₁ = 20”, the state change rate is “ -(Does not exist) ". That is, if the pointing mark is enlarged too much, the operability of the pointing device 10 by the user may be deteriorated. Therefore, the deterioration of the operability is suppressed by preventing further enlargement.

(2) State change of pointing mark In the first to third embodiments, the state change of the pointing mark has been described as being enlarged. However, in the present invention, in addition to enlargement, transmission, blinking, color change, luminance You may give at least one of a change and a brightness change.

  FIG. 20 is a diagram illustrating a case where the pointing mark is transmitted. As shown in FIG. 20, if the pointing mark is enlarged too much, it becomes difficult to see characters and pictures displayed on the projection plane. If the projection plane occupancy is equal to or greater than a predetermined threshold, the pointing mark is displayed. Make it transparent. At this time, enlargement may be performed while transmitting. That is, in the same manner as the above-described transmission processing, blinking, color change, luminance change, brightness change, and the like may be performed.

  FIG. 21 is a diagram for explaining a temporary state change of the pointing mark. As shown on the left side of FIG. 21, if the state of the pointing mark is constantly changed, the operability may be deteriorated. For example, when it is desired to add an underline to a specific location, there is a possibility that a fine operation becomes difficult. In such a case, as shown in the right side of FIG. 21, when drawing is detected, the pointing mark is reduced, for example, the state is changed to an easily operable state. About the state after a change, you may make it a default shape and you may set a value separately.

(3) Configuration In addition, information including processing procedures, control procedures, specific names, various data, parameters, and the like shown in the document and drawings can be arbitrarily changed unless otherwise specified. For example, the acceleration pattern and the coordinate displacement pattern are not limited to the above example, and can be changed as appropriate.

  Further, each component of each illustrated apparatus is functionally conceptual, and does not necessarily need to be physically configured as illustrated. In other words, the specific form of distribution or integration of each device is not limited to the one shown in the figure, and all or a part thereof is functionally or physically distributed in arbitrary units according to various burdens or usage conditions. Or they can be integrated. For example, the state processing unit 230 and the acceleration determination unit 250 may be integrated as an “acceleration state processing unit” that determines an acceleration pattern and calculates a state change rate suitable for matching the acceleration pattern.

(4) Program The information processing apparatus according to the present embodiment includes a control device such as a CPU, a storage device such as a ROM (Read Only Memory) and a RAM, an external storage device such as an HDD and a CD drive device, and a display device. Etc. and an input device such as a keyboard and a mouse, and has a hardware configuration using a normal computer.

  The image processing program executed by the information processing apparatus according to the present embodiment is a file in an installable format or an executable format, and is a CD-ROM, flexible disk (FD), CD-R, DVD (Digital Versatile Disk). Or the like recorded on a computer-readable recording medium.

  The image processing program executed by the information processing apparatus according to the present embodiment may be stored on a computer connected to a network such as the Internet and provided by being downloaded via the network. . The image processing program executed by the information processing apparatus according to the present embodiment may be configured to be provided or distributed via a network such as the Internet. Further, the image processing program executed by the information processing apparatus according to the present embodiment may be provided by being incorporated in advance in a ROM or the like.

  The image processing program executed by the information processing apparatus according to the present embodiment has a module configuration including the above-described units (state processing unit 130 and image generation unit 140), and the actual hardware is a CPU (processor). ) Reads out and executes the image processing program from the storage medium, whereby the above-described units are loaded onto the main storage device, and the state processing unit 130 and the image generation unit 140 are generated on the main storage device. Yes.

DESCRIPTION OF SYMBOLS 10 Pointing device 11 Display position detection part 12 Distance information detection part 20 Projection apparatus 21 Operation determination part 22 Projection part 100 Information processing apparatus 110 Reception part 120 State change rate memory | storage part 130 State processing part 140 Image generation part

JP 2008-066552 A

Claims (8)

A projection distance representing a distance from the projection plane onto which the projection image is projected by the projection apparatus to the projection apparatus, and a distance from the projection plane to an instruction device for operating an instruction image representing an instruction position in the projection image A state change storage unit that stores state change information representing information for changing the state of the instruction image in association with an instruction device distance representing
A state processing unit for identifying the state change information from the preset projection distance and the pointing device distance included in the device information related to the pointing device ;
An image generation unit that generates the projection image in which the instruction image according to the specified state change information is arranged at the instruction position included in the device information. An acceleration determination unit that determines whether or not the acceleration information of the pointing device within a certain period of time matches a predetermined acceleration pattern;
Wherein the state processing unit, when the acceleration information in a given time by the acceleration determination unit determines that matches the acceleration pattern, a distance information included in the device information, determined according to the projection distance The information processing apparatus according to claim 1, wherein the state change information corresponding to a projection size indicating a size of the projection plane is specified. A coordinate displacement determination unit that determines whether or not coordinate displacement information indicating a displacement of coordinates of the designated position on the projection plane of the pointing device within a predetermined time matches a predetermined coordinate displacement pattern; ,
Wherein the state processing unit, when the coordinate displacement information within a given time by the coordinate displacement determination unit determines matches the coordinate displacement pattern, a distance information included in the device information, the projection distance The information processing apparatus according to claim 1, wherein the state change information corresponding to a projection size indicating a size of the projection plane determined according to the specification is specified. The state change storage unit is in a state corresponding to a case where a projection plane occupancy ratio representing a ratio of the instruction image size indicating the size of the instruction image to a projection size indicating the size of the projection plane is equal to or larger than a predetermined threshold. The information processing apparatus according to claim 1 , wherein change information that is different from the state change information corresponding to a case where the change information is less than a predetermined threshold is stored. The image generation unit, when the current mode of the instruction device is not a mode for drawing a locus of the instruction image, claim 2, characterized in that to generate the projection image to erase the drawn trace Or the information processing apparatus of 3 . The image generation unit is an enlarged, transparent, flashing, color change, processing according to any one of claims 1-5, characterized in that performing at least one of the luminance change and brightness change to the instruction image apparatus. Computer
A projection distance representing a distance from the projection plane onto which the projection image is projected by the projection apparatus to the projection apparatus, and a distance from the projection plane to an instruction device for operating an instruction image representing an instruction position in the projection image A state change storage unit that stores state change information indicating information for changing the state of the instruction image in association with the instruction device distance indicating
In the computer,
Identifying the state change information from the preset projection distance and the pointing device distance included in the device information related to the pointing device ;
Generating the projection image in which the instruction image corresponding to the specified state change information is arranged at the instruction position included in the device information;
An image processing program for execution. A projection system having an instruction device, an information processing apparatus, and a projection apparatus,
The pointing device is
A detection unit that detects device information related to the pointing device for operating the pointing image representing the pointing position in the projection image projected on the projection plane;
The information processing apparatus includes:
Represents information for changing the state of the instruction image in association with the projection distance representing the distance from the projection plane to the projection apparatus and the instruction device distance representing the distance from the projection plane to the instruction device. A state change storage unit for storing state change information;
A state processing unit that identifies the state change information from the preset projection distance and the instruction device distance included in the device information;
An image generation unit that generates the projection image in which the instruction image according to the specified state change information is arranged at the instruction position included in the device information;
The projector is
A projection system comprising: a projection unit that projects the generated projection image onto the projection plane.

Images