JP5088192B2 - Drawing apparatus and program - Google Patents

Description

  The present invention relates to a drawing apparatus and a program.

Based on the input coordinate and the calculated coordinate position, the input detection unit that detects the input of the coordinate to the display surface, the position calculation unit that calculates the position of the input coordinate, and the same coordinate position on the display surface The touch determination unit that determines that the input state (touch state) is maintained and the input start and end events (click event) within the predetermined time interval to the same coordinate position on the display surface have occurred When it is determined that the input to a certain coordinate position is in a touch state by the click determining unit and the touch determining unit, and the click determining unit determines that a click event to another coordinate position has occurred, An apparatus including a display control unit that displays a toolbar assigned with a predetermined function is disclosed in Patent Document 1.
JP 2002-91649 A

  Provided are an apparatus and a program capable of presenting an interface screen or the like in a user operable range.

The invention according to claim 1 is a drawing apparatus, wherein drawing means for drawing drawing contents based on a user's operation on a screen, estimation means for estimating a user's operable range on the screen, and the estimation the operable range that is, seen containing a display unit, the displaying the input screen image for receiving an instruction operation of a user, the estimating means estimates the length of the user's arm, the arm that the estimated length And a virtual sphere that represents the reach of each arm of the user based on the distance between the user and the screen, finds a cross circle between the virtual sphere and the screen, This is estimated as the operable range of the operator .

The invention according to claim 2 is the drawing apparatus according to claim 1, wherein the estimation means estimates each operable range for a plurality of users, and the display means can perform each estimated operation. In the range, an input screen image that accepts a user's instruction operation is displayed within an operable range with the largest area.

Invention of Claim 3 is a program, Comprising: The drawing means which draws the drawing content based on a user's operation on a screen, The estimation means which estimates the user's operable range on a screen, In the estimated operable range, function as display means for displaying an input screen image that accepts a user instruction operation, and when functioning as the estimation means, estimate the length of the user's arm, Based on the estimated length of the arm and the distance between the user and the screen, a virtual sphere representing the reach of each arm of the user is generated, and an intersection circle between the virtual sphere and the screen is found, The inside of the cross circle is estimated as the operable range of the operator .

According to the first or third aspect of the invention, the operable range can be determined within the reach of the user's hand.

  According to invention of Claim 2, it can respond to a some user.

  Embodiments of the present invention will be described with reference to the drawings. As illustrated in FIG. 1, the drawing device 1 according to the embodiment of the present invention includes a control unit 11, a storage unit 12, a drawing unit 13, an operation unit 14, and a user detection unit 15. It is configured.

  Here, the control unit 11 is a program control device such as a CPU (Central Processing Unit) and operates according to a program stored in the storage unit 12. The control unit 11 executes a drawing process for drawing the drawing content based on the user's operation on the screen of the drawing unit 13. Further, the control unit 11 estimates the user's operable range on the screen based on the detection result of the user detecting unit 15, and inputs the user's instruction operation into the estimated operable range. A process for displaying a screen image is executed. Detailed contents of the processing of these control units 11 will be described later.

  The storage unit 12 includes a memory element such as a RAM (Random Access Memory). The storage unit 12 stores a program executed by the control unit 11. This program may be provided by being stored in a computer-readable recording medium such as a DVD-ROM and copied to the storage unit 12. The storage unit 12 also operates as a work memory for the control unit 11.

  The drawing unit 13 includes a screen for displaying drawing contents, such as a display such as a liquid crystal display or plasma, or a projector and a screen. When the user touches the screen of the drawing unit 13 with a pen or a finger, the operation unit 14 detects the touched position and outputs information representing the detected position. The operation unit 14 may be, for example, a touch panel arranged on the screen of the drawing unit 13. In addition, the operation unit 14 may be configured to capture a finger touching the screen of the drawing unit 13 with a plurality of cameras or the like, and generate and output information indicating the position.

  The user detection unit 15 includes a sensor such as a camera, for example, and detects the position of the user's head using a person located within a predetermined distance from the screen of the drawing unit 13 as a user. For this head detection, a device that detects a moving circular object as a human head from a captured image can be used. The user detection unit 15 outputs the detected position of the user's head as a value in a predetermined coordinate system.

  As an example, as illustrated in FIG. 2A, the user detection unit 15 uses the intersection of the line segment extending the screen left end of the drawing unit 13 vertically downward and the floor as the origin O, and the drawing unit 13 The position coordinate of the user's head is output in a coordinate system in which the right direction on the screen is the X axis, the upper direction is the Y axis, and the front direction perpendicular to the screen is the Z axis (FIG. 2B).

  Next, the content of the process by the control part 11 is demonstrated. When the user touches the screen of the drawing unit 13 with a pen or a finger, the control unit 11 acquires information representing the touched position from the operation unit 14 and draws a circle of a set size at the position. To do.

  Further, the control unit 11 acquires the position coordinates of the user's top detected by the user detection unit 15, and based on the value of the position coordinates, the position of the user's shoulder, the length of the user's arm, Is estimated.

  As an example, a table (standard table) in which the sizes of a standard sternal upper edge height (A), shoulder width (B), and upper limb length (C) with respect to human height are recorded in association with each other is stored in the storage unit 12. (FIG. 3B). Here, as shown in FIG. 3A, the sternum upper edge height (A) is the length from the top of the head to the center of the shoulder, and the shoulder peak width (B) is the distance between the centers of both shoulders. The upper limb length (C) represents the length from the center of the shoulder to the tip of the arm (tip of finger). For example, Makiko Kawachi, Masaaki Mochimaru, Hiroshi Iwasawa, Seiji Mitani (2000): Japanese human body size database 1997-98; That's fine.

  The control unit 11 reads the value of y corresponding to the top height (ie, height) from the coordinates (x, y, z) of the top of the user input from the user detection unit 15. Then, the sternum upper edge height A (y), shoulder width B (y), and upper limb length C (y) corresponding to the value of y are acquired from the standard table.

The control unit 11 calculates the estimated position coordinate L of the left shoulder and the estimated position coordinate R of the right shoulder as L (x−B / 2, y−A (y), z).
R (x + B / 2, y−A (y), z)

And calculate. That is, here, it is assumed that the user is facing the screen of the drawing unit 13.

Then, the control unit 11 generates an expression representing two phantom spheres SL and SR having a radius C centered on the estimated position coordinates L and R of both shoulders. The control unit 11 uses these virtual spheres SL and SR to obtain an intersection set with the plane expression (Z = 0) representing the screen of the drawing unit 13. Since this is the intersection of the sphere and the plane, this solution is
(1) None (real solution) (2) Points (3) Yen

One of them. When the solution of the point or circle is obtained here, the control unit 11 estimates the point or the inside of the circle as the operable range on the user's screen.

  And the control part 11 displays the input screen image which receives a user's instruction | indication operation inside this operable range (for example, the center is located in the center of the operable range).

  Here, the input screen image is a toolbar having a function of setting the pen size, color, and the like (in accordance with this example, the input screen image is hereinafter referred to as a toolbar). The user performs operations such as setting the pen size and color, or holding the image data drawn on the drawing unit 13 as a file on a recording medium by performing an operation on the toolbar.

  The drawing apparatus 1 according to the present embodiment has the above-described configuration and performs the following operation. When the user approaches the screen of the drawing unit 13 up to a predetermined distance, the drawing apparatus 1 according to the present embodiment starts the processing shown in FIG. 4 and detects the position coordinates of the user's top of the head ( S1). The drawing apparatus 1 estimates information on the position of the shoulder and the length of the arm from the position coordinates of the top of the head with reference to information related to the standard physique of the human (S2). Then, a virtual sphere having a radius equal to the length of each arm is set with the estimated position of both shoulders as the center (S3).

  As illustrated in FIG. 5, the drawing apparatus 1 obtains a range of virtual points or virtual circles Ic created by intersecting the virtual sphere S and the screen of the drawing unit 13 (S4). In order for the user to touch the peripheral line (or point) of the virtual circle or the like, the user has to extend his arm fully (that is, the user must move to touch the outside). This is the estimated boundary line. Actually, here, since two spheres are drawn centering on both shoulders when it is assumed that the user is directly facing the screen of the drawing unit 13, it is generated by the intersection of the virtual sphere and the screen. A virtual circle is obtained when two small virtual circles are separated (F) when the user is relatively far from the screen, as shown in FIG. Two imaginary circles are obtained (N) such that their parts overlap.

  The drawing apparatus 1 moves and draws the screen of the toolbar near the virtual point or virtual circle obtained here (S5). At this time, for example, if two virtual circles L and R overlap each other, the screen W of the toolbar may be arranged so that the center thereof is a midpoint between the center coordinates of the virtual circle (FIG. 7A). ). Moreover, you may arrange | position so that it may become the center of any one virtual circle (it should predetermine) (FIG.7 (b), FIG.7 (c)). Further, when the virtual circle includes the peripheral edge (B) of the screen of the drawing unit 13, the toolbar screen W may be arranged so as to be in contact with the peripheral edge (B) (FIG. 7D). Also, if a place where at least a part of the virtual circle crosses and the toolbar screen W is not overlapped with a figure or the like drawn in the screen is found, the toolbar screen W is placed in such a place. May be arranged.

  The drawing apparatus 1 according to the present embodiment may perform the above processing repeatedly, and draw the toolbar screen within the reach of the user's arm at the destination whenever the user moves. Further, after drawing the toolbar screen in the process S5 of FIG. 6, it is checked whether or not at least a part of the toolbar screen intersects the virtual point or virtual circle determined in the process S4. The drawing position may not be moved. If it is determined that they do not intersect, step S5 may be executed to move the toolbar screen to a position that intersects the virtual point or virtual circle.

  Further, in this case, when it is determined that the vehicle does not intersect and waits for a predetermined waiting time, until the waiting time elapses, when the virtual point or the virtual circle is never intersected, the process S5 is executed, The screen of the toolbar may be moved to a position that intersects the virtual point or virtual circle.

  Also, after displaying the toolbar screen in step S5, when the virtual point or virtual circle disappears on the screen due to the user leaving the screen or the like, the virtual point or virtual circle is finally found until the next time it is found. The toolbar may continue to be displayed at the displayed position.

[Multiple users]
In the above description, the case where there is a single user has been described as an example. However, even when there are a plurality of users, if the top of each head can be detected, a virtual point or virtual A circle may be defined on the screen and the above-described processing may be performed. At this time, the virtual circle radii r1, r2... (That is, the area of the virtual circle) on the screen generated for each user 1, 2,. Is identified. Then, the toolbar screen is arranged so as to at least partially overlap the virtual circle of the user whose radius (area) is maximum.

  In this case, after drawing the toolbar screen, check whether or not at least a part of the toolbar screen still intersects with the virtual circle with the largest radius (area). May not move the drawing position. When it is determined that the virtual circle having the largest radius (area) has not intersected, the toolbar screen can be moved to a position intersecting the virtual circle having the largest radius (area). Good.

  Furthermore, in this case, when it is determined that it will not intersect, it waits for a predetermined waiting time, and when the radius (area) does not intersect with the maximum virtual circle once until the waiting time elapses, The screen of the tool bar may be moved to a position intersecting with a virtual circle having the maximum radius (area).

[Use drawing position]
In the description so far, it is assumed that the user is facing the screen (FIG. 8A). For this reason, it has been estimated that the virtual circle formed by the virtual sphere centering on the position of each shoulder intersecting the screen has the same radius (FIG. 8C). In practice, however, the user brings the drawing shoulder closer to the screen (FIG. 8B). Therefore, the drawing apparatus 1 according to the present embodiment detects a drawing position (a point where a pen, a finger, or the like is in contact) output from the operation unit 14, and which of the two virtual circles includes the position. Check out. Then, the radius of the virtual circle on the included side is set larger than the virtual circle on the non-included side. For example, the radius of the included virtual circle may be α (α> 1) times the original radius, and the radius of the non-included virtual circle may be β (β <1) times the original radius. Good. As a result, the radius of the virtual circle on the shoulder side that is closer is set larger (FIG. 8D).

  Also in this case, the drawing apparatus 1 arranges the toolbar screen so as to intersect the virtual circle having the maximum radius.

[Personal database]
Furthermore, the drawing apparatus 1 of the present embodiment may acquire and use information that identifies a user. For example, the user detection unit 15 of the drawing apparatus 1 according to the present embodiment may include not only a device that detects the user's head, but also a card reader that reads a card that stores information that identifies the user. Here, the information specifying the user may include information on the gender of the user.

  In this case, the user starts the operation after having the card reader read the card. The user detection unit 15 outputs information read from the card (such as information on the gender of the user) to the control unit 11.

  Thus, in the example which distinguishes a user's sex, the standard table shown in FIG.3 (b) is stored for every sex. And the control part 11 selectively utilizes one of the standard tables for every sex according to the sex information read from the card.

  For example, when the gender information read from the card is “female”, the sternal upper edge height (A) and shoulder width (B) corresponding to the height information found from the coordinates of the top of the head from the “female” standard table ), The upper limb length (C) is read, and a virtual sphere is set.

  Furthermore, although it was set as the example which uses a card reader here, when gender information etc. can be acquired with the position of a user from the information transmitter which each user is wearing, the detection result of the top part of a plurality of users and The same process may be performed by determining the gender of each user in combination.

  In this way, when each of a plurality of users can be specified, when displaying the toolbar screen, the user corresponding to the virtual circle displaying the toolbar is specified, and a toolbar predetermined for each user is specified. The screen may be displayed.

  In addition, although a device for detecting the top of the head is essential here, the present embodiment is not limited to this. For example, if you have an information transmission device that records information including height and gender for each user, and you can identify the position on the XZ coordinate of the information transmission device (for example, on the shoe sole of each user) A wireless tag having the information recorded thereon is pasted and read by a reading device arranged in a matrix on the floor, and the position of each user on the X-Z coordinate is determined based on the reading position and the information of the wireless tag. The height and gender can be specified), the height of the sternum (A) and the ridge width (B) are read out from the height and gender of each user, and the position of both shoulders on the Y-axis is specified. The position of both shoulders on the X and Z axes is determined from the position on the X-Z coordinate of the user, and the position of both shoulders in the three-dimensional space is specified. Based on this and the height and sex of the user A virtual sphere may be set using the upper limb length (C) read out in the above.

  Further, when the user's height information is acquired from other than the position of the top of the head, the top of the head may be detected. In this case, the position on the XZ coordinate of the user obtained by the reading position of the wireless tag or the like is compared with the position on the XZ coordinate of the user obtained by detecting the top of the head. Get the coordinates of the top of the head. As a result, the coordinates of the top, height, and sex are associated with each user. The drawing apparatus 1 of the present embodiment first reads the user's sternum upper edge height (A), shoulder width (B), and upper limb length (C) from the height and gender information. Then, the drawing apparatus 1 obtains the position coordinates of both shoulders from the read sternal upper edge height (A), shoulder ridge width (B), and the coordinates of the crown. Furthermore, a virtual sphere with the upper limb length (C) as a radius from the position of both shoulders is set. In this case, the accuracy of estimating the positions of both shoulders (that is, the virtual sphere, the virtual point, and the virtual circle) can be increased even when the posture is different due to the user squatting.

  In addition, the method for detecting the position of the user's head is not limited to the method described here. For example, a sensor for detecting whether light is blocked at different heights is arranged in front of the screen. Alternatively, the position of the top of the user standing in front of the screen may be obtained by detecting up to which sensor the light is blocked.

1 is a configuration block diagram illustrating an example of a drawing apparatus according to an embodiment of the present invention. It is explanatory drawing showing the example of a setting of the coordinate system in the process of the drawing apparatus which concerns on embodiment of this invention. It is explanatory drawing showing the dimension of the user used in the process of the drawing apparatus which concerns on embodiment of this invention, and explanatory drawing showing the example of the standard table holding the dimension. It is a flowchart figure showing the process example of the drawing apparatus which concerns on embodiment of this invention. It is explanatory drawing showing the virtual sphere set by the process of the drawing apparatus which concerns on embodiment of this invention, and a virtual circle. It is explanatory drawing showing the aspect of the virtual circle calculated | required by the process of the drawing apparatus which concerns on embodiment of this invention. It is explanatory drawing showing the example of a display of the input screen image by the drawing apparatus which concerns on embodiment of this invention. It is explanatory drawing showing another aspect of the virtual circle calculated | required by the process of the drawing apparatus which concerns on embodiment of this invention.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Drawing apparatus, 11 Control part, 12 Storage part, 13 Drawing part, 14 Operation part, 15 User detection part.

Claims (3)

A drawing means for drawing the drawing content based on the user's operation on the screen;
An estimation means for estimating the operable range of the user on the screen;
Display means for displaying an input screen image for accepting a user's instruction operation in the estimated operable range;
Only including,
The estimation means estimates the length of the user's arm and generates a virtual sphere representing the reach of each arm of the user based on the estimated arm length and the distance between the user and the screen. A drawing device characterized by finding an intersection circle between the virtual sphere and the screen and estimating the inside of the intersection circle as an operable range of the operator . The estimation means estimates each operable range for a plurality of users,
2. The drawing apparatus according to claim 1, wherein the display means displays an input screen image that accepts a user's instruction operation within an operable range with the largest area among the estimated operable ranges. . Computer
A drawing means for drawing the drawing content based on the user's operation on the screen;
An estimation means for estimating the operable range of the user on the screen;
Display means for displaying an input screen image for accepting a user's instruction operation in the estimated operable range;
To function as,
When functioning as the estimation means, the length of the user's arm is estimated, and the reach of each arm of the user is represented based on the estimated arm length and the distance between the user and the screen. A program that generates a virtual sphere, finds an intersection circle between the virtual sphere and the screen, and estimates the inside of the intersection circle as an operable range of the operator .

Images