JP5643249B2 - One-stroke figure direction detector - Google Patents

Description

  The present invention relates to a one-stroke figure direction detecting device capable of detecting the direction of a one-stroke figure.

  In recent years, many display devices to which a camera and an infrared sensor are attached have appeared, and many methods for controlling contents displayed on the display device by making gestures instead of key operations on a remote controller have appeared. Among the gesture operations, a one-stroke gesture operation method that can be operated efficiently without burden on the user has been proposed (Non-Patent Document 1). In this method, the shape and direction of a single-drawn figure drawn by the user are identified, and a command is uniquely determined based on the shape and direction. Content processing suitable for the command is performed, and the result is displayed on the screen. Is displayed.

"One-stroke gesture interface with a camera suitable for menu selection on a large display", Ryosuke Aoki, Yutaka Karatsu, Masayuki Ihara, Atsuhiko Maeda, Tomoki Watanabe, Satoshi Kobayashi, Shingo Kagami: 67th Human Interface Society Meeting And General (SIG-CE-02) ", November 2010

  The direction detection function of Non-Patent Document 1 calculates the center of gravity of each coordinate of a finger that draws a one-stroke drawing obtained from the start to the end of the gesture, calculates the angle between the center of gravity and the gesture detection area, A method of determining the direction according to the angle is used. However, since the size, shape, and position of a one-stroke drawing figure differ from person to person, the above method sometimes fails to detect the direction of the one-stroke drawing figure intended by the user.

  The present invention has been made in view of the above problems, and an object of the present invention is to provide a one-stroke figure direction detection device capable of detecting the direction of a one-stroke figure.

  In order to solve the above-described problem, the present invention provides the one-stroke drawing when the one-stroke drawing is drawn in the recognition area including the gesture detection area where the drawing of the one-stroke drawing obtained by the gesture is started and ended. A one-stroke figure direction detecting device for detecting in which direction a figure is located with respect to the origin in the recognition area, and generating a one-stroke figure by filling the inside of the one-stroke figure A generating unit; an area dividing unit that divides the recognition area into a plurality of small recognition areas with a plurality of lines extending radially from the origin as boundaries; and for each of the small recognition areas, An area calculation unit for calculating the area of a portion included in the small recognition region, a region selection unit for selecting the small recognition region having the largest area, and the selected Recognition region and solutions with a single stroke graphic direction detecting apparatus characterized by comprising a direction detector for detecting whether the position in which direction relative to the origin.

  In the one-stroke drawing direction detection device, for example, in the case where the recognition region includes a plurality of pixels arranged in a matrix, and only the pixel at the position in the filled one-stroke drawing figure has a predetermined state, the area calculation unit For each of the small recognition areas, the number of pixels having the predetermined state in the small recognition area is calculated, and the area selection unit calculates the number of pixels that is the largest among the calculated number of pixels. The small recognition area corresponding to is selected.

For example, in the process of drawing a spiral line from the origin, the one-stroke figure direction detection device calculates the number of pixels at the position of the spiral line and having the predetermined state for each small recognition area, The small recognition area is excluded from the selection candidates according to the low increasing tendency of the number of pixels.

  For example, the one-stroke drawing direction detection device extracts an area surrounded by a straight line in contact with the one-stroke drawing figure from the recognition area, and treats the area as the recognition area.

  According to the present invention, a solid one-stroke drawing figure is generated by filling the inside of a one-stroke drawing figure, and the recognition area is divided into a plurality of small recognition areas with a plurality of lines extending radially from the origin as boundary lines. For the recognition area, calculate the area of the part included in the small recognition area in the filled one-stroke drawing figure, select the small recognition area with the largest area, and in what direction the selected small recognition area is relative to the origin Since it is detected whether it is located, that is, in which direction the one-stroke drawing figure is located with respect to the origin can be detected.

It is a figure which shows the utilization form of the information processing apparatus containing the one-stroke drawing figure direction detection apparatus which concerns on this Embodiment. 2 is a functional block diagram illustrating a schematic configuration of the information processing apparatus 1. FIG. It is a figure which shows an example of the one-stroke drawing figure memorize | stored beforehand in the one-stroke drawing figure storage part. 4 is a diagram for explaining a configuration of an operation content storage unit 33. FIG. 4 is a diagram for explaining a configuration of a content storage unit 34. FIG. 4 is a flowchart showing the operations of the real-time processing generation unit 10, the camera image acquisition unit 20, and the one-stroke drawing detection on / off switching unit 41. It is the figure which illustrated the image typically. It is a flowchart which shows the flow of operation | movement (S7) of the one-stroke drawing figure detection on / off switching part 41. FIG. It is a figure which shows an example of the change of an image in case the one-stroke drawing figure detection part 42 changes into an operation state from a stop state. It is a figure which shows an example of the change of an image in case the one-stroke drawing figure detection part 42 changes into a stop state from an operation state. 4 is a flowchart showing the operation of a one-stroke drawing figure detection unit 42; It is a figure which shows a mode that the one-stroke drawing figure by a gesture is drawn. It is a functional block diagram which shows schematic structure of the one-stroke drawing figure direction detection part 423. It is a flowchart which shows the 1st example of operation | movement (S47) of the one-stroke drawing figure direction detection part 423. It is a figure for demonstrating the operation | movement in a 1st example. It is a flowchart which shows the 2nd example of operation | movement (S47) of the 1 stroke drawing figure direction detection part. It is a figure for demonstrating the operation | movement in a 2nd example. It is a figure for demonstrating another method regarding narrowing down of a small recognition area | region.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings.

  FIG. 1 is a diagram showing a usage pattern of an information processing apparatus including a one-stroke figure direction detecting apparatus according to the present embodiment.

  For example, the information processing apparatus 1 captures, with the camera 2, a one-stroke drawing figure drawn by the user U with the LED 60 that emits light on his finger and displays the content (image, video, etc.) selected based on the one-stroke drawing figure. This is a device for displaying on the device 3 (such as a television receiver), and is connected to the camera 2 and the display device 3 with a connection cable or the like.

  FIG. 2 is a functional block diagram illustrating a schematic configuration of the information processing apparatus 1.

  The information processing apparatus 1 includes a real-time process generation unit 10, a camera image acquisition unit 20, a database 30, a one-stroke drawing figure detection unit 40, and a display processing unit 50.

  The database 30 includes a camera image storage unit 31, a one-stroke drawing storage unit 32, an operation content storage unit 33, a content storage unit 34, and a finger position storage unit 35.

  The one-stroke drawing figure detection unit 40 includes a one-stroke drawing figure detection on / off switching unit 41 and a one-stroke drawing figure detection unit 42.

  The one-stroke drawing figure detection on / off switching unit 41 includes a finger position detection unit 411 and a one-stroke drawing figure detection on / off switching unit 412.

  The one-stroke drawing figure detection unit 42 includes a one-stroke drawing figure input determination unit 421, a one-stroke drawing figure detection unit 422, and a one-stroke drawing figure direction detection unit 423. The configuration of the one-stroke drawing direction detection unit 423 will be described later.

  FIG. 3 is a diagram illustrating an example of a one-stroke drawing figure stored in advance in the one-stroke drawing figure storage unit 32.

  The one-stroke-drawn figure storage unit 32 stores a plurality of one-stroke-drawn figure data as shown in FIGS.

  FIG. 4 is a diagram for explaining the configuration of the operation content storage unit 33.

  The operation content accumulating unit 33 includes a plurality of (plural types) commands (instructions), and each command includes a shape ID indicating the shape characteristics of a one-stroke drawing to be generated when the command is generated, and a predetermined ID A direction ID indicating the direction in which the one-stroke drawing figure should be positioned is associated with the origin (described later in detail).

  FIG. 5 is a diagram for explaining the configuration of the content storage unit 34.

  The content accumulation unit 34 includes a plurality (a plurality of types) of content (image and video data), and each content is associated with a command to be generated when the content is displayed.

(Operation of the information processing apparatus 1)
FIG. 6 is a flowchart showing the operations of the real-time processing generation unit 10, the camera image acquisition unit 20, and the one-stroke drawing detection on / off switching unit 41.

  The real-time processing generation unit 10 starts time measurement, sequentially determines whether or not the elapsed time T has exceeded, for example, 16 milliseconds (S1). If the elapsed time T has exceeded 16 milliseconds, the elapsed time T is set to 0. Return (S3), the camera image acquisition unit 20 is operated.

  Thereby, the camera image acquisition part 20 controls the camera 2, and images the user U (S5). The camera image acquisition unit 20 stores an image obtained by the camera 2 in the camera image storage unit 31.

  Next, the one-stroke drawing figure detection on / off switching unit 41 operates (S7), and then the control returns to step S1.

  FIG. 7 is a diagram schematically illustrating an image. The LED 60 is reflected in the image. When the user U performs a gesture with a finger, the LED 60 draws a trajectory, thereby generating a one-stroke drawing figure. Since such an image can be obtained not by the camera 2 but also by an infrared sensor, the camera 2 may be replaced with an infrared sensor.

  FIG. 8 is a flowchart showing the flow of the operation (S7) of the one-stroke drawing figure detection on / off switching unit 41.

  First, the finger position detection unit 411 reads an image from the camera image storage unit 31 and tries to detect a finger (for example, LED) from the image (S11).

  Next, the one-stroke drawing figure detection on / off switching unit 412 determines whether or not the one-stroke drawing figure detection unit 42 is in an operating state (ON) (S13).

  The one-stroke drawing detection on / off switching unit 412 determines whether or not a finger has been detected from the image if the one-stroke drawing detection unit 42 is in an operating state (S15).

  If a finger is detected, the one-stroke drawing detection on / off switching unit 412 finishes the process. If no finger is detected, the one-stroke drawing detection unit 42 is stopped (turned off) (S17), and the gesture detection area. Is deleted (S19), a gesture start area is created (S21), and the process ends.

  If the one-stroke drawing detection unit 42 is in the stopped state, the one-stroke drawing detection on / off switching unit 412 determines whether or not there is a finger in the gesture start area (S23).

  If there is no finger in the gesture start area, the one-stroke figure detection on / off switching unit 412 finishes the process. If there is a finger in the gesture start area, the one-stroke figure detection unit 42 is put into an operation state (S25), and the gesture starts. The area is deleted (S27), a gesture detection area is created (S29), and the process ends.

  FIG. 9 is a diagram illustrating an example of a change in an image when the one-stroke writing figure detection unit 42 changes from a stopped state to an operating state.

  The recognition area 100 is created in a memory in the information processing apparatus 1 and here corresponds to the visual field area of the camera 2.

  When the one-stroke drawing detection unit 42 is not operating, for example, a circular gesture start area 200 is created at the center of the recognition area 100. If the finger F enters the gesture start area 200 in the process of changing the image, the one-stroke drawing figure detection unit 42 enters an operating state, the gesture start area 200 is deleted, and a gesture, for example, is placed at the center of the recognition area 100. A circular gesture detection area 300 larger than the start area 200 is created.

  That is, the user U causes the finger F to enter the gesture start area 200 and then starts the gesture.

  FIG. 10 is a diagram illustrating an example of a change in the image when the one-stroke drawing graphic detection unit 42 is changed from the operating state to the stopped state.

  If the finger F no longer exists in the recognition area 100 in the process of image change, the one-stroke drawing figure detection unit 42 is stopped, the gesture detection area 300 is deleted, and the gesture start area 200 is located at the center of the recognition area 100. Is created.

  That is, the user U moves the finger F to the outside of the recognition area 100, thereby ending the gesture.

  FIG. 11 is a flowchart showing the operation of the one-stroke figure detection unit 42.

  The one-stroke-drawn figure detection unit 42 that has been activated in step S25 of FIG. 8 performs the following processing each time an image is stored.

  First, the one-stroke figure input determination unit 421 determines whether or not there is a finger in the gesture detection area in the image (S41).

  When the finger that has entered the gesture detection area comes out of the gesture detection area (when the finger is not in the gesture detection area), the one-stroke drawing input determination unit 421 indicates that the gesture has been started. The gesture flag indicating whether or not there is “TRUE (true)” is set (S43), and the process is terminated.

  On the other hand, when there is a finger in the gesture detection area, the one-stroke drawing figure input determination unit 421 determines whether or not the gesture flag is “TRUE” (S45).

  When the gesture flag is “TRUE”, the one-stroke figure input determination unit 421 means that a finger that has not been in the gesture detection area has entered the gesture detection area, that is, the gesture (one-stroke drawing) has ended. Therefore, the one-stroke drawing figure detection unit 422 and the one-stroke drawing figure direction detection unit 423 are operated (S47).

  When the gesture flag is “FALSE”, the one-stroke figure input determination unit 421 indicates that the finger that was in the gesture detection area is still in the gesture detection area. The process is terminated without operating the direction detection unit 423.

  In addition, when the operation of the one-stroke figure detecting unit 422 and the one-stroke figure direction detecting unit 423 is completed (S47), the one-stroke figure input determining unit 421 sets the gesture flag to “FALSE” (false). ) ”(S49), and the process is terminated.

  FIG. 12 is a diagram illustrating a state where a one-stroke drawing figure is drawn by a gesture.

  The finger F that has been in the gesture detection area 300 exits the gesture detection area 300 to draw a one-stroke drawing. At this time, the gesture flag becomes “TRUE”. Then, the finger F enters the gesture detection area 300 in order to finish drawing the one-stroke drawing figure. At this time, the gesture flag becomes “FALSE”. A one-stroke drawing is drawn in this way.

  While the gesture flag is “TRUE”, the finger position storage unit 35 stores the finger position and the image acquisition time for each image.

  Further, in step S47 of FIG. 11, the one-stroke drawing figure detection unit 422 detects the shape of the one-stroke drawing figure drawn by the finger based on the change in the finger position stored in the finger position accumulation unit 35.

  FIG. 13 is a functional block diagram illustrating a schematic configuration of the one-stroke drawing figure direction detection unit 423.

  The one-stroke figure direction detection unit 423 is also referred to as a one-stroke figure direction detector, and, as described above, a one-stroke figure is displayed in the recognition area including the gesture detection area where drawing of the one-stroke figure obtained by the gesture is started and ended. In the case of drawing, it is detected in which direction the one-stroke drawing figure is located with respect to the origin in the recognition area.

  The one-stroke figure direction detection unit 423 generates a filled one-stroke figure generation unit 4231 that generates a figure (hereinafter referred to as a “filled one-stroke figure”) that fills the inside of the one-stroke figure, and the recognition area 100 radially from the origin. An area dividing unit 4232 that divides a plurality of extending lines into a plurality of small recognition areas, and an area for calculating the area of each small recognition area included in the small recognition area in a filled one-stroke figure. A calculation unit 4233, a region selection unit 4234 that selects a small recognition region having the largest calculated area, and a direction detection unit 4235 that detects in which direction the selected small recognition region is located with respect to the origin. Prepare.

  FIG. 14 is a flowchart illustrating a first example of the operation (S47) of the one-stroke drawing figure direction detection unit 423. FIG. 15 is a diagram for explaining the operation in the first example.

  First, the filled one-stroke drawing figure generation unit 4231 generates a filled one-stroke drawing figure in which the inside of the one-stroke drawing figure (the figure detected by the one-stroke drawing figure detection unit 422) drawn in the recognition area is filled (S51). As shown in FIG. 15, when the one-stroke drawing drawn in the recognition area 100 is “circle”, a filled one-stroke drawing 1000 with the inside filled is generated.

  Next, the region dividing unit 4232 divides the recognition region 100 into a plurality of small recognition regions 100A, 100B, 100C, and 100D having a plurality of lines L1 to L4 extending radially from the origin P as boundary lines (S53).

  Next, the area calculation unit 4233 calculates, for each small recognition area, the area of the portion included in the small recognition area in the filled one-stroke figure (S55).

  Here, the area calculation unit 4233 includes, for example, a plurality of pixels in which the recognition region 100 is arranged in a matrix, and only pixels at positions in the filled one-stroke drawing have a predetermined state, for example, a value indicating black When having “1” of “0” indicating white and “1”, the number of pixels having the state in the small recognition area (having the value “1”) is calculated for each small recognition area To do.

  In the case of the example in FIG. 15, the number and area of the small recognition regions 100A, 100B, 100C, and 100D are in a ratio such as 20: 1: 0: 1.

  Next, the region selection unit 4234 selects a small recognition region having the largest calculated area (S57).

  Here, the region selection unit 4234 selects a small recognition region corresponding to the number of pixels that is the largest among the calculated number of pixels. In the example of FIG. 15, the small recognition area 100A is selected.

  Next, the direction detection unit 4235 detects in which direction the selected small recognition area is located with respect to the origin P, that is, in which direction the one-stroke drawing figure is located with respect to the origin P. (S59), and the process ends. In the case of the example in FIG. 15, it is detected that the one-stroke drawing figure is located in the direction of the small recognition area 100 </ b> A with respect to the origin P, that is, in the upward direction.

  FIG. 16 is a flowchart showing a second example of the operation (S47) of the one-stroke drawing figure direction detection unit 423. FIG. 17 is a diagram for explaining the operation in the second example.

  First, similarly to the first example, the filled one-stroke drawing generation unit 4231 generates a painted one-stroke drawing that fills the inside of the one-stroke drawing drawn in the recognition area 100 (S51). As shown in FIG. 17, when the one-stroke drawing figure drawn in the recognition area 100 is “circle”, a filled one-stroke drawing figure 1000 in which the inside is filled is generated.

  Next, the area dividing unit 4232 extracts an area 100 ′ surrounded by a straight line in contact with the one-stroke drawing figure 100 from the recognition area 100 (S 52).

  Next, as shown in FIG. 17, the region dividing unit 4232 treats the region 100 ′ as a recognition region of the first example, that is, a plurality of lines L1 to L4 extending radially from the origin P to the region 100 ′ are boundary lines. Are divided into a plurality of small recognition areas 100A, 100B and 100D (S53). The subsequent operations are the same as in the first example, and will be omitted. However, in this example, the region 100 ′ is extracted, and as shown in FIG. The direction can be quickly detected.

  FIG. 18 is a diagram for explaining another method for narrowing down the small recognition area.

  The one-stroke drawing direction detection unit 423 draws a spiral line R from the origin P, and in the process, the small recognition regions 100A to 100D are at the position of the spiral line and have a predetermined state (for example, the value “ The number of pixels having “1” ”may be calculated, and the small recognition area may be excluded from the selection candidates according to the low tendency of the increase in the number of pixels.

  In the case of the example in FIG. 18, the small recognition area 100 </ b> C has the number of pixels at the position of the spiral line R and having a predetermined state (for example, having the value “1”) as compared with the other small recognition areas. Since the increasing tendency is low, it is excluded from the selection candidates. Therefore, direction detection can be performed quickly.

  When the shape and direction of the one-stroke drawing figure are thus detected, the finger position and the image acquisition time stored in the finger position storage unit 35 of FIG. 2 are deleted. Then, the display processing unit 50 sends a command associated with the shape ID corresponding to the same shape as the detected one-stroke figure from the operation content storage unit 33 and the direction ID corresponding to the same direction as the detected direction. Is read. Then, the display processing unit 50 reads content (image or video data) associated with the command from the content storage unit 34, transmits the content to the display device 3, and displays the content.

  Therefore, according to the one-stroke drawing figure direction detecting device (423) according to the present embodiment, a solid one-stroke drawing figure is generated by filling the inside of the one-stroke drawing figure, and the recognition area includes a plurality of lines extending radially from the origin. Divide into multiple small recognition areas as boundary lines, and for each small recognition area, calculate the area of the portion included in the small recognition area in the filled stroke and select the small recognition area with the largest area. Since it is detected in which direction the selected small recognition area is located with respect to the origin, it is possible to detect in which direction the one-stroke drawing figure is located with respect to the origin.

  In addition, for each small recognition area, the number of pixels having a predetermined state in the small recognition area is calculated, and the small recognition area corresponding to the largest number of pixels among the calculated number of pixels is selected. In which direction the one-stroke drawing figure is located with respect to the origin can be detected.

  Also, in the process of drawing a spiral line from the origin, for each small recognition area, calculate the number of pixels at the position of the spiral line and having a predetermined state, and according to the low tendency of the number of pixels to increase Since the small recognition area is excluded from the selection candidates, the direction can be detected quickly.

  In addition, since the area surrounded by the straight line in contact with the one-stroke drawing figure is extracted from the recognition area and the area is treated as the recognition area, the direction can be detected quickly.

  A computer program for causing a computer to function as the one-stroke figure direction detection device (423) according to the present embodiment is a computer-readable recording medium such as a semiconductor memory, a magnetic disk, an optical disk, a magneto-optical disk, or a magnetic tape. And can be widely distributed by being transmitted through a communication network such as the Internet.

DESCRIPTION OF SYMBOLS 1 Information processing apparatus 2 Camera 3 Display apparatus 10 Real-time process generation part 20 Camera image acquisition part 30 Database 31 Camera image storage part 32 One-stroke drawing figure accumulation part 33 Operation content accumulation part 34 Content accumulation part 35 Finger position accumulation part 40 One-stroke drawing figure Detection unit 41 One-stroke drawing figure detection on / off switching unit 42 One-stroke drawing figure detection unit 50 Display processing unit 100 Recognition area 100 ′ Area surrounded by a straight line in contact with one-stroke drawing figure 100 100A to 100D Small recognition area 200 Gesture start area 300 Gesture detection Area 411 Finger position detection unit 412 One-stroke drawing figure detection ON / OFF switching section 421 One-stroke drawing figure input determination section 422 One-stroke drawing figure detection section 423 One-stroke drawing figure direction detection section 4231 Filled one-stroke drawing figure generation section 4232 Area division section 4233 Area calculation section 234 region selection unit 4235 direction detecting unit

Claims (4)

When the one-stroke drawing figure is drawn in the recognition area including the gesture detection area where drawing of the one-stroke drawing obtained by the gesture is started and ended, in which direction the one-stroke drawing figure is relative to the origin in the recognition area Is a one-stroke figure direction detection device that detects whether it is located at
A filled one-stroke drawing figure generating unit that generates a filled one-stroke drawing figure that fills the inside of the one-stroke drawing figure;
An area dividing unit that divides the recognition area into a plurality of small recognition areas with a plurality of lines extending radially from the origin as boundary lines;
For each small recognition area, an area calculation unit that calculates the area of the portion included in the small recognition area in the filled one-stroke figure,
A region selection unit for selecting a small recognition region having the largest area;
A one-stroke figure direction detecting device, comprising: a direction detecting unit that detects in which direction the selected small recognition area is located with respect to the origin. The recognition area is composed of a plurality of pixels arranged in a matrix, and only pixels at positions in the filled one-stroke drawing figure have a predetermined state.
The area calculation unit calculates, for each small recognition region, the number of pixels having the predetermined state in the small recognition region,
The one-stroke figure direction detection device according to claim 1, wherein the region selection unit selects a small recognition region corresponding to the largest number of pixels among the calculated number of pixels. In the process of drawing a spiral line from the origin, the number of pixels at the position of the spiral line and having the predetermined state is calculated for each small recognition area, and the increase in the number of pixels is low. The single-drawn figure direction detecting device according to claim 2, wherein the small recognition area is excluded from the selection candidates according to. The one-stroke figure direction detecting device according to any one of claims 1 to 3, wherein an area surrounded by a straight line in contact with the one-stroke drawing figure is extracted from the recognition area, and the area is treated as the recognition area. .