JP5894764B2 - Information processing device - Google Patents

Description

  The present invention relates to an information processing apparatus, and more particularly, to an information processing apparatus such as a terminal that has a touch panel and can select and input information and functions using a user's finger, pen, or the like.

Nowadays, application programs used in information processing apparatuses such as personal computers and portable terminals are increasingly sophisticated and have a large number of functions. In order for a user to use a specific function, for example, a function item requested by the user is selected from a menu item that lists a large number of functions, and the function item is displayed. Input is done.
However, as the number of selectable functions increases, the number of items displayed on the selection menu increases, and the menu display structure becomes complicated. When the number of items displayed on one screen increases, the listability deteriorates, and it takes time for the user to select a desired item, resulting in poor operability.

Therefore, in order to improve the visibility and operability, in many application programs, several similar function items are grouped into one group and menu items are hierarchized.
This hierarchization makes it easier to select items. However, as the functions increase and the hierarchies become more complex and deep, it takes time and effort for the user to reach the target selection item.

  For example, when an operation for selecting the first menu item in the uppermost layer using the mouse or the touch panel is performed, the second menu item in the lower hierarchy is displayed in a list form next to or below the operation position. When an operation for selecting one of the items is performed, the third menu item in the lower layer is displayed in a list form, and the same operation needs to be performed until the target item is displayed.

  Further, in Patent Document 1, when an input operation is performed on a display screen on which a touch panel is provided, a radial menu in which a plurality of menu items are radially arranged around the touch position of the touch panel is displayed. A content reproduction apparatus is described in which a desired operation can be performed without gazing at a display screen by performing a release operation with a user's finger or the like after a slide operation.

  Furthermore, in Patent Document 2, when only N (N <M) graphic items are displayed on the display screen in a graphic menu bar including M graphic items prepared in advance, the left is left touching a predetermined position. A bar operation method is described in which a graphic item that has not been displayed is displayed on a graphic menu bar by sliding in the right direction or the right direction.

JP 2011-13990 A JP 2009-266220 A

  However, when the menu items with the hierarchical structure as described above are displayed in the hierarchical order and a lower item is selected by touching a predetermined position on the touch panel with a finger, the lower layer menu screen is displayed in a list form sequentially. If you do not know in which hierarchy the target item is located, it will take time to find the target item. It was over.

  Similarly, when displaying items radially around the touched position as in Patent Document 1, the number of items displayed at a time increases as the number of items increases. It will take time.

Further, as in Patent Document 2, when the number of items to be displayed on the screen is limited and the target item is searched for by a sliding operation, similarly, as the number of items increases, it is troublesome to search for the target item. It will take time.
Further, the display of menu items and graphic items used in these patent documents is not performed hierarchically.

  Therefore, the present invention has been made in consideration of the above-described circumstances, and the item data belonging to the hierarchical menu data can be obtained by simply operating the touch panel with a user's finger. It is an object of the present invention to provide an information processing apparatus capable of sequentially displaying and selecting target item data easily and quickly.

The present invention provides a storage unit that stores a plurality of item data for specifying an executable function in a hierarchical association, and stores the stored item data on a semicircular circle of each input order layer. a display unit to be displayed on, is disposed opposite on the screen of the display unit, when contacted entered on the screen, an input unit for generating information identifying the touch input position, second on the display unit Among a plurality of item data displayed on the semicircle of one circle, when the display area of the first item data is input by contact, the contact position and the item data input by contact are the first item. An item detection unit that detects that the data is data, and a plurality of item data belonging to a lower hierarchy associated with the detected first item data are extracted from the storage unit, and the detected first item data and the center position of the display position of the second circle Set Te, the on half the circumference of the second circle, and a field selection unit for displaying a plurality of item data the extracted semi circumference of the second circle are extracted by the item selecting section Of the plurality of item data displayed above, when the second item data is touch-input by the input unit, the display position of the touch-input second item data is set as the center position of the third circle. , A plurality of item data belonging to a lower hierarchy associated with the second item data is displayed, and a plurality of items displayed on the semicircle of the second circle viewed from the center position of the second circle The display direction of the item data is different from the display direction of the plurality of item data displayed on the semicircle of the first circle viewed from the center position of the first circle, and the center of the third circle Table of multiple item data displayed on the third semicircle seen from the position Direction is intended to provide an information processing apparatus according to claim different from the second in the second display direction of the plurality of item data displayed on half the circumference of a circle as viewed from the center of the circle is there.
According to this, a plurality of item data belonging to a lower hierarchy associated with the first item data input by contact is displayed on a semicircle of a circle with the display position of the first item data as the center position. Therefore, item data for selecting a desired function can be easily input in the hierarchical order to be input, and user operability can be improved.

According to which this, a plurality of item data associated, so will be displayed in the order of the lower layer from the upper, the user only a simple and intuitive operation, easily and quickly the desired function Can be selected.

Further, the display position of the plurality of item data belonging to the lower hierarchy associated with the item data is compared with the display position of the item data input by contact as compared to the display position of the item data input by contact. It is arranged on the circumference of the left half of the circle as the center position or on the circumference of the right half of the circle.
Further, the positional relationship between the display position of the first item data belonging to a predetermined upper hierarchy and the display position of the second item data belonging to the hierarchy one level lower than that hierarchy, and the display position of the second item data The positional relationship with the display position of the third item data belonging to the next lower hierarchy is that the left and right sides are opposite to each other when viewed from the center position of each circle.
According to this, the display position of the item data of a predetermined upper and lower layer and the display position of the item data of the hierarchy one level lower than that hierarchy are arranged on the left side and the right side that are opposite to each other when viewed from the center of the circle. Therefore, it is possible to facilitate the input of hierarchical item data simply by performing an operation of alternately inputting the two fingers of the user.

  Further, when the distance between the display position of the item data contact-inputted by the input unit and the edge of the screen of the display unit is shorter than a predetermined value, a plurality of items belonging to a lower hierarchy associated with the item data The center position of a circle serving as a reference for the position for displaying the item data is adjusted in the center direction of the display unit.

  Further, contact input on the screen by the input unit is performed using the user's two fingers, and after the contact input of the item data displayed on the display unit is performed using one finger. Further, any item data among a plurality of item data belonging to a lower hierarchy associated with the item data input by contact using the other finger is input by contact.

  According to the present invention, a plurality of item data is stored in a hierarchically associated manner, and the display area of the first item data displayed on the screen is contact-input by the input unit arranged opposite to the display unit. In this case, a plurality of item data belonging to a lower hierarchy associated with the first item data input by contact is displayed on a semicircle of a circle centered on the display position of the first item data. Therefore, when selecting a desired function while sequentially selecting multiple item data, the user can easily and quickly select the desired item data simply by performing an easy-to-understand operation for the user. The operability can be improved.

1 is a configuration block diagram of an embodiment of an information processing apparatus of the present invention. It is explanatory drawing of one Example of contact input operation by the screen display content and finger | toe of this invention. It is explanatory drawing of one Example of contact input operation by the screen display content and finger | toe of this invention. It is explanatory drawing of one Example of contact input operation by the screen display content and finger | toe of this invention. It is explanatory drawing of one Example of contact input operation by the screen display content and finger | toe of this invention. It is explanatory drawing of one Example of contact input operation by the screen display content and finger | toe of this invention. In this invention, when the number of item data displayed is an odd number, it is explanatory drawing of one Example of the display position of item data. In this invention, when the number of item data displayed is an even number, it is explanatory drawing of one Example of the display position of item data. It is explanatory drawing of one Example of the menu data table of this invention. It is explanatory drawing of one Example of the menu coordinate table of this invention. It is explanatory drawing of one Example of main variable data of this invention. It is a flowchart of one Example of the item selection and display process in the information processing apparatus of this invention. It is a flowchart of one Example of the item selection and display process in the information processing apparatus of this invention. It is a flowchart of one Example of the item selection and display process in the information processing apparatus of this invention. It is a flowchart of one Example of the item selection and display process in the information processing apparatus of this invention. It is a flowchart of one Example of the item selection and display process in the information processing apparatus of this invention. It is a flowchart of one Example of the item selection and display process in the information processing apparatus of this invention. It is a flowchart of one Example of the item selection and display process in the information processing apparatus of this invention.

Hereinafter, the present invention will be described based on the embodiments shown in the drawings.
However, this does not limit the present invention.
<Configuration of Information Processing Apparatus of the Invention>
FIG. 1 is a block diagram showing the configuration of an embodiment of an information processing apparatus according to the present invention.
As shown in FIG. 1, the information processing apparatus according to the present invention mainly includes a control unit 1, a display control unit 2, a display unit 3, an input control unit 4, an input unit 5, a counter 6, and a storage unit 10. .

  Here, the control unit 1 operates various hardware to realize various functions of the information processing apparatus of the present invention, and mainly includes a CPU, a ROM, a RAM, an I / O controller, a timer, and the like. It consists of a built-in microcomputer.

  The counter 6 is a register that counts the elapsed time (input continuation time) when a finger or the like is in contact with the touch panel. For example, after the counter value CT (seconds) is set as an initial value, the counter 6 counts down every second. The control unit 1 measures the time until the count value CT becomes zero.

The display unit 3 displays predetermined information such as a menu for selecting a function, and corresponds to a display device such as an LCD, CRT, or PDP. In particular, in the present invention, the item data stored in the storage unit 10 is displayed for each layer in the order input by the input unit 5.
The display control unit 2 corresponds to a display driver circuit, and gives display data developed in a VRAM (video memory) (not shown) to the display unit 3. The VRAM is a rewritable display-only memory that stores data for one screen to be displayed by the control unit 1 in a format that can be displayed on the display unit 3.

The input unit 5 is a part where a user inputs information such as characters, figures, symbols, etc., menu selection or function selection, and various input devices such as a keyboard, a mouse, and a touch panel are used.
Since the present invention is characterized by an operation method for selecting and inputting item data for specifying a function or the like using a touch panel in particular, the following embodiment will be described mainly using a touch panel as the input unit 5. In addition, a finger, a pen, or the like can be used for input to the touch panel, but in the following embodiments, description will be made assuming that a user's finger is used.

The input control unit 4 generates information input from the touch panel as the input unit 5, that is, information (input coordinates) for specifying the position of the touch panel touched by the user's finger or pen, and sends the information to the control unit 1. The part to give.
The touch panel 5 is arranged opposite to the screen of the display unit 3 and is provided with contact detection points in a matrix so that the pressed position coordinates on the screen can be detected. Information to identify is generated. The input control unit 4 receives the signal specifying the position of the contact detection point, generates the coordinate value (x, y) of the contacted position, and gives it to the control unit 1. When the horizontal direction of the screen of the display unit 3 is the X-axis and the vertical direction is the Y-axis, the contact input position is represented by the X coordinate and the Y coordinate.

The storage unit 10 is a part that stores information used in the information processing apparatus of the present invention. For example, a storage medium such as a ROM, a RAM, a flash memory, or a hard disk is used.
As will be described later, information to be stored so as not to be erased is stored in a ROM or a hard disk, such as a menu data table 101 and a menu coordinate table 102, whose contents are fixedly set in advance.
However, the menu data table 101 and the menu coordinate table 102 may be stored so as to be rewritable so that they can be updated or newly defined later.

In addition, information that needs to be rewritten each time a setting input or a predetermined function of the information processing apparatus is executed is stored in a rewritable memory such as a RAM or a hard disk. For example, as will be described later, input coordinates (first input coordinates (P1) 113, first input coordinates (P1) 113, a display content table 111, a display coordinate table 112 of an item of interest, a display coordinate table 112, and a position currently in contact with the touch panel 5 as described later. Second input coordinates (P2) 114), center coordinates 115 of the currently displayed menu, display coordinates 116 indicating the position of information to be displayed, and the like are stored in the RAM or the hard disk.
Further, although not shown, the storage unit 10 stores programs for executing various functions of the information processing apparatus of the present invention.

  The CPU of the control unit 1 realizes the functions of the present invention by organically operating various hardware based on a program stored in advance in a ROM or the like. The program may be stored in a fixed manner in a ROM or the like in advance, but in order to be able to easily cope with subsequent specification changes or function updates, it is stored in a flash memory, a CD-ROM, a hard disk or the like. It may be stored and provided, or may be downloaded from an external server via a network as needed and stored in a hard disk or the like.

The control unit 1 mainly includes an item detection unit and an item selection unit.
When the display area of the first item data is input by contact among the plurality of item data displayed on the display unit, the item detection unit is the first item data including the contact position and the item data input by contact. It is a part that detects that there is. That is, it is a part for detecting what item data is displayed at the position touched on the touch panel, and the menu coordinate table 102, the display content table 111, the display coordinate table 112, and the like are used.

The item selection unit extracts a plurality of item data belonging to a lower hierarchy associated with the detected first item data from the storage unit 10, and a circle whose center position is the display position of the detected first item data This is a part for displaying a plurality of extracted item data on the semicircular circumference.
In other words, the menu data table 101 is a portion that displays a plurality of item data at a level one level lower hierarchically associated with the first item data that is input by touching, near the display position of the first item data. , Menu coordinate table 102, menu center coordinate 115, and the like are used.

  Further, when a plurality of item data extracted by the item selection unit is displayed, one item data (referred to as second item data) among the plurality of item data is input by contact by the input unit A plurality of item data belonging to a lower hierarchy associated with the second item data is displayed on the semicircle of the circle centered on the display position of the second item data.

  As described above, the item data of the upper hierarchy is selected and input first, and then the item data of the lower hierarchy is selected and input. In addition, in order to make the selection input operation easier, the display position of the item data of the upper hierarchy is set to the center position of the circle, and the item data of the next lower hierarchy is displayed on the semicircle of the circle. Let

  Also, in consideration of the case where the user's two fingers are alternately used for touch input, the display positions of a plurality of item data belonging to the lower layers are touch-input in order to facilitate the input operation. The display position of the item data is preferably arranged at regular intervals on the circumference of the left half of the circle or the circumference of the right half of the circle with the display position of the item data as the center position of the circle.

Further, in order to facilitate contact input using two fingers alternately, the display position of the first item data of the upper hierarchy is set as the center position of the circle, and 1 on the semicircle on the right side of the circle. In the case where the second item data of the lower hierarchy is displayed, the third item of the next lower hierarchy is set with the display position of the item data input by contact in the second item data as the center position of the circle. When displaying the data, the third item data is displayed on the semicircle on the left side of the circle.
That is, it is preferable that the display position of the item data in the lower hierarchy is on a semicircular circumference where the left and right are alternately opposite to each other when viewed from the center position of the circle.

  Further, in the case where contact input is performed using two fingers of one hand of the user, the radius of the circle is made smaller than the distance between the two fingers and item data is used using one finger. After the contact input is performed, any item data among a plurality of item data belonging to a lower hierarchy associated with the item data input by the contact can be input by using the other finger. It is preferable to do.

<Function selection method using touch panel>
Here, an outline of a function selection method using a touch panel, which is a feature of the present invention, will be described.
FIG. 2 to FIG. 6 show the contents displayed on the screen of the display unit 3 and an explanatory diagram of one embodiment of the touch input operation with a finger.
In the following description, it is assumed that the operation input of the touch panel is performed using a user's finger, in particular, two fingers of the right index finger and middle finger. However, two fingers may be used, and which finger is used depends on ease of operation by the user.
For example, there are various combinations of the two fingers such as the thumb and index finger of one hand, the index finger of the left hand and the index finger of the right hand, and the combination is not particularly limited. From this point of view, it is considered preferable to use two fingers, the index finger and the middle finger of one hand.

In FIG. 2, first, in a display state in which only the item “menu” is displayed on the screen of the display unit 3, the user moves the area (M0) where the “menu” is displayed to the right hand. It is assumed that the middle finger keeps touching for a certain time (for example, 3 seconds or more). Hereinafter, the contact is also referred to as a touch.
Here, the “menu” display area (M0) means not only a portion where the characters of “menu” are actually displayed, but also a rectangular area having a certain size including the characters. 2 is an area in which a rectangle enclosing the characters “menu” is displayed.

At this time, when detecting that the touch panel has been touched for 3 seconds or longer, the control unit 1 displays each item data belonging to the menu data of the first layer of the menu as shown in FIG.
That is, predetermined item data is displayed on the left semicircle portion on the semicircle of the circle centered on the display position of the “menu”. FIG. 2 shows a state in which five items of data (cut and paste, layout, insertion, formula, and data) set in advance as the first layer menu data are displayed on the left semicircle. Yes.

These five item data are the five data stored in the menu data MD0 of the hierarchy 1 (R = 0) of the menu data table (MD) 101 shown in FIG. 9 as an example.
Here, as shown in FIG. 7, the five item data are shifted by a fixed central angle (36 degrees) on the semicircle on the left side of the circle, with the display position of the “menu” being the center position of the circle. Is displayed. When the number of data items is five as shown in FIG. 2 and FIG. 7, the third item (insert) is displayed on the left side in the horizontal direction of the center position (menu) of the circle, and ± 36 vertically from the horizontal line. The second item (layout) and the fourth item (formula) are displayed at the position opened only by degrees, and the first item (cut and pasted) at the position opened by ± 72 degrees vertically. And the fifth item (data) are displayed.

Thus, when the number of item data items to be displayed is an odd number, the item data items may be arranged on the circumference at intervals of ± 36 degrees in the vertical direction. For example, when there are three item data items to be displayed, the item data items may be displayed at the positions of display position numbers 2, 3, and 4 in FIG. When there is one item data to be displayed, the one item data may be displayed at the position of display position number 3.
By displaying the five item data belonging to the first layer of the menu as shown in FIG. 2, the user can understand that one of the five items can be selected next.

When four items are set in advance in one menu data, as shown in FIG. 8, “menu” is displayed at the center position of the circle, and the horizontal line at the display position of “menu” is displayed. The second and third items are displayed at positions opened by ± 22.5 degrees in the vertical direction, and the first and fourth items are respectively displayed at positions opened by ± 67.5 degrees in the vertical direction. May be displayed.
That is, when the number of item data items to be displayed is an even number, the item data items to be displayed are arranged at symmetrical positions in the vertical direction with respect to the horizontal line passing through the center of the circle, and the interval is 45 degrees. What is necessary is just to arrange | position each item data on the circumference.

Also, when an input operation is performed on the touch panel with the right hand, as shown in FIG. 2, five item data are arranged in the left direction of the “menu” position touched with the middle finger of the right hand. This is to make it easy to select one of the item data with the index finger of the right hand.
That is, in order to be able to select one of the five item data display areas with the index finger of the right hand while touching the screen with the middle finger of the right hand, the middle finger and index finger are opened. Within the possible distance, it is preferable to set the display position of the “menu” and the five item data. It is difficult to unambiguously determine what distance is most preferable depending on the character size of the data to be displayed, the size of the user's hand, etc., but from the viewpoint of good operability, each item data is arranged The radius of the circle is preferably smaller than the distance at which the two fingers to be used are opened, and for example, a size of about 3 cm to 5 cm is considered preferable.

Further, the radius of the circle is not a constant value, and may be changed according to the size of the user's hand.
If the user operates the touch panel with the left hand, the positional relationship between the middle finger and the index finger is opposite to that of the right hand, so ask the user to set in advance whether to operate the touch panel with the left hand or the right hand. It may be.

When the menu finger position is touched with the middle finger of the left hand, in order to select the five item data in the first layer with the index finger of the left hand, the five item data are on the left side as shown in FIG. Display on the right semicircle, not on the semicircle.
Further, the display position of the “menu” is the center position of the circle. More specifically, for example, the coordinates (x, y) of the center (diagonal point of the diagonal line) of the rectangle surrounding the character “menu” are The coordinates (cx, cy) of the center position may be used.

  In the above description, the input operation of the touch panel for touching the display position of the “menu” has been described on the assumption that the character “menu” is already displayed in FIG. The “menu” may not be displayed.

In other words, when the user touches an arbitrary position on the display screen in a state where the characters “Menu” are not displayed on the display screen, the contact is continued for a certain time (for example, 3 seconds or more). Then, the character “menu” is displayed at the contact position, the display position of the “menu” is set at the center position of the circle, and then, as shown in FIG. It may be displayed on the circumference.
In this case, the display position of the item data is not fixed at a fixed position, and the subsequent item data is displayed based on the first position where the user touches the touch panel. The operability can be improved.

Next, in the display state of FIG. 2, it is assumed that the user touches the display position of the item data “insertion” with the index finger of the right hand while touching the position of the “menu” on the screen with the middle finger of the right hand. . FIG. 3 shows a state in which “Menu” is touched with the middle finger of the right hand and “Insert” is touched with the index finger of the right hand.
Here, touching “Menu” means contacting an arbitrary position inside the rectangular area (M0) enclosing the characters “Menu”, and touching “Insert” ”Means an arbitrary position inside the rectangular area (MD0-3) enclosing the character“ ”.

When the control unit 1 detects that the two fingers are in contact with each other, it determines that “insertion” may be selected from the five item data in the first layer. , The display area (MD0-3) of “Insert” is highlighted. Alternatively, highlighting or color display is performed.
By performing such reverse display, the user can understand that “insertion” can be selected. In addition, when the user does not intend to select “insert”, for example, when he / she wants to select “layout”, the index finger of “layout” is moved by moving the index finger of the right hand while touching the middle finger of the right hand. What is necessary is just to touch a display area (MD0-2). In this case, the reverse display of “Insert” returns to the original display, and the display area of “Layout” is reversely displayed.

Next, in the display and operation state of FIG. 3, it is assumed that the user releases the middle finger of the right hand from the screen while touching the index finger of the right hand on the “insert” display area.
At this time, the control unit 1 determines that “insertion” of the item data touched by the index finger has been selected. That is, the selection of the item data touched with the other index finger is confirmed by detecting that the contact of the middle finger that has been touched has been released.
Conversely, when canceling the menu selection, the menu selection process is canceled by releasing both fingers.
For example, in the state shown in FIG. 3, if none of the menu items such as “Insert” is selected with the index finger and the middle finger is released from the screen, it is determined that the menu selection has been canceled and the menu display is initially displayed. Return to state.
In the embodiment, the menu selection is also canceled when the middle finger is moved and the outside of the “menu” display area is touched. However, when this operation is performed, “the item held by the index finger” “Selected” or “Waiting for menu selection until middle finger returns to original position” may be used.

When selection of the item data “insertion” is confirmed, menu data related to “insertion” in the first hierarchy is read out from the menu data stored in advance as the menu data table in the second hierarchy.
For example, as shown in FIG. 9, three menu data (MD01, MD02, MD03) are set in advance as the menu data of the hierarchy 2, and each menu data is the menu data (MD0) of the hierarchy 1 respectively. Assume that it is related to the three item data (cut and paste, layout, and insertion).
In this case, among the three menu data, the menu data (MD03) related to “insertion” whose selection has been confirmed is read.

  Since the read item data of the second layer (MD03) has five item data set in advance, the characters of these five items (figure, figure, graph, table, link) are displayed on the screen. Display. The new five item data are displayed on the circumference of the right half with the display position of “insert” as the center position of the circle.

In FIG. 4, after the selection of “insert” is confirmed, five item data belonging to the menu data MD03 of the second hierarchy are displayed, and the middle finger of the right hand displays “ The state where the inside of the “graphic” display area is touched is shown.
That is, FIG. 4 shows a display state when the index finger of the right hand touches “insertion” (MD0-3) and at the same time the middle finger of the right hand touches “figure” (MD03-2).
Since the item data of the second layer is displayed on the circumference in the right direction with respect to the display position of “insert” which is the item data of the first layer, touch “insert” with the index finger of the right hand In this case, the five item data are at positions that can be easily selected with the middle finger of the right hand.

Therefore, in the display state of FIG. 4, by moving the touch position of the middle finger of the right hand up and down while touching the index finger of the right hand, other item data other than “graphic” can be easily selected. Become.
In FIG. 4, “Figure” (MD03-2) is highlighted, but if “Insert” is still being touched by the index finger of the right hand, the selection of “Figure” is still confirmed. This is a state in which any of the other items can be selected.

Next, assume that the index finger of the right hand is released from the screen from the display and operation state of FIG. Alternatively, it is assumed that the index finger of the right hand is moved and the outside of the “insert” display area is touched. At this time, the selection of “graphic” of the item data shown in FIG. 4 is confirmed.
Further, item data belonging to the lower layer (third layer) menu data (MD032 in FIG. 9) previously related to the “figure” touched with the middle finger of the right hand is displayed.

  FIG. 5 shows a display state after the right index finger is removed from the screen as described above. Here, with the display position of the “figure” touched with the middle finger of the right hand as the center position of the circle, five item data belonging to the menu data (MD032) in FIG. Lines, squares, circles, semicircles, and character frames).

  By performing such display, the user can easily understand that any of the lower five item data belonging to the “figure” can be selected. In addition, when the “graphic” display area is touched with the middle finger of the right hand, the item data of the next lower hierarchy (third hierarchy) is displayed on the left side of the “graphic” display position. Therefore, any of the item data can be easily selected by moving the index finger of the right hand.

Next, FIG. 6 shows a state where the right index finger is moved and the inside of the “square” display area is touched while the middle finger of the right hand is touching the “graphic” display area from the display and operation state of FIG. Is shown.
Here, in order to indicate that “square” can be selected as the next selection candidate, the inside of the rectangular area surrounding “square” is displayed in reverse video. In addition, the reverse display of “figure” is returned to the original display.
When the middle finger of the right hand is touching “Figure”, the selection of “Square” has not been confirmed, so if you want to select other item data, move the index finger to the display area of the desired item data. Just do it.

  Next, in the display and operation state of FIG. 6, it is assumed that the middle finger of the right hand is released from the screen while the index finger is still touching the “square”. Further, it is assumed that the menu data MD032 to which the currently selectable “square” belongs is the lowest hierarchy, and no menu data in a lower hierarchy is set. That is, it is assumed that there is no lower-level menu data associated with “square”.

In this case, when the control unit 1 detects that the middle finger of the right hand has left the screen, the control unit 1 determines the selection of the “square” that the index finger is currently touching.
When there is no lower-level menu data related to “square”, the function of “insert square” is performed by a series of operations shown in FIGS. 2 to 6 when the selection of “square” is confirmed. Is determined to have been selected.
That is, when the user performs an operation of releasing the middle finger of the right hand from the screen, the display content of FIG. 6 is erased, and the function “insert square” can be executed in the currently operating application program. Become.

  Thereafter, a function of “inserting a square”, which is provided in advance as one function of the application program, is executed, so that the user can input a square of a desired shape at a desired display position, for example. Become.

As shown in FIGS. 2 to 6, the user sequentially selects the item data of the menu layered in advance by alternately moving and touching the middle finger and the index finger of the right hand. be able to.
For example, by using two fingers to alternate the contact operation on the screen and the release operation, the item data that can be selected next is displayed, so that the user can select the next It is easy to understand what kind of item data is available, and selectable item data is displayed at regular intervals on the circumference in the display area below the side where the released finger exists. Therefore, the user does not need to move the hand greatly, and can easily select a desired item by moving the released finger slightly.

In the description using FIG. 2 to FIG. 6, the middle finger and the index finger are used as the two fingers, but the combination of the two fingers is not limited to this, for example, the thumb of one hand A combination of the middle finger and the thumb and index finger may be used. If there is no problem with the user's operability, any two of the five fingers may be used for operation. Good.
In addition, the two fingers need not be limited to one hand, and the finger that can be easily operated by the user may be used. For example, the right index finger and the left index finger may be used. Of the ten fingers, any two fingers may be used.

Further, in FIG. 2, the two fingers to be used are the middle finger and index finger of the right hand, and the first finger that touches the screen is the middle finger of the right hand. Although one item data is displayed, it is not limited to this.
The first finger to contact may be the index finger of the right hand or the thumb of the left hand instead of the middle finger of the right hand, and may be the thumb of the left hand. It can be considered that it is preferable to display the menu on the left or right side when viewed from the display position.

For example, when the index finger of the right hand is used as the first contact finger and then the middle finger of the right hand is used, considering the operability with the middle finger of the right hand, unlike the case of FIG. Is preferably displayed on the right side of the “menu”.
Accordingly, as the initial setting items, the two fingers used by the user, the first contact finger, and the user's hand (right hand or left hand) can be set in advance, and the items based on the setting contents You may make it determine the position which displays data.

  Even if such a setting is made, the user may perform a touch operation using a finger different from the setting. For example, when the user uses the index finger of the right hand as the first contact finger, but five item data are displayed on the left side of the “menu” as shown in FIG. 2, the user uses the middle finger of the right hand. Instead, it is only necessary to touch any one of the five item data using the thumb of the right hand.

  Alternatively, the name of the finger to be used first may be displayed somewhere on the display screen before the first touch operation. For example, “Use the middle finger of the right hand as the first finger to touch” or “Use the middle finger and index finger of the right hand and use the middle finger of the right hand as the first finger to touch” in advance. Then, the subsequent touch operation and the display position of the item data will not be inconsistent.

<Information stored in the storage unit>
FIG. 9, FIG. 10 and FIG. 11 are explanatory diagrams of one embodiment of information used in the present invention.
FIG. 9 shows the contents of an example of the menu data table (MD) 101.
The menu data table 101 includes a plurality of menu data, and is fixedly stored in advance in the storage unit 10 at a stage before use such as when the information processing apparatus is shipped.
The menu data table 101 stores a plurality of item data for specifying executable functions in a hierarchical association.

  Here, selectable item data belonging to the menu data is divided into three layers, hierarchies 1, 2 and 3, and each of the item data belonging to the menu data of the higher hierarchy is menu data of the next lower hierarchy. Are related and stored.

In FIG. 9, the first hierarchy (hierarchy 1) is composed of one menu data MD0, and five item data (cut and paste, layout, insertion, mathematical expression, and data) are preset in the menu data MD0. . One item data indicates the contents for specifying the function that the user is going to execute.
In the second hierarchy (hierarchy 2), menu data (MD01 to MD05) associated with each of the five item data in the first hierarchy is set in advance. In FIG. 9, the specific item data is shown about two menu data (MD01, MD03), and the item data of other menu data are abbreviate | omitted.

  In the menu data MD03 of FIG. 9, five item data (figure, figure, graph, table, link) are set in advance. For example, when “insert” is first selected and then “graph” is selected by the selection operation of the menu data item by the user, this means that the function “insert graph” can be selected and input. .

Further, menu data (MD011, MD031, etc.) associated with each item data belonging to the five menu data (MD01 to MD05) of the second hierarchy is preset in the third hierarchy (hierarchy 3).
For example, the menu data MD032 shown in FIG. 9 is menu data related to the item data “figure” of the menu data MD03 of the second hierarchy, and among these, five item data (line, square, circle, half (Circle, character frame) are set in advance.

For example, if “insertion”, “figure”, and “circle” are sequentially selected for each of the three layers by performing a selection input operation with two fingers as will be described later, The function “insert a figure” is selected and input.
Note that R is a variable that means a hierarchy, as will be described later. For example, R = 0 means the first hierarchy.

FIG. 10 is an explanatory diagram of an embodiment of the menu coordinate table 102.
In FIG. 10, four tables are shown, but these are fixedly stored in the storage unit 10 in advance. Each table (1-4) is comprised from the coordinate (x, y) of the position which displays each item data which belongs to one menu data on a screen. Here, relative coordinates with the center position of the circle as the origin coordinates (0, 0) are shown.

Tables 1 and 3 show specific examples of coordinate values when the number of item data belonging to one menu data (data number Q) is an odd number. Tables 2 and 4 show that the data number Q is The example of the coordinate value in the case of an even number is shown.
Tables 1 and 2 show examples of display coordinates when item data is displayed on the circumference on the left side of the circle as seen from the center position of the circle, as shown in FIGS. 7 and 8, respectively. .
Tables 3 and 4 show examples of display coordinates when item data is displayed on the circumference on the right side of the circle when viewed from the center position of the circle.

Further, Tables 1 and 3 show the display coordinates when the number of data is five as a representative example when the number of item data is an odd number, and Tables 2 and 4 show the number of data as a representative example when the number of item data is an even number. Indicates the display coordinates in the case of four.
For example, table 1 is the display coordinates when displaying five item data as shown in FIG. This means that one item data is displayed at the position of one coordinate (-9, -29).

This coordinate value (x, y) indicates a representative point of a region in which one item data is displayed. For example, the coordinate value (x, y) is an intersection of rectangular diagonal lines surrounding the character string of the item data. The item data is displayed.
Each of the five item data is displayed at each position indicated by the display coordinates No. 1 to No. 5 in Table 1. In the case of this table 1, as shown in FIG. 7, the display position of the “menu” is on the circumference of the left half of the circle with the center position of the circle as the origin coordinate (0, 0) and Five item data are respectively displayed at the positions.

Similarly, when there are four item data items to be displayed, when each item data item is displayed at the display coordinates shown in Table 2, the four item data items are displayed at the positions shown in FIG.
The table is not limited to these four, and the display coordinates when the number of item data to be displayed is 2, 3, 6 or 7 are set in advance and stored in the storage unit 10. Also good.

  FIG. 11 shows a specific example of main variables used for the item data selection and display processing of the present invention. These variables are temporarily stored in a rewritable memory such as a RAM or a hard disk.

The first input coordinate P <b> 1 and the second input coordinate P <b> 2 are input coordinates on the touch panel at a position touched by a finger, and are data generated from a signal on the input position of the touch panel detected by the input control unit 4.
The first input coordinate P1 stores the input coordinate of the position where the touch panel is first touched, and when the touch operation is repeated thereafter, the first input coordinate P1 mainly indicates the input coordinate of the position touched odd number of times.

  The second input coordinate P2 stores the input coordinate of the second touched position when the second position is further touched when one position of the touch panel remains in contact. In the case where the touch operation is repeated, the input coordinates of the position touched at the even number of times are shown.

  The menu center coordinate C0 (cx, cy) indicates, for example, the position at which the characters “Menu” shown in FIG. 7 are displayed, and a circle for displaying the item data of the next lower layer on the circumference. It is a coordinate which shows the center position. The menu center coordinates C0 correspond to the coordinates of the position where the selected item data was displayed among the item data one level higher than the item data displayed on the circumference.

The display coordinate S0 (sx, sy) is a position where the currently focused item data is displayed, and any one of the display coordinate tables 112 shown in FIG. 11 is displayed for each item data to be displayed. Coordinate values (x, y) are set.
Based on the display coordinates S0, the display data of the item data currently focused on is expanded on the VRAM, and the item data is displayed.

The display content table 111 temporarily stores the content (character string) of the item data of the menu data currently displayed on the screen. The item data stored here is data displayed on a semicircle of a circle as shown in FIG.
The display content table 111 of FIG. 11 shows the storage content in the case of displaying five item data belonging to the first layer menu data MD0.

  The display coordinate table 112 stores the position coordinates (x, y) on the screen for displaying the item data stored in the display content table 111, respectively. Based on the position coordinates temporarily stored in the table 112, the item data of the corresponding number in the display content table 111 is displayed.

As the coordinate values of the display coordinate table 112, a table corresponding to the number of item data items to be displayed and the display position is selected from the preset display coordinate table 102 as shown in FIG. The coordinate value of is set.
In the display coordinate table 112 of FIG. 11, when the five item data belonging to the menu data MD0 are displayed on the left semicircle as shown in FIG. 7 (coordinate values of the table 1) are set. Is shown.

The display item MT is the name of the displayed menu, and for example, a character string “menu” is stored as an initial value. When the item “insert” is selected, “insert” is stored in the display item MT.
The display menu hierarchy R indicates the hierarchy number of the item data currently displayed on the circumference. The variable R is indicated by a numerical value obtained by subtracting 1 from the hierarchy number in FIG. 9. For example, R in the second hierarchy is 1.

The display menu number RN indicates the table number of the menu data currently displayed on the circumference. For example, when the menu table of the first hierarchy is displayed, since the menu data MD0, RN = 0.
When an item of certain menu data is selected, the table number of the selected menu data is calculated based on the formula RN = RN × 10 + N using the table number RN of the current menu data and the selected item number N (New RN) is calculated.
For example, when the second item “graphic” of the menu data MD03 is selected, 03 × 10 + 2 = 32, and the new RN is 32, that is, the item of the menu data MD032 is displayed.
Therefore, the menu data currently displayed is uniquely specified by the variable RN indicating the display menu number.

The reverse display number PN is set with a number (No) of item data to be displayed different from the normal display form. For example, the reverse display is performed by reversing the display of black and white dots. The number of item data is specified.
There are other variables that are used, but these will be described in the flowchart described later.

<Flowchart of Item Selection and Display Processing of the Present Invention>
Hereinafter, in the information processing apparatus according to the present invention, a process for allowing a user to select a desired function item while sequentially displaying and selecting hierarchical menu data will be described.
12 to 18 are flowcharts showing an embodiment of item selection and display processing according to the present invention.
First, in steps S1 to S8 in FIG. 12, first touch input detection processing for the touch panel is performed. Next, in step S9 in FIG. 12 to step S21 in FIG. 13, initialization of main variables necessary for executing the selection input process with two fingers is performed.
Furthermore, in step S22 and subsequent steps in FIG. 13, a series of selection display processes for performing the selection input operation described with reference to FIGS.

<First touch input detection process>
In step S <b> 1 of FIG. 12, the control unit 1 checks whether there is a touch input from the touch panel (input unit) 5. The presence or absence of this input is based on the fact that after generating input coordinate information specifying the contact position from the current signal generated when the input control unit 4 touches the finger on the touch panel, a detection signal including that information has been received. May be performed by the control unit 1 confirming the above.
One detection signal includes, for example, input coordinate information (x, y) indicating one position where the touch panel is an area obtained by subdividing the touch panel into a matrix.

In step S2, when the control unit 1 detects the input of the detection signal, the process proceeds to step S3. Otherwise, the process returns to step S1.
In step S3, the number of touch panel inputs is checked. That is, it is checked whether the number of touched positions (number of inputs) on the touch panel is one or two or more. If two or more different detection signals are detected, it is determined that there are two or more positions input simultaneously on the touch panel, and it is unknown which input position is the correct position. Return.

If the received detection signal is one in step S3, it is determined that the position indicated by the input coordinate information included in the detection signal is touch-input, and the process proceeds to step S4.
In step S4, coordinate information (x, y) of the input position of the touch panel is acquired from the received detection signal, and stored in the storage unit 10 as the first input coordinates P1 (t1x, t1y).
In step S5, the control unit 1 sets a predetermined counter value (CT) in the counter 6 and starts the counter operation in order to measure the time during which the contact state continues, that is, the input duration time.
The counter 6 is a down counter and checks whether a time (for example, 3 seconds) from when the counter value (CT) is set until CT becomes zero is checked.

In step S6, the control unit 1 checks whether or not a detection signal is received, and determines whether or not the input state on the touch panel is still continued. When the detection signal is no longer detected, it is considered that the touch input operation has been canceled, and the process returns to step S1.
On the other hand, when the input state with respect to the touch panel is continuing, the process proceeds to step S7.
In step S7, the current counter value (CT) is checked, and it is checked whether or not the time corresponding to the counter value (CT) set in step S5 has elapsed. In the case of the down counter, if the current count value (CT) is zero, it is determined that the set time has elapsed, and the process proceeds to step S8. On the other hand, if the set time has not yet elapsed, the process returns to step S6.

In step S8, the value of the input coordinate information (x, y) included in the currently received detection signal is compared with the coordinate value (t1x, t1y) of the first input coordinate P1 stored in step S4. And check if it has changed.
If the coordinate values do not match and the input position has changed, the process returns to step S1, and the process of confirming the first touch input to the touch panel is performed again. On the other hand, if the two coordinate values match and there is no change in the touch input position, the process proceeds to step S9.
As described above, the first touch input to the touch panel is detected, and the input position is specified.

<Initialization of variables>
Next, in steps S9 to S21, variables used in the processing after step S22 are initialized.
In step S9, a variable (display menu hierarchy) R indicating the hierarchy of menu data to be displayed is set to zero, and a display menu number variable RN is set to zero.
Further, variables N, M, P, and PN used in processing to be described later are set to 1.
Here, the variable N indicates the number of item data to be displayed, the variable M indicates the number of item data of the menu data currently focused on, and the variable P indicates the menu coordinate table 102. The variable PN is a variable that means the number of item data to be displayed in reverse video.

In step S10, the contents of the display contents table 111 are erased and initialized.
In step S11, the contents (coordinate values) of the display coordinate table 112 are erased and initialized. For example, all coordinate values are set to (X, Y) = (0, 0).
In step S12 of FIG. 13, the character “menu” is stored as an initial value in the character variable MT.
In step S13, the coordinate value (t1x, t1y) set in the first input coordinate P1 is stored in the menu center coordinate C0 (cx, cy). Thereby, the input position touched first is set as the center position of the circle.

In steps S14 to S21, the menu center coordinate C0 is adjusted.
That is, when the distance between the position (first input coordinate P1) first input by contact and the edge of the screen of the display unit is shorter than a predetermined value, the position where a plurality of item data belonging to the lower hierarchy is displayed. The center position C0 (cx, cy) of the circle serving as the reference is adjusted in the central direction of the display unit.
This is because the item data of the next lower layer may not be displayed on the circumference when the first touch input position is close to the edge of the touch panel. A position slightly shifted from the position toward the center of the display unit is set as the menu center position C0.
The setting process in steps S14 to S21 shows an example of adjustment when the resolution of the LCD (display unit) 3 is 480 × 240 (dpi). Accordingly, in the case of LCDs having different resolutions, the set values of the center coordinates (cx, cy) are different.

  In step S14, when the x coordinate cx of the center position C0 set in step S13 is 30 or less, it is determined that the actual input position is too close to the end, and in step S15, the x coordinate is forcibly determined. Set cx to 30. That is, the x-coordinate cx of the center of the circle is reset in the center direction of the display unit.

In step S16, if the x coordinate cx of the central coordinate C0 is 450 or more, it is determined that the input position is too close to the end in the reverse direction, and in step S17, the x coordinate cx is forcibly set to 450. Set.
Similarly, when the y coordinate cy of the center coordinate C0 is 30 or less in step S18, the y coordinate cy is forcibly set to 30 in step S19.

If the y coordinate cy of the center coordinate C0 is 240 or more in step S20, the y coordinate cy is forcibly set to 240 in step S21.
As described above, when the input position touched first is too close to the end of the touch panel, the menu center coordinate C0 is adjusted in the center direction of the screen of the display unit rather than the actual input position.

<Menu item data selection display processing>
After the variable initialization process as described above, in step S22, among the menu data included in the menu data table 101, the menu data specified by the display menu number variable RN belongs to the menu data. The number of item data is checked and set to the variable Q for the number of data.
When the first touch input is performed and the item data of the first layer menu data MD0 is to be displayed, since the variable RN remains at the initial value, the number of item data belonging to the menu data MD0 is checked. In the case of FIG. 9, since the number of item data of the menu data MD0 is 5, 5 is set to the data number variable Q.

In step S23, it is checked whether the value of the set data count variable Q is odd or even. If the number is odd, the process proceeds to step S24. If the number is even, the process proceeds to step S25.
In step S24, (5-Q) / 2 + 1 is calculated and set to the variable M. This equation means that the menu items are arranged near the center when the number of menu items to be displayed is small. For example, when the variable Q = 5, M = 1, and when the variable Q = 3, M = 2.
When there are 5 items, display from the top as usual, but when there are only 3 items, it is not displayed at the position of the top item, but the menu item from the second display position. Is displayed. Thereby, when there are few items, it can display in the center.
If the number of items is an even number, in step S25, (4-Q) / 2 + 1 is calculated and the variable M is set so that it is displayed in the same manner in the center. For example, when the variable Q = 2, M = 2, and when the variable Q = 4, M = 1.

In step S26, it is checked whether the variable R indicating the currently focused hierarchy is an odd number or an even number. If the variable R is an odd number, the process proceeds to step S28, and 1 is set to the variable P. If the variable R is an even number, the process proceeds to step S29, and 3 is set to the variable P.
Here, the variable P means the table number of the menu coordinate table 102 shown in FIG. For example, when the variable Q for the number of data is an odd number (= 5) and the hierarchy R is an odd number (= 1), the table 1 in FIG. 10 is selected in step S28.
In step S27, it is checked whether the variable R indicating the hierarchy is odd or even. If the variable R is an odd number, the process proceeds to step S30 and 2 is set to the variable P. If the variable R is an even number, the process proceeds to step S31 and 4 is set to the variable P.
After setting the variable P, the process proceeds to step S32.

In step S32, the value of the coordinate (x, y) stored in the Mth column of the table P of the menu coordinate table 102 in the Nth coordinate (x, y) of the display coordinate table 112 is Store.
For example, if N = 1, M = 1, and P = 1, the x coordinate (−9) stored in advance in the column of No = 1 in the table 1 in the menu coordinate table 102 shown in FIG. ) And y coordinate (−29) are respectively set to the x coordinate and the y coordinate in the column No = 1 in the display coordinate table 112.

In step S33 of FIG. 14, the value of the x coordinate cx of the menu center coordinate C0 is added to the Nth x coordinate of the display coordinate table 112, and the x coordinate of the actual display position for displaying the Nth item data is obtained. Set.
That is, x = x + cx is calculated.

In step S34, the value of the y coordinate cy of the menu center coordinate C0 is added to the Nth y coordinate of the display coordinate table 112, and the y coordinate of the actual display position for displaying the Nth item data is set.
That is, y = y + cy is calculated.

  In step S35, item data preset in the Nth item of the menu data of the RN number is stored in the Nth data of the display content table 111.

In step S36, the value of the coordinate (x, y) stored in the Nth column of the display coordinate table 112 is stored in the display coordinate S0 (sx, sy).
In step S37, the VRAM is used to display the data content (item data) stored in the Nth column of the display content table 111 at the display position set to the display coordinates S0 (sx, sy).
For example, when the variables N = 1, cx = 100, and cy = 60, the data (cut and paste) stored in the first column of the display content table 111 in FIG. 11 is stored in the first column of the display coordinate table 112. It is displayed (x coordinate 100-9, y coordinate 60-29) at the (X, Y) coordinate position (91, 31).
In step S38, the next number is set to the variables N and M in order to display the next item data. That is, N = N + 1 and M = M + 1 are set.

In step S39, it is checked whether or not the variable N is larger than the number of data Q.
If N> Q, the process proceeds to step S40; otherwise, the process returns to step S32.
When N> Q, it means that all the item data belonging to one menu data has been displayed.
On the other hand, if N ≦ Q, it means that item data to be displayed still remains, so the process returns to step S32 to repeat the processing from step S32 to S38 to display the next item data.

  In step S40, the contents of the character string stored in the character variable MT are displayed at the display position indicated by the menu center coordinates C0 (cx, cy) using the VRAM. For example, as shown in FIG. 2, the characters “Menu” are displayed at the center of the circle.

In step S41 of FIG. 15, it is confirmed whether or not there is a touch input on the touch panel after the menu is displayed. This confirmation may be performed in the same manner as in step S1.
In steps S41 to S49, unlike the first touch input, it is confirmed whether or not there is a second touch input.

In step S42, as in step S2, the presence / absence of input is checked. If there is no touch input, the process returns to step S41, and if there is a touch input, the process proceeds to step S43.
In step S43, the current number of touch inputs to the touch panel is checked. If two places are pressed simultaneously, the number of touch inputs is two.

In step S44, when the number of touch inputs is one, the process proceeds to step S62, and processing is performed when only one point on the touch panel is touched.
In step S45, when the number of touch inputs is two, the process proceeds to step S46.
In other cases, that is, when the number of touch inputs is zero or three or more, it is determined that there is no input operation error or no touch input, and the process returns to step S1.

In step S46, since the number of touch inputs is two, the position coordinates of one of the two touch inputs are read, and the input coordinates of the one touch input are stored in the storage unit. It is checked whether or not the input coordinates P1 (t1x, t1y) match.
If they match, the process proceeds to step S47, and if they do not match, the process proceeds to step S48.
In step S47, since one input position is the first input coordinate P1, the position coordinate (x, y) of the other touch input is stored in the storage unit as the second input coordinate P2 (t2x, t2y). . Thereafter, the process proceeds to step S50.

  In step S48, since the position coordinate of one touch input is different from the first input coordinate, the position coordinate of the one touch input is stored in the storage unit as the second input coordinate P2 (t2x, t2y). . In this case, since the position coordinate of one touch input of the two touch inputs is different from the first input coordinate, the position coordinate of the other touch input is already the touch input if the menu is being selected. It should match the same first input coordinates as the position where the That is, when it is assumed that two fingers used for touch input are alternately used, when the touch operation of the other finger is performed, one finger remains in a touch input state at the same position. .

In step S48, since the input position of one touch input is set as the second input coordinate P2, the input position of the other touch input should be the first input coordinate that has already been input, but it moves. It may be.
Therefore, in step S49, it is checked whether or not the input position of the other touch input matches the first input coordinate P1 (t1x, t1y).
If they match, the process proceeds to step S50. If they do not match, the menu selection is canceled and the process returns to step S1.
In step S50, the variable N is initialized to 1.

Hereinafter, in step S51 to S59, it is determined which item data display area of the currently displayed item data has the second input coordinate set as the position coordinate of the second touch input. A check is made and the part of the display area of the item data including the second input coordinates is highlighted.
For example, as shown in FIG. 3, when the “insert” display area is touched with the index finger of the right hand while the middle finger of the right hand is still touching “menu”, the display area portion of “insert” is highlighted.

In step S51, the x-coordinate of the Nth column stored in the current display coordinate table 112 is compared with the x-coordinate (t2x) of the second input coordinate, and the difference is within the range from 0 to −20. Check if there is. That is, it is checked whether t2x−20 ≦ x coordinate ≦ t2x + 0. However, the value of “−20” is an example and varies depending on the resolution, the size of the display menu, and the like.
In step S52, when the x coordinate is within the range of the inequality, the process proceeds to step S53, and when it is out of the range, the process proceeds to step S55.
If it is out of range, it is determined that the second touch input position is outside the display area of the Nth item data that is currently focused on.

In step S55, 1 is added to the variable N.
In step S56, it is checked whether or not the variable N is larger than the number Q of item data. If N> Q, the process returns to step S41. If N ≦ Q, the process returns to step S51, and the process from steps S51 to S54 is repeated for the new variable N.

In step S53, the y-coordinate in the Nth column stored in the current display coordinate table 112 is compared with the y-coordinate (t2y) of the second input coordinate, and the difference is within the range from 0 to −5. Check if there is. That is, it is checked whether t2y-5 ≦ y coordinate ≦ t2y + 0.
However, the value of “−5” is one example, and is not limited to this value, and varies depending on the resolution of the display unit 3, the size of the display menu, and the like.

In step S54, if the y coordinate is within the range of the inequality, the process proceeds to step S57, and if it is out of the range, the process proceeds to step S55.
In the case of proceeding to step S57, it means that the second touch input position is inside the display area of the Nth item data currently focused on. For example, in FIG. 3, it means that the inside of the “insert” display area is touch-input with the index finger of the right hand.

In step S57, the value of the coordinate (x, y) in the PN-th column stored in the current display coordinate table 112 is set in the display coordinate S0 (sx, sy).
In step S58, the item data stored in the PN-th column of the current display content table 111 is normally displayed at the position of the display coordinates S0 (sx, sy) using the VRAM. As a result, the item that has already been highlighted is returned to the normal display. When this step is first reached, PN = 1, but the top item is overwritten with the normal display, so it cannot be identified by the user.
In step S59, the value of the variable N of the item data currently focused on is set to the variable PN that indicates the number of the item data to be highlighted.
In step S60, the value of the coordinate (x, y) in the PN-th column stored in the current display coordinate table 112 is set in the display coordinate S0 (sx, sy).
In step S61, the item data stored in the PN-th column of the current display content table 111 is reversely displayed at the position of the display coordinates S0 (sx, sy) using the VRAM.
After step S61, the process returns to step S41, and the presence / absence of the next touch input and the item data selection display process are performed.

If the number of current touch inputs is one, it is checked in step S62 in FIG. 17 whether or not the coordinates of the input position of the touch input match the first input coordinates P1 (t1x, t1y). If they match, the position of the touch input has not moved from the initial touch input position, and the process returns to step S41.
If they do not match, the current touch input position is different from the first first input coordinates, so the process proceeds to step S63, and the coordinates of the current touch input position are set to the second input coordinates P2 (t2x, t2y). To do. In this case, for example, as shown in FIG. 5, the index finger of the right hand is released and only the middle finger of the right hand is touch-input.

In step S64, the variable N is set to 1.
In steps S65 and S66, the same processing as in steps S51 and S52 is performed.
That is, the x coordinate in the Nth column stored in the display coordinate table 112 is compared with the x coordinate (t2x) of the second input coordinate P2, and the x coordinate in the Nth column is t2x−20 ≦ x. Check if the coordinates are within the range of t2x + 0. If it is within the range, the process proceeds to step S67, and if it is out of the range, the process proceeds to step S69.

  In steps S67 and S68, the same processing as in steps S53 and S54 is performed. That is, the y coordinate in the Nth column stored in the display coordinate table 112 is compared with the y coordinate (t2y) of the second input coordinate P2, and the y coordinate in the Nth column is t2y-5 ≦ y. Check whether the coordinates are within the range of t2y + 0. If it is within the range, the process proceeds to step S71, and if it is out of the range, the process proceeds to step S69.

In step S69, 1 is added to the variable N as in step S55.
In step S70, the variable N and the variable Q are compared in the same manner as in step S56. If N ≦ Q, the process returns to step S65, and the series of processing from step S65 to S68 is repeated.
On the other hand, in the case of N> Q, all the item data in the display coordinate table were examined, but the position where the touch input is currently performed was not within the display area of all the item data currently displayed. Therefore, it is determined that the selection of item data has been stopped, and the process returns to step S1.

In step S71, a value of RN × 10 + N is set in the variable RN. As described above, the table number of the selected menu data is generated by this calculation.
For example, when “insert” is selected as shown in FIG. 3, since RN = 0 and N = 3, the new RN becomes 03 and the menu data MD03 is referred to.
In step S72, 1 is added to the variable R indicating the current hierarchy. As a result, the hierarchy R currently focused on moves down by one.

In step S73 of FIG. 18, it is checked whether or not the menu data of the variable RN number newly set in step S71 exists.
For example, when RN is 03, menu data MD03 exists as shown in FIG.
As shown in FIG. 6, when “square” is selected, the menu data is MD032 and item 2, so the calculated RN value is 322, but this menu data does not exist.
As described above, when the menu data exists, the process proceeds to step S74, and when it does not exist, the process proceeds to step S77.

In the case of proceeding to step S74, item data is selected and displayed by touch input operation for menu data in a lower hierarchy.
When the process proceeds to step S77, it means that the menu data belonging to the lowest hierarchical menu data has already been selected, and then the desired function is executed by a series of selection input operations by the user.

In step S74, the contents of the item data stored in the Nth column of the display contents table 111 are set in the character variable MT. For example, in FIG. 4, a character string “graphic” that is touch-inputted with the middle finger of the right hand is set in the character variable MT.
In step S75, the coordinate value (x, y) stored in the Nth column of the display coordinate table 112 is set to the menu center coordinate C0 (cx, cy). For example, in FIG. 4, the coordinates (x, y) of the display position of the item data “graphic” are set to the new menu center coordinates (cx, cy). Thereafter, the display position of the “graphic” becomes the center position of the circle, and the item data belonging to the menu data in the lower hierarchy is displayed on the circumference of the circle.
FIG. 5 shows a state in which the display position of this “graphic” becomes the center position of a new circle, and the lower five item data corresponding to “graphic” are displayed on the circumference of the left half. Yes.
After step S75, in step S76, the inversion variable PN is initialized to 1, the process returns to step S14, and the same processing as described above is performed.

In step S77, as in step S74, the contents of the item data stored in the Nth column of the display contents table 111 are set in the variable MT. Thus, the variable MT is set in order to inform the application of the menu item whose selection has been confirmed.
In step S78, the contents of the item data set in the variable MT are notified to the currently activated application program. That is, the application program is notified that the function corresponding to the item data selected by a series of touch input operations using two fingers is selected.
The application program confirms this notification content and executes a function corresponding to the selected item data. For example, in FIG. 6, when the selection input of the item data “square” is confirmed, the item data “square” is notified to the application program, and based on this notification, the application program inserts the graphic “square”. ”Is executed.

1 Control unit (CPU)
2 Display control unit 3 Display unit (LCD)
4 Input control unit 5 Input unit (touch panel)
6 Counter 10 Storage unit 101 Menu data table 102 Menu coordinate table 111 Display content table 112 Display coordinate table 113 First input coordinate 114 Second input coordinate 115 Menu center coordinate 116 Display coordinate

Claims (5)

A storage unit that stores a plurality of item data for specifying executable functions in a hierarchical manner, and
A display unit that displays the stored item data on a semicircle of a circle for each level of input order;
An input unit that is arranged oppositely on the screen of the display unit and generates information for specifying a position where the contact is input when the contact is input on the screen;
Among the plurality of item data displayed on the semicircle of the first circle on the display unit, when the display area of the first item data is input by contact, the contact position and the item data input by contact An item detection unit for detecting that is the first item data;
A plurality of item data belonging to a lower hierarchy associated with the detected first item data is extracted from the storage unit, and a display position of the detected first item data is defined as a center position of a second circle. An item selection unit for displaying the plurality of extracted item data on a semicircle of the second circle ,
Of the plurality of item data extracted by the item selection unit and displayed on the semicircle of the second circle, when the second item data is input by contact by the input unit, the second input by the contact Setting the display position of the item data as the center position of the third circle, and displaying a plurality of item data belonging to a lower hierarchy associated with the second item data;
The display direction of the plurality of item data displayed on the semicircle of the second circle viewed from the center position of the second circle is the half of the first circle viewed from the center position of the first circle. Unlike the display direction of the plurality of item data displayed on the circumference, the display direction of the plurality of item data displayed on the third semicircle viewed from the center position of the third circle is An information processing apparatus characterized by being different from a display direction of a plurality of item data displayed on a semicircle of a second circle viewed from a center position of the second circle . Compared with the display position of the item data input by contact, the display positions of the plurality of item data belonging to the lower hierarchy associated with the item data are:
2. The device according to claim 1, wherein the circle is arranged on a circumference of a left half of a circle having a display position of the item data input by contact as a center position, or on a circumference of a right half of the circle. Information processing device. The positional relationship between the display position of the first item data belonging to a predetermined upper hierarchy and the display position of the second item data belonging to the hierarchy one level lower than the hierarchy, the display position of the second item data and the first The information processing according to claim 2 , wherein the positional relationship with the display position of the third item data belonging to the lower hierarchy is opposite to the left and right when viewed from the center position of each circle. apparatus. When the distance between the display position of the item data contact-inputted by the input unit and the edge of the screen of the display unit is shorter than a predetermined value, a plurality of items belonging to the lower hierarchy associated with the item data the center position of the circle as a reference position for displaying the data, the information processing apparatus according to any one of 3 claims 1 and adjusting the center direction of the display unit. The contact input on the screen by the input unit is performed using two fingers of the user, and after the contact input of the item data displayed on the display unit is performed using one finger, the other it of claims 1, characterized in that one of item data among a plurality of item data belonging to the lower hierarchy associated with the item data that is the touch input is a touch input with a finger either 4 An information processing apparatus according to claim 1.