JP6957578B2 - Electronic devices, control methods and control programs - Google Patents

Description

The present application relates to electronic devices, control methods and control programs.

Some electronic devices are equipped with physical keys, a touch screen, and the like. For example, Patent Document 1 discloses an electronic device that executes various functions according to an operation detected via a physical key and a touch screen.

International Publication No. 2008/086302

In conventional electronic devices, there is room for improvement in the operability of various contents such as characters, figures, sounds, images, moving images, and web pages composed of combinations thereof displayed on a display.

The electronic device according to one embodiment includes a housing, one or more physical keys arranged along the edge of the housing, storage for storing rules for classifying elements contained in the content, and the rules. It includes a controller that classifies the elements included in the content based on the content and assigns the elements of the classified content to one or a plurality of physical keys.

The electronic device according to the other aspect includes a housing, a display, a first group of physical keys including a plurality of physical keys arranged in a first row along the edge of the housing, and the edge of the housing. A second set of physical keys containing multiple physical keys in the second column, a storage that stores rules for classifying the elements contained in the content, and a controller that classifies the elements contained in the content based on the rules. And. The controller sets the content to a predetermined area on the display and assigns the area to one of the physical keys of the first physical key group. When the operation of the physical key of the first physical key group is detected, the controller classifies the elements of the content contained in the area corresponding to the physical key in which the operation is detected based on the rule. The controller assigns the classified elements to any of the physical keys in the second physical key group.

A control method according to one aspect is an electronic device comprising a housing, one or more physical keys lined up along the edges of the housing, and storage for storing rules for classifying elements contained in the content. It is a control method of. The control method classifies the elements included in the content based on the rule, and assigns the elements of the classified content to one or a plurality of physical keys.

A control method according to another aspect includes a housing, a display, a first group of physical keys including one or more physical keys arranged in a first row along the edge of the housing, and an edge of the housing. It is a control method of an electronic device including a second physical key group including one or a plurality of physical keys arranged in a second row along the line, and a storage for storing rules for classifying elements included in the content. The control method sets the content in a predetermined area on the display, allocates the area to any of the physical keys of the first physical key group, and detects the operation of the physical key of the first physical key group. The elements of the content contained in the area corresponding to the physical key in which the operation is detected are classified according to the rules, and the classified elements are assigned to any of the physical keys of the second physical key group.

A control program according to one aspect is an electronic device comprising a housing, one or more physical keys lined up along the edges of the housing, and storage for storing rules for classifying elements contained in the content. Perform each of the following steps. The control program causes the electronic device to perform a step of classifying the elements contained in the content according to a rule and assigning the classified elements to one or a plurality of physical keys.

The control program according to the other aspect includes the housing, the display, the first physical key group including one or more physical keys arranged in the first row along the edge of the housing, and the edge of the housing. The next step is for an electronic device that includes a second set of physical keys containing one or more physical keys in a second row along it and a storage that stores rules for classifying elements contained in the content. Let it run. The control program sets the content in a predetermined area on the display of the electronic device, assigns the area to one of the physical keys of the first physical key group, and the physical key of the first physical key group. When the operation of is detected, the elements of the content contained in the area corresponding to the physical key in which the operation is detected are classified according to the rules, and the classified elements are classified into one of the physical keys of the second physical key group. Perform the assigned steps.

FIG. 1 is a block diagram showing an example of the functional configuration of the electronic device according to the embodiment. FIG. 2 is a diagram showing an example of key data according to the embodiment. FIG. 3 is a diagram showing an example of the element classification rule according to the embodiment. FIG. 4 is a diagram showing an example of a user attribute correspondence priority table according to the embodiment. FIG. 5 is a diagram showing an example of user attribute data according to the embodiment. FIG. 6 is a diagram showing an outline of assignment of elements included in the web screen according to the embodiment to physical keys. FIG. 7 is a diagram showing an outline of assignment of elements included in the web screen according to the embodiment to physical keys. FIG. 8 is a diagram showing an outline of assignment of elements included in the web screen according to the embodiment to physical keys. FIG. 9 is a diagram showing an outline of assignment of elements included in the web screen according to the embodiment to physical keys. FIG. 10 is a diagram showing an outline of assignment of elements included in the web screen according to the embodiment to physical keys. FIG. 11 is a diagram showing an outline of assignment of elements included in the web screen according to the embodiment to physical keys. FIG. 12 is a diagram showing an outline of assignment of elements included in the web screen according to the embodiment to physical keys. FIG. 13 is a diagram showing an example of the operation of the electronic device according to the embodiment. FIG. 14 is a diagram showing an example of the operation of the electronic device according to the embodiment. FIG. 15 is a diagram showing an example of the operation of the electronic device according to the embodiment. FIG. 16 is a diagram showing an example of the operation of the electronic device according to the embodiment. FIG. 17 is a flowchart showing an example of a processing flow of the electronic device according to the embodiment. FIG. 18 is a flowchart showing an example of a processing flow of the electronic device according to the embodiment. FIG. 19 is a diagram showing an example of an overall image of the web screen according to the embodiment. FIG. 20 is a flowchart showing another example of the processing flow of the electronic device according to the embodiment. FIG. 21 is a diagram showing an outline of assignment of elements included in the spreadsheet screen according to the embodiment to physical keys. FIG. 22 is a diagram showing an outline of assignment of elements included in the spreadsheet screen according to the embodiment to physical keys. FIG. 23 is a diagram showing an outline of assignment of elements included in the spreadsheet screen according to the embodiment to physical keys. FIG. 24 is a diagram showing an outline of assignment of elements included in the spreadsheet screen according to the embodiment to physical keys. FIG. 25 is a diagram showing another example of key data according to the embodiment. FIG. 26 is a diagram showing the correspondence between the physical key and the assigned element according to the embodiment. FIG. 27 is a diagram showing another example of the operation of the electronic device according to the embodiment. FIG. 28 is a diagram showing an outline of assignment of elements included in the document editing screen according to the embodiment to physical keys.

A plurality of embodiments for implementing the electronic device, control method, and control program according to the present application will be described in detail with reference to the drawings.

The electronic device according to the present application may be a device such as a smartphone, a mobile phone, a tablet, a portable personal computer, a media player, an electronic book reader, a navigator, a wearable device, or a game machine.

FIG. 1 is a block diagram showing an example of the functional configuration of the electronic device according to the embodiment. In the following description, similar components may be designated by the same reference numerals. In the following description, duplicate description may be omitted. In the following description, content is processed by software such as characters, figures, sounds, images, moving images, a collection of digital data composed of combinations thereof, and applications, as typified by web pages. It is a collection of digital data. As represented by the screen of a web page (hereinafter referred to as a web screen), the content includes characters, figures, sounds, images, moving images, and a screen displayed on a display or the like in a state composed of a combination thereof. It shall include the screen displayed on the display etc. as the software such as the application is executed. In the embodiment described below, as an example of the content, a web screen and a screen displayed on a display or the like as the software is executed will be taken up and described.

As shown in FIG. 1, the electronic device 1 includes a touch screen display 2, a button 3, an illuminance sensor 4, a proximity sensor 5, a communication unit 6, a receiver 7, a microphone 8, a storage 9, and a controller. 10, the speaker 11, the camera 12, the camera 13, the connector 14, and the motion sensor 15.

The touch screen display 2 has a display 2A and a touch screen 2B. The display 2A and the touch screen 2B may be positioned one on top of the other, side by side, or separated from each other, for example. When the display 2A and the touch screen 2B are positioned so as to overlap each other, for example, one or a plurality of sides of the display 2A may not be along any side of the touch screen 2B.

The display 2A is a display such as a liquid crystal display (LCD: Liquid Crystal Display), an organic EL display (OELD: Organic Electro-Luminence Display), or an inorganic EL display (IELD: Organic Electro-Luminence Display). The display 2A displays objects such as characters, images, symbols, and figures on the screen. The screen including the objects displayed by the display 2A includes a screen called a lock screen, a screen called a home screen, and an application screen displayed while the application is being executed. The home screen may be called a desktop, a standby screen, an idle screen, a standard screen, an application list screen, or a launcher screen.

The touch screen 2B detects contact or proximity of a finger, pen, stylus pen, or the like to the touch screen 2B. The touch screen 2B can detect a position on the touch screen 2B when a plurality of fingers, pens, stylus pens, or the like touch or approach the touch screen 2B. In the following description, a position where a plurality of fingers, pens, stylus pens, etc. detected by the touch screen 2B are in contact with or close to the touch screen 2B is referred to as a “detection position”. The touch screen 2B notifies the controller 10 of the contact or proximity of the finger to the touch screen 2B together with the detection position. The touch screen 2B may notify the controller 10 of the detection of contact or proximity with the notification of the detection position. The touch screen display 2 having the touch screen 2B can execute the operation that the touch screen 2B can perform. In other words, the operation performed by the touch screen 2B may be performed by the touch screen display 2.

The controller 10 has at least one of the contact or proximity detected by the touch screen 2B, the detection position, the change in the detection position, the duration of the contact or proximity, the interval at which the contact or proximity is detected, and the number of times the contact is detected. Based on the above, the type of gesture is determined. The electronic device 1 having the controller 10 can execute the operation that the controller 10 can perform. In other words, the operation performed by the controller 10 may be performed by the electronic device 1. Gesture is an operation performed on the touch screen 2B using a finger. The operation performed on the touch screen 2B may be performed on the touch screen display 2 having the touch screen 2B. Gestures that the controller 10 determines via the touch screen 2B include, for example, touch, long touch, release, swipe, tap, double tap, long tap, drag, flick, pinch in, and pinch out. Not limited to.

The detection method of the touch screen 2B may be any method such as a capacitance method, a resistance film method, a surface acoustic wave method, an infrared method, and a load detection method.

The button 3 receives an operation input from the user. The button 3 may include one or more physical keys aligned along the edges of the housing of the electronic device 1. The buttons 3 include a first physical key group including a plurality of physical keys arranged in a first row along the edge of the housing of the electronic device 1, and a plurality of buttons 3 arranged in a second row along the edge of the housing. It may include a second physical key group including the physical key of.

The illuminance sensor 4 detects the illuminance. The illuminance is a value of a luminous flux incident on a unit area of the measurement surface of the illuminance sensor 4. The illuminance sensor 4 is used, for example, for adjusting the brightness of the display 2A.

The proximity sensor 5 detects the presence of a nearby object in a non-contact manner. The proximity sensor 5 detects the presence of an object based on a change in the magnetic field, a change in the feedback time of the reflected wave of the ultrasonic wave, or the like. The proximity sensor 5 detects, for example, that the display 2A and the face are close to each other. The illuminance sensor 4 and the proximity sensor 5 may be configured as one sensor. The illuminance sensor 4 may be used as a proximity sensor.

The communication unit 6 communicates wirelessly. The wireless communication standards supported by the communication unit 6 include, for example, cellular phone communication standards such as 2G, 3G, 4G, and 5G, and short-range wireless communication standards. Communication standards for cellular phones include, for example, LTE (Long Term Evolution), W-CDMA (Wideband Code Division Multiple Access), WiMAX® (registered trademark) (Worldwide Intellectual Cellular) Mobile There are GSM (registered trademark) (Global System for Mobile Communications), PHS (Personal Handy-phone System) and the like. Examples of short-range wireless communication standards include IEEE802.11, Bluetooth (registered trademark), IrDA (Infrared Data Association), NFC (Near Field Communication), WPAN (Wireless Personal Area Network), and the like. WPAN communication standards include, for example, ZigBee®. The communication unit 6 may support one or more of the above-mentioned communication standards.

The receiver 7 outputs a sound signal transmitted from the controller 10 as sound. The receiver 7 can output, for example, the sound of a moving image played by the electronic device 1, the sound of music, and the voice of the other party during a call. The microphone 8 converts the input user's voice or the like into a sound signal and transmits it to the controller 10.

The storage 9 stores programs and data. The storage 9 may be used as a work area for temporarily storing the processing result of the controller 10. The storage 9 may include any non-transitory storage medium such as a semiconductor storage medium and a magnetic storage medium. The storage 9 may include a plurality of types of storage media. The storage 9 may include a combination of a storage medium such as a memory card, an optical disk, or a magneto-optical disk, and a reader of the storage medium. The storage 9 may include a storage device used as a temporary storage area such as a RAM (Random Access Memory).

The program stored in the storage 9 includes an application executed in the foreground or the background, and a support program (not shown) that supports the operation of the application. When the application is executed in the foreground, for example, the screen related to the application is displayed on the display 2A. The support program includes, for example, an OS. The program may be installed in the storage 9 via wireless communication by the communication unit 6 or a non-transient storage medium.

The storage 9 can store the control program 9A, the key data 9B, the element classification rule 9C, the user attribute correspondence priority table 9D, the setting data 9Z, and the like. The control program 9A can cooperate with various applications stored in the electronic device 1 when providing various functions. The control program 9A may cooperate with the cloud storage via the communication unit 6 to access the files and data stored in the cloud storage. The cloud storage may store a part or all of the programs and data stored in the storage 9.

The control program 9A can provide functions for realizing processing related to various operations of the electronic device 1. The function provided by the control program 9A includes a function of adjusting the brightness of the display 2A based on the detection result of the illuminance sensor 4. The function provided by the control program 9A includes a function of invalidating the operation on the touch screen 2B based on the detection result of the proximity sensor 5. The function provided by the control program 9A includes a function of realizing a telephone call by controlling the communication unit 6, the receiver 7, the microphone 8, and the like. The function provided by the control program 9A includes a function of controlling the shooting process of the camera 12 and the camera 13. The function provided by the control program 9A includes a function of controlling communication with an external device connected via the connector 14. The function provided by the control program 9A includes a function of performing various controls such as changing the information displayed on the display 2A according to the gesture determined based on the detection result of the touch screen 2B. The function provided by the control program 9A includes a function of detecting the movement, stop, etc. of the user carrying the electronic device 1 based on the detection result of the motion sensor 15.

The functions provided by the control program 9A include functions related to content operations and the like. Content is a collection of digital data composed of characters, figures, sounds, images, videos, and combinations thereof, as typified by web pages, and a collection of digital data processed by software such as applications. The body. As represented by the screen of a web page (hereinafter referred to as a web screen), the content includes characters, figures, sounds, images, moving images, and a screen displayed on a display or the like in a state composed of a combination thereof. Includes screens that are displayed on displays and the like as software such as applications are executed.

For the functions related to the operation of the content provided by the control program 9A, for example, the electronic device 1 sets the content displayed on the touch screen display 2 in a predetermined area on the touch screen display 2, and sets the set area as the first. It also includes a function for realizing a process of assigning to any of the physical keys of one physical key group. Further, in this function, for example, when the electronic device 1 detects the operation of the physical key of the first physical key group, the element of the content included in the area corresponding to the physical key for which the operation is detected is an element. It also includes a function for realizing a process of classifying based on the classification rule 9C. Further, for this function, the electronic device 1 refers to the user attribute setting value (hereinafter, user attribute data) in the setting data 9Z described later and the user attribute correspondence priority table 9D, and is based on the element classification rule 9C. It also includes a function to realize the process of selecting the element corresponding to the priority corresponding to the user attribute data from the classified elements. That is, when the priority range corresponding to the user attribute data is priority 1 to 3, the element corresponding to the priority of priority 1 to 3 from the elements classified based on the element classification rule 9C. Sort only. Further, this function includes, for example, a function for realizing a process in which the electronic device 1 assigns an element selected based on user attribute data to any of the physical keys of the second physical key group. Further, in this function, for example, when the number of elements of the content is larger than the number of physical keys in the electronic device 1, a process of allocating different elements to the same physical key in duplicate according to a predetermined pattern. The function to realize is included. Further, in this function, for example, the electronic device 1 sets a category for enabling user selection for each element collectively for the elements selected based on the user attribute data, and the set category is set as the first. It is possible to provide a function for realizing the process of assigning to the physical key of the physical key group. For example, when the address bar, each menu part, each link part, the text in the page, and the image in the page are classified as elements included in the content, the electronic device 1 corresponds to the "address" as the classification corresponding to the address bar and each part of the menu. "Menu" is set as the category to be displayed, "link" is set as the category corresponding to each part of the link, "text" is set as the category corresponding to the text in the page, and "image" is set as the category corresponding to the image in the page. It can be assigned to each physical key of the physical key group.

The function related to the operation of the content provided by the control program 9A also includes, for example, a function of the electronic device 1 to realize a process of outputting a voice corresponding to a division or element assigned to the physical key detected by the operation. Is done. When the "address bar", which is an element of the web screen, is assigned to the physical key in which the operation is detected, the electronic device 1 can realize a process of outputting a voice reading out the address described in the address bar. When "address" is assigned to the physical key in which the operation is detected as a classification corresponding to the element of the web screen, the electronic device 1 assigns the "address" to the physical key in which the operation is detected as the classification corresponding to the element. It is possible to realize a process of outputting a voice for notifying that "" is assigned. When "menu parts", which are elements of the web screen, are assigned to the physical keys for which the operation is detected, the electronic device 1 can realize a process of outputting a voice reading out the fact that the menu is a menu and the contents of the menu. When the "menu" is assigned to the physical key in which the operation is detected as a category corresponding to the element of the web screen, the electronic device 1 sets the "menu" as the category corresponding to the element in the physical key in which the operation is detected. It is possible to realize a process of outputting a voice for notifying that "" is assigned. When the "text within the page", which is an element of the web screen, is assigned to the physical key for which the operation is detected, the electronic device 1 can realize a process of outputting a voice that reads out the content described in the text. When "text" is assigned to the physical key in which the operation is detected as a category corresponding to the element of the web screen, the electronic device 1 performs "text" as the category corresponding to the element in the physical key in which the operation is detected. It is possible to realize a process of outputting a voice for notifying that "" is assigned. When "link parts", which are elements of the web screen, are assigned to the physical key for which the operation is detected, the electronic device 1 can realize a process of outputting a voice that reads out the contents described in the link. When "link" is assigned to the physical key in which the operation is detected as a category corresponding to the element of the web screen, the electronic device 1 causes the physical key in which the operation is detected to be "linked" as the category corresponding to the element. It is possible to realize a process of outputting a voice for notifying that "" is assigned. When the "in-page image" which is an element of the web screen is assigned to the physical key for which the operation is detected, the electronic device 1 can realize a process of outputting a voice reading out the ID given to the image. When "image" is assigned to the physical key in which the operation is detected as a category corresponding to the element of the web screen, the electronic device 1 assigns "image" to the physical key in which the operation is detected as the category corresponding to the element. It is possible to realize a process of outputting a voice for notifying that "" is assigned.

The key data 9B includes data relating to the configuration of a physical key provided in the electronic device 1. For example, the key data 9B includes a physical key arrangement position set with reference to a predetermined position of the electronic device 1, the number of physical keys, and the like. Further, the key data 9B includes management information of content elements and divisions assigned to the physical key. The management information is referred to when executing a process corresponding to the operated physical key (for example, a voice output that reads out the contents of an element or a division).

FIG. 2 is a diagram showing an example of key data 9B according to the embodiment. As illustrated in FIG. 2, the key data 9B includes data indicating the key configuration of the physical keys constituting the physical key group, the allocation function for the physical key, the allocation classification for the physical key, or the allocation element for each physical key group. I'm out. In the example shown in FIG. 2, the key configuration corresponding to the first physical key group G1 is five physical keys _{of "30a 1 to 30a 5".} In the example shown in FIG. 2, the physical key 30a ₁ is assigned an operation function of "going back one", and the physical key 30a ₅ is assigned an operation function of "forwarding one". In the example shown in FIG. 2, the physical keys 30a _{2 to 30a 4} are assigned the "address", "menu", and "link" categories as the first round of the allocation categories. In the example shown in FIG. 2, as the allocation classification, the physical keys constituting the first physical key group G1 are allocated from the second round onward. That is, as shown in FIG. 2, the “text” category is assigned to the _{physical key 30a 2 as the second round of the allocation category.} Further, in the example shown in FIG. 2, the key configuration corresponding to the second physical key group G2 is 10 physical keys _{of "30b 1 to 30b 10".} In the example shown in FIG. 2, the physical key 30b ₁ is assigned an operation function of "going back one", and the physical key 30b ₁₀ is assigned an operation function of "forwarding one". In the example shown in FIG. 2, as the first round of the allocation elements, the physical keys 30b _{7 to 30b 9} are set to "menu e1- (3)", "menu e1- (2)", and "address e1- (1)". Elements are assigned. In the example shown in FIG. 2, as the allocation element, the allocation of the second and subsequent rounds exists for the plurality of physical keys constituting the second physical key group G2. That is, as shown in FIG. 2, as the second round of the allocation elements, the physical keys 30b _{2 to 30b 9} are pressed with "text e2- (8)", "menu e2- (7)", and "menu e2- (6). ) ”,“ Link e2- (5) ”,“ Link e2- (4) ”,“ Link e2- (3) ”,“ Link e2- (2) ”,“ Link e2- (1) ” Assigned. Further, as shown in FIG. 2, as the third round of the allocation elements, the physical keys 30b _{6 to 30b 9} are pressed with "menu e2- (12)", "text e2- (11)", and "menu e2- (10). ) ”And“ text e2- (9) ”are assigned. Further, as shown in FIG. 2, as the fourth round of the allocation elements, the elements of "menu e3- (2)" and "menu e3- (1)" are assigned to the _{physical keys 30b 8} and 30b _9. .. The data of the allocation division and the allocation element shown in FIG. 2 is recorded in the key data 9B in accordance with the processing realized by the controller 10 by executing the control program 9A. Further, the data of the allocation division and the allocation element recorded in the key data 9B may be updated every time the allocation to the physical key is changed. The timing at which the physical key assignment is changed includes the timing at which the screen displayed on the touch screen display 2 is changed.

The element classification rule 9C corresponds to a rule for classifying the elements included in the content. FIG. 3 is a diagram showing an example of the element classification rule according to the embodiment. As shown in FIG. 3, the element classification rule 9C is displayed on a web screen that can be viewed by a predetermined browser such as a web page, a spreadsheet screen that is displayed when the spreadsheet application is executed, and a document editing application. The target screen is the document editing screen. Further, the element classification rule 9C includes an address bar, menu parts, link parts, in-page text, in-page image, and the like as classification elements from the web screen. The address bar corresponds to, for example, a widget used in a web browser in which a URL (Uniform Resource Location), a homepage address, and the like are described. Each part of the menu corresponds to, for example, various navigation menus arranged on the web screen. Each part of the link corresponds to, for example, a hyperlink described on a web screen. The in-page text corresponds to, for example, text data written on a web screen. The in-page image corresponds to, for example, image data pasted on a web screen. Similarly, the element classification rule 9C includes menu parts, worksheets, charts, texts in worksheets (cells), and the like as classification elements from the spreadsheet screen. Similarly, the element classification rule 9C includes each part of the menu, the document input area, the chart, the text in the document input area, and the like as the classification elements from the document edit screen.

Further, as shown in FIG. 3, the element classification rule 9C includes information on the classification set to enable the user to collectively select the elements classified from the contents for each element. For example, the element classification rule 9C is set as an "address" set as a division corresponding to the address bar, a "menu" set as a division corresponding to each part of the menu, and a division corresponding to each part of the link with respect to the web screen. It includes information on a "link", a "text" set as a category corresponding to the text in the page, and an "image" set as a category corresponding to the image in the page. Similarly, the element classification rule 9C also includes the information of the classification set to enable the user selection collectively for each element in the spreadsheet screen and the document editing screen.

Further, as shown in FIG. 3, the element classification rule 9C includes information on the priority when assigning the element of the content to the physical key. The priority information included in the element classification rule 9C is information preset according to the target screen (content type). For example, in the element classification rule 9C, regarding the web screen, the priority "1" for "text in the page", the priority "2" for "link parts", the priority "3" for "address bar", and the "menu parts". Includes information of priority "4" and "image in page" of priority "5". Similarly, the element classification rule 9C also includes information on the priority when assigning the element of the content to the physical key on the spreadsheet screen and the document editing screen. The priority information included in the element classification rule 9C may include a case where the classification elements are not superior or inferior (for example, "no priority"). The priority is only reference data in the physical key allocation process based on the user attribute correspondence priority table 9D described later. When the priority information included in the element classification rule 9C is set to "no priority" that does not give superiority or inferiority to the classification element, the priority information corresponding to the user attribute is included in the content. Since it is not used for assigning elements to physical keys, it is not necessary to store the user attribute correspondence priority table 9D (see FIG. 4) and user attribute data (see FIG. 5), which will be described later, in the storage 9.

The user attribute correspondence priority table 9D is referred to when the electronic device 1 executes a process of assigning an element (for example, an element on a web screen) included in the content to a physical key by a function provided by the control program 9A. .. FIG. 4 is a diagram showing an example of a user attribute correspondence priority table according to the embodiment. As shown in FIG. 4, the user attribute correspondence priority table 9D stores information indicating the priority range of the element to be assigned to the physical key for each user attribute of the electronic device 1. Here, the user attribute is information that can be arbitrarily set to determine whether or not the element included in the content is a useful element for the user of the electronic device 1, and is, for example, information on the visual acuity of the user. Etc. can be adopted. When the user attribute corresponds to "attribute 1" (when attribute 1 is set as the user attribute), the controller 10 refers to the user attribute correspondence priority table 9D and determines all the priorities included in the content. Assign an element to a physical key. When the user attribute corresponds to "attribute 2" (when attribute 2 is set as the user attribute), the controller 10 refers to the user attribute correspondence priority table 9D and describes the elements included in the content. From the inside, the elements of priority 1 to 3 are assigned to the physical key. When the user attribute corresponds to "attribute 3" (when attribute 3 is set as the user attribute), the controller 10 refers to the user attribute correspondence priority table 9D and describes the elements included in the content. From the inside, only the element of priority 1 is assigned to the physical key. Users with visual acuity of 0.7 or more with both eyes are "attribute 1", users with visual acuity of 0.02 or more and less than 0.7 are "attribute 2", and users with total blindness to less than 0.02 are "attribute 1". When classified as "3", in the example shown in FIG. 4, the weaker the user's eyesight, the more visual information (information that is considered to be more visually recognized) is excluded from the physical key assignment target. Will be done. In this way, the electronic device 1 can provide an operation environment according to the user by changing the assignment of the elements classified from the content to the physical key according to the user attribute, and as a result, improve the operability of the content. Can be done.

The above-mentioned user attribute correspondence priority table 9D is in a state in which the priority range corresponding to the user attribute is set in advance. For example, a physical key is assigned to an element that the user of the electronic device 1 thinks unnecessary. The electronic device may be provided with a table that can be arbitrarily set so as not to be present.

The setting data 9Z is data referred to when the electronic device 1 executes various processes by the function provided by the control program 9A. FIG. 5 is a diagram showing an example of user attribute data according to the embodiment. As shown in FIG. 5, the setting data 9Z can store data arbitrarily set as a user attribute (for example, “attribute 1”).

The controller 10 includes an arithmetic processing unit. The arithmetic processing unit includes, for example, a CPU (Central Processing Unit), a SoC (System-on-a-Chip), an MCU (Micro Control Unit), an FPGA (Field-Programmable Gate Array), and a coprocessor. Not limited. The controller 10 comprehensively controls the operation of the electronic device 1 to realize various functions.

Specifically, the controller 10 executes an instruction included in the program stored in the storage 9 while referring to the data stored in the storage 9 as necessary. Then, the controller 10 controls the functional unit according to the data and the instruction, thereby realizing various functions. The functional unit includes, but is not limited to, for example, a display 2A, a communication unit 6, a microphone 8, and a speaker 11. The controller 10 may change the control according to the detection result of the detection unit. The detection unit includes, but is not limited to, for example, a touch screen 2B, a button 3, an illuminance sensor 4, a proximity sensor 5, a microphone 8, a camera 12, a camera 13, and a motion sensor 15.

By executing the control program 9A, the controller 10 can realize processing related to various operations of the electronic device 1. By executing the control program 9A, the controller 10 can realize processing related to the operation of the content displayed on the touch screen display 2. For example, the controller 10 can realize a process of classifying the elements included in the content displayed on the touch screen display 2 and assigning the classified elements to one or a plurality of physical keys based on the element classification rule 9C. For example, the controller 10 sets the content displayed on the touch screen display 2 in a predetermined area on the touch screen display 2, and sets the area in which the content is set as one of the physical keys of the first physical key group. The process of assigning to can be realized. For example, when the controller 10 detects the operation of the physical key of the first physical key group, the controller 10 classifies the elements of the content included in the area corresponding to the physical key in which the operation is detected based on the element classification rule 9C. Processing can be realized. For example, the controller 10 can realize a process of selecting an element corresponding to the priority corresponding to the user attribute data from the classified elements. For example, the controller 10 can realize a process of assigning an element selected based on a user attribute to any of the physical keys of the second physical key group. For example, the controller 10 sets a division for enabling user selection for each element selected based on the user attribute, and assigns the set division to the physical key of the first physical key group. Can be realized. For example, the controller 10 can realize a process of outputting a voice corresponding to an element or a division of the element assigned to the physical key in which the operation is detected.

The speaker 11 outputs a sound signal transmitted from the controller 10 as sound. The speaker 11 is used, for example, to output a ringtone and music. One of the receiver 7 and the speaker 11 may also serve as the other function.

The camera 12 and the camera 13 convert the captured image into an electric signal. The camera 12 is an in-camera that captures an object facing the display 2A. The camera 13 is an out-camera that captures an object facing the opposite surface of the display 2A. The camera 12 and the camera 13 may be mounted on the electronic device 1 in a functionally and physically integrated state as a camera unit that can be used by switching between an in-camera and an out-camera.

The connector 14 is a terminal to which another device is connected. The connector 14 may be a general-purpose terminal such as USB (Universal Social Bus), HDMI (registered trademark) (High-Definition Multimedia Interface), Light Peak (Thunderbolt (registered trademark)), and earphone / microphone connector. .. The connector 14 may be a dedicated terminal such as a Dock connector. Devices connected to the connector 14 include, but are not limited to, for example, external storage, speakers, and communication devices.

The motion sensor 15 can detect various information for determining the operation of the user carrying the electronic device 1. The motion sensor 15 may be configured as a sensor unit including an acceleration sensor, an orientation sensor, a gyroscope, a magnetic sensor, a pressure sensor, and the like.

The electronic device 1 may include a GPS receiver and a vibrator in addition to the above-mentioned functional units. The GPS receiver receives radio signals in a predetermined frequency band from GPS satellites. The GPS receiver performs demodulation processing of the received radio wave signal and sends the processed signal to the controller 10. The GPS receiver supports arithmetic processing of the current position of the electronic device 1. The electronic device 1 may include a receiver capable of receiving signals of a positioning artificial satellite other than a GPS satellite, and may execute arithmetic processing of the current position. The vibrator vibrates a part or the whole of the electronic device 1. The vibrator has, for example, a piezoelectric element, an eccentric motor, or the like in order to generate vibration. The electronic device 1 implements a functional unit that is naturally used to maintain the function of the electronic device 1, such as a battery, and a control unit that is naturally used to realize the control of the electronic device 1.

The electronic device 1 may access the storage server on the cloud via the communication unit 6 and acquire various programs and data.

An example of a method of assigning a physical key corresponding to a web screen according to an embodiment will be described with reference to FIGS. 6 to 12. 6 to 12 are diagrams showing an outline of assignment of elements included in the web screen according to the embodiment to physical keys. In the following description, it is assumed that the user attributes (for example, attribute 1) of the user of the electronic device 1 are set in advance.

The electronic device 1 shown in FIG. 6 includes a substantially rectangular parallelepiped housing, and the plane of the electronic device 1 has a substantially rectangular shape as shown in FIG. The first physical key group G1 includes a total of five physical keys, that _{is, the physical keys 30a 1} , ..., And the physical keys 30a _{5 shown in FIG.} The physical keys 30a ₁ , ..., The physical keys 30a ₅ are arranged in a row along the edge F1 of the housing of the electronic device 1 in the direction parallel to the y-axis shown in FIG. The second physical key group G2 includes a total of 10 _{physical keys including the physical keys 30b 1} , ..., And the physical keys 30b _{10 shown in FIG.} The physical keys 30b ₁ , ..., The physical keys 30b ₁₀ are arranged in a row along the edge F2 of the housing of the electronic device 1 in the direction parallel to the x-axis shown in FIG. The number of physical keys constituting each of the first physical key group G1 and the second physical key group G2 shown in FIG. 6 is an example, and is not necessarily composed of the same number of physical keys as the example shown in FIG. You may. Further, the arrangement position of the first physical key group G1 shown in FIG. 6 is an example, and may be arranged along an edge of the housing different from the edge F1 of the housing shown in FIG. Similarly, the second physical key group G2 shown in FIG. 6 may be arranged along the edge of the housing different from the edge F2 of the housing shown in FIG. In the example shown in FIG. 6, the physical keys 30a ₁ , ..., The physical keys 30a ₅ are arranged along the edge F1 of the housing of the electronic device 1, but one side forming the contour of the touch screen display 2. It may be arranged along. Similarly, the physical keys 30b ₁ , ..., And the physical keys 30b ₁₀ may be arranged along one side forming the contour of the touch screen display 2. In the example shown in FIG. 6, the electronic device 1 displays the web screen C1 on the touch screen display 2.

In the electronic device 1, for example, at the timing when the web screen C1 is displayed on the touch screen display 2, the web screen C1 is displayed on the touch screen display 2 in three regions, regions A1, A2, and as shown in FIG. Set to A3. Subsequently, the electronic device 1 _{allocates the area A1 to the physical key 30a 2} of the first physical key group G1, the area A2 to the physical key 30a ₃ of the first physical key group G1, and the area A3 to the first physical key group G1. It is assigned to _{the physical keys 30a 4} of the physical key group G1.

When, for example, the electronic device 1 _{detects the operation of the physical key 30a 2} , as shown in FIG. 8, the electronic device 1 sets the elements of the web screen C1 included in the area A1 corresponding to _{the physical key 30a 2 based on the element classification rule 9C.} Classify. That is, the electronic device 1 extracts each element such as the address bar, the menu parts, the link parts, the text in the page, and the image in the page included in the web screen C1 as the physical key assignment target. In the example shown in FIG. 8, the elements e1- (1), the element e1- (2), and the element e1- (3) are classified as the elements of the web screen C1 included in the area A1. Subsequently, the electronic device 1 refers to the user attribute data and the user attribute correspondence priority table 9D, and selects the user attribute from the elements e1- (1), element e1- (2), and element e1- (3). Select the elements that correspond to the priority corresponding to the data. For example, when the element e1- (1), the element e1- (2), and the element e1- (3) are selected, the electronic device 1 transfers the element e1- (1) to the second physical key group G2. Assigned to the included physical key 30b _{9 , element e1- (2) is assigned to the physical key 30b 8} included in the second physical key group G2, and element e1- (3) is assigned to the second physical key group G2. Assign to the included physical key 30b _7.

When, for example, the electronic device 1 _{detects the operation of the physical key 30a 3} , as shown in FIG. 9, the electronic device 1 sets the elements of the web screen C1 included in the area A2 corresponding to _{the physical key 30a 3 based on the element classification rule 9C.} Classify. In the example shown in FIG. 9, 12 elements from the element e2- (1) to the element e2- (12) are classified as the elements of the web screen C1 included in the area A2. Subsequently, the electronic device 1 refers to the user attribute data and the user attribute correspondence priority table 9D, and selects the user attribute data from the 12 elements from the element e2- (1) to the element e2- (12). Select the elements that correspond to the corresponding priorities. For example, when all the elements from the element e2- (1) to the element e2- (12) are selected, the electronic device 1 first has eight elements from the element e2- (1) to the element e2- (8). Are assigned to the physical keys 30b _{9 to the physical keys 30b 2} included in the second physical key group G2, respectively. Subsequently, the electronic device 1 folds back _{and returns to the physical key 30b 9} again, and the four elements from the element e2- (9) to the element e2- (12) are transferred from the physical key 30b ₉ to the physical key 30b ₆ , respectively. Assign in order. As described above, the electronic device 1 is included in the second physical key group G2 when the number of elements to which the physical key is assigned is larger than the number of physical keys included in the second physical key group G2. This can be dealt with by cyclically using physical keys and assigning different elements to the same physical key in duplicate.

When the electronic device 1 _{detects, for example, the operation of the physical key 30a 4} , as shown in FIG. 10, the electronic device 1 sets the elements of the web screen C1 included in the area A3 corresponding to _{the physical key 30a 4 based on the element classification rule 9C.} Classify. In the example shown in FIG. 10, the elements e3- (1) and the elements e3- (2) are classified as the elements of the web screen C1 included in the area A3. Subsequently, the electronic device 1 refers to the user attribute data and the user attribute correspondence priority table 9D, and corresponds to the priority corresponding to the user attribute data from the elements e3- (1) and the element e3- (2). Select the elements that have been selected. For example, when the element e3- (1) and the element e3- (2) are selected, the electronic device 1 assigns the element e3- (1) to the physical key 30b _{9 included in the second physical key group G2.} , Element e3- (2) is assigned _{to the physical key 30b 8} included in the second physical key group G2.

For example, as shown in FIG. 11, the electronic device 1 has a direction parallel to the y-axis direction (1) and a direction parallel to the x-axis direction (2) with reference to the coordinates (X1, Y1) of the touch screen display 2. By scanning on the touch screen display 2, the elements on the web screen C1 can be classified and numbered in the order of classification. FIG. 12 shows, for example, the transition of scanning with respect to the area A2 on the touch screen display 2 in which the web screen C1 is set. The electronic device 1 starts the scan SC1 in the direction (1) parallel to the y-axis direction (step S1). The electronic device 1 detects the region HT1 on the web screen C1 by the scan SC1 (step S2). The electronic device 1 starts the scan SC2 with respect to the region HT1 in the direction (2) parallel to the x-axis direction (step S3). The electronic device 1 assigns the identification number e2- (1) to the element included in the region HT2 detected by the scan SC2, and assigns the identification number e2 to the element included in the region HT3 detected following the region HT2. -(2) is added (step S4). In this way, after scanning the entire area of the area A2, the electronic device 1 also scans the other areas on the touch screen display 2 on which the web screen C1 is set in the same manner as the area A2, and includes the web screen C1. Perform classification and numbering of the elements to be used. The electronic device 1 assigns the elements on the web screen C1 to the physical keys in the order in which they are numbered.

The electronic device 1, after allocated to the physical key included elements classified from web screen C1 to the second physical key group G2, allocation areas A1 to physical keys 30a _2, allocation of area A2 to the physical key 30a ₃ , And the allocation of the area A3 to the physical key 30a ₄ is released, and the division of the element selected from the elements included in the web screen C1 is newly assigned to the physical key of the first physical key group G1. The electronic device 1 assigns, for example, an “image”, which is a category corresponding to an in-page image, to the physical keys 30a ₂ among the elements selected from the web screen C1, and a “text”, which is a category corresponding to the in-page text. Is assigned to the physical key 30a _3, and "link", which is a division corresponding to each part of the link, is assigned to the physical key 30a ₄ .

When executing the allocation shown in FIGS. 6 to 12, the electronic device 1 records the data related to the allocation as management information in the key data 9B so that the correspondence between the physical key and the element assigned to the physical key can be understood. (See Fig. 2).

In the example shown in FIGS. 6 to 12, the electronic device 1 scans the web screen C1 triggered by the operation detection of the physical key of the first physical key group G1 to detect the elements included in the web screen C1. Classification, sorting, and assignment of sorted elements to physical keys are performed, but are not limited to this example. For example, the electronic device 1 includes the web screen C1 in the web screen C1 for each of the areas A1, A2, and A3 at the timing when the web screen C1 is set in the three areas, the areas A1, A2, and A3 on the touch screen display 2. The classification of the classified elements and the assignment of the classified elements to the physical keys may be automatically executed.

Subsequently, an example of the operation of the electronic device according to the embodiment will be described with reference to FIGS. 13 to 16. 13 to 16 are diagrams showing an example of the operation of the electronic device according to the embodiment. 13 to 16 shown below show that when the physical key is operated by the user after the assignment of the element containing the content to the physical key is completed, the electronic device 1 executes the operation according to the operation on the physical key. It shows the operation. That is, the electronic device 1 executes a process of outputting information or the like related to the elements assigned to the physical keys as voice in response to the operation of the physical keys by the user.

In the example shown in FIG. 13, the electronic device 1 displays the web screen C2 on the touch screen display 2 (step S11).

When the electronic device 1 detects an operation on _{the physical key 30a 2} of the first physical key group G1, it outputs a voice M1 that reads out the classification (“image”) of the element assigned to _{the physical key 30a 2 (step S12).} ).

After accepting the operation on the physical key 30a ₂ , when the electronic device 1 detects the operation on _{the physical key 30b 2} of the second physical key group G2, the voice M2 reads out the ID of the image assigned to the _{physical key 30b 2.} Is output (step S13).

In the example shown in FIG. 14, the electronic device 1 displays the web screen C2 on the touch screen display 2 (step S21), as in the example shown in FIG.

When the electronic device 1 detects an operation on _{the physical key 30a 3} of the first physical key group G1, it outputs a voice M3 that reads out the classification (“text”) of the element assigned to _{the physical key 30a 3 (step S22).} ).

After accepting the operation on the physical key 30a ₃ , when the electronic device 1 detects the operation on _{the physical key 30b 2} of the second physical key group G2, the content described in the text assigned to the _{physical key 30b 2 is displayed.} The voice M4 to be read out is output (step S23).

In the example shown in FIG. 15, similarly to the example shown in FIG. 13, the electronic device 1 displays the web screen C2 on the touch screen display 2 (step S31).

When the electronic device 1 detects an operation on _{the physical key 30a 4} of the first physical key group G1, it outputs a voice M5 that reads out the classification (“link”) of the element assigned to _{the physical key 30a 4 (step S32).} ).

After accepting the operation on the physical key 30a ₄ , when the electronic device 1 detects the operation on _{the physical key 30b 2} of the second physical key group G2, the content described in the link assigned to the _{physical key 30b 2 is displayed.} The voice M6 to be read out is output (step S33). Following manipulations of physical keys 30b _2, the electronic device 1, the physical detects an operation on the key 30b _3, and outputs the audio M7 to read the contents linked described in assigned to a physical key 30b ₃ (step S34 ).

In the example shown in FIG. 16, similarly to the example shown in FIG. 13, the electronic device 1 displays the web screen C2 on the touch screen display 2 (step S41).

When the electronic device 1 detects an operation on _{the physical key 30a 5} of the first physical key group G1, it selects the classification of another element assigned to _{the physical key 30a 2} to the physical key 30a _{4 in the second and subsequent rounds.} The voice M8 to the effect of moving is output (step S42).

When the operation of the physical key 30a ₂ of the second round is accepted following the operation of the physical key 30a _{5 , the electronic device 1 classifies the elements assigned to the physical key 30a 2} of the second round (“address”). Is output (step S43).

After accepting the operation of the physical key 30a _{2 in} the second round, when the operation on the physical key 30b ₂ of the second physical key group G2 is detected, the electronic device 1 moves to the address bar assigned to the _{physical key 30b 2.} The voice M10 that reads out the described contents is output (step S44).

The processing flow of the electronic device 1 according to the embodiment will be described with reference to FIGS. 17 and 18. 17 and 18 are flowcharts showing an example of the processing flow of the electronic device according to the embodiment. The processes shown in FIGS. 17 and 18 are realized by the controller 10 executing the control program 9A.

A process relating to the assignment of content elements to physical keys (see FIGS. 6 to 12 and the like) will be described with reference to FIG. As shown in FIG. 17, the controller 10 determines whether the content is displayed on the touch screen display 2 (step S101).

When the controller 10 displays the content as a result of the determination (step S101, Yes), the controller 10 sets the displayed content in a predetermined area on the touch screen display 2 (step S102).

The controller 10 allocates each area to the physical key of the first physical key group G1 (step S103).

The controller 10 determines whether or not an operation on the physical key of the first physical key group G1 has been detected (step S104).

When the controller 10 detects an operation on the physical key of the first physical key group G1 as a result of the determination (step S104, Yes), the controller 10 executes a scan of the area corresponding to the physical key in which the operation is detected (step S105). ).

The controller 10 classifies the elements detected by the scan based on the element classification rule 9C (step S106).

The controller 10 refers to the user attribute data and the user attribute correspondence priority table 9D, and selects the element corresponding to the priority corresponding to the user attribute data from the elements classified in step S106 (step S107).

The controller 10 assigns the element selected in step S107 to the physical key of the second physical key group G2 (step S108).

The controller 10 assigns the division of the element selected in step S107 to the physical key of the first physical key group G1 (step S109).

The controller 10 determines whether or not the processing for the displayed content is completed (step S110).

As a result of the determination, when the controller 10 completes the process for the displayed content (steps S110, Yes), the controller 10 ends the process shown in FIG.

On the other hand, if the result of the determination is that the process for the displayed content is not completed (steps S110, No), the controller 10 returns to the determination in step S104.

In step S104, if the controller 10 has not detected an operation on the physical key of the first physical key group G1 as a result of the determination (steps S104, No), the determination is repeated.

In step S101, when the result of the determination is that the content is not displayed (steps S101, No), the controller 10 ends the process shown in FIG.

As described above, the electronic device 1 according to the embodiment is a web screen and an application displayed on the touch screen display 2 by changing the assignment of the elements classified from the contents to the physical keys according to the user attributes. The operability of various contents such as screens can be improved.

A process (see FIGS. 13 to 16 and the like) executed in response to an operation detection to the physical key after the assignment of the element included in the content to the physical key is completed will be described with reference to FIG. As shown in FIG. 18, the controller 10 determines whether the content is being displayed (step S201).

As a result of the determination, when the content is being displayed (step S201, Yes), the controller 10 determines whether or not the operation on the physical key is detected (step S202).

When the controller 10 detects an operation on the physical key as a result of the determination (step S202, Yes), the controller 10 determines whether the operation is on the physical key of the first physical key group G1 (step S203).

As a result of the determination, when the controller 10 is an operation on the physical key of the first physical key group G1 (step S203, Yes), the controller 10 executes a process corresponding to the physical key of the first physical key group G1 (step). S204), the process returns to the determination in step S201.

On the other hand, as a result of the determination, if the controller 10 does not operate on the physical key of the first physical key group G1 (steps S203, No), it determines whether the operation is on the physical key of the second physical key group G2. Determine (step S205).

As a result of the determination, when the controller 10 is an operation on the physical key of the second physical key group G2 (step S205, Yes), the controller 10 executes a process corresponding to the physical key of the second physical key group G2 (step). S206), the process returns to the determination in step S201.

On the other hand, if the result of the determination is that the operation is not for the physical key of the second physical key group G2 (steps S205, No), the controller 10 returns to the determination in step S201.

In step S202, if the controller 10 has not detected an operation on the physical key as a result of the determination (steps S202, No), the controller 10 returns to the determination in step S201.

In step S201, if the result of the determination is that the content is not being displayed (steps S201, No), the controller 10 ends the process shown in FIG.

(Other embodiments)
In the above embodiment, after the electronic device 1 sets the content displayed on the touch screen display 2 in a predetermined area on the touch screen display 2, the elements of the content are classified, and the classified elements are classified according to the user attributes. However, the example is described in which the selected elements are assigned to the physical keys, but the present invention is not limited to this example. For example, the electronic device 1 may execute the assignment of the elements classified from the contents to the physical keys without setting the contents in a predetermined area on the touch screen display 2.

The control program 9A classifies and classifies the elements included in the content displayed on the touch screen display 2 based on the element classification rule 9C without setting the predetermined area on the touch screen display 2, for example. It provides a function for selecting elements based on user attributes and assigning the selected elements to one or a plurality of physical keys. Then, the controller 10 classifies the elements included in the content displayed on the touch screen display 2 based on the element classification rule 9C by the function provided by the control program 9A, and classifies the classified elements based on the user attributes. And sorts, and realizes the process of assigning the sorted elements to one or a plurality of physical keys.

FIG. 19 is a diagram showing an example of an overall image of the web screen according to the embodiment. For example, as shown in FIG. 19, the electronic device 1 scans the content displayed on the touch screen display 2 (for example, the web screen C1) over the entire surface, and is assigned from the web screen C1 to the physical key. Elements (for example, element e- (1) to element e- (33)) may be classified, the classified elements may be selected based on user attributes, and the selected elements may be assigned to physical keys. Hereinafter, the flow of processing when the content is not set in a predetermined area on the touch screen display 2 will be described with reference to FIG.

FIG. 20 is a flowchart showing another example of the processing flow of the electronic device 1 according to the embodiment.

As shown in FIG. 20, the controller 10 determines whether the content is displayed on the touch screen display 2 (step S301).

When the controller 10 displays the content as a result of the determination (step S301, Yes), the controller 10 scans the content (step S302).

The controller 10 classifies the elements detected by the scan based on the element classification rule 9C (step S303).

The controller 10 refers to the user attribute data and the user attribute correspondence priority table 9D, and selects the element corresponding to the priority corresponding to the user attribute data from the elements classified in step S303 (step S304).

The controller 10 assigns the element selected in step S304 to the physical key of the second physical key group G2 (step S305).

The controller 10 assigns the division of the element selected in step S304 to the physical key of the first physical key group G1 (step S306), and ends the process shown in FIG.

In step S301, when the result of the determination is that the content is not displayed (steps S301, No), the controller 10 ends the process shown in FIG.

In the process shown in FIG. 20, when the content is displayed on the touch screen display 2, the electronic device 1 classifies and classifies the elements included in the content displayed on the touch screen display 2 based on the element classification rule 9C. It realizes the process of selecting the selected elements based on the user attributes and assigning the selected elements to one or a plurality of physical keys. For this reason, the process shown in FIG. 20 does not need to set the content in a predetermined area on the touch screen display 2 as in the process shown in FIG. 17, and further, the content is set in the set area. It is not necessary to detect the operation of, and all the assignment of the elements included in the content to the physical key can be completed at the timing when the content is displayed on the touch screen display 2, as compared with the process shown in FIG. The convenience of the user can be further improved.

In the above embodiment, the electronic device 1 has described an example in which elements included in the content displayed on the touch screen display 2 provided by the electronic device 1 are classified and selected and assigned to physical keys, but the present invention is limited to this example. Not done. The electronic device 1 also has the same contents as those in the above-described embodiment, for example, with respect to the content displayed on the external display device connected so as to be able to communicate with each other via the communication unit 6 or the connector 14. In addition, the elements contained in the content can be classified and sorted and assigned to the physical key.

Further, as described above, the electronic device 1 scans the web screen C1 displayed on the touch screen display 2, classifies the elements included in the web screen C1, selects the classified elements, and selects the selected elements. Performs an assignment to a physical key, but is not limited to this example. The electronic device 1 elements the elements included in the web screen C1 by, for example, analyzing the source code of the web page that is the source of the web screen C1 when displaying the web screen C1 on the touch screen display 2. It may be automatically classified based on the classification rule 9C, and then the classified elements may be selected and the selected elements may be assigned to the physical keys. That is, even if the content is not displayed on the touch screen display 2, the electronic device 1 can extract the elements included in the content if there is a method for extracting the elements of the content as in the source code analysis of the web page. It can be categorized and sorted and assigned to a physical key.

An outline of the assignment to the physical key corresponding to the screen of the application according to the embodiment will be described with reference to FIGS. 21 to 28.

21 to 24 are used to show an outline of assignment of elements included in the spreadsheet screen to physical keys. 21 to 24 are diagrams showing an outline of assignment of elements included in the spreadsheet screen according to the embodiment to physical keys. When assigning the elements included in the spreadsheet screen displayed on the touch screen display 2 to the physical keys, the elements included in the web screen C1 illustrated in FIGS. 6 to 12 are basically assigned to the physical keys. The same is true. That is, as shown in FIG. 21, the electronic device 1 sets the spreadsheet screen C3 in the areas A4, A5, and A6 on the touch screen display 2. The electronic device 1 allocates the area A4 to the physical key 30a ₂ of the first physical key group G1, the area A5 to the physical key 30a ₃ of the first physical key group G1, and the area A6 to the first physical key group. It is assigned to the physical key 30a _{4 of G1.}

_{When the electronic device 1 receives an operation of the physical key 30a 2} to which the area A4 corresponding to the menu of the spreadsheet screen C3 is assigned, for example, as shown in FIG. 22, the element of the spreadsheet screen C3 included in the area A4. Is classified based on the element classification rule 9C. That is, the electronic device 1 executes the classification related to each part of the menu included in the spreadsheet screen C3. In the example shown in FIG. 22, elements e101 to e122 are classified as elements of the spreadsheet screen C3 included in the area A4. Subsequently, the electronic device 1 refers to the user attribute data and the user attribute correspondence priority table 9D, and selects an element corresponding to the priority corresponding to the user attribute data from the classified elements e101 to e122. For example, when the elements e101 to e122 are selected, the electronic device 1 _{assigns the element e101 to the physical key 30b 9} included in the second physical key group G2, and assigns the element e102 to the second physical key group G2. Each selected element is assigned to the physical key included in the second physical key group G2, such as being assigned to the included physical key 30b _8.

The electronic device 1, for example, when receiving an operation of the physical key 30a ₃ the area A5 is allocated corresponding to the worksheet in spreadsheet screen C3, as shown in Figure 23, the spreadsheet screen C3 included in the area A5 Elements are classified based on element classification rule 9C. That is, the electronic device 1 executes the classification related to the worksheet included in the spreadsheet screen C3. In the example shown in FIG. 23, as a part of the elements of the spreadsheet screen C3 included in the area A5, for example, the elements of the element e (n−b) − (1) to the element e (n−b) − (10). Are classified. Subsequently, the electronic device 1 refers to the user attribute data and the user attribute correspondence priority table 9D, and for example, the elements of the element e (n−b) − (1) to the element e (n−b) − (10). From the, select the element corresponding to the priority corresponding to the user attribute data. For example, when the elements of the element e (n−b) − (1) to the element e (n−b) − (10) are selected, the electronic device 1 sets the element e (n−b) − (1). _{, Assign to the physical key 30b 9} included in the second physical key group G2, assign the elements e (n−b) − (2) to the physical key 30b ₈ included in the second physical key group G2, and so on. , Each selected element is assigned to the physical key included in the second physical key group G2.

_{When the electronic device 1 receives an operation of the physical key 30a 4} to which the area A6 corresponding to the graph of the spreadsheet screen C3 is assigned, for example, as shown in FIG. 24, the element of the spreadsheet screen C3 included in the area A6. Is classified based on the element classification rule 9C. That is, the electronic device 1 executes the classification related to the chart included in the spreadsheet screen C3. In the example shown in FIG. 24, the element en- (1) and the element en- (2) are classified as the elements of the spreadsheet screen C3 included in the area A6. Subsequently, the electronic device 1 refers to the user attribute data and the user attribute correspondence priority table 9D, and has a priority corresponding to the user attribute data from the classified elements en- (1) and element en- (2). Select the elements that correspond to. For example, when the element en- (1) and the element en- (2) are selected, the electronic device 1 assigns the _{element en- (1) to the physical key 30b 9 included in the second physical key group G2.} , Element en- (2) is assigned _{to the physical key 30b 8} included in the second physical key group G2.

FIG. 25 is a diagram showing another example of the key data 9B according to the embodiment. FIG. 26 is a diagram showing the correspondence between the physical key and the assigned element according to the embodiment. When executing the allocation shown in FIGS. 21 to 24, as shown in FIG. 25, the electronic device 1 uses the data related to the allocation as key data so that the correspondence between the physical key and the element assigned to the physical key can be understood. Record on 9B. In the example shown in FIG. 25, in the n-a cycle (a is a natural number) of the allocation division / element, a line (a is a natural number) is connected to the physical key 30a ₂ , the physical key 30a _3, and the physical key 30a ₄ of the first physical key group G1. 1), line (2) and line (3) are assigned. Further, in the example shown in FIG. 25, in the n-a cycle (a is a natural number) of the allocation division / element, the physical keys 30b ₉ to the physical keys 30b ₃ of the second physical key group G2, the columns (A) to Column (G) is assigned. For example, line (1) shows the first row of each row placed on the worksheet as shown in FIG. 26, and column (A) is placed on the worksheet as shown in FIG. The Ath column in each column is shown. In this way, on the spreadsheet screen C3, in consideration of the operability of the worksheet, each row on the worksheet is assigned to the physical key of the first physical key group G1 and the physical key of the second physical key group G2 is assigned. You may assign each column on the worksheet.

FIG. 27 is a diagram showing another example of the operation of the electronic device according to the embodiment. FIG. 27 shows an operation on the physical key when the user operates the physical key after the assignment of the element included in the spreadsheet screen C3 outlined with reference to FIGS. 21 to 26 to the physical key is completed. Indicates the operation executed by the electronic device 1 according to the above.

As shown in FIG. 27, when the electronic device 1 detects an operation on the _{physical keys 30a 5} to which the function of "advance one" is assigned among the physical keys of the first physical key group G1, the electronic device 1 has a second physical key group. The element assigned to the physical key of the physical key group G1 of 1 is shifted from the element of the first round to the element of the second round (step S51).

_{When the electronic device 1 detects an operation on the physical key 30a 2} to which the element of "text" is assigned among the physical keys of the first physical key group G1, the text in the cell included in the worksheet is displayed. The state transitions to an operable state by the physical key of the physical key group G2 of 2 (step S52).

_{When the electronic device 1 detects the operation of the physical key 30b 9} of the second physical key group G2, the content (“time (t)” described in the text in the cell, which is an element assigned to the physical key 30b _9. ) Is output (step S53).

_{When the electronic device 1 detects the operation of the physical key 30b 8} of the second physical key group G2, it reads out the content (“2πt”) described in the text in the cell, which is an element assigned to the physical key 30b _8. The voice M12 is output (step S54).

FIG. 28 is a diagram showing an outline of assignment of elements included in the document editing screen according to the embodiment to physical keys. Regarding the assignment of the elements included in the document editing screen displayed on the touch screen display 2 to the physical keys, in the case of the web screen C1 (FIGS. 6 to 12 and the like) and in the case of the spreadsheet screen C3 (FIGS. 21 to 24 and the like). ) Is basically the same. That is, as shown in FIG. 28, the electronic device 1 sets the document editing screen C4 displayed on the touch screen display 2 in the areas A7, A8, and A9 on the touch screen display 2. The electronic device 1 allocates the area A7 to the physical key 30a ₂ of the first physical key group G1, the area A8 to the physical key 30a ₃ of the first physical key group G1, and the area A9 to the first physical key group. It is assigned to the physical key 30a _{4 of G1.} Although detailed description is omitted, the electronic device 1 classifies the elements of the document editing screen C4 included in each of the areas A7, A8, and A9 based on the element classification rule 9C, and classifies the classified elements into user attribute data. The selected elements are assigned to the physical keys of the second physical key group G2.

In the present specification, characteristic embodiments have been described in order to fully and clearly disclose the technology according to the accompanying claims. However, the appended claims are not limited to the above embodiments, and all modifications and alternatives that can be created by those skilled in the art within the scope of the basic matters set forth herein. It should be embodied in a possible configuration.

1 Electronic device 2 Touch screen display 2A Display 2B Touch screen 3 Button 4 Illumination sensor 5 Proximity sensor 6 Communication unit 7 Receiver 8 Microphone 9 Storage 9A Control program 9B Key data 9C Element classification rule 9D User attribute correspondence Priority table 9Z Setting data 10 Controller 11 Speaker 12 Camera 13 Camera 14 Connector 15 Motion sensor

Claims (4)

With the housing
With one or more physical keys lined up along the edge of the housing,
A storage that stores rules including priorities set for each element included in the content for each type of the content in order to classify the elements included in the content and assign the classified elements to the physical key. ,
An electronic device including a controller that classifies elements included in the content based on the rules and assigns elements having the priority associated with user attributes from the classified elements to one or a plurality of physical keys. .. The electronic device according to claim 1, wherein the user attribute is information on the user's visual acuity. With the housing
With one or more physical keys lined up along the edge of the housing,
A storage that stores rules including priorities set for each element included in the content for each type of the content in order to classify the elements included in the content and assign the classified elements to the physical key. ,
In the control method of electronic devices equipped with
A control method in which elements included in the content are classified based on the rules, and elements having the priority associated with user attributes are assigned to one or a plurality of physical keys from the classified elements. With the housing
With one or more physical keys lined up along the edge of the housing,
A storage that stores rules including priorities set for each element included in the content for each type of the content in order to classify the elements included in the content and assign the classified elements to the physical key. ,
For electronic devices equipped with
Control to classify the elements included in the content based on the rule and execute a step of assigning the element having the priority associated with the user attribute from the classified elements to one or a plurality of physical keys. program.

Images