JP7631056B2 - Information processing device, control method, program, and storage medium - Google Patents

Description

The present invention relates to an information processing device, a control method, a program, and a storage medium.

In communication terminals and e-book terminals equipped with a web browser, it is possible to select a part of the content consisting of characters, images, etc. displayed on the screen. There is also technology for displaying the contents of a selected range when the selected range is too large to fit on the screen. Patent Document 1 discloses a technique for reducing the selected range so that it is displayed in its entirety, and for displaying thumbnails of multiple pages that include the selected range when the selected range spans multiple pages. Patent Document 2 discloses a technique for changing the display layout, such as the character size and line spacing of the text, so that when text is selected, the characters of the selection start line and selection end line are displayed.

JP 2004-86621 A JP 2013-8201 A

However, in conventional technologies, including those described in the above patent documents, the text size is reduced and the display layout is changed, making it difficult to read the contents of the selected range.

The present invention aims to make the contents of a selected range easy to understand even when the selected range does not fit on the screen.

In order to solve the above problems, an information processing device of the present invention is an information processing device capable of displaying content, and has a reception means for receiving an instruction to specify a selection range for a part of the content, a determination means for determining first information based on information relating to a first endpoint which is an endpoint outside a display area in which the content is displayed, when the endpoint of the selection range is outside the display area, a display control means for controlling the first information to be displayed superimposed within the display area, and a touch panel , wherein the reception means receives the instruction by operating the touch panel .

According to the present invention, the contents of the selected range can be made easy to understand even if the selected range does not fit on the screen.

FIG. 2 is a diagram illustrating an example of a hardware configuration of an information processing device. FIG. 2 is a diagram illustrating an example of a functional configuration of an information processing device. FIG. 11 is a diagram showing a display example of presentation information. 13 is a flowchart showing a presentation information display process. 5 is a flowchart showing details of the process of S406 in FIG. 4. FIG. 11 is a diagram showing a display example of presentation information. 5 is a flowchart showing details of the process of S407 in FIG. 4. 13 is a flowchart showing a display area changing process. 13A and 13B are diagrams for explaining an operation of expanding or contracting a selection range. 5 is a flowchart showing details of the process of S407 in FIG. 4. 5 is a flowchart showing details of the process of S406 in FIG. 4. FIG. 11 is a diagram showing a display example of presentation information. FIG. 11 is a diagram showing a display example of presentation information.

The following describes an embodiment of the present invention with reference to the drawings.

<Embodiment 1>
In this embodiment, the information processing device 100 is, for example, a portable device such as a smartphone that is browsed and operated by a user, and is capable of displaying content including characters, images, etc., in a web browser (hereinafter, referred to as a browser). Note that the information processing device 100 is not limited to the above-mentioned portable device, and may be a general-purpose computer such as a PC (personal computer), an MFP (multifunction peripheral), etc., as long as it is a device capable of displaying content.

1 is a diagram showing an example of the hardware configuration of an information processing device 100 according to this embodiment. The information processing device 100 includes a CPU 101, a ROM 102, a RAM 103, a touch panel display 104, and a storage device 105, which are connected to each other by a bus 106. The CPU 101 controls the entire information processing device 100. The CPU 101 loads a program stored in the ROM 102 or the like into the RAM 103 and executes it, whereby the information processing device 100 controls each component to realize the processing of the flowchart described below. The ROM 102 stores various programs including a browser application program, and data necessary for the CPU 101 to execute processing based on the program. Note that the application is not limited to a browser application, and various applications in practical use can be used as long as they are capable of displaying content. The RAM 103 temporarily stores the programs and data read out from the ROM 102 by the CPU 101.

The touch panel display 104 is integrally configured with a touch panel as an input device and a display as a display device. For example, the touch panel is configured so that the light transmittance does not interfere with the display of the display, and is attached to the upper layer of the display surface of the display. By associating position coordinates on the touch panel with display coordinates on the display screen of the display, a GUI (graphical user interface) is provided that makes it seem as if the screen displayed on the display can be directly operated. The touch panel display 104 provides operation information operated by the user to the CPU 101. The operation information is, for example, position coordinates touched with a finger or pen, and time information of touch. The touch panel display 104 may be configured with input devices such as a keyboard and a mouse, and a display device such as a liquid crystal panel, separately. The storage device 105 is an auxiliary storage device such as a HDD, and stores content data acquired from a content server on a network via a network interface (not shown), content data acquired from an external storage device, etc.

Fig. 2 is a diagram showing an example of the functional configuration of the information processing device 100 according to this embodiment. The information processing device 100 functions as a reception unit 200 that receives instructions from a user's operation, a presentation information determination unit 201, and a display control unit 202, by the CPU 101 expanding a program stored in the ROM 102 into the RAM 103 and executing it. Each functional unit will be described below.

The reception unit 200 receives instructions according to user operations. More specifically, the reception unit 200 first determines the type of touch operation input based on operation information provided by the touch panel display 104. Touch operations include, for example, a tap operation in which a finger or pen touches the touch panel and is then removed from the touch panel, and a drag operation in which a finger or pen touches the touch panel and the finger or pen is moved without removing it from the touch panel and then released. Another example is a swipe operation in which a finger or pen is slid while touching the touch panel. When the reception unit 200 detects a swipe operation, it recognizes it as an instruction to scroll the screen in the direction in which the finger or pen is moved.

The reception unit 200 manages the position coordinates of the touch panel display 104 and the display coordinates of the components of the content, such as characters and images, in association with each other, based on the display layout information of the content calculated by the display control unit 202. Therefore, when the reception unit 200 detects a tap operation or a drag operation, it can recognize the character or image at the touched position as an instruction to specify the start point or end point of a selection range. In other words, the reception unit 200 receives an instruction to specify a selection range for a part of the content by operating the touch panel display 104. The reception unit 200 stores information about the specified selection range in the RAM 103. The reception unit 200 updates the information stored in the RAM 103 every time the start point or end point of the selection range is changed.

When an end point of the selection range is outside the display area of the content, the presentation information determination unit 201 determines the presentation information to be presented to the user based on information about the end point outside the display area. The end points of the selection range here are the start point and end point of the selection range. Specifically, the presentation information determination unit 201 first reads information about the selection range from the RAM 103, obtains position information of the end points of the selection range, and determines whether the end points are inside or outside the display area. If it is determined that any one of the end points is outside the display area, the presentation information determination unit 201 determines the presentation information based on the information about the selection range, position information of the components of the content, such as characters and images, in the display area, and the content data to be displayed. Furthermore, the presentation information determination unit 201 determines information that specifies the display mode when the determined presentation information is displayed.

The display control unit 202 controls the display content displayed on the touch panel display 104. Specifically, the display control unit 202 reads out content data to be displayed from the storage device 105, calculates display layout information for the read out content data, and displays the content on the touch panel display 104 in a layout according to the calculation result. When a selection range is specified by the reception unit 200, the display control unit 202 changes and displays the background of characters, images, etc. within the specified selection range. When the reception unit 200 instructs scrolling of the screen, the display control unit 202 moves the position of the display area by the instructed movement amount in the instructed direction. The display control unit 202 displays the presentation information determined by the presentation information determination unit 201 in a specified display mode, superimposed on the content in the display area.

Next, the presentation information display process for displaying the presentation information will be described with reference to Figs. 3 and 4. Fig. 3(A) is a diagram showing a display example when a part of the content is selected. First, the range of the display area 301 surrounded by a solid line is displayed on the touch panel display 104 with respect to the entire range of the content 300 surrounded by a dotted line. When a part of the content 300 is selected, the background of the selected range 303 is changed. The coordinate system 302 used in the following description is defined by coordinate axes with the upper left corner of the display area 301 as the origin. The horizontal axis is positive in the rightward direction, and the vertical axis is positive in the downward direction.

3B is a diagram showing a display example when scrolling is performed in the direction of the arrow 310 in the state of FIG. 3A. When a part of the content 300 is selected, as shown in FIG. 3B, if a user operation is performed to change the display area, such as scrolling or zooming the screen, a part of the selected range 303 may go outside the display area 301. In such a case, the user cannot properly grasp the contents of the selected range. Therefore, when an end point of the selected range goes outside the display area, the information processing device 100 determines the presentation information based on information about the end point outside the display area, and controls so that the determined presentation information is displayed superimposed in the display area. In the example of FIG. 3B, in response to the scroll operation in the direction of the arrow 310, the fifth character "na" in the fourth line from the top of the content 300, which is the start point of the selected range 303, goes outside the display area 301, so that the presentation information 304 for the start point is displayed in the display area 301.

Figure 4 is a flowchart showing the flow of the presentation information display process. In this embodiment, CPU 101 periodically executes the process of the flowchart in Figure 4 from the time CPU 101 launches the browser application until it is terminated. Note that the process may also be executed non-periodically at the time of user operation or other timing. CPU 101 may also accept various other instructions (e.g., an instruction to change the display layout of content, an instruction to specify a selection range, an instruction to scroll) while the browser application is running, and execute processing as appropriate. In that case, CPU 101 may execute that processing in parallel with the processing of the flowchart in Figure 4. Below, each step of the flowchart will be explained with an S added to the beginning of the reference number.

In S400, CPU 101 obtains information about the specified selection range from RAM 103. In the example of Fig. 3B, since selection range 303 is specified, the fifth character "na" on the fourth line from the top of content 300 is obtained as information indicating the start point of selection range 303, and the eighth character "wo" on the sixth line is obtained as information indicating the end point of selection range 303.
Next, in S401, the CPU 101 determines whether or not a part of the content is in a state where a range is selected based on the information acquired in S400. If the CPU 101 determines that a range is selected (Yes in S401), the process proceeds to S402. If the CPU 101 determines that a range is not selected (No in S401), the process of this flowchart ends.

In step S402, the CPU 101 acquires position information of the start point of the selection range (hereinafter, referred to as the start position). In the example of FIG. 3B, the center coordinates of the bounding box of the character “na” at the start point of the selection range 303 are acquired as the start position 305.
Next, in step S403, the CPU 101 acquires position information of the end point of the selection range (hereinafter, referred to as the end position). In the example of FIG. 3B, the central coordinates of the bounding box of “” at the end point of the selection range 303 are acquired as the end position 306.
In this embodiment, the position coordinates of the end points of the selection range are determined as the center coordinates of the bounding box of the character at the end point, but the method of determining the position coordinates of the end points of the selection range is not limited to this. For example, the CPU 101 may determine them as the end point coordinates of the bounding box. Furthermore, if the end points of the selection range are images, the CPU 101 may determine them as the center coordinates, center of gravity coordinates, end point coordinates, etc. of the image.

Next, in S404, the CPU 101 acquires position information indicating the range of the display area. In this embodiment, the CPU 101 acquires position information indicating the range of the display area based on display layout information of the content data to be displayed.
Next, in S405, the CPU 101 determines whether or not both the start point and the end point of the selection range are inside the display area. Here, the CPU 101 makes the determination based on the position information acquired in S402, S403, and S404. If it is determined that both the start point and the end point of the selection range are inside the display area (Yes in S405), the processing of this flowchart ends. If it is determined that either one of the start point and the end point of the selection range is outside the display area (No in S405), the processing proceeds to S406.

In the example of FIG. 3B, the four characters from the starting point "na" of the selection range 303 are not displayed because they are outside the display area 301. If part of the selection range 303 is not displayed in this way, the user may miss a mistake in the range selection, or may not know from where or to what extent the range is selected. Therefore, in S406, the CPU 101 determines the information to be presented based on information about the end points that are outside the display area. Details of the processing executed in S406 will be described later with reference to FIG. 5.

Next, in S407, the CPU 101 determines information for designating a display mode when the presentation information determined in S406 is displayed. Details of the process executed in S407 will be described later with reference to FIG.
Next, in S408, the CPU 101 displays the presentation information determined in S406 in the display mode specified in S407, superimposed within the display area. In the example of Fig. 3B, "tsute to naninu" is displayed as the presentation information 304 determined in S406, superimposed on the content 300. Thereafter, the processing of this flowchart ends.

FIG. 5 is a flowchart showing the details of the process of S406 in FIG.
In S500, CPU 101 determines whether an image is specified at an end point outside the display area. Here, CPU 101 makes the determination based on the information on the selection range acquired in S400 and the position information acquired in S402, S403, and S404. If it is determined that an image is specified at an end point outside the display area (Yes in S500), the process proceeds to S511. If it is determined that an image is not specified at an end point outside the display area (No in S500), it is determined that a character is specified at an end point outside the display area, and the process proceeds to S501.

In S501, the CPU 101 determines whether or not an end point outside the display area is the start point of the selection range. Here, the CPU 101 makes the determination based on the position information acquired in S402, S403, and S404. If it is determined that an end point outside the display area is the start point of the selection range (Yes in S501), the process proceeds to S502. If it is determined that an end point outside the display area is not the start point of the selection range (No in S501), the process proceeds to S506.

In S502, CPU 101 determines the presentation information based on information about the start point of the selection range. In this embodiment, CPU 101 determines the presentation information based on a character string that includes the character at the start point of the selection range and is within the selection range. Specifically, a character string of a predetermined number of characters starting with the character at the start point is determined as the presentation information. In the example of FIG. 3B, "naninu", a three-character character string starting with the start point "na", is determined. Note that the method of determining the presentation information is not limited to a method using a character string of a predetermined number of characters starting with a character at an end point, and may be a method using a word or phrase that includes the character at the end point. In the following S503 to S505, the presentation information determined in S502 is referred to as end point information.

In the example of FIG. 3B, the character string "naninu" exists as endpoint information in four places in content 300. In this way, when a part that is the same as or similar to the part indicated by the endpoint information exists in the content, displaying only the endpoint information may prevent the user from correctly recognizing where in the content the endpoint information indicates. Therefore, CPU 101 determines information for identifying the start point of the selected range as additional information, and displays the determined additional information together with the endpoint information. In this embodiment, CPU 101 determines the additional information based on a character string that is outside the selected range and includes characters adjacent to the endpoint character that is outside the display area.

First, in S503, the CPU 101 determines whether or not a character string identical to or similar to the character string indicated by the endpoint information exists in the content. In the example of FIG. 3B, it determines whether or not the same character string "naninu" as the character string indicated by the endpoint information exists in the content 300. If it is determined that an identical or similar character string exists (Yes in S503), the process proceeds to S504. If it is determined that an identical or similar character string does not exist (No in S503), the process proceeds to S506.

In S504, the CPU 101 determines information for identifying the start point of the selection range as additional information. In this embodiment, the CPU 101 determines a character string of a predetermined number of characters preceding the character at the start point as additional information. In the example of FIG. 3B, the CPU 101 determines "tsuteto", which is the three character string preceding the start point "na". The method of determining additional information may be a method using character strings in the lines before and after the line where the endpoint exists, the line number or page number where the endpoint exists, or a character string indicating the chapter title of the chapter where the endpoint exists.

Next, in S505, the CPU 101 combines the endpoint information with the additional information determined in S504 to determine new presentation information. In this embodiment, the CPU 101 determines "tsute to naninu" as the new presentation information, which is a combination of "naninu" as the endpoint information and "tsute to" as the additional information.

Next, in S506, CPU 101 determines whether the end point outside the display area is the end point of the selected range. Here, CPU 101 makes the determination based on the position information acquired in S402, S403, and S404. If it is determined that the end point outside the display area is the end point of the selected range (Yes in S506), processing proceeds to S507. If it is determined that the end point outside the display area is not the end point of the selected range (No in S506), processing proceeds to S407 in FIG. 4.

The following explanation of the processes in S507 to S510 will be simplified because it is the same as the explanation of the processes in S502 to S505 except that the start points are replaced with end points.
In S507, the CPU 101 determines the presentation information based on information about the end point of the selection range. Specifically, the CPU 101 determines the character string of a predetermined number of characters up to the character at the end point as the presentation information. In the following S508 to S510, the presentation information determined in S507 is referred to as end point information.

Next, in S508, the CPU 101 determines whether or not a character string identical to or similar to the character string indicated by the endpoint information exists in the content. If it is determined that an identical or similar character string exists (Yes in S508), the process proceeds to S509. If it is determined that an identical or similar character string does not exist (No in S508), the process proceeds to S407 in FIG.
In S509, the CPU 101 determines information for identifying the end point of the selected range as the additional information. In this embodiment, a character string of a predetermined number of characters beginning with the character next to the end point is determined as the additional information.
Next, in S510, the CPU 101 combines the end point information with the additional information determined in S509 to determine new presentation information. After that, the process proceeds to S407 in FIG.

Next, the process to be performed when the determination in S500 is Yes will be described.
In S511, the CPU 101 acquires character information related to an image that is specified at an end point outside the display area from the content data to be displayed. The character information here is, for example, the title, file name, and caption of the image.
Next, in S512, the CPU 101 determines the presentation information based on the character information acquired in S511. Fig. 6 is a diagram showing an example of the display of the presentation information when the end point outside the display area is an image. In Fig. 6, the end point of the selection range 303 is outside the display area 301, and the image 307 is specified as the end point. In this case, the CPU 101 acquires the title name "Vehicle" of the image 307 at the end point of the selection range 303, and determines "Picture: Vehicle" using this as the presentation information 304. Thereafter, the process proceeds to S407 in Fig. 4.

In S512, CPU 101 determines the presentation information based on character information related to the image, but it may also determine the presentation information based on reduced image data or partial image data. In addition, if a character string identical to or similar to the character string indicated by the presentation information determined in S512 exists in the content, CPU 101 may additionally obtain character information related to the image, determine additional information using the obtained information, and combine it with the presentation information determined in S512.

According to the above flowchart in Figure 5, it is possible to present to the user a character string near the start point that is outside the display area. Furthermore, if a character string similar to the character string near the start point exists in the content, additional information for identifying the start point is also presented, allowing the user to correctly recognize where in the content the start point is located. The same effect can be achieved with respect to the end point.

FIG. 7 is a flowchart showing the details of the process of S407 in FIG.
In S700, the CPU 101 determines whether the presentation information determined in S406 includes additional information. If it is determined that the presentation information does not include additional information (No in S700), the normal display mode is determined, and the process proceeds to S408 in Fig. 4. If it is determined that the presentation information includes additional information (Yes in S700), the process proceeds to S701.

In S701, the CPU 101 specifies different display modes for the end point information and the additional information included in the presentation information. In this embodiment, the CPU 101 assigns display flags indicating the display modes to the portions of the presentation information corresponding to the end point information and the portions corresponding to the additional information. For example, a flag for displaying characters in an emphasized manner is specified as the display flag assigned to the portion corresponding to the end point information. Also, a flag for displaying characters in a small size is specified as the display flag assigned to the portion corresponding to the additional information. In the display example of FIG. 3B, a flag for displaying characters in bold is specified for the end point information "nani nu", and a flag for displaying characters in a small size is specified for the additional information "tsu te to". Note that the CPU 101 may use character color, highlighting, or the like to differentiate the display modes. After that, the process proceeds to S408 in FIG. 4. In S408, the CPU 101 displays the end point information and the additional information in different display modes according to the display flag.

The flowchart in Figure 7 allows the user to distinguish at a glance between the endpoint information and the additional information contained in the presented information, making it easier for the user to understand where in the content the start and end points of the selected range indicate.

According to the present embodiment as described above, even if the selected range does not fit within the display area, it is possible to grasp the start and end of the selected range. In addition, since the character size and display layout do not change, the contents of the intermediate part of the selected range are also easy to read. Therefore, the effect of presenting the contents of the selected range to the user in an easy-to-understand manner is obtained.

<Embodiment 2>
In the second embodiment, a process for preventing the presentation information from overlapping the end points of the selection range in the display area will be described with reference to FIGS. 8 to 10. The hardware configuration of the information processing device 100 according to this embodiment is the same as that of the first embodiment shown in FIG. 1, and therefore will not be described again. The functional configuration of the information processing device 100 according to this embodiment is the same as that of the first embodiment shown in FIG. 2, except for the following differences. The first difference is that the reception unit 200 further receives an instruction to select the presentation information on the screen. The second difference is that the display control unit 202 changes the position of the display area of the content so that the end points corresponding to the selected presentation information are displayed in the display area. The third difference is that the presentation information determination unit 201 determines the display mode of the presentation information so that the presentation information does not overlap the end points in the display area. The following mainly describes the differences from the first embodiment.

Fig. 8 is a flowchart showing a process of changing a display area. The flowchart of Fig. 8 is executed in parallel with the flowchart of Fig. 4. However, in this embodiment, the process of determining the display mode of the presented information executed in S407 of Fig. 4 is different from that of the first embodiment. The flowchart of Fig. 8 is started when the flowchart of Fig. 4 is executed and the presented information is displayed.
First, in S800, the CPU 101 determines whether or not an instruction to select presented information has been given based on operation information from the touch panel display 104. In this embodiment, it is determined that an instruction to select presented information has been given when the touched position coordinates are within the coordinate range in which the presented information is displayed. The process of S800 is repeated until an instruction to select is given, and if an instruction to select is given (Yes in S800), the process proceeds to S801.

Figure 9 (A) is a diagram showing a state in which the user has selected presented information 304. In the example of Figure 9 (A), the start point "na" of selected range 303 is outside the display area 301. If the user attempts to extend or resize a selected range when an end point of the selected range is outside the display area, the display area must be adjusted by screen scrolling or the like so that the end point of the selected range is displayed. The longer the selected range, the greater the effort required. Therefore, when presented information is selected, the CPU 101 changes the position of the display area so that the end point of the selected range corresponding to the selected presented information is located within the display area.

In step S801, the CPU 101 acquires position information of the end points of the selection range corresponding to the presentation information selected by the user. In the example of Fig. 9A, since the presentation information 304 is selected, the CPU 101 acquires the center coordinates of the bounding box of "na" at the start point of the selection range 303 as the start position 305.
Next, in S802, the CPU 101 calculates the amount of change in the display area to display the endpoints of the selection range within the display area. In this embodiment, to display the endpoints of the selection range at the vertical center of the display area, the CPU 101 calculates the amount of vertical movement of the display area based on the vertical center position of the display area and the position information of the endpoints of the selection range (start position 305 of the selection range 303 in FIG. 9A). Note that the position at which the endpoints are displayed is not limited to the center of the display area, and may be, for example, the beginning of the display area. The CPU 101 may also calculate the zoom factor of the display area as the amount of change in the display area.

Next, in S803, the CPU 101 changes the display area based on the change amount calculated in S803. In this embodiment, the CPU 101 moves the position of the display area of the content by the movement amount calculated in S803. Then, the process of this flowchart ends.
Fig. 9(B) is a diagram showing a state after a process for changing display area 301 from the state of Fig. 9(A) has been executed. As shown in Fig. 9(B), the start point "na" of selection range 303 is displayed within display area 301. Meanwhile, the end point "K" of selection range 303 that was displayed within display area 301 has moved outside display area 301, so "IJK" is displayed within display area 301 as presentation information 304 for end point "K".

According to the flowchart in Figure 8, the start point or end point that was outside the display area is automatically scrolled so that it is displayed within the display area with a single operation, making it easy to extend or resize a long selection range later.

9(C) is a diagram showing how the start position 305 of the selection range 303 is changed from the state shown in FIG. 9(B). In this embodiment, the user changes the end point of the selection range by dragging the end point of the selection range. Based on the operation information from the touch panel display 104, the CPU 101 designates the text, image, etc. of the content that is closest to the drag end coordinate as the end point of the new selection range. Note that there is no need to wait until the operation to change the position of the end point of the new selection range is completed (in the case of a drag operation, the user's finger or pen is removed from the touch panel display 104). The drag end position is detected periodically at short intervals or irregularly (such as when the user's finger or pen touching the touch panel display 104 moves), and each time, the CPU 101 updates the information about the selection range stored in the RAM 103.

Next, the details of the process of S407 in FIG. 4 according to this embodiment will be described with reference to the flowchart of FIG.
In S1000, the CPU 101 determines whether or not the selection range is being expanded or contracted. In this embodiment, it determines whether or not a drag operation is being performed on an end point of the selection range. If it is determined that the selection range is not being expanded or contracted (No in S1000), the process proceeds to S408 in Fig. 4. If it is determined that the selection range is being expanded or contracted (Yes in S1000), the process proceeds to S1001.

In S1001, the CPU 101 acquires position information indicating an area where the presentation information should be displayed based on the presentation information determined in S406. For example, the CPU 101 acquires the coordinates of the area where the presentation information should be displayed based on the content amount of the presentation information, the position information of the end points corresponding to the presentation information, etc. The coordinates acquired here are, for example, the center coordinates, the center of gravity coordinates, the end point coordinates, etc. of the area where the presentation information should be displayed.
Next, in S1002, CPU 101 determines whether or not the presented information overlaps an end point of the selection range based on the position information acquired in S1001. In this embodiment, CPU 101 compares the touched position on touch panel display 104 (end point of the newly specified selection range) with the coordinates acquired in S1001, and determines whether or not the distance between the two points is within a predetermined value. If it is determined that the presented information does not overlap an end point of the selection range, the process proceeds to S408 in Fig. 4. If it is determined that the presented information overlaps an end point of the selection range, the process proceeds to S1003.

In S1003, CPU 101 determines the display mode of the presented information so that the presented information does not overlap the end points of the selection range. In this embodiment, CPU 101 assigns a display flag to the presented information to hide it. As a result, the presented information is not displayed in S408. Note that CPU 101 is not limited to hiding the display mode of the presented information, and may shift the display position of the presented information or reduce the character size of the presented information, as long as the presented information is in a form that prevents it from overlapping the end points of the selection range. Furthermore, if the presented information includes additional information, CPU 101 may hide only the display mode of the additional information.

Fig. 9 (D) is a diagram showing an example of a display when, in the state of Fig. 9 (C), the start position 305 of the selection range 303 is changed in the direction of the arrow, thereby shrinking the selection range 303, and it is determined that the changed start position 305 overlaps with the presented information 304. As shown in Fig. 9 (D), as the start position 305 approaches the presented information 304, the presented information 304 is hidden.

According to the flowchart in Figure 10, the presented information does not obscure the end points of the selection range, making it easier to expand or contract the selection range.

As a modification of the second embodiment, the presentation information determination unit 201 may determine the presentation information so that the presentation information does not overlap with end points within the display area. For example, the presentation information determination unit 201 may reduce the content amount of the presentation information to a reference value or less so that the area in which the presentation information should be displayed becomes smaller. Even in this case, the same effect as when the display mode of the presentation information is changed as shown in the flowchart of FIG. 10 can be obtained.

<Embodiment 3>
In the third embodiment, a process for preventing the presentation information from hiding the selected range will be described with reference to Figs. 11 and 12. The hardware configuration of the information processing device 100 according to this embodiment is similar to that of the first embodiment shown in Fig. 1, and therefore will not be described again. The functional configuration of the information processing device 100 according to this embodiment is similar to that of the first embodiment shown in Fig. 2, except for the following differences. The difference is that the presentation information determination unit 201 adjusts the content amount of the presentation information based on the degree to which the display range of the presentation information overlaps with the selected range in the display area. The following description will focus on the differences from the first embodiment.

In this embodiment, the flowchart in Fig. 4 is also executed. However, in this embodiment, the process of determining presentation information executed in S406 in Fig. 4 is different from that in embodiment 1. Details of the process in S406 in Fig. 4 in this embodiment will be described with reference to the flowchart in Fig. 11.
First, in S1100, the CPU 101 executes the same processes as in S500 to S512 in Fig. 5. As a result, presentation information is determined in the same manner as in the first embodiment.
Next, in step S1101, the CPU 101 acquires the display range of the presentation information based on the presentation information determined in step S1100. In this embodiment, the CPU 101 calculates the coordinate range of the area in which the presentation information should be displayed.

Next, in S1102, the CPU 101 acquires the area of the selection range within the display area based on the position information indicating the range of the display area and the position information of the endpoints of the selection range, etc. In this embodiment, the CPU 101 calculates a coordinate range indicating the area of the selection range within the display area.
Next, in S1103, the CPU 101 determines whether the display range of the presentation information overlaps the selection range in the display area to a large extent. In this embodiment, the CPU 101 uses the coordinate information calculated in S1101 and S1102 to calculate the ratio of the size of the display range of the presentation information to the size of the selection range in the display area, and determines whether the ratio is equal to or greater than a first threshold value (for example, 1/4). If it is determined that the display range of the presentation information overlaps the selection range in the display area to a large extent (Yes in S1103), the presentation information covers most of the selection range in the display area, and the process proceeds to S1104. If it is determined that the display range of the presentation information does not overlap the selection range in the display area to a large extent (No in S1103), the process proceeds to S1105. Note that the index representing the degree to which the display range of the presentation information overlaps the selection range in the display area is not limited to the ratio of the size of the display range of the presentation information to the size of the selection range in the display area. For example, the ratio of the number of characters included in the display range of the presented information to the number of characters included in the selection range in the display area may be used.

In S1104, the CPU 101 changes the content amount of the presented information. In this embodiment, the CPU 101 determines new presented information by reducing the number of characters of the presented information determined in S1100 by a predetermined number of characters (for example, one character). Then, the process proceeds to S407 in FIG. 4.
Fig. 12A is a diagram showing a display example in which the presented information "What is it?" is determined in the process of S1100, and the content amount is reduced in the process of S1104. In Fig. 12A, the last character of the presented information is reduced, and "What is it?" is displayed as presented information 304. This reduces the extent to which the selected range in the display area is hidden by the presented information, making both the presented information and the selected range easier to read.

In S1105, CPU 101 determines whether the extent to which the display range of the presentation information overlaps with the selection range in the display area is sufficiently small. In this embodiment, CPU 101 determines whether the ratio of the size of the display range of the presentation information to the size of the selection range in the display area calculated in S1103 is smaller than a second threshold (e.g., 1/6). The second threshold is smaller than the first threshold used in S1103. If it is determined that the extent to which the display range of the presentation information overlaps with the selection range in the display area is sufficiently small (Yes in S1105), processing proceeds to S1106. If it is determined that the extent to which the display range of the presentation information overlaps with the selection range in the display area is not sufficiently small (No in S1105), processing proceeds to S407 in FIG. 4.

In S1106, the CPU 101 changes the content amount of the presented information. In this embodiment, the CPU 101 increases the number of characters of the presented information by a predetermined number of characters (for example, two characters) and determines new presented information. After that, the process proceeds to S407 in FIG.
Fig. 12B is a diagram showing a display example in which the presented information "What is it?" is determined in the process of S1100, and the amount of content is increased in the process of S1106. In Fig. 12B, the number of characters of the presented information is increased by two, and "What is it?" is displayed as presented information 304. This makes it possible to increase the amount of information in the presented information while only slightly hiding the selected range in the display area, making the content of the selected range even easier to understand.

According to this embodiment as described above, the display of the presented information can be adjusted so as not to obscure the selected range in the display area, making it possible to present the contents of the selected range in an even easier-to-understand manner.

As a modified example of the third embodiment, the presentation information determination unit 201 may determine the display mode of the presentation information based on the degree to which the display range of the presentation information overlaps with the selection range in the display area. Specifically, when the display range of the presentation information overlaps with the selection range in the display area to a large extent, the CPU 101 may make the background of the presentation information 304 semi-transparent as shown in FIG. 13(A) so that the contents of the selection range that overlaps with the presentation information 304 can also be seen. As another example, the CPU 101 may move the display position of the presentation information 304 to a position that does not overlap with the selection range as shown in FIG. 13(B). As another example, the CPU 101 may hide the presentation information 304 as shown in FIG. 13(C).

For example, if the display range of the presented information overlaps a large extent with the selection range in the display area and the presented information includes additional information, CPU 101 may hide only the portion that corresponds to the additional information.For example, if the display range of the presented information overlaps a small extent with the selection range in the display area and the presented information does not include additional information, CPU 101 may determine the additional information and display it together with the presented information, thereby increasing the amount of information in the presented information.

The present invention has been described above in conjunction with embodiments, but the above embodiments are merely illustrative examples of how the present invention may be implemented, and the technical scope of the present invention should not be interpreted in a limiting manner based on these embodiments. In other words, the present invention can be implemented in various forms without departing from its technical concept or main features.

Other Embodiments
The present invention can also be realized by a process in which a program for implementing one or more of the functions of the above-described embodiments is supplied to a system or device via a network or a storage medium, and one or more processors in a computer of the system or device read and execute the program. The present invention can also be realized by a circuit (e.g., ASIC) that implements one or more of the functions.

100: Information processing device, 104: Touch panel display, 200: Reception unit, 201: Presentation information determination unit, 202: Display control unit

Claims (18)

An information processing device capable of displaying content,
a receiving means for receiving an instruction to designate a selection range for a part of the content;
a determination means for determining, when an end point of the selection range is outside a display area displaying the content, first information based on information on a first end point that is the end point outside the display area;
a display control means for controlling the display of the first information in a manner superimposed on the display area;
A touch panel and
having
The information processing apparatus according to claim 1, wherein the receiving means receives the instruction by operating the touch panel . the receiving means further receives an instruction to change at least one of a size and a position of the display area in which the content is displayed;
The information processing device according to claim 1, characterized in that the display control means controls so that the first information determined by the determination means is displayed when an end point of the selected range goes outside the display area in response to a change in the display area. The determining means further determines second information for identifying the first endpoint when a portion identical or similar to the portion indicated by the first information is present in the content; and
3. The information processing apparatus according to claim 1, wherein the display control means controls so that the second information is added to the first information and then displayed. The information processing device according to claim 3, characterized in that the display control means controls the display of the first information and the second information in different display modes. The receiving means further receives an instruction to select the first information to be displayed,
The information processing device according to any one of claims 1 to 4, characterized in that when the display control means accepts a selection of the first information by the accepting means, it changes at least one of the size and position of the display area in which the content is displayed so that the first endpoint is displayed within the display area. The information processing device according to any one of claims 1 to 5, characterized in that when a second end point, which is an end point of the selection range different from the first end point, and the first information are displayed in the display area and the reception means receives a change to the second end point, the display control means changes the display mode of the first information so that the first information does not overlap the second end point. The information processing device according to any one of claims 1 to 6, characterized in that the determining means calculates a ratio of the display range of the first information to the selection range in the display area, and adjusts the content amount of the first information based on the ratio. The information processing device according to claim 7, characterized in that the determining means determines new first information by reducing the content amount of the first information used in calculating the ratio when the ratio is greater than a first threshold value. The information processing device according to claim 8, characterized in that the determining means determines new first information by increasing the content amount of the first information used in calculating the ratio when the ratio is smaller than a second threshold value that is smaller than the first threshold value. The information processing device according to any one of claims 1 to 6, characterized in that the display control means calculates a ratio of the display range of the first information to the selection range in the display area, and determines the display mode of the first information based on the ratio. The information processing device according to any one of claims 1 to 10, characterized in that, when a character included in the content is specified at the first endpoint, the determination means determines the first information based on a character string that includes the character specified at the first endpoint and is within the selection range. The information processing device according to claim 11, characterized in that the first information is a character string of a predetermined number of characters starting from the first end point when the first end point is the start point of the selected range, and is a character string of a predetermined number of characters up to the end point when the first end point is the end point of the selected range. The information processing device according to any one of claims 1 to 12, characterized in that, when an image included in the content is specified at the first endpoint, the determination means determines the first information based on at least one of the title, file name, and caption of the image specified at the first endpoint. The information processing device according to claim 3, characterized in that, when a character included in the content is specified at the first endpoint, the determination means determines the second information based on a character string that includes a character adjacent to the character specified at the first endpoint and is outside the selection range. The information processing device according to claim 3, characterized in that the determining means determines the second information based on at least one of the line number on which the first endpoint exists, the page number on which the first endpoint exists, and the chapter title of the chapter on which the first endpoint exists. A method for controlling an information processing device capable of displaying content, comprising:
a receiving step of receiving an instruction to designate a selection range for a portion of the content;
a determination step of determining, when an end point of the selection range is outside a display area displaying the content, first information based on information about a first end point that is the end point outside the display area;
a display control step of controlling the first information to be displayed in a superimposed manner within the display area;
Including,
The information processing device includes a touch panel,
The method for controlling an information processing device , wherein the receiving step receives the instruction by operating the touch panel . A program for causing a computer to function as each of the means of the information processing device according to any one of claims 1 to 15 . A computer-readable storage medium storing a program for causing a computer to function as each of the means of the information processing device according to any one of claims 1 to 15 .

Images