JP7633555B2 - Information processing device, image processing range designation method, and image processing range designation program - Google Patents

Description

The present invention relates to an information processing device, an image processing range designation method, and an image processing range designation program.

In recent years, various online services such as websites (web pages, web services), online games, and application software (hereinafter referred to as "apps") that are delivered to information processing devices such as mobile terminals via computer networks have become widespread.

Apps include, for example, apps for viewing distributed manga and apps for editing images. Such apps are provided with multiple functions, such as a function for advancing or rewinding the progress of the manga displayed on the screen (flip function) and a function for cutting out and processing part of the manga image (trimming function). The user appropriately selects a desired function from among these multiple functions and has the app execute it.

Patent Document 1 discloses an electronic book or portable information device that allows a user to trace the area containing the information they wish to cut out with their index finger, encircle the area with a rectangle, and then remove their finger from the screen, causing the enclosed area to appear as if it were floating on the screen. Patent Document 1 also discloses that a rectangular area can be floated by designating two points P1 and P2 on the screen with the finger, with the line segment connecting the two points as its diagonal.

JP 2000-163444 A

The action of tracing the area of the image to be cut out with a finger as disclosed in Patent Document 1 is similar to the action of moving the area of the image displayed on a touch panel display. Also, the action of specifying two points P1 and P2 on the screen with a finger to determine the area to be cut out is similar to the action of enlarging or reducing an image displayed on a touch panel display.

Therefore, there is a need to develop new actions (gestures) for specifying the area to be trimmed from an image displayed on a touch panel display. It is also desirable for these gestures to be simple.

The present invention has been made in consideration of the above circumstances, and aims to provide an information processing device, an image processing range designation method, and an image processing range designation program that allow a user to easily designate the processing range of an image displayed on a touch panel display.

To solve the above problems, the information processing device, image processing range designation method, and image processing range designation program of the present invention employ the following means.

In order to solve the above problems, an "information processing device" according to one aspect of the present invention is an information processing device that displays content consisting of moving images or still images on a touch panel display, and includes a contact position identification means for identifying a contact position of a pointer on the touch panel display, and a processing range change means for changing a processing range of an image displayed on the touch panel display in accordance with a contact time of the pointer based on the contact position.

In order to solve the above problems, the "image processing range designation method" according to one aspect of the present invention is an image processing range designation method carried out by an information processing device that displays content consisting of moving images or still images on a touch panel display, and includes a first step of identifying a contact position of a pointer on the touch panel display, and a second step of changing the processing range of an image displayed on the touch panel display in accordance with the contact time of the pointer, based on the contact position.

To solve the above problem, the "image processing range designation program" according to one aspect of the present invention causes a computer included in an information processing device that displays content consisting of moving images or still images on a touch panel display to function as a contact position identification means for identifying the contact position of a pointer on the touch panel display, and a processing range change means for changing the processing range of an image displayed on the touch panel display in accordance with the contact time of the pointer, based on the contact position.

The above-mentioned "information processing device" may be subject to various technical limitations, as exemplified below. In addition, technical limitations of the same nature may be applied to the processing steps executed by the "image processing range designation method" or to the functions of the "image processing range designation program."

The processing range change means stops changing the processing range when the indicator is moved away from the touch panel display after starting to change the processing range.

The processing range changing means alternately expands and contracts the processing range by repeatedly contacting and separating the indicator from the touch panel display.

The processing range changing means changes the processing range based on the contact position, changes the processing range in the opposite direction when the pointer moves away from the touch panel display, and stops changing the processing range when the pointer touches the touch panel display thereafter.

The processing range change means changes the rate of change of the processing range each time the processing range is expanded and contracted.

The content is a manga having frames, and the processing range changing means changes the processing range based on the frame of the frame.

The processing range change means expands the processing range based on the contact position, and stops expanding the processing range when the processing range expands to the frame frame that includes the contact position.

When the contact position is shifted from the center of the frame that includes the contact position, the processing range change means controls the speed at which the processing range expands so that the periphery of the processing range reaches multiple sides that form the frame of the frame at the same time.

The present invention has the advantage that a user can easily specify the processing range of an image displayed on a touch panel display.

1 is a configuration diagram of a manga distribution system according to an embodiment of the present invention. FIG. 2 is a block diagram showing an electrical configuration of a server according to an embodiment of the present invention. 2 is a block diagram showing an electrical configuration of a mobile terminal according to an embodiment of the present invention; FIG. FIG. 4 is a schematic diagram showing a trimming range according to the embodiment of the present invention. FIG. 1 is a schematic diagram showing a trimming range for a manga frame border according to an embodiment of the present invention. 11A to 11C are schematic diagrams showing examples of processing for a trimming range according to an embodiment of the present invention; FIG. 2 is a functional block diagram relating to a manga viewing function of a mobile terminal according to an embodiment of the present invention. 4 is a flowchart showing the flow of a trimming range designation process according to an embodiment of the present invention. FIG. 11 is a schematic diagram showing a trimming range according to another embodiment of the present invention.

Below, an embodiment of an information processing device, an image processing range designation method, and an image processing range designation program according to the present invention will be described with reference to the drawings. In this embodiment, as an example, a form will be described in which manga is delivered from a server to a mobile terminal, which is an information processing device, and the delivered manga is viewed by a user using the mobile terminal.

[1. Configuration of manga distribution system]
1 is a schematic diagram of a manga distribution system 1 according to this embodiment. The manga distribution system 1 includes a communication line 2, a plurality of mobile terminals 3, and a server 4.

Communication line 2 forms a computer network and is, for example, a wide area communication line provided by an electric power company.

The mobile terminal 3 is, for example, an information processing terminal such as a smartphone, tablet terminal, or notebook computer, and is used by the user to utilize web services distributed via the communication line 2. The mobile terminal 3 includes a touch panel display 3a that displays images, a speaker 3b that outputs sound, a microphone 3c that inputs sound, and a camera 3d that captures an image of a subject. Here, the touch panel display 3a includes, for example, an LCD (Liquid Crystal Display) and a touch sensor. The LCD displays various images, and the touch sensor accepts various input operations performed using a pointing object such as a finger, a stylus, or a pen.

The server 4 is an information processing device that distributes web services to the mobile terminal 3 via the communication line 2.

The manga distribution system 1 according to this embodiment distributes manga in the form of digital data from the server 4 to the mobile terminal 3 via the communication line 2 as one of the web services. The manga referred to here is an example of content formed of a series of still images, which are composed of pictures and have a story-like quality as a whole. The user uses dedicated application software (hereinafter referred to as the "manga viewing app") to view the manga distributed to the mobile terminal 3. The manga viewing app is pre-installed on the mobile terminal 3. As an example, the manga viewing app can display manga on the mobile terminal 3 page by page, and can also enlarge or reduce the manga displayed page by page. Note that the manga viewing app can function even when the mobile terminal 3 and the server 4 are not communicating (offline state) as long as manga data has been downloaded from the server 4 to the mobile terminal 3.

2. Server Configuration
FIG. 2 is a block diagram showing the electrical configuration of the server 4 according to the present embodiment.

The server 4 according to this embodiment includes a CPU (Central Processing Unit) 20 which is a main control unit that controls the overall operation of the server 4, a ROM in which various programs and various data are stored in advance,
(Read Only Memory) 22, a RAM (Random Access Memory) 24 used as a work area when the CPU 20 executes various programs, and a HDD (Hard Disk Drive) 26 as storage means for storing various programs and various data.

The HDD 26 stores manga data indicating the manga to be distributed to the mobile terminal 3. Note that the storage means is not limited to the HDD 26, and may be other storage media such as semiconductor memory such as flash memory.

The server 4 further includes an operation input unit 28, which is composed of a keyboard, a mouse, etc. and accepts input of various operations, a monitor 30, such as a liquid crystal display device, which displays various images, and an external interface 32, which is connected to other information processing devices, such as a mobile terminal 3, via the communication line 2 and transmits and receives various data to and from the other information processing devices.

The CPU 20, ROM 22, RAM 24, HDD 26, operation input unit 28, monitor 30, and external interface 32 are electrically connected to each other via a system bus 34. Therefore, the CPU 20 can access the ROM 22, RAM 24, and HDD 26, grasp the operation status of the operation input unit 28, display images on the monitor 30, and send and receive various data to and from other information processing devices, etc. via the external interface 32.

[3. Electrical configuration of the mobile terminal]
FIG. 3 is a functional block diagram showing the electrical configuration of the mobile terminal 3. As shown in FIG.

In addition to the components shown in FIG. 1, the mobile terminal 3 includes a main control unit 40, a main memory unit 42, an auxiliary memory unit 44, a communication unit 46, and an operation button 48.

The main control unit 40 is, for example, a CPU, a microprocessor, a DSP (Digital Signal Processor), etc., and controls the overall operation of the mobile terminal 3.

The main memory unit 42 is composed of, for example, RAM or DRAM (Dynamic Random Access Memory), and is used as a work area when the main control unit 40 executes processes based on various programs.

The auxiliary memory unit 44 is, for example, a non-volatile memory such as a flash memory, and stores various data such as images, as well as programs used in the processing of the main control unit 40. The programs stored in the auxiliary memory unit 44 are, for example, an OS (Operating System) for implementing the basic functions of the mobile terminal 3, drivers for controlling various hardware, and programs for implementing e-mail, web browsing, and various other functions. In addition, the auxiliary memory unit 44 pre-stores a manga viewing application for displaying manga distributed from the server 4 on the touch panel display 3a.

The communication unit 46 is, for example, a network interface controller (NIC), and has a function of connecting to the communication line 2. Note that the communication unit 46 may have a function of connecting to a wireless LAN (Local Area Network), a function of connecting to a wireless WAN (Wide Area Network), and a function of enabling short-range wireless communication such as Bluetooth (registered trademark), infrared communication, etc., instead of or together with the NIC.

The operation buttons 48 are provided on the side of the mobile terminal 3 and include a power button for starting and stopping the mobile terminal 3 and a volume adjustment button for the sound output by the speaker 3b.

The main control unit 40, main memory unit 42, auxiliary memory unit 44, communication unit 46, touch panel display 3a, speaker 3b, microphone 3c, camera 3d, and operation buttons 48 are electrically connected to each other via a system bus 49. Therefore, the main control unit 40 can access the main memory unit 42 and auxiliary memory unit 44, display images on the touch panel display 3a, grasp the operation state of the touch panel display 3a and the operation buttons 48 by the user, input sound to the microphone 3c, output sound from the speaker 3b, control the camera 3d, and access various communication networks and other information processing devices via the communication unit 46.

[4. Trimming function]
The user reads the manga distributed from the server 4 using a manga viewing app installed on the mobile terminal 3. This manga viewing app is equipped with various functions, and the user selects a function as necessary and has the manga viewing app execute it.

The manga viewing app according to this embodiment has a trimming function. The trimming function specifies a processing range (hereinafter referred to as the "trimming range") to be subjected to image processing, etc., for the manga image displayed on the screen 3a (touch panel display 3a). The trimming function according to this embodiment specifies the trimming range by touching and separating an indicator from the screen 3a, as will be described in detail later.

[4-1. Specifying the trimming range]
The trimming function according to this embodiment specifies the contact position of the indicator on the screen 3a. The trimming function according to this embodiment uses the contact position of the indicator as a reference and changes the trimming range of the image displayed on the screen 3a according to the contact time of the indicator on the screen 3a. That is, the trimming function according to this embodiment automatically changes the trimming range according to the contact time when the indicator contacts the screen 3a, so that the user can easily specify the trimming range of the image displayed on the screen 3a.

As described above, the trimming function according to this embodiment changes the trimming range based on the contact position of the indicator. As an example of this, the trimming function according to this embodiment changes the trimming range centered on the contact position of the indicator, but this is not limited to this, and the trimming range may be changed centered on a position slightly shifted from the contact position of the indicator. For example, if the indicator is a finger, the trimming range may be changed centered, for example, 1 cm above the contact position of the indicator. This makes it easier for the user to recognize the center of the trimming range, since the center of the trimming range is not hidden by the user's finger.

In this embodiment, the indicator is the user's finger, and when the user presses and holds the screen 3a for a predetermined time or more (for example, 2 seconds or more), the manga viewing application executes the trimming function. That is, the long press position becomes the contact position. The trimming function is not executable when the manga displayed on the screen 3a is scrolling, but is executable when the scrolling is stopped.

Figure 4 shows the trimming range 50 that is displayed by pressing and holding the screen 3a. Note that the example in Figure 4 shows a state in which a manga is displayed on the screen 3a, although there is no indication.

As an example, the trimming function according to this embodiment sets the trimming range 50 to a circular closed figure. Specifically, the trimming range 50 expands into a circular shape by expanding in all directions from the long press position 52 on the screen 3a at a uniform speed proportional to the duration of the long press. The speed at which the trimming range 50 expands is preset, and as an example, the user can change the set speed.

The trimming function according to this embodiment stops changing (enlarging) the trimming range 50 when the pointer is moved away from the screen 3a after starting to change the trimming range 50 around the long press position 52 of the pointer. This allows the user to specify the desired trimming range 50 with just the simple operation of touching and removing the pointer from the screen 3a. In the following description, the removal of the pointer from the screen 3a is also referred to as touch-off.

In addition, after the user touches off, the trimming function according to this embodiment displays a confirmation dialog on the screen 3a to prompt the user to input an input such as saving the image within the specified trimming range 50 or canceling the designation of the trimming range 50. If the specified trimming range 50 is not the desired range, the user can designate the trimming range 50 again by long pressing on the screen 3a.

In addition, when the trimming range 50 is expanded, if the long press position 52 moves without the indicator moving away from the screen 3a, the trimming range 50 also moves together with the movement of the long press position 52. That is, the user can arbitrarily move the center of the trimming range 50 by moving the long press position 52. Note that the trimming function may continue to expand the trimming range 50 even when the long press position 52 is moving, but is not limited to this. The expansion of the trimming range 50 may be temporarily halted when the long press position 52 is moving, and the expansion of the trimming range 50 may be resumed when the movement of the long press position 52 stops.

[4-2. Variation 1 for specifying the trimming range]
The trimming function may alternately expand and reduce the trimming range 50 by repeatedly touching and separating the indicator from the screen 3a. For example, the trimming function reduces the trimming range 50 when a long press is performed again within a predetermined time (e.g., within 5 seconds) after the expansion of the trimming range 50 is stopped by a touch-off, and stops the reduction of the trimming range 50 when the touch is again released. Furthermore, when a long press is performed again within the predetermined time, the trimming function starts expanding the trimming range 50.

This allows the user to easily specify the desired trimming range 50 by repeatedly touching and releasing the pointer on the screen 3a. Note that, as an example, the trimming function displays a confirmation dialog on the screen 3a each time the user touches off, prompting the user to input an option to enlarge or reduce the trimming range 50, save the image within the trimming range 50, cancel the specification of the trimming range 50, etc.

The trimming function may change the speed of change of the trimming range 50 each time the trimming range 50 is enlarged and reduced. As an example, the speed of change of the trimming range 50 is slowed down in stages. This allows the user to fine-tune the trimming range 50, making it easier to specify the desired trimming range 50. The degree to which the speed of change of the trimming range 50 is slowed down is predetermined. Also, if enlargement and reduction are repeated a predetermined number of times or more, the process of changing the speed of change of the trimming range 50 may not be executed any more. Furthermore, the trimming function may increase the speed of change of the trimming range 50 each time the trimming range 50 is enlarged and reduced. This allows the user to specify the trimming range 50 more quickly.

[4-3. Variation 2 for specifying the trimming range]
The trimming function may change the trimming range 50 around the long press position 52 of the indicator, change the trimming range 50 in the opposite direction when the indicator moves away from the screen 3a, and then stop changing the trimming range 50 when the indicator comes into contact with the screen 3a.

In other words, in the trimming function according to Variation 2, when the trimming range 50 is expanded by starting a long press, the expansion of the trimming range 50 stops when the user releases touch, but then automatically starts reducing the trimming range 50. Then, when the trimming range 50 becomes the desired range after reduction, the user can stop reducing the trimming range 50 by tapping the screen 3a with the pointer.

The trimming function according to Variation 2 may temporarily halt the change in the trimming range 50 and display a confirmation dialog on the screen 3a before reducing the trimming range 50 by touching off. This confirmation dialog includes buttons that prompt the user to input options such as saving the image shown in the trimming range 50, reducing the trimming range 50, and canceling the designation of the trimming range 50. This allows the user to save the image within the trimming range 50 without reducing it when the trimming range 50 has been enlarged to the desired range.

Furthermore, when the trimming function is automatically reducing the trimming range 50, if the user presses and holds the screen 3a rather than tapping it, the trimming function may stop reducing the trimming range 50 and resume expanding the trimming range 50. The trimming function may also change the rate at which the trimming range 50 changes each time the trimming range 50 is expanded and reduced.

[4-4. Expanding the trimming range according to the manga frame border]
The manga that the user views with the manga viewing app according to this embodiment is, as an example, a manga having frames. The manga viewing app recognizes the center position (center of gravity) and shape of the frame of the manga frame (hereinafter referred to as the "frame frame") displayed on the screen 3a, for example, by image recognition or the like. In other words, the frame frame is the outer edge of the frame. In this embodiment, as an example, the frame frame is an area surrounded by lines that define the range of the frame. For example, the frame frame is a rectangular shape such as a square, rectangle, or parallelogram.

The trimming function may change the trimming range 50 based on the frame border. This allows the user to easily cut out the desired frame of the manga.

As one example of this, the trimming function may expand the trimming range 50 around the long press position 52, and stop expanding the trimming range 50 when the trimming range 50 expands to the frame border of the frame that includes the long press position 52.

Now, with reference to Figure 5, we will explain the expansion of the trimming range 50 according to the frame frame 54 (hereinafter referred to as "frame frame-based expansion process"). Note that in the example of Figure 5, the shape of the frame frame 54 is a regular rectangle, but the shape of the frame frame 54 is not limited to this.

Figure 5 (A) is a schematic diagram showing the expansion of the trimming range 50 when the long press position 52 is the same as the center position of the frame 56. The frame frame-based expansion process in this case expands the trimming range 50 in all directions at a uniform speed. That is, the trimming range 50 expands from the long press position 52 to the four sides of the frame frame (sides x1, x2, y1, and y2) such that Vx1 = Vx2 = Vy1 = Vy2. Vx1 is the speed toward side x1, Vx2 is the speed toward side x2, Vy1 is the speed toward side y1, and Vy2 is the speed toward side y2. This allows the trimming range 50 to reach the multiple sides that make up the frame frame 54 at the same time.

The trimming range 50 changes to fit the outer edge of the frame frame 54. In other words, even if a part of the trimming range 50 reaches the frame frame 54, the other part continues to expand so that it has the same shape as the outer edge of the frame frame 54. As a result, the trimming range 50 eventually has the same shape as the frame frame 54. However, this is not limited to this, and the trimming range 50 may stop expanding when it reaches all four sides of the frame frame 54 and maintain its circular shape. Also, even if the trimming range 50 has not reached the frame frame 54, the expansion of the trimming range 50 stops when the indicator is touched off the screen 3a.

In addition, in the frame frame-based enlargement process, even if the trimming range 50 is enlarged until it reaches the frame frame 54, the trimming range 50 may be further enlarged if the long press continues. Specifically, in the frame frame-based enlargement process, if the trimming range 50 is enlarged until it reaches the frame frame 54 and the long press continues, the enlargement of the trimming range 50 is temporarily stopped and the trimming range 50 is enlarged again. In this way, the frame frame-based enlargement process pauses the enlargement when the trimming range 50 reaches the frame frame 54, thereby giving the user time to select whether to make the trimming range 50 the same as the frame frame 54 or to enlarge the trimming range 50 beyond the frame frame 54.

Figure 5 (B) is a schematic diagram showing the expansion of the trimming range 50 when the long press position 52 is offset from the center of the frame 56 that contains the long press position 52. In this case, the frame frame reference expansion process controls the expansion speed of the trimming range 50 so that the periphery of the trimming range 50 reaches multiple sides that make up the frame frame 54 at the same time. As a result, regardless of the user's long press position 52, the trimming range 50 expands to match the frame frame 54, improving convenience for users who want to specify the trimming range 50 based on the frame frame 54.

In the example of FIG. 5B, the long press position 52 is located below the frame 56. That is, the long press position 52 is closer to side y1 than side y2. Meanwhile, the long press position 52 is located halfway between sides x1 and x2. For this reason, the frame frame reference enlargement process controls the enlargement of the trimming range 50 by making Vy2>Vy1 so that the trimming range 50 reaches sides y1 and y2 at the same timing. Meanwhile, the speed at which the trimming range 50 reaches side x1 and the speed at which the trimming range reaches side x2 are set to the same speed (Vx1=Vx2). Then, Vy1, Vy2, Vx1, and Vx2 are controlled so that the above-mentioned relationship of Vy1>Vy2 and Vx1=Vx2 is maintained and the timing at which the trimming range 50 reaches each side x1, x2, y1, and y2 is the same.

Whether or not to perform the frame frame-based enlargement process is set by the user. If the frame frame-based enlargement process is not performed, the trimming range 50 will be enlarged according to the contact time of the pointer, centered on the long press position 52, as described above, regardless of the positional relationship between the long press position 52 and the frame 56.

Figure 6 shows another example of frame frame-based enlargement processing, in which the trimming range 50 expands at a constant speed in both directions regardless of the position of the long press position 52, but the area 58 beyond the frame frame 54 is not included in the trimming range 50.

In addition, the trimming range 50 may not only be expanded to a range not exceeding the frame frame 54 as described above, but may also be expanded beyond the frame frame 54 while using the frame frame 54 as a reference.

For example, when the trimming range 50 is expanded so that the trimming range 50 includes not only the frame 56 that includes the long press position 52 but also other adjacent frames 56, a determination may be made as to whether or not to include the other frames 56 in the range to be trimmed.

In this determination, if the trimming range 50 includes not only the frame 56 that includes the long press position 52 but also other adjacent frames 56, the range including the adjacent frames 56 is subject to cutting (copying) only if the adjacent frames 56 account for a predetermined percentage or more of the entire trimming range 50. On the other hand, if the adjacent frames 56 account for less than the above-mentioned predetermined percentage, the range including the adjacent frames 56 is not subject to cutting, and only the range of the frame 56 that includes the long press position 52 is subject to cutting.

[4-5. Processing of trimming range]
The trimming function according to this embodiment may include a process (hereinafter referred to as an "image processing process") for performing various processes on the image within the trimming range 50. Examples of the image processing process are given below. Note that the image processing process may involve processing the image within the trimming range 50 before the image is saved, or the image within the trimming range 50 may be saved, and then the image after the processing may be saved separately.

Image processing includes a masking process that masks a portion of the trimming range 50. For example, if the image contains a manga speech bubble, the masking process masks the text in the speech bubble and the entirety of the speech bubble.

Image processing includes an image superimposition process that superimposes an image on the trimming range 50. The image superimposition process superimposes, for example, text information as an image. The superimposed text information may include, in addition to characters entered as text or handwritten characters, for example, date and time information indicating the date and time of trimming, source information indicating the source of the trimmed manga, copyright information indicating the copyright of the trimmed manga, etc.

As shown in FIG. 6, the image overlay process may filter an area 58 (hatched area in FIG. 6) of the trimming range 50 that exceeds the frame frame 54 by filling it in with white or another image, and then overlaying text information or the like on this filtered area 58.

The image overlay process may also overlay decorative images such as frames and stamps onto the trimming area 50 as other images.

[5. Functional block of manga viewing function]
7 is a functional block diagram relating to a manga viewing function executed by a manga viewing application installed in the mobile terminal 3 according to this embodiment. The main control unit 40 included in the mobile terminal 3 includes a manga display control unit 60, a scroll control unit 62, and a trimming function execution unit 64. The processes executed by each function included in the main control unit 40 are realized by programs stored in the auxiliary storage unit 44.

The manga display control unit 60 displays the manga distributed from the server 4 on the screen 3a.

The scroll control unit 62 scrolls the manga displayed on the screen 3a in response to an operation on the screen 3a by a pointer.

The trimming function execution unit 64 executes the trimming function when the screen 3a is pressed and held for a predetermined period of time or longer. The trimming function execution unit 64 includes a touch determination unit 70, a trimming range change unit 72, and a processing unit 74.

The touch determination unit 70 determines whether or not the indicator has come into contact with the screen 3a, whether or not a long press has been performed, and if a long press has been performed, identifies the long press position 52. The touch determination unit 70 also determines whether or not there has been a touch-off from the screen 3a.

The trimming range change unit 72 performs the various processes described above to change the trimming range 50, such as changing the trimming range 50 according to the contact time of the pointer, centered on the long press position 52 of the pointer on the screen 3a. These various processes also include frame frame reference enlargement processing.

The image processing unit 74 performs image processing on the image within the trimming range 50.

The trimming function execution unit 64 is not limited to the functions executed by the above configuration, but also has functions necessary for the trimming function, such as displaying a confirmation dialog on the screen 3a and saving the image within the trimming range 50.

[6. Flowchart of Trimming Area Designation Processing]
FIG. 8 is a flowchart showing the flow of a manga browsing process executed by the main control unit 40 included in the mobile terminal 3 .

First, in step 100, the manga display control unit 60 displays the manga distributed from the server 4 on the screen 3a.

In the next step 102, the scroll control unit 62 determines whether or not the user has performed a scroll operation on the screen 3a. If the determination is affirmative, the process proceeds to step 104, and if the determination is negative, the process proceeds to step 106.

In step 104, the scroll control unit 62 scrolls the manga displayed on the screen 3a in response to the user's scrolling operation.

In step 106, when the scrolling of the manga has stopped, the touch determination unit 70 determines whether or not the user has pressed and held down the screen 3a. If the determination is affirmative, the process proceeds to step 108, and if the determination is negative, the process proceeds to step 118.

In step 108, the touch determination unit 70 identifies the long press position 52 on the screen 3a, and the trimming range change unit 72 starts displaying the trimming range 50 centered on the long press position 52.

In the next step 110, the trimming range change unit 72 changes the trimming range 50 displayed on the screen 3a. Note that the trimming range change unit 72 according to this embodiment expands the trimming range 50 when a long press is performed on the screen 3a.

In the next step 112, the touch determination unit 70 determines whether or not the indicator has been touched off the screen 3a. If the determination is positive, the process proceeds to step 114. If the determination is negative, the process returns to step 110, and the trimming range change unit 72 continues to change the trimming range 50.

In step 114, the trimming range change unit 72 stops changing the trimming range 50.

In the next step 116, the trimming function execution unit 64 displays a confirmation dialog on the screen 3a and performs processing according to the user's instructions entered through the confirmation dialog. Note that this processing includes processing of the image within the trimming range 50, saving the image within the trimming range 50, etc.

In the next step 118, the manga display control unit 60 determines whether the manga displayed on screen 3a has ended, and if the determination is positive, the manga viewing process ends, and if the determination is negative, the process proceeds to step 102 and the manga display continues. Note that, as an example, the manga display control unit 60 determines that the manga has ended when the manga displayed on screen 3a cannot be scrolled any further.

As described above, the trimming function of the manga viewing process according to this embodiment identifies the contact position of the pointer on the screen 3a. The trimming function then uses the contact position of the pointer as a reference and changes the trimming range 50 of the image displayed on the screen 3a according to the contact time of the pointer on the screen 3a. In other words, the trimming function according to this embodiment automatically changes the trimming range 50 according to the contact time when the pointer touches the screen 3a, allowing the user to easily specify the trimming range 50 of the image displayed on the screen 3a.

7. Other embodiments
The present invention has been described above using the above embodiment, but the technical scope of the present invention is not limited to the scope described in the above embodiment. Various modifications or improvements can be made to the above embodiment without departing from the gist of the invention, and the forms with such modifications or improvements are also included in the technical scope of the present invention. In addition, the above embodiments may be combined as appropriate.

For example, in the above embodiment, the content is described as a manga, but the present invention is not limited to this. For example, the content may be a video, or the content may be a novel composed of text. When the content is a video, the user pauses the progression of the video when specifying the trimming range 50.

In the above embodiment, the trimming range 50 is described as being circular, but the present invention is not limited to this. For example, the trimming range 50 may be rectangular with the contact position of the indicator (long press position 52) as the center, as shown in FIG. 9. In the example of FIG. 9, the sides of the trimming range 50 extend parallel to the sides of the screen 3a, thereby expanding the trimming range 50. In the example of FIG. 9, the trimming range 50 is a regular square, but this is not limited, and the trimming range 50 may be a rectangle. Furthermore, the trimming range 50 is not limited to a square, and may be any other shape as long as it is a closed figure, such as a polygonal shape with pentagons or more, or a star shape.

The trimming range 50 may also be similar in shape to the frame frame that contains the contact position of the pointer. In this case, for example, if the frame frame is a square, the trimming range 50 is also enlarged or reduced in a square, and if the frame frame is a parallelogram, the trimming range 50 is also enlarged or reduced in a parallelogram.

In the above embodiment, the trimming range 50 is changed by expanding the trimming range 50 based on the contact position of the indicator (long press position 52), but the present invention is not limited to this. The trimming range 50 may be changed by shrinking it from the periphery of the screen 3a toward the contact position of the indicator (long press position 52).

In the above embodiment, the frame frame is the area surrounded by the lines that define the range of the frame, but the present invention is not limited to this. For example, the frame frame may be an area that exceeds the range. Specifically, if a speech bubble containing the lines spoken by a character extends beyond the range, the frame frame also includes the range of the protruding speech bubble. If text such as sound effects extends beyond the range, the frame frame also includes the outline of the protruding text. This makes it possible to cut (copy) speech bubbles that are included in the frame but extend beyond it as the trimming range 50. For this purpose, for example, the characters, speech bubbles, sound effects, background, etc. that make up the manga are identified as objects, and groups of these objects can be recognized as frames.

Furthermore, the flow of the trimming range designation process described in the above embodiment is also one example, and unnecessary steps may be deleted, new steps may be added, or the processing order may be changed without departing from the spirit of the present invention.

3. Mobile terminal (information processing device)
3a Touch panel display 50 Trimming range (processing range)
52 Long press position (contact position)
60 Frame frame (frame of a frame)
62 Frame 70 Touch determination unit (contact position identification means)
72 Trimming range change unit (processing range change means)

Claims (4)

A processor is provided.
The processor identifies a contact position of a pointer on a touch panel display on which an image including a frame and an object arranged within the frame is displayed ,
the processor expands a processing range for performing a trimming process on the object corresponding to the contact position in accordance with a contact time of the pointer;
the processor stops expanding the processing range when the processing range expands to reach the frame surrounding the object corresponding to the contact position ;
the processor displays text information based on the object in the processing range superimposed on an image of the object corresponding to the contact position .
Information processing device. A processor identifies a contact position of a pointer on a touch panel display on which an image including a frame and an object arranged within the frame is displayed ;
a processor expands a processing range in which a trimming process is performed on the object corresponding to the contact position in accordance with a contact time of the pointer;
a processor stops expanding the processing range when the processing range expands to reach the frame surrounding the object corresponding to the contact position ;
a processor displays text information based on the object in the processing range superimposed on an image of the object corresponding to the contact position ;
Information processing methods. causing a processor to identify a contact position of a pointer on a touch panel display on which an image including a frame and an object arranged within the frame is displayed ;
a processor that expands a processing range in which a trimming process is performed on the object corresponding to the contact position in accordance with a contact time of the pointer;
causing a processor to stop expanding the processing range when the processing range expands to reach the frame surrounding the object corresponding to the contact position ;
causing a processor to display text information based on the object in the processing range superimposed on an image of the object corresponding to the contact position ;
A program that executes a process. A server and a terminal device are provided,
The server,
causing the terminal device to specify a contact position of a pointer on a touch panel display on which an image including a frame and an object arranged within the frame is displayed ;
causing the terminal device to expand a processing range in which a trimming process is performed on the object corresponding to the contact position in accordance with a contact time of the pointer;
causing the terminal device to stop expanding the processing range when the processing range reaches the frame surrounding the object corresponding to the contact position ;
causing the terminal device to display character information based on the object in the processing range so as to be superimposed on an image of the object corresponding to the contact position ;
system.

Images