JP5978708B2 - External display program and external display device - Google Patents

Description

  Some embodiments relate to an external display program and an apparatus for external display.

  In recent years, terminals such as smart phones, mobile phones, PDAs, tablet terminals, personal computers (PCs), and notebook PCs have become widespread. Displaying contents such as an image file, a homepage, and a PDF file on a display screen of a display device included in these terminals is performed. However, there is content that requires a wide display area in order to display the entire content such as a large-scale homepage. And when browsing the content which requires such a wide display area in the limited display area with which a terminal is provided, it is necessary to repeat display operations, such as expansion, reduction, and scrolling, for example.

  In particular, in a terminal having a relatively small display screen such as a smartphone, display operations are frequently repeated when browsing content. In this regard, the content being browsed on the terminal is displayed on a display device around the terminal.

  For example, a technique for providing a mobile communication terminal capable of improving user convenience while minimizing the functions of the mobile communication terminal main body is known.

  There is also known a technique for providing a remote display system in which a predetermined content is remotely displayed on a predetermined display device around a communication terminal.

  In addition, a technology for realizing an information processing terminal and a content acquisition system capable of selecting a peripheral device according to the content is known.

JP 2010-166464 A JP 2004-362437 A JP 2001-256162 A

  However, there has been no technology that draws the user's intention from the display operation performed on the content and displays the content on the peripheral device in an easy-to-read manner. Some embodiments according to the present invention have an object of providing a technology that draws a user's intention from a display operation performed on content and displays the content on a peripheral device in an easy-to-read manner.

  An external display request program that requests to display content being displayed on a first display screen included in a terminal according to one aspect of the present invention on a second display screen included in an external display device is input to the terminal The operation type indicating the type of the display condition changing operation for the content being displayed on the first display screen, the operation amount indicating the magnitude of the display condition changing operation, and the information on the center position or direction of the display condition changing operation The second information is recorded as operation information in the storage unit, and is multiplied by the magnification set according to the operation type to the first display magnification of the content on the first display screen determined according to the display condition changing operation. The second display magnification on the display screen is set, and the display position of the content to be displayed on the second display screen is set and set using information on the center position or direction of the display condition changing operation. Content in the second display magnification to determine the display condition for the second display screen to appear in shown positions.

  According to the above-described aspect, the user's intention can be obtained from the display operation performed on the content, and the content can be easily displayed on the peripheral device.

It is a figure which illustrates the system by which the external display request process which concerns on some embodiment is implemented. It is a figure which illustrates the flow of the external display request process which concerns on some embodiment. It is a figure which illustrates the functional block structure of the terminal which concerns on some embodiment. It is a figure which illustrates another functional block structure of the terminal which concerns on some embodiment. It is a figure which illustrates the operation history information concerning some embodiments. It is a figure which illustrates content management information concerning some embodiments. It is a figure which illustrates the display apparatus information which concerns on some embodiment. It is a figure which illustrates the external display apparatus information which concerns on some embodiment. It is a figure which illustrates the operation | movement flow of the external display request process performed by the control part of the terminal which concerns on some embodiment. It is a figure which illustrates the display apparatus candidate extraction process performed by the control part of the terminal which concerns on some embodiment. It is a figure which illustrates the list of the candidates of the display apparatus which concerns on one Embodiment. It is a figure which illustrates the display condition determination process performed by the control part of the terminal which concerns on some embodiment. It is a figure explaining the display condition determination processing in expansion operation concerning some embodiments. It is a figure which illustrates the operation | movement flow of the display condition determination process in the expansion operation performed by the control part of the terminal which concerns on some embodiment. It is a figure explaining the display condition determination process in the reduction operation which concerns on some embodiment. It is a figure which illustrates the operation | movement flow of the display condition determination process in the reduction operation performed by the control part of the terminal which concerns on some embodiment. It is a figure explaining the reference position of the display screen used in the display condition determination processing in the scroll operation according to some embodiments. It is a figure explaining the display condition determination process in the scroll operation which concerns on some embodiment. It is a figure which illustrates the operation | movement flow of the display condition determination process in the scroll operation performed by the control part of the terminal which concerns on some embodiment. It is a figure which illustrates speed corresponding magnification setting information concerning some embodiments. It is a figure which illustrates the operation | movement flow of the display condition determination process in the scroll operation performed by the control part of the terminal which concerns on another embodiment. It is a figure explaining the display of the display range instruction | indication frame performed by the control part of the terminal which concerns on some embodiment. It is a figure explaining the display of the display range instruction | indication frame performed by the control part of the terminal which concerns on some embodiment. It is a figure which illustrates the functional block structure of the external display apparatus which concerns on some embodiment. It is a figure which illustrates the operation | movement flow of the display process performed by the control part of the display apparatus which concerns on some embodiment. It is a figure which illustrates the hardware constitutions of the computer for implement | achieving a terminal and an external display apparatus based on some embodiment.

  Hereinafter, some embodiments of the present invention will be described in detail with reference to the drawings. In addition, the same code | symbol was attached | subjected to the corresponding element in several drawing.

  In the embodiment illustrated below, a case where display operations (for example, enlargement, reduction, scrolling, etc.) on content are performed via a touch panel capable of multi-touch (detection of two or more points) will be described as an example. However, some embodiments are not limited to this. For example, the present invention can be applied to a case where an operation such as enlargement, reduction, scrolling, or the like is performed on content via an input device such as a button or a mouse. For example, in some embodiments, as an alternative to multi-touch pinch operations, operations such as dragging with a mouse and double-clicking may be applied. Further, as an alternative to the swipe operation on the touch panel, for example, an operation using a mouse wheel of a mouse, a drag operation, a double click operation, or the like may be applied.

  FIG. 1 is a diagram illustrating a system 100 in which external display request processing according to some embodiments is performed. A system 100 illustrated in FIG. 1 includes a terminal 101 and a display device 103. The terminal 101 and the display device 103 are connected via a wireless communication 120 and transmit / receive information via the wireless communication 120. Further, the terminal 101 and the display device 103 may be connected to the network 110. When the terminal 101 and the display device 103 are connected to the network 110, the terminal 101 and the display device 103 transmit / receive information to / from a server that distributes content via the network 110.

  The terminal 101 is a terminal such as a personal computer, a notebook computer, a mobile phone, a tablet terminal, or a smartphone. The terminal 101 includes a display device 102. For example, content acquired via a network is displayed on the display device 102. The display device 102 includes display devices such as a cathode ray tube (CRT) display, a liquid crystal display, a plasma display, an organic EL display, and a projector, and displays a video signal such as a still image or a moving image output from the terminal 101.

  The display device 103 includes display devices such as a cathode ray tube (CRT) display, a liquid crystal display, a plasma display, an organic EL display, and a projector, and displays a video signal such as a still image or a moving image output from a device such as a computer. . The display device 103 is a device that exists in the vicinity of the terminal 101, and transmits / receives information to / from the terminal 101 via the wireless communication 120. Note that the display device 103 can use the same device as the terminal 101.

  The network 110 is a network such as the Internet, a local area network (LAN), and a wireless LAN. The wireless communication 120 includes, for example, Bluetooth (registered trademark), DLNA (registered trademark), UPnP (registered trademark), and wireless LAN (ad hoc).

  FIG. 2 is a diagram illustrating the flow of external display request processing according to some embodiments. In the external display request processing according to some embodiments, for example, the display device 103 existing around the terminal 101 is requested to display the content being displayed on the terminal 101 in the following flow. First, the user operates the terminal 101 to display contents such as a PDF, a still image, a moving image, a document, and a homepage acquired via the network 110 on the display screen of the display device 102 (S201). Subsequently, the user performs display operations such as enlargement, reduction, and scrolling on the displayed content (S202). In this case, in some embodiments, the terminal 101 specifies an operation type (for example, enlargement, reduction, and scrolling) that is a type of display operation performed by the user. Furthermore, the terminal 101 also acquires the operation amount of the display operation performed by the user. For example, when the operation type is enlargement, the operation amount may be information on the distance that two points are swiped in the pinch-out operation. For example, when the operation type is reduction, the information may be information about the distance that two points are swiped in the pinch-in operation. For example, when the operation type is scroll, information on the distance of the swipe executed in the scroll operation may be used. For example, the terminal 101 accumulates the operation type and operation amount information as described above as an operation history (S203). Subsequently, every time the user performs an operation on the content, the terminal 101 analyzes the accumulated operation history of the content (S204). In this analysis, the terminal 101 determines whether to suggest to the user that the content being displayed on the terminal 101 is displayed on the external display device 103 having a screen that is easier to view than the terminal 101 based on the operation history. For example, when the user repeatedly performs display operations such as enlargement, reduction, and scrolling on the content being displayed, the user has difficulty in browsing the content on the display device 102 provided in the terminal 101. it is conceivable that. Therefore, the terminal 101 acquires the number of times that the user has performed display operation on the content from the number of accumulated operation histories. Then, when the number of times exceeds the predetermined number, the user is suggested to display on the external display device 103 as having difficulty in browsing the content (S205). As an external display device 103 that is a candidate for requesting content display, an appropriate display device candidate that satisfies conditions such as a larger screen size and a larger resolution than the display device 102 of the terminal 101 is proposed. The When the user designates the display device 103 that requests content display from among the proposed display device candidates, for example, the display type is displayed on the external display device 103 based on the operation type and operation amount of the most recent display operation. Content display conditions are determined (S206). The display condition includes, for example, information for determining the display magnification of the content when displayed on the external display device 103 and the position where the content is displayed on the external display device 103. Subsequently, the terminal 101 transmits a request to the external display device 103 designated to display the content under the determined display condition (207). The display magnification is determined in accordance with the purpose of the display operation performed by the user estimated based on the operation type and operation amount of the display operation performed on the content, for example. As such, some embodiments are configured. Therefore, the user can display and browse the content on the external display device 103 at an appropriate display magnification determined according to the display operation performed by the user.

  As described above along the flow shown in FIG. 2, in some embodiments, a history of display operations performed by a user on content is held in the terminal 101 as an operation history. Then, based on the operation history, it is determined whether it is desirable to display on the external display device 103. For this reason, it is not necessary to actually display on the external display device 103 having a large display screen, and even when a sufficient content is displayed on the small screen at hand, the content is displayed on the external display device 103, which is convenient. It is prevented from being damaged. Further, when displaying on the external display device 103, since the display is performed under the display conditions of the content according to the intention of the display operation by the user based on the operation history, the user can easily display the desired region of the content. Can be viewed.

  FIG. 3 is a diagram illustrating a functional block configuration of the terminal 101 according to some embodiments. In FIG. 3, the terminal 101 includes a control unit 300, a storage unit 320, a display unit 303, an input unit 304, and a communication unit 305. The control unit 300 of the terminal 101 includes a display condition determination unit 311, an operation processing unit 312, an operation history determination unit 313, a display device candidate extraction unit 314, and a request candidate display device information acquisition unit 315. Furthermore, the control unit 300 of the terminal 101 also includes a content acquisition unit 316, a display device candidate extraction timing processing unit 317, and a display device candidate search extraction unit 318. The storage unit 320 of the terminal 101 includes a content holding unit 321, a content information holding unit 322, a local terminal display device information holding unit 323, an external display candidate information holding unit 324, an external display device storage unit 325, and an operation history holding unit 326. , And a speed corresponding magnification holding section 327.

  The display unit 303 is a functional unit for displaying various information to the user. The input unit 304 is a functional unit for a user to input information. The communication unit 305 is a functional unit for the terminal 101 to communicate with the outside. The content acquisition unit 316 is a functional unit for acquiring content via the network 110, for example. The content holding unit 321 is a functional unit that holds content acquired locally (or via a network). The content information holding unit 322 is a functional unit that holds information such as the type, size, and security level of local content held in the content holding unit 321 or content acquired from the network. The operation processing unit 312 is a functional unit for interpreting a display operation performed on the content displayed on the terminal and changing a display condition according to the display operation. The operation history holding unit 326 is a functional unit that holds an operation history of display operations performed on displayed content. The operation history determination unit 313 determines whether to propose display on the external display device 103 having a display screen larger than that of the terminal 101 based on the operation history accumulated in the operation history holding unit 326. Part. The display device candidate extraction timing processing unit 317 is a functional unit that determines the timing for searching for an external display device 103 that can request display of content. The display device candidate search and extraction unit 318 searches for the external display device 103 around the terminal 101 by the wireless communication 120 via the communication unit 305 at the timing determined by the display device candidate extraction timing processing unit 317. The function unit performs processing for extracting the found external display device 103 as a candidate. The request candidate display device information acquisition unit 315 communicates information such as position information, the physical size of the display screen, and the resolution from the external display device 103 that can request display of the content extracted by the display device candidate search extraction unit 318. A functional unit for obtaining via the unit 305. The external display candidate information holding unit 324 is a functional unit that stores information about the external display device 103 that is a display device candidate that can request display of the content acquired by the request candidate display device information acquisition unit 315. The own terminal display device information holding unit 323 is a functional unit that stores position information of the display device 102 included in the own terminal 101, a physical size of the display screen, a resolution, and the like. In order to compare the information held in the own terminal display device information holding unit 323 with the information of the display device 103 that is a display device candidate that can be requested to display the content held in the external display candidate information holding unit 324 Used. The display device candidate extraction unit 314 is a display device that is a candidate for requesting content display based on the information in the external display candidate information holding unit 324, the information in the local terminal display device information holding unit 323, and the content information in the content information holding unit 322. This is a functional unit that extracts 103. The external display device storage unit 325 is a functional unit for storing the display device 103 that is a candidate for requesting display of the content extracted by the display device candidate extraction unit 314 and the display device 103 for which the display request has been determined. . The speed corresponding magnification holding unit 327 is a functional unit that holds information in which the swipe speed and the magnification in the display operation are associated with each other. The display condition determination unit 311 is a functional unit that determines how to display the content based on the operation type and operation amount of the operation history of the display operation for the content recorded in the operation history holding unit 326. In one embodiment, the display condition determination unit 311 also determines how to display the content with the information that associates the speed and magnification of the swipe in the display operation held in the speed corresponding magnification holding unit 327. For use.

  FIG. 4 is a diagram illustrating another functional block configuration of the terminal 101 according to some embodiments. The control unit 300 of the terminal 101 includes, as the function unit 400, for example, an operation history recording unit 401, an external display magnification setting unit 402, a display position setting unit 403, and a display condition determining unit 404. A program 410 is stored in the storage unit 320 of the terminal 101. The storage unit 320 of the terminal 101 includes information 420 used in external display request processing according to some embodiments. The information 420 used in the external display request process includes, for example, operation history information 500, content management information 600, display device information 700, external display device information 800, and speed corresponding magnification setting information 2000. The control unit 300 of the terminal 101 reads and executes the program 410 to include, for example, an operation history recording unit 401, an external display magnification setting unit 402, a display position setting unit 403, a display condition determination unit 404, and the like included in the function unit 400. Provides the functionality of Details of these functional units 400 and details of the information 420 stored in the storage unit 320 will be described later.

  FIG. 5 is a diagram illustrating operation history information 500 according to some embodiments. In one embodiment, the operation history information 500 is held in the operation history holding unit 326 of the storage unit 320 of the terminal 101. In another embodiment, the operation history information 500 is stored in the storage unit 320 of the terminal 101. The operation history information 500 stores a history of display operations performed by the user on the content being displayed on the terminal 101. The operation history information 500 is information generated for each content in the present embodiment. FIG. 5A is a diagram illustrating operation history information 500a according to an embodiment. The operation history information 500a illustrated in FIG. 5A includes operation information 501a that is information about one display operation performed on the content by the user. The operation information 501a includes information on an operation type 502a, an operation amount 503a, and a center position or direction 504a. The operation type 502a is information about the type of display operation performed on the content by the user. The operation type 502a includes, for example, types such as enlargement, reduction, and scrolling. The enlargement is a display operation in which the display magnification of the content on the display screen is increased and the content is displayed in an enlarged manner before the operation. The reduction is a display operation in which the display magnification of the content on the display screen is reduced and the content is displayed in a reduced size than before the operation. Scrolling is a display operation for moving the position of content to be displayed on the display screen.

  The operation amount 503a is information about the size of the display operation performed on the content. As the operation amount 503a, in the case of an enlargement operation, for example, a finger touch when a pinch-out operation is performed at two points on a touch panel that supports multi-touch operation that can sense that a plurality of places are touched at a time. The information of the distance moved by the swipe may be stored. In the case of a reduction operation, for example, in a touch panel capable of multi-touch, information on the distance that a finger or the like has moved by swiping when a pinch-in operation is performed at two points may be stored. In the case of a scroll operation, information on the distance that a finger or the like has moved by swiping at one point on the touch panel may be stored. The swipe operation is a display operation in which a finger or the like is slid while touching the display screen of the touch panel, for example. The pinch-in operation is a display operation for reducing the screen by moving the display target on the screen with two fingers in a touch panel capable of multi-touch, for example. On the other hand, the pinch-out operation is a display operation for enlarging the screen by, for example, moving the display target on the screen with two fingers in a touch panel capable of multi-touch. In the operation amount 503a, for example, information on the size of the display operation performed on the content by the user as described above is stored.

  The center position or direction 504a stores the position of a point on the content whose position is fixed in the enlargement or reduction process when the operation type 502a is a content enlargement or reduction operation. In the center position or direction 504a, for example, the position of the pixel at the midpoint between the two points specified first before swiping in the pinch-out operation or the pinch-in operation may be stored.

  In the center position or direction 504a, when the operation type 502a is a content scroll operation, the scroll direction is stored. For example, assume that the user touches the screen of the touch panel, swipes his / her finger downward in the displayed content, and scrolls the displayed content downward. In this case, “down” is stored as the scroll direction in the center position or direction 504a.

  Similarly, for example, when the user scrolls the content being displayed upward, for example, “up” is stored in the center position or direction 504a. When the user scrolls the displayed content in the left direction, for example, “left” is stored in the center position or direction 504a. When the user scrolls to the right of the displayed content, for example, “right” is stored in the center position or direction 504a. When the user scrolls the content being displayed in the lower left diagonal direction, for example, “lower left” is stored in the center position or direction 504a. When the user scrolls the displayed content in the upper left diagonal direction, for example, “upper left” is stored in the center position or direction 504a. When the user scrolls the displayed content in the lower right diagonal direction, for example, “lower right” is stored in the center position or direction 504a. When the user scrolls the displayed content in the upper right diagonal direction, for example, “upper right” is stored in the center position or direction 504a.

  In the center position or direction 504a, for example, in the case of the pinch-out operation or the pinch-in operation as described above, the position of the pixel serving as the center of the pinch-out operation or the pinch-in operation is fixed in the enlargement or reduction process. Stored. For example, in the case of a scroll operation, the direction in which the content is scrolled is stored. As the stored scrolling direction, in the above example, any one of the eight directions of “up”, “down”, “left”, “right”, “upper right”, “lower right”, “upper left”, and “lower left” is stored. It is comprised so that.

  FIG. 5B is a diagram illustrating operation history information 500b according to another embodiment. The operation history information 500b in FIG. 5B includes the operation information 501b similarly to the operation history information 500a in FIG. 5A. The operation information 501b includes an operation type 502b, an operation amount 503b, a center position or direction 504b. Is included. The operation history information 500b shown in FIG. 5B further includes a speed 505b. The speed 505b is information representing the operation speed of the scroll operation executed on the content being displayed on the terminal 101, for example. For example, in the example illustrated in FIG. 5B, information indicating the swipe distance per 1 millisecond (msec) in the scroll operation in units of pixels is stored as the speed 505 b.

  FIG. 6 is a diagram illustrating content management information 600 according to some embodiments. In one embodiment, the content management information 600 is held in the content information holding unit 322 of the storage unit 320 of the terminal 101. In another embodiment, the content management information 600 is stored in the storage unit 320 of the terminal 101. The content management information 600 includes content information 601. The content information 601 is associated with the content and stores information about the associated content. The content information 601 includes information such as a type 602, a size 603, and a security level 604, for example. The type 602 is information about the type of content, for example, information such as an extension of a file including the content. The size 603 is information about the size of the content. In the example of FIG. 6, the size 603 includes X605 and Y606. X605 is information on the resolution of the content in the X-axis direction. Y606 is information on the resolution of the content in the Y-axis direction. The security level 604 is information about the security level set for the content. In the example of FIG. 6, the security level 604 stores, for example, information that designates a group having content viewing qualifications. For example, the content associated with the content information 601 of the security level 604: “in-house” indicates that browsing is permitted for people in the company. On the other hand, the content associated with the content information 601 of the security level 604: “inside” indicates that it should not be shown to people outside the company. In the case of content that can be viewed by anyone, the security level is not particularly set. In this case, “public” is stored in the security level 604. The security level 604 may not be included in the content management information 600. For example, in some embodiments, content management information 600 does not include security level 604.

  FIG. 7 is a diagram illustrating display device information 700 according to some embodiments. In one embodiment, the display device information 700 is held in the own terminal display device information holding unit 323 of the storage unit 320 of the terminal 101. In another embodiment, the display device information 700 is stored in the storage unit 320 of the terminal 101. In the example illustrated in FIG. 7, the display device information 700 includes display device screen information 701 that is information about the display device 102 included in the terminal 101 and the display screen of the display device 102. The display device screen information 701 illustrated in FIG. 7 includes information about a display device ID 702, a screen physical size 703, a screen resolution 704, and a display device position 707. The display device ID 702 is information for identifying the display device 102. Here, since the display device 102 is a display device provided in the terminal 101, and the terminal 101 can identify the display device 102, in the example of the display device information 700 shown in FIG. Is not stored. The screen physical size 703 is information on the physical size of the screen of the display device 102 provided in the terminal 101. In the example shown in FIG. 7, the screen physical size 703 stores the diagonal dimensions of the screen in units: inches. The screen resolution 704 is information about the screen resolution of the display device 102. The screen resolution 704 includes X705 and Y706. X705 is resolution information in the X-axis direction of the screen of the display device 102. Y706 is resolution information in the Y-axis direction of the screen of the display device 102. The display device position 707 is information on the position of the display device 102 of the terminal 101 and includes information on latitude 708 and longitude 709. In latitude 708 and longitude 709, for example, information on latitude and longitude acquired by a GPS receiver provided in the terminal 101 is stored.

  FIG. 8 is a diagram illustrating external display device information 800 according to some embodiments. In one embodiment, the external display device information 800 is held in the external display candidate information holding unit 324 of the storage unit 320 of the terminal 101. In another embodiment, the external display device information 800 is stored in the storage unit 320 of the terminal 101. In the example shown in FIG. 8, the external display device information 800 includes display device screen information 801 that is information about the display device 103 around the terminal 101 and the display screen of the display device 103. The display device screen information 801 illustrated in FIG. 8 includes information of a display device ID 802, a screen physical size 803, a screen resolution 804, a display device position 807, and identification information 810. The display device ID 802 is information for identifying the external display device 103. In the example shown in FIG. 8, an example in which an IP address is used as the display device ID 802 is shown. The screen physical size 803 is information on the physical size of the screen of the display device 103. In the example shown in FIG. 8, the screen physical size 803 stores the diagonal dimensions of the screen in units: inches. The screen resolution 804 is information about the screen resolution of the display device 103. The screen resolution 804 includes X805 and Y806. X805 is information on the resolution in the X-axis direction of the screen of the display device 103. Y806 is resolution information in the Y-axis direction of the screen of the display device 103. The display device position 807 stores information about the position of the display device 103. The display device position 807 includes information on latitude 808 and longitude 809. In latitude 808 and longitude 809, for example, latitude and longitude information of the display device 103 is stored as position information of the display device 103, respectively. The identification information 810 is information registered so that the user can easily identify which display device 103 the display device screen information 801 is. For example, in the display device screen information 801 of the IP address “10.25.244.12”, “3F conference room rear screen” is registered as the identification information 810. For example, from the identification information 810, the user confirms that the display device 103 corresponding to the display device screen information 801 having the IP address “10.25.244.12” is a display device installed behind the conference room on the third floor. Can be identified. The identification information 810 may not be included in the external display device information 800.

  Note that the external display device information 800 illustrated in FIG. 8 is generated at a predetermined timing by the control unit 300 of the terminal 101. The predetermined timing may be, for example, a timing at which the user performs a process of searching for the surrounding display device 103 in the terminal 101. Alternatively, for example, it may be configured to detect that the terminal 101 has not moved for a predetermined time after moving a predetermined distance, and to generate at the detection timing. The detection of whether or not the terminal 101 is moving may be performed using a device capable of measuring the movement of the terminal 101 such as a GPS (Global Positioning System) or an acceleration sensor. For example, the terminal 101 generates the external display device information 800 at the predetermined timing as described above. Information about the external display device 103 existing in the surrounding area necessary for generating the external display device information 800 is acquired from the display device 103 existing in the surrounding area through the wireless communication 120, for example. Examples of information acquired from the external display device 103 include information such as a display device ID 802, a screen physical size 803, a screen resolution 804, a display device position 807, and identification information 810 necessary for registration of the display device screen information 801. It is included. Such information is stored in advance in, for example, a storage device included in the external display device 103, and the external display device 103 notifies the information in response to a request from the terminal 101. 101.

  The wireless communication 120 is, for example, short-range wireless communication having a maximum communication distance of a radius of several hundred meters or less. For example, Bluetooth (registered trademark), DLNA (registered trademark), UPnP (registered trademark), and Includes communication by wireless LAN (ad hoc) or the like. DLNA (registered trademark) is an abbreviation for Digital Living Network Alliance. UPnP is an abbreviation for Universal Plug and Play. The terminal 101 receives information necessary for generating the display device screen information 801 from the surrounding display devices 103 through the wireless communication 120 and generates the external display device information 800. For example, the control unit 300 of the terminal 101 acquires information from the display device 103 existing at a distance where short-range wireless communication is possible. Therefore, the display device 103 whose information is registered in the external display device information 800 is the display device 103 that exists in the vicinity of the terminal 101 at a predetermined timing when the external display device information 800 is generated.

  FIG. 9 is a diagram illustrating an operation flow of external display request processing executed by the control unit 300 of the terminal 101 according to some embodiments. The operation flow of the external display request process in FIG. 9 is implemented by, for example, reading and executing the program 410 stored in the storage unit 320 by the control unit 300 of the terminal 101. The operation flow of the external display request process in FIG. 9 starts when, for example, the terminal 101 instructs the display device 102 to display content. In step S <b> 901, the control unit 300 of the terminal 101 determines whether a display operation has been input for the content being displayed on the display device 102. When the display operation for the content is not input (No in step S901), the flow proceeds to step S912. On the other hand, if a display operation for content has been input (Yes in step S901), the flow proceeds to step S902. In step S902, the control unit 300 of the terminal 101 records the display operation performed on the content in the operation history information 500a. For example, the control unit 300 of the terminal 101 identifies the operation type 502a from the content of the input display operation. In one embodiment, if the input display operation is a pinch-out operation, enlargement, if it is a pinch-in operation, reduce if it is a one-point swipe operation, and scroll and operation type 502a may be specified. Further, the control unit 300 of the terminal 101 specifies the operation amount 503a from the contents of the input display operation. In one embodiment, when the operation type 502a is enlargement or reduction, the control unit 300 of the terminal 101 uses the number of pixels passed in the swipe to determine the distance swept between the two points in the pinch-out operation and the pinch-in operation. The represented value is specified as the operation amount 503a. When the operation type 502a is scrolling, a value representing the distance that one point is swiped by the number of pixels passed in the swipe is specified as the operation amount 503a. Furthermore, the control unit 300 of the terminal 101 specifies the center position or direction 504a from the contents of the input display operation. In one embodiment, the control unit 300 of the terminal 101, when the operation type 502a is enlargement or reduction, is the midpoint between the two points specified first before swiping in the pinch-out operation and the pinch-in operation. The position of the pixel is specified. When the operation type 502a is scroll, the scroll direction determined from the swipe direction is specified. For example, the control unit 300 of the terminal 101 registers the operation information 501a including the value specified as described above in the operation history information 500a.

  In step S903, the control unit 300 of the terminal 101 refers to the operation history information 500a and determines whether or not the display operation performed on the content is a predetermined number of times or more. If the content has not been displayed for a predetermined number of times (No in step S903), the flow returns to step S901. On the other hand, if the content has been operated more than the predetermined number of times (Yes in step S903), the flow proceeds to step S904. In the operation history information 500a, operation information 501a is registered every time a display operation is input to the content. Therefore, for example, this determination may be performed by determining whether or not the number of pieces of operation information 501a included in the operation history information 500a is a predetermined number or more.

  In step S <b> 904, the control unit 300 of the terminal 101 determines whether the content is already being displayed on the external display device 103. If the content is being displayed on the external display device 103 (Yes in step S904), the flow proceeds to step S910. On the other hand, when the content is not displayed on the external display device 103 (No in step S904), the flow proceeds to step S905. In step S905, the control unit 300 of the terminal 101 refers to the content management information 600 and determines whether or not the security level 604 of the content information 601 corresponding to the content being displayed is open. If the security level 604 of the content being displayed is public (step S905 is Yes), the process proceeds to step S907. On the other hand, if the security level 604 of the content being displayed is not public (No in step S905), the process proceeds to step S906, and an input instructing whether or not the content may be displayed on the external display device 103. Is received from the user. In step S906, when a signal instructing that the content being displayed by the user should not be displayed externally is input to the terminal 101 (No in step S906), the operation flow ends. On the other hand, when a signal indicating that the content being displayed by the user may be displayed externally is input to the terminal 101 (Yes in step S906), the flow proceeds to step S907.

  In step S907, the control unit 300 of the terminal 101 extracts a display device candidate extraction that extracts the external display device 103 that is a candidate for displaying content from the external display devices 103 registered in the external display device information 800. Execute the process. Details of the display device candidate extraction process will be described later.

  In step S908, the control unit 300 of the terminal 101 displays a list of display devices including information on the candidate external display device 103 that displays the content extracted in step S907 and information on the display device 102 included in the terminal 101. Present to the user. And the control part 300 of the terminal 101 receives selection of the display apparatus which displays a content from a user. In step S909, when the display device 102 included in the terminal 101 is selected from the candidate list instead of the external display device 103 (No in step S909), the operation flow ends. On the other hand, in step S909, when the external display device 103 is selected from the candidate list (step S909 is Yes), the flow proceeds to step S910. In step S <b> 910, the control unit 300 of the terminal 101 executes a display condition determination process, and determines a content display condition on the selected external display device 103. The display condition determination process is a process of determining a display condition that defines how content is displayed on the external display device 103. Details of the display condition determination processing will be described later.

  Subsequently, in step S911, the control unit 300 of the terminal 101 notifies the request to display the content with the determined display condition on the selected external display device 103. Then, the external display device 103 that has received this request displays the content under the display conditions determined in step S910. In step S911, when the external display device 103 is notified of a content display request, the flow returns to step S901.

  As described above, when the display operation for the content is not input (No in step S901), the flow proceeds to step S912. In step S912, the control unit 300 of the terminal 101 determines whether or not an instruction for ending display of the content being displayed has been input by the user. Here, the display end instruction includes, for example, an operation of closing the displayed content or an operation of displaying another content in place of the displayed content. In step S912, when the user inputs the end of content display (step S912 is Yes), the operation flow ends. On the other hand, if it is determined in step S912 that the user has not input content termination (No in step S912), the flow returns to step S901.

  Whether or not to request the external display device 103 to display content is determined by the operation flow of FIG. 9 described above. In the operation flow of FIG. 9, in step S901 to step S902, an operation history for the content being displayed is recorded. In step S903, when the number of operations on the content is equal to or greater than a predetermined number, the user is suggested to display the content on the external display device 103. This is considered that when the user repeatedly executes display operations such as enlargement, reduction, and scrolling on the content, the user has difficulty in browsing the content on the display device 102 of the terminal 101. . On the other hand, if the user has performed operations such as enlargement, reduction, and scrolling on the content only a few times, the user can view the content comfortably on the display device 102 of the terminal 101. I guess that. For example, even when content can be browsed sufficiently comfortably on the display device 102 of such a terminal 101, if a display using the external display device 103 is proposed, an unnecessary proposal is made. Therefore, user convenience is impaired. Therefore, in the present embodiment, the history of the display operation for the content being displayed is recorded, and when the number of display operations performed on the content is a predetermined number or more, the content on the external display device 103 is Is proposed to the user. As a result, it is possible to detect and propose a case where the user repeatedly performs display operations such as enlargement, reduction, scrolling, etc. on the content, and it is considered that it is difficult to browse the content. Convenient for users.

  Subsequently, the display device candidate extraction process executed in step S907 of FIG. 9 will be described with reference to FIG. FIG. 10 is a diagram illustrating display device candidate extraction processing executed by the control unit 300 of the terminal 101 according to some embodiments. The operation flow of the display device candidate extraction process in FIG. 10 is implemented, for example, when the control unit 300 of the terminal 101 reads and executes the program 410 stored in the storage unit 320. In step S1001, the control unit 300 of the terminal 101 refers to the display device information 700 and the external display device information 800, and refers to the external display device 103 having a larger screen size than the display device 102 of the own terminal 101. Extract from For example, the control unit 300 of the terminal 101 acquires the physical size of the display screen of the display device 102 of the terminal 101 from the screen physical size 703 of the display device information 700. Then, the external display device 103 having a display screen physical size larger than the acquired display screen physical size is extracted with reference to the screen physical size 803 of the external display device information 800.

  Subsequently, in step S1002, the control unit 300 of the terminal 101 determines whether the displayed content is a moving image. This determination may be made from the extension of the content being displayed, for example. For example, the type 602 of the content management information 600 corresponding to the content being displayed may be referred to, and if the type 602 is an extension representing a moving image such as “mpg”, it may be determined to be a moving image. When it is a moving image, it determines with Yes in step S1002, and progresses to step S1003.

  In step S1003, the control unit 300 of the terminal 101 displays a display device having a resolution equal to or higher than a predetermined ratio with respect to the resolution of the own terminal 101 from the display device screen information 801 of the external display device 103 extracted in step S1001. Screen information 801 is extracted. This extraction is performed, for example, by comparing the screen resolution 704 of the display device information 700 with the screen resolution 804 of the external display device information 800. That is, the display device screen information 801 having a resolution equal to or higher than a predetermined ratio with respect to the value of the screen resolution 704 is extracted from the display device screen information 801 of the external display device 103 extracted in step S1001. Is called. For example, when the resolution of the terminal 101 is 1, the predetermined ratio is set to a ratio of 1 or less including the display device 103 having a resolution lower than the resolution of the terminal 101. In one embodiment, the predetermined ratio is 2/3. Subsequently, in step S1004, the control unit 300 of the terminal 101 rearranges the extracted display device screen information 801 in the order of display devices having a larger screen size. This rearrangement is performed, for example, by referring to the screen physical size 803 of the display device screen information 801 and rearranging the display device screen information 801 in descending order. In step S1004, after rearranging in the order of the display devices with the largest screen size, this operation flow ends.

  On the other hand, in step S1002, if the type 602 is an extension representing a still image or document such as “jpg”, “bmp”, “doc”, etc., it is determined No, and the process proceeds to step S1005. In step S1005, the control unit 300 of the terminal 101 extracts display device screen information 801 having a resolution higher than that of the terminal 101 from the display device screen information 801 of the external display device 103 extracted in step S1002. To do. This extraction is performed, for example, by comparing the screen resolution 704 of the display device information 700 with the screen resolution 804 of the external display device information 800. That is, the display device screen information 801 having a resolution higher than the value of the screen resolution 704 is extracted from the display device screen information 801 of the external display device 103 extracted in step S1001. Subsequently, in step S1006, the control unit 300 of the terminal 101 determines whether the own terminal 101 and the external display device 103 are based on the display device position 807 of the extracted display device screen information 801 and the display device position 707 of the own terminal 101. Calculate the distance between them. Then, the control unit 300 of the terminal 101 rearranges the extracted display device screen information 801 in order of distance from the terminal 101, and the operation flow ends.

  According to the operation flow of FIG. 10 described above, the external display device 103 to be presented is extracted and the order is rearranged according to whether or not the content being displayed is a moving image. In the display device candidate extraction process of FIG. 10, when the content being displayed is a moving image, the external display device 103 having a resolution equal to or higher than a predetermined ratio (value of 1 or less) with respect to the resolution of the terminal 101 is used. It is configured to extract and rearrange in descending order of screen size. This is because when the content is a moving image, it is highly desirable for the user to view the content on a screen larger than the display device 102 of the terminal 101 itself. In this case, even if the resolution is slightly lower than that of the display device 102 of the own terminal 101, there is little influence on enjoying the moving image, and therefore a predetermined ratio (a value of 1 or less) with respect to the resolution of the own terminal 101. The external display device 103 having the above resolution is extracted. On the other hand, when the content being displayed is content other than a moving image, the external display device 103 having a resolution higher than the resolution of the terminal 101 is extracted and rearranged in the order of closer screens. This is because when the content is other than a moving image, for example, a still image or the like, it is possible for the user to browse the content on the display device 103 having a higher resolution than the display device 102 of the terminal 101 and view a wider area of the content. This is because it is highly desirable. In addition, when the content is other than a moving image, for example, a still image, it is not particularly desirable to view it on a large screen, so a display screen with a short distance that can be used more easily by the user is rearranged at the top. doing. As described above, the display device screen information 701 for the display device 102 included in the terminal 101 is added to the list of the display device screen information 801 of the external display device 103 that is the display candidate extracted and rearranged as described above. A list of candidates is presented in step S908. An example of a list of display device candidates presented to the user in step S908 is illustrated in FIG.

  FIG. 11 is a diagram illustrating a list 1100 of display device candidates according to an embodiment. The list 1100 illustrated in FIG. 11 is an example of a list of display device candidates in the case where the determination is Yes in step S1002 in FIG. 10 and the screens are rearranged in descending order of the screen size in step S1004. A list 1100 illustrated in FIG. 11 includes display device screen information 1101. The display device screen information 1101 includes information of a display device ID 1102, a screen physical size 1103, a screen resolution 1104, a display device position 1107, and identification information 1110. In FIG. 11, display device screen information 1101 shown at the top is information about the display device 102 included in the added own terminal 101. Therefore, the information from the display device ID 1102 to the display device position 1107 of the display device screen information 1101 shown at the top is information corresponding to the information from the display device ID 702 to the display device position 707, respectively. On the other hand, display device screen information 1101 shown in the second and subsequent rows is a list of external display devices 103 that are candidates extracted in step S907. Therefore, the information from the display device ID 1102 to the identification information 1110 of the display device screen information 1101 shown in the second and subsequent stages is information corresponding to the information from the display device ID 802 to the identification information 810, respectively. In the list 1100 shown in FIG. 11, the display device screen information 1101 for the external display devices 103 displayed in the second and subsequent levels is rearranged in descending order of the screen physical size as can be seen with reference to the screen physical size 1103. It has been. For example, the list 1100 described above is presented to the user in step S908.

  Next, with reference to FIG. 12, the display condition determination process executed in step S910 in FIG. 9 will be described. FIG. 12 is a diagram illustrating display condition determination processing executed by the control unit 300 of the terminal 101 according to some embodiments. The operation flow of the display condition determination process in FIG. 12 is implemented, for example, when the control unit 300 of the terminal 101 reads and executes the program 410 stored in the storage unit 320. In step S1201, the control unit 300 of the terminal 101 determines an operation type from the operation type 502a of the operation information 501a of the display operation input in step S901 and registered in the operation history information 500a in step S902. If the operation type is enlarged, the process proceeds to step S1202. If the operation type is reduced, the process proceeds to step S1203. If the operation type is scroll, the process proceeds to step S1204.

  In step S1202, the control unit 300 of the terminal 101 executes the display condition determination process in the enlargement operation according to some embodiments, and then the operation flow ends. In step S1203, after the control unit 300 of the terminal 101 executes the display condition determination process in the reduction operation according to some embodiments, the operation flow ends. In step S1204, the control unit 300 of the terminal 101 executes the display condition determination process in the scroll operation according to some embodiments, and then the operation flow ends. Details of the display condition determination process in each of the enlargement operation, the reduction operation, and the scroll operation executed in steps S1202, S1203, and S1204 will be described later.

  First, display condition determination processing in an enlargement operation according to some embodiments will be described with reference to FIGS. 13 and 14. FIG. 13 is a diagram illustrating display condition determination processing in an enlargement operation according to some embodiments. FIG. 13 shows the display device 102 provided in the terminal 101 and the external display device 103 selected in step S908. Two display devices 102 are shown. The display device 102 on the left side of the drawing is the display device 102 before execution of content enlargement, and the display device 102 on the right side of the drawing is the display device 102 after execution of content enlargement. When an enlargement operation is input by the user on the terminal 101, the display magnification is changed according to the input operation amount of the enlargement operation, and the content is enlarged and displayed. A display area 1302 represents a specific area of content before execution of content enlargement, and a display area 1303 represents the same area after execution of content enlargement. As shown in the figure, after execution of content enlargement, the display area 1302 is enlarged and displayed in the display area 1303.

  Next, display on the external display device 103 according to some embodiments when the above-described enlargement operation is performed on the display device 102 will be described. An external display device 103 illustrated in FIG. 13 represents the external display device 103 after the terminal 101 performs content enlargement. As shown in the figure, the display area 1303 of the display device 102 after the enlargement of the content is displayed at a further enlarged display magnification on the external display device 103. In the present embodiment, the external display device 103 is configured to display on the external display device 103 using a display magnification further enlarged than the display magnification used by the display device 102 after execution of content enlargement. doing. Therefore, during the enlargement operation, more enlarged content is displayed on the external display device 103, and the user can use the enlarged content on the external display device 103 having a larger screen than the display device 102 of the own terminal 101. , You can check the contents in more detail. Further, as an external display device 103 requesting display of content, a display device 103 having a screen size larger than that of the terminal 101 is extracted in step S1001. For this reason, even if the external display device 103 displays the image with a display magnification that is larger than the display magnification of the own terminal 101, a sufficiently wide area of the content is displayed, and visibility is not impaired.

  FIG. 14 is a diagram illustrating an operation flow of display condition determination processing in an enlargement operation executed by the control unit 300 of the terminal 101 according to some embodiments. The operation flow of the display condition determination process in the enlargement operation of FIG. 14 is implemented, for example, by the control unit 300 of the terminal 101 reading and executing the program 410 stored in the storage unit 320. The operation flow of the display condition determination process in the enlargement operation in FIG. 14 starts when the operation type is determined to be an enlargement operation in step S1201 in FIG. 12, and the process proceeds to step S1202. In step S1401, the control unit 300 of the terminal 101 refers to the operation history information 500a and determines whether or not there is a predetermined number or more of operation information 501a whose operation type 502a is expansion. That is, it is determined whether or not the number of enlargement operations performed on the content is greater than or equal to a predetermined number. When the operation information 501a whose operation type 502a is expansion is not equal to or greater than the predetermined number (step S1401 is No), this operation flow ends.

  On the other hand, if there is a predetermined number or more of operation information 501a whose operation type 502a is expansion (step S1401 is Yes), the flow proceeds to step S1402. In step S1402, the value of the operation amount 503a of the operation information 501a corresponding to the enlargement operation input in step S901 is acquired, and the enlargement magnification corresponding to the operation amount 503a is acquired. Then, the display magnification of the content on the display device 102 of the terminal 101 is acquired by multiplying the display magnification of the content on the display device 102 of the terminal 101 by the acquired magnification. The process of acquiring the magnification rate of the content from the operation amount 503a may use a method of determining the magnification rate by a pinch-out operation used in an existing smartphone, for example. In the process of acquiring the magnification of the content from the operation amount according to the embodiment, a table in which the operation amount and the enlargement factor are associated with each other is stored in the storage unit 320 in advance, and the operation amount 503a is referred to by referring to the table. The magnification is acquired. Then, the display magnification of the content after enlargement on the display device 102 of the terminal 101 may be acquired by multiplying the display magnification used for displaying the content on the terminal 101 by the acquired enlargement magnification.

  Subsequently, in step S1403, the display magnification of the enlarged content used for displaying the content on the display device 102 of the own terminal 101 acquired in step S1402 is multiplied by a magnification larger than one. Thereby, the display magnification of the content in the external display device 103 that requests the display of the content is set. In step S1404, the control unit 300 of the terminal 101 obtains the position of the point on the content whose position is fixed in the enlargement process from the center position or direction 504a of the operation information 501a corresponding to the enlargement operation input in step S901. To do. The point on the content is used as a point for fixing the position in the enlargement process even in the enlarged display on the external display device 103, and the display position of the content is set. The position on the display device 103 outside the point on the content stored in the center position or direction 504a can be arranged in an arbitrary manner. For example, in one embodiment, it is assumed that the center of the display screen of the display device 102 of the terminal 101 and the center of the display screen of the external display device 103 are overlapped with each other. When overlapping in this way, the pixel on which the point on the content stored in the center position or direction 504a is arranged is the position of the pixel from the center of the display screen of the display device 102 and the external display device 103. It may be arranged on the external display device 103 so as to match. Alternatively, in another embodiment, the position of the point on the content whose position is fixed in the enlargement process stored in the center position or direction 504a may be arranged at the center of the display screen in the external display device 103. Good. For example, the display position of the content is determined as described above.

  In step S1405, content display conditions on the external display device 103 are determined so that the content is displayed at the display position set in step S1404 at the display magnification set in step S1403. Note that the point on the content where the position is fixed when the content is enlarged at the display magnification set in step S1403 is the same as the point on the content stored in the center position or direction 504a. After the display conditions are determined in step S1405, the operation flow ends.

  The display conditions for the external display device 103 in the enlargement operation are determined by the operation flow of FIG. 14 described above. In the display condition determination processing in the enlargement operation of FIG. 14, the external display device 103 multiplies the content display magnification on the display device 102 of the terminal 101 after execution of content enlargement by the enlargement operation by a magnification larger than 1. The display magnification is set to display. Therefore, the content is displayed on the external display device 103 at a display magnification that is larger than that displayed on the display device 102 of the terminal 101. Accordingly, the user can view the content on the external display device 103 having a screen larger than that of the terminal 101 on a larger scale. For this reason, it is possible to confirm the area of the content desired to be enlarged and browsed by performing an enlargement operation on the external display device 103 in more detail.

  Furthermore, in the operation flow of FIG. 14, the operation information 501a is referred to, and when the number of enlargement operations performed on the content is equal to or greater than a predetermined number, the processing from step S1402 is executed. . And it is comprised so that the display conditions of the external display apparatus 103 which concern on this embodiment may be determined by the process after step S1402. Therefore, when the content frequently requires enlargement operation, the user can view the content displayed on the external display device 103 at a further enlarged display magnification. Therefore, the user's work of adjusting the content to a size that allows easy viewing of the content by repeating the enlargement operation is reduced, which is highly convenient.

  Note that a predetermined value that is set in advance, such as 1.5, may be used as the magnification larger than 1 multiplied by the display magnification in step S1402. Alternatively, a magnification larger than 1 may be calculated from the resolution between the display device 102 of the terminal 101 and the external display device 103. For example, in one embodiment, the magnification larger than 1 that is multiplied by the display magnification is X805 that is the X-axis resolution of the external display device 103, and the X-axis resolution of the display device 102 of the own terminal 101. It may be calculated by dividing by X705. That is, it may be obtained by “a magnification larger than 1 multiplied by the display magnification = X805 of the external display device 103 / X705 of the display device 102”. Alternatively, in one embodiment, the magnification larger than 1 multiplied by the display magnification is Y806, which is the resolution of the Y axis of the external display device 103, and the resolution of the Y axis of the display device 102 of the own terminal 101. It may be calculated by dividing by Y706. That is, it may be obtained by “magnification larger than 1 multiplied by display magnification = Y806 of external display device 103 / Y706 of display device 102”. Furthermore, in another embodiment, the average value of the values obtained by “X805 of the external display device 103 / X705 of the display device 102” and “Y806 of the external display device 103 / Y706 of the display device 102” is calculated. You may use as a magnification larger than 1 which multiplies with respect to display magnification.

  Next, display condition determination processing in a reduction operation according to some embodiments will be described with reference to FIGS. 15 and 16. FIG. 15 is a diagram illustrating display condition determination processing in a reduction operation according to some embodiments. FIG. 15 shows the display device 102 provided in the terminal 101 and the external display device 103 selected in step S908. Two display devices 102 are shown. The display device 102 on the left side of the drawing is the display device 102 before the content reduction, and the display device 102 on the right side of the drawing is the display device 102 after the content reduction. When a reduction operation is input by the user on the terminal 101, the display magnification is changed according to the input operation amount of the reduction operation, and the content is reduced and displayed. A display area 1502 represents a specific area of the content before execution of the content reduction, and a display area 1503 represents the same area after execution of the content reduction. As shown in the figure, the display area 1502 is reduced and displayed in the display area 1503 after the content reduction.

  Next, display on the external display device 103 according to some embodiments when the above reduction operation is performed on the display device 102 will be described. An external display device 103 illustrated in FIG. 15 represents the external display device 103 after the content reduction is performed in the terminal 101. As shown in the figure, the display area 1503 of the display device 102 after the content reduction is performed is displayed at a further reduced display magnification on the external display device 103. Thus, in the present embodiment, the external display device 103 displays on the external display device 103 using a display magnification reduced or the same display magnification as the display magnification used in the display area 1503 of the display device 102. It is configured to make it. By configuring in this way, for example, the following effects can be obtained. For example, a display device 103 having a larger resolution than the display device of the terminal 101 is extracted as the external display device 103 that is a candidate for requesting content display. In this case, even if the same display magnification as that of the terminal 101 is used in the external display device 103, a wider range of content is displayed on the display screen of the external display device 103. Furthermore, when a display magnification lower than the display magnification of the display device 102 of the terminal 101 is used in the external display device 103, a wider range of content can be displayed. Therefore, the user can confirm a wider range of content on the external display device 103 having a larger screen than the display device 102 of the terminal 101 itself.

  FIG. 16 is a diagram illustrating an operation flow of display condition determination processing in a reduction operation executed by the control unit 300 of the terminal 101 according to some embodiments. The operation flow of the display condition determination process in the reduction operation in FIG. 16 is implemented, for example, when the control unit 300 of the terminal 101 reads and executes the program 410 stored in the storage unit 320. The operation flow of the display condition determination process in the reduction operation in FIG. 16 starts when the operation type is determined to be a reduction operation in step S1201 in FIG. 12, and the process proceeds to step S1203. In step S1601, the control unit 300 of the terminal 101 refers to the operation history information 500a and determines whether or not there is a predetermined number or more of operation information 501a whose operation type 502a is reduced. That is, it is determined whether the number of reduction operations performed on the content is equal to or greater than a predetermined number. When the operation information 501a whose operation type 502a is reduction is not equal to or greater than the predetermined number (No in step S1601), the operation flow ends.

  On the other hand, if there are more than a predetermined number of pieces of operation information 501a whose operation type 502a is reduction (step S1601 is Yes), the flow proceeds to step S1602. In step S1602, the value of the operation amount 503a of the operation information 501a corresponding to the reduction operation input in step S901 is acquired, and the reduction magnification corresponding to the operation amount 503a is acquired. Then, the display magnification of the content after reduction on the display device 102 of the terminal 101 is acquired by multiplying the display magnification of the content before reduction on the display device 102 of the terminal 101 by the acquired reduction magnification. The process of acquiring the reduction ratio of the content from the operation amount 503a may use a method of determining the reduction ratio by, for example, a pinch-in operation used with an existing smartphone or the like. In the process of acquiring the content reduction ratio from the operation amount according to the embodiment, a table in which the operation amount and the reduction ratio are associated with each other is stored in the storage unit 320 in advance, and the operation amount 503a is referred to by referring to the table. The reduction ratio is acquired. Then, the display magnification of the reduced content on the display device 102 of the terminal 101 may be acquired by multiplying the display magnification used for displaying the content on the terminal 101 by the acquired reduction magnification.

  Subsequently, in step S1603, the display magnification of the reduced content used for displaying the content on the display device 102 of the own terminal 101 acquired in step S1602 is multiplied by a magnification of 1 or less. Thereby, the display magnification of the content in the external display device 103 that requests the display of the content is set. In step S1604, the control unit 300 of the terminal 101 acquires the position of the point on the content whose position is fixed in the reduction process, from the center position or direction 504a of the operation information 501a corresponding to the reduction operation input in step S901. To do. The point on the content is used as a point for fixing the position in the reduction process even in the reduced display on the external display device 103, and the display position of the content is set. The position on the display device 103 outside the point on the content stored in the center position or direction 504a can be arranged in an arbitrary manner. For example, in one embodiment, it is assumed that the center of the display screen of the display device 102 of the terminal 101 and the center of the display screen of the external display device 103 are overlapped with each other. When overlapping in this way, the pixel on which the point on the content stored in the center position or direction 504a is arranged is the position of the pixel from the center of the display screen of the display device 102 and the external display device 103. You may arrange | position in the external display apparatus 103 so that it may correspond. Alternatively, in another embodiment, the position of the point on the content whose position is fixed in the reduction processing stored in the center position or direction 504a may be arranged at the center of the display screen in the external display device 103. Good. For example, the display position of the content is determined as described above.

  In step S1605, content display conditions on the external display device 103 are determined so that the content is displayed at the display position set in step S1604 at the display magnification set in step S1603. When the display magnification is set by multiplying by a magnification less than 1 in step S1603, the point on the content whose position is fixed when the content is reduced by the set display magnification is stored in the center position or direction 504a. Same as content point. After the display conditions are determined in step S1605, the operation flow ends.

  The display conditions for the external display device 103 in the reduction operation are determined by the operation flow of FIG. 16 described above. In the display condition determination processing in the reduction operation of FIG. 16, the content display magnification on the display device 102 of the terminal 101 after execution of the content reduction by the reduction operation is multiplied by a magnification of 1 or less on the external display device 103. Display magnification is set for display. Therefore, on the external display device 103, the content is displayed at the same display magnification as that displayed on the display device 102 of the terminal 101 or at a reduced display magnification. Therefore, the user can check a wider range of content on the external display device 103 having a larger screen than the terminal 101 itself. For this reason, it is possible to confirm the content desired to be reduced and browsed by performing the reduction operation on the external display device 103 over a wider range.

  Furthermore, the operation flow of FIG. 14 is configured to refer to the operation information 501a and execute the processing after step S1602 when the number of reduction operations performed on the content is equal to or greater than a predetermined number. . And it is comprised so that the display conditions of the external display apparatus 103 which concern on this embodiment may be determined by the process after step S1602. Therefore, when the content frequently requires a reduction operation, the user can view the content displayed on the external display device 103 at a reduced display magnification. For this reason, the user's work of adjusting the content to be easy to view by repeating the reduction operation is reduced, and the convenience is high.

  Note that a predetermined value that is set in advance, such as 0.8, may be used as a magnification of 1 or less that is multiplied by the display magnification in step S1608. Or you may comprise so that it may calculate from information, such as the resolution of the display apparatus 102 of the own terminal 101, and the external display apparatus 103. FIG. For example, in one embodiment, the magnification of 1 or less that is multiplied by the display magnification is X705 that is the X-axis resolution of the display device 102 of the terminal 101, and X805 that is the X-axis resolution of the external display device 103. It may be calculated by dividing by. Similarly, it may be calculated by dividing Y706, which is the Y-axis resolution of the display device 102 of the terminal 101, by Y806, which is the Y-axis resolution of the external display device 103. Or the average value of the calculation result in these X-axis and Y-axis may be sufficient.

  Subsequently, a display condition determination process in a scroll operation according to some embodiments will be described with reference to FIGS. 17 to 19. FIG. 17 is a diagram illustrating a reference position 1710 of the display screen 1700 used in the display condition determination process in the scroll operation according to some embodiments. FIG. 17 shows a display screen 1700 of a display device such as the display device 102 and the external display device 103, for example. It is assumed that the left direction in the drawing coincides with the upper direction of the content and the display screen. In FIG. 17, dotted lines are shown at the center of the upper and lower widths of the display screen 1700 and at the center of the left and right widths. In such a display screen 1700, the reference position 1710 is set. The middle point of the left and right widths at the upper end of the display screen 1700 is set as an upper reference position 1710 and is set as an upper reference point 1701. Further, the position of the middle point of the left and right widths at the lower end of the display screen 1700 is set as a lower reference position 1710 and is set as a lower reference point 1702. The left reference point 1703 is defined as a left reference position 1710 at the left end of the display screen 1700 where the middle point of the vertical width is the left reference position 1710. A right reference point 1704 is set with a right reference point 1710 at the right end of the display screen 1700 and the middle point of the upper and lower widths. The position of the upper left corner of the display screen 1700 is defined as the upper left reference point 1705 with the upper left reference position 1710. The position of the lower left corner of the display screen 1700 is set as a lower left reference point 1706 as a lower left reference position 1710. The position of the upper right end of the display screen 1700 is defined as an upper right reference point 1707 with the upper right reference position 1710. The position of the lower right corner of the display screen 1700 is set as a lower right reference point 1708 as a lower right reference position 1710. For example, display condition determination processing in a scroll operation according to some embodiments is performed using eight reference points that become the reference position 1710 determined as described above.

  FIG. 18 is a diagram for explaining display condition determination processing in a scroll operation according to some embodiments. 18A to 18F show the display device 102 provided in the terminal 101 and the external display device 103 selected in step S908. It is assumed that the upward direction in the drawing coincides with the upward direction of the content and the display screen. FIG. 18A is a diagram for explaining determination of content display conditions on the external display device 103 when the content is scrolled upward.

  In the display condition determination process in the scroll operation according to some embodiments, when the user scrolls the content upward, the upper reference point 1701 is selected as the reference position 1710 as shown in FIG. . Then, a point on the content at the position of the upper reference point 1701 after the scrolling of the content is completed on the display device 102 provided in the terminal 101 is acquired. Subsequently, content alignment is performed in the external display device 103 so that the acquired point on the content is arranged at the upper reference point 1701 of the external display device 103. In the present embodiment, in the case of a scroll operation, the display magnification at the terminal 101 is multiplied by a value less than 1, and the display is performed on the external display device 103 at a reduced display magnification. . Therefore, when the content is scrolled upward, the area below the content is displayed by the display magnification reduced from the display magnification on the display device 102 of the terminal 101 and the alignment using the upper reference point 1701. Is displayed on the external display device 103 in a wider range. Therefore, the user can view the display content intended in the scroll operation on the external display device 103 in a wider range.

  FIG. 18B is a diagram for explaining determination of content display conditions on the external display device 103 when the content is scrolled downward. In the display condition determination process in the scroll operation according to some embodiments, the lower reference point 1702 is selected as the reference position 1710 when the user scrolls the content downward. Then, the point on the content at the position of the lower reference point 1702 after the scrolling of the content is completed on the display device 102 provided in the terminal 101 is acquired. Subsequently, the content alignment is performed in the external display device 103 so that the acquired point on the content is arranged at the lower reference point 1702 of the external display device 103. In the case of a scroll operation, the display magnification at the terminal 101 is multiplied by a value less than 1, and display is performed on the external display device 103 at a reduced display magnification. Therefore, when the content is scrolled downward, the region above the content is more extensive due to the display magnification reduced than the display magnification of the display device 102 of the terminal 101 and the alignment by the lower reference point 1702. Is displayed on the external display device 103. Therefore, the user can view the display content intended in the scroll operation on the external display device 103 in a wider range.

  FIG. 18C is a diagram illustrating determination of content display conditions on the external display device 103 when the content is scrolled to the left. In the display condition determination process in the scroll operation according to some embodiments, the left reference point 1703 is selected as the reference position 1710 when the user scrolls the content in the left direction. Then, a point on the content at the position of the left reference point 1703 after the scrolling of the content is completed on the display device 102 provided in the terminal 101 is acquired. Subsequently, the content alignment is performed on the external display device 103 so that the acquired point on the content is arranged at the left reference point 1703 of the external display device 103. In the case of a scroll operation, the display magnification at the terminal 101 is multiplied by a value less than 1, and display is performed on the external display device 103 at a reduced display magnification. Therefore, when the content is scrolled to the left, the right region of the content is more extensive due to the display magnification reduced than the display magnification on the display device 102 of the terminal 101 and the alignment by the left reference point 1703. Is displayed on the external display device 103. Therefore, the user can view the display content intended in the scroll operation on the external display device 103 in a wider range.

  FIG. 18D is a diagram illustrating determination of content display conditions on the external display device 103 when the content is scrolled to the right. In the display condition determination process in the scroll operation according to some embodiments, the right reference point 1704 is selected as the reference position 1710 when the user scrolls the content in the right direction. Then, the point on the content at the position of the right reference point 1704 after the scrolling of the content is completed on the display device 102 provided in the terminal 101 is acquired. Subsequently, content alignment is performed on the external display device 103 so that the acquired point on the content is arranged at the right reference point 1704 of the external display device 103. In the case of a scroll operation, the display magnification at the terminal 101 is multiplied by a value less than 1, and display is performed on the external display device 103 at a reduced display magnification. Therefore, when the content is scrolled in the right direction, the area on the left side of the content is more extensive due to the display magnification reduced than the display magnification on the display device 102 of the terminal 101 and the alignment by the right reference point 1704. Is displayed on the external display device 103. Therefore, the user can view the display content intended in the scroll operation on the external display device 103 in a wider range.

  FIG. 18E is a diagram for explaining determination of content display conditions on the external display device 103 when the content is scrolled in the upper left direction. In the display condition determination process in the scroll operation according to some embodiments, the upper left reference point 1705 is selected as the reference position 1710 when the user scrolls the content in the upper left direction. Then, the point on the content at the position of the upper left reference point 1705 after the scrolling of the content is completed on the display device 102 provided in the terminal 101 is acquired. Subsequently, the content alignment is performed on the external display device 103 so that the acquired point on the content is arranged at the upper left reference point 1705 of the external display device 103. In the case of a scroll operation, the display magnification at the terminal 101 is multiplied by a value less than 1, and display is performed on the external display device 103 at a reduced display magnification. Therefore, when the content is scrolled in the upper left direction, the lower right region of the content is determined by the display magnification reduced from the display magnification of the display device 102 of the terminal 101 and the alignment by the upper left reference point 1705. A wider range is displayed on the external display device 103. Therefore, the user can view the display content intended in the scroll operation on the external display device 103 in a wider range.

  FIG. 18F is a diagram illustrating determination of content display conditions on the external display device 103 when the content is scrolled in the lower right direction. In the display condition determination process in the scroll operation according to some embodiments, the lower right reference point 1708 is selected as the reference position 1710 when the user scrolls the content in the lower right direction. Then, a point on the content at the position of the lower right reference point 1708 after the scrolling of the content is completed on the display device 102 provided in the terminal 101 is acquired. Subsequently, content alignment is performed on the external display device 103 so that the acquired point on the content is arranged at the lower right reference point 1708 of the external display device 103. In the case of a scroll operation, the display magnification at the terminal 101 is multiplied by a value less than 1, and display is performed on the external display device 103 at a reduced display magnification. Therefore, when the content is scrolled in the lower right direction, the upper left area of the content is obtained by the display magnification reduced from the display magnification on the display device 102 of the terminal 101 and the alignment by the lower right reference point 1708. Is displayed on the external display device 103 in a wider range. Therefore, the user can view the display content intended in the scroll operation on the external display device 103 in a wider range.

  The determination of content display conditions on the external display device 103 when scrolling in the lower left direction is performed in the same manner. That is, in the display condition determination process in the scroll operation according to some embodiments, the lower left reference point 1706 is selected as the reference position 1710 when the user scrolls the content in the lower left direction. Then, the point on the content at the position of the lower left reference point 1706 after the scrolling of the content is completed on the display device 102 provided in the terminal 101 is acquired. Subsequently, content alignment is performed on the external display device 103 so that the acquired point on the content is arranged at the lower left reference point 1706 of the external display device 103. In the case of a scroll operation, the display magnification at the terminal 101 is multiplied by a value less than 1, and display is performed on the external display device 103 at a reduced display magnification. Therefore, when the content is scrolled in the lower left direction, the area on the upper right side of the content is further increased by the display magnification reduced than the display magnification on the display device 102 of the terminal 101 and the alignment by the lower left reference point 1706. A wide range is displayed on the external display device 103. Therefore, the user can view the display content intended in the scroll operation on the external display device 103 in a wider range.

  The determination of content display conditions on the external display device 103 when scrolling in the upper right direction is performed in the same manner. That is, in the display condition determination process in the scroll operation according to some embodiments, the upper right reference point 1707 is selected as the reference position 1710 when the user scrolls the content in the upper right direction. Then, a point on the content at the position of the upper right reference point 1707 after the scrolling of the content is completed on the display device 102 provided in the terminal 101 is acquired. Subsequently, the content alignment is performed on the external display device 103 so that the acquired point on the content is arranged at the upper right reference point 1707 of the external display device 103. In the case of a scroll operation, the display magnification at the terminal 101 is multiplied by a value less than 1, and display is performed on the external display device 103 at a reduced display magnification. Accordingly, when the content is scrolled in the upper right direction, the lower left region of the content is more enhanced by the display magnification reduced than the display magnification on the display device 102 of the terminal 101 and the alignment by the upper right reference point 1707. A wide range is displayed on the external display device 103. Therefore, the user can view the display content intended in the scroll operation on the external display device 103 in a wider range.

  As described above with reference to FIG. 18, in some embodiments, when the scroll operation is performed, the display magnification is reduced. In addition, a position serving as a reference of content for executing display magnification reduction is selected and determined from eight reference points from an upper reference point 1701 to a lower right reference point 1708 based on the scroll direction. For this reason, the content area spreading in the direction opposite to the scrolling direction is displayed in a wide range on the external display device 103, and the user can check the content browsing area on the external display device 103 in a wide range.

  The display condition determination process in the scroll operation according to some embodiments described with reference to FIG. 18 will be described with reference to FIG. FIG. 19 is a diagram illustrating an operation flow of display condition determination processing in a scroll operation executed by the control unit 300 of the terminal 101 according to some embodiments. The display condition determination process in the scroll operation of FIG. 19 is implemented by, for example, reading and executing the program 410 stored in the storage unit 320 by the control unit 300 of the terminal 101. The operation flow of the display condition determination process in the scroll operation in FIG. 19 starts when the display operation is determined to be the scroll operation in step S1201 in FIG. 12 and the process proceeds to step S1204. In step S1901, the control unit 300 of the terminal 101 refers to the operation history information 500a and determines whether or not there is a predetermined number or more of operation information 501a whose operation type 502a is scroll. That is, it is determined here whether or not the number of scroll operations performed on the content is equal to or greater than a predetermined number. If the operation information 501a whose operation type 502a is scroll is not equal to or greater than the predetermined number (No in step S1901), the operation flow ends.

  On the other hand, if there is a predetermined number or more of operation information 501a whose operation type 502a is scroll (Yes in step S1901), the flow proceeds to step S1902. In step S1902, the control unit 300 of the terminal 101 acquires the scroll direction from the center position or the direction 504a of the operation information 501a of the scroll operation input in step S901. Then, the control unit 300 of the terminal 101 selects a reference position 1710 in a direction that matches the acquired scroll direction, and determines a reference point. That is, if the scroll direction stored in the center position or direction 504 a is “up”, the upper reference point 1701 is selected as the reference position 1710. If the scroll direction stored in the center position or direction 504 a is “down”, the lower reference point 1702 is selected as the reference position 1710. If the scroll direction stored in the center position or direction 504 a is “left”, the left reference point 1703 is selected as the reference position 1710. If the scroll direction stored in the center position or direction 504 a is “right”, the right reference point 1704 is selected as the reference position 1710. If the scroll direction stored in the center position or direction 504 a is “upper left”, the upper left reference point 1705 is selected as the reference position 1710. If the scroll direction stored in the center position or direction 504 a is “lower left”, the lower left reference point 1706 is selected as the reference position 1710. If the scroll direction stored in the center position or direction 504 a is “upper right”, the upper right reference point 1707 is selected as the reference position 1710. If the scroll direction stored in the center position or direction 504 a is “lower right”, the lower right reference point 1708 is selected as the reference position 1710.

  Subsequently, in step S1903, the control unit 300 of the terminal 101 multiplies the current content display magnification on the display device 102 of the terminal 101 by a magnification less than 1 to display on the external display device 103. Set the reduced display magnification of the content. As a magnification smaller than 1, for example, a preset value such as 0.5 may be used.

  Subsequently, in step S1904, the control unit 300 of the terminal 101 sets the display position of the content on the external display device 103 using the reference position 1710 determined in step S1902. That is, when content scrolling is completed on the display device 102 provided in the terminal 101, a point on the content at the reference position 1710 determined in step S1902 is acquired. Then, the display position of the content on the external display device 103 is set so that the acquired point on the content is arranged on the same reference position 1710 of the external display device 103. In step S1905, content display conditions on the external display device 103 are determined so that the content is displayed at the display position set in step S1904 at the display magnification set in step S1903, and this operation flow ends.

  The display conditions for the external display device 103 in the scroll operation are determined by the operation flow of FIG. 19 described above. In the display condition determination processing in the scroll operation of FIG. 19, the display magnification for display on the external display device 103 is set by multiplying the display magnification on the terminal 101 by a magnification less than 1. Therefore, the content is displayed on the external display device 103 at a reduced display magnification compared to the case of displaying on the display device 102 of the terminal 101. Since the external display device 103 has a screen larger than that of the terminal 101 and displays the image at a reduced display magnification as compared with the case where it is displayed on the display device 102 of the terminal 101, the external display device 103 allows the user to It is possible to see a wider area.

  Subsequently, a display condition determination process in a scroll operation executed by the control unit 300 of the terminal 101 according to another embodiment will be described with reference to FIGS. In the display condition determination process in the scroll operation described with reference to FIGS. 20 and 21, the operation history information 500b including the speed 505b illustrated in FIG. 5B is stored in, for example, the operation history holding unit 326 or the storage unit 320. Assume that it is stored.

  FIG. 20 is a diagram illustrating speed corresponding magnification setting information 2000 according to some embodiments. In one embodiment, the speed corresponding magnification setting information 2000 is held in the speed corresponding magnification holding unit 327 of the storage unit 320 of the terminal 101. In another embodiment, the speed corresponding magnification setting information 2000 is stored in the storage unit 320 of the terminal 101. The speed corresponding magnification setting information 2000 includes speed corresponding magnification information 2001. The speed corresponding magnification information 2001 includes a speed 2002 and a reduction magnification 2003. The speed 2002 is information representing the operation speed of the scroll operation executed on the terminal 101. In FIG. 20, the speed 2002 stores information representing the swipe distance per 1 millisecond (msec) in the scroll operation in units of pixels. The reduction magnification 2003 stores a magnification associated with the speed correspondence magnification information 2001 of the speed 2002.

  FIG. 21 is a diagram illustrating an operation flow of display condition determination processing in a scroll operation executed by the control unit 300 of the terminal 101 according to another embodiment. The display condition determination process in the scroll operation of FIG. 21 is implemented by, for example, reading and executing the program 410 stored in the storage unit 320 by the control unit 300 of the terminal 101. The operation flow of the display condition determination process in the scroll operation in FIG. 21 starts when it is determined in step S1201 in FIG. 12 that the display operation is a scroll operation and the process proceeds to step S1204. In step S2101, the control unit 300 of the terminal 101 refers to the operation history information 500b and determines whether or not there is a predetermined number or more of operation information 501b whose operation type 502b is scroll. That is, it is determined here whether or not the number of scroll operations performed on the content is equal to or greater than a predetermined number. When the operation information 501b whose operation type 502b is scroll is not equal to or larger than the predetermined number (step S2101: No), this operation flow ends.

  On the other hand, if there is a predetermined number or more of operation information 501b whose operation type 502b is scroll (step S2101 is Yes), the flow proceeds to step S2102. In step S2102, the control unit 300 of the terminal 101 acquires the scroll direction from the center position or the direction 504b of the operation information 501b of the scroll operation input in step S901. Then, the control unit 300 of the terminal 101 selects a reference position 1710 in a direction that matches the acquired scroll direction, and determines a reference point. That is, if the scroll direction stored in the center position or direction 504 b is “up”, the upper reference point 1701 is selected as the reference position 1710. If the scroll direction stored in the center position or direction 504 b is “down”, the lower reference point 1702 is selected as the reference position 1710. If the scroll direction stored in the center position or direction 504 b is “left”, the left reference point 1703 is selected as the reference position 1710. If the scroll direction stored in the center position or direction 504 b is “right”, the right reference point 1704 is selected as the reference position 1710. If the scroll direction stored in the center position or direction 504 b is “upper left”, the upper left reference point 1705 is selected as the reference position 1710. If the scroll direction stored in the center position or direction 504 b is “lower left”, the lower left reference point 1706 is selected as the reference position 1710. If the scroll direction stored in the center position or direction 504 b is “upper right”, the upper right reference point 1707 is selected as the reference position 1710. If the scroll direction stored in the center position or direction 504 b is “lower right”, the lower right reference point 1708 is selected as the reference position 1710.

  Subsequently, in step S2103, the control unit 300 of the terminal 101 refers to the speed corresponding magnification information 2001 using the speed 505b of the scroll operation operation information 501b input in step S901, and the reduction magnification corresponding to the speed 505b. Get 2003. For example, when the speed 505b is “23”, “23” is in the range of the speed 2002 “21-30 pixels / msec” of the speed corresponding magnification information 2001, and therefore “0.6” is acquired as the magnification. Thus, the magnification is determined.

  In step S2104, the control unit 300 of the terminal 101 reduces the current content display magnification on the display device 102 by multiplying the magnification determined in step S2103 to display the content on the external display device 103. Set the display magnification.

  Subsequently, in step S2105, the control unit 300 of the terminal 101 sets the display position of the content on the external display device 103 using the reference position 1710 determined in step S2102. That is, when content scrolling is completed on the display device 102 provided in the terminal 101, a point on the content at the reference position 1710 determined in step S2102 is acquired. Then, the display position of the content on the external display device 103 is set so that the acquired point on the content is arranged on the same reference position 1710 of the external display device 103. In step S2106, content display conditions on the external display device 103 are determined so that the content is displayed at the display position set in step S2105 at the display magnification set in step S2104, and this operation flow ends.

  The display conditions for the external display device 103 in the scroll operation are determined by the operation flow of FIG. 21 described above. In the display condition determination process in the scroll operation of FIG. 21, the reduction magnification of the display magnification when the content is displayed on the external display device 103 is determined according to the operation speed of the scroll operation performed on the content. . For example, it is considered that the user desires to move the display position of the content being displayed by a long distance when the user performs a fast scroll operation. In such a case, it may be preferable for the user to set the reduction ratio smaller and display the content on the external display device 103 in a wider range. On the other hand, when the user performs a slow scroll operation, it is considered that the user wants to move the display position of the content being displayed by a small distance. In such a case, compared with the display magnification on the display device 102 of the terminal 101, the target area of the user can be sufficiently displayed on the external display device 103 without reducing the display magnification of the external display device 103 so much. It may be displayed on the display screen. Therefore, a lower display magnification is set when the speed is higher than when the speed 505b is slow.

  In FIG. 14, the operation history information 500 is referred to, and if the number of enlargement operations is not equal to or greater than the predetermined number, the operation flow is terminated (step S1401). Similarly, in FIGS. 16, 19, and 21, the operation flow is terminated when the number of operations for reduction or scrolling is not equal to or greater than a predetermined number (steps S <b> 1601, S <b> 1901, And Step S2101). In this case, a display condition is not determined separately for the external display device 103, and the display condition on the display device 102 of the terminal 101 is used as it is on the external display device 103. For example, in one embodiment, the display magnification after enlargement, reduction, and scrolling on the display device 102 of the terminal 101 is used as the display magnification in the external display device 103. Further, for example, with respect to the display position, the display position on the display device 103 is such that the point on the content displayed at the center of the display device 102 of the terminal 101 is also centered on the external display device 103. May be set. For example, as described above, the display conditions on the display device 102 of the terminal 101 are used as they are on the external display device 103.

  In some embodiments described above, the control unit 300 and the storage unit 320 function as various functional units illustrated in FIG. The control unit 300 functions as the display condition determination unit 311 in FIG. 3 in step S910 in FIG. 9, steps S1402 to S1405 in FIG. 14, and steps S1602 to S1605 in FIG. The control unit 300 also functions as the display condition determination unit 311 in FIG. 3 in steps S1902 to S1905 in FIG. 19 and steps S2102 to S2106 in FIG. The control unit 300 also functions as the operation processing unit 312, acquires the operation type, the operation amount, the center position, or the direction from the input display operation, and displays the display conditions of the content displayed on the display screen of the terminal 101. To change. Values such as the operation type, operation amount, center position or direction acquired by the operation processing unit 312 are stored in the operation history information 500 stored in the operation history storage unit 326 of the storage unit 320 in step S902 of FIG. As recorded. The control unit 300 functions as the operation history determination unit 313 in step S903 in FIG. 9, step S1401 in FIG. 14, step S1601 in FIG. 16, step S1901 in FIG. 19, and step S2101 in FIG. The control unit 300 functions as the display device candidate extraction unit 314 in step S907 in FIG. 9 and steps S1001 to S1006 in FIG. The control unit 300 also functions as a request candidate display device information acquisition unit 315, a display device candidate search extraction unit 318, and a display device candidate extraction timing processing unit 317. The display device candidate search and extraction unit 318 searches for the peripheral display device 103 at the timing determined by the display device candidate extraction timing processing unit 317, and the request candidate display device information acquisition unit 315 obtains information about the found display device 103. get. The display device candidate search extraction unit 318 and the request candidate display device information acquisition unit 315 generate external display device information 800 from the information acquired from the display device 103 and store it in the external display candidate information holding unit 324 of the storage unit 320. The control unit 300 also functions as a content acquisition unit 316, and acquires content via a network, for example. The acquired content is stored in the content holding unit 321 of the storage unit 320, for example.

  The storage unit 320 functions as a content holding unit 321 that stores content acquired locally (or via a network). The storage unit 320 also functions as a content information holding unit 322 that stores content management information 600 including information such as the type, size, and security level of the content stored in the content holding unit 321. The storage unit 320 functions as an own terminal display device information holding unit 323 that stores display device information 700 including position information of the display device 102 included in the own terminal 101, a physical size of the display screen, a resolution, and the like. The storage unit 320 functions as an external display candidate information holding unit 324 that stores the external display device information 800. The storage unit 320 functions as an external display device storage unit 325 that stores the list 1100 generated by the display device candidate extraction unit 314. The storage unit 320 stores the operation history information 500 and functions as the operation history holding unit 326. The storage unit 320 stores speed corresponding magnification setting information 2000 and functions as a speed corresponding magnification holding unit 327.

  In some embodiments described above, the control unit 300 and the storage unit 320 function as various functional units illustrated in FIG. The control unit 300 functions as the operation history recording unit 401 in step S902 in FIG. The control unit 300 functions as the external display magnification setting unit 402 in steps S1402 to S1403 in FIG. 14 and steps S1602 to S1603 in FIG. The control unit 300 also functions as the external display magnification setting unit 402 in step S1903 in FIG. 19 and in steps S2103 to S2104 in FIG. The control unit 300 functions as the display position setting unit 403 in step S1404 in FIG. 14, step S1604 in FIG. 16, step S1902 and step S1904 in FIG. 19, and step S2102 and step S2105 in FIG. The control unit 300 functions as the display condition determination unit 404 in step S1405 in FIG. 14, step S1605 in FIG. 16, step S1905 in FIG. 19, and step S2106 in FIG.

  22 and 23 are diagrams for describing display of the display range instruction frame 2200 executed by the control unit 300 of the terminal 101 according to some embodiments. FIG. 22 shows a display range instruction frame when the display range of the content displayed on the display device 102 of the terminal 101 according to some embodiments is narrower than the display range of the content displayed on the external display device 103. It is a figure explaining the display of 2200. FIG. The display range of the content on the external display device 103 is wider than the display range of the display device 102 of the own terminal 101, and the display range of the content displayed on the display device 102 of the own terminal 101 is the display screen of the external display device 103. In some cases. In this case, the control unit 300 of the terminal 101 displays, for example, a display indicating the display range of the content displayed on the display device 102 of the own terminal 101 on the display screen of the external display device 103 as illustrated. The display device 103 is instructed to display the range instruction frame 2200. Accordingly, the user can know from the display range instruction frame 2200 which part of the content area displayed on the display device 102 of the terminal 101 corresponds to on the display screen of the external display device 103.

  FIG. 23 shows a display range when the display range of the content displayed on the external display device 103 according to some embodiments is narrower than the display range displayed on the display device 102 of the terminal 101. It is a figure explaining the display of the instruction frame 2200. FIG. The display range of the content on the display device 102 of the own terminal 101 is wider than the display range of the external display device 103, and the display range of the content displayed on the external display device 103 is the display screen of the display device 102 of the own terminal 101. In some cases. In this case, the control unit 300 of the terminal 101 displays, for example, a display indicating the display range of the content displayed on the external display device 103 in the display screen of the display device 102 of the terminal 101 as illustrated. The display device 102 is instructed to display the range instruction frame 2200. As a result, the user can know from the display range instruction frame 2200 which part of the content area displayed on the external display device 103 corresponds to on the display screen of the display device 102 of the terminal 101 itself.

  In the embodiment exemplified above, the same magnification is used for the vertical and horizontal contents as the magnification in the enlargement, reduction, and scroll processing used to set the display magnification of the external display device 103. An example was given. However, some embodiments are not limited to this. For example, in some embodiments, different magnifications may be used for content length and width. For example, some display devices have different vertical and horizontal resolution ratios. In the case of using such a display device having a different ratio of vertical and horizontal resolution, the content of the same level as the range displayed on the axis having the higher resolution in the axis having the lower resolution in the vertical and horizontal directions. Different magnifications may be used in the vertical and horizontal directions so that the range is displayed.

  Further, in some embodiments, the operation history information 500 for content is held in the storage unit 320 even when, for example, content display end is input in step S912. Then, when the same content is displayed after the next time, processing may be performed using the operation history information 500 held in the storage unit 320. Also, in this case, if the display was performed using the external display device 103 in the previous display, the content is displayed to the user using the external display device 103 before the content is displayed. It may be configured as proposed. Note that the display of the same content may be detected because, for example, the file name, the homepage address, the PATH to the file, and the like match.

  In some embodiments, a lower limit may be set for the display magnification so that the information contained in the content is not crushed and cannot be read when the content display magnification is reduced. For example, by acquiring the “complexity” index as described below for the content being displayed, the display magnification is adjusted so that the image is not crushed and cannot be read because the content is reduced too much. be able to. First, for example, when the content is an image file such as JPEG, a process of binarizing the image into a monochrome image is performed. Then, for example, the number of times the image changes from white to black (or black to white) for the horizontal lines of the screen pixels when the image is displayed at the size of the original image that has not been enlarged or reduced in display magnification is counted. Then, the total number of times the image changes from white to black (or from black to white) in the original image size is obtained by summing up the number of changes made in each line. This total number is used as an index representing the “complexity” of the original image. Subsequently, in the image after the content is reduced and displayed, the number of times the image is changed from white to black (or from black to white) is similarly counted for each line. Then, the total number of times the image has changed from white to black (or from black to white) in the reduced image size is obtained by summing the number of times it has appeared on each line. This total number is used as an index representing the “complexity” of the reduced image. Then, the display magnification may be controlled so that the total number representing “complexity” after reduction does not decrease by 30% or more compared to the total number representing “complexity” of the original image. With this configuration, it is possible to prevent the image from being crushed at an unacceptable level. For example, when the display condition determining unit 311 or the display condition determining unit 404 determines the display condition, the external display device 103 does not fall below the lower limit of the display magnification determined by the “complexity” as described above. You may control the setting of the display magnification in.

  Also, in some embodiments, the operational flow shown in FIG. 9 is activated each time new content is displayed. Therefore, for example, when a plurality of contents are displayed on the terminal 101, the operation flow shown in FIG. 9 is executed for each content. In this case, a content display request may be made from the terminal 101 to a plurality of external display devices 103. In this case, for example, a process of displaying the first content on the first external display device 103 and displaying the second content on the second external display device 103 may be performed in some embodiments. It may be done.

  Further, in the embodiment exemplified above, the display magnification on the external display device 103 at the time of content enlargement operation is multiplied by a magnification greater than 1 to the display magnification on the terminal 101 after execution of the enlargement operation. In the example described in However, in some embodiments, the display magnification on the external display device 103 may be set as follows. For example, before the swipe is performed in the pinch-out operation, a rectangular area similar to the display screen of the own terminal 101 passing through the two points specified first is enlarged to the smaller of the vertical or horizontal sides of the external display device 103. The display magnification may be set as described.

  In some embodiments, when the displayed content is content in which information included in the content is changed by an enlargement or reduction process such as a map provided on the web, as described above. An image that is simply enlarged or reduced may be displayed. However, in such a case, the user can refer to more detailed information by re-acquiring and displaying the information of the content of the scale corresponding to the changed display magnification.

  FIG. 24 is a diagram illustrating a functional block configuration of the external display device 103 according to some embodiments. The control unit 2400 of the external display device 103 includes, for example, a reception unit 2402, a display unit 2403, and a notification unit 2404 as functional units 2401. Further, for example, a program 2421 and display device information 2422 are stored in the storage unit 2420 of the external display device 103. The control unit 2400 of the external display device 103 provides functions such as a reception unit 2402, a display unit 2403, and a notification unit 2404 included in the function unit 2401 by reading and executing the program 2421. The receiving unit 2402 is a functional unit that receives a content display request transmitted from the terminal 101. The display unit 2403 is a functional unit that displays content on the display screen of the display device 103 in accordance with display conditions included in the content display request received from the terminal 101. When the terminal 101 requests the terminal 101 to provide information about the display device 103 in the process of searching for the surrounding display device 103 performed at a predetermined timing in the terminal 101, the notification unit 2404 displays the display device information to the terminal 101. 2422 is transmitted. The display device information 2422 includes, for example, a display device ID 802, a screen physical size 803, a screen resolution 804, a display device position 807, which are necessary for registering the display device screen information 801 of the display device 103 in the external display device information 800. The information of the identification information 810 is included.

  FIG. 25 is a diagram illustrating an operation flow of display processing executed by the control unit 2400 of the display device 103 according to some embodiments. The operation flow of the display process of FIG. 25 is implemented by, for example, reading and executing the program 2421 stored in the storage unit 2420 by the control unit 2400 of the display device 103. In one embodiment, the display process starts when the display device 103 is activated. In step S2501, the control unit 2400 of the display apparatus 103 determines whether a content display request has been received. If no content display request has been received (No in step S2501), the process returns to step S2501 to repeat the process. On the other hand, if a content display request is received (Yes in step S2501), the process advances to step S2502. In step S2502, the control unit 2400 of the display device 103 displays the content on the display screen included in the display device 103 according to the display condition included in the received display request, and the operation flow ends. For example, as described above, the content is displayed on the display screen of the display device 103 in accordance with the display condition determined in step S910 in the terminal 101.

  In step S2501 of FIG. 25, the control unit 2400 of the external display device 103 functions as the reception unit 2402. In step S2502 of FIG. 25, the control unit 2400 of the external display device 103 functions as the display unit 2403.

  FIG. 26 is a diagram illustrating a hardware configuration of a computer 2600 for realizing the terminal 101 and the external display device 103 according to some embodiments. The hardware configuration of the computer 2600 in FIG. 26 includes, for example, a processor 2601, a memory 2602, a storage device 2603, a reading device 2604, a communication interface 2606, an input / output device 2607, and a display device 2611. Note that the processor 2601, the memory 2602, the storage device 2603, the reading device 2604, the communication interface 2606, and the input / output device 2607 are connected to each other via a bus 2608, for example.

  The processor 2601 provides a part or all of the functions of each functional unit described above by executing a program describing the procedure of the above-described operation flow using the memory 2602. For example, the control unit 300 of the terminal 101 is a processor 2601, for example. Further, the storage unit 320 of the terminal 101 includes, for example, a memory 2602, a storage device 2603, and a detachable recording medium 2605. The control unit 2400 of the external display device 103 is, for example, a processor 2601. The storage unit 2420 of the control unit 2400 includes, for example, a memory 2602, a storage device 2603, and a removable recording medium 2605.

  The memory 2602 is a semiconductor memory, for example, and includes a RAM area and a ROM area. The storage device 2603 is, for example, a hard disk, a semiconductor memory such as a flash memory, or an external recording device.

  The reading device 2604 accesses the removable recording medium 2605 in accordance with an instruction from the processor 2601. The detachable recording medium 2605 includes, for example, a semiconductor device (USB memory or the like), a medium (information such as a magnetic disk) to which information is input / output by a magnetic action, For example, a DVD). The communication interface 2606 transmits and receives data via the network 2610 in accordance with instructions from the processor 2601. The input / output device 2607 corresponds to, for example, a touch panel that receives instructions from the user, a device such as a keyboard and a mouse, an interface with a display device 2611 such as a display, and an interface with a sound device such as a speaker. . Note that the communication interface 2606 of the computer 2600 includes a communication interface for the wireless communication 120 and a corresponding communication device. For example, a communication interface 2606 capable of wireless communication 120 such as Bluetooth (registered trademark), DLNA (registered trademark), UPnP (registered trademark), and wireless LAN, and a communication device corresponding thereto are provided. The terminal 101 and the external display device 103 perform wireless communication 120 via the communication interface 2606 and the communication device. The input / output device 2607 is connected to the display device 2611 and instructs the display device 2611 to display content, for example. The display device 2611 includes devices such as a cathode ray tube (CRT) display, a liquid crystal display, a plasma display, an organic EL display, and a projector. The display device 2611 displays a video signal such as a still image or a moving image input via the communication interface 2606 and stored in the storage device 2603 according to an instruction of the processor 2601 of the computer 2600.

  The display unit 303 of the display device 102 of the terminal 101 is a display device 2611, for example. The input unit 304 of the terminal 101 is an input / output device 2607, for example. The communication unit 305 of the terminal 101 is a communication interface 2606, for example.

Each program according to the embodiment is provided to the terminal 101 and the external display device 103 in the following form, for example.
(1) Installed in advance in the storage device 2603.
(2) Provided by the removable recording medium 2605.
(3) Provided from a server 2609 such as a program server.

  According to some embodiments described above, based on the user's operation situation, at the timing when the user is estimated to require a larger display device, the user's operation intention is collected and emphasized. Information can be displayed on a display device in the vicinity of the user. Therefore, a better information reference environment can be provided to the user.

  In the above, several embodiments have been described. However, the embodiments according to the present invention are not limited to the above-described embodiments, but should be understood as including various modifications and alternative forms of the above-described embodiments. For example, it will be understood that various embodiments can be embodied by modifying the components without departing from the spirit and scope thereof. Further, it will be understood that various embodiments according to the present invention can be formed by appropriately combining a plurality of constituent elements disclosed in the above-described embodiments. Alternatively, various implementations according to the present invention may be made by deleting or replacing some components from all the components shown in the embodiment, or adding some components to the components shown in the embodiment. One skilled in the art will appreciate that the form may be implemented.

DESCRIPTION OF SYMBOLS 100 System 101 Terminal 102 Display apparatus 103 Display apparatus 103 External display apparatus 110 Network 120 Wireless communication 300 Control part 303 Display part 304 Input part 305 Communication part 311 Display condition determination part 312 Operation processing part 313 Operation history determination part 314 Display apparatus candidate Extraction unit 315 Request candidate display device information acquisition unit 316 Content acquisition unit 317 Display device candidate extraction timing processing unit 318 Display device candidate search extraction unit 320 Storage unit 321 Content holding unit 322 Content information holding unit 323 Self terminal display device information holding unit 324 External display candidate information holding unit 325 External display device storage unit 326 Operation history holding unit 327 Speed corresponding magnification holding unit 400 Function unit 401 Operation history recording unit 402 External display magnification setting unit 403 Display position setting unit 404 Display Matter determination unit 410 program 420 information 500 operation history information 501 operation information 502 operation type 503 operation amount 504 center position or direction 505 speed 600 content management information 601 content information 602 type 603 size 604 security level 605 X
606 Y
700 Display device information 701 Display device screen information 702 Display device ID
703 Screen physical size 704 Screen resolution 705 X
706 Y
707 Display device position 708 Latitude 709 Longitude 800 External display device information 801 Display device screen information 802 Display device ID
803 Screen physical size 804 Screen resolution 805 X
806 Y
807 Display device position 808 Latitude 809 Longitude 810 Identification information 1100 List 1101 Display device screen information 1102 Display device ID
1103 Screen physical size 1104 Screen resolution 1105 X
1106 Y
1107 Display position 1108 Latitude 1109 Longitude 1110 Identification information 1302 Display area 1303 Display area 1502 Display area 1503 Display area 1700 Display screen 1701 Upper reference point 1702 Lower reference point 1703 Left reference point 1704 Right reference point 1705 Left upper reference point 1706 Left lower reference point 1707 Upper right reference point 1708 Lower right reference point 1710 Reference position 2000 Speed corresponding magnification setting information 2001 Speed corresponding magnification information 2002 Speed 2003 Reduction magnification 2200 Display range instruction frame 2400 Control unit 2401 Function unit 2402 Reception unit 2403 Display unit 2404 Notification unit 2420 Storage Unit 2421 Program 2422 Display device information 2600 Computer 2601 Processor 2602 Memory 2603 Storage device 2604 Reading device 2605 Removable recording medium 2606 Communication in Face 2607 input-output device 2608 bus 2609 server 2610 network 2611 display equipment

Claims (12)

An external display request program for requesting to display content being displayed on a first display screen provided in a computer on a second display screen provided in an external display device,
The content being displayed in the first display screen, enlargement, reduction, or if the change operation of the scroll display condition is entered into the computer, the first display screen in accordance with the changing operation of the display condition Display the content at the first display magnification,
A second display magnification is set by multiplying the first display magnification by a magnification according to whether the display condition changing operation is enlargement, reduction, or scrolling ;
The content before Symbol second display magnification to determine the display condition with respect to the second display screen to be displayed,
To perform the processing to the computer, an external display request program. The setting of the second display magnification, wherein, when changing operation of the display condition is enlarged is performed by multiplying a greater magnification than 1 in the first display magnification changes from the previous SL display conditions If operation is shrinking, Ru is executed by multiplying one fewer ratios to the first display magnification,
External display request program according to claim 1, wherein the this. Setting of the second display magnification, wherein, when changing operation of the display conditions are the scroll is performed by multiplying the magnification of less than 1 on the first display magnification,
Wherein in the determination of the display condition, the selected Ru group reference position depending on the direction of put that before Symbol scroll to the first display screen, a point on the content to be displayed after execution of the scroll, the second The display condition is determined so as to be arranged at the reference position on the display screen and to display the content at the second display magnification.
The external display requesting program according to claim 1 or 2 , characterized in that The second display screen has a higher resolution than the first display screen;
Wherein one greater magnification than to be multiplied to the first display magnification when changing operation of the display condition is expanding, X of the second display screen X axis of the first display screen resolution of The magnification calculated by dividing by the axial resolution, or the magnification calculated by dividing the Y-axis resolution of the second display screen by the Y-axis resolution of the first display screen. And
The external display request program according to claim 2 . The direction is any one of the upward direction, the downward direction, the right direction, the left direction, the upper left direction, the lower left direction, the upper right direction, and the lower right direction of the display screen.
The reference position is
At the top edge of the display screen, the upper reference point at the midpoint of the left and right of the display screen,
At the bottom edge of the display screen, the lower reference point at the midpoint of the left and right of the display screen,
At the left edge of the display screen, the left reference point at the midpoint of the top and bottom of the display screen,
At the right edge of the display screen, the right reference point at the midpoint of the top and bottom of the display screen,
Upper left reference point at the upper left position of the display screen,
Lower left reference point at the lower left corner of the display screen,
Upper right reference point at the position of the upper right corner of the display screen,
Lower right reference point at the lower right corner of the display screen,
Including
When the direction is an upward direction, an upper reference point is selected as the reference position,
If the direction is downward, a lower reference point is selected as the reference position,
If the direction is the left direction, a left reference point is selected as the reference position,
When the direction is the right direction, a right reference point is selected as the reference position,
When the direction is the upper left direction, the upper left reference point is selected as the reference position,
When the direction is the lower left direction, a lower left reference point is selected as the reference position,
When the direction is the upper right direction, the upper right reference point is selected as the reference position,
When the direction is the lower right direction, a lower right reference point is selected as the reference position.
The external display request program according to claim 3 , wherein: Change Operation of the previous SL display condition magnification of the less than 1 which is multiplied by the first display magnification in the case of the scroll, the scroll is determined in accordance with the speed of the swipe when entered,
The external display request program according to claim 3 or 5 . When the display condition change operation is input to the computer, the operation information for recording the input display condition change operation is stored in a storage unit,
Wherein said operation information more than a predetermined number in the storage unit if that is recorded, receives an input for instructing whether or not to display the content on the second display screen,
If the content have received input of an instruction to be displayed on the second display screen, and executes a process of determining the display condition for the processing and the second display screen for setting the second display magnification,
Processing is executed further to the computer, an external display request program according to any one of claims 1 6, characterized in that. Before Symbol display range indication frame indicating the display range of the content displayed on the first display screen to display on the second display screen, or the content displayed on the second display screen Instructing to display a display range instruction frame indicating the display range of the first display screen,
Processing further characterized by causing the computer to perform the external display request program according to any one of claims 1 to 7. Wherein the second display magnification that is set in the second display magnification setting, characterized in that a lower limit that is set in accordance with the content is provided,
The external display request program according to any one of claims 1 to 8 . A the device for requesting to display the contents being displayed in the first display screen provided apparatus in the second display screen with an external display device,
The content being displayed in the first display screen, enlargement, reduction, or when scrolling display condition change operation is input to the device, the first display screen in accordance with the changing operation of the display condition A control unit for displaying the content at a first display magnification;
Wherein the first display magnification, the display condition change operation enlargement, reduction, or the external display magnification setting unit for setting a second display magnification by multiplying the magnification in accordance with whether it is a scroll,
Before Symbol display condition determination unit in which the content in the second display magnification to determine the display condition with respect to the second display screen to be displayed,
An apparatus comprising: The content being displayed in the first display screen end powder comprises, enlargement, reduction, or the first display magnification of the content in the first display screen is determined according to the scroll display condition change operation expansion operation of changing the display condition is reduced, or the display request to instruct the said content at a second display rate set by multiplying the magnification in accordance with which of the scroll is displayed the Received from the device,
In the second display screen and displays the previous SL content on the display request received thus in the second display magnification,
A display program that causes a computer to execute processing. The content being displayed in the first display screen end powder comprises, enlargement, reduction, or the first display magnification of the content in the first display screen is determined according to the scroll display condition change operation expansion operation of changing the display condition is reduced, or the display request to instruct the said content at a second display rate set by multiplying the magnification in accordance with which of the scroll is displayed the A receiving unit for receiving from the terminal ;
In the second display screen, a display unit for displaying the previous SL content on the display request received thus in the second display magnification,
Including a display device.

Images