JP5774931B2 - Portable terminal device and program - Google Patents

Description

  The present invention relates to a mobile terminal device such as a mobile phone, a PDA (Personal Digital Assistant), and a tablet PC (Tablet PC), and a program that is preferably used for the mobile terminal device.

  Conventionally, a configuration including two displays in a mobile terminal device such as a mobile phone has been proposed. In such a portable terminal device, a configuration is adopted that can be switched between an open state in which two displays are arranged and a closed state in which one display overlaps the other display (see, for example, Patent Document 1).

  As described above, when the mobile terminal device includes two displays, the execution screens of the two applications can be displayed on the two displays, respectively.

  For example, an operation for an application executed on each display is performed by an input to a touch sensor arranged on each display.

JP-A-9-305262

  As described above, when the mobile terminal device can be switched between the closed state and the open state, when the user moves, the mobile terminal device can be closed so that the user can easily carry the mobile terminal device. When the application is executed on both displays, the application is continued to be executed on the lower display.

  The user may use the mobile terminal device while moving. In this case, the user does not want to open the portable terminal device because it is difficult to hold, but there may be a situation where the user wants to see the application execution screen on the lower display or to operate the execution screen. .

  For example, when a document is created by starting an email or notepad on the upper display while the web screen is displayed on the lower display, the user occasionally refers to information on the web screen, There may be a situation in which it is desired to perform a predetermined operation such as an enlargement or movement operation on the web screen.

  However, in the above configuration, in the closed state, the lower display and the touch sensor are hidden by the upper display, so that the execution screen of the lower display is viewed and the operation screen is operated. I can't.

  The present invention has been made in view of such a problem, and in a mobile terminal device including two display units, the other display unit even in a closed state where one display unit overlaps the other display unit. The purpose is to be able to see and operate the execution screen.

The portable terminal device according to the first aspect of the present invention includes a first display unit and a second display unit, a first cabinet in which the first display unit is disposed, and a second in which the second display unit is disposed. Switching for switching to a cabinet, an input detection unit that is arranged on the first display unit and detects an input to the first display unit, and a detection unit that detects an input to the second display unit A switching detection unit that detects an operation; and a control unit that controls the first display unit and the second display unit. Here, when the first display unit and the first cabinet are arranged so that the first display unit overlaps the second display unit, the image displayed on the second display unit is the first display unit. It is comprised so that it may be seen through one display part. Then, when the first display unit is overlaid on the second display unit, the control unit shows an image on the first display unit and an image of the second display unit overlaid on the image is transparent. When the switching operation is performed, the two display units are controlled based on the input to the second display unit detected by the input detection unit.
In the mobile terminal device according to this aspect, when the first display unit is in a state of overlapping the second display unit, the control unit displays an image interlocked with an image of the second display unit in the first display. It can be set as the structure displayed on a part in a translucent state. For example, when the mobile terminal device further includes a camera unit, the control unit displays a shooting screen shot by the camera unit on the second display unit, and the additional information related to the shooting screen is displayed on the first display unit. The additional information screen may be displayed in a translucent state.
In the mobile terminal device according to this aspect, the control unit displays a moving image reproduction screen on the second display unit, and the moving image reproduction screen to be compared with the moving image of the second display unit on the first display unit. Can be displayed in a translucent state.

  The portable terminal device according to this aspect may be configured to further include a switching operation unit operated during the switching operation. In this case, the switching detection unit detects the switching operation by operating the switching operation unit.

In the mobile terminal device according to this aspect, the input detection unit may be configured to include a pressure-sensitive touch sensor. In this case, the switching detection unit detects the switching operation based on the pressure applied to the touch sensor.

  In the mobile terminal device according to this aspect, the first display unit may be configured to have translucency. In this case, the first cabinet is displayed on the second display unit at a portion sandwiched between the first display unit and the second display unit in a state where the first display unit overlaps the second display unit. A passing section through which the image passes.

  In the case of the above configuration, the first display unit further includes a light-transmitting organic EL display so that the other side of the first display unit can be seen through when an image is displayed. obtain.

  In the case of the above configuration, the control unit further reduces the brightness of the first display unit or turns off the first display unit when the switching operation is performed, and turns off the first display unit. The transparency of the image of the second display unit in the unit may be increased.

The program according to the second aspect of the present invention includes a first display unit and a second display unit, a first cabinet in which the first display unit is arranged, and a second cabinet in which the second display unit is arranged. An input detection unit that is disposed on the first display unit and detects an input to the first display unit, wherein the first display unit and the first cabinet are the second display unit and the second display unit is the second display unit. The input detection unit is connected to a computer of a portable terminal device configured to allow an image displayed on the second display unit to be viewed through the first display unit when arranged so as to overlap the display unit. A function for detecting a switching operation for switching to a detection unit that detects an input to the second display unit, and an image on the first display unit when the first display unit is in a state of overlapping the second display unit The second overlaid on the image Is displayed in a translucent state so that the image of the radical 113 is seen through, when the switching operation is performed, the second display portion based on the input to the second display unit detected by the input detection unit And a function to control.

  According to the mobile terminal device and the program of the present invention, even in a closed state where one display unit overlaps the other display unit, the execution screen of the other display unit can be viewed and operated on the execution screen. .

  The effects and significance of the present invention will become more apparent from the following description of embodiments. However, the following embodiment is merely an example when the present invention is implemented, and the present invention is not limited to what is described in the following embodiment.

It is a figure which shows the external appearance structure and internal structure of the mobile phone of a closed state and an open state based on Embodiment. It is a figure which shows the external appearance structure of the mobile phone of the tilt state based on Embodiment. It is a figure explaining a mode that a cellular phone concerning an embodiment is changed from a closed state to an open state. It is a block diagram which shows the whole structure of the mobile telephone based on Embodiment. It is a figure which shows the state by which the launcher screen and the execution screen of the application were displayed on the 1st display and 2nd display based on embodiment. It is a flowchart which shows the control processing operation | movement when operation to a 1st touch sensor is made in a closed state based on embodiment. When a notepad application is executed on the first display and a web browser is executed on the second display in the closed state according to the embodiment, when an operation is performed on the execution screen of each display It is a figure for demonstrating an example. For explaining an example when an operation is performed on an execution screen of each display when an augmented reality application is executed on the first display and the second display in the closed state according to the embodiment FIG. It is a figure for demonstrating the screen display when it switches from a closed state to an open state, when the application of an augmented reality is performed with the 1st display and 2nd display based on Embodiment. For explaining a case where an operation is performed on an execution screen of each display when an application of a video player is executed on the first display and the second display in the closed state according to the embodiment FIG. It is a flowchart which shows the control processing operation | movement when operation to a 1st touch sensor is made in the closed state based on the modification example 1 and the modification example 2. It is a flowchart which shows the control processing operation | movement when operation to a 1st touch sensor is made | formed in the closed state based on the other modification.

  Hereinafter, a mobile phone according to an embodiment of the present invention will be described.

<Configuration of mobile phone>
1 (a) to 1 (d), 2 (a) and 2 (b) are diagrams showing the configuration of the mobile phone 1 according to the present embodiment. FIG. 1A is a perspective view showing the configuration of the mobile phone 1 in the closed state, and FIG. 1B is a perspective view showing the configuration of the mobile phone 1 in the open state. 1C is an internal perspective view of the mobile phone 1 of FIG. 1A viewed from the right side, and FIG. 1D is a view of the mobile phone 1 of FIG. 1B viewed from the right side. FIG.

  FIG. 2A is a perspective view of the mobile phone 1 in the tilted state as viewed from the front side of the first cabinet 10, and FIG. 2B is the rear side of the mobile phone 1 in the tilted state of the first cabinet 10. It is the perspective view seen from.

  With reference to FIG. 1, the mobile phone 1 includes a first cabinet 10, a second cabinet 20, and a connecting portion 30 that connects the first and second cabinets 10 and 20.

  Hereinafter, the directions of “right”, “left”, “up”, “down”, “front” and “back” with respect to the mobile phone 1 are set as shown in FIGS. The positive directions of the X axis, the Y axis, and the Z axis correspond to the up, left, and front directions, respectively. The “front surface” of the first and second cabinets 10 and 20 is the front surface of the first and second cabinets 10 and 20, respectively. The “rear surfaces” of the first and second cabinets 10 and 20 are the back surfaces of the first and second cabinets 10 and 20, respectively.

  The closed state is a state in which the first cabinet 10 is placed on the front surface of the second cabinet 20. The open state is a state in which the first cabinets 10 are arranged on the upper side of the second cabinet 20.

  The first cabinet 10 has a flat rectangular parallelepiped shape that is long in the left-right direction. A first touch panel 11 is arranged in the first cabinet 10. The first touch panel 11 includes a first display 12 and a first touch sensor 13.

  The first display 12 is a light-transmitting organic EL display, and includes a light-transmitting organic EL panel and a driver circuit that drives the organic EL panel (not shown). In the organic EL panel, both the anode and the cathode sandwiching the organic EL layer are made of transparent electrodes, and the other side of the panel can be seen through. When the driver circuit is energized between the transparent electrodes based on a screen signal and a control signal received from a display control device (described later), the organic EL layer emits light and an image is drawn on the organic EL panel. Thereby, the user can browse the drawn image via the first display surface 14 which is the outer surface of the first touch panel 11.

  The first display 12 displays the image in a translucent state. When the brightness of the first display 12 increases, the displayed image becomes dark, and thus the transparency of the first display 12, that is, the transparency of the scenery of the first display 12 beyond the first display 12 decreases. On the other hand, when the brightness of the first display 12 decreases, the displayed image becomes thin, and thus the transparency of the first display 12 increases.

  The first touch sensor 13 is a rectangular transparent sheet, and is placed on the first display 12 so as to overlap. The first touch sensor 13 detects a position (input position) on the touched first display surface 14 when the user inputs to the first display surface 14, that is, when the first display surface 14 is touched. . The first touch sensor 13 outputs a position signal corresponding to the detected input position.

  Note that the user “touching” the first display surface 14 means that the user touches the first display surface 14 with a contact member such as a finger or a pen. “Touch” is performed when the user presses the first display surface 14 with the contact member, strokes, or draws a graphic or a character on the first display surface 14. When the user “tap” the first display surface 14, the user touches the contact member or finger at a position on the first display surface 14 so that the contact member or finger flips the first display surface 14. The action to release. The “sliding” of the first display surface 14 by the user means an operation in which the user moves the contact member or the finger along the first display surface 14 while being in contact with the first display surface 14.

  A key group 15 is arranged on the front surface of the first cabinet 10. The key group 15 includes a home key 15H for displaying the home screen on the first display surface 14, a back key 15B for returning one execution screen displayed on the first display surface 14 when the application is executed, It includes a launcher key 15R for displaying an application startup screen (launcher screen) including an icon for startup on the first display surface 14.

  Home key 15H, back key 15B, and launcher key 15R are touch keys. When any of the home key 15H, the back key 15B, and the launcher key 15R is touched with a finger or the like, a touch sensor (not shown) provided in a key input circuit (described later) detects the touch operation and is touched. A signal corresponding to the key is output.

  The second cabinet 20 has a flat rectangular parallelepiped shape that is long in the left-right direction. A second touch panel 21 is disposed in the second cabinet 20. The second touch panel 21 includes a second display 22 and a second touch sensor 23.

  The second display 22 is a liquid crystal display, and includes a liquid crystal panel, a backlight, and a driver circuit that drives them (not shown). The driver circuit drives the liquid crystal panel and the backlight based on a screen signal and a control signal received from a display control device (described later), whereby the liquid crystal panel draws an image and the backlight is turned on. Thereby, the user can view the drawn image via the second display surface 24 which is the outer surface of the second touch panel 21.

  The second touch sensor 23 is a rectangular transparent sheet, and is placed on the second display 22 so as to overlap. The second touch sensor 23 detects the touched position on the second display surface 24 when the user touches the second display surface 24. The second touch sensor 23 outputs a signal corresponding to the detected position.

  Key groups 25 and 26 are arranged on the front and side surfaces of the second cabinet 20. The key group 25 includes a home key 25H for displaying the home screen on the second display surface 24, a back key 25B for returning the execution screen displayed on the second display surface 24 when the application is executed, and application activation. A launcher key 25R for displaying the screen on the second display surface 24 is included. Home key 25H, back key 25B, and launcher key 25R are touch keys. When any of the home key 25H, the back key 25B, and the launcher key 25R is touched with a finger or the like, a touch sensor (not shown) provided in a key input circuit (described later) detects the touch operation, and touches A position signal corresponding to the key is output.

  The key group 26 includes function keys 26F1, 26F2, and 26F3 arranged on the lower side surface portion of the second cabinet 20. The function keys 26F1, 26F2, and 26F3 are keys for various functions such as activation of a predetermined application or volume adjustment during execution of the application. When the function key 26F1, 26F2, 26F3 is pressed, the key input circuit detects this pressing and outputs a signal corresponding to the pressed key.

  The key group 26 further includes a switching key 26 </ b> C disposed on the right side surface portion of the second cabinet 20. In the closed state, the switching key 26C detects the input to the second display 22 (second display surface 24) from the detection unit that detects the input to the first display 12 (first display surface 14). Touched when switching to the detecting unit. The switch key 26C is a touch key. When the switching key 26C is touched with a finger or the like, a touch sensor (not shown) provided in the key input circuit detects this touch operation and outputs a switching signal.

  Note that the arrangement position of the switching key 26C may not be the right side surface portion of the second cabinet 20, and may be, for example, the left side surface portion, the front surface portion, the rear surface portion, and the back surface portion. In addition, the first cabinet 10 may be provided with a switching key 26C.

As shown in FIG. 2B, an opening 16 is formed on the back surface of the first cabinet 10. When the mobile phone 1 is in the closed state, the first display 12 and the second display 22 face each other through the opening 16. Since the first display 12 has translucency, even in the closed state, the user can view the image displayed on the second display 22 from the front side of the mobile phone 1 through the first display 12 and the opening 16. it can.

  Referring to FIG. 1C, only the first display surface 14 of the first and second display surfaces 14 and 24 faces the outside in the closed state. The second display surface 24 is disposed behind the first cabinet 10 and does not face the outside. With reference to FIG. 1 (d), in the open state, the first and second display surfaces 14, 24 face the outside from the front side of the mobile phone 1.

  In the tilted state shown in FIGS. 2A and 2B, the first cabinet 10 is arranged side by side above the second cabinet 20. However, the front surfaces of the first and second cabinets 10 and 20 in the tilted state are different from those in the open state, as shown in FIGS. 2A and 2B, with a predetermined obtuse angle (for example, hundreds of tens of degrees). ).

  The connecting portion 30 includes a central frame 31, a first right frame 32, a first left frame 33, a second right frame 34, and a second left frame 35. The center frame 31 has a shape extending left and right. The right end of the center frame 31 is connected to one end of the first right frame 32 and one end of the second right frame 34. The left end of the center frame 31 is connected to one end of the first left frame 33 and one end of the second left frame 35.

  The other ends of the first right frame 32 and the first left frame 33 are each provided with a shaft (not shown) extending in the left-right direction. This shaft is sandwiched between the groove portions 17 arranged on the left and right side portions of the first cabinet 10. In FIG. 2B, only the groove portion 17 on the left side surface portion is drawn. These shafts are held in the first cabinet 10 so as to be slidable along the groove portion 17, so that the first cabinet 10 can rotate around the shaft and can slide along the groove portion 17 in the vertical direction. The first right frame 32 and the first left frame 33 are held.

  The second right frame 34 and the second left frame 35 hold the second cabinet 20 so as to be rotatable about the horizontal direction.

  As will be described below with reference to FIGS. 3A to 3F, the connecting portion 30 can switch the first and second cabinets 10 and 20 between the open state and the closed state via the tilt state. Hold on. The user can manually change the arrangement state of the mobile phone 1. The closed state corresponds to the first arrangement state of the present invention, and the open state and the tilt state correspond to the second arrangement state of the present invention.

  3 (a) to 3 (f), the screen state of the mobile phone 1 is changed from the closed state (FIG. 3 (a)) to the open state (FIG. 3 (f)) through the tilt state (FIG. 3 (d)). FIG. 4 is a diagram for explaining a process of transition to the mobile phone 1 as viewed from the right side.

  When the mobile phone 1 is in the closed state as shown in FIG. 3A, when the first cabinet 10 is moved in the forward direction (broken line arrow in FIG. 3A), as shown in FIG. The back surface of the first cabinet 10 is separated from the front surface of the second cabinet 20. At this time, according to the movement of the first cabinet 10, the connecting portion 30 is rotated in the clockwise direction (solid arrow).

  In the state shown in FIG. 3B, when the first cabinet 10 is moved further forward and the first display surface 14 is rotated so as to face downward (broken line arrow), the state of the mobile phone 1 3 reaches the tilt state of FIG. 3D through the arrangement state of FIG. In the tilted state, the lower side of the back surface of the first cabinet 10 abuts on the connecting portion 30.

  When the connecting portion 30 is further rotated in the clockwise direction (broken arrow in FIG. 3D) while the lower side of the back surface of the first cabinet 10 is kept in contact with the connecting portion 30, the mobile phone 1 reaches a state where the first display surface 14 and the second display surface 24 are substantially in a single state as shown in FIG.

  In FIG. 3E, a gap (several millimeters) exists between the first cabinet 10 and the second cabinet 20. When the first cabinet 10 is slid downward with respect to the second cabinet 20 (a dashed-dotted arrow), the mobile phone 1 is brought into an open state as shown in FIG. At this time, the lower side surface of the first cabinet 10 and the upper side surface of the second cabinet 20 are in contact with each other.

  When the mobile phone 1 is in the tilted state shown in FIG. 3D, that is, when the first right frame 32, the first left frame 33, and the second cabinet 20 form a predetermined obtuse angle, The portion 30 has a structure for locking the rotation of the connecting portion 30 weakly. Since the rotation is weakly locked, the user can use the mobile phone 1 while maintaining the tilt state, and can easily change the use state from the tilt state to the open state or the closed state. Can do.

  FIG. 4 is a block diagram showing the overall configuration of the mobile phone 1. The cellular phone 1 according to the present embodiment includes a CPU 100, a memory 200, a camera module 301, a microphone 302, a voice encoder 303, a key input circuit 304, a communication module 305, a first display control device 306, in addition to the above-described components. A second display control device 307, a first VRAM 308, a second VRAM 309, an audio decoder 310, a speaker 311, an open / close sensor 312, an acceleration sensor 313, a GPS module 314, and an electronic compass 316 are provided.

  The camera module 301 is arranged in the second cabinet 20. The camera module 301 captures an image through a lens window (not shown) provided on the back surface of the second cabinet 20, and generates a digital imaging signal by a video encoder (not shown) built in the camera module 301. The camera module 301 outputs the generated imaging signal to the CPU 100.

  The microphone 302 is disposed in the first cabinet 10. The microphone 302 converts the collected sound into a sound signal and outputs the sound signal to the sound encoder 303. The audio encoder 303 converts an analog audio signal from the microphone 302 into a digital audio signal, and outputs the converted digital audio signal to the CPU 100.

  The key input circuit 304 outputs a signal corresponding to the pressed key to the CPU 100 when each key of the key group 15, 25, 26 is pressed.

  The communication module 305 includes an antenna (not shown) that transmits and receives radio waves for calls and communications. The communication module 305 converts a signal input from the CPU 100 into a radio signal, and transmits the converted radio signal to a communication destination such as a base station or another communication device via an antenna. The communication module 305 converts the radio signal received via the antenna into a signal in a format that can be used by the CPU 100, and outputs the converted signal to the CPU 100.

The first display control device 306 and the second display control device 307 control the first display 12 and the second display 22, respectively. The first display control device 306 and the second display control device 307 each have a controller. Further, the first display control device 306 and the second display control device 307 have a first VRAM 308 and a second VRAM 309 for storing a screen, respectively.

  The first display control device 306 generates screen display data based on the image data input from the CPU 100, and stores the generated screen data in the first VRAM 308 based on a control signal input from the CPU 100. The first VRAM 308 can store screen data of a plurality of screens (for example, several screens). The first display control device 306 outputs the display target screen data stored in the first VRAM 308 to the driver circuit of the first display 12 at a predetermined time interval (for example, about several tens of times per second).

  The second display control device 307 has the same configuration as the first display control device 306. That is, the second display control device 307 stores a plurality of screen data in the second VRAM 309 based on the control signal and screen data input from the CPU 100. The second display control device 307 outputs the display target screen data stored in the second VRAM 309 to the driver circuit of the second display 22 at a predetermined time interval (for example, about several tens of times per second).

  The audio decoder 310 performs decoding processing and D / A conversion on the sound signal from the CPU 100, and outputs the converted signal to the speaker 311. The speaker 311 outputs sound based on the signal input from the audio decoder 310.

  The open / close sensor 312 detects an angle of the connecting portion 30 with respect to the second cabinet 20. The open / close sensor 312 includes an angle sensor that detects an angle formed by the second cabinet 20 and the connecting unit 30, and outputs a digital signal corresponding to the detected angle to the CPU 100. Based on the signal from the open / close sensor 312, the CPU 100 detects whether the arrangement state of the first cabinet 10 and the second cabinet 20 of the mobile phone 1 is currently an open state, a closed state, or a tilt state. Run.

  The acceleration sensor 313 is disposed in the second cabinet 20 and detects an acceleration applied to the mobile phone 1. The acceleration sensor 313 is a three-axis acceleration sensor, and detects acceleration generated in the three directions of the X-axis direction, the Y-axis direction, and the Z-axis direction in FIG. The acceleration sensor 313 outputs an acceleration signal corresponding to the detected acceleration to the CPU 100. Based on the acceleration signal from the acceleration sensor 313, the CPU 100 detects whether the mobile phone 1 is oriented in the horizontal direction or the vertical direction. When the usage state is the tilt state, the CPU 100 determines whether the orientation of the mobile phone 1 is in the horizontal direction or the vertical direction with respect to the orientation of the second cabinet 20 in which the acceleration sensor 313 is arranged. Detect whether or not

  The GPS module 314 measures a geographical current position such as longitude and latitude based on signals from a plurality of GPS satellites in the sky, and outputs the position information, that is, current position information to the CPU 100.

  The electronic compass 315 is a three-axis type electronic compass and outputs a detection signal corresponding to the direction. Based on the detection signal from the electronic compass 315, the CPU 100 detects the direction in which the lens window of the camera module 301 faces, that is, the direction in which the camera module 301 is photographing.

  The memory 200 includes a ROM and a RAM. The memory 200 stores a control program for giving a control function to the CPU 100. The control programs include various application programs (hereinafter simply referred to as “applications”) such as telephone calls, electronic mail (hereinafter simply referred to as “mails”), camera functions, web browsers, music players, and the like. The control program includes a program for executing a control process when an operation is performed on the first touch sensor 13 in the closed state, which will be described later.

  The memory 200 is also used as a working memory that stores various data temporarily used or generated when an application is executed.

  In the memory 200, in addition to the control program, image data, information captured from the outside via the communication module 305, information input by the first and second touch sensors 13, 23, and the like are in a predetermined file format. Saved.

  The CPU 100, based on the operation input signals from the key input circuit 304 and the touch sensors 13 and 23, according to the control program, the camera module 301, the microphone 302, the communication module 305, the first and second displays 12, 22, the speaker 311 and the like. To work. As a result, the CPU 100 executes various applications.

<Mobile phone functions>
FIG. 5A is a diagram showing a state in which the launcher screen is displayed on the first display 12 (first display surface 14) and the second display 22 (second display surface 24) in the open state. FIG. 5B is a diagram showing a state in which an execution screen of an application started by an operation on the launcher screen is displayed on the first display surface 14 and the second display surface 24 in the open state. FIG. 5C is a diagram illustrating a state in which the execution screen is displayed on the first display surface 14 and the execution screen of the second display surface 24 is visible through the first display surface 14 in the closed state. 5A, 5 </ b> B, and 5 </ b> C schematically show the configuration of the mobile phone 1, and some configurations such as the key groups 15, 25, and 26 are not shown. . The same applies to FIG.

  As shown in FIG. 5A, icons D1 corresponding to various applications are displayed on the launcher screen. The application can be obtained by downloading through the Internet in addition to the application provided in advance in the mobile phone 1, and the obtained application is added to the mobile phone 1 by installation.

  The user can start a desired application by tapping the desired icon D1 with a finger or the like from among the plurality of icons D1.

  The memory 200 stores an icon correspondence table that associates each icon D1 with the position of each icon D1 on the display surfaces 14 and 24, and an application correspondence table that associates each icon D1 with each application. When the icon D1 is tapped, the CPU 100 specifies the tapped icon D1 using the icon correspondence table based on the tapped position. Furthermore, using the application correspondence table, the application corresponding to the tapped icon D1 is specified, and the application is activated.

  When the icon D1 corresponding to the application A1 displayed on the first display surface 14 is tapped, an application execution screen is displayed on the first display surface 14. When the icon D1 corresponding to the application A2 displayed on the second display surface 24 is tapped, the execution screen of the application A2 is displayed on the second display surface 24 (see FIG. 5B).

Now, when a user moves, the mobile telephone 1 is closed so that it may carry easily. When the mobile phone 1 is closed in a state where the two applications A1 and A2 are executed, the execution screen of the application A1 remains displayed on the first display surface 14, but further, the execution screen of the application A2 Is still displayed on the second display surface 24. As described above, the first display 12 is in a state in which the execution screen of the second display surface 24 is reflected in the back of the execution screen of the first display surface 14 because the other side can be seen through even when the execution screen is displayed. (See FIG. 5 (c)).

  The user may use the mobile phone 1 while moving. In this case, the user does not want to open the mobile phone 1 because it is difficult to hold it, but there is a situation in which the user wants to perform a predetermined operation on the execution screen displayed on the lower second display 22. obtain.

  Therefore, in the present embodiment, as described below, the user can perform a desired operation on the execution screen displayed on the second display 22 while the mobile phone 1 is in the closed state. .

  FIG. 6 is a flowchart showing a control processing operation when the first touch sensor 13 is operated in the closed state. This control process is performed by the CPU 100 when the execution screen relating to the application is displayed on both the first display 12 and the second display 22 in the closed state.

  Referring to FIG. 6, CPU 100 monitors whether or not a predetermined operation such as touch, tap, or flick has been performed on first touch sensor 13 (S101). If it is determined that a predetermined operation has been performed (S101: YES), the CPU 100 determines whether or not the switch key 26C is touched (S102).

  When the user wants to perform an operation on the execution screen displayed on the first display 12, the user performs a predetermined operation on the first touch sensor 13 without touching the switching key 26C. If the CPU 100 determines in step S102 that the switching key 26C is not touched (S102: NO), the CPU 100 determines that the operation on the first touch sensor 13 is an operation on the execution screen of the first display 12, and The display on the first display 12 is controlled according to the operation content to the one touch sensor 13, that is, the touched position and the type of operation (tap, flick, etc.) (S103). That is, the CPU 100 changes the content of the execution screen of the first display 12 to a content corresponding to the operation content.

  On the other hand, when the user wants to perform an operation on the execution screen displayed on the second display 22, the user performs a predetermined operation on the first touch sensor 13 while touching the switching key 26C. If the CPU 100 determines in step S102 that the switching key 26C is touched (S102: YES), the CPU 100 determines that the operation on the first touch sensor 13 is an operation on the execution screen of the second display 22, The display on the second display 12 is controlled in accordance with the operation content to the one touch sensor 13 (S104). That is, the CPU 100 changes the content of the execution screen of the second display 22 to a content corresponding to the operation content.

  In this way, even when the mobile phone 1 is in the closed state, the user performs the same operation as that in the open state on the execution screen displayed on the second display 22 and confirms the contents based on the operation. be able to.

  In FIG. 7, when a notepad application is executed on the first display 12 and a web browser is executed on the second display 22 in the closed state, operations are performed on the execution screens of the displays 12 and 22. It is a figure for demonstrating the case at the time.

7A and 7B show a state in which the character input screen of the notepad application is displayed on the first display 12 and the map web screen (map screen) is displayed on the second display 22 in the closed state. FIG. FIG. 7C is a diagram showing a screen display example when the character input screen of the first display 12 is operated in the closed state, and FIG. 7D is a map of the second display 22. It is a figure which shows the example of a screen display when operation is performed with respect to the screen.

  In FIGS. 7B, 7C, and 7D, in order to make the execution screens of the respective displays 12 and 22 easy to understand, the two displays 12 and 22 that are actually overlapped are described side by side. Yes. The same applies to FIGS. 8B, 8C and 8D and FIGS. 10B, 10C and 10D.

  When the mobile phone 1 is closed, as shown in FIG. 7B, when the character input screen of the memo pad application is displayed on the first display 12 and the map screen is displayed on the second display 22, As shown in FIG. 7A, the map screen displayed on the second display 22 can be seen behind the character input screen displayed on the first display 12.

  The user can create a document on the character input screen while referring to the transparent map screen. In this case, the user operates the keyboard displayed on the character input screen without touching the switching key 26C. As a result, the processes of steps S101, S102, and S103 in FIG. 6 are performed, and characters based on key operations are input to the character input screen as shown in FIG. 7C.

  On the other hand, for example, when it is desired to refer to another range on the map screen during document creation, the user operates the movement key displayed on the map screen while touching the switching key 26C. As a result, the processes of steps S101, S102, and S104 in FIG. 6 are performed, and the map screen is moved to display a map in another range as shown in FIG. 7D.

  In this way, in the case of FIG. 7, when the application of the first display 12 is used in the closed state, the execution screen of the application on the second display 22 is referred to in the closed state, or the execution screen is displayed. It can be operated against.

  FIG. 8 illustrates a case where an operation is performed on the execution screens of the displays 12 and 22 when an augmented reality application is executed on the first display 12 and the second display 22 in the closed state. It is a figure for doing.

  In FIGS. 8A and 8B, in the closed state, a shooting screen shot by the camera module 301 is displayed on the second display 22, and an additional information screen including additional information (annotation) related to the shooting screen is displayed first. It is a figure which shows the state displayed on 1 display. FIG. 8C is a diagram illustrating a screen display example when an operation is performed on the additional information screen of the first display 12 in the closed state, and FIG. 8D is a photograph of the second display 22. It is a figure which shows the example of a screen display when operation is performed with respect to the screen.

  When an augmented reality application is activated in a state where the mobile phone 1 is closed, the camera module 301 is driven. Further, the current location information is acquired from the GPS module 314, and the orientation taken by the camera module 301 is detected using the electronic compass 315. The current location information and the direction information are sent to the dedicated server via the communication module 305, and additional information based on these information is sent from the dedicated server. For example, when a landscape on a street corner is photographed, additional information regarding various stores occupying a building included in the landscape is acquired.

  In this way, as shown in FIG. 8B, the second display 22 displays a screen shot by the camera module 301, for example, a landscape of a street corner. The first display 12 displays an additional information screen including additional information related to the shooting screen.

On the additional information screen, additional information related to each building is represented by a balloon image corresponding to each building. The balloon may include a character string in which a hyperlink is set. The additional information is also represented by an icon image smaller than the balloon. At this time, when the icon is arranged at the same position as the balloon and overlaps with the balloon, the icon is synthesized and displayed on the shooting screen on the second display 22 as shown in FIG. .

  As shown in FIG. 8A, the photographing screen displayed on the second display 22 can be seen through the additional information screen displayed on the first display 12. In the additional information screen, each balloon is arranged so as to overlap the corresponding building.

  The user can view additional information superimposed on the landscape by photographing the desired landscape with the camera module 301. In this case, when the user touches the position of the character string to which the hyperlink in the balloon is set on the first touch sensor 13 without touching the switching key 26C, the processing in steps S101, S102, and S103 in FIG. Processing is performed, and an execution screen based on the hyperlink is displayed on the first display 12. For example, when information on various stores is shown in a balloon and the set hyperlink refers to the URL of the homepage of store C, which is one of those stores, the web browser is activated. As shown in FIG. 8C, the homepage of the store C is displayed on the first display 12.

  On the other hand, when the user touches the position of the icon on the first touch sensor 13 while touching the switching key 26C, the processing in steps S101, S102, and S104 in FIG. 6 is performed, and the execution screen based on the icon is displayed on the second display. 22 is displayed. For example, as illustrated in FIG. 8D, detailed information regarding the store at the place where the icon is located in the building is displayed on the second display 22.

  In addition, when the mobile phone 1 is opened from the closed state shown in FIG. 8A, as shown in FIG. 9, more detailed information is displayed on the first display 12 than in the closed state. The user can know more detailed information on various stores in each building by opening the mobile phone 1.

  In this way, in the example of FIG. 8, when objects (balloons, icons, etc.) that represent additional information and are the target of operation exist at similar positions on the shooting screen, these objects are displayed on the first display 12 and the first display. It can be placed on top of two displays. Therefore, when an augmented reality application is executed in the closed state, more additional information can be combined with the photographed landscape on the screen in a state where it can be easily operated.

  FIG. 10 illustrates a case where an operation is performed on the execution screen of each display 12 and 22 when the application of the video player is being executed on the first display 12 and the second display 22 in the closed state. It is a figure for doing.

  10 (a) and 10 (b), in a closed state, a playback screen for a predetermined video is displayed on the first display 12, and a playback screen for a video to be compared with the video on the first display 12 is the second display 22. It is a figure which shows the state displayed on. FIG. 10C is a diagram showing a screen display example when an operation for reproducing the moving image of the first display 12 is performed in the closed state, and FIG. 10D is a reproduction of the moving image of the second display 22. It is a figure which shows the example of a screen display when operation to do is made.

In the state in which the cellular phone 1 is closed, as shown in FIG. 10B, for example, a reproduction screen of a moving image in which the user's golf swing is photographed is displayed on the first display 12 as a predetermined moving image. As an image to be compared, for example, when a playback screen of a video in which a golf golfer's golf swing is captured is displayed on the display 22, the image is displayed on the first display 12 as shown in FIG. The image of the professional golfer displayed on the second display 22 is seen behind the user's image. An operation bar composed of a play button, a feed button, a return button, and the like is arranged on the playback screen.

  The user operates the playback button on the playback screen of the first display 12 without touching the switching key 26C when playing back the movie on the first display 12, that is, the movie of his golf swing. As a result, the processes of steps S101, S102, and S103 in FIG. 6 are performed, and as shown in FIG. 10C, the golf swing video is reproduced.

  On the other hand, the user operates the playback button on the playback screen of the second display 12 while touching the switching key 26 </ b> C when playing the movie on the second display 22, that is, the movie of the golf swing of a professional golfer. Thereby, the processing of steps S101, S102, and S104 in FIG. 6 is performed, and as shown in FIG. 10D, a movie of a golf swing of a professional golfer is reproduced.

  In this way, in the example in FIG. 10, two moving images to be compared with each other are displayed so as to overlap each other, and in this state, it is possible to operate each moving image. It is possible to easily compare and analyze a moving image and a moving image of a golf swing of a professional golfer.

  In addition, as a moving image compared with each other, the moving image of the bat swing of a user and a professional baseball player etc. other than a golf swing can be considered, for example.

  Further, when the user presses a playback button on the first display 12 while pressing a specific key, for example, the function key 26F1, the moving images on the two displays 12 and 22 may be played back simultaneously. . In this way, the user can more easily compare and analyze the two moving images.

<Effects of the present embodiment>
As mentioned above, according to this Embodiment, the 1st display 12 is comprised by the display which has translucency, and is in the site | part of the 1st cabinet 10 located between the 1st display 12 and the 2nd display 22 in a closed state. An opening 16 is formed. Further, the first touch sensor 13 is used as an input detection unit for the second display 22 by operating the switching key 26C. Thereby, even in the closed state, the user can view the image displayed on the second display 22 through the opening 16 and the first display 12, and can perform an operation on the execution screen of the second display 22. it can.

  In addition, according to the present embodiment, the first display 12 is in a state where the other side of the display is transparent even when an image is displayed. Therefore, even if an execution screen is displayed on the first display 12, The execution screen of the second display 22 can be viewed through the first display 12.

Furthermore, according to the present embodiment, unlike the conventional configuration in which the execution screens of both displays 12 and 22 cannot be viewed and operated on these execution screens unless they are open , FIG. 8 and FIG. As in the case shown in FIG. 10, a new function that cannot be realized by the conventional configuration can be realized.

Furthermore, according to the present embodiment, since the organic EL display is used for the first display 12, the first cabinet 10 can be thinned.

<Example of change>
FIGS. 11A and 11B are flowcharts illustrating control processing operations when an operation is performed on the first touch sensor 13 in the closed state, according to Modification Example 1 and Modification Example 2, respectively.

  In the first modification, the process of step S105 is added between step S102 and step S104 of the above embodiment shown in FIG. That is, when the CPU 100 determines that the switching key 26C is touched when an operation is performed on the first touch sensor 13 (S101: YES), the brightness of the first display 12 is reduced. . Thereby, since the execution screen of the 1st display 12 becomes thin, it becomes easy to see the execution screen of the back 2nd display 22 through the 1st display 12. FIG.

  On the other hand, in the modified example 2, the process of step S106 is added between step S102 and step S104 of the above-described embodiment shown in FIG. That is, when the CPU 100 determines that the switching key 26C is touched (S102: YES) when an operation is performed on the first touch sensor 13 (S101: YES), the CPU 100 turns off the first display 12. As a result, the execution screen of the first display 12 disappears, so that the execution screen of the rear second display 22 can be easily viewed through the first display 12.

  Thus, if it is set as the structure of the modification example 1 and the modification example 2, after operating with respect to the execution screen of a 2nd display, the execution screen based on the operation can be made easier to see.

  In the first modification, the CPU 100 once restores the brightness when the switch key 26C is released after the brightness of the first display 12 is lowered. In the second modification, the CPU 100 once turns off the first display 12 and then turns on the first display 12 again when the switching key 26C is released.

  Further, as described above, the CPU 100 reduces the brightness of the first display 12 at the timing at which the switching key 26C is touched, not at the timing at which the first touch sensor 13 is operated, It may be configured to turn off. In this case, if the switching key 26C is released before the first touch sensor 13 is operated, the CPU 100 restores the brightness of the first display 12 or turns on the first display 12.

<Others>
Although the embodiment of the present invention has been described above, the present invention is not limited to the above embodiment, and the embodiment of the present invention can be variously modified in addition to the above.

For example, in the above embodiment, whether the first touch sensor 13 is used as an input detection unit for the first display 12 or an input detection unit for the second display 22 is determined by touching the switching key 26C. It is configured to be switched. However, the operation that triggers switching is not limited to this. For example, when a pressure-sensitive touch sensor is used as the first touch sensor 13, it is added to the first touch sensor 13 when an operation is performed on the first touch sensor 13 as shown in FIG. 12. The detected pressure is detected (S107). If the pressure is equal to or less than the predetermined threshold (S107: NO), the CPU 100 controls the display on the first display 12 according to the operation content to the first touch sensor 13 (S103). On the other hand, if the pressure is greater than the predetermined threshold (S107: YES), the CPU 100 determines whether the second display 2 is in accordance with the operation content to the first touch sensor 13.
2 is controlled (S104).

  When the user operates the execution screen of the first display 12 in front, the user operates the first touch sensor 13 with a weak force and operates the execution screen of the second display 22 in the back. Since it is sufficient to operate the first touch sensor 13 with a strong force, a more intuitive operation can be performed.

  In the first modification, when the operation screen of the second display 22 is operated in the closed state, the luminance of the first display 12 is reduced. However, in addition to this, or alternatively, in the closed state, the brightness of the first display 12 may be increased when an operation is performed on the execution screen of the first display 12. . In this case, for example, if the switch key 26 </ b> C is not touched when an operation is performed on the first touch sensor 13, the CPU 100 increases the luminance of the first display 12. Thereafter, for example, when the switching key 26 </ b> C is touched, the CPU 100 restores the luminance of the first display 12.

  Furthermore, in the said embodiment, although the organic electroluminescent display which has translucency is used as the 1st display 12, the liquid crystal display which has translucency may be used. Moreover, in the said embodiment, although the liquid crystal display is used as the 2nd display 22, an organic electroluminescent display may be used.

  Further, in the above-described embodiment, the opening 16 is provided on the back surface of the first cabinet 10 in order to pass the image displayed on the second display 22. However, at least the back portion of the first cabinet 10 may be formed of a transparent material.

  Furthermore, in the said embodiment, the mobile telephone 1 provided with the two displays 12 and 22 is shown. However, the present invention may be applied to a mobile phone including three or four displays. In this case, a display other than the lowermost display in the closed state is a display having translucency. Further, in the closed state, the touch sensor arranged on the uppermost display is switched as a detection unit that detects an input to the other display. For example, in a mobile phone having three displays, a first switch key and a second switch key are provided. When the uppermost touch sensor is operated with the first switch key pressed, the CPU controls the display on the intermediate display according to the operation content, and the second switch key is pressed. When the uppermost touch sensor is operated in the state, the CPU controls the display on the lowermost display in accordance with the operation content.

  Furthermore, the mobile terminal device of the present invention is not limited to a mobile phone, and may be a PDA (Personal Digital Assistant), a tablet PC (Tablet PC), or the like.

  In addition, the embodiment of the present invention can be variously modified as appropriate within the scope of the technical idea shown in the claims.

10 1st cabinet 12 1st display (1st display part)
13 First touch sensor (input detection unit)
16 Opening (passage)
20 2nd cabinet 22 2nd display (2nd display part)
26C switching key (switching operation part)
100 CPU (control unit, switching detection unit)

Claims (10)

A first display section and a second display section;
A first cabinet in which the first display unit is disposed;
A second cabinet in which the second display unit is disposed;
An input detection unit disposed on the first display unit for detecting an input to the first display unit;
A switching detection unit that detects a switching operation for switching the input detection unit to a detection unit that detects an input to the second display unit;
A control unit for controlling the first display unit and the second display unit,
When the first display unit and the first cabinet are arranged so that the first display unit overlaps the second display unit, an image displayed on the second display unit is displayed on the first display unit. Configured to be seen through and
When the first display unit is overlaid on the second display unit, the control unit shows an image on the first display unit and an image of the second display unit superimposed on the image can be seen through. When the display operation is performed in a semi-transparent state and the switching operation is performed, the two display units are controlled based on the input to the second display unit detected by the input detection unit.
The portable terminal device characterized by the above-mentioned. The mobile terminal device according to claim 1,
A switching operation unit operated during the switching operation;
The switching detection unit detects the switching operation by operating the switching operation unit;
The portable terminal device characterized by the above-mentioned. The mobile terminal device according to claim 1,
The input detection unit includes a pressure-sensitive type touch sensor,
The switching detection unit detects the switching operation based on a pressure applied to the touch sensor;
The portable terminal device characterized by the above-mentioned. In the portable terminal device according to any one of claims 1 to 3,
The first display unit has translucency,
In the first cabinet, an image displayed on the second display unit at a portion sandwiched between the first display unit and the second display unit in a state where the first display unit overlaps the second display unit. With a passing section to pass through,
The portable terminal device characterized by the above-mentioned. The mobile terminal device according to claim 4,
The first display unit includes an organic EL display having translucency, and in a state where an image is displayed, the other side of the first display unit can be seen through.
The portable terminal device characterized by the above-mentioned. The mobile terminal device according to claim 5,
When the switching operation is performed, the control unit lowers the luminance of the first display unit or turns off the first display unit, so that the second display unit in the first display unit is turned off. Increase image transparency,
The portable terminal device characterized by the above-mentioned. A first display section and a second display section;
A first cabinet in which the first display unit is disposed;
A second cabinet in which the second display unit is disposed;
An input detection unit that is disposed on the first display unit and detects an input to the first display unit,
When the first display unit and the first cabinet are arranged so that the first display unit overlaps the second display unit, an image displayed on the second display unit is the first display unit. To a mobile terminal computer configured to be viewed through,
A function of detecting a switching operation for switching the input detection unit to a detection unit that detects an input to the second display unit;
When the first display unit is overlaid on the second display unit, an image is displayed on the first display unit, and the image of the second display unit superimposed on the image is translucent. A function of controlling the two display units based on an input to the second display unit detected by the input detection unit when the state is displayed and the switching operation is performed;
A program that grants. The mobile terminal device according to claim 1,
The control unit causes the first display unit to display an image linked with the image of the second display unit in a semi-transparent state when the first display unit is in a state of being superimposed on the second display unit. ,
The portable terminal device characterized by the above-mentioned. The mobile terminal device according to claim 8, wherein
A camera unit,
The control unit causes the second display unit to display a shooting screen shot by the camera unit, and causes the first display unit to display an additional information screen including additional information related to the shooting screen in a translucent state. ,
The portable terminal device characterized by the above-mentioned. The mobile terminal device according to claim 1,
The control unit displays a moving image reproduction screen on the second display unit, and causes the first display unit to display a moving image reproduction screen to be compared with the moving image of the second display unit in a translucent state;
The portable terminal device characterized by the above-mentioned.

Images