JP5647464B2 - Mobile terminal device - Google Patents

Description

The present invention relates to a mobile terminal device such as a mobile phone or a PDA (Personal Digital Assistant).

  Conventionally, a mobile terminal device can display a web page or the like on a display unit via the Internet or the like. A user may use this type of mobile terminal device to view a web page on which various products are posted, and may want to purchase a product that he / she likes.

  By the way, when the product is furniture or interior miscellaneous goods, when the product is placed in his / her room, harmony with other interiors can be an important factor in purchasing the product. Therefore, it is convenient for the user if it can be confirmed in advance whether the furniture or the like posted on the web page or the like fits in his / her room.

  On the other hand, the mobile terminal device may be configured such that an image such as a picture or a table is acquired from a web page or the like, and the acquired image can be displayed on the standby screen so as to be superimposed on the background image of the room. The background image may be a room photograph taken by a camera (for example, Patent Document 1).

JP 2006-178758 A

  However, in the above configuration, in order to change the orientation of the room shown in the photo to the orientation of the furniture, or to change the location of the room where the furniture is to be placed, take a photo that changes the orientation and location each time. It is necessary to perform an operation of superimposing the furniture image on the photo, which is troublesome.

  The present invention has been made in view of such a problem, and an object of the present invention is to provide a mobile terminal device that can easily superimpose an image on an actually-viewable landscape.

The mobile terminal device of the present invention includes a display unit, an extraction unit that extracts an object image instructed by a user from an original image, and a display control unit that controls the display unit. The display unit includes a first display area that can be set to a see-through state that allows light to pass forward from behind, and a second display area that is not set to the see-through state, and the mobile terminal device includes the first display area. Is set to the see-through state, the scenery behind the apparatus main body can be seen through the first display area . The display control unit displays the object image in the first display area in response to an instruction to move the object image displayed in the second display area to the first display area. sets the display region other than the object image in the first display region on the see-through state.

According to the portable terminal device according to the present embodiment, by displaying the object image extracted from the original image in the first display area, a landscape viewed through the first display region may be the background of the object image. For this reason, the background on which the object images are superimposed can be changed in real time only by changing the orientation and position of the first display area .

The portable terminal device of the present invention may further include a position detection unit for detecting the position indicated on the display unit. Here, the display control unit displays the object image at the position detected by the position detection unit.

In such a configuration, by instructing the user to position on the table radical 113, the object image is displayed on the instruction position. Therefore, intuitive and easy placement of the object image in accordance with the scenery reflected on transparent Table radical 113.

  The portable terminal device of the present invention may further include a range detection unit for detecting a specified range in the original image. Here, the extraction unit extracts an image of a range detected by the range detection unit as the object image.

  With such a configuration, it is possible to intuitively and easily specify and extract an image displayed at the designated position as an object image simply by designating the position with respect to the original image.

  When the mobile terminal device includes a first unit, a first position overlapping the first unit, and a second unit movable to a second position next to the first unit, the first display area is the The second unit may be set to the first unit, and the second display area may be set to the second unit.

  With such a configuration, an object image can be displayed in a wide first display area by a simple operation. Therefore, the object image can be smoothly superimposed on the landscape.

In this case, the display control unit displays the selection candidate of the object image in the second display area in a state where the second unit is positioned at the second position, and selects the predetermined selection from the displayed selection candidate. In response to the input of an instruction to select the object image and move it to the first display area, the object image is displayed in the first display area, and other than the object image in the first display area The display area may be configured to set the see-through state.

  With such a configuration, the user can select a desired object image and overlay it on the landscape while viewing the landscape at a predetermined angle in the first display area.

  Alternatively, the display control unit displays the object image selection candidates in the second display area in a state where the second unit is positioned at the first position, and sets the first display area to the see-through state. After an instruction to set and select a predetermined object image from the displayed selection candidates is input, the object image is converted into the first image in response to the second unit being positioned at the second position. The display area other than the object image in the first display area may be set to the see-through state while being displayed in the display area.

  With such a configuration, since the object image is displayed in the first display area with the second unit positioned at the second position as a trigger, the operation can be simplified.

  As described above, according to the present invention, it is possible to provide a mobile terminal device that can easily superimpose an image on a landscape that can actually be seen.

  The effects and significance of the present invention will become more apparent from the following description of embodiments. However, the embodiment described below is merely an example when the present invention is implemented, and the present invention is not limited to what is described in the following embodiment.

It is a perspective view which shows the whole portable terminal device which concerns on embodiment. It is sectional drawing which shows the portable terminal device which concerns on embodiment. It is a perspective view for demonstrating operation | movement of the portable terminal device which concerns on embodiment. It is a block diagram which shows the circuit of the portable terminal device which concerns on embodiment. It is a flowchart which shows the process sequence which displays the object image which concerns on embodiment. It is a figure which shows the state which designates an object image in the 2nd display surface which concerns on embodiment. It is a figure which shows the state which displays an object image in the designation | designated position on the 1st display surface which concerns on embodiment. It is a block diagram which shows the circuit of the portable terminal device which concerns on embodiment. It is a flowchart which shows the process sequence which displays the object image which concerns on embodiment. It is a figure which shows the state which displays the object image designated with respect to the 2nd display surface which concerns on embodiment on a 1st display surface. It is a figure which shows the state which displays the object image designated with respect to the 2nd display surface which concerns on embodiment on a 1st display surface.

  Hereinafter, the mobile terminal device 1 according to the present embodiment will be described with reference to the drawings.

<Configuration of mobile terminal device>
FIG. 1A is a perspective view showing a state in which the first unit 10 of the mobile terminal device 1 is overlapped with the second unit 20. FIG. 1B is a perspective view showing a state in which the first unit 10 and the second unit 20 of the mobile terminal device 1 are arranged. FIG. 2A is a cross-sectional view taken along the line AA ′ in FIG. FIG. 2B is a cross-sectional view taken along line BB ′ in FIG. In the present embodiment, the position of the first unit 10 is on the upper side with respect to the second unit 20, and the first unit 10 and the second unit 20 overlap in a state where the mobile terminal device 1 is placed horizontally. Is called the vertical direction, and the direction perpendicular to the vertical direction is called the horizontal direction.

  The mobile terminal device 1 includes a first unit 10 and a second unit 20, and the first unit 10 is slidably stacked on the second unit 20.

  The first unit 10 includes a first bottom portion 11, a slide portion 12 provided on the first bottom portion 11, a first display portion 13 and a first input portion 14 accommodated in the first bottom portion 11, and a first display portion 13. A wiring 15 connected to the first display portion 13, a first lid portion 16 covering the first display portion 13, and a covering portion 17 attached to the first lid portion 16.

The first bottom portion 11 has a rectangular shape and is formed by injection molding with a transparent resin such as polycarbonate or acrylic. The first bottom portion 11 is provided with two bottom through holes 11a spaced from each other. The bottom through hole 11a is a direction in which the first unit 10 slides (slide direction).
It is an elongate hole extending in the direction. The slide portion 12 is fitted in the bottom through hole 11a.

  The slide part 12 is disposed on a second lid part 27 described later. The slide portion 12 is a member that is elongated in the sliding direction of the first unit 10, and has an insertion hole 12a in the middle portion and a locking portion 12b in the end portion. The locking portion 12b is disposed in the second lid portion 27, and the main body portion protruding upward from the second lid portion 27 is fitted into the bottom through hole 11a. A through hole 12c is formed in the locking portion 12b. A first display portion 13 is disposed on the first bottom portion 11 between the two slide portions 12.

  The 1st display part 13 is a rectangular flat plate shape, Comprising: For example, it is comprised by the transparent liquid crystal display. The liquid crystal display includes only a liquid crystal panel whose display mode is normally white, and no illumination unit (backlight) is disposed behind the liquid crystal panel. The liquid crystal panel is configured by sandwiching a transparent liquid crystal (not shown) and a transparent electrode (not shown) between two transparent plates (not shown). The first display unit 13 has a first display surface 13b facing upward. An electrode 13 a is provided at the end of the first display unit 13, and the first input unit 14 is overlaid on the first display unit 13.

  A transparent liquid crystal display and wiring 15 are connected to the electrode 13a.

  A flexible wiring (flexible substrate) is used for the wiring 15. The wiring 15 passes through the through hole 12c of the locking portion 12b, exits from the side surface of the locking portion 12b in the lateral direction, and goes out into the second lid portion 27.

  The first input unit 14 includes a position sensor 14a. A touch panel or the like is used for the position sensor 14a. The touch panel is a transparent rectangular sheet, and two transparent electrodes (not shown) are incorporated in a matrix. The touch panel detects a change in capacitance between the transparent electrodes to detect a position touched by the user's finger or the like on the first display surface 13b, and outputs a signal corresponding to the position. Similar to the wiring 15 of the first display unit 13, the wiring of the first input unit 14 passes through the through hole 12 c of the locking unit 12 b and is guided into the second lid 27.

  The first lid portion 16 is placed on the first bottom portion 11 so as to cover the first input portion 14. The first lid portion 16 is formed by injection molding with a transparent resin such as polycarbonate or acrylic. The first lid portion 16 is provided with two lid through holes 16a. The cover through-hole 16 a is fitted with the covering portion 17 and covers the slide portion 12.

  The covering portion 17 is formed by injection molding with an opaque resin. The cover portion 17 is provided with a screw hole 17a. When the screw 18 is fitted into the screw hole 17a and the insertion hole 12a of the slide portion 12, the slide portion 12 and the covering portion 17 are connected in the vertical direction.

  By connecting the slide part 12 and the covering part 17, the first lid part 16 and the first bottom part 11 are fixed, and the first unit 10 is assembled.

  The second unit 20 covers the second bottom portion 21, the battery 22 accommodated in the second bottom portion 21, the substrate 23, the second input portion 24, the second display portion 25 and the receiving portion 26, and the second display portion 25. A second lid 27.

  The second bottom portion 21 has a rectangular shape and opens upward. A support portion 21a is provided in the second bottom portion 21, and a receiving portion 26 is disposed on the support portion 21a.

  The receiving part 26 is arrange | positioned under the guide hole 27a, and is attached to the latching | locking part 12b.

  The battery 22 is disposed in the second bottom portion 21. A substrate 23 is stacked on the battery 22, and a connector 22 a is provided beside the battery 22. Connectors 23a and electronic components (not shown) such as CPU 23b and memory 23c are arranged on the surface of the substrate 23, and the electronic components are connected by wiring (not shown). The substrate 22 and the battery 22 are connected to the connector 22a. The connector 23 a is connected to the wiring 15 of the first display unit 13 and the wiring of the first input unit 14. The second display unit 25 and the second input unit 24 are stacked on the substrate 23 in this order.

  The second display unit 25 is formed of, for example, a non-transparent liquid crystal display, and includes a liquid crystal panel 25a, a light guide plate 25b for illuminating the liquid crystal panel 25a, and a light emitting unit 25c. The liquid crystal panel 25a is configured by sandwiching a transparent liquid crystal (not shown) and a transparent electrode (not shown) between two transparent plates (not shown). The light guide plate 25b is disposed beside the light emitting unit 25c and below the liquid crystal panel 25a so as to guide light from the light emitting unit 25c to the second display unit 25.

  The second input unit 24 includes a position sensor 24a. For the position sensor 24a, for example, a touch panel is used. The touch panel is a transparent rectangular sheet. In the touch panel, two transparent electrodes (not shown) are incorporated in a matrix, and wiring (not shown) is connected to the transparent electrodes.

  Wirings (not shown) are arranged on the light emitting unit 25 c, the liquid crystal panel 25 a and the second input unit 24, respectively, and these wirings are connected to the substrate 23.

  The second lid portion 27 is connected to the second bottom portion 21 to form the second unit 20. A display window 27b is formed at the center of the second lid 27, and the second display surface 25d of the second display 25 faces the outside through the display window 27b. The second lid portion 27 is provided with two guide holes 27a spaced apart from each other. The first unit 10 and the second unit 20 are connected by the locking portion 12b passing through the guide hole 27a being locked to the edge of the second lid portion 27 surrounding the guide hole 27a.

<Operation of mobile terminal device>
FIG. 3A is a perspective view showing the wiring 15 when the first unit 10 and the second unit 20 are overlapped. FIG. 3B is a perspective view showing the wiring 15 when the first unit 10 and the second unit 20 are arranged. 14A and 14B, some parts such as the first lid portion 16 are represented by broken lines so that the state of the wiring 15 can be easily understood.

  As shown in FIG. 1A, in a state where the first unit 10 overlaps the second unit 20, the first display surface 13b faces the outside. Hereinafter, this display form is referred to as a first form. In the first mode, as shown in FIG. 3A, the locking portion 12b of the slide portion 12 is positioned at one end of the guide hole 27a, that is, in the vicinity of the connector 23a of the substrate 23. The wiring 15 extends along the bottom surface of the receiving portion 26 from the through hole 12d of the locking portion 12b, bends in the middle, overlaps and returns to the through hole 12d along the bottom surface of the receiving portion 26, and is connected to the connector 23a. The

On the other hand, as shown in FIG. 1B, when the first unit 10 is pulled out to the side of the second unit 20, both the first display surface 13b and the second display surface 25d face the outside. At this time, the end of the first unit 10 slightly overlaps the end of the second display surface 25d, and the first display surface 13b and the second display surface 25d are arranged side by side with no gap. Less than. This display form is referred to as a second form. By switching between the first form and the second form, the second unit has a first position overlapping the first unit in the first form and a second position arranged next to the first unit in the second form. Moving.

  In the second mode, as shown in FIG. 3B, the locking portion 12b of the slide portion 12 moves from one end of the guide hole 27a to the other end, and the guide hole 27a opens. The locking part 12b moves away from the position of the connector 23a of the board 23, and the wiring 15 extends linearly from the through hole 12d of the locking part 12b to the connector 23a of the board 23.

<Circuit of portable terminal device>
FIG. 4 is a block diagram of a circuit of the mobile terminal device 1.

  The memory 23c is a storage unit including a ROM and a RAM. The memory 23c stores a control program for giving a control function to the CPU 23b. The memory 23c stores image information captured by a camera module (not shown), image information taken from the outside via a communication module (not shown), text information, and the like in a predetermined file format. Further, the memory 23c stores information (display content information) on the contents displayed on the display units 13 and 25, position definition information, and the like. The display content information in each of the display units 13 and 25 includes the color information and color information of the pixels constituting the image displayed on the display surfaces 13b and 25d, and includes the pixel positions. In the position definition information, positions of icons and buttons displayed on the display units 13 and 25 are associated with files and programs corresponding to the icons. The color information includes color tone and gradation.

  The battery 22 receives a control signal from the CPU 23b and supplies power to the CPU 23b, the display units 13 and 25, the input units 14 and 24, and the like according to the control signal.

  The first display unit 13 and the second display unit 25 receive image signals from the CPU 23b. By applying a voltage to the transparent electrodes of the display units 13 and 25 based on these image signals, the alignment of the liquid crystal changes, and the light passing through the liquid crystal is modulated. Thereby, in each display part 13 and 25, images, such as an icon and a keyboard, pictures, a character, a picture, and a window, are displayed on each display surface 13b and 25d. In the first display unit 13, the transmittance is maximized and light is transmitted in a range where no voltage is applied. Therefore, since the first cover portion 16, the first input portion 14, and the first bottom portion 11 sandwiching the first display portion 13 are transparent, the light transmission range in the first display portion 13 is transparent or translucent. It is possible to set a see-through state in which the scenery behind the first display unit 13 can be seen.

  Electric power from the battery 22 is supplied to the light emitting unit 25c of the second display unit 25 by a control signal from the CPU 23b, whereby the light emitting unit 25c emits light. The emitted light enters the light guide plate 25b from the side surface of the light guide plate 25b, and a part of the light exits from the surface of the light guide plate 25b to the liquid crystal panel 25a side while being reflected inside the light guide plate 25b. As a result, light is uniformly emitted from the entire light guide plate 25b, and the liquid crystal panel 25a is irradiated with light.

  The 1st input part 14 and the 2nd input part 24 are position detection parts which detect the position which the user touched and instruct | indicated on each display surface 13b, 25d by position sensor 14a, 24a. Accordingly, the first input unit 14 detects an input to the first display unit 13, and the second input unit 24 detects an input to the second display unit 25. And each input part 14 and 24 outputs the position signal according to an instruction | indication position to CPU23b.

The CPU 23b is a display control unit that displays images on the display surfaces 13b and 25d and changes the transmittance of the first display unit 13. That is, it receives a position signal and a software request signal by a user operation. The CPU 23b executes processing according to the position signal and the like, reads out from the memory 23c, or receives it via a communication line or the Internet, and acquires image data such as a photograph or a picture. The CPU 23b outputs the image data as an image signal to each of the first display unit 13 and the second display unit 25, and displays an image on each of the display surfaces 13b and 25d. Further, the CPU 23 b controls the voltage applied to the transparent electrode by adjusting the power supplied from the battery 22 and changes the transmittance of the first display unit 13. Thereby, the CPU 23b displays the object image on the first display unit 13, and sets the display area other than the object image on the first display unit 13 to the see-through state.

  When the image is displayed on the second display unit 25, the CPU 23b supplies power from the battery 22 to the light emitting unit 25c and causes the light emitting unit 25c to emit light.

  The CPU 23b receives position signals from the position sensors 14a and 24a of the input units 14 and 24, and specifies the designated position. The CPU 23b refers to the position definition information and executes processing such as an icon program corresponding to the designated position. Further, the CPU 23b displays an image at the designated position.

  The CPU 23b is a range detection unit that detects an instructed range in the images displayed on the display surfaces 13b and 25d based on the positions corresponding to the position signals from the input units 14 and 24.

  The CPU 23b is an extraction unit that extracts an object image included in the designated range from images displayed on the display surfaces 13b and 25d. That is, the CPU 23b obtains a range instructed by the user on the second display surface 25d from the position signal from the position sensor 24a of the second input unit 24. The CPU 23b extracts the image of the object corresponding to the designated range from the image of the memory 23c while referring to the display content information on the second display surface 25d of the memory 23c.

<Functions of mobile terminal device>
The portable terminal device of the present embodiment has an image capture function described below. For example, the user can activate this function by selecting an icon corresponding to the image capture function on the menu screen.

  FIG. 5 is a flowchart showing a processing procedure for displaying an object extracted from the image displayed on the second display unit 25 on the first display unit 13. FIG. 6 shows a mobile terminal device 1 of a second form in which a web page is displayed on the second display surface 25d and the first display surface 13b is transparent. FIG. 7 shows the mobile terminal device 1 of the second form in which the chair image extracted from the web page displayed on the second display surface 25d is displayed on the first display surface 13b.

  As shown in FIG. 6, the user can access the second input unit 24 to the Internet with the first display surface 13b and the second display surface 25d arranged side by side and the second display surface 25d exposed to the outside. Perform the connection operation. Thereby, CPU23b acquires the image information of a web page via the internet, and displays a web page on the 2nd display part 25 (S101). Here, the image of two chairs is included in the web page. Further, the color information of each pixel of the image displayed on the second display surface 25d and the position where the pixel is arranged are associated with each other and stored in the memory 23c as display content information.

  When the user touches the second display surface 25d with a finger to indicate the position and traces the outline of the chair image, the second input unit 24 detects the contact position and transmits the position to the CPU 23b as a signal. To do. The CPU 23b receives the position signal and specifies a range instructed by the user from the indicated position on the second display surface 25d (S102).

The CPU 23b compares the position of the display content information in the memory 23c with the position of the designated range, and obtains the color information of the pixels included in the designated range and the position where the pixels are arranged. This
The CPU 23b specifies an image displayed in the designated range from the images displayed on the second display surface 25d, extracts this image as an object image, and stores it in the memory 23c (S103). In this case, the chair image displayed on the second display surface 25d is extracted as the object image.

  In addition, the CPU 23b controls the power supply from the battery 22 to the first display unit 13 to be in an off state. Accordingly, the first display unit 13 can transmit light, so that the user can see the scenery beyond the first unit 10 through the first unit 10 including the transparent first display unit 13. . The user directs the first display surface 13b to a place where the chair is to be placed. Then, as shown in FIG. 7, the user touches the first display surface 13 b with his / her finger and touches the position where the chair is to be placed in the scenery seen on the first display surface 13 b. Thus, when the arrangement position of the object image on the first display surface 13b is instructed, the first input unit 14 detects the position where the finger contacts, and outputs a signal corresponding to the position to the CPU 23b. The CPU 23b receives the position signal and obtains the user's designated position (S104).

  The CPU 23b reads out the object image from the memory 23c, and extracts the arrangement of the color information of the pixels included in the object image. The CPU 23b converts the arrangement of the color information of the object image into the position of the color information arranged on the first display surface 13b with reference to the user's designated position. The CPU 23b outputs the color information of the object image and the position of the color information on the first display surface 13b as an image signal to the first display unit 13. The 1st display part 13 represents the color according to color information in each position in the 1st display surface 13b. Thereby, the object image of the chair is displayed at the position designated by the user on the first display surface 13b (S105). In addition, since the background area excluding the object image is transparent on the first display surface 13b, the scenery beyond the first display surface 13b can be seen as the background of the chair. Furthermore, ambient light is also applied to the first display unit 13 and is used as illumination for the first display unit 13.

  As described above, according to the present embodiment, by designating a range for an image displayed on the second display surface 25d, a desired object image included in the range can be easily selected from the images on the second display surface 25d. Can be extracted.

  In addition, according to the present embodiment, since the other side can be visually recognized through the first display surface 13b, the object image can be displayed on the first display surface 13b with the scenery seen from the other side as the background. Then, the user can sensuously indicate a desired position of the object image according to the scenery while seeing the scenery on the other side of the first display surface 13b through the transparent portion of the first unit 10. Further, since the location of the room reflected in the background can be changed in real time according to the chair image simply by changing the orientation and position of the first display unit 13, the chair and the room can be easily compared.

Second Embodiment
The mobile terminal device 1 of the second embodiment is different from the mobile terminal device 1 of the first embodiment in that it further includes an open / close sensor 28. In addition, about the thing similar to the structure of 1st Embodiment among the structures of 2nd Embodiment, the same number is attached | subjected and the description is abbreviate | omitted.

  A magnet (not shown) is arranged in the first unit 10 shown in FIG. 1, and an open / close sensor 28 is arranged in the second unit 20. A magnet is arrange | positioned in the vicinity of the latching | locking part 12b, and the opening / closing sensor 28 is arrange | positioned in the position close | similar to a magnet in a 1st form. The open / close sensor 28 is connected to the CPU 23b of the substrate 23 by wiring (not shown).

The open / close sensor 28 is connected to the substrate 23 by wiring and transmits / receives a signal to / from the CPU 23b of the substrate 23. In the first embodiment, when the magnet is present in the vicinity of the open / close sensor 28, the open / close sensor 28 detects the magnetic field of the magnet and outputs a detection signal to the CPU 23b. On the other hand, when the magnet is separated from the open / close sensor 28 in the second embodiment, the open / close sensor 28 does not detect the magnetic field of the magnet and does not output a detection signal to the CPU 23b.

  FIG. 8 shows a block diagram of a circuit of the mobile terminal device 1.

  When the detection signal is input from the open / close sensor 28, the CPU 23b determines that the mobile terminal device 1 is in the first form. In the first mode, since the first input unit 14 is disposed on the second display surface 25d, the CPU 23b switches the first input unit 14 as an input unit for the second display surface 25d. Thereby, instead of the second input unit 24, the first input unit 14 detects an input to the second display unit 25. When the CPU 23b receives the position signal from the first input unit 14, the CPU 23b associates the position position indicated by the position signal with the image on the second display surface 25d and executes a predetermined process. When the image signal is generated by executing the processing, the CPU 23b outputs the image signal to the second display unit 25, and displays the image on the second display surface 25d.

  On the other hand, if no detection signal is input from the open / close sensor 28, the CPU 23b determines that the mobile terminal device 1 is in the second form. In the second mode, the CPU 23 b uses the first input unit 14 as an input unit for the first display unit 13 and the second input unit 24 as an input unit for the second display unit 25.

<Functions of mobile terminal device>
FIG. 9 is a flowchart illustrating a processing procedure for displaying an object extracted from the image displayed on the second display unit 25 on the first display unit 13. FIG. 10A shows the mobile terminal device 1 of the first form in which a web page is displayed on the second display surface 25d and the first display surface 13b is transparent. FIG.10 (b) shows the portable terminal device 1 of the 2nd form which displayed the image of the chair extracted from the web page of the 2nd display surface 25d on the 1st display surface 13b.

  In the present embodiment, the CPU 23b displays, on the first display surface 13b, an input screen for acquiring a desired image when it is determined that the mobile terminal device is in the first form based on a signal from the open / close sensor 28. Then, a position signal from the first input unit 14 is awaited.

  The user performs an operation of acquiring an image such as a web page with respect to the first input unit 14 exposed to the outside in the state of the first form. If the CPU 23b determines that an operation for obtaining an image has been performed based on the position signal from the first input unit 14 (S201: YES), the CPU 23b performs processing corresponding to the position signal from the first input unit 14 on the second display surface 25d. For example, as shown in FIG. 10A, a web page including an image of a chair is displayed on the second display surface 25d (S202). Here, the color information of the pixel of the image displayed on the second display surface 25d is associated with the position where the pixel is arranged, and is stored in the memory 23c as display content information. The CPU 23b controls the power supply from the battery 22 to be in an off state, and makes the first display unit 13 transparent.

  Since the user operates the first input unit 14 while viewing the second display surface 25d through the transparent first display surface 13b, the position signal from the first input unit 14 is derived from the input signal to the first display surface 13b. The input signal is switched to the second display surface 25d. Therefore, when the user touches the first display surface 13b and traces the outline of the chair image, the first input unit 14 detects a contact position and outputs a position number corresponding to the contact position to the CPU 23b. The CPU 23b receives the position signal from the first input unit 14, obtains an instructed position with respect to the second display surface 25d from the position signal, and further specifies a range instructed by the user based on the instructed position (S203).

  The CPU 23b extracts color information corresponding to the position of the designated range while referring to the position of the display content information in the memory 23c. Thereby, the color information of the pixel included in the designated range and the position where the pixel is arranged are extracted as the object image information of the chair and stored in the memory 23c (S204).

  Next, when the user slides the first unit 10 with respect to the second unit 20 to set the mobile terminal device 1 to the second form, the open / close sensor 28 does not output a detection signal to the CPU 23b. Therefore, the CPU 23b determines that the mobile phone has been switched to the second form by not receiving the detection signal from the open / close sensor 28 (S205: YES).

  The CPU 23b reads out the object image from the memory 23c, extracts the position of the color information of the object image, and converts this position into the position of the color information arranged on the first display surface 13b. The CPU 23b outputs the color information of the object image and the position of the color information on the first display surface 13b as an image signal to the first display unit 13. The 1st display part 13 displays the color according to color information in each position in the 1st display surface 13b, and displays the object image of a chair on the 1st display surface 13b (S206).

  At this time, as the first unit 10 is pulled out, the position signal from the first input unit 14 is returned from the input signal to the second display surface 25d to the input signal to the first display surface 13b. Further, the user can see the scenery beyond the first display surface 13b through the transparent first unit 10 in the background area other than the object image. Since there is a possibility that the arrangement of the object image may be changed in accordance with the scenery, the CPU 23b determines whether or not there is a position instruction from the user (S207).

  When the user touches the first display surface 13b and indicates the change position of the object image, the first input unit 14 outputs a signal corresponding to the contact position to the CPU 23b. The CPU 23b receives the position signal from the first input unit 14 and determines that the position of the object image has been instructed (S207: YES).

  The CPU 23b converts the position of the displayed object image to a position based on the designated position corresponding to the position signal, and displays the object image at the user designated position as shown in FIG. 7 (S210).

  As described above, according to the present embodiment, in the mobile terminal device 1 according to the first embodiment, the first input unit 14 detects an input to the second display surface 25d, thereby corresponding to the indicated position on the first display surface 13b. An image displayed at the position of the second display unit 25 is extracted as an object image. For this reason, an object image can be designated from the images on the second display surface 25d via the first display surface 13b.

<Other embodiments>
Although the embodiments of the present invention have been described above, the present invention is not limited to the above-described embodiments, and various modifications other than those described above can be made to the embodiments of the present invention. .

  For example, in the above-described embodiment, when the user designates a range on the second display surface 25d, the image displayed in the designated range is specified as the object image. On the other hand, it is also possible to use an image recognition program that identifies a background image and an object image by using features such as color continuity and distribution with respect to a position change, and identifies the object image.

In the above embodiment, the user can also extract a plurality of object images from the images displayed on the second display surface 25d in advance and store them in the memory. In this case, when all the object images have been extracted, as shown in FIG. 11, these object images are displayed as thumbnails on the second display surface 25d. Then, the user instructs the position where the object image is arranged on the first display surface 13b. Thereafter, when the user designates the first object image by touching the first object image from the plurality of objects displayed as thumbnails, the first object image is displayed at the arrangement position of the first display surface 13b. . Next, if a second object image is designated from among a plurality of object images, the second object image is displayed instead of the first object image at the arrangement position. With such a configuration, the object images can be changed one after another without trouble.

  Furthermore, in the above embodiment, the CPU 23b may change the size of the object image displayed on the first display surface 13b based on a predetermined operation. Thereby, the size of the object image can be adjusted according to the scenery of the room seen through the first display surface 13b.

  Further, in the above embodiment, the first unit 10 is arranged so as to be linearly movable with respect to the second unit 20, but the first unit 10 is arranged around a predetermined axis perpendicular to the display surface. You may arrange | position with respect to the 2nd unit 20 so that it may rotate. Moreover, the portable terminal device 1 may be a foldable type. That is, the first unit 10 may be arranged with respect to the second unit 20 so as to rotate around a predetermined axis parallel to the display surface.

  In the above embodiment, when there is an incoming call such as a call while the image capture function is used, the CPU 23b displays a message for notifying the incoming call, a response to the incoming call, and a button for rejecting the call on the display units 13 and 25. It can also be displayed. At this time, the information regarding the image capture function is stored and then set to the hold state. When the user touches the display position of the response button, the telephone line is connected and a telephone call can be made. On the other hand, when the user touches the display position of the reject button, the telephone line is disconnected. When the call line is disconnected due to termination of the call or rejection of the response, the hold of the image capture function is released, and information related to this function is read and the state before the hold is restored. The message includes an incoming call, a telephone number or name of a caller such as a telephone. The name of the sender is obtained based on the contact information stored in association with the telephone number and the name.

  Furthermore, in the above embodiment, a positioning unit can be provided. The positioning unit receives a signal from a GPS satellite, a signal from a base station in the communication area, etc., obtains a position from this signal, and outputs a signal corresponding to the position to the CPU 23b. For example, when the image capture function is suspended, the CPU 23b acquires the position of the mobile terminal device 1 from the positioning unit and stores it in the memory 23c. When canceling the hold state, the CPU 23b obtains the position of the mobile terminal device 1 again and compares it with the position at the time of the hold. If these positions are larger than the predetermined threshold, it is considered that the user has moved from one place such as a room where the image capture function is used to another place and the use of this function has ended. This function is then terminated. This saves the trouble of ending this function.

In the above embodiment, each of the display surfaces 13b and 25d is touched, and each of the input units 14 and 24 detects the input to operate the mobile terminal device 1. Can also be provided. For example, when a user presses an operation key, the user can respond to an incoming call or end a call.
In addition, the embodiment of the present invention can be variously modified as appropriate within the scope of the technical idea shown in the claims.

DESCRIPTION OF SYMBOLS 1 ... Portable terminal device 10 ... 1st unit 13 ... 1st display part 14 ... 1st input part 20 ... 2nd unit 24 ... 2nd input part 25 ... 2nd display part 23b ... CPU

Claims (6)

In a mobile terminal device,
A display unit;
An extraction unit that extracts an object image instructed by the user from the original image;
A display control unit for controlling the display unit,
The display unit includes a first display area that can be set in a see-through state that transmits light forward from behind, and a second display area that is not set in the see-through state,
When the first display area is set to a see-through state, the mobile terminal device can view a landscape behind the device body through the first display area ,
The display control unit displays the object image in the first display area in response to an instruction to move the object image displayed in the second display area to the first display area. , Setting the display area other than the object image of the first display area to the see-through state,
The portable terminal device characterized by the above-mentioned. The mobile terminal device according to claim 1,
A position detection unit that detects a position indicated on the display unit;
The display control unit displays the object image at a position detected by the position detection unit;
The portable terminal device characterized by the above-mentioned. The mobile terminal device according to claim 1 or 2,
A range detecting unit for detecting a specified range in the original image;
The extraction unit extracts an image of a range detected by the range detection unit as the object image;
The portable terminal device characterized by the above-mentioned. In the portable terminal device according to any one of claims 1 to 3,
A first unit;
A first position overlapping the first unit and a second unit movable to a second position next to the first unit;
The first display area is set in the first unit;
The second display area is set in the second unit;
The portable terminal device characterized by the above-mentioned. The mobile terminal device according to claim 4 ,
The display control unit displays a selection candidate of the object image in the second display area in a state where the second unit is positioned at the second position, and the predetermined object image is displayed from the displayed selection candidate. Is selected and moved to the first display area, the object image is displayed in the first display area, and a display area other than the object image in the first display area is displayed. Set to the see-through state,
The portable terminal device characterized by the above-mentioned. The mobile terminal device according to claim 4 ,
The display control unit displays the object image selection candidates in the second display area in a state where the second unit is positioned at the first position, and sets the first display area to the see-through state. After the instruction for selecting the predetermined object image from the displayed selection candidates is input, the object image is displayed in the first display area in response to the second unit being positioned at the second position. And displaying the display area other than the object image of the first display area in the see-through state.
The portable terminal device characterized by the above-mentioned.

Images