JP5694268B2 - Portable information processing device - Google Patents

Description

  The present invention relates to a portable information processing apparatus.

  In recent years, portable information processing apparatuses such as mobile phones, smartphones, notebook PCs, and tablet PCs have built-in cameras. In such a portable information processing apparatus, an image taken by a camera can be displayed on a built-in display. Here, the image displayed on the display is a color characteristic that is a combination of the color characteristic of the camera and the color characteristic of the display, and thus may not be an image having a color characteristic desired by the user.

  For example, it is desired that a captured image is displayed in a color as natural as possible. A white balance adjustment circuit is added to the camera. In this white balance adjustment circuit, when a white object illuminated with a light source having a certain color temperature is imaged, adjustment is performed so that R: G: B = 1: 1: 1. However, in the conventional white balance adjustment circuit, it is normally adjusted only for certain input light, and when the input light is too dark, it is adjusted to be bluish, or, for example, one of the angles of view of the camera. If there is a strong light source in the area and the input light is too bright, it may be adjusted reddish. On the other hand, recently, techniques using an LCD display device as a mirror have been proposed (see, for example, Patent Documents 1 and 2 and Non-Patent Document 1).

JP 2005-52086 A JP 2005-321717 A

http://download.p4c.philips.com/files/4/42pm8822_10/42pm8822_10_pss_eng.pdf

  The present invention has been made in view of the above problems, and is capable of displaying an image having color characteristics desired by an operator when an image captured by a camera is displayed on a display unit. The purpose is to provide.

  In order to solve the above-described problems and achieve the object, the present invention provides a display unit, a mirror surface that can be formed on the display surface side of the display unit, a camera that can be disposed on the display surface side of the display unit, A user interface for setting a color characteristic of an image captured by the camera and displayed on the display unit; and an adjusting unit that adjusts the color characteristic of the image based on the color characteristic set by the user interface; , Provided.

  According to a preferred aspect of the present invention, it is desirable that the color characteristic is white balance.

  Moreover, according to a preferable aspect of the present invention, it is desirable that the mirror surface is formed on a part of the display unit in a pseudo manner.

  According to a preferred aspect of the present invention, it is desirable that the mirror surface is a mirror surface of a mirror.

  Moreover, according to the preferable aspect of this invention, it is desirable that the said portable information processing apparatus is a smart phone.

  ADVANTAGE OF THE INVENTION According to this invention, when displaying the image image | photographed with the camera on a display part, it becomes possible to provide the portable information processing apparatus which can display the image of an operator's favorite color characteristic.

FIG. 1 is a perspective view showing an appearance of a mobile phone terminal according to the present embodiment. FIG. 2 is a rear view showing the appearance of the mobile phone terminal according to the present embodiment. FIG. 3 is a schematic A-A ′ sectional view of FIG. 1. FIG. 4 is a schematic diagram for explaining the normal mode of the mirror surface forming unit. FIG. 5 is a schematic diagram for explaining the mirror surface mode of the mirror surface forming unit. FIG. 6 is a block diagram showing the configuration of the mobile phone terminal according to the present embodiment. FIG. 7 is a diagram for explaining the color characteristic adjustment mode. FIG. 8 is a diagram for explaining the normal display mode. FIG. 9 is a perspective view illustrating an appearance of a mobile phone terminal according to the first modification. FIG. 10 is a schematic A-A ′ sectional view of FIG. 9. FIG. 11 is a perspective view showing an appearance of a mobile phone terminal according to the second modification.

  Hereinafter, an embodiment of the portable information processing apparatus according to the present embodiment will be described. Although the components of the present invention are generally illustrated in the drawings herein, it can be readily understood that they may be arranged and designed in a wide variety of configurations with various configurations. Accordingly, the following more detailed description of the apparatus, method and program embodiments of the present invention is not intended to limit the scope of the invention as set forth in the appended claims, but merely to implement selected embodiments of the invention. It is intended as an example only, and is merely illustrative of selected embodiments of an apparatus, system and method consistent with the present invention as set forth in the claims herein. Those skilled in the art will appreciate that the present invention may be practiced without one or more of the specific details or with other methods, components, or materials.

(Embodiment)
An external configuration of the cellular phone terminal 1 that is an embodiment of the portable information processing apparatus will be described. In this embodiment, a smartphone will be described as an example of a mobile phone terminal. FIG. 1 is a perspective view showing an appearance of the mobile phone terminal 1. FIG. 2 is a rear view showing the appearance of the mobile phone terminal. FIG. 3 is a schematic AA ′ sectional view of FIG. 1. FIG. 4 is a schematic diagram for explaining the normal mode of the mirror surface forming unit. FIG. 5 is a schematic diagram for explaining the mirror surface mode of the mirror surface forming unit.

  As shown in FIGS. 1 to 3, the mobile phone terminal 1 includes a substantially hexahedral-shaped housing 2. One surface of the surface of the housing 2 is the front surface 2A, the other surface facing the front surface 2A is the back surface 2C, and the surface of the housing 2 sandwiched between the front surface 2A and the back surface 2C is the side surface 2B. . The cellular phone terminal 1 includes a touch display unit 3 including a touch panel 3A, a mirror surface forming unit 3B, a spacer 3C, and a display unit 3D, an operation unit 4, a microphone 5, and a first surface on a front surface 2A of the housing 2. A camera 6A and a speaker 7 are arranged. A second camera 6B is disposed on the back surface 2C of the housing 2. On the side surface 2B of the housing 2, a power button, a volume adjustment button, etc. (not shown) are arranged.

  The touch display unit 3 is disposed over substantially the entire center of the front surface 2A. The operation unit 4 and the microphone 5 are arranged at one end in the longitudinal direction of the front surface 2A. The first camera 6A and the speaker 7 are disposed at the other end in the longitudinal direction of the front surface 2A. The second camera 6B is disposed at one end of the back surface 2C in the longitudinal direction. That is, the first camera 6A can shoot from the front 2A side (including self-portrait), and the second camera 6B can shoot from the back 2C side.

  The touch display unit 3 displays information such as characters, graphics, and images, and detects various operations performed on the touch panel 3A using a finger, stylus, pen, or the like (hereinafter referred to as “indicator”). . As a method of detecting various operations by the touch panel 3A, a capacitance type, a pressure sensitive type, or the like can be adopted. As shown in FIG. 3, the touch display unit 3 includes a display unit 3D that displays characters, figures, images, and the like, a mirror surface forming unit 3B and a transparent spacer 3C that are arranged on the display unit 3D, and a mirror surface forming unit. 3B and the touch panel 3A disposed on the spacer 3C. The mirror surface forming portion 3B and the spacer 3C have substantially the same size, and the mirror surface forming portion 3B covers a substantially half rectangular area of the display portion 3D.

  The mirror surface forming portion 3B has a configuration capable of forming a mirror surface (reflection surface) in a pseudo manner. As shown in FIG. 4, the mirror surface forming unit 3 </ b> B transmits light from the display unit 3 </ b> D and displays information on the entire surface of the touch display unit 3 in the normal mode. In addition, as shown in FIG. 5, the mirror surface forming unit 3B blocks the light from the display unit 3D and reflects external light to form a mirror surface in the mirror surface mode. Thereby, in the mirror surface mode, information is displayed in the region 3E1 (half surface) of the touch display unit 3, and the remaining region 3E2 (half surface) forms a mirror surface and can be used as a mirror.

  For example, the mirror surface forming unit 3B is configured to reflect a polarized light component in a direction other than the transmission axis (polarization axis) direction, and selectively apply a voltage with an electrode to selectively pass light. It can be composed of a liquid crystal layer that exhibits a state in which the polarization axis is rotated and a state in which the polarization axis is not rotated, a polarizing plate, and the like. As the configuration of the mirror surface forming portion 3B, a known configuration can be adopted. For example, the mirror surface forming method described in Patent Document 1 or Patent Document 2 can be used, and thus detailed description thereof is omitted. .

  The operation unit 4 includes a plurality of buttons such as a button 4A and a button 4B to which a predetermined function is assigned.

  Images taken by the first and second cameras 6A and 6B can be displayed on the display unit 3D. The image displayed on the display unit 3D is a color characteristic that is a combination of the color characteristics of the first and second cameras 6A and 6B (including a camera processing unit 15 described later) and the color characteristic of the display unit 3D. In some cases, the image does not have the color characteristics that the user likes. Therefore, in the present embodiment, in the color characteristic adjustment mode described later, a subject is formed by forming a mirror surface in the region 3E2 of the touch display unit 3, and the subject is photographed by the first camera 6A in the region 3E1 of the touch display unit 3. An image is displayed, and the operator can adjust the color characteristics of the displayed image of the subject while viewing the subject reflected on the mirror surface.

  FIG. 6 is a block diagram showing a configuration of the mobile phone terminal 1. As shown in FIG. 6, the mobile phone terminal 1 includes a control unit 10, a memory 11, a storage unit 12, a communication unit 13, a camera processing unit 15, and a touch display unit 3 (touch panel 3A, mirror surface forming unit 3B). , Display unit 3D), operation unit 4, microphone 5, first camera 6A, second camera 6B, and speaker 7.

  The touch display unit 3 includes a display unit 3D, a mirror surface forming unit 3B superimposed on the display unit 3D, and a touch panel 3A superimposed on the mirror surface forming unit 3B. The touch panel 3A detects various operations performed on the touch panel 3A using an indicator such as a finger or a pen together with a position on the touch panel 3A where the operation is performed, and notifies the control unit 10 of the detected operation. The operations detected by the touch panel 3A include a touch operation, a slide operation, and a pitch operation. The mirror surface forming unit 3B is controlled by the control unit 10 to switch between the normal mode and the mirror surface mode. The display unit 3D includes, for example, a liquid crystal display (LCD), an organic EL (Organic Electro-Luminescence) panel, and the like, and displays characters, graphics, and the like.

  The operation unit 4 receives a user's operation through the buttons 4A, 4B and the like, and transmits an instruction signal corresponding to the received operation to the control unit 10. The button 4A is a button for switching between the color characteristic adjustment mode and the normal display mode. In the color characteristic adjustment mode, a mirror surface is formed in the area 3E2 of the touch display unit 3, the image of the subject photographed by the first camera 6A is displayed in the area 3E1 of the touch display unit 3, and the color of the displayed subject image This is a mode for adjusting the characteristics (in this case, the mirror surface forming unit 3B is in the mirror surface mode). The normal display mode is a normal mode in which an image of a subject photographed by the first camera 6A is displayed on the entire surface of the touch display unit 3 (in this case, the mirror surface forming unit 3B is in the normal mode).

  The power supply unit 14 supplies power obtained from the storage battery or the AC adapter to each unit of the mobile phone terminal 1 including the control unit 10 according to the control of the control unit 10.

  The first and second cameras 6A and 6B each include a lens and an imaging unit. The lens 31 forms an image of subject light. The imaging unit 32 includes an imaging element such as a CCD (Charge Coupled Device) or CMOS (Complementary Metal-Oxide Semiconductor), an RGB color filter, and the like, and R, G, and B images of subject light captured by the lens. The signal is output to the camera processing unit 15 as a signal.

  The camera processing unit 15 has an AE function, an AWB function, and the like, and includes an A / D converter, an image processing LSI, a memory, and the like, performs drive timing of the image sensor, exposure control, and the like. Various signal processing is performed on the RGB image signals obtained by the second cameras 6A and 6B. Specifically, the camera processing unit 15 performs color characteristic adjustment processing on the RGB image signal according to the color characteristic parameters set by the control unit 10. For example, the camera processing unit 15 performs white balance adjustment on the RGB image signal in accordance with the white balance adjustment parameter set by the control unit 10.

  The communication unit 13 establishes a radio signal line with the base station via a channel assigned by the base station, and performs telephone communication and information communication with the base station. The speaker 7 outputs the sound signal transmitted from the control unit 10 as sound. The microphone 5 converts the voice of the user or the like into a voice signal and outputs it to the control unit 10.

  The memory 11 is composed of, for example, a RAM, a DRAM, or the like, and serves as a work area for temporarily storing a program executed by the control unit 10, data referred to by the control unit 10, calculation results of the control unit 10, and the like. used.

  The storage unit 12 is, for example, a nonvolatile memory or a magnetic storage device, and stores programs and data used for processing in the control unit 10. The program stored in the storage unit 12 includes an OS that realizes the basic functions of the mobile phone terminal 1, a device driver that controls the hardware of the device, and a mail that provides a function for realizing an e-mail function. A program, a browser program that provides a function for realizing a WEB browsing function, a color characteristic adjustment program for executing a color characteristic adjustment mode, and the like are included.

  The control unit 10 is, for example, a CPU (Central Processing Unit), a microprocessor, a DSP, and the like, and implements various functions (modes) by comprehensively controlling the operation of the mobile phone terminal 1. Specifically, the control unit 10 executes instructions included in the program stored in the storage unit 9 while referring to the data stored in the storage unit 9 and the data expanded in the RAM 11 as necessary. Various functions (modes) are realized by controlling the touch display unit 3, the communication unit 13, the camera processing unit 15, and the like. Note that the program executed by the control unit 10 and the data to be referenced may be downloaded from the server device by wireless communication by the communication unit 13.

  Next, the color characteristic adjustment mode executed by the control unit 10 will be described. FIG. 7 is a diagram for explaining the color characteristic adjustment mode. FIG. 8 is a diagram for explaining the normal display mode. When the button 4A is operated and the color characteristic adjustment mode is selected, the control unit 10 executes the color characteristic adjustment mode by executing the color characteristic adjustment program stored in the storage unit 12. Here, a case where the operator photographs his / her face as a subject will be described, but the subject is not limited to this.

  In the color characteristic adjustment mode, the control unit 10 sets the mirror surface forming unit 3B of the touch display unit 3 to the mirror surface mode to form a mirror surface, and also captures an image captured by the first camera 6A on the touch display unit 3 (display unit 3D). Displayed in area 3E1. Further, the control unit 10 displays a bar 9 that is a UI for white balance adjustment in the region 3E1. In the bar 9, the operator can move the button 9A to adjust the white balance. When the button 9A is moved to the left, a warm white (orange) white balance is obtained, and when the button 9A is moved to the right, a cold (blue) white balance is obtained.

  The operator adjusts the angle of the mobile phone terminal 1 and his / her position so that his / her face falls within the imaging range of the first camera 6A and his / her face is reflected in the area 3E2 (mirror surface). FIG. 7 shows a state where his / her face is displayed in the area 3E1 and his / her face is shown in the area 3E2. The operator operates the bar 9A in order to compare his own image displayed in the area 3E1 with his own image displayed in the area 3E2 and to display a white balance image suitable for his / her preference. The control unit 10 sets white balance adjustment parameters in the camera processing unit 15 according to the position of the bar 9A. Thereafter, the camera processing unit 15 performs white balance adjustment on the captured image based on the white balance adjustment parameters set by the control unit 10. As a result, the captured image that has been subjected to white balance adjustment is displayed in the region 3E1. Thereby, the operator can adjust the displayed image to a white balance that suits his / her preference.

  For example, after the operator adjusts the display of the captured image to the white balance that suits his / her preference, the operator cancels the color characteristic adjustment mode and selects the normal display mode, as shown in FIG. It is conceivable that the captured image is displayed on the entire surface of 3 and makeup is applied while looking at the image displayed on the touch display unit 3 instead of the mirror.

  Although the white balance is adjusted as the color characteristic here, the gamma, hue, saturation, brightness, etc. of the image may be adjusted. In addition, although the camera processing unit 15 adjusts the white balance of the captured image, the display unit 3D may perform white balance adjustment. In addition, the first camera 6A and the second camera 6B are provided on the front 2A side and the back 2C side. However, one camera is provided so as to be rotatable with respect to the housing 2, and the front side and the back are provided by one camera. It is good also as a structure which can image | photograph from the side. Moreover, you may decide to arrange | position a half mirror instead of the mirror surface formation part 3B.

  As described above, according to the present embodiment, the touch display unit 3, the mirror surface that can be formed on the display surface side of the touch display unit 3, and the first camera that can be disposed on the display surface side of the touch display unit 3. 6A, the user interface (bar 9) for setting the color characteristics of the image captured by the first camera 6A and displayed on the touch display unit 3, and the color of the image according to the color characteristics set in the user interface Since the camera processing unit 15 for adjusting the characteristics is provided, when an image captured by the camera is displayed on the display unit, it is possible to display an image having a color characteristic desired by the operator.

  Further, since the white balance is adjusted as the color characteristic, the white balance desired by the operator can be obtained.

  Further, since the mirror surface is artificially formed on a part of the touch display unit 3 by the mirror surface forming unit 3B, the mirror surface can be formed on a part of the display screen and a large display area is secured. Is possible.

(Modification 1)
In the above-described embodiment, the mirror surface forming unit 3B artificially forms a mirror surface. However, a mirror may be arranged to configure the mirror surface. 9 and 10 describe the external configuration of the mobile phone terminal 1 according to the first modification. FIG. 1 is a perspective view showing an appearance of a mobile phone terminal according to the first modification. FIG. 10 is a schematic AA ′ sectional view of FIG. 9.

  As shown in FIGS. 9 and 10, in the touch display unit 3, a mirror 20 is provided instead of the mirror surface forming unit 3B, and the size of the display unit 3D is half that of the case shown in FIGS. You may decide to make it big. In this case, although the display area is narrowed, the mirror 20 is arranged instead of the mirror surface forming unit 3B, so that a low-cost configuration can be achieved.

(Modification 2)
In the above embodiment, a smartphone has been described as an example of a mobile phone terminal, but a foldable mobile phone terminal may be used. In this case, as in the above-described embodiment, the above-described mirror surface forming unit 3B may be formed in a part of the display area, but a mirror is formed in the casing on the side where the operation unit is arranged. Good.

  FIG. 11 is a diagram illustrating an appearance of a mobile phone terminal according to the second modification. The mobile phone terminal 100 is a foldable mobile phone, and includes a display unit side body 101 and an operation unit side body 102, both of which are substantially rectangular parallelepipeds. The display unit side body 101 and the operation unit side body 102 are connected to each other by a connecting part (hinge part) 103 at each end, and the connecting part 103 supports these cases so that they can be opened and closed. . The display unit side body 101 includes a display unit 104, a camera 105 that is arranged at a substantially upper center on the display surface side of the display unit 104, and that can capture a subject in front, a speaker (not shown), and the like. The operation unit side body 102 includes a mirror 106 above it, an operation unit 107 disposed below the mirror 106, a microphone (not shown), and the like.

  An operator displays his / her face on the display unit 104 while shooting his / her face on the mirror 106 while the display unit side housing 101 of the mobile phone terminal 100 is opened. To do. Then, the operator operates the white balance adjustment bar 9 to adjust the white balance of the image displayed on the display unit 104 as described above.

  In the above embodiment, a mobile phone terminal has been described. However, the present invention is not limited to this, and a tablet PC, notebook PC, PHS (Personal Handy-phone System), PDA (Personal Digital Assistant), portable The present invention can also be applied to other portable information processing devices such as navigation devices and game machines.

  As described above, the portable information processing device according to the present invention can be widely used for a portable information processing device including a camera and a display unit.

DESCRIPTION OF SYMBOLS 1 Mobile phone terminal 2 Housing | casing 3 Touch display part 3A Touch panel 3B Mirror surface formation part 3C Spacer 3D Display part 4 Operation part 5 Microphone 6A 1st camera 6B 2nd camera 7 Speaker 9 User interface (UI)
DESCRIPTION OF SYMBOLS 10 Control part 11 Memory 12 Storage part 13 Communication part 14 Power supply part 15 Camera processing part 20 Mirror 100 Mobile phone terminal 101 Display part side housing | casing 102 Operation part side housing | casing 103 Connection part (hinge part)
104 Display unit 105 Camera 106 Mirror 107 Operation unit

Claims (5)

A display unit;
A mirror surface forming unit that is disposed on the display surface side of the display unit and covers a partial region of the display unit;
A camera that can be arranged on the display surface side of the display unit;
A user interface for setting color characteristics of an image captured by the camera and displayed on the display unit;
Adjusting means for adjusting the color characteristics of the image based on the color characteristics set in the user interface;
Equipped with a,
In the first mode, an image of a subject photographed by the camera is displayed on the entire surface of the display unit, and the mirror surface forming unit transmits light from the display unit,
In the second mode, an image of the subject photographed by the camera is displayed in an area not covered by the mirror surface forming unit of the display unit, and the mirror surface forming unit blocks light from the display unit, A portable information processing apparatus that reflects external light to form a mirror surface .   The portable information processing apparatus according to claim 1, wherein the color characteristic is white balance. The portable information processing apparatus according to claim 1, wherein the color characteristic is gamma, hue, saturation, or brightness.   4. The portable information processing apparatus according to claim 1, wherein the partial area of the display unit is a substantially half area of the display unit. 5.   The portable information processing apparatus according to any one of claims 1 to 4, wherein the portable information processing apparatus is a smartphone.

Images