JP6329373B2 - Electronic device and program for controlling electronic device - Google Patents

Description

  The present disclosure relates to control of an electronic device, and more particularly to control of an electronic device having a shooting function and a touch operation function.

  Smartphones, tablet terminals, and other portable electronic devices have a shooting function and a touch operation function. When the camera is arranged on the display device side as a so-called in-camera, the user of the electronic device can perform a so-called self-photographing called a self-portrait.

  For example, Non-Patent Document 1 discloses a technique capable of photographing a user of a display device by touching a shutter icon displayed on the display device as an image representing a shutter using an in-camera disposed on the display device side. (See page 51).

AQUOS PHONE ZETA SH-01F Instruction Manual, '13 .10

  When the user takes a selfie, the user performs a touch operation while looking at the shutter icon. For this reason, when the display device and the in-camera are separated from each other, shooting is performed in a state where the user's line of sight does not look at the camera. Therefore, there is a need for a technique that allows a user who is looking straight ahead to take a selfie.

  This indication is made in order to solve the above problems, and the objective in a certain situation is to provide the electronic device which can perform self-taking in the state where the user looked straight.

  An object in another aspect is to provide a program for controlling an electronic device so that a user can take a self-portrait while looking straight ahead.

  An electronic device according to an embodiment includes a display device having a touch panel that receives an instruction input in a non-contact state, a camera disposed on a display surface side of the display device, and a control device for controlling the electronic device. The control device displays a monitor image from the camera on the display device, displays a guidance image for guiding the user's line of sight of the electronic device to the camera, and displays the guidance image on the camera based on a photographing instruction to the electronic device. Let's take an image.

Preferably, the guidance image includes an image indicating a direction in which the camera is arranged.
Preferably, displaying the guidance image on the display device includes displaying a shutter image for accepting a photographing instruction and moving the shutter image in the direction of the camera.

  Preferably, the display device displays the guidance image when the interval between the means for giving a photographing instruction to the electronic device and the display device is equal to or smaller than a predetermined interval.

  According to another embodiment, a program for controlling an electronic device is provided. The electronic device includes a display device having a touch panel that receives an instruction input in a non-contact state, a camera disposed on the display surface side of the display device, and a processor for controlling the electronic device. The program includes a step of displaying a monitor image from the camera on the display device on the processor, a step of displaying a guide image for guiding the user's line of sight of the user of the electronic device to the camera, and a photographing instruction to the electronic device And causing the camera to take an image based on

  In one aspect, the electronic device can take a selfie while the user is looking straight ahead.

  The above and other objects, features, aspects and advantages of the present invention will become apparent from the following detailed description of the present invention taken in conjunction with the accompanying drawings.

It is a block diagram showing the outline of the structure of the electronic device 100 which concerns on 1st Embodiment. It is a flowchart showing a part of process which CPU141 performs in order to perform a self-portrait. It is a figure showing transition of a screen in display 151. It is a flowchart showing a part of process which CPU141 of the electronic device 100 which concerns on 2nd Embodiment performs. 14 is a flowchart illustrating a part of processing executed by CPU 141 of electronic device 100 according to the third embodiment. It is a figure showing the transition of the screen in the display apparatus 151 of the electronic device 100 which concerns on 3rd Embodiment.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings. In the following description, the same parts are denoted by the same reference numerals. Their names and functions are also the same. Therefore, detailed description thereof will not be repeated.

<First Embodiment>
[Constitution]
A first embodiment of the present invention will be described with reference to FIG. FIG. 1 is a block diagram illustrating an outline of a configuration of an electronic device 100 according to the first embodiment. For example, the electronic device 100 is a mobile phone, a smartphone, a tablet terminal, a notebook computer, or other electronic device, and is a device having a photographing function and a touch operation function.

  The electronic device 100 includes an input unit 110, a camera 120, a storage unit 130, a control unit 140, and a display unit 150. The input unit 110 includes a touch panel 111 and keys 112. The control unit 140 includes a CPU 141, a memory 142, and a program 143. The program 143 includes a non-contact position information determination unit 144 and a contact position information determination unit 145. The display unit 150 includes a display device 151.

  The touch panel 111 has a so-called hover function. The hover function is a function that can be accepted as a touch operation on the area before the screen of the display device 151 is touched. The key 112 includes a power button and other hard switches provided on the casing of the electronic device 100.

  The camera 120 includes a lens, a complementary metal-oxide semiconductor (CMOS) or other image sensor, and an autofocus mechanism.

The storage unit 130 includes a built-in storage device and a removable memory card.
The CPU 141 executes a command for controlling the operation of the electronic device 100. The instruction is incorporated in a program stored in the storage unit 130 or the memory 142, the program 143, or the like.

  The memory 142 is realized by a RAM (Random Access Memory), a ROM (Read-Only Memory), or the like.

  The program 143 is installed in the control unit 140 by the manufacturer of the electronic device 100 or installed by a user who has downloaded the program 143 from the manufacturer or other providers. When the program 143 is executed, the control unit 140 functions as a non-contact position information determination unit 144 and a contact position information determination unit 145.

  The non-contact position information determination unit 144 realizes a so-called hover function. More specifically, the member is a display device until the distance between the display device 151 and a means for giving a command to the electronic device 100, such as a user's finger, a stylus pen, or the like, becomes a predetermined interval. When approaching 151, the non-contact position information determination unit 144 determines that a command for the electronic device 100 is given by the member. Note that the distance between the electronic device 100 and the member to be detected as an instruction input to the electronic device 100 is defined by the specification of the display device 151.

  The contact position information determination unit 145 detects a touch operation on an image (icon) displayed on the display device 151 and executes a command to the electronic device 100 based on the position where the touch operation is detected.

  In one aspect, the CPU 141 displays a monitor image from the camera 120 on the display device 151, and displays a guidance image for guiding the user's line of sight of the user of the electronic device 100 to the camera 120, to the electronic device 100. Based on the shooting instruction, the camera 120 is caused to take an image.

[Control structure]
With reference to FIG. 2, a control structure of electronic device 100 will be described. FIG. 2 is a flowchart showing a part of the process executed by CPU 141 for taking a self-portrait. The processing is realized by the CPU 141 executing one or more instructions included in the program. In other aspects, all or part of the processing may be realized by circuit elements or other hardware.

  In step S <b> 210, based on the signal from touch panel 111, CPU 141 uses non-contact position information determination unit 144 to determine whether or not there is a non-contact reaction in the shutter icon area. The shutter icon area refers to an area in which a shutter image for the electronic device 100 to accept a shooting instruction is displayed on the display device 151. When the hover function of the electronic device 100 is valid, the CPU 141 determines that a non-contact reaction has occurred when the distance between the user's finger or other pointing member and the display device 151 is equal to or smaller than a predetermined distance. If there is a non-contact reaction (YES in step S210), CPU 141 switches control to step S220. If not (NO in step S210), CPU 141 switches control to step S250.

In step S220, CPU 141 displays a line-of-sight guidance arrow on display device 151.
In step S230, CPU 141 uses contact position information determination unit 145 based on the signal from touch panel 111 to determine whether or not there is a contact reaction in the shutter icon area. More specifically, the CPU 141 determines whether or not a touch operation on the shutter icon displayed on the display device 151, that is, an imaging instruction is input. When CPU 141 determines that a contact reaction has occurred (YES in step S230), control is switched to step S240. If not (NO in step S230), CPU 141 returns control to step S210.

In step S240, CPU 141 executes a photographing process using camera 120.
In step S250, CPU 141 maintains the current state of electronic device 100 without displaying the line-of-sight guidance arrow on display device 151.

[Operation]
With reference to FIG. 3, the operation of the electronic device 100 will be described. FIG. 3 is a diagram illustrating an example of screen transition in the display device 151.

  As shown in the state (A), the display device 151 displays an icon 310 for starting an application that executes the self-portrait process on the display surface 152. At this time, when the finger 320 of the user of the electronic device 100 touches the icon 310 displayed on the display surface 152, the electronic device 100 activates an application for selfie as shown in the state (B). Then, the operation mode is switched to the selfie mode.

  In the state (B), the electronic device 100 displays the user image and the shutter icon 331. In the user's image, the line of sight 330 faces downward. This is because the user is looking at the shutter icon 331 displayed on the display device 151. At this time, the distance between the user's finger 320 and the display surface 152 is such that the hover function does not work.

  Thereafter, as shown in the state (C), when the user brings the finger 320 close to the display surface 152, the electronic device 100 uses the non-contact position information determination unit 144 to bring the finger 320 close to the shutter icon 331. Detect that In response to the detection, electronic device 100 displays a line-of-sight guidance arrow 340 for guiding the user's line of sight to camera 120.

  As shown in the state (D), the line of sight 350 of the user who has seen the line-of-sight guidance arrow 340 faces the front rather than the line of sight 330 in the state (B). In this state, the user performs shooting by touching the shutter icon 331. Thereby, self-portrait is realized.

  As described above, electronic device 100 according to the present embodiment displays line-of-sight guidance arrow 340. Since the line of sight of the user who has recognized the line-of-sight guidance arrow 340 faces the front, the electronic device 100 can obtain a normal image of the user by photographing in that state.

<Second Embodiment>
Hereinafter, a second embodiment will be described. The electronic device 100 according to the second embodiment differs from the electronic device 100 according to the first embodiment in that when the electronic device 100 has a hover function, the hover function can be a trigger for executing a shooting operation. . That is, electronic device 100 according to the second embodiment performs a shooting operation in response to the presence of a finger in the vicinity of electronic device 100 without the user performing a touch operation.

  The hardware configuration of the electronic device 100 according to the second embodiment is the same as the configuration shown in FIG. Therefore, the description of the hardware configuration will not be repeated.

[Control structure]
A control structure of electronic device 100 according to the second embodiment will be described with reference to FIG. FIG. 4 is a flowchart showing a part of the process executed by CPU 141 of electronic device 100 according to the second embodiment. Also, the same step numbers are assigned to the same processes as those in the flowchart shown in FIG. Therefore, description of similar processing will not be repeated.

  In step S230, CPU 141 determines whether or not a contact reaction has occurred in the shutter icon area based on a signal from touch panel 111. When CPU 141 determines that a contact reaction has occurred (YES in step S230), control is switched to step S240. If not (NO in step S230), CPU 141 switches control to step S410.

  In step S410, CPU 141 determines whether or not a predetermined time has elapsed since the non-contact reaction was detected. The certain time is a time defined by the specification of the display device 151 of the electronic device 100 or a time that can be set by the manufacturer or the user of the electronic device 100. When CPU 141 determines that the predetermined time has elapsed (YES in step S410), CPU 141 switches control to step S240. If not (NO in step S410), CPU 141 returns control to step S210.

  As described above, electronic device 100 according to the second embodiment can execute a shooting operation using the hover function even when the touch operation on the shutter icon is not performed. Since the user can take an image without touching the display device 151 with his / her finger, the movement of the line of sight is suppressed, and a normally viewed image can be obtained.

<Third Embodiment>
The third embodiment will be described below. The electronic device 100 according to the third embodiment is different from the electronic device 100 according to the first or second embodiment in that it has a function of moving a shutter icon. Note that the electronic device 100 according to the third embodiment is realized by using the hardware configuration of the electronic device 100 according to the first embodiment. Therefore, the description of the hardware configuration will not be repeated.

[Control structure]
A control structure of electronic device 100 according to the third embodiment will be described with reference to FIG. FIG. 5 is a flowchart illustrating a part of the process executed by CPU 141 of electronic device 100 according to the third embodiment. In addition, the same step number is attached | subjected to the process similar to the process of the electronic device 100 which concerns on the above-mentioned embodiment. Therefore, description of similar processing will not be repeated.

  In step S <b> 210, based on the signal from touch panel 111, CPU 141 uses non-contact position information determination unit 144 to determine whether or not there is a non-contact reaction in the shutter icon area. When CPU 141 determines that a non-contact reaction has occurred (YES in step S210), control is switched to step S510. If not (NO in step S210), CPU 141 returns control to step S210.

  In step S510, CPU 141 moves and displays the shutter icon in the direction of camera 120.

  In step S520, based on the signal from touch panel 111, CPU 141 uses contact position information determination unit 145 to determine whether or not a contact reaction has occurred in the moved shutter icon area. When CPU 141 determines that a contact reaction has occurred (YES in step S520), CPU 141 switches control to step S240. If not (NO in step S520), CPU 141 returns control to step S210.

[Operation]
With reference to FIG. 6, the operation of the electronic device 100 will be described. FIG. 6 is a diagram illustrating an example of screen transition in the display device 151 of the electronic device 100 according to the third embodiment.

  As shown in the state (A), the display device 151 displays an icon 310. When the user's finger 320 touches the icon 310, the electronic device 100 activates an application for selfie.

  As shown in the state (B), when the application is activated, the display device 151 displays a user image captured by the camera 120 as a monitor image. In addition, electronic device 100 displays on display device 151 an icon 610 for accepting a shutter operation. At this time, the user's finger 320 is separated from the display surface 152 to such an extent that the hover function does not work.

  Thereafter, as shown in the state (C), when the finger 320 approaches the display surface 152, an icon 620 for receiving a shutter operation is displayed at a position approaching the camera 120. The user's line of sight changes from a downward line of sight to a normal view to track the moving icon 620.

  Furthermore, as shown in the state (D), when the icon is moved and displayed as the icon 630, the camera 120 and the icon 630 are close to each other. Since the user looks normal, if the user performs a shooting operation in this state, an image of the user who has seen it is obtained.

[Summary of embodiment]
The disclosed electronic device 100 displays such that the user's line of sight is directed to the camera when the self-portrait is performed. The display includes moving and displaying an arrow and a shutter icon. When the user recognizes the display, the user's line of sight faces the camera, so that an image viewed by the user can be obtained.

  The embodiment disclosed this time should be considered as illustrative in all points and not restrictive. The scope of the present invention is defined by the terms of the claims, rather than the description above, and is intended to include any modifications within the scope and meaning equivalent to the terms of the claims.

  100 electronic device, 110 input unit, 111 touch panel, 112 key, 120 camera, 130 storage unit, 140 control unit, 141 CPU, 142 memory, 143 program, 144 non-contact position information determination unit, 145 contact position information determination unit, 150 Display unit, 152 display surface, 310, 610, 620, 630 icon, 320 finger, 330, 350 line of sight, 331 shutter icon, 340 line of sight guidance arrow.

Claims (4)

Electronic equipment,
A display device having a touch panel that accepts an instruction input in a non-contact state;
A camera disposed on the display surface side of the display device;
A control device for controlling the electronic device,
The controller is
Displaying a monitor image from the camera on the display device;
A guidance image for guiding the user's line of sight of the electronic device to the camera is displayed on the display device;
Based on the shooting instruction to the electronic device, let the camera image,
Displaying the guidance image on the display device includes displaying a shutter image for receiving the photographing instruction, and moving the shutter image in the direction of the camera. Electronic equipment,
A display device having a touch panel that accepts an instruction input in a non-contact state;
A camera disposed on the display surface side of the display device;
A control device for controlling the electronic device,
The controller is
Displaying a monitor image from the camera on the display device;
A guidance image for guiding the user's line of sight of the electronic device to the camera is displayed on the display device;
Based on the shooting instruction to the electronic device, let the camera image,
The electronic device, wherein the display device displays the guidance image when an interval between the display device and the means for giving a photographing instruction to the electronic device is equal to or less than a predetermined interval. The induction image includes an image that indicates the direction in which the camera is located, the electronic device according to claim 1 or 2. A program for controlling an electronic device,
The electronic device is
A display device having a touch panel that accepts an instruction input in a non-contact state;
A camera disposed on the display surface side of the display device;
A processor for controlling the electronic device,
The program is stored in the processor.
Displaying a monitor image from the camera on the display device;
Displaying a guidance image for guiding the user's line of sight of the electronic device to the camera;
Causing the camera to take an image based on a shooting instruction to the electronic device,
The step of displaying the guidance image on the display device includes displaying a shutter image for accepting the photographing instruction and moving the shutter image in the direction of the camera.

Images