JP7739052B2 - Electronic device, its control method, program, and recording medium - Google Patents

Description

The present invention relates to an electronic device, a control method for the electronic device, a program, and a recording medium.

In recent years, digital cameras with two lens optical systems have become known. If the two optical systems are positioned to capture images in the same direction, it is possible to create an image with a 180-degree range (a hemispherical image) or an image that can be viewed in stereoscopic terms from the two parallax images captured by each system. If the two optical systems are positioned to capture images in opposite directions, it is possible to create an image with a 360-degree range (a spherical image) from the two images captured by each system.

Patent Document 1 discloses that two optical systems are arranged side by side so that they capture images in the same direction, and that these two optical systems are used to capture images of the same subject from left and right viewpoints, thereby obtaining images for the left eye and right eye, respectively. Patent Document 2 discloses that in a digital camera with a single optical system, the enlargement frame and AF frame can be moved within a live view image, and that when the AF frame moves, the AF frame and enlargement frame move in tandem, and when the enlargement frame moves, only the enlargement frame moves.

Patent No. 4875225 Japanese Patent Application Laid-Open No. 2013-201527

However, Patent Document 1 does not disclose how to adjust the focus for each of the left and right images captured using two optical systems, so if a user wants to adjust the focus, they do not know how to do so. Patent Document 2 does not disclose images captured using two optical systems, so when shooting using two optical systems, it is unclear on which of the two live view images the enlargement frame or AF frame will be displayed, or how the enlargement frame or AF frame will move when instructed to do so.

The present invention aims to enable the items used in photography to be moved appropriately depending on the optical system used for photography.

In order to solve the above problems, the present invention provides:
an acquisition means for acquiring a third image in which a first image captured via a first optical system and a second image captured via a second optical system and having a parallax with respect to the first image are arranged side by side;
A receiving means for receiving a location designation by a user;
a display control means for displaying on a display means the third image, a first item indicating a focus detection area, and a second item different from the first item indicating a target range of the image to which a predetermined process is to be applied,
The display control means controls the second item to be moved without moving the first item in response to a position specification being made to the reception means.

This invention allows items used in photography to be moved appropriately depending on the optical system used for photography.

FIG. 1 is an external view of a digital camera 100. FIG. 1 is a schematic block diagram showing an example of the hardware configuration of a digital camera 100. FIG. 2 is a schematic diagram illustrating an example of the configuration of a lens unit. 10 is a flowchart of a display mode switching process of a camera when a twin lens is attached and a process when a live view is touched according to the present embodiment. FIG. 10 is a diagram showing an example of a live view display of the camera when a twin lens is attached according to the present embodiment. 10 is a flowchart of a process for moving the enlargement frame of the camera when a twin lens is attached according to the present embodiment. 10A and 10B are diagrams illustrating the left and right boundaries of a live view of a camera when a twin lens is attached according to the present embodiment. 10 is a flowchart of a magnification process and a photographing operation of a camera when a twin lens is attached according to an embodiment. 10A and 10B are diagrams for explaining a zoom operation of a camera when a twin lens is attached according to an embodiment.

A preferred embodiment of the present invention will be described below with reference to the drawings. In this embodiment, the electronic device will be described as a digital camera (imaging device).

The digital camera 100 according to this embodiment can acquire a twin-lens image in which a left image and a right image with a predetermined parallax in the left-right direction are arranged side by side in a single image, and display the image on the display unit. The digital camera 100 can also apply predetermined image processing to a target area of the image displayed on the display unit. The predetermined image processing is, for example, enlargement processing, and the following description will discuss enlargement processing in detail. The digital camera 100 displays an enlarged image of the target area enlarged in response to an enlargement instruction on the display unit. Note that the predetermined image processing is not limited to enlargement processing. For example, it may be processing that detects the luminance distribution or chromaticity distribution within the target area and generates a histogram or waveform monitor, or processing that applies filter processing such as contrast enhancement to the target area. In this embodiment, an enlargement instruction is issued by pressing the enlarge button 78, which is a depressible physical member. However, an enlargement instruction may also be issued by pinching in on the touch panel 70a, and the enlarged display may be canceled by pinching out.

The digital camera 100 according to this embodiment displays an item indicating the target range in the twin-eye image, aligned with the twin-eye image. The item may be, for example, a frame-shaped indicator indicating the target range, or a semi-transparent color image to be composited into the target range. The digital camera 100 can change the display position of the item (i.e., the target range indicated by the item) in response to user operation. When displaying a twin-eye image, the digital camera 100 displays the item in a position that does not straddle both the left and right images. In other words, the target range is determined so as not to include both the left and right images. In other words, the target range is set to include only one of the left and right images.

Digital camera 100 controls the display of items so that the target range indicated by the item does not span both the left and right images, even if a user operation is performed to change the display position of the item (position of the target range).

FIGS. 1(a) and (b) show external views of a digital camera 100 as an example of a device to which the present invention can be applied. FIG. 1(a) is a front perspective view of the digital camera 100, and FIG. 1(b) is a rear perspective view of the digital camera 100. In FIG. 1, a display unit 28 is a display unit provided on the back of the camera that displays images and various information. A touch panel 70a is a touch detection means that can detect touch operations on the display surface (operation surface) of the display unit 28. An outside-finder display unit 43 is a display unit provided on the top surface of the camera that displays various camera settings such as shutter speed and aperture.

The shutter button 61 is an operation unit used to issue shooting instructions. The mode selector switch 60 is an operation unit used to switch between various modes. The terminal cover 40 is a cover that protects connectors (not shown) such as connection cables that connect external devices to the digital camera 100. The main electronic dial 71 is a rotary operation member included in the operation unit 70, and by turning this main electronic dial 71, settings such as shutter speed and aperture can be changed. The power switch 72 is an operation member that switches the power of the digital camera 100 on and off.

The sub electronic dial 73 is included in the operation unit 70 and is a rotary operation member that can be used to move the selection frame and advance images. The cross key 74 is included in the operation unit 70 and is a cross key (four-way key) that can be pressed up, down, left, or right. Operations can be performed according to which part of the cross key 74 is pressed. The SET button 75 is included in the operation unit 70 and is a push button that is mainly used to confirm selections. The video button 76 is used to start and stop video shooting (recording).

The enlargement button 78 is included in the operation unit 70 and is an operation button for turning the enlargement mode ON and OFF in the live view display in the shooting mode. By turning the enlargement mode ON and operating the main electronic dial 71, the LV image can be enlarged or reduced. In the playback mode, it functions as an enlargement button for enlarging the playback image and increasing the magnification ratio. The playback button 79 is included in the operation unit 70 and is an operation button for switching between the shooting mode and the playback mode. Pressing the playback button 79 in the shooting mode switches to the playback mode, and the most recent image recorded on the recording medium 200 can be displayed on the display unit 28.

The menu button 81 is included in the operation unit 70, and when the menu button 81 is pressed, a menu screen that allows various settings to be made is displayed on the display unit 28. The user can intuitively make various settings using the menu screen displayed on the display unit 28, the cross key 74, and the SET button 75.

The multi-controller 82 can be used to issue eight-way directional commands such as up, down, left, and right by tilting it 360 degrees. It can also be used to activate assigned functions by pressing it down. The display mode switching button 83 is an operating member for switching between multiple different display modes for information such as live view images and shooting information displayed on the display unit 28 or EVF 29. Each time the display mode switching button 83 is pressed, the display mode switches, allowing the user to view information about images being captured or played back in the display mode desired.

The communication terminal 10 is a communication terminal that allows the digital camera 100 to communicate with the lens side (detachable).

The eyepiece 16 is the eyepiece of the eyepiece finder (a peer-type finder), and the user can view the image displayed on the internal EVF 29 through the eyepiece 16. The eyepiece detection unit 57 is an eyepiece detection sensor that detects whether the photographer has placed their eye on the eyepiece 16. The lid 202 is the lid for the slot that stores the recording medium 200. The grip unit 90 is a holding unit shaped to be easily held in the right hand when the user holds the digital camera 100. When the digital camera is held by gripping the grip unit 90 with the little finger, ring finger, and middle finger of the right hand, the shutter button 61 and main electronic dial 71 are positioned so that they can be operated with the index finger of the right hand. In the same position, the sub electronic dial 73 is positioned so that it can be operated with the thumb of the right hand.

Figure 2 is a block diagram showing an example configuration of a digital camera 100 according to this embodiment. In Figure 2, lens unit 150 is a lens unit equipped with an interchangeable photographic lens. Lens 103 is usually composed of multiple lenses, but for simplicity's sake, only a single lens is shown here. Communication terminal 6 is a communication terminal that allows lens unit 150 to communicate with digital camera 100, and communication terminal 10 is a communication terminal that allows digital camera 100 to communicate with lens unit 150. Lens unit 150 communicates with system control unit 50 via communication terminals 6 and 10, controls aperture 1 via aperture drive circuit 2 using the internal lens system control circuit 4, and adjusts focus by displacing the position of lens 103 via AF drive circuit 3. In addition, communication terminals 6 and 10 identify the type of lens unit 150 attached to digital camera 100.

The shutter 101 is a focal plane shutter that can freely control the exposure time of the imaging unit 22 under the control of the system control unit 50.

The imaging unit 22 is an imaging element composed of a CCD, CMOS element, or the like that converts an optical image into an electrical signal. The imaging unit 22 may also have an imaging surface phase difference sensor that outputs defocus amount information to the system control unit 50. The A/D converter 23 converts analog signals into digital signals. The A/D converter 23 is used to convert the analog signals output from the imaging unit 22 into digital signals.

The image processing unit 24 performs predetermined pixel interpolation, resizing such as reduction, and color conversion processing on data from the A/D converter 23 or data from the memory control unit 15. The image processing unit 24 also performs predetermined calculations using the captured image data. The system control unit 50 performs exposure control and distance measurement control based on the calculation results obtained by the image processing unit 24. This results in TTL (through-the-lens) AF (autofocus) processing, AE (autoexposure) processing, and EF (pre-flash) processing. The image processing unit 24 also performs predetermined calculations using the captured image data, and performs TTL AWB (auto white balance) processing based on the calculation results obtained.

The output data from the A/D converter 23 is written to the memory 32 via the image processing unit 24 and memory control unit 15, or directly via the memory control unit 15. The memory 32 stores image data obtained by the imaging unit 22 and converted into digital data by the A/D converter 23, as well as image data to be displayed on the display unit 28 and EVF 29. The memory 32 has sufficient storage capacity to store a predetermined number of still images and a predetermined period of moving images and audio.

Memory 32 also serves as a memory (video memory) for image display. D/A converter 19 converts image display data stored in memory 32 into an analog signal and supplies it to display unit 28 and EVF 29. In this way, the display image data written to memory 32 is displayed by display unit 28 and EVF 29 via D/A converter 19. Display unit 28 and EVF 29 display the image according to the analog signal from D/A converter 19 on a display device such as an LCD or organic EL. Digital signals that are A/D converted once by A/D converter 23 and stored in memory 32 are converted to analog by D/A converter 19 and then sequentially transferred and displayed on display unit 28 or EVF 29, thereby enabling live view display (LV display). Hereinafter, images displayed in live view are referred to as live view images (LV images).

Various camera settings, including shutter speed and aperture, are displayed on the viewfinder LCD display 43 via the viewfinder display drive circuit 44.

The non-volatile memory 56 is an electrically erasable and recordable memory, such as an EEPROM. Constants and programs for the operation of the system control unit 50 are stored in the non-volatile memory 56. The "program" referred to here refers to a program for executing the various flowcharts described later in this embodiment.

The system control unit 50 is a control unit consisting of at least one processor or circuit, and controls the entire digital camera 100. It executes the programs recorded in the non-volatile memory 56 mentioned above to realize the various processes of this embodiment, which will be described later. The system memory 52, for example, is RAM, and stores constants and variables for the operation of the system control unit 50, programs read from the non-volatile memory 56, and the like. The system control unit 50 also performs display control by controlling the memory 32, D/A converter 19, display unit 28, etc.

The system timer 53 is a timing unit that measures the time used for various controls and the time of the built-in clock.

The operation unit 70 is an operating means for inputting various operational instructions to the system control unit 50. The mode selector switch 60 is an operating member included in the operation unit 70 and switches the operating mode of the system control unit 50 to one of still image capture mode, video capture mode, playback mode, etc. Modes included in the still image capture mode include auto capture mode, auto scene determination mode, manual mode, aperture priority mode (Av mode), shutter speed priority mode (Tv mode), and program AE mode (P mode). There are also various scene modes and custom modes that provide capture settings for specific shooting scenes. The mode selector switch 60 allows the user to directly switch to one of these modes. Alternatively, the user may first switch to a list screen of shooting modes using the mode selector switch 60, then select one of the displayed modes and switch using other operating members. Similarly, the video capture mode may also include multiple modes.

The first shutter switch 62 is turned ON when the shutter button 61 on the digital camera 100 is pressed halfway (a shooting preparation command) and generates a first shutter switch signal SW1. The first shutter switch signal SW1 initiates shooting preparation operations such as AF (autofocus) processing, AE (auto exposure) processing, AWB (auto white balance) processing, and EF (pre-flash) processing.

The second shutter switch 64 is turned ON when the shutter button 61 is fully pressed (a shooting instruction) and generates a second shutter switch signal SW2. The system control unit 50 uses the second shutter switch signal SW2 to initiate a series of shooting processing operations, from reading a signal from the imaging unit 22 to writing the captured image to the recording medium 200 as an image file.

The operation unit 70 is a variety of operation members (reception means) that serve as an input unit that accepts operations from the user. The operation unit 70 includes at least the following operation members: shutter button 61, main electronic dial 71, power switch 72, sub electronic dial 73, cross key 74, SET button 75, movie button 76, AF lock button 77, magnify button 78, playback button 79, menu button 81, and multi-controller 82. Other operation members 70b represent all operation members not individually shown in the block diagram.

The power supply control unit 80 is composed of a battery detection circuit, a DC-DC converter, a switch circuit that switches between powered blocks, and other components, and detects whether a battery is installed, the battery type, and the remaining battery charge. The power supply control unit 80 also controls the DC-DC converter based on the detection results and instructions from the system control unit 50, and supplies the required voltage for the required period to each component, including the recording medium 200. The power supply unit 30 consists of primary batteries such as alkaline batteries or lithium batteries, secondary batteries such as NiCd batteries, NiMH batteries, or Li batteries, an AC adapter, etc.

The recording medium I/F 18 is an interface with a recording medium 200 such as a memory card or hard disk. The recording medium 200 is a recording medium such as a memory card for recording captured images, and is composed of a semiconductor memory, a magnetic disk, etc.

The communication unit 54 is connected wirelessly or via a wired cable and transmits and receives video and audio signals. The communication unit 54 can also connect to a wireless LAN (Local Area Network) or the Internet. The communication unit 54 can also communicate with external devices via Bluetooth (registered trademark) or Bluetooth Low Energy. The communication unit 54 can transmit images (including LV images) captured by the imaging unit 22 and images recorded on the recording medium 200, and can also receive images and various other information from external devices.

The orientation detection unit 55 detects the orientation of the digital camera 100 relative to the direction of gravity. Based on the orientation detected by the orientation detection unit 55, it is possible to determine whether an image captured by the imaging unit 22 was captured with the digital camera 100 held horizontally or vertically. The system control unit 50 can add orientation information corresponding to the orientation detected by the orientation detection unit 55 to the image file of the image captured by the imaging unit 22, or rotate and record the image. An acceleration sensor, gyro sensor, or the like can be used as the orientation detection unit 55. The acceleration sensor or gyro sensor that constitutes the orientation detection unit 55 can also be used to detect movement of the digital camera 100 (panning, tilting, lifting, whether it is stationary, etc.).

The eyepiece detection unit 57 is an eyepiece detection sensor that detects (approach detection) whether the eye (object) is approaching (eyepiece) or moving away (eyepiece) from the viewfinder eyepiece 16. The system control unit 50 switches the display unit 28 and EVF 29 between on (display state) and off (non-display state) depending on the state detected by the eyepiece detection unit 57. More specifically, at least in the shooting standby state and when the display destination switching is automatic, when the eye is not in contact with the subject, the display is turned on as the display unit 28 and the EVF 29 is not displayed. Furthermore, when the eye is in contact with the subject, the display is turned on as the display unit 29 and the EVF 29 is not displayed.

The eyepiece detection unit 57 can be, for example, an infrared proximity sensor, and can detect the approach of an object to the eyepiece 16 of the viewfinder that houses the EVF 29. When an object approaches, infrared light emitted from the light-emitting unit (not shown) of the eyepiece detection unit 57 is reflected and received by the light-receiving unit (not shown) of the infrared proximity sensor. The amount of received infrared light can also be used to determine the distance the object has approached from the eyepiece 16 (eyepiece distance). In this way, the eyepiece detection unit 57 performs eyepiece detection, detecting the proximity of an object to the eyepiece 16.

When an object is detected approaching within a predetermined distance from the eyepiece unit 16 from a non-eyepiece state (non-approaching state), it is detected that the eye has been placed in proximity. When an object that was detected as approaching from the eyepiece state (approaching state) moves away by more than a predetermined distance, it is detected that the eye has been removed. The threshold for detecting eye placement and the threshold for detecting eye removal may be different, for example, by providing hysteresis. Furthermore, once eye placement is detected, the eye placement state is maintained until eye removal is detected. Once eye removal is detected, the non-eye placement state is maintained until eye placement is detected. Note that the infrared proximity sensor is just one example, and other sensors that can detect the approach of an eye or object that can be considered as eye placement may be used for the eye placement detection unit 57 as long as they are capable of detecting the approach of an eye or object that can be considered as eye placement.

The touch panel 70a and the display unit 28 can be configured as an integrated unit. For example, the touch panel 70a is configured so that its light transmittance does not interfere with the display of the display unit 28, and is attached to the upper layer of the display surface of the display unit 28. Input coordinates on the touch panel 70a are then associated with display coordinates on the display screen of the display unit 28. This makes it possible to provide a GUI (Graphical User Interface) that allows the user to directly operate the screen displayed on the display unit 28. The system control unit 50 can detect the following operations or states on the touch panel 70a:
A finger or pen that has not been touching the touch panel 70a touches the touch panel 70a again, that is, the start of touching (hereinafter referred to as touch-down).
The touch panel 70a is in a state of being touched with a finger or a pen (hereinafter referred to as Touch-On).
- Touching the touch panel 70a with a finger or a pen and moving it (hereinafter referred to as Touch-Move).
The finger or pen that has been touching the touch panel 70a is released, that is, the touch is ended (hereinafter referred to as "touch-up").
A state in which nothing is touching the touch panel 70a (hereinafter referred to as Touch-Off).

When touch down is detected, touch on is also detected at the same time. After touch down, touch on will usually continue to be detected unless touch up is detected. Touch move is also detected when touch on is detected. Even if touch on is detected, touch move will not be detected unless the touch position moves. Once it is detected that all fingers or pens that were touching have touched up, touch off occurs.

These operations and states, as well as the position coordinates of the finger or pen touching the touch panel 70a, are notified to the system control unit 50 via the internal bus, and the system control unit 50 determines what operation (touch operation) was performed on the touch panel 70a based on the notified information. For touch moves, the direction of movement of the finger or pen on the touch panel 70a can also be determined for each vertical and horizontal component on the touch panel 70a based on changes in the position coordinates.

When a touch move of a predetermined distance or more is detected, it is determined that a slide operation has been performed. An operation in which a finger is touched to the touch panel, quickly moved a certain distance, and then released is called a flick. In other words, a flick is an operation in which a finger is quickly traced across the touch panel 70a as if flicking. When a touch move of a predetermined distance or more at a predetermined speed or more is detected, followed by a touch up, it can be determined that a flick has been performed (a flick can be determined to have occurred following a slide operation).

Furthermore, a touch operation in which multiple points (for example, two points) are touched together (multi-touch) and the touch positions are brought closer together is called a pinch in, while a touch operation in which the touch positions are moved farther apart is called a pinch out. Pinch out and pinch in are collectively referred to as a pinch operation (or simply pinch). The touch panel 70a may be of any of a variety of touch panel types, including resistive film, capacitive, surface acoustic wave, infrared, electromagnetic induction, image recognition, and optical sensor types. Depending on the type, there are types that detect a touch when there is contact with the touch panel, and types that detect a touch when a finger or pen approaches the touch panel, but either type is acceptable.

Figure 3 is a schematic diagram showing an example of the configuration of the lens unit 300. Figure 3 shows the lens unit 300 attached to the digital camera 100. Note that the same components of the digital camera 100 shown in Figure 3 as those described in Figure 2 are given the same reference numerals, and descriptions thereof will be omitted where appropriate.

Lens unit 300 is a type of interchangeable lens that can be attached to and detached from digital camera 100. Lens unit 300 is a twin lens that can capture optical images with parallax between left and right images. Lens unit 300 has two optical systems (photographing lenses), each with a wide 180-degree field of view, allowing it to capture images of the front hemisphere. Specifically, the two optical systems of lens unit 300 can each input an optical image of a subject within a field of view (angle of view) of 180 degrees in the left-right direction (horizontal angle, azimuth angle, yaw angle) and 180 degrees in the up-down direction (vertical angle, elevation angle, pitch angle).

The lens unit 300 includes a right-eye optical system 301R having multiple lenses and reflecting mirrors, a left-eye optical system 301L having multiple lenses and reflecting mirrors, and a lens system control circuit 303. The right-eye optical system 301R corresponds to an example of a first optical system, and the left-eye optical system 301L corresponds to an example of a second optical system. In the right-eye optical system 301R and the left-eye optical system 301L, the lenses 302R and 302L located on the subject side face in the same direction, and their optical axes are parallel. Each optical system is a so-called fisheye lens, and a circular optical image is formed on the imaging unit 22 (sensor). The optical image (left image) input via the left-eye optical system 301L and the optical image (right image) input via the right-eye optical system 301R are formed on the imaging surface of a single imaging unit 22, and the imaging unit 22 acquires an image including each optical image.

The lens unit 300 of this embodiment is a VR180 lens (two-eye lens) for capturing images for VR180, a VR image format that enables two-eye stereoscopic viewing. The VR180 lens has fisheye lenses that enable the right-eye optical system 301R and left-eye optical system 301L to each capture a 180-degree range. Note that the VR180 lens may be a lens that can capture a wide viewing angle range of approximately 160 degrees, which is narrower than the 180-degree range, as long as the right-eye optical system 301R and left-eye optical system 301L can each capture images that can be displayed as two-eye VR in VR180. The VR180 lens can form a right image (first image) formed via the right-eye optical system 301R and a left image (second image) formed via the left-eye optical system 301L, which has parallax from the right image, on one or two image sensors of the attached camera. In the digital camera 100 according to this embodiment, the right and left images are formed on a single image sensor (sensor), and a single image (twin image) is generated in which an image corresponding to the right image and an image corresponding to the left image are arranged side by side. This twin image includes an image corresponding to the right image and an image corresponding to the left image, as well as an area where no optical image is formed (blacked-out area).

The lens unit 300 is attached to the digital camera 100 via the lens mount section 304 and the camera mount section 305 of the digital camera 100. This electrically connects the system control section 50 of the digital camera 100 and the lens system control circuit 303 of the lens unit 300 via the communication terminal 10 of the digital camera 100 and the communication terminal 306 of the lens unit 300.

In this embodiment, a right image formed via the right-eye optical system 301R and a left image formed via the left-eye optical system 301L, which has parallax from the right image, are formed side by side on the imaging unit 22 of the digital camera 100. That is, two optical images formed by the right-eye optical system 301R and the left-eye optical system 301L are formed on a single imaging element. The imaging unit 22 converts the formed subject image (optical signal) into an analog electrical signal to acquire image data of the two-eye image. In this way, by using the lens unit 300, two images with parallax can be simultaneously acquired (as a set) from two locations (optical systems), the right-eye optical system 301R and the left-eye optical system 301L. Furthermore, by dividing the acquired images into an image for the left eye and an image for the right eye and displaying them in VR, the user can view a stereoscopic VR image with a 180-degree range, known as VR180.

Conventionally, with a normal single lens, the image that enters the lens is inverted point-symmetrically around the center of the optical axis and input to the sensor. Imaging devices like digital camera 100 generate natural (non-inverted) images by adjusting the sensor reading order and inverting the read images. On the other hand, with a twin lens, the image is inverted point-symmetrically up and down and input to the sensor, but the image acquired through the left-eye optical system is not inverted left and right, so that what is acquired through the right-eye optical system is input to the sensor on the left side, and what is acquired through the right-eye optical system is input to the sensor on the right side. Therefore, if inversion processing is performed as in the past, the left and right sides of the image after inversion processing will be reversed from the left and right sides of digital camera 100, meaning that what is acquired through the left-eye optical system will be displayed on the right, and what is acquired through the right-eye optical system will be displayed on the left side.

Here, VR images are images that can be displayed in VR, as described below. VR images include omnidirectional images (spherical images) captured by an omnidirectional camera (spherical camera) and panoramic images with a wider image range (effective image range) than can be displayed at one time on a display unit. VR images are not limited to still images, but also include videos and live images (images captured from a camera in near real time). VR images have an image range (effective image range) of up to 360 degrees horizontally and vertically. VR images also include images with a wider field of view than can be captured by a normal camera, or an image range wider than can be displayed at one time on a display unit, even if the field of view is less than 360 degrees horizontally or vertically. Images captured by the digital camera 100 using the lens unit 300 described above are a type of VR image. VR images can be displayed in VR by, for example, setting the display mode of a display device (a display device capable of displaying VR images) to "VR view." By displaying a VR image with a 360-degree angle of view and changing the orientation of the display device left and right (horizontal rotation), the user can enjoy seamless, omnidirectional images in both the left and right directions.

Here, VR display (VR view) refers to a display method (display mode) that allows for a change in the display range, displaying a VR image with a field of view that corresponds to the orientation of the display device. VR display includes "single-eye VR display (single-eye VR view)," which displays a single image by mapping a VR image onto a virtual sphere (a transformation that corrects distortion). VR display also includes "two-eye VR display (two-eye VR view)," which displays a VR image for the left eye and a VR image for the right eye side by side in left and right regions by mapping each onto a virtual sphere. Stereoscopic viewing is possible by performing "two-eye VR display" using a VR image for the left eye and a VR image for the right eye that have parallax between them.

Regardless of the VR display, for example, when a user wears a display device such as an HMD (head-mounted display), an image with a field of view that corresponds to the orientation of the user's face is displayed. For example, suppose a VR image is displayed with a field of view centered at 0 degrees left and right (a specific direction, e.g., north) and 90 degrees up and down (90 degrees from the zenith, i.e., horizontal) at a certain point. If the orientation of the display device is flipped from this state (e.g., the display surface is changed from facing south to facing north), the display range changes to an image of the same VR image with a field of view centered at 180 degrees left and right (the opposite direction, e.g., south) and 90 degrees up and down. In other words, if a user wearing an HMD turns their face from north to south (i.e., facing backwards), the image displayed on the HMD will also change from a north image to a south image.

Note that the VR image captured using the lens unit 300 of this embodiment is a VR180 image capturing a 180-degree range in front, and does not contain any image in the 180-degree range behind. If such a VR180 image is displayed in VR and the orientation of the display device is changed to the side where no image is present, a blank area will be displayed.

By displaying VR images in this way, the user visually feels as if they are inside the VR image (in a VR space). Note that the method of displaying VR images is not limited to changing the orientation of the display device. For example, the display range may be moved (scrolled) in response to user operation via a touch panel or directional buttons. Furthermore, during VR display (when the display mode is "VR view"), in addition to changing the display range due to changes in orientation, the display range may also be changed in response to touch-move on the touch panel, dragging with a mouse, pressing directional buttons, etc. Note that a smartphone attached to VR goggles (head-mounted adapter) is a type of HMD.

In the digital camera 100 configured as described above, the twin-eye image captured through the lens unit 300 is an image that includes right and left images input to the imaging unit 22 via the right and left optical systems. Furthermore, users of the digital camera 100 may enlarge and display part of an image to check the details of a live view image or a recorded image. When enlarging, the center position of the range to be enlarged may be uniquely set to the center position of the entire image.

When enlarging a portion of a twin-eye image to confirm it, it is desirable to display only a portion of either the right or left image. If the center position of the range to be enlarged is uniquely set to the center of the entire image when enlarging, and the enlarged image includes both the right and left images, it will be difficult for the user to intuitively understand which part of the original image is being displayed in the enlarged image. Specifically, the left edge of the right image will be aligned to the right side of the enlarged image, and the right edge of the left image will be aligned to the left side of the enlarged image, resulting in an enlarged image with a different left-right positional relationship to the field of view of the subject.

In this embodiment, therefore, the processing of the digital camera 100 that performs live view magnification processing suitable for shooting with a twin lens such as the lens unit 300 will be described with reference to the flowchart in Figure 4.

Figure 4 is a flowchart showing an example of processing in the shooting mode of the digital camera 100. The flowchart in Figure 4 is implemented by the system control unit 50 by loading a program recorded in the non-volatile memory 219 into the system memory 52 and executing it. The flowchart in Figure 4 is started when the digital camera 100 is turned on and in a shooting standby state. When starting the control flowchart in Figure 4, the system control unit 50 initializes control variables, etc., and begins processing.

Furthermore, an example of the display on the display unit 28 when the control flowchart of Figure 4 is executed will be explained using Figure 5. Details of the display example shown in Figure 5 will be explained after explaining the control flowchart of Figure 4.

In S401, the system control unit 50 obtains the previously used display mode from the flag (N) stored in the non-volatile memory 56, and displays a live view image and information related to shooting on the display unit 28 based on the previously used display mode. For example, if the flow was started by turning the power on, the previously used display mode is the display mode that was used the previous time the power was turned off. Alternatively, if the flow was started by switching to shooting mode from a mode other than shooting mode, such as playback mode, it is the display mode that was used when processing was last performed in shooting mode.

In S402, the system control unit 50 determines whether the display mode switching button 83 has been pressed. If it has been pressed, the process proceeds to S403; if not, the process proceeds to S410.

In S403, the system control unit 50 references the system memory 52 and determines whether the flag N indicating the display mode is 5 (N=5). If N=5, the process proceeds to S404; if not, the process proceeds to S405.

In S404, the system control unit 50 determines via communication terminals 6 and 10 whether the attached lens is a twin lens (i.e., a two-lens system). If it is a twin lens, proceed to S406; if not (i.e., a normal single lens or no lens is attached), proceed to S408. A twin lens is a two-lens system with a lens on each side, and each lens is a wide-angle fisheye lens capable of capturing at least a 180-degree range on the side on which the lens is located, i.e., the subject side. Data for the left and right images captured through the left eye optical system 301L and right eye optical system 301R can be captured using one or two image sensors.

In S405, since the determination in S403 is No, the system control unit 50 increments the flag N indicating the display mode by 1 (N = N + 1) and stores it in the system memory 52.

In S406, the system control unit 50 sets flag N to 6 (N=6) and stores it in the system memory 52.

In S407, when N=6, the system control unit 50 displays a display mode dedicated to twin lenses on the display unit 28. An example of the display at this time is shown in Figure 5(f). Figure 5(f) will be explained in detail later.

In S408, since the determination in S404 was No, the system control unit 50 sets flag N to 1 (N=1) and stores it in the system memory 52.

In S409, the system control unit 50 displays a live view image or information in a display mode corresponding to the display unit 28, according to the value of flag N stored in the system memory 52. Examples of displays corresponding to the display modes displayed on the display unit 28 are shown in Figures 5(a) to 5(e). This step is also reached if the determination in S404 is No, so the image is displayed even when no twin lens is attached, i.e., when a single lens is attached or no lens is attached.

The LV image and information displayed on the display unit 28 will be described using Figures 5(a) to (f). Figures 5(a) to (f) show two LV images when a twin lens (twin lens) is attached to the digital camera 100. However, when a single lens is attached, one LV image is displayed, and the rest of the display is similar. When a single lens is attached, as described above with reference to Figure 4, the display mode shown in Figure 5(f) is not transitioned. Each time the user switches the display mode (in this embodiment, by pressing the display mode switch button 83), the information displayed on the display unit 28 is changed. Specifically, Figures 5(a) to (f) are displayed according to the number of flag N, which indicates the display mode described above with reference to Figure 4. Note that in this embodiment, the LV image displayed on the display unit 28 is a circular fisheye display; however, this is not limiting and an equirectangular display may be achieved by performing equirectangular conversion processing on the circular fisheye display LV image.

Figure 5(a) shows the display mode when flag N = 1, i.e., when the digital camera 100 is powered on and an LV image is displayed on the display unit 28 while the camera is in a shooting standby state. Two LV images (LV500R, LV500L) are displayed side by side, and information displays 501a-501c are also displayed on the display unit 28. The two LV images arranged side by side in this case are called side-by-side images. Information displays 501a-501c show shooting information and are the minimum information display assumed to be essential for the user when shooting. Pressing the display mode switch button 83 in the state shown in Figure 5(a) transitions to Figure 5(b).

Figure 5(b) shows the display mode when flag N = 2. In Figure 5(b), in addition to LV500R, LV500L, and information displays 501a-501c, information displays 502a and 502b are displayed. Like information displays 501a-501c, information displays 502a and 502b display shooting information and display various information related to shooting (for example, currently set settings and the type of inserted recording medium 200). Because they contain more information than information displays 501a-501c, the user can view more shooting information. However, this may reduce the visibility of the LV image. Pressing the display mode switch button 83 in the state shown in Figure 5(b) will transition to Figure 5(c).

Figure 5(c) shows the display mode when flag N=3. In Figure 5(c), in addition to LV500R, LV500L, and information displays 501a-501c, 502a, and 502b, information display 503, which is a histogram of the LV image currently being captured, is displayed. Information display 503 is a graph with brightness on the horizontal axis and the number of pixels on the vertical axis, and serves as a guide for checking the brightness of the LV image currently being captured, the exposure level trend, and the overall gradation of the LV image. Some users may want to check information display 503 while capturing an image, so it is displayed. However, because it is superimposed on a relatively large area of the LV image, visibility is reduced. Pressing the display mode switch button 83 in the state shown in Figure 5(c) will transition to Figure 5(d).

Figure 5(d) shows the display mode when flag N = 4. In the display mode of Figure 5(d), all information displays 501a-501c, 502a, 502b, and 503 are hidden, and only LV500R and LV500L are displayed. This display allows the user to take pictures while viewing only the LV image, without feeling bothered by various shooting information. Pressing the display mode switch button 83 in the state shown in Figure 5(d) will transition to Figure 5(e).

Figure 5(e) shows the display mode when flag N = 5. In the display mode of Figure 5(e), the LV image is not displayed, and only information about shooting is displayed in a table-like format. When the display mode switch button 83 is pressed in the state shown in Figure 5(e), the display transitions to Figure 5(f) if a twin lens is attached, and transitions to Figure 5(a) if a single lens is attached or no lens is attached.

Figure 5(f) shows the display mode when flag N = 6 (S407 in Figure 4). In other words, this is the display mode that is entered only when a twin lens is attached to the digital camera 100. At this time, the display unit 28 displays LV500R, LV500L, information displays 505 and 506, and an enlargement frame 511, focus guide 512, and magic window 513 superimposed on the LV image. Information display 505 indicates that LV500R is an LV image (right image) captured by the right-eye optical system 301R, and displays "R" meaning right. Information display 506 indicates that LV500L is an LV image (left image) captured by the left-eye optical system 301L, and displays "L" meaning left.

In the case of an optical system such as that shown in digital camera 100, the image captured by the image sensor (image capture unit 22) is captured upside down. This upside-down image is then flipped 180 degrees and displayed on display unit 28 or EVF 29. With this structure in mind, consider taking pictures using a lens with two optical systems (twin lens) as shown in Figure 3. As mentioned above, if the two LV images captured by the left and right optical systems and input to image capture unit 22 are displayed on display unit 28 without being flipped, the LV images will be displayed upside down, which is inconvenient for the user. For this reason, the two LV images input to image capture unit 22 are flipped, just as in the case of a single lens.

However, even if the inversion process is performed, the two LV images displayed on the display unit 28 will have the LV image (right image) acquired via the right-eye optical system 301R displayed in the left area, and the LV image (left image) acquired via the left-eye optical system 301L displayed in the right area. In particular, in this embodiment, since imaging is performed using a single imaging element (imaging unit 22), the process of identifying the boundary between the two LV images on a single imaging element and swapping the left and right LV images places a heavy processing load on the system control unit 50. Therefore, the LV image input to the imaging unit 22 is flipped 180 degrees up and down and displayed on the display unit 28 without swapping the left and right images.

When two LV images are displayed on the display unit 28, the user generally assumes that the LV image displayed in the left area was captured by the left eye optical system 301L, and the LV image displayed in the right area was captured by the right eye optical system 301R. In other words, without the display of information displays 505 and 506, the user is unlikely to understand that the left and right LV images are mirror-inverted, and if the user is not aware that the images are mirror-inverted at the time of capture, this can lead to confusion. For this reason, by displaying information displays 505 and 506, the user can clearly see which optical system, left or right, each LV image was captured by.

The enlargement frame 511 superimposed on the LV image is a frame display that indicates the area of the LV image that will be enlarged when the user issues an enlargement command (similar to S801 in Figure 8, described below). The focus guide 512 is a frame that indicates the focus detection area and an indicator that displays information such as an index and color to indicate the degree of focus on the subject at the position where the focus detection area is superimposed. In this embodiment, the degree of focus is expressed by three indexes displayed above or below the focus detection area. The focus guide 512 in Figure 5(f) shows that the subject at the position where the focus detection area is displayed is out of focus and in back focus (the subject is not in focus as the focus is behind the subject). Furthermore, when the subject is not in focus, the focus guide is displayed in white. When these three indexes become two, it indicates that the subject is in focus and the focus guide is displayed in green.

The magic window 513 is an indicator displayed on the display unit 28 that indicates the range that is initially displayed before the user moves their viewpoint. This indicates the range that is initially displayed before the user moves their viewpoint when a single 180-degree image (semi-spherical image) is generated from the LV500R and LV500L and played back on a browser or head-mounted display (HMD). By displaying the magic window 513 on the LV image, the range that will be displayed first during playback, i.e., the range that the viewer sees first, can be visually confirmed during shooting, allowing the user to more effectively capture the composition and subject that they desire.

The magic window 513 is an indicator that is only needed when creating a 180-degree image, and is a unique indicator that is expected to be particularly necessary for users when shooting with twin lenses attached. For this reason, the display mode shown in Figure 5(f) is not displayed when a single lens is attached. Also, because the display position of the magic window 513 is fixed, as long as the user can confirm the range of the magic window 513, it is not necessarily necessary for it to be displayed at all times during subsequent shooting.

In this embodiment, the enlargement frame 511 and focus guide 512 are superimposed on only one of the two LV images, while the magic window 513 is superimposed on both of the two LV images. Since the enlargement frame 511 indicates the position to be enlarged, it is optimal to display only one, but the focus guide 512 may be displayed on both of the two LV images instead of just one.

Next, the processing performed when a touchdown operation is performed on the touch panel 70a will be described. In response to a touchdown on the touch panel 70a while an image is being displayed, the system control unit 50 of the digital camera 100 displays items related to focus control and items indicating the magnification range within the image. If the lens unit connected to the digital camera 100 is not a twin lens (a conventional single lens), the system control unit 50 displays a focus guide indicating the level of focus or an AF frame indicating the area targeted for autofocus at a position corresponding to the touchdown. Furthermore, if the lens unit connected to the digital camera 100 is a twin lens, the system control unit 50 positions the focus guide indicating the level of focus in the center of either the area displaying the left image or the area displaying the right image in response to the touchdown (recentering). Furthermore, the system control unit 50 displays an enlargement frame indicating the magnification range at a position corresponding to the touchdown. If the lens unit connected to the digital camera 100 is a twin lens, the system control unit 50 displays the enlargement frame so that it does not include both the left and right images.

In S410, the system control unit 50 determines whether a touch-down operation has been performed on the touch panel 70a. If a touch-down operation has been performed, the coordinates (xt, xy) indicating the touch-down position (touch position) are stored and processing proceeds to S411; if not, processing proceeds to S601 in FIG. 6.

In S411, similar to S404, the system control unit 50 determines whether the attached lens is a twin lens via the communication terminals 6 and 10. If it is a twin lens, the process proceeds to S412; if not, the process proceeds to S421.

In S412, the system control unit 50 determines whether the touch position (dutch-down position) of the touch-down operation performed on the touch panel 70a in S410 is within the right area (area 701R) of the twin-lens image. FIG. 7 is a schematic diagram showing an example display of a twin-lens image. If the touch position is within the right area (area 701R), the process proceeds to S413; if the touch position is within the left area (area 701L), the process proceeds to S417. Line 705 is the line that marks the exact boundary between the live view images (LV700R and LV700L) captured by the left and right optical systems. In this embodiment, line 705 is the center line when the imaging unit 22 is divided into two halves, left and right.

In S413, the system control unit 50 displays the focus guide in the center of the right area (returning the display position to the center). At this time, if a focus guide is already displayed superimposed on the LV image in either the left or right area LV image, the display is moved to the center of the right area (the center of the LV image captured by the left eye optical system 301L shown in the right area). An example of this display is shown in guide 512 in Figure 5 (f). The focus guide is composed of a frame indicating the focus detection area and multiple indicators that indicate the degree of focus in the focus detection area based on the relative display positions of the indicators. Depending on the relative display positions of the indicators, the user can visually determine whether the focus detection area is in focus at its display position, how out of focus it is, and, if out of focus, whether it is in front of or behind the subject in the focus detection area. Note that the focus guide is not limited to this display format and may also indicate the degree of focus using, for example, color, etc.

In S414, the system control unit 50 determines whether the touch position of the touch-down operation on the touch panel 70a performed in S410 is near a boundary. Specifically, the system control unit 50 determines whether the touch position is in the area between line 705 in FIG. 7 and a line a predetermined distance to the right of line 705. If so, the process proceeds to S415; if not, the process proceeds to S416. Here, the predetermined distance is assumed to be half the horizontal length of the enlargement frame. Note that the predetermined distance can be set arbitrarily. The position on the touch panel 70a is expressed in an x-y coordinate system. Here, the x-coordinate of the line a predetermined distance to the right of line 705 is assumed to be Rmin. In other words, when the x-component of the center coordinate of the enlargement frame is Rmin, the left side of the enlargement frame is in contact with (overlaps with) line 705. If the x-component of the center coordinate of the enlargement frame is smaller than Rmin, the enlargement frame may straddle the left and right regions.

In S415, the system control unit 50 displays the enlargement frame so that its center is aligned with the coordinates (Rmin, yt). By controlling in this way, even if the user performs a touch operation near line 705, the enlargement frame will not cross line 705 and will be displayed so that it includes only the right region.

In S416, the system control unit 50 displays the enlargement frame so that its center coincides with the coordinates (xt, yt) of the touch position.

In S417, since the determination in S412 was No, the system control unit 50 displays the focus guide in the center of the left area (the center of the LV image captured by the right-eye optical system 301R shown in the left area). At this time, if the focus guide is already displayed superimposed on the LV image, the display is moved to the center of the left area.

In S418, the system control unit 50 determines whether the touch position of the touchdown operation performed on the touch panel 70a in S410 is in the area between line 705 in FIG. 7 and a line a predetermined distance to the left of line 705. If so, proceed to S419; if not, proceed to S420. As noted in S414, the predetermined distance is half the horizontal length of the enlargement frame. The user may also be able to set the predetermined distance as desired. Here, the x-coordinate of the line a predetermined distance to the left of line 705 is defined as Lmax. In other words, when the x-component of the center coordinate of the enlargement frame is Lmax, the right side of the enlargement frame is in contact with (overlaps with) line 704. If the x-component of the center coordinate of the enlargement frame is greater than Lmax, the enlargement frame may straddle the left and right regions.

In S419, the system control unit 50 displays the enlargement frame so that its center is aligned with the coordinates (Lmax, yt).

In S420, the system control unit 50 displays the enlargement frame so that its center coincides with the coordinates (xt, yt) of the touch position.

By controlling in this way, even if the user uses a touch operation to specify the position of the enlargement frame in an area including the vicinity of line 705, the enlargement frame will not be displayed across both the left and right areas. If the enlargement frame were displayed across both the left and right areas, as will be described later, when the user performs an enlargement operation (presses the enlarge button 78), the boundary between the left and right LV images would be enlarged, which could confuse the user. For this reason, the enlargement frame is prevented from being displayed across both the left and right areas.

Next, we will explain the control that is executed in response to touchdown when the lens attached to the digital camera 100 is not a twin lens (it is a single lens).

In S421, the system control unit 50 references the non-volatile memory 56 and determines whether the focus mode setting is autofocus mode (AF mode) or manual focus mode (MF mode). If it is MF mode, the process proceeds to S422, and if it is AF mode, the process proceeds to S423. If the focus guide display setting is ON in MF mode, the focus guide is displayed to assist with focusing during MF operation.

In S422, the system control unit 50 moves the focus guide display to the touch position specified by the user in S410.

In S423, the system control unit 50 displays an AF frame (autofocus frame) indicating the in-focus position at the touch position specified by the user in S410.

In S424, the system control unit 50 displays an enlargement frame at the touch position made in S410.

In other words, if the lens attached to the digital camera 100 is not a twin lens (it is a single lens), the magnification frame and focus guide will be displayed at the position touched by the user regardless of the focus mode setting. The magnification frame is also displayed in conjunction with the focus detection area of the AF frame and focus guide. On the other hand, if a twin lens is attached, the display position of the magnification frame is not linked to the focus detection area of the focus guide.

In this embodiment, when a twin lens is attached, the display position of the focus guide is fixed to the center of the display area of the left and right LV images. Therefore, if the display position of the focus guide and the display position of the magnification frame were linked, only the center of the LV image could be enlarged, which would be inconvenient for the user. Furthermore, with a twin lens, two LV images are displayed on the display unit 28, and each LV image is less than half the size of an LV image when a single lens is attached. Therefore, there is a high possibility that the user will enlarge the LV image more times than when a single lens is attached to check it in more detail. Therefore, the magnification frame (i.e., the magnification range of the LV image) is not linked to the focus guide so that the user can freely check the desired position.

Even if the focus guide is not fixed to the center, when a twin lens is attached, the focus guide and magnification frame are not linked. Users use the focus guide to make more precise focus adjustments, but there may be times when they want to zoom in on a position other than the desired focus position to check it in more detail. For example, if they want to zoom in on an area within the magic window (described below) or an area close to the circumference of the LV image in a circular fisheye display, it is easier for the user to operate if the focus guide and magnification frame positions are not linked.

Figure 6 is a control flowchart for display control of the digital camera 100 when an operation is performed on an operating member capable of indicating a direction according to this embodiment.

The system control unit 50 of the digital camera 100 moves the position of an item in the image (specifies the position of the item) in response to a directional instruction received while displaying a twin-lens image and an item such as a magnification frame. If the lens unit connected to the digital camera 100 is not a twin-lens unit (a conventional single-lens unit), the system control unit 50 moves the focus guide or AF frame, and the magnification frame in response to the directional instruction.

Furthermore, if the lens unit connected to the digital camera 100 is a twin lens, the system control unit 50 moves the enlargement frame in response to the directional instruction. However, the focus guide is not moved. Furthermore, when the enlargement frame is displayed in the right area of the display unit and is near the boundary so that it does not include both the left and right images, the system control unit 50 moves the display position of the enlargement frame to the left area in response to receiving an instruction to the left. When the enlargement frame is displayed in the left area of the display unit and is near the boundary so that it does not include both the left and right images, the system control unit 50 moves the display position of the enlargement frame to the right area in response to receiving an instruction to the right.

In S601, the system control unit 50 determines whether a direction has been specified using the multi-controller (MC) 82 or cross key 74 of the operation unit 70. If a direction has been specified, the process proceeds to S602; if not, the process proceeds to S617.

In S602, similar to S411, the system control unit 50 obtains the type of attached lens via the communication terminals 6 and 10 and determines whether it is a twin lens. If it is a twin lens, the process proceeds to S607; if not, the process proceeds to S603.

In S603, similar to S421, the system control unit 50 determines whether the current focus mode of the camera is AF mode or MF mode. If it is AF mode, proceed to S604; if it is MF mode, proceed to S605. Note that in MF mode, if the focus guide display setting for assisting MF focusing is ON, the focus guide is displayed on one of the LV images displayed on the display unit 28. If a touch-down operation has not been performed on the touch panel 70a as described above in S410, the focus guide is displayed superimposed on the LV image in the right area.

In S604, the system control unit 50 moves the AF frame displayed on the display unit 28 in the direction instructed in S601.

In S605, the system control unit 50 moves the focus guide displayed on the display unit 28 in the direction instructed in S601. If the focus guide display setting is turned off by the user, this step is skipped. At this time, the entire focus guide is moved, but it is also possible to move only the focus detection area instead of the entire focus guide.

In S606, the system control unit 50 moves the enlargement frame displayed on the display unit 28 in conjunction with the position of the AF frame or the frame indicating the focus detection area of the focus guide that was moved in S604 or S605.

In S607, the system control unit 50 determines whether the direction instruction given by the MC 82 or the cross key 74 determined in S601 is a direction instruction to the right. If it is to the right, the process proceeds to S608; if not, the process proceeds to S611.

In S608, the system control unit 50 determines whether the position coordinates of the center of the enlargement frame before the instruction was given in S601 were Lmax. If the center coordinates are Lmax, the process proceeds to S609; if not, the process proceeds to S610. If the position coordinates of the center of the enlargement frame before the direction instruction was given were Lmax, the right side of the enlargement frame was in contact with line 705 before the direction instruction was input.

In S609, the system control unit 50 moves the enlargement frame so that its center is at coordinate (Rmin, y coordinate before the direction is specified). In other words, when the enlargement frame is displayed in the left region so that its right side is in contact with line 705, and an instruction to move the enlargement frame further to the right is input, the enlargement frame moves to the right region. By controlling in this way, the enlargement frame is not displayed across the left and right regions.

In this step, since S602 returns Yes, it can be determined that a twin lens is attached to the digital camera 100. Therefore, there are two LV images displayed on the display unit 28, each of which divides the display unit 28 into left and right halves. In other words, if the display position of the enlargement frame is moved so that it straddles line 705 in Figure 7, i.e., so that it includes both the left and right areas, when the user issues an enlargement command, an enlarged image including both the left and right LV images will be displayed, which may confuse the user. Therefore, when moving the enlargement frame, the enlargement frame is moved so that it does not straddle line 705 (does not include both the left and right areas), and when the left or right side of the enlargement frame reaches the boundary between the left and right areas indicated by line 705, the entire enlargement frame is displayed in only one of the left or right areas.

In S610, the system control unit 50 moves the display position of the enlargement frame to the right. At this time, the amount of movement of the display position in response to one direction instruction is assumed to be one pixel on the display unit 28. Note that if the right side of the enlargement frame reaches the right side of area 701R (the right edge of the display unit 28), the enlargement frame will not move even if a rightward movement instruction is given.

In S611, the system control unit 50 determines whether the direction instruction given by the MC 82 or the cross key 74 determined in S601 is left. If it is left, the process proceeds to S612; if not, the process proceeds to S615.

In S612, the system control unit 50 determines whether the center position of the enlargement frame before the instruction was given in S601 was Rmin. If the center coordinate is Rmin, proceed to S613; if not, proceed to S614. If the center position coordinate of the enlargement frame before the direction instruction was given was Rmin, the left side of the enlargement frame was in contact with line 705 before the direction instruction was input.

In S613, the system control unit 50 moves the enlargement frame so that its center is at coordinate (Lmax, y coordinate before the direction is specified). That is, when the enlargement frame is displayed in the right region so that its left side is in contact with line 705, and an instruction to move the enlargement frame further to the left is input, the enlargement frame moves to the left region. By controlling in this way, the enlargement frame is not displayed across the left and right regions.

In S614, the system control unit 50 moves the display position of the enlargement frame to the left. At this time, the amount of movement of the display position in response to one direction instruction is assumed to be one pixel on the display unit 28. Note that if the left side of the enlargement frame reaches the left side of area 701L (the left edge of the display unit 28), the enlargement frame will not move even if an instruction to move to the left is given.

In S615, the system control unit 50 determines whether the direction instruction given by the MC 82 or the cross key 74 determined in S601 is up or down. If it is up or down, the process proceeds to S616; if not, the process proceeds to S617.

In S616, the system control unit 50 moves the display position of the enlargement frame in the specified vertical direction. At this time, the amount of movement of the display position in response to one directional instruction is assumed to be one pixel on the display unit 28.

If the system control unit 50 determines in S602 that a twin lens is attached to the digital camera 100, only the enlargement frame moves in response to the movement instruction (directional instruction), and the focus guide does not move from its already displayed position. In other words, in S609, S610, S613, S614, and S616, only the enlargement frame moves in response to the directional instruction, and the focus guide does not move (it remains fixed at the center of the LV image in the displayed area).

The above is the flow for controlling the movement of items such as the enlargement frame and focus guide when a directional instruction is input using the MC 82 or the cross key 74.

Next, we will explain the control that occurs when an operation is performed to return the display positions of items such as the enlargement frame and focus guide to their predetermined positions. The system control unit 50 displays items such as the enlargement frame and focus guide at predetermined positions in response to receiving a predetermined operation (such as pressing the MC82 or the SET button 75). When a twin-eye image is being displayed, the system control unit 50, upon receiving the predetermined operation, displays the item in the center of either the right or left area in which the item was displayed before receiving the predetermined operation. On the other hand, when a twin-eye image is not being displayed, the system control unit 50, upon receiving the predetermined operation, displays the item in the center of the screen. This makes it possible to appropriately control the display position of an item depending on whether the displayed image is a twin-eye image or not.

In S617, the system control unit 50 determines whether the center of the MC 82 has been pressed (not an up/down/left/right movement operation) or the SET button 75 has been pressed. If the button has been pressed or depressed, the process proceeds to S618; if not, the process proceeds to S801 in Figure 8. Pressing the MC 82 or pressing the SET button 75 in this step can be considered a center movement instruction to move the currently displayed enlargement frame to the center of the LV image of the displayed area (return to center).

In S618, similar to S411, the system control unit 50 obtains the type of attached lens via the communication terminals 6 and 10 and determines whether it is a twin lens. If it is a twin lens, the process proceeds to S623; if not, the process proceeds to S619.

In S619, similar to S421, the system control unit 50 determines whether the current focus mode of the camera is AF mode or MF mode. If it is AF mode, proceed to S620; if it is MF mode, proceed to S621.

In S620, the system control unit 50 moves the AF frame to the center of the LV image displayed on the display unit 28.

In S621, the system control unit 50 moves the focus guide frame to the center of the LV image displayed on the display unit 28.

In S622, the system control unit 50 moves the enlargement frame to the center of the LV image displayed on the display unit 28 in conjunction with the position of the AF frame or focus detection area of the focus guide.

In S623, the system control unit 50 determines whether the enlargement frame is displayed in the LV image in the right area. That is, it determines whether the enlargement frame is displayed in area 701R in FIG. 7. If so, proceed to S625; if not, proceed to S624.

In S624, since the determination in S623 is No, the system control unit 50 moves the display position of the enlargement frame to the center of the LV image displayed in the left area. In other words, it moves to the center of the LV image displayed in area 701L in FIG. 7.

In S625, since the determination in S623 is Yes, the system control unit 50 moves the display position of the enlargement frame to the center of the LV image displayed in the right area. In other words, it moves to the center of the LV image displayed in area 701R in Figure 7.

The above is the flow showing the control when an operation is performed to return the display positions of items such as the magnification frame and focus guide to their specified positions.

Next, we will explain the enlargement process and magnification rate change process that are performed when the enlargement button 78 is pressed.

Figure 8 is a control flowchart relating to the enlargement and shooting operations of the LV image displayed on the display unit 28 according to this embodiment. A display example on the display unit 28 when the control flowchart of Figure 8 is executed will be described using Figure 9. Details of the display example shown in Figure 9 will be explained after the explanation of the control flowchart of Figure 8.

In S801, the system control unit 50 determines whether the enlarge button 78 has been pressed. If it has been pressed, the process proceeds to S802; if not, the process proceeds to S819. In this embodiment, the enlargement instruction is given by pressing the enlargement button 78, which is a depressible physical member, but the enlargement instruction may also be given by pinching in on the touch panel 70a, and the enlarged display may be canceled by pinching out.

In S802, similar to S411, the system control unit 50 obtains the type of attached lens via the communication terminals 6 and 10 and determines whether it is a twin lens. If it is a twin lens, the process proceeds to S803; if not, the process proceeds to S812.

In S803, the system control unit 50 enlarges the LV image at the position where the enlargement frame is displayed by six times and displays it on the display unit 28. The size of the enlargement frame displayed before the enlargement process is set in advance so that when the enlargement process is performed at a six-times magnification, the entire enlarged image is displayed on the display unit 28. The six-times magnification in this case is based on the state in which the LV image displayed on the display unit 28 is not enlarged (at the same magnification). Display examples at this time are shown in Figures 9(c) and (d).

In S804, the system control unit 50 determines whether an operation to move the enlargement position (enlarged area) has been performed. If an operation to move the enlargement position has been performed, the process proceeds to S805; if not, the process proceeds to S806. As explained using the control flowchart in Figure 6, the operation to move the enlargement position is assumed to be a directional instruction using the MC 82 or the direction keys of the cross key 74. Note that the operation can also be performed by operating the touch panel 70a.

In S805, the system control unit 50 moves the enlargement position only within the currently enlarged area on the left or right of the display area of the two LV images displayed on the display unit 28, based on the enlargement position movement operation in S804. In other words, even if the area to be enlarged is in contact with line 705 in either the left or right area, and a movement operation is performed to move the center of the enlargement position closer to line 705, the movement operation is invalidated and the enlargement position is not moved.

As shown in S607 to S614, when the enlargement frame is moved while the LV image is at full size, the user can see the enlargement frame displayed on the display unit 28, so the user will not lose track of the enlargement frame even if it can be moved from one area where the enlargement frame is displayed to another area. In contrast, if the enlarged position moves across areas when an enlarged image is displayed, it is difficult for the user to intuitively understand which position the enlarged image is displaying.

Let's assume that a user wishes to check the left edge of the LV image in the right area in more detail (where the left edge of the enlargement position is in contact with line 705). If the user unintentionally moves the enlargement frame while enlarging and viewing the left edge of the LV image in the right area, the enlarged area may become the right edge of the LV image in the left area, which could confuse the user. Therefore, when an enlarged image is displayed and the user instructs to move the enlargement position, if the enlargement position is at the edge of each LV image, the enlargement position will not move beyond the left or right area.

In S806, the system control unit 50 determines whether a left/right switching operation has been performed. If a left/right switching operation has been performed, the process proceeds to S807; if not, the process proceeds to S808. A left/right switching operation refers to switching from one image to the other of two images lined up side by side. Specifically, a left/right switching operation refers to pressing a button with a left/right switching function (for example, an INFO button (not shown)).

In S807, the system control unit 50 moves the enlargement position from the area where the enlargement position was set before the button with the left/right switching function was pressed to the other area, and performs an enlarged display. At this time, the enlargement position is moved so that the relative position of the enlargement position in the area where the enlargement position was set before the button with the left/right switching function was pressed is maintained even after moving to the other area. For example, when an LV image of the right area is enlarged, the distance from the center of the LV image of the right area to the enlarged position is calculated. In response to the user's left/right switching operation, the calculated distance from the center of the LV image to the enlarged position is applied to the distance from the center of the LV image of the opposite area (here, the left area), and displayed on the display unit 28 as the enlarged position. By using this control, when the user wants to check the same position on both the left and right LV images displayed, switching between the left and right LV images can be performed more easily with fewer steps, and does not require time during shooting.

In S808, the system control unit 50 determines whether the enlarge button 78 has been pressed. If it has been pressed, the process proceeds to S809; if not, the process returns to S804.

In S809, the system control unit 50 references the system memory 52 and determines whether the magnification of the LV image displayed on the display unit 28 is 15x. If it is 15x, the process proceeds to S810; if not, the process proceeds to S811.

In S810, the system control unit 50 cancels the enlarged state of the LV image and displays the non-enlarged (actual size) LV image on the display unit 28. Display examples at this time are shown in Figures 9(a) and (b).

In S811, the system control unit 50 enlarges and displays the LV image on the display unit 28 at a magnification of 15x at the display position of the enlargement frame superimposed on the LV image. The magnification of 15x in this case is based on the magnification of the LV image in an unenlarged (actual size) state. Display examples are shown in Figures 9(e) and (f).

In S812, since the determination in S802 was No, the system control unit 50 enlarges and displays the LV image on the display unit 28 at a magnification of 6x at the display position of the enlargement frame superimposed on the LV image. The magnification of 6x in this case is based on the magnification of the LV image in an unenlarged (actual size) state.

In S813, similar to S804, the system control unit 50 determines whether an operation to move the enlargement position has been performed. If an operation to move the enlargement position has been performed, the process proceeds to S814; if not, the process proceeds to S815.

In S814, the system control unit 50 moves the enlargement position within the display area of the LV image based on the operation to move the enlargement position. In this step, since S802 returns No, it is determined that the lens attached to the digital camera 010 is a single lens or that no lens is attached. In other words, since only one LV image is displayed on the display unit 28, the enlargement position can be moved without considering the left and right areas as in S805.

In S815, similar to S808, the system control unit 50 determines whether the enlarge button 78 has been pressed. If it has been pressed, the process proceeds to S816; if not, the process returns to S813.

In S816, the system control unit 50 references the system memory 52 and determines whether the current magnification of the LV image is 15x. If it is 15x, proceed to S817; if not, proceed to S818.

In S817, similar to S810, the system control unit 50 cancels the enlarged state of the LV image and displays the non-enlarged (actual size) LV image on the display unit 28.

In S818, the system control unit 50 enlarges and displays the LV image on the display unit 28 at a magnification of 15x at the display position of the enlargement frame superimposed on the LV image. The magnification of 15x here is based on the magnification of the LV image in an unenlarged (actual size) state.

In S819, the system control unit 50 determines whether the first shutter switch 62 is on. If the first shutter switch 62 is on, the process proceeds to S820; if not, the process proceeds to S830. As mentioned above, the first shutter switch 62 being on indicates that the shutter button 61 is half-pressed. In other words, it can be assumed that the user is about to take a picture.

In S820, similar to S411, the system control unit 50 obtains the type of attached lens via the communication terminals 6 and 10 and determines whether it is a twin lens. If it is a twin lens, the process proceeds to S823; if not, the process proceeds to S821.

In S821, the system control unit 50 determines whether the focus mode is set to AF mode. If it is set to AF mode, the process proceeds to S822; if it is not set to MF mode (if it is set to MF mode), the process proceeds to S823. Switching between AF mode and MF mode can be performed using the settings menu screen or a switch provided on the outside of the lens unit 150.

In S822, the system control unit 50 performs AF processing based on the AF frame position.

In S823, the system control unit 50 performs other shooting preparation processes such as AE and AWB.

In S824, the system control unit 50 determines whether the second shutter switch 64 is on. If the second shutter switch 64 is on, i.e., if the shutter button 61 is fully pressed, the process proceeds to S825; if not, the process proceeds to S829.

In S825, similar to S411, the system control unit 50 obtains the type of attached lens via the communication terminals 6 and 10 and determines whether it is a twin lens. If it is a twin lens, the process proceeds to S826; if not, the process proceeds to S827.

In S826, the system control unit 50 performs a series of image capture processes, including recording the image captured by the twin lenses and twin lens information as an image file on the recording medium 200.

In S827, the system control unit 50 performs a series of image capture processes, including recording the captured image and normal (single-lens) lens information as an image file on the recording medium 200.

In S828, the system control unit 50 determines whether the first shutter switch 62 continues to be on. If the first shutter switch 62 continues to be on, the process returns to S824; if not, the process proceeds to S830.

In S829, the system control unit 50 determines whether any other operation other than those described above has been detected. If any other operation has been detected, the process proceeds to S830; if not, the process proceeds to S831. Specifically, the system control unit 50 determines whether the menu button 81, play button 79, etc. has been pressed.

In S830, the system control unit 50 starts executing other processing corresponding to the detected other operation. If the menu button 81 is pressed, a settings menu screen is displayed, and if the play button 79 is pressed, an image stored on the recording medium 200 is displayed on the display unit 28.

In S831, the system control unit 50 determines whether the shooting standby state has ended. For example, if the shooting standby state has ended due to the power being turned off, the control flowchart in FIG. 8 ends; if not, the process returns to S401 in FIG. 4.

Using Figures 9(a) to (f), we will explain the LV image displayed on the display unit 28 when the user issues an enlargement command.

Figure 9(a) shows an example display when the magnification is 1x (i.e., no magnification) and the magnification frame is displayed superimposed on the left region, i.e., the LV image (LV900R) captured via the right-eye optical system 301R. The display unit 28 displays the LV900R captured via the right-eye optical system 301R and the LV900L captured via the left-eye optical system 301L. As mentioned above, the LV900R displayed in the left region was captured via the right-eye optical system 301R, and the LV900L displayed in the right region was captured via the left-eye optical system 301L. Display items 901 and 902 are displayed to notify the user that the images are reversed. Display item 901 displays "R" to indicate right, and display item 902 displays "L" to indicate left. When the enlargement button 78 is pressed once in the state shown in Figure 9(a), the state changes to that shown in Figure 9(c), and when the left/right switching button (not shown) is pressed once, the enlargement frame superimposed on the LV900R moves to the same relative position on the LV900L, and the state changes to that shown in Figure 9(b).

Figure 9(b) shows a display example where the magnification is 1x (i.e., no magnification) and the magnification frame is displayed superimposed on the right region, i.e., the LV image (LV900L) captured by the left eye optical system 301L. In Figure 9(b), the magnification frame 904 is displayed superimposed on the LV900L. Pressing the magnification button 78 once in the state shown in Figure 9(b) transitions to the state shown in Figure 9(d), and pressing the left/right switching button once moves the magnification frame superimposed on the LV900L to the same relative position on the LV900R, transitioning to the state shown in Figure 9(a).

Figure 9(c) shows an example of a display when the LV900R is enlarged at a magnification of 6x. The enlarged image displayed on the display unit 28 has a display item 901 indicating which optical system was used to capture the image, superimposed on the enlarged LV image, LV910R.

Figure 9(d) shows an example of a display when the LV900L is enlarged at a magnification of 6x. The enlarged image displayed on the display unit 28 has a display item 902 indicating which optical system was used to capture the image, superimposed on the enlarged LV image LV910L.

Figure 9(e) shows an example of a display in which the LV900R is enlarged at a magnification of 5x. The enlarged image displayed on the display unit 28 is superimposed on the LV920R enlarged at 15x, and a display item 901 showing the LV image captured by the right eye optical system 301R is displayed.

Figure 9(f) shows an example of a display in which the LV900L is enlarged at a magnification of 5x. The enlarged image displayed on the display unit 29 is superimposed on the LV920L enlarged at 15x, and a display item 902 showing the LV image captured by the left eye optical system 301L is displayed.

That is, Figures 9(a) and (b) are LV images displayed on the display unit 28 when the magnification is 1x (i.e., no magnification), Figures 9(c) and (d) are LV images displayed when the magnification is 6x, and Figures 9(e) and (f) are LV images displayed on the display unit 28 when the magnification is 15x.

Each time the zoom button 78 is pressed, the magnification of the LV image displayed on the display unit 28 changes in the following order: 1x → 6x → 5x → 1x. Also, when the left/right switch button is pressed, if the magnification is 1x, the magnification frame is switched to be superimposed on the other LV image. In other words, if the magnification frame is superimposed on the LV900R displayed in the left area, the display area is switched so that it is superimposed on the LV900L displayed in the right area. If the magnification is other than 1x, the magnification position is switched to the area of the other LV image that is in the same relative position. The magnification does not change in this case.

In addition, while it has been explained that operations such as switching display modes, moving the enlargement frame or enlargement position, and enlargement are performed using operation buttons with dedicated functions, these functions may also be assigned to buttons to which various arbitrary functions can be assigned.

As described above, when a lens having two optical systems (twin lens) is attached and image capture is performed, the enlargement frame indicating the enlargement position of the LV image is not displayed across the boundary between the two LV images during capture. Two LV images captured through the two optical systems are displayed side by side on the display unit, and the enlargement frame is not displayed or moved across the boundary between the two LV images. This makes it possible to avoid an image containing both LV images being enlarged when the user issues an enlargement command, reducing user confusion.

In addition, when two LV images are displayed at the same size (not enlarged), if the user instructs further movement to the right after the enlargement frame has reached the right edge of the LV image displayed in the left area, the enlargement frame is moved so as to jump over the boundary between the two LV images. In other words, the enlargement frame is controlled to move from the right edge of the LV image in the left area to the left edge of the LV image in the right area. This ensures that the range indicated by the enlargement frame is not included in both LV images, as described above, and also allows the enlargement frame to move smoothly between the two LV images.

On the other hand, if one of the two LV images is enlarged, even if an instruction to move the enlargement position is given when the edge of the boundary of the currently enlarged image (the right edge if the left area is enlarged, or the left edge if the right area is enlarged) has been reached, the enlargement position will not move in the indicated direction. In other words, if the user has difficulty visually recognizing the current enlargement position, the enlargement position will not move beyond the area (the boundary of the LV image). This reduces the chance of unintentionally crossing the boundary of the LV image and reduces user confusion.

In addition, when a lens with two optical systems (twin lens) is attached, the focus guide and magnification frame are not linked (de-linked). As a result, when two LV images are displayed, as with a twin lens, and it is difficult to check the entire LV image in detail without magnification, there is a high possibility that the user will want to enlarge the LV image regardless of the focus position to check the LV image in more detail. For this reason, rather than allowing only the position of the focus guide, which has a frame indicating the focus detection area, to be enlarged, the focus guide and AF frame are de-linked so that the user can enlarge the position of their choice. On the other hand, when a normal lens (single lens) is attached, the focus guide/AF frame and magnification frame are primarily linked, and moving the focus guide/AF frame also moves the position of the magnification frame. When a single lens is attached, only one LV image is displayed, and the LV image is displayed larger on the display than when two LV images are displayed. This makes it easier to check the LV image in more detail at 100% magnification than when a twin lens is attached.

The various controls described above as being performed by the system control unit 50 may be performed by a single piece of hardware, or the entire device may be controlled by multiple pieces of hardware (e.g., multiple processors or circuits) sharing the processing.

While the present invention has been described in detail based on preferred embodiments, the present invention is not limited to these specific embodiments, and various forms within the scope of the gist of the invention are also included in the present invention. Furthermore, each of the above-described embodiments merely represents one embodiment of the present invention, and each embodiment can be combined as appropriate.

In addition, while the above-described embodiment has been described with reference to an example in which the present invention is applied to a digital camera 100, this is not limited to this example and the present invention can be applied to any imaging control device that can display images captured by two optical systems. In other words, the present invention can be applied to personal computers, PDAs, mobile phone terminals, portable image viewers, printer devices with displays, digital photo frames, music players, game consoles, e-book readers, home appliances, in-vehicle devices, medical equipment, and the like.

The present invention can also be applied to a control device that communicates with an imaging device (including a network camera) via wired or wireless communication, and remotely controls the imaging device, rather than just the imaging device itself. Examples of devices that remotely control an imaging device include smartphones, tablet PCs, and desktop PCs. The imaging device can be remotely controlled by issuing commands from the control device to the imaging device to perform various operations and settings based on operations or processes performed on the control device. It is also possible to receive live view images captured by the imaging device via wired or wireless communication and display them on the control device.

(Other embodiments)
The present invention can also be realized by executing the following process. That is, software (programs) that realize the functions of the above-described embodiments are supplied to a system or device via a network or various storage media, and the computer (or CPU, MPU, etc.) of the system or device reads and executes the program code. In this case, the program and the storage media storing the program constitute the present invention.

Claims (13)

an acquisition means for acquiring a third image in which a first image captured via a first optical system and a second image captured via a second optical system and having a parallax with respect to the first image are arranged side by side;
A receiving means for receiving a location designation by a user;
a display control means for displaying on a display means the third image, a first item indicating a focus detection area, and a second item different from the first item indicating a target range of the image to which a predetermined process is to be applied,
The imaging control device is characterized in that the display control means controls the second item to move without moving the first item in response to a position specification made to the reception means. The display control means
If a first type of lens is attached to the imaging control device, in response to a position specification being made to the accepting means, the second item is moved without moving the first item;
The imaging control device described in claim 1, characterized in that when a second type of lens is attached to the imaging control device, the imaging control device controls the first item and the second item to move together in response to a position specification made to the reception means. An imaging control device according to claim 1 or 2, wherein the first item is at least one of a frame indicating the focus detection area in a focus guide that indicates the degree of focus for the focus detection area in manual focus mode, or an autofocus frame in autofocus mode. An imaging control device as described in claim 3, characterized in that the focus guide is an item consisting of the focus detection area and multiple indicators that indicate the degree of focus based on the relative display positions of the indicators. further comprising touch detection means capable of detecting a touch operation on a display surface of the display means;
4. The imaging control device according to claim 1, wherein, when a touch operation is performed on the touch detection means, the display control means displays the first item and the second item superimposed on an image displayed on the side where the touch operation is performed. The device further includes a setting unit for setting whether or not the first item is to be displayed on the display unit,
The imaging control device according to any one of claims 1 to 5, characterized in that when the setting is such that the first item is not displayed, the display control means displays only the second item on the display means, and controls the second item to move in response to a position specification made to the reception means. An imaging control device according to any one of claims 1 to 6, characterized in that, when the image displayed on the display means is not enlarged, if the second item reaches the boundary between the first image and the second image and the user specifies a further position to the reception means, the display control means displays the second item so that it includes only one of the first image and the second image. An imaging control device according to any one of claims 1 to 7, characterized in that the display control means controls the display position of the first item so that it does not move from the first image, even if the second item moves from the first image to the second image in response to a position specification made to the reception means while the first item and the second item are displayed in the first image. An imaging control device according to any one of claims 1 to 8, characterized in that when a first position specification is made to the reception means to move the center of the target range indicated by the second item in either the first image or the second image after the predetermined processing has been performed, and the target range shown on the display means before the first position specification is an area located on the boundary, the display control means controls the target range not to move even when the first position specification is made. An imaging control device according to any one of claims 1 to 9, characterized in that the predetermined processing is enlarged display. an acquiring step of acquiring a third image in which a first image captured via a first optical system and a second image captured via a second optical system and having a parallax with respect to the first image are arranged side by side;
a reception step for receiving a location specification by a user;
a display control step of displaying on a display means the third image, a first item indicating a focus detection area, and a second item different from the first item indicating a target range of the image to which predetermined processing is applied,
A control method for an imaging control device, characterized in that the display control step controls the second item to move without moving the first item in response to a position specification made to the reception step. A program for causing a computer to function as each means of the imaging control device described in any one of claims 1 to 10. A computer-readable recording medium storing a program for causing a computer to function as each of the means of the imaging control device described in any one of claims 1 to 10.