JP6579486B2 - Remote operation system - Google Patents

Description

  The present invention relates to a remote operation system capable of remotely operating a photographing apparatus.

  In recent years, there has been known a remote operation system capable of remotely operating a digital camera using a portable information processing terminal by connecting the portable information processing terminal such as a smartphone to a digital camera equipped with a wireless communication function. Has been put to practical use. For example, Patent Document 1 describes a specific configuration of this type of remote operation system.

  In the remote operation system described in Patent Literature 1, when a smartphone and a digital camera are connected via Wi-Fi, a through image representing a scene photographed by the digital camera is transferred to the smartphone in real time. For example, the user can change the zoom magnification of the digital camera by performing a zoom operation on a GUI (Graphical User Interface) on the smartphone, and also performs a release instruction operation on the GUI on the smartphone. As a result, it is possible to perform shooting with a digital camera (capturing a still image or starting recording a moving image). In addition, the user can check the captured image recorded in the digital camera on the display screen of the smartphone by performing a reproduction instruction operation on the GUI on the smartphone.

JP 2014-220715 A

  For example, consider a case where a user confirms a captured image recorded in a digital camera on a display screen on a smartphone while traveling on a train or the like. In this case, a situation is conceivable in which the user holds a smartphone in his hand and performs a GUI operation such as a reproduction instruction, and puts a digital camera without a storage place during movement into a bag or a pocket of clothes. Under these circumstances, if the user accidentally touches the GUI on the smartphone, or the release button of the digital camera is pressed and pressed in the bag or pocket, the digital camera's lens barrel will move in the bag or pocket. The feeding operation is performed.

  Often, there is not enough space in the bag or clothing pocket for the digital camera barrel to extend. If there is not enough space for the digital camera barrel to extend, if the lens barrel is extended, the lens barrel is compressed in the bag or pocket, and the mechanism around the lens barrel is loaded. May break down.

  The present invention has been made in view of the above circumstances, and the object of the present invention is to provide a remote operation suitable for preventing an unintended lens barrel extension operation of an imaging apparatus capable of remote operation by an information processing terminal. Is to provide a system.

  A remote operation system according to an embodiment of the present invention is a system capable of remotely operating a photographing apparatus using an information processing terminal. In such a system, the information processing terminal transmits a prohibition command for prohibiting the operation of extending the lens barrel of the imaging apparatus to the imaging apparatus. In accordance with the prohibit command received from the information processing terminal, the photographing apparatus shifts to a prohibit mode in which the lens barrel extension operation is prohibited.

  In one embodiment of the present invention, the photographing apparatus may be configured not to cancel the prohibit mode unless receiving a cancel command for canceling the prohibit command from the information processing terminal.

  In one embodiment of the present invention, the information processing terminal displays a user interface screen using a Web application, and when a predetermined user operation is performed on the displayed interface screen, a prohibited command is sent to the photographing apparatus. It is good also as a structure which transmits.

  In one embodiment of the present invention, the photographing apparatus may be configured to retract the lens barrel and close the lens barrier when the prohibition mode is entered.

  In one embodiment of the present invention, when the imaging device is activated in a state where an operation on a specific operation member is performed, the imaging device is automatically set to a mode connectable to the information processing terminal and is set to a prohibit mode. It is good also as a structure set up automatically.

  In one embodiment of the present invention, the information processing terminal may transmit a restart command instructing the imaging apparatus to restart. In addition, when the imaging apparatus is restarted according to the restart command received from the information processing terminal, the photographing apparatus may be automatically set to a mode connectable to the information processing terminal and automatically set to a prohibit mode. Good.

  According to an embodiment of the present invention, there is provided a remote operation system suitable for preventing an unintended lens barrel extension operation of an imaging apparatus that can be remotely operated by an information processing terminal.

It is a block diagram which shows the structure of the remote operation system which concerns on one Embodiment of this invention. It is a block diagram which shows the structure of the imaging device with which the remote operation system which concerns on one Embodiment of this invention is equipped. It is a block diagram which shows the structure of the portable information processing terminal with which the remote operation system which concerns on one Embodiment of this invention is equipped. It is a block diagram which shows the structure of the web server with which the remote operation system which concerns on one Embodiment of this invention is equipped. It is a figure which shows the screen at the time of starting of the Web application which concerns on one Embodiment of this invention. It is a figure which shows the main menu of the web application which concerns on one Embodiment of this invention. It is a figure which shows the utility screen of the Web application which concerns on one Embodiment of this invention. It is a figure which shows the Wi-Fi setting screen of the web application which concerns on one Embodiment of this invention. It is a figure which shows the connection sequence of the Web application and imaging | photography apparatus which are performed in one Embodiment of this invention. It is a figure which assists description of the optimization process of an event. It is a figure which shows the subcommand screen (Left) of the web application which concerns on one Embodiment of this invention. It is a figure which shows the subcommand screen (Right) of the web application which concerns on one Embodiment of this invention. It is a figure which shows the advance setting screen of the web application which concerns on one Embodiment of this invention. It is a figure which shows the quick view screen (Lastest) of the web application which concerns on one Embodiment of this invention. It is a figure which shows the quick view screen (Recent) of the Web application which concerns on one Embodiment of this invention. It is a figure which shows the security setting screen of the web application which concerns on one Embodiment of this invention. It is a figure which shows the reset execution screen of the Web application which concerns on one Embodiment of this invention. It is a figure which shows the viewer screen of the web application which concerns on one Embodiment of this invention. It is a figure which shows the gallery screen of the web application which concerns on one Embodiment of this invention. It is a figure which shows the viewer screen of the web application which concerns on one Embodiment of this invention. It is a figure which shows the preset screen of the web application which concerns on one Embodiment of this invention. It is a figure which shows the configuration screen of the Web application which concerns on one Embodiment of this invention.

  Hereinafter, a remote operation system according to an embodiment of the present invention will be described with reference to the drawings.

[Configuration of remote operation system 1]
FIG. 1 is a block diagram showing a configuration of a remote operation system 1 according to an embodiment of the present invention. As shown in FIG. 1, the remote operation system 1 includes a photographing apparatus 10, a portable information processing terminal 20, and a web server 30. In this embodiment, the imaging device 10 is a compact digital camera, and the portable information processing terminal 20 is a smartphone. In another embodiment, the photographing apparatus 10 may be another form of photographing apparatus such as a digital single-lens reflex camera, a mirrorless single-lens camera, a video camera, or a camcorder. The portable information processing terminal 20 may be another type of portable information processing terminal such as a notebook PC, a tablet PC, or a portable game machine.

[Configuration of Shooting Device 10]
FIG. 2 is a block diagram illustrating a configuration of the imaging apparatus 10 according to an embodiment of the present invention. As shown in FIG. 2, the photographing apparatus 10 includes a system controller 100, an operation unit 102, a drive circuit 104, a photographing lens 106, a diaphragm 108, a shutter 110, a solid-state image sensor 112, a signal processing circuit 114, an image processing engine 116, A buffer memory 118, an LCD (Liquid Crystal Display) 120, a ROM (Read Only Memory) 122, a nonvolatile memory 124, a card interface 126, and a Wi-Fi interface 128 are provided. The photographing lens 106 is a zoom lens having a plurality of lenses, but is shown as a single lens for convenience in FIG.

  The operation unit 102 includes various buttons and dials necessary for the user to operate the photographing apparatus 10 such as a power button, a release button, and a photographing mode button. When the user operates the power button, power is supplied from a battery (not shown) to various circuits of the photographing apparatus 10 through a power line.

  The system controller 100 includes a CPU (Central Processing Unit) and a DSP (Digital Signal Processor). After supplying power, the system controller 100 accesses the ROM 122, reads out a control program, loads it into a work area (not shown), and executes the loaded control program to control the entire photographing apparatus 10.

  When the release button is operated, the system controller 100 is measured by, for example, a photometric value calculated based on an image picked up by the solid-state image sensor 112 or an exposure meter (not shown) built in the photographing apparatus 10. The diaphragm 108 and the shutter 110 are driven and controlled via the drive circuit 104 so that proper exposure can be obtained based on the photometric values. More specifically, drive control of the aperture 108 and the shutter 110 is performed based on an AE function specified by a shooting mode button, such as a program AE (Automatic Exposure), shutter priority AE, aperture priority AE, or the like. Further, the system controller 100 performs AF (Autofocus) control together with AE control. An active method, a phase difference detection method, a contrast detection method, or the like is applied to the AF control. The AF mode includes a central single-point ranging mode using a single central ranging area, a multi-point ranging mode using a plurality of ranging areas, and the like. The system controller 100 controls driving of the photographing lens 106 via the driving circuit 104 based on the AF result, and adjusts the focus of the photographing lens 106. Since the configuration and control of this type of AE and AF are well known, detailed description thereof is omitted here.

  The light flux from the subject passes through the photographing lens 106, the diaphragm 108, and the shutter 110 and is received by the light receiving surface of the solid-state image sensor 112. The solid-state imaging device 112 is a single-plate color CCD (Charge Coupled Device) image sensor having a Bayer pixel arrangement. The solid-state imaging device 112 accumulates an optical image formed by each pixel on the light receiving surface as a charge corresponding to the amount of light, and generates R (Red), G (Green), and B (Blue) image signals. Output. The solid-state image sensor 112 is not limited to a CCD image sensor, and may be replaced with a CMOS (Complementary Metal Oxide Semiconductor) image sensor or other types of imaging devices. The solid-state image sensor 112 may also have a complementary color filter mounted thereon.

  The signal processing circuit 114 performs predetermined signal processing such as clamping and demosaicing on the image signal input from the solid-state imaging device 112 and outputs the processed signal to the image processing engine 116. The image processing engine 116 performs predetermined signal processing such as matrix operation, Y / C separation, and white balance on the image signal input from the signal processing circuit 114 to generate a luminance signal Y and color difference signals Cb and Cr. , And compressed in a predetermined format such as JPEG (Joint Photographic Experts Group). The buffer memory 118 is used as a temporary storage location for processing data when the image processing engine 116 executes processing. The storage format of the captured image data is not limited to the JPEG format, and may be a RAW format in which only minimal image processing (for example, black level correction) is performed.

  A memory card (not shown) is detachably inserted into the card slot of the card interface 126.

  The image processing engine 116 can communicate with the memory card via the card interface 126. The image processing engine 116 stores the generated captured image data in the memory card or the nonvolatile memory 124.

  Further, the image processing engine 116 buffers the generated luminance signal Y and color difference signals Cb and Cr in a frame memory (not shown) in units of frames. The image processing engine 116 sweeps the buffered signal from each frame memory at a predetermined timing, converts it into a video signal of a predetermined format, and outputs it to the LCD 120. The LCD 120 modulates and controls the liquid crystal based on the image signal input from the image processing engine 116. Thereby, the photographed image of the subject is displayed on the display screen of the LCD 120. The user can view through a display screen of the LCD 120 a real-time through image (live view) captured with appropriate exposure and focus based on AE control and AF control.

  When the user performs a reproduction operation of the captured image, the image processing engine 116 reads the captured image data specified by the operation from the memory card or the nonvolatile memory 124, converts it into an image signal of a predetermined format, and outputs it to the LCD 120. To do. The LCD 120 modulates and controls the liquid crystal based on the image signal input from the image processing engine 116, so that a captured image of the subject is displayed on the display screen of the LCD 120.

[Configuration of Portable Information Processing Terminal 20]
FIG. 3 is a block diagram showing a configuration of the portable information processing terminal 20 according to the embodiment of the present invention. As shown in FIG. 3, the portable information processing terminal 20 includes a CPU 200, a main storage device 202 such as a RAM (Random Access Memory), an auxiliary storage device 204 such as a flash memory, a carrier communication interface 206, and a Wi-Fi interface 208. And a touch panel 210. In FIG. 2 and FIG. 3 to be described later, the connection of each block is not shown for convenience of simplifying the drawing.

  The CPU 200 accesses necessary hardware after the portable information processing terminal 20 is powered on. Immediately after the portable information processing terminal 20 is turned on, the CPU 200 accesses the auxiliary storage device 204, reads out an OS (Operating System) 204a, loads it into the main storage device 202, and activates it. Thereafter, the CPU 200 and the OS 204a cooperate to execute various processes by the portable information processing terminal 20. For example, in the auxiliary storage device 204, a plurality of types of applications including the browser 204b are installed. Various applications operate under the management of resources and processes by the OS 204a.

  The browser 204b is a Web browser capable of interpreting, for example, HTML (Hyper Text Markup Language), CSS (Cascading Style Sheets), JavaScript (registered trademark), and related specifications. The browser 204b generates a request message conforming to HTTP (Hypertext Transfer Protocol), accesses a URI (Uniform Resource Identifier) designated by a user operation or the like, and downloads content such as a Web page. The browser 204b interprets the downloaded HTML content and generates a DOM (Document Object Model) tree, a layout tree, and the like. The browser 204b sequentially renders each element of the content whose layout is determined in an image buffer in the main storage device 202. The content rendered in the image buffer is transferred to a VRAM (Video Random Access Memory) (not shown). The content is displayed on the touch panel 210 by transferring the rendering result to the VRAM. The user can input the content displayed on the touch panel 210 by pen touch or finger touch, scroll the screen by flick operation (operation to touch the screen with a finger), or pinch operation (between two fingers on the screen). Various operations such as zoom-in / zoom-out by an operation of enlarging or contracting can be performed.

[Configuration of Web Server 30]
FIG. 4 is a block diagram showing the configuration of the Web server 30 according to an embodiment of the present invention. As shown in FIG. 4, the Web server 30 includes a CPU 300, a main storage device 302 such as a RAM, an auxiliary storage device 304 such as an HDD (Hard Disk Drive), and a communication interface 306. The auxiliary storage device 304 stores a Web application 304a as Web content.

  The Web application 304a is an application for remotely operating the photographing apparatus 10, and is, for example, an HTML file in which a program such as JavaScript (registered trademark) is embedded.

[Acquire Web Application 304a]
The portable information processing terminal 20 is connected to a carrier line such as a 3G (3rd Generation) line or an LTE (Long Term Evolution) line via the carrier communication interface 206 and can access the Web server 30. When the URL (Uniform Resource Locator) of the Web application 304a of the Web server 30 is designated, the browser 204b requests the Web application 304a by a GET command.

  The web server 30 transmits the web application 304a stored in the auxiliary storage device 304 to the browser 204b in accordance with the request received from the browser 204b. The browser 204b stores the Web application 304a downloaded from the Web server 30 in a memory (for example, the non-volatile memory 124), and interprets resources included in the stored Web application 304a. As a result, the screen shown in FIG. 5 (the screen when the Web application 304 a is started, and hereinafter referred to as “start-up screen (or main command screen)” for convenience of explanation) is displayed on the touch panel 210. .

[Pairing between the photographing apparatus 10 and the Web application 304a]
A main menu button 1000 for displaying a main menu is arranged in the upper left corner of the startup screen shown in FIG. When a touch operation is performed on the main menu button 1000, the main menu shown in FIG. 6 appears by sliding from the screen side.

  As shown in FIG. 6, buttons “Commander”, “Viewer”, “Presets”, “Utilities”, “Configuration”, “About”, and “Power Off” are arranged side by side in the main menu. .

  When a touch operation is performed on the “Utilities” button in the main menu shown in FIG. 6, the utility screen shown in FIG. 7 is displayed. Information relating to the photographing apparatus 10 is displayed on the utility screen. The information related to the imaging device 10 includes information related to storage such as a memory card (Storage), remaining battery level (Battery), current time (Clock), and model name (Model).

  A “Sync Clock” button is arranged below the information regarding the photographing apparatus 10. Below the “Sync Clock” button, buttons linked to various setting screens are arranged side by side. Specifically, “Wi-Fi”, “Security”, and “Reset GR” buttons are arranged side by side.

  When a touch operation on the “Wi-Fi” button is performed on the utility screen shown in FIG. 7, a Wi-Fi setting screen shown in FIG. 8 is displayed. The Wi-Fi setting screen is a screen for setting the photographing apparatus 10 as an access point in order to link the Web application 304a (browser 204b) and the photographing apparatus 10. On the Wi-Fi setting screen, a form for entering “SSID (Service Set Identifier)” and “Password” necessary for pairing is arranged, and furthermore, wireless channel setting (automatic setting / manual setting) A radio button (Auto / Manual) is arranged. When these settings are input and the input settings are stored, the photographing apparatus 10 is registered as an access point.

  Note that when there are a plurality of photographing apparatuses 10, the Web application 304a can register each photographing apparatus 10 as a separate access point.

[Connection between Web Application 304a and Imaging Device 10]
FIG. 9 is a diagram illustrating a connection sequence between the Web application 304a and the photographing apparatus 10.

[S11 in FIG. 9 (Acquisition of Web Application 304a)]
In this processing step S11, when connecting the Web application 304a and the photographing apparatus 10, as shown in FIG. 9, the browser 204b communicates with the Web server 30 to download the latest Web application 304a. The browser 204b stores the downloaded web application 304a in a memory (for example, the nonvolatile memory 124), interprets resources included in the stored web application 304a, and the like. Thereby, the startup screen shown in FIG. 5 is displayed on the touch panel 210.

  In the present embodiment, the Web application 304a is downloaded every time the Web application 304a is activated. Therefore, the user can always use the latest Web application 304a. Note that the browser 204b may execute the web application 304a cached in the nonvolatile memory 124 when the web server 30 cannot be accessed due to a communication error or the like.

  A reload button 1002 is arranged in the upper right corner of the startup screen shown in FIG. 5, and a main screen 1004 is arranged in the upper center area of the startup screen. Here, the browser 204b downloads not only the Web application 304a but also the demo program from the Web server 30.

  The Web application 304 a includes a description for reproducing a predetermined demo image (moving image or still image) included in the demo program on the main screen 1004 when not connected to the photographing apparatus 10. Immediately after downloading the Web application 304a, the connection between the Web application 304a and the photographing apparatus 10 is not established. Therefore, a demo image is reproduced on the main screen 1004.

[S12 in FIG. 9 (connection attempt between Web application 304a and photographing apparatus 10)]
When the Web application 304a is downloaded in this processing step S11 (acquisition of the Web application 304a), switching from the carrier communication interface 206 to the Wi-Fi interface 208 is automatically performed. Next, the Web application 304a tries the Wi-Fi connection with the access point set on the Wi-Fi setting screen illustrated in FIG. 8, that is, the photographing apparatus 10 via the Wi-Fi interface 208.

  Note that when a plurality of access points are set, the Web application 304a may try Wi-Fi connection with the access points according to a preset priority order, for example. In addition, an access point to which a Wi-Fi connection is attempted may be arbitrarily designated by a user operation.

[S13 in FIG. 9 (Display Transfer Image)]
This processing step S13 is executed when a Wi-Fi connection between the Web application 304a and the photographing apparatus 10 is established.

  In the main screen 1004, a link to a fixed IP address (specifically, the photographing apparatus 10) is pasted, and a description requesting transfer of a display image (typically a through image) on the LCD 120 is embedded. ing.

  In this processing step S13, the Web application 304a reads the link pasted on the main screen 1004, accesses the photographing apparatus 10, and requests transfer of a through image. The Web application 304a reproduces a through image transferred from the photographing apparatus 10 on the main screen 1004 instead of a predetermined demo image (moving image or still image) included in the demo program.

  As described above, in this embodiment, a predetermined demo image (moving image or still image) included in the demo program is reproduced on the main screen 1004 during the standby time until the through image is reproduced. As a result, the user can perceive the user as if there was no waiting time until the through image was reproduced.

  On the other hand, consider a case where the Wi-Fi connection between the Web application 304a and the photographing apparatus 10 has failed. In this case, a predetermined demo image (moving image or still image) included in the demo program is continuously reproduced on the main screen 1004. Therefore, the user can enjoy the operation of the Web application 304a even when the Wi-Fi connection fails.

  Typically, when the photographing apparatus 10 is turned off or when the Wi-Fi connection mode of the photographing apparatus 10 is set to off, the positions of the photographing apparatus 10 and the portable information processing terminal 20 are The Wi-Fi connection fails when the user is away from the Wi-Fi communication range.

  The Web application 304a periodically checks the status of connection with the image capturing apparatus 10. When the Web application 304a detects that the connection with the photographing apparatus 10 is disconnected, the display on the main screen 1004 is changed from a through image transferred from the photographing apparatus 10 to a predetermined demo image (moving image or still image) included in the demo program. Screen).

  Typically, when the battery of the photographing apparatus 10 is exhausted, or when the photographing apparatus 10 and the portable information processing terminal 20 are separated from the Wi-Fi communication range, the mutual connection is disconnected.

  When a touch operation is performed on “Power Off” of the main menu shown in FIG. 6, the Web application 304 a instructs the photographing apparatus 10 to turn off the power. In this case, the Web application 304a immediately determines that the connection has been disconnected without checking the connection status in order to improve the response.

  Further, when the web application 304a is connected to the photographing apparatus 10, the web application 304a turns off the auto power off function of the photographing apparatus 10 in order to maintain the connection with the photographing apparatus 10.

  In addition, the Web application 304a prohibits the photographing apparatus 10 from automatically shifting to the sleep mode while the through image is being transferred from the photographing apparatus 10.

  When a touch operation is performed on the reload button 1002, the Web application 304a tries to connect to the imaging device 10 again. The connection timeout when the reload button 1002 is operated is set to be relatively long, for example, about 30 seconds to 1 minute. On the other hand, the connection timeout at the time of starting the Web application 304a is set relatively short to reduce power consumption, and is about 10 seconds, for example. The connection timeout time may be set individually for each model or browser, for example.

  In addition, the Web application 304 a synchronizes a clock built in the photographing apparatus 10 with a clock built in the portable information processing terminal 20 when establishing a Wi-Fi connection with the photographing apparatus 10. The synchronized clock is displayed in the “Clock” column of the utility screen shown in FIG.

  In addition, when the Wi-Fi connection between the Web application 304a and the imaging apparatus 10 is established, if the clock in the imaging apparatus 10 and the clock in the portable information processing terminal 20 are shifted by a predetermined time or more, the Web application 304a is There is a high possibility of being connected to a different access point (photographing device 10 different from the previous one). In this case, the Web application 304a resets the current setting, specifically, the setting corresponding to the imaging device 10 connected last time.

  Further, normally, it is considered that the Web application 304a communicates with the imaging device 10 in millisec units in order to ensure the accuracy of the clock information (that is, the time indicated by “Clock”) in the imaging device 10. . However, in this embodiment, the Web application 304a updates the time indicated by “Clock” by counting up without synchronizing with the photographing apparatus 10 once the clock is synchronized in order to reduce the communication amount. . Communication with the imaging device 10 may be performed, for example, every several tens of seconds to prevent synchronization loss.

  Further, the user can synchronize the web application 304a and the clock of the photographing apparatus 10 at an arbitrary timing by touching the “Sync Clock” button on the utility screen shown in FIG.

  Further, when a touch operation is performed on the “Security” button on the utility screen shown in FIG. 7, a security setting screen shown in FIG. 16 is displayed. On the security setting screen, a form for inputting a domain and passcode of the origin server of the Web content that permits cross-domain access is arranged. In the present embodiment, execution of a malicious Web application is avoided by performing cross-domain communication using information set on the security setting screen. Note that the domain of the Web server 30 is permitted by default.

  Further, when a touch operation on the “Reset GR” button is performed on the utility screen shown in FIG. 7, a reset execution screen shown in FIG. 17 is displayed. On the reset execution screen, buttons of “Reset All Settings”, “Reset Shooting Settings”, “Reset Network Settings”, and “Reset Key Custom Options” are arranged.

  When a touch operation is performed on the “Reset All Settings” button on the reset execution screen illustrated in FIG. 17, the settings of the imaging device 10 are initialized, and the imaging device 10 is restarted. Note that the Wi-Fi connection mode of the photographing apparatus 10 is automatically turned on at the time of restart in order to smoothly reconnect the Web application 304a and the photographing apparatus 10.

  When a touch operation is performed on the “Reset Shooting Settings” button on the reset execution screen illustrated in FIG. 17, the settings relating to the shooting conditions of the shooting apparatus 10 are reset, and the shooting apparatus 10 is restarted.

  When a touch operation on the “Reset Network Settings” button on the reset execution screen illustrated in FIG. 17 is performed, the network-related settings of the imaging device 10 are reset, and the imaging device 10 is restarted.

  When a touch operation is performed on the “Reset Key Custom Options” button on the reset execution screen illustrated in FIG. 17, the custom setting of the imaging device 10 is reset and the imaging device 10 is restarted. Illustratively, the functions registered in the Fn (function) 1 button and the Fn2 button provided on the camera body of the photographing apparatus 10 are reset.

[Event optimization processing]
The system controller 100 performs processing without distinguishing between a direct operation on the photographing apparatus 10 and a remote operation of the photographing apparatus 10 by the Web application 304a. FIG. 10 is a diagram for assisting the description of such processing.

  For example, consider a case where an AE lock operation is performed. In the photographing apparatus 10, an AE lock operation is performed through an AF lever provided on the camera body. The operation unit 102 detects a change in the operation state of the AF lever (AE lock on), and transmits the detected change to the system controller 100 as an event. The system controller 100 sets the AE lock on according to the transmitted event.

  In the Web application 304a, the AE lock operation is performed by “AF Level” on the subcommand screen (Left), which will be described in detail later. When receiving the AE lock-on command transmitted from the Web application 304a, the Wi-Fi interface 208 transmits the same event to the system controller 100 as when the AF lever provided on the camera body of the photographing apparatus 10 is operated. Accordingly, the system controller 100 can set the AE lock to ON without distinguishing between a direct operation on the photographing apparatus 10 and a remote operation of the photographing apparatus 10 by the Web application 304a.

  However, for example, if the same operation is performed at the same timing on the photographing apparatus 10 side and the Web application 304a side, there is a possibility that the system controller 100 cannot perform normal processing. Therefore, in this embodiment, event optimization is performed in order to avoid this type of problem. In FIG. 10, for convenience of explanation, the system controller 100 is divided into a block for performing event optimization (optimization processing block 100a) and a block for executing processing according to the event after optimization (main program block 100b). Separately shown.

・ Optimization example 1
The optimization processing block 100a receives ON again for a certain event when the last received one is ON (in the above example, the AE lock is turned on by operating the AF lever provided on the camera body of the photographing apparatus 10). When an AE lock-on event by “AF Level” on the Web application 304a is received), the on-event received later is ignored (or discarded). In this case, the main program block 100b is not affected by the same operation performed at the same timing on the photographing apparatus 10 side and the Web application 304a side, so that the process can be executed normally.

・ Optimization example 2
In this example 2, a case where the release button is operated will be described. The photographing apparatus 10 alone cannot perform an operation of omitting the half-press of the release button and fully pressing the release button. However, on the Web application 304a, it is possible to perform an operation corresponding to a full press of the release button without performing an operation corresponding to a half press of the release button.

  If an operation corresponding to the full release button is performed without performing an operation corresponding to the half-press of the release button on the Web application 304a, the optimization processing block 100a immediately before the event of the full release button press. Insert a half-press event. As described above, in the second example, the optimization processing block 100a matches the event generated by the operation on the Web application 304a with the event generated when the photographing apparatus 10 is similarly operated. As a result, in the second example, the main program block 100b can execute processing in the order of AF control and imaging processing in the same manner as when the release button of the imaging apparatus 10 is operated.

・ Optimization example 3
When the optimization processing block 100a waits for optimization of a received event that cannot be processed by the main program block 100b (for example, the same operation is repeated on the photographing apparatus 10 side and the Web application 304a side). When the number of events waiting for optimization exceeds a predetermined threshold value), the oldest event or the newest event among the events waiting for optimization is discarded. In addition, if the optimization processing block 100a discards only off, there is a possibility that the event may continue to be on, so the on and off events are discarded as a set.

Optimization example 4
The case where the release button is operated also in this example 4 will be described. When the release button is not pressed, event S0 is transmitted from the operation unit 102 to the optimization processing block 100a, event S1 is transmitted when the release button is half-pressed, and the release button is fully pressed. If so, event S2 is transmitted.

  For example, during the touch AF operation (described later) on the Web application 304a, the event S0 is discarded and the event S1 at the time of the touch AF operation is applied (that is, adopted as an event to be processed by the main program block 100b). If a touch AF operation is performed on the Web application 304a while the release button of the photographing apparatus 10 is half-pressed, the event S1 when the release button is half-pressed is discarded, and the event S1 during the touch AF operation is applied. Is done. Alternatively, the event S1 at the time of the touch AF operation is discarded while the event S1 at the time of half-pressing the release button is applied. When the release button of the photographing apparatus 10 is half-pressed during the touch AF operation on the Web application 304a, the event S1 at the time of the touch AF operation is discarded, and the event S1 at the time of the half-press of the release button is applied. . Alternatively, the event S1 when the release button is pressed halfway is discarded while the event S1 during the touch AF operation is applied.

[Remote operation of photographing apparatus 10]
Next, a specific example of remote operation of the photographing apparatus 10 that can be performed on the Web application 304a will be described.

  In the startup screen shown in FIG. 5, a main command tab 1006 and sub-command tabs 1008 and 1010 are arranged below the main screen 1004. The startup screen shown in FIG. 5 is displayed on the touch panel 210 during startup or when the main command tab 1006 is touched.

  The buttons “Mode”, “Focus”, “Shutter”, “F”, “SS”, and “EV” are arranged side by side below the main command tab 1006 on the startup screen shown in FIG. Furthermore, toggle buttons of “Selftimer”, “Lens Lock”, and “Key Lock” are arranged below each other.

  The “Mode” button on the startup screen shown in FIG. 5 is a button corresponding to the shooting mode button of the shooting apparatus 10. The imaging apparatus 10 switches the imaging mode in response to a touch operation on the “Mode” button.

  The “Focus” button on the startup screen shown in FIG. 5 is a button for performing AF control. In response to the touch operation on the “Focus” button, the image capturing apparatus 10 performs focus control in the AF mode currently set on the image capturing apparatus 10 side, for example.

  Note that during the period in which the button is pressed and held on the Web application 304a, the Web application 304a does not transmit a signal indicating that the button is on to the imaging device 10. For example, during the period when the “Focus” button is pressed and held, the Web application 304 a transmits a packet for repeating the focus control on signal and the off signal to the photographing apparatus 10. The packet includes at least one set of signals arranged in the order of on and off. Even when the communication with the Web application 304a is disconnected, the focus control of the photographing apparatus 10 is normally turned off because the last signal of the last received packet is off.

  When the live view displayed on the main screen 1004 is directly touched (touch AF operation), the touched point is used regardless of the AF mode set on the photographing apparatus 10 side for the sake of convenience. In contrast, focus control by spot AF may be performed.

  However, if the photographing apparatus 10 is set to a mode in which touch AF is not possible, an error is returned from the photographing apparatus 10 to the Web application 304a. When receiving the error, the Web application 304a instructs the photographing apparatus 10 again to perform focus control in the AF mode currently set on the photographing apparatus 10 side. When receiving an instruction from the Web application 304a, the imaging apparatus 10 performs focus control in the currently set AF mode. This avoids the problem that focus control is not performed despite the touch AF operation.

  The “Shutter” button on the startup screen shown in FIG. 5 is a button corresponding to the release button (full press) of the photographing apparatus 10. The imaging device 10 performs an imaging process in response to a touch operation on the “Shutter” button.

  The “F” button on the startup screen shown in FIG. 5 is a button for setting the F value of the photographing apparatus 10 (aperture 108). The imaging device 10 sets the F value in response to a touch operation on the “F” button. Note that with the photographing apparatus 10 alone, for example, when the dial operation is performed during aperture priority AE, the setting of the F value is changed.

  The “SS” button on the startup screen shown in FIG. 5 is a button for setting the shutter speed of the photographing apparatus 10 (shutter 110). The photographing apparatus 10 sets the shutter speed in response to a touch operation on the “SS” button. In the photographing apparatus 10 alone, for example, the shutter speed setting is changed by performing a dial operation during shutter priority AE.

  “EV” on the startup screen shown in FIG. 5 is a button for adjusting the EV value of the photographing apparatus 10. The imaging apparatus 10 adjusts the EV value in accordance with a touch operation on the “EV” button. In the photographing apparatus 10 alone, for example, the EV value is adjusted by performing an operation on a menu screen displayed on the LCD 120.

  The “Selftimer” button on the startup screen shown in FIG. 5 is a button for switching on / off self-timer shooting. The imaging device 10 switches on / off of self-timer imaging (for example, 2 seconds) in response to a touch operation on the “Selftimer” button. In the photographing apparatus 10 alone, for example, when a self-timer button provided on the camera body is pressed, on / off of self-timer photographing (for example, 2 seconds) is switched.

  The “Lens Lock” button on the start-up screen shown in FIG. 5 is a toggle button for switching on / off the lens lock of the photographing apparatus 10. When a touch operation for turning on the “Lens Lock” button is performed, a prohibit command is transmitted to the photographing apparatus 10 and the lens lock is turned on. When a touch operation for turning off the “Lens Lock” button is performed, a release command is transmitted to the photographing apparatus 10 and the lens lock is turned off.

  For example, consider a case where the photographing apparatus 10 is set to the playback mode. The reproduction mode is a mode in which a photographed image saved on a memory card or the like inserted into the card interface 126 is reproduced on the LCD 120. In the reproduction mode, the lens barrel of the photographing lens 106 is retracted to the camera body of the photographing apparatus 10 and the lens barrier is closed.

  If the Wi-Fi connection mode is turned on in the playback mode, for example, when the “Shutter” button is touched, the photographing apparatus 10 shifts from the reproduction mode to the photographing mode, the lens barrier is opened, and the photographing lens is opened. A lens barrel 106 is extended from the camera body. Similarly, when the release button of the photographing apparatus 10 is pressed and pressed in the bag or pocket, the photographing apparatus 10 shifts from the reproduction mode to the photographing mode, the lens barrier is opened, and the photographing lens 106 is opened. The lens barrel is fed out from the camera body.

  For example, if the lens barrier is opened or the lens barrel of the photographing lens 106 is extended while the photographing apparatus 10 is placed in a bag or a clothing pocket, the lens barrier may be caught in the bag or in the pocket. There is a possibility that the photographing apparatus 10 may break down because the body is compressed and a load is applied to a mechanism around the lens barrel.

  When the lens lock is turned on, the lens barrier is not opened and the lens barrel of the photographing lens 106 is not extended because the photographing apparatus 10 is not operated regardless of how the photographing device 10 is operated. In principle, the lens lock cannot be released on the photographing apparatus 10 side, and is not released unless the “Lens Lock” button is switched off on the Web application 304a side. Exceptionally, when the photographing apparatus 10 is restarted (turned on again after the power is turned off), the lens lock is released.

  Note that when the lens lock is turned on while the lens barrel of the photographing lens 106 is extended, the photographing apparatus 10 shifts to the reproduction mode, the lens barrel is retracted into the camera body, and the lens barrier is closed.

  Further, when the power of the photographing apparatus 10 is turned on while the playback button of the photographing apparatus 10 is pressed and held, the photographing apparatus 10 is automatically activated with the lens locked and the Wi-Fi connection mode is automatically set. Turned on.

  As described above, according to the present embodiment, turning on the lens lock prevents the lens barrier from being opened and the taking-out operation of the lens barrel of the photographing lens 106 against the user's intention, thereby preventing the photographing apparatus 10 from malfunctioning. It is prevented.

  The “Key Lock” button on the startup screen shown in FIG. 5 is a button for invalidating the user's operation on the photographing apparatus 10. When a touch operation on the “Key Lock” button is performed, the functions of all the operation units other than the power button of the image capturing device 10 are locked (the state shifts to a state in which the operation is not accepted).

  When a touch operation on the subcommand tab 1008 is performed on the startup screen shown in FIG. 5, the subcommand screen (Left) shown in FIG. 11 is displayed. On the sub-command screen (Left), “Beep”, “Dial-L”, “Dial-R”, “Shutter +”, “Light”, “ADJ-L”, “ADJ” are displayed below the main command tab 1006 and the like. The buttons “-R” and “ADJ-OK” are arranged side by side, and further, the “AF Level”, “Display”, and “Sounds” toggle buttons are arranged side by side.

  A “Beep” button on the subcommand screen (Left) shown in FIG. 11 is a button for causing the photographing apparatus 10 to reproduce a predetermined sound (for example, a sound at the time of focusing). When a touch operation on the “Beep” button is performed, sound is reproduced by the photographing apparatus 10, which is useful when the user searches for the photographing apparatus 10, for example.

  “Dial-L” and “Dial-R” buttons on the subcommand screen (Left) shown in FIG. 11 are buttons corresponding to an up / down dial provided on the camera body of the photographing apparatus 10. When a touch operation on the “Dial-L” button is performed, the photographing apparatus 10 performs the same operation as when the up / down dial is rotated counterclockwise. When a touch operation on the “Dial-R” button is performed, the photographing apparatus 10 performs the same operation as when the up / down dial is rotated clockwise.

  A “Shutter +” button on the subcommand screen (Left) shown in FIG. 11 is a button corresponding to the release button (maintained half-pressed) of the photographing apparatus 10. When a touch operation on the “Shutter +” button is performed, for example, focus lock or AF tracking is performed in the photographing apparatus 10.

  Note that when the screen of the Web application 304a is changed to another screen during the focus lock of the photographing apparatus 10, the focus lock may be released.

  A “Light” button on the subcommand screen (Left) shown in FIG. 11 is a button for switching on / off of auxiliary light during AF of the photographing apparatus 10. The imaging apparatus 10 switches on / off the auxiliary light during AF in response to a touch operation on the “Light” button. Note that with the photographing apparatus 10 alone, for example, an operation on a menu screen displayed on the LCD 120 is performed to switch on / off the auxiliary light during AF.

  The “ADJ-L”, “ADJ-R”, and “ADJ-OK” buttons on the subcommand screen (Left) shown in FIG. 11 are displayed on a predetermined dial (ADJ dial) provided on the camera body of the photographing apparatus 10. Corresponding button. When a touch operation on the “ADJ-L” button is performed, the photographing apparatus 10 performs the same operation as when the ADJ dial is rotated counterclockwise. When a touch operation on the “ADJ-R” button is performed, the photographing apparatus 10 performs the same operation as when the ADJ dial is rotated clockwise. When a touch operation on the “ADJ-OK” button is performed, the photographing apparatus 10 performs the same operation as when the ADJ dial is pressed.

  The “AF Level” button on the subcommand screen (Left) shown in FIG. 11 is a toggle button corresponding to the AF lever provided on the camera body of the photographing apparatus 10. The imaging apparatus 10 performs, for example, setting of focus lock or AE lock in response to a touch operation on the “AF Level” button.

  A “Display” button on the subcommand screen (Left) shown in FIG. 11 is a toggle button for switching on / off of the LCD 120. The imaging device 10 turns on or off the LCD 120 in response to a touch operation on the “Display” button.

  Even after the LCD 120 is turned off, the through image transfer to the Web application 304a is continued. Therefore, the display of the through image is continued on the main screen 1004. Thus, for example, it is possible to allow the user to visually recognize the progress in the middle of shooting that takes time to the extent that it is difficult to keep the LCD 120 displayed due to battery limitations, such as comparatively bright combining (interval combining) shooting. it can.

  The “Sounds” button on the subcommand screen (Left) shown in FIG. 11 is a toggle button for switching on / off the speaker of the photographing apparatus 10. The imaging device 10 switches the speaker on / off in response to a touch operation on the “Sounds” button.

  When a touch operation on the subcommand tab 1010 is performed on the startup screen shown in FIG. 5, the subcommand screen (Right) shown in FIG. 12 is displayed. On the subcommand screen (Right), “Z-in”, “Z-out”, “AE / AF”, “Macro”, “Play”, “OK”, “Flash” are displayed below the main command tab 1006 and the like. ”,“ Effect ”,“ Fn1 ”,“ Fn2 ”,“ WB ”, and“ Disp ”buttons are arranged side by side.

  The buttons “Z-in” and “Z-out” on the subcommand screen (Right) shown in FIG. 12 are buttons corresponding to the + button and the − button provided on the camera body of the photographing apparatus 10, respectively. is there. The photographing apparatus 10 changes the digital zoom or the flash light adjustment value in response to a touch operation on the “Z-in” button or the “Z-out” button.

  The “AE / AF” button on the subcommand screen (Right) shown in FIG. 12 is a button corresponding to the AE / AF button provided on the camera body of the photographing apparatus 10. The photographing apparatus 10 performs, for example, AE lock or focus lock in response to a touch operation on the “AE / AF” button.

  The “Macro” button on the subcommand screen (Right) shown in FIG. 12 is a button corresponding to the upper button provided on the camera body of the photographing apparatus 10. In response to a touch operation on the “Macro” button, the imaging apparatus 10 performs, for example, macro shooting settings or moves the focus on the menu screen displayed on the LCD 120 upward.

  A “Play” button on the subcommand screen (Right) shown in FIG. 12 is a button corresponding to a playback button provided on the camera body of the photographing apparatus 10. In response to a touch operation on the “Play” button, the photographing apparatus 10 shifts to, for example, a playback mode.

  The “OK” button on the subcommand screen (Right) shown in FIG. 12 is a button corresponding to the OK button provided on the camera body of the photographing apparatus 10. In response to a touch operation on the “OK” button, the imaging apparatus 10 displays a menu screen on the LCD 120, for example, or makes a determination on an item that is focused on the menu screen.

  The “Flash” button on the subcommand screen (Right) shown in FIG. 12 is a button corresponding to the right button provided on the camera body of the photographing apparatus 10. In response to a touch operation on the “Flash” button, the image capturing apparatus 10 sets, for example, a flash, or moves the focus on the menu screen displayed on the LCD 120 to the right.

  The “Effect” button on the sub-command screen (Right) shown in FIG. 12 is a button corresponding to the Effect button provided on the camera body of the photographing apparatus 10. In response to a touch operation on the “Effect” button, the imaging apparatus 10 sets an effect on the captured image, for example.

  The “Fn1” button on the subcommand screen (Right) shown in FIG. 12 is a button corresponding to the Fn (function) 1 button provided on the camera body of the photographing apparatus 10. In response to a touch operation on the “Fn1” button, the imaging apparatus 10 executes a function registered in the Fn1 button, for example, or moves the focus on the menu screen displayed on the LCD 120 to the left.

  The “Fn2” button on the subcommand screen (Right) shown in FIG. 12 is a button corresponding to the Fn (function) 2 button provided on the camera body of the photographing apparatus 10. The imaging apparatus 10 executes, for example, a function registered in the Fn2 button in response to a touch operation on the “Fn2” button.

  The “WB” button on the subcommand screen (Right) shown in FIG. 12 is a button corresponding to the WB button provided on the camera body of the photographing apparatus 10. In response to a touch operation on the “WB” button, the photographing apparatus 10 sets, for example, white balance or moves the focus on the menu screen displayed on the LCD 120 downward.

  The “DISP” button on the subcommand screen (Right) shown in FIG. 12 is a button corresponding to the DISP button provided on the camera body of the photographing apparatus 10. In response to a touch operation on the “DISP” button, the photographing apparatus 10 displays a grid guide, a level, etc. on a through image on the LCD 120, for example.

  Buttons of “Sync”, “Settings”, and “Quickview” are arranged at the bottom of each command screen shown in FIG. 5, FIG. 11 and FIG.

  The “Sync” button on each command screen shown in FIG. 5, FIG. 11 and FIG. 12 is a button for sending the current settings of the photographing apparatus 10 on the Web application 304a in a batch. For example, when the F value setting is changed on the Web application 304a, it is reflected in the photographing apparatus 10, that is, the F value of the photographing apparatus 10 (aperture 108) is changed. On the other hand, when the setting of the F value is changed by operating the photographing apparatus 10, the setting change of the F value is not reflected on the Web application 304a. Therefore, the setting on the Web application 304a side and the setting on the photographing apparatus 10 side do not match.

  Therefore, in the present embodiment, when a touch operation on the “Sync” button is performed, the current settings of the image capturing device 10 on the Web application 304a are collectively transmitted and reflected on the image capturing device 10. As a result, the settings of the Web application 304a and the photographing apparatus 10 are synchronized, and the mismatch between the settings is resolved.

  When a touch operation on the “Settings” button is performed on each command screen shown in FIG. 5, FIG. 11 and FIG. 12, an advanced setting screen shown in FIG. 13 is displayed. The advanced setting screen includes “ISO”, “WB”, “Flash”, “Focus”, “Metering”, “BKT”, “Format”, “Aspect”, “Crop”, “Effect”, “Image”, Buttons for setting each parameter of “DR”, “Transmit”, and “Cancel” are arranged side by side.

  The “ISO” button on the advance setting screen shown in FIG. 13 is a button for setting the ISO sensitivity of the photographing apparatus 10. By performing a touch operation on the “ISO” button, the ISO sensitivity setting on the advanced setting screen is changed. In the photographing apparatus 10 alone, for example, the ISO sensitivity setting is changed by performing an operation on a menu screen displayed on the LCD 120 or an ISO button provided on the camera body of the photographing apparatus 10.

  The “WB” button on the advance setting screen shown in FIG. 13 is a button for setting the white balance of the photographing apparatus 10. By performing a touch operation on the “WB” button, the white balance setting on the advanced setting screen is changed. In the photographing apparatus 10 alone, for example, the white balance setting is changed by performing an operation on a menu screen displayed on the LCD 120 or a WB button provided on the camera body of the photographing apparatus 10.

  The “Flash” button on the advance setting screen shown in FIG. 13 is a button for setting the light emission mode of the photographing apparatus 10. By performing a touch operation on the “Flash” button, the setting of the light emission mode on the advanced setting screen is changed. In the photographing apparatus 10 alone, for example, the setting of the light emission mode is changed by performing an operation on a menu screen displayed on the LCD 120 or a right button provided on the camera body of the photographing apparatus 10.

  The “Focus” button on the advance setting screen shown in FIG. 13 is a button for setting the focus mode of the photographing apparatus 10. By performing a touch operation on the “Focus” button, the setting of the focus mode on the advanced setting screen is changed. In the photographing apparatus 10 alone, for example, an operation on a menu screen displayed on the LCD 120 is performed, whereby the setting of the focus mode is changed.

  The “Metering” button on the advanced setting screen shown in FIG. 13 is a button for setting the AF mode of the photographing apparatus 10. By performing a touch operation on the “Metering” button, the setting of the AF mode on the advanced setting screen is changed. In the photographing apparatus 10 alone, for example, the setting of the AF mode is changed by performing an operation on a menu screen displayed on the LCD 120 or an AF lever provided on the camera body of the photographing apparatus 10.

  The “BKT” button on the advance setting screen shown in FIG. 13 is a button for setting bracket shooting of the shooting apparatus 10. By performing a touch operation on the “BKT” button, the bracket shooting setting on the advanced setting screen is changed. In the photographing apparatus 10 alone, for example, the setting for bracket photographing is changed by performing an operation on a menu screen displayed on the LCD 120.

  The “Format” button on the advance setting screen shown in FIG. 13 is a button for setting the format of the image captured by the image capturing apparatus 10. By performing a touch operation on the “Format” button, the setting of the format of the captured image on the advanced setting screen is changed. In the photographing apparatus 10 alone, for example, the setting of the format of the photographed image is changed by performing an operation on a menu screen displayed on the LCD 120.

  The “Aspect” button on the advanced setting screen shown in FIG. 13 is a button for setting the aspect ratio of the image captured by the image capturing apparatus 10. By performing a touch operation on the “Aspect” button, the setting of the aspect ratio of the captured image on the advanced setting screen is changed. In the photographing apparatus 10 alone, for example, the setting of the aspect ratio of the photographed image is changed by performing an operation on a menu screen displayed on the LCD 120.

  The “Crop” button on the advance setting screen shown in FIG. 13 is a button for setting the crop mode of the photographing apparatus 10. By performing a touch operation on the “Crop” button, the setting of the crop mode on the advanced setting screen is changed. In the photographing apparatus 10 alone, the setting of the crop mode is changed by performing an operation on a menu screen displayed on the LCD 120, for example.

  The “Effect” button on the advanced setting screen shown in FIG. 13 is a button for setting an effect on a photographed image by the photographing apparatus 10. By performing the touch operation on the “Effect” button, the effect setting for the captured image on the advanced setting screen is changed. Note that, in the photographing apparatus 10 alone, for example, an effect setting for a photographed image is changed by performing an operation on a menu screen displayed on the LCD 120 or an Effect button provided on the camera body of the photographing apparatus 10.

  The “Image” button on the advance setting screen shown in FIG. 13 is a button for setting the image quality and the like of the image captured by the image capturing apparatus 10. By performing a touch operation on the “Image” button, settings such as the image quality of the captured image on the advanced setting screen are changed. Note that, in the photographing apparatus 10 alone, for example, an operation on a menu screen displayed on the LCD 120 is performed to change settings such as the image quality of the photographed image.

  The “DR” button on the advance setting screen shown in FIG. 13 is a button for setting the dynamic range correction of the captured image by the imaging apparatus 10. By performing a touch operation on the “DR” button, the setting of dynamic range correction on the advance setting screen is changed. Note that with the photographing apparatus 10 alone, for example, an operation on a menu screen displayed on the LCD 120 is performed, whereby the setting of dynamic range correction is changed.

  The “Transmit” button on the advance setting screen shown in FIG. 13 is a button for sending the settings on the advance setting screen to the photographing apparatus 10 at once. By performing a touch operation on the “Transmit” button, all settings on the advanced setting screen are reflected in the photographing apparatus 10.

  The “Cancel” button on the advanced setting screen shown in FIG. 13 is a button for collectively canceling all the setting changes made on the advanced setting screen. By performing a touch operation on the “Cancel” button, setting changes made on the advanced setting screen are canceled in a lump without being reflected in the photographing apparatus 10.

  When a touch operation on the “Quickview” button is performed on each command screen shown in FIGS. 5, 11, and 12, a quick view screen (Lastest) shown in FIG. 14 is displayed.

  In the upper part of the quick view screen (Lastest) shown in FIG. 14, “Lestest” and “Recent” tabs are arranged. When a touch operation on the “Quickview” button on each command screen or a touch operation on the “Lastest” tab is performed, the quick view screen (Lastest) shown in FIG. 14 is displayed, and when a touch operation is performed on the “Recent” tab, the screen shown in FIG. A quick view screen (Recent) is displayed.

  Here, the Web application 304a is stored in all or specified folders stored in a memory card or the like of the photographing apparatus 10 at a predetermined timing (for example, when establishing a Wi-Fi connection with the photographing apparatus 10). A reduced image (for example, a thumbnail in EXIF (Exchangeable image file format)) of the captured image (main image) is requested to the imaging device 10 and downloaded, and stored in the auxiliary storage device 204.

  When the transition to the quick view screen (Lastest) shown in FIG. 14 is performed, the thumbnail of the latest date and time is read from the auxiliary storage device 204 and displayed at the upper center of the screen. When the transition to the quick view screen (Recent) shown in FIG. 15 is performed, the nine thumbnails of the most recent date and time are read from the auxiliary storage device 204 and displayed side by side at the top center of the screen. Is done.

  Here, the detailed information of the photographed image file includes information that does not take time to obtain from the photographing apparatus 10 and information that takes time to obtain from the photographing apparatus 10. The former information includes, for example, date and file name, and the latter information includes, for example, image orientation (vertical orientation, landscape orientation).

  In this embodiment, the Web application 304a downloads all the detailed information of the captured image file when the thumbnail is downloaded for the first time, saves it in the auxiliary storage device 204, and displays the thumbnail according to the stored detailed information. From the next time onward, the Web application 304 a does not download all the detailed information of the captured image file, but downloads only information such as the date and time and the file name that do not take time to obtain and stores them in the auxiliary storage device 204. The Web application 304a acquires the thumbnail direction using the saved date and file name as a key, and displays the thumbnail according to the acquired direction information. In the present embodiment, by performing such communication, the communication amount between the Web application 304a and the photographing apparatus 10 is reduced, and the display speed of thumbnails is increased.

  14 and FIG. 15, buttons for “Download VGA”, “Download Original”, and “Close” are arranged side by side at the bottom of each quick view screen.

  When a touch operation on the “Download VGA” button is performed on the quick view screen (Lastest) illustrated in FIG. 14, the Web application 304a captures a thumbnail VGA image displayed at the upper center of the quick view screen (Lastest). The device 10 is requested and downloaded, and stored in the auxiliary storage device 204.

  Further, when a touch operation is performed on the “Download Original” button on the quick view screen (Lastest) shown in FIG. 14, the Web application 304 a displays the thumbnail main image displayed at the upper center of the quick view screen (Lastest). Is requested and downloaded to the photographing apparatus 10 and stored in the auxiliary storage device 204.

  In the present embodiment, the VGA image is originally an image created for displaying the captured image on the LCD 120, has a size larger than the thumbnail and smaller than the main image, and is the same as the main image. Has an aspect ratio.

  Further, when a touch operation is performed on the “Download VGA” button on the quick view screen (Recent) shown in FIG. 15, the Web application 304 a is displayed in the thumbnail group displayed at the upper center of the quick view screen (Recent). The VGA image of the thumbnail focused on is requested and downloaded to the photographing apparatus 10 and stored in the auxiliary storage device 204.

  Further, when a touch operation is performed on the “Download Original” button on the quick view screen (Recent) shown in FIG. 15, the Web application 304 a requests the photographing apparatus 10 for the main image of the thumbnail that is also focused. Downloaded to the auxiliary storage device 204. The user can change the thumbnail to be focused by directly touching an arbitrary thumbnail in the thumbnail group.

  When a touch operation on the “Close” button is performed on each quick view screen of FIGS. 14 and 15, the display of the Web application 304 a returns to the previous command screen.

  When a touch operation is performed on the “Viewer” button in the main menu shown in FIG. 6, a viewer screen shown in FIG. 18 is displayed. A folder list is displayed on the viewer screen. The folder list includes a folder for storing the current day's captured images (“Today's Shots” folder), a folder for storing the captured images before the previous day (“100 RICOH (“ RICOH ”is a registered trademark)” folder, and “101 RICOH” folder). , “102RICOH” folder...) Are displayed side by side. Each folder displayed in the folder list is a thumbnail in the auxiliary storage device 204 downloaded from the photographing apparatus 10 and any thumbnail in the folder is displayed.

  Each folder in the folder list is a virtual folder. For example, when a touch operation is performed on the “Today's Shots” folder on the viewer screen shown in FIG. 18, the current date thumbnail is read from the auxiliary storage device 204, and as shown in FIG. 19. Are displayed side by side on the screen.

  The folder for storing the current day's captured images and the folder for storing the previous day's captured images are divided each time the number of thumbnails to be stored exceeds 100. For example, if there are 250 today's captured images, the folder storing today's captured images is divided into three. By limiting the number of thumbnails in one folder, for example, the response drop when the gallery screen shown in FIG. 19 is scrolled is improved.

  When a touch operation on the thumbnail is performed on the gallery screen shown in FIG. 19, the viewer screen shown in FIG. 20 is displayed. Specifically, the Web application 304a switches to a screen that enlarges and displays a single thumbnail that has been touched, and requests the VGA image corresponding to the thumbnail to be downloaded to the photographing apparatus 10. When the download of the VGA image is completed, the Web application 304a replaces the displayed thumbnail with the VGA image and displays it.

  As described above, in the present embodiment, thumbnails are alternatively displayed during the downloading of the VGA image, so that even if it takes a long time to download the VGA image, the user is less likely to feel stress.

  Note that thumbnails and VGA images have different sizes and aspect ratios. In the viewer screen shown in FIG. 20, if thumbnails are displayed as they are, they are switched to VGA images with completely different sizes and aspect ratios, which may give the user a sense of discomfort.

  Therefore, in the present embodiment, on the viewer screen shown in FIG. 20, the thumbnail is displayed after being enlarged and trimmed in accordance with the VGA image. Since the thumbnail and the VGA image are displayed in substantially the same area and in the same size, the thumbnail and the VGA image are switched without giving the user a sense of incongruity.

  In the viewer screen shown in FIG. 20, every time a flick operation is performed, the next thumbnail in the current folder (a VGA image after the download is completed) is displayed.

  Also, when a touch operation is performed on the download button 1012 on the viewer screen shown in FIG. 20, the Web application 304a requests the imaging device 10 to download the main image of the currently displayed VGA image and downloads it to the auxiliary storage device. Save to 204.

  When a touch operation on the “Presets” button is performed in the main menu shown in FIG. 6, a preset screen shown in FIG. 21 is displayed. Since the preset screen has a size that requires screen scrolling, for convenience, the preset screen is divided into two diagrams of FIG. 21 (a) and FIG. 21 (b).

  Various preset buttons are arranged side by side on the preset screen shown in FIG. Specifically, a preset button related to shooting, a preset button related to image reproduction, and a preset button related to the system are arranged side by side.

  The preset buttons related to shooting include “Selftimer”, “Continuous Shooting”, “Interval Shooting”, and “Interval Composite” buttons. Preset buttons related to image reproduction include a “Slideshow” button. The preset buttons related to the system include “Sleep”, “Shutdown”, and “Restart” buttons.

  When a touch operation on the “Selftimer” button is performed on the preset screen illustrated in FIG. 21, the photographing apparatus 10 performs self-timer photographing.

  When a touch operation on the “Continuous Shooting” button is performed on the preset screen illustrated in FIG. 21, the photographing apparatus 10 performs continuous shooting.

  When a touch operation on the “Interval Shooting” button is performed on the preset screen illustrated in FIG. 21, the photographing apparatus 10 performs interval photographing.

  When a touch operation on the “Interval Composite” button is performed on the preset screen illustrated in FIG. 21, the photographing apparatus 10 performs comparatively bright combination (interval composition) photographing.

  The processing contents registered in each preset button can be edited. Illustratively, an arbitrary self-timer time can be registered for the “Selftimer” button, and an arbitrary continuous shooting number can be registered for the “Continuous Shooting” button.

  Note that, when the screen of the Web application 304a is changed to another screen during execution of self-timer shooting, continuous shooting, interval shooting, or the like by the shooting device 10, these shootings may be forcibly stopped.

  When a touch operation on the “Slideshow” button is performed on the preset screen illustrated in FIG. 21, for example, a slide show of captured images stored in a memory card is started on the LCD 120.

  When a touch operation on the “Sleep” button is performed on the preset screen illustrated in FIG. 21, the photographing apparatus 10 shifts to the sleep mode.

  While the photographing apparatus 10 is sleeping, a screen for notifying that it is sleeping is transferred from the photographing apparatus 10 to the Web application 304a as in the case of the through image. The transferred screen is processed on the Web application 304a without being distinguished from the through image, and is reproduced on the main screen 1004.

  Further, during a period in which the photographing apparatus 10 cannot generate a through image due to system restrictions (for example, during storage of a moving image), the Web application 304a is informed that the moving image is being stored as in the case of the through image. The screen to be transferred is transferred from the photographing apparatus 10. The transferred screen is processed on the Web application 304a without being distinguished from the through image, and is reproduced on the main screen 1004.

  As described above, in the remote operation system 1 according to the present embodiment, the imaging device 10 is in the sleep state or the moving image is being saved without causing the Web application 304a to detect the status of the imaging device 10. It can be communicated to the user through the Web application 304a.

  When a touch operation on the “Shutdown” button is performed on the preset screen illustrated in FIG. 21, the power of the photographing apparatus 10 is turned off.

  When a touch operation on the “Restart” button is performed on the preset screen illustrated in FIG. 21, the photographing apparatus 10 is restarted. Note that, in order to smoothly reconnect the Web application 304a and the photographing apparatus 10, the Wi-Fi connection mode is automatically turned on at the time of restart. In addition, when the imaging apparatus 10 is restarted, the lens is automatically locked in order to prevent failure of the lens barrier, the lens barrel of the imaging lens 106, and the like.

  When a touch operation is performed on the “Configuration” button in the main menu shown in FIG. 6, the configuration screen shown in FIG. 22 is displayed. Since the configuration screen has a size that requires screen scrolling, the configuration screen is divided into two diagrams of FIGS. 22A and 22B for convenience.

  The configuration screen shown in FIG. 22 includes radio buttons (Focus / Capture) for setting instruction contents when a through image on the main screen 1004 is directly touched, and an image to be displayed on the viewer screen shown in FIG. Check boxes (JPEG / RAW (DNG) / Movie (MOV)) for setting the file format are arranged.

  On the configuration screen shown in FIG. 22, buttons for setting the color theme of the Web application 304a are arranged. Color themes that can be set in the present embodiment include “Light” that is a white tone and “Dark” that is a black tone.

  Further, the Web application 304a may acquire information on the color of the camera body of the photographing apparatus 10 and display the information with a color theme corresponding to the acquired color. In this case, it is assumed that the photographing apparatus 10 holds information on the color of the camera body.

  On the configuration screen shown in FIG. 22, a “Demo Mode” button is arranged. A demo program is executed on the Web application 304a by performing a touch operation on the “Demo Mode” button.

  In the configuration screen shown in FIG. 22, a “Reset GR Remote” button is arranged. By performing a touch operation on the “Reset GR Remote” button, information in the Web application 304a (for example, a file list of photographed images acquired from the photographing apparatus 10, management information in the Web application 304a, etc.) is reset. .

  The above is the description of the exemplary embodiments of the present invention. Embodiments of the present invention are not limited to those described above, and various modifications are possible within the scope of the technical idea of the present invention. For example, the embodiment of the present invention also includes contents appropriately combined with embodiments or the like clearly shown in the specification or obvious embodiments.

DESCRIPTION OF SYMBOLS 1 Remote operation system 10 Image pick-up device 20 Portable information processing 30 Web server 100 System controller 100a Optimization process block 100b Main program block 102 Operation part 104 Drive circuit 106 Shooting lens 108 Aperture 110 Shutter 112 Solid-state image sensor 114 Signal processing circuit 116 Image Processing engine 118 Buffer memory 120 LCD
122 ROM
124 Non-volatile memory 126 Card interface 128 Wi-Fi interface 200 CPU
202 Main storage device 204 Auxiliary storage device 204a OS
204b Browser 206 Carrier communication interface 208 Wi-Fi interface 210 Touch panel 300 CPU
302 Main storage device 304 Auxiliary storage device 304a Web application 306 Communication interface 1000 Main menu button 1002 Reload button 1004 Main screen 1006 Main command tab 1008, 1010 Subcommand tab 1012 Download button

Claims (6)

In a remote operation system having an information processing terminal and a photographing device connected to the information processing terminal ,
The information processing terminal
Sending a prohibit command to prohibit the extension operation of the lens barrel of the photographing apparatus to the photographing apparatus,
The imaging device
The remote operation system which transfers to the prohibit mode which prohibits the extending | stretching operation | movement of the said lens barrel according to the prohibit command received from the said information processing terminal. The imaging device
When receiving a release command to release the prohibit command from the information processing terminal, cancel the prohibition of the lens barrel extension operation ,
The remote operation system according to claim 1. The information processing terminal
When a user interface screen is displayed using an application and a predetermined user operation is performed on the displayed user interface screen, the prohibit command is transmitted to the photographing apparatus.
The remote operation system according to claim 1 or 2. The imaging device
When entering the prohibit mode, the lens barrel is retracted and the lens barrier is closed.
The remote operation system according to any one of claims 1 to 3. The imaging device
When activated in a state where an operation on a specific operation member has been performed, it is set to a mode connectable to the information processing terminal and set to the prohibit mode.
The remote operation system according to any one of claims 1 to 4. The information processing terminal
Sending a restart command instructing the imaging device to restart,
The imaging device
When restarted according to the restart command received from the information processing terminal, it is set to a mode connectable to the information processing terminal and set to the prohibit mode.
The remote operation system according to any one of claims 1 to 5.