JP6595292B2 - Recording apparatus, recording apparatus control method, recording system, wearable information processing apparatus, and program - Google Patents

Description

The present invention relates to a recording apparatus, a recording apparatus control method, a recording system, a wearable information processing apparatus, and a program .

  A wearable information processing device (wearable device) worn by a person is generally popular. For example, as described in Patent Document 1, sound applied to the wearer is collected, an operation mode corresponding to the work of the wearer is set, and the collected sound data according to the operation of the wearer Has been put into practical use for recording the image in association with the set operation mode.

JP 2011-014081 A

  The wearable device has a function of acquiring wearer information (for example, biological information). In addition, a recording apparatus configured to be communicable with a wearable apparatus is generally put into practical use. The recording device is a device that records an image, sound, or some other data as main data. In such a recording apparatus, it is important to acquire information from the wearable apparatus and process it in association with it.

An object of the present invention is to provide a recording apparatus, a recording apparatus control method, a recording system, a wearable information processing apparatus, and a program having high convenience.

A recording apparatus according to an embodiment includes a communication unit that communicates with a cooperation device, a first acquisition unit that acquires main data, a second acquisition unit that acquires sub data from the cooperation device, and the main data. anda recording unit for recording said auxiliary data as one file, the second acquisition unit acquires the list of the sub-data can be acquired in the linked device from the list the second The sub data acquired by the acquisition unit is selected .

Recording apparatus having a high convenience, the control method of the recording apparatus, recording system, it is possible to provide a wearable information processing apparatus, and a program.

FIG. 1 is an explanatory diagram for describing an example of an imaging system according to an embodiment. FIG. 2 is an explanatory diagram for describing an example of a configuration of an imaging apparatus according to an embodiment. FIG. 3 is an explanatory diagram for describing an example of a configuration of a wearable device according to an embodiment. FIG. 4 is an explanatory diagram for describing processing related to mode selection of the imaging apparatus according to the embodiment. FIG. 5 is an explanatory diagram for describing an example of cooperative shooting processing by the imaging device according to the embodiment. FIG. 6 is an explanatory diagram for explaining an example of processing for causing the user to select biometric information to be acquired. FIG. 7 is an explanatory diagram for explaining an example of the operation of the wearable device according to the embodiment. FIG. 8 is an explanatory diagram for describing an example of an image file according to an embodiment. FIG. 9 is an explanatory diagram for describing an example of utilization of sub data included in an image file according to an embodiment. FIG. 10 is an explanatory diagram for explaining an example of utilization of sub data included in an image file according to an embodiment. FIG. 11 is an explanatory diagram for describing an example of an imaging system according to another embodiment. FIG. 12 is an explanatory diagram for describing an example of a configuration of an imaging apparatus according to another embodiment. FIG. 13 is an explanatory diagram for describing an example of a configuration of a wearable device according to another embodiment. FIG. 14 is an explanatory diagram for describing an example of cooperative shooting processing by an imaging apparatus according to another embodiment. FIG. 15 is an explanatory diagram for describing an example of imaging control cooperation by an imaging apparatus according to another embodiment. FIG. 16 is an explanatory diagram for describing an example of processing for causing the user to select setting items for cooperation in imaging control and a cooperation device. FIG. 17 is an explanatory diagram for explaining an example of the operation of the wearable device according to another embodiment. FIG. 18 is an explanatory diagram for describing an example of imaging control cooperation according to another embodiment. FIG. 19 is an explanatory diagram for describing an example of imaging control cooperation according to another embodiment.

(First embodiment)
Hereinafter, a recording apparatus, a recording apparatus control method, a recording system, and a wearable information processing apparatus according to a first embodiment will be described in detail with reference to FIGS. 1 to 10.

  FIG. 1 is an explanatory diagram illustrating an example of an imaging system 1 as a recording system. The imaging system 1 includes an imaging device 2 as a recording device, a wearable device 3 as a wearable information processing device, and the like.

  The imaging device 2 is a camera that acquires image data by capturing a subject image. The imaging device 2 can communicate with the wearable device 3, for example. For example, the imaging device 2 and the wearable device 3 correspond to wireless LAN, Bluetooth (registered trademark), or human body communication. The imaging device 2 communicates with the wearable device 3 using communication means such as wireless LAN, Bluetooth, or human body communication.

  The imaging device 2 performs operations such as changing settings for imaging and imaging a subject image in accordance with an operation. Further, the imaging device 2 acquires information (for example, biometric information) of the wearer 3 wearer acquired in the wearable device 3 from the wearable device 3. The imaging device 2 uses the image data as main data, the biometric information acquired from the wearable device 3 as sub data, and records the main data and sub data as a single file (image file).

  The wearable device 3 is an information processing device that can acquire the wearer's biological information when worn on the wearer's body. The wearable device 3 includes at least a communication unit that communicates with the imaging device 2 and an information acquisition unit that acquires biological information of the wearer of the wearable device 3. The wearable device 3 acquires the wearer's biological information and transmits it to the imaging device 2. The wearable device 3 is, for example, a wristband type, a wristwatch type, a glasses type, an earphone type, or another type of device that can be worn on the human body. Some are incorporated in clothes, shoes, hats, belts, pillows, futons, sheets, beds, seats, etc., and used close to the human body directly or through cloths, etc., and in this case, they are not recognized as wearable devices However, in the present invention, a device having a sensor unit that can acquire information on an environment close to or from a human body in a hands-free state is treated as a wearable device, and these are covered. In the present embodiment, the wearable device 3 will be described as a wristwatch type device.

  FIG. 2 is a block diagram illustrating an example of the configuration of the imaging device 2.

  As shown in FIG. 2, the imaging device 2 includes a lens 11, an imaging device 12, a signal processing unit 13, an image processing unit 14, a sound collection unit 15, an operation unit 16, a communication unit 17, a memory I / F 18, and a main control. The unit 20 is provided.

  The lens 11 forms an image of the transmitted light on the image sensor 12. The lens 11 includes an imaging lens in which a plurality of lenses are combined, an aperture mechanism, a lens control unit that controls operations of the imaging lens and the aperture mechanism, and an operation member. The imaging lens focuses light rays from the subject on the imaging surface of the imaging element 12. The imaging lens may be configured to change the focal length. The aperture mechanism is configured to be openable and closable, and adjusts the amount of light incident on the image sensor via the imaging lens based on the control of the lens control unit. The lens control unit is configured to be communicable with the main control unit 20. The lens control unit controls the operations of the imaging lens and the diaphragm mechanism according to the input from the main control unit 20 or the operation of the operation member.

  The image sensor 12 is provided at the rear of the lens 11, that is, on the inner side of the housing of the image pickup device 2. The imaging element 12 includes an imaging surface configured by arranging a plurality of pixels that store charges by photoelectric conversion. A color filter is provided on a surface on which light of each imaging pixel is incident. The image sensor 12 is configured by, for example, a charge coupled device (CCD) image sensor, a complementary metal oxide semiconductor (CMOS) image sensor, or another image sensor. The image pickup device 12 generates an image signal by converting a subject image condensed through the lens 11 and formed on the image pickup surface into an electric signal corresponding to the amount of light. Note that the plurality of pixels constituting the imaging surface of the imaging element 12 may be arranged in a planar shape or in a curved shape.

  The signal processing unit 13 reads out the image signal generated by the image sensor 12 based on the control of the main control unit 20. The signal processing unit 13 performs various signal processing on the read image signal based on the control of the main control unit 20. The signal processing unit 13 converts the image signal subjected to the signal processing into image data of a digital signal and inputs it to the main control unit 20.

  As described above, the lens 11, the imaging element 12, and the signal processing unit 13 constitute an imaging unit. The imaging unit acquires image data as main data when the imaging element 12 images the light imaged on the imaging surface by the lens 11. The imaging unit continuously acquires image data to be displayed as a through image. For example, the imaging unit outputs the image data generated by the imaging element 12 from the signal processing unit 13 in a cycle based on the control of the main control unit 20. Thereby, a plurality of continuous image data that can be displayed as a through image can be acquired.

  The image processing unit 14 performs various types of image processing such as color correction, gamma (γ) correction, contrast correction, monochrome / color mode processing, and through image processing on the subject image based on the control of the main control unit 20. . Further, the image processing unit 14 compresses the image data using the Jpeg method based on the control of the main control unit 20 and converts the image data into Jpeg data that is Jpeg method image data. The image processing unit 14 inputs Jpeg data to the main control unit 20.

  The sound collecting unit 15 collects sound. For example, the sound collection unit 15 is a stereo microphone. The sound collection unit 15 acquires digital sound data by converting sound into an analog electric signal and converting the electric signal into a digital signal. The sound collection unit 15 inputs the acquired audio data to the main control unit 20.

  The operation unit 16 includes a plurality of operation members for the user to perform various operations on the imaging device 2. The operation member includes, for example, a touch sensor 16t, a release button, a cross button, a power button, and other various buttons. The touch sensor 16t is, for example, a resistive touch sensor or a capacitive touch sensor. That is, the touch sensor 16t is a specified position acquisition unit that acquires information indicating a specified position in a certain area. The touch sensor 16t is provided integrally with a display panel of the display unit 19 to be described later, detects a signal (touch position signal) indicating a touched position on the display panel, and sends the detected touch position signal to the main control unit 20. input.

  The release button is an operation member for the user to instruct the imaging apparatus 2 to perform various processes for acquiring an image. The operation unit 16 gives an instruction to the main control unit 20 to execute automatic exposure (AE) processing and automatic focusing (AF) processing when the release button is pressed halfway. In addition, the operation unit 16 gives an instruction of an imaging operation for acquiring an image by the imaging unit to the main control unit 20 when the release button is fully pressed.

  The cross button is an operation member for the user to instruct the imaging device 2 to perform the up / down / left / right selection operation. For example, the operation unit 16 gives an instruction to the main control unit 20 to select the up / down / left / right selection in various menus according to the operation of the cross button by the user.

  The power button is an operation member for the user to switch on / off the power of the imaging apparatus 2.

  The communication unit 17 is a circuit for communicating with other electronic devices. The communication unit 17 is configured to be able to communicate with the wearable device 3. For example, the communication unit 17 communicates with the wearable device 3 by a communication method such as wireless LAN, Bluetooth, or human body communication. The communication unit 17 receives data transmitted from an electronic device such as the wearable device 3 and supplies the received data to the main control unit 20. The communication unit 17 also receives data to be transmitted from the main control unit 20 to the electronic device such as the wearable device 3 and transmits the received data to the electronic device such as the wearable device 3.

  The memory I / F 18 includes a card slot into which a recording medium M having a plurality of contact terminals can be inserted, and a contact terminal that is electrically connected to the contact terminals of the recording medium M when the recording medium M is inserted into the card slot. And comprising. The recording medium M is a memory card, for example. The memory I / F 18 relays data input / output between the recording medium M and the main control unit 20.

  The display unit 19 displays a screen based on the control of the main control unit 20. The display unit 19 includes a display panel and a drive circuit that displays a screen on the display panel. The display panel is a display device for displaying, for example, a liquid crystal display, an organic EL display, or another screen. The display panel functions as a touch panel (touch screen) by integrally combining the touch sensors 16t described above.

  The main control unit 20 controls the operation of each unit of the imaging device 2. The main control unit 20 acquires biological information as sub data acquired in the wearable device 3 by communicating with the wearable device 3 through the communication unit 17, for example. In addition, the main control unit 20 can transmit a control signal to the wearable device 3 by the communication unit 17, for example.

  The main control unit 20 includes, for example, a CPU and a memory. The main control unit 20 realizes various functions by, for example, the CPU reading and executing a program and control data stored in the memory. The main control unit 20 functions as an operation determination unit 21, an imaging control unit 22, a display control unit 23, a main data processing unit 24, a sub data processing unit 25, a filing unit 26, and a recording control unit 27.

  The operation determination unit 21 determines the operation signal supplied from the operation unit 16. That is, the operation determination unit 21 recognizes what operation is instructed by the operation unit 16.

  The imaging control unit 22 controls various processes related to imaging. For example, the imaging control unit 22 controls the imaging unit to execute an imaging operation based on the operation signal. The imaging control unit 22 controls processing such as AF, AE, and auto white balance (AWB) based on the operation signal. Further, the imaging control unit 22 changes the imaging setting based on the operation signal. The imaging setting is a setting relating to an imaging operation by the imaging unit, signal processing by the signal processing unit, and image processing by the image processing unit. Specifically, the imaging setting includes settings such as an exposure value (Ev value) and a white balance (WB). Further, the imaging settings may include settings such as aperture value (F value), shutter speed (SS), ISO sensitivity, AF mode, recording image quality, aspect ratio, high dynamic range (HDR), and photometry mode. .

  Furthermore, the imaging control unit 22 controls acquisition of image data that can be displayed as a through image by the imaging unit. For example, the imaging control unit 22 controls the signal processing unit 13 so that the image data generated by the imaging element 12 is read at a preset period. Thereby, the imaging control unit 22 acquires a plurality of continuous image data that can be displayed as a through image by the imaging unit.

  The display control unit 23 controls display processing by the display unit 19. For example, the display control unit 23 causes the display panel of the display unit 19 to display a screen by inputting image data to the display unit 19. For example, the display control unit 23 causes the display unit 19 to display a through image by inputting image data that can be displayed as a through image to the display unit 19.

  Furthermore, the display control unit 23 displays OSD data for causing the display unit 19 to display an on-screen display (OSD) including display of various icons and characters based on various setting information and the state of the imaging device 2. Generate. For example, the display control unit 23 displays OSD data for causing the display device of the display unit 19 to display the shooting mode of the imaging device 2, various setting information, the remaining battery level, the number of shootable images and the shootable time, and the AF area. Is generated. The display control unit 23 inputs image data on which the OSD based on the OSD data is superimposed to the display unit 19.

  The main data processing unit 24 is a processing unit that performs various processes related to main data when creating an image file. The main data processing unit 24 converts the main data so as to correspond to the format of the image file for recording. The main data processing unit 24 converts image data (main data) acquired by the imaging unit by the imaging operation into a format for recording as an image file. For example, when the setting is to record Jpeg data as an image file, the main data processing unit 24 converts the acquired image data into Jpeg data by the image processing unit 14. For example, when the setting is to record Raw data as an image file, the main data processing unit 24 converts the acquired image data into Raw data.

  The sub data processing unit 25 is a processing unit that performs various processes relating to sub data when creating an image file. The sub data processing unit 25 converts the sub data so as to correspond to the format of the image file for recording. The sub data processing unit 25 converts the biometric information (sub data) acquired from the wearable device 3 into a format for recording in an image file. Note that the sub data processing unit 25 may be configured to handle shooting information including imaging settings at the time of shooting, thumbnails of image data as main data, position information acquired by GPS, and the like as sub data together.

  The filing unit 26 generates an image file by filing the main data processed by the main data processing unit 24 and the sub data processed by the sub data processing unit 25 as one file. Further, the filing unit 26 may be configured to generate a search tag (search tag) from the sub data and further add the search tag to the image file.

  The recording control unit 27 includes an intermediate buffer that temporarily records an image. The recording control unit 27 records the image file filed by the filing unit 26 in the intermediate buffer. The recording control unit 27 writes the image file recorded in the intermediate buffer to the recording medium M attached to the memory I / F 18.

  FIG. 3 shows an example of the configuration of the wearable device 3. The wearable device 3 includes an information acquisition unit 32, a sound collection unit 35, an operation unit 36, a communication unit 37, a storage unit 38, a display unit 39, and a control unit 40.

  The information acquisition unit 32 acquires information stored as sub data in an image file generated by the imaging device 2 operating in cooperation. For example, the information acquisition unit 32 is a sensor that can detect information (biological information) indicating the state of the wearer when the wearable device 3 is worn on the wearer's body. The biological information is, for example, information such as the wearer's heart rate, body temperature, number of steps, brain waves, and blood sugar level. The information acquisition unit 32 detects one or more of these pieces of information. The information acquisition unit 32 inputs the acquired biological information to the control unit 40.

  The sound collecting unit 35 collects sound. For example, the sound collection unit 35 is a stereo microphone. The sound collecting unit 35 obtains digital sound data by converting sound into an analog electric signal and converting the electric signal into a digital signal. The sound collection unit 35 inputs the acquired audio data to the control unit 40.

  The operation unit 36 includes a plurality of operation members for the user to perform various operations of the wearable device 3. The operation unit 36 generates an operation signal based on the operation of the operation member by the user, and supplies the generated operation signal to the control unit 40. The operation unit 36 further includes a touch sensor 36t. The touch sensor 36t is a device that generates position information based on a capacitive sensor, a thermo sensor, or other methods. For example, the touch sensor 36 t is provided integrally with the display panel of the display unit 39. The touch sensor 36t generates an operation signal based on an operation on the screen displayed on the display panel, and supplies the operation signal to the control unit 40.

  The communication unit 37 is a circuit for communicating with other electronic devices. The communication unit 37 is configured to be able to communicate with the imaging device 2. For example, the communication unit 37 communicates with the imaging device 2 by a communication method such as wireless LAN, Bluetooth, or human body communication. The communication unit 37 receives data transmitted from an electronic device such as the imaging device 2 and supplies the received data to the control unit 40. In addition, the communication unit 37 receives data to be transmitted from the control unit 40 to the electronic device such as the imaging device 2, and transmits the received data to the electronic device such as the imaging device 2.

  The storage unit 38 is a storage medium capable of storing various information. The storage unit 38 stores information acquired by the information acquisition unit 32 based on the control of the control unit 40, for example. That is, the storage unit 38 stores the biological information acquired by the information acquisition unit 32, for example. The storage unit 38 is a semiconductor storage device such as a solid state drive (SSD). The storage unit 38 may be configured as a memory I / F such as a card slot into which a recording medium such as a memory card can be inserted.

  The display unit 39 displays a screen based on the image input from the control unit 40. The display unit 39 includes a display panel and a drive circuit for displaying an image on the display panel. The display panel is a display device for displaying, for example, a liquid crystal display, an organic EL display, or another screen. The display unit 39 displays a screen on the display panel based on the image input from the control unit 40. The display panel functions as a touch panel (touch screen) by combining the touch sensors 36t described above.

  The control unit 40 controls the operation of each unit of the wearable device 3. The control unit 40 includes, for example, a CPU and a memory. For example, the control unit 40 implements various functions by reading and executing a program, an application, and control data stored in the memory or the storage unit 38 by the CPU. The control unit 40 functions as an operation determination unit 41, an information processing unit 42, a display control unit 43, and a recording control unit 44.

  The operation determination unit 41 determines the operation signal supplied from the operation unit 36. That is, the operation determination unit 41 recognizes what operation is instructed by the operation unit 36.

  The information processing unit 42 controls various information processing. For example, the information processing unit 42 processes data transmitted to and received from the imaging device 2. For example, the information processing unit 42 analyzes the information transmitted from the imaging device 2 and recognizes the control content transmitted from the imaging device 2 to the wearable device 3. Further, the information processing unit 42 converts data to be transmitted to the imaging device 2 into a format that can be analyzed by the imaging device 2.

  Further, the information processing unit 42 processes the biological information acquired by the information acquisition unit 32. For example, the information processing unit 42 converts the biological information acquired by the information acquisition unit 32 into a file in a recording format. Further, the information processing unit 42 may total the biometric information acquired by the information acquisition unit 32 during a certain period, and generate a biometric information file from the total result.

  The display control unit 43 controls display processing by the display unit 39. For example, the display control unit 43 causes the display panel of the display unit 39 to display a screen by inputting image data to the display unit 39. The display control unit 43 generates OSD data for causing the display unit 39 to display an on-screen display (OSD) including display of various icons and characters based on various setting information and the state of the wearable device 3. . The display control unit 23 inputs image data on which the OSD based on the OSD data is superimposed to the display unit 39.

  The recording control unit 44 records the biometric information file converted by the information processing unit 42.

  4 and 5 are flowcharts for explaining the operation of the imaging apparatus 2. FIG. 4 is a flowchart for explaining processing related to mode selection of the imaging apparatus 2.

  The main control unit 20 of the imaging device 2 determines whether the shooting mode is selected (step S11), whether the cooperative shooting mode is selected (step S12), and whether the playback mode is selected (step S11). S13) and whether or not the search mode is selected (step S14).

  If it is determined in step S11 that the shooting mode is selected (step S11, YES), the main control unit 20 executes a shooting process (step S15), and proceeds to step S19. The imaging process is a process in which the imaging device 2 performs an imaging operation according to an operation and records image data.

  If it is determined in step S12 that the cooperative shooting mode is selected (step S12, YES), the main control unit 20 executes cooperative shooting processing (step S16), and proceeds to step S19. In the cooperative shooting process, the imaging device 2 executes an imaging operation in response to an operation to acquire image data as main data, and biological information as sub-data from the wearable device 3 that is a device to be linked (cooperative device). Is acquired, and the acquired main data and sub data are recorded as one image file.

  If it is determined in step S13 that the reproduction mode is selected (step S13, YES), the main control unit 20 executes a reproduction process (step S17), and proceeds to step S19. The reproduction process is a process in which the imaging device 2 reproduces a file recorded on the recording medium M according to an operation and displays the file on the display unit 19.

  If it is determined in step S14 that the search mode is selected (step S14, YES), the main control unit 20 executes a search process (step S18), and proceeds to step S19. The search process is a process in which the imaging device 2 searches the recording medium M for an image file corresponding to the search tag.

  The imaging device 2 generates a search tag when recording an image file, and adds the generated search tag to the image file. When the image file generated in this way is recorded on the recording medium M, the imaging device 2 acquires a search tag and searches for an image file to which a search tag that matches the acquired search tag is added. . The imaging device 2 acquires a search tag from the sound acquired by the sound collection unit 15, for example. The imaging device 2 may be configured to acquire a search tag from the wearable device 3, for example.

  Further, for example, when a plurality of search tags are acquired, the imaging device 2 may be configured to determine a search tag to be used for the search process according to an operation of the operation unit 16 from the plurality of search tags. Furthermore, the imaging device 2 may be configured to determine a search tag used for search processing according to an operation of the operation unit 16 from a plurality of preset search tags. By generating tags based on biological information in this way and using them for searching, it can be used for classification of image files.

  If it is determined in step S14 that the search mode is not selected (step S14, NO), the main control unit 20 determines whether or not to end the operation (step S19). If the main control unit 20 does not end the operation (step S19, NO), the main control unit 20 returns to step S11. Moreover, the main control part 20 complete | finishes the process of FIG. 4, when complete | finishing operation | movement (step S19, YES).

  FIG. 5 is a flowchart for explaining the cooperative shooting process shown in step S16 of FIG.

  The main control unit 20 acquires image data by the imaging unit, and executes a live view for displaying the acquired image data on the display unit 19 (step S21).

  The main control unit 20 determines whether or not it is already connected to the cooperation device (step S22). The cooperation device is a device that can acquire the sub data and can communicate with the imaging device 2, and is the wearable device 3 in the present embodiment. That is, the main control unit 20 determines whether there is a wearable device 3 in a communicable state. When it determines with having connected with the apparatus of cooperation object (step S22, YES), the main control part 20 transfers to the process of step S28.

  When it is determined that the main control unit 20 has not been connected to the cooperation device (step S22, NO), the main control unit 20 determines whether there is a cooperation device (step S23). For example, the main control unit 20 transmits a predetermined signal to a communicable range, and determines whether or not there is a cooperation device according to the response. When it determines with there being no cooperation apparatus (step S23, NO), the main control part 20 transfers to the process of step S21.

  When it is determined that there is a cooperation device (step S23, YES), the main control unit 20 transmits a connection request to the cooperation device. For example, the main control unit 20 transmits a connection request to the wearable device 3 when the wearable device 3 is detected as a cooperation device in a state where the connection with the wearable device 3 is not established. When the wearable device 3 receives a connection request from the imaging device 2, the wearable device 3 determines whether or not to approve the connection of the imaging device 2, and performs various communication arrangements with the imaging device 2 when it is approved. Thus, the connection with the imaging device 2 is established. In the following description, it is assumed that the cooperation device is the wearable device 3.

  The main control unit 20 determines whether or not a connection has been established with the wearable device 3 (step S25). When it is determined that the connection with the wearable device 3 has not been established (step S25, NO), the main control unit 20 proceeds to the process of step S21.

  When the main control unit 20 determines that a connection has been established with the wearable device 3 (step S25, YES), the main control unit 20 displays a list of biometric information that can be acquired in the wearable device 3 from the wearable device 3. Obtain (step S26). For example, the main control unit 20 acquires a list of biometric information that can be acquired in the wearable device 3 that the wearable device 3 transmits to the imaging device 2 when the connection is established. The main control unit 20 may be configured to acquire a list of biometric information that can be acquired in the wearable device 3 by transmitting a request to the wearable device 3 and receiving a response to the request. The main control unit 20 may be configured to recognize the type of the wearable device 3 and to search and acquire a list of biometric information that can be acquired in the wearable device 3 from the network according to the type of the wearable device 3.

  The main control unit 20 selects biometric information to be recorded (step S27). For example, the main control unit 20 selects biometric information to be recorded according to the operation from biometric information that can be acquired by the wearable device 3. Specifically, the main control unit 20 displays a plurality of buttons 61 for causing the user to select biometric information to be acquired based on a list of biometric information that can be acquired by the wearable device 3, as shown in FIG. 19 is displayed. The main control unit 20 selects biological information according to the operation of the button 61 by the touch sensor 16t. In addition, for example, the main control unit 20 may be configured to select all biological information that can be acquired in the wearable device 3. In addition, for example, the main control unit 20 may be configured to select biological information set in advance from biological information that can be acquired by the wearable device 3.

  Next, the main control unit 20 determines whether or not there is an instruction for a photographing operation (step S28). As described above, the main control unit 20 determines that an instruction to execute the photographing operation is input when the release button of the operation unit 16 is fully pressed. When the main control unit 20 determines that there is no instruction for the photographing operation (NO in step S28), the main control unit 20 proceeds to the process of step S21.

  When the main control unit 20 determines that there is an instruction for a shooting operation (step S28, YES), the main control unit 20 acquires image data as main data by executing the imaging operation (step S29).

  When executing the photographing operation, the main control unit 20 transmits a biometric information acquisition request to the wearable device 3 (step S30). The biometric information acquisition request is information requesting the wearable device 3 to transmit biometric information to the imaging device 2. The biometric information acquisition request includes information indicating biometric information for which transmission is requested. The main control unit 20 adds information indicating the biological information selected in step S27 to the biological information acquisition request. Thereby, the main control unit 20 requests the wearable device 3 to transmit the biological information selected in step S27. The wearable device 3 transmits biometric information to the imaging device 2 when receiving a biometric information acquisition request.

  After transmitting the biometric information acquisition request to the wearable device 3, the main control unit 20 acquires biometric information as sub data transmitted from the wearable device 3 (step S31). Further, the main control unit 20 may be configured to further acquire shooting information including imaging settings at the time of shooting as sub data. Further, the main control unit 20 may be configured to further acquire a thumbnail generated from the image data as sub data. In addition, the main control unit 20 may be configured to further acquire position information generated by GPS at the time of imaging as sub data.

  The main control unit 20 generates an image file by filing the main data and the sub data as one file (step S32).

  The main control unit 20 records the filed image file on the recording medium M attached to the memory I / F 18 (step S33), and ends the cooperative shooting process.

  FIG. 7 is a flowchart for explaining the operation of the wearable device 3 as a cooperation device that operates in cooperation with the imaging device 2.

  The control unit 40 of the wearable device 3 acquires the wearer's biometric information by controlling the information acquisition unit 32 (step S41). When there are a plurality of pieces of biometric information that can be acquired, the control unit 40 may be configured to acquire preset information from among the plurality of pieces of biological information.

  The control unit 40 determines whether or not the imaging device 2 is already connected (step S42). When it determines with having connected with the imaging device 2 (step S42, YES), the control part 40 transfers to the process of step S46.

  When it determines with having not connected with the imaging device 2 (step S42, NO), the control part 40 determines whether there exists a connection request from the imaging device 2 (step S43). When the control unit 40 determines that there is no connection request from the imaging device 2 (step S43, NO), the control unit 40 proceeds to the process of step S41.

  When it is determined that there is a connection request from the imaging device 2 (step S43, YES), the control unit 40 establishes a connection with the imaging device 2 (step S44). The control unit 40 establishes a connection with the imaging device 2 by making various communication arrangements with the imaging device 2. Note that the control unit 40 may be configured to perform an authentication process for determining whether or not to establish a connection with the imaging device 2. For example, the control unit 40 approves the connection of the imaging device 2 when the imaging device 2 that transmitted the connection request is a device that is set in advance as a cooperation target. Further, the control unit 40 is configured to determine whether or not to approve the connection of the imaging device 2 that has transmitted the connection request by transmitting and receiving an authentication code such as a preset PIN to and from the imaging device 2. Also good.

  When the connection with the imaging device 2 is established, the control unit 40 transmits a list of biological information that can be acquired by itself to the imaging device 2 (step S45). Note that the control unit 40 may be configured to transmit the list of biological information acquired in step S41 to the imaging device 2.

  The control unit 40 determines whether there is a biometric information acquisition request (step S46). That is, the control unit 40 determines whether a biological information acquisition request transmitted from the imaging device 2 has been received. If it is determined that there is no biometric information acquisition request (step S46, NO), the control unit 40 proceeds to the process of step S41.

  When it is determined that there is a biometric information acquisition request (step S46, YES), the control unit 40 transmits the biometric information requested by the biometric information acquisition request to the imaging device 2 (step S47). The control unit 40 may be configured to transmit the biological information already acquired by the information acquisition unit 32 and stored in the storage unit 38 to the imaging device 2, or newly acquire biological information by the information acquisition unit 32. Then, it may be configured to transmit to the imaging device 2. Further, the control unit 40 may be configured to total the biological information acquired by the information acquisition unit 32 during a certain period and transmit the totaled result as the biological information to the imaging device 2.

  When transmitting the biological information, the control unit 40 determines whether or not to end the operation (step S48). Control part 40 returns to Step S41, when operation is not completed (Step S48, NO). Moreover, the control part 40 complete | finishes the process of FIG. 7, when complete | finishing operation | movement (step S48, YES).

  As described above, the imaging device 2 establishes a connection with the wearable device 3 as a cooperation device, and acquires a list of sub data (biological information) that can be acquired by the wearable device 3. The imaging device 2 selects sub data to be recorded as a file, and transmits an acquisition request (biometric information acquisition request) indicating the selected sub data. When receiving the acquisition request from the imaging device 2, the wearable device 3 transmits the sub data specified by the acquisition request to the imaging device 2. The imaging device 2 acquires main data (image data) in response to a recording instruction (imaging instruction), acquires sub data (biological information) transmitted from the wearable device 3, and combines the main data and sub data into one Record as a file for recording. Thereby, the imaging device 2 can record the main data acquired according to the recording instruction, the sub data acquired from the wearable device 3 as the cooperation device, and one file.

  FIG. 8 is an explanatory diagram for explaining an example of the image file 71. The image file 71 has main data 72 and sub data 73. The main data 72 includes image data 74, for example. The sub data 73 includes, for example, shooting information 75, biological information 76, thumbnail 77, and position information 78.

  The wearable device 3 may be configured to transmit information (apparatus information) that can identify itself to the imaging device when biometric information is transmitted to the imaging device 2. The device information is information that can identify the type of the wearable device 3, for example. Further, the device information may be information allocated to each individual wearable device 3, for example. For example, the device information uses a MAC address or the like. The main control unit 20 of the imaging device 2 may be configured to generate the image file 71 as the sub data 73 by associating the device information acquired together with the biological information from the wearable device 3 with the biological information 76. That is, when the main control unit 20 records the main data and the sub data as a single recording file, the main control unit 20 adds the device information to the recording file as information indicating the supply source of the sub data. Thereby, the supply source of the sub data can be specified from the recording file. That is, the imaging device 2 identifies the wearable device 3 that has supplied the biological information 76 from the image file 71 including the image data 74 as the main data 72 and the biological information 76 as the sub data 73 as in the present embodiment. can do.

  Further, as described above, the biological information may be a result of information processing performed on biological information acquired during a certain period. For example, the biological information may be any information such as an average value, an intermediate value, or a total value of biological information acquired during a certain period. Furthermore, the wearable device 3 may be configured to transmit a comparison result between the acquired biological information and a preset reference value to the imaging device 2 as biological information. Furthermore, the wearable device 3 may be configured to calculate the reference value using the biological information acquired from the wearer. Thereby, the imaging device 2 can acquire biological information indicating a difference between the wearer's state and the reference state.

  In the above-described embodiment, the user's posture, sleep, standing behavior, and so on, which are relatively easy to acquire by taking advantage of the wearable terminal, such as being attached to the body or clothes, and being usable unconsciously for a long time, Daily information such as life information, meals, commuting, work, rest, etc., biological information such as heart rate, blood pressure, pulse wave, blood flow, body temperature, number of steps, brain wave, eye position, blink, and blood sugar level Although the configuration treated as sub-data has been described, it is not limited to this configuration. Any information to be filed as sub-data may be used. In particular, if it can be used unconsciously for a long time, there is an advantage that the time change can be determined. From the change over time, the average value can be obtained, and the reference according to the situation can be determined, and there is an advantage that the change from there and the determination of the abnormal value can be made without difficulty. There are many cases where it is possible to judge data such as more excitement than usual, and there are many cases where comparison data with a set reference value is important, but sometimes it is easier to handle this than the device used for the hand. . This reference value may be a simple time average of values obtained after wearing for a while, but as long as it is biometric data, it is more accurate to reflect the rhythm of life. Based on the result of classifying the time zones like this, it may be reflected as “compared to the average blood pressure after winter breakfast”. Of course, a general average value obtained from age, sex, etc. may be used as a reference. To that effect (reference value and its basis) may be recorded, and further obtained data may be recorded, or a comprehensive judgment result may be recorded. Such complicated processing may be partially supported by another device, and the calculation location may be any device. On the other hand, a device used by hand is suitable for acquiring setting data of the device itself, a process until reaching the setting, and environmental data around the device. In addition, although it is not possible to do hands-free, it is easy to operate by hand, so there is an important merit that more specific and quick operation can be performed.

  Further, for example, the wearable device 3 may be configured to acquire environmental information such as atmospheric pressure, temperature, humidity, water pressure, and position information acquired by GPS, and transmit it to the imaging device 2 as sub data. Environmental information is information indicating the environment around the user wearing the wearable device 3, but because it is wearable, it can be worn unconsciously in a hands-free state, so long-term measurement and its change, Data acquisition close to the experience is possible. The imaging device 2 acquires such environment information from the wearable device 3 and files the acquired environment information as sub-data together with image data as main data, so that the surrounding environment when the image data is acquired can be determined. It can be kept as a record. For example, the climate can be estimated from humidity and temperature. In addition, the altitude of the shooting point can be estimated from the atmospheric pressure. In addition, the water depth at the photographing point can be estimated from the water pressure. Also, the coordinates on the map of the shooting point can be estimated from the position information. The imaging device 2 may be configured to infer an environment at the time of shooting based on the sub data and display it together with the image data when reproducing the image file. Furthermore, the imaging device 2 may be configured to generate a search tag based on the above-described biological information or environment information.

  FIG. 9 is an explanatory diagram for explaining an example of utilization of sub data included in an image file. Here, it is assumed that the atmospheric pressure and heart rate in a certain period are recorded as sub data. For example, as illustrated in FIG. 9, the imaging device 2 can display a graph 91 indicating an altitude estimated from the atmospheric pressure based on the sub-data 73 and a graph 92 indicating the heart rate on the display unit 19. Further, the imaging device 2 can display the heart rate or altitude value and the thumbnail of the image file in association with each other on the display unit 19. According to the example of FIG. 9, a thumbnail 77a and a thumbnail 77b are displayed in association with the heart rate. As described above, when the image capturing apparatus 2 reproduces an image file, the sub-data is used to display information indicating the wearing state of the wearable apparatus 3 at the time of shooting, the surrounding environment, and the like together with the image. Information can be provided. In the example of FIG. 9, the example in which the graph 91 indicating the altitude and the graph 92 indicating the heart rate are displayed on the basis of the time axis has been described, but the configuration is not limited thereto. The imaging device 2 may display information in any format as long as it displays information based on the sub data together with the image.

  Further, in the above-described embodiment, the imaging apparatus 2 has been described as having a configuration in which the sub data acquired in the wearable device 3 is acquired and recorded together with the main data as a file, but is not limited to this configuration. The imaging device 2 may be configured to record image data in a state where the image data can be associated with information generated by the wearable device 3. For example, the wearable device 3 may be configured to detect the posture of the wearer such as standing / walking, sitting, or lying down. Furthermore, the wearable device 3 may be configured to generate a graph 93 indicating a change in posture of the wearer during a certain period as shown in FIG. 10 by plotting the detected posture with reference to time. Furthermore, the wearable device 3 may be configured to upload the generated graph to a server device (not shown).

  When the imaging device 2 acquires image data, the imaging device 2 acquires information for associating the acquired image data with the graph generated in the wearable device 3 as sub data from the wearable device 3, and a file together with the image data as main data. And record. Furthermore, the imaging device 2 uploads the image file to the server device. In this case, based on the sub-data of the image file uploaded from the imaging device 2, the server device performs a process of associating the image file with the graph uploaded from the wearable device 3 and recording it together with the graph. Also good. The process of associating the image file with the graph may be configured to be performed by the wearable device 3 when the imaging device 2 transmits the image file to the wearable device 3.

  Furthermore, the imaging device 2 may be configured to cause the server device to generate a record based on the sub data by uploading an image file in which biological information or environment information is recorded as the sub data to the server device. For example, the imaging device 2 acquires the detection result of the wearer's posture of the wearable device 3 as described above from the wearable device 3 when recording the image data, records the image file, and stores the recorded image file in the server By uploading to the device, it is possible to cause the server device to generate an action record in which the posture of the wearer 3 and the image data are associated with each other. As a result, as shown in FIG. 10, it is possible to leave action records in which the image file 71 a and the image file 71 b are respectively associated with the graph 93 indicating the posture of the wearer 3.

  Still further, the server device or the wearable device 3 is configured to detect that the wearer of the wearable device 3 has taken an unusual behavior by comparing the behavior records of the wearer 3 on different dates. Also good. As a result, the server device or wearable device 3 can detect an event different from usual. As a result, the imaging apparatus 2 can record the image data in association with the event detected in this way.

  Further, the wearable device 3 may be configured to transmit an event detection notification to the imaging device 2 when a behavior different from the usual behavior by the wearer of the wearable device 3 is detected. The imaging device 2 may be configured to perform an operation for prompting the user to take a picture when the event detection notification is received from the wearable device 3. For example, the imaging device 2 may be configured to perform an operation of prompting the user to take a picture by displaying predetermined information on the display unit 19. Further, for example, the imaging device 2 may be configured to perform an operation for prompting the user to take a picture by outputting a predetermined sound from a speaker (not shown) or the like.

  In addition, the imaging device 2 attaches the wearable device 3 to the subject and images the subject with the imaging device 2 so that the image data showing the subject and the biological information acquired from the subject by the wearable device 3 are one. It can be filed as an image file. Thereby, the imaging device 2 can acquire an image file that can be used, for example, for analysis of a training load by a sports player.

  In addition, the imaging apparatus 2 converts the biometric information acquired by a medical device as a linked device and image data obtained by imaging a patient (or an affected part of the patient) into a single image file as a file. It is possible to obtain an image file that is useful to be added to and recorded.

  The wearable device 3 has been described as a configuration that transmits biometric information to the imaging device 2 when a biometric information acquisition request is received from the imaging device 2, but is not limited to this configuration. The wearable device 3 may be configured to periodically transmit biological information to the imaging device 2 when a connection is established with the imaging device 2. According to such a configuration, after the connection with the wearable device 3 is established, the imaging device 2 selects the biological information to be acquired according to the operation, and transmits information indicating the selected biological information to the wearable device 3. Thus, the biological information is periodically acquired from the wearable device 3 before the imaging operation is performed. When the imaging device 2 is configured to periodically acquire biometric information from the wearable device 3, the imaging device 2 files the result of performing information processing on the biometric information acquired during a certain period together with image data as sub-data. It may be a configuration. In addition, for example, the imaging device 2 may be configured to handle any information such as an average value, an intermediate value, or a total value of biological information acquired during a certain period as biological information. Furthermore, the imaging device 2 may be configured to file a comparison result between the acquired biological information and a preset reference value as a sub-data together with the image data. The imaging device 2 may be configured to calculate the reference value using the biological information acquired from the wearable device 3.

  Furthermore, the imaging device 2 may be configured to perform shooting control according to the sub data acquired from the wearable device 3. For example, the imaging device 2 may be configured to predict the weather by acquiring environmental information from the wearable device 3 and to control the WB according to the predicted weather. In addition, the imaging device 2 predicts the wearer's state by acquiring biological information from the wearable device 3, and controls the WB or the like according to the predicted state, so that the wearer of the wearable device 3 wears. Can be reflected in the image.

  In the above-described embodiment, the imaging device 2 has been described as being configured to acquire biological information from the wearable device 3, but is not limited to this configuration. The imaging device 2 may be configured to acquire the operator's biological information. The imaging device 2 configured in this manner associates the device information with the biometric information acquired by itself, and creates a file by correlating the device information acquired from the wearable device 3 with the biometric information from the wearable device 3. The supplier of each biological information can be clarified.

(Second Embodiment)
Hereinafter, the recording apparatus, the control method for the recording apparatus, the recording system, and the wearable information processing apparatus according to the second embodiment will be described in detail with reference to FIGS. 11 to 19.

  FIG. 11 is an explanatory diagram illustrating an example of an imaging system 1A as a recording system. The imaging system 1A includes an imaging device 2A as a recording device, wearable devices 3A and 4A as wearable information processing devices, and the like.

  The imaging device 2A is a camera that acquires image data by capturing a subject image. The imaging device 2A is different from the imaging device 2 in that the imaging operation in the wearable device 3A or 4A can be controlled.

  The wearable devices 3A and 4A are information processing devices that can acquire the wearer's biological information when worn on the wearer's body. The wearable devices 3A and 4A include a communication unit that communicates with the imaging device 2, an information acquisition unit that acquires biological information of a wearer of the wearable device 3A, an imaging unit (camera) that acquires an image, and a display that displays an image. A section. The wearable devices 3A and 4A are, for example, a wristband type, a wristwatch type, a glasses type, an earphone type, or other devices that can be worn on the human body. In the present embodiment, it is assumed that wearable device 3A is a watch-type, and wearable device 4 is a spectacle-type display device (FMD: Face Mount Display).

FIG. 12 is a block diagram illustrating an example of the configuration of the imaging apparatus 2A.
As illustrated in FIG. 12, the imaging device 2A includes a lens 11, an imaging device 12, a signal processing unit 13, an image processing unit 14, a sound collection unit 15, an operation unit 16, a communication unit 17, a memory I / F 18, and a main control. 20A is provided.

  The main control unit 20A controls the operation of each unit of the imaging device 2A. The main control unit 20A is different from the main control unit 20 in that the main control unit 20A includes an imaging control cooperation unit 28A that controls an imaging operation in the wearable device to be linked.

  The imaging control cooperation unit 28A performs processing for reflecting the change of the imaging setting in the imaging device 2 also on the wearable device 3A or 4A as imaging control cooperation. For example, the imaging control cooperation unit 28A detects that the imaging setting has been changed by the imaging control unit 22, generates a control signal (cooperation control signal) according to the changed imaging setting, and generates the generated cooperation control signal. Sent to the wearable device to be linked. The phrase “according to the setting” is not necessarily exactly matched to the setting, and there are systems with specifications that place more emphasis on recording the surrounding environment than the object being shot. Adjustment control may be used. In addition to reflecting the result of the image on the image, it is also important that 3D information called an image can be easily obtained, and an intuitive operation can be reflected on acquisition of other information. In addition, there is also the merit that the feelings can be reflected in devices that are difficult to operate by hand (wearable or remote), etc., by delicate operations that are unique to devices that are operated by hand. In other words, an imaging unit that captures an image of a subject according to a manual setting and acquires image data, a communication unit that communicates with a cooperation device including an information acquisition unit, an imaging control unit that changes the imaging setting, including a GUI, There is also an aspect of an imaging apparatus including a control cooperation unit that controls information acquisition characteristics of the information acquisition unit in the cooperation device according to the change of the imaging setting. The information acquisition is because the sound collection characteristics of the sound can be changed or the temperature measurement range can be specified by specifying the image. In addition, the information acquisition unit may acquire biological information. In this case, measurement characteristics such as sensitivity and timing may be changed according to control of the manual operation device. In other words, depending on the operation of the manually operated device, more detailed determination may be necessary depending on information associated with the image obtained by the device, or on the contrary, rough timing may be acceptable. For example, when images are acquired intermittently by manual operation, biometric information may be acquired at that timing.

  In addition, the imaging control cooperation unit 28A performs processing for displaying an image of a partial region (enlarged region) of image data as a through image acquired by the imaging unit on the wearable device 3A or 4A as imaging control cooperation. For example, the imaging control cooperation unit 28A sets an enlarged area in the image data as a through image acquired by the imaging unit, cuts out an image of the set enlarged area, and sends the cut out image (enlarged image) to the wearable device 3A or 4A. Send.

  FIG. 13 shows an example of the configuration of the wearable devices 3A and 4A. In order to simplify the description, the wearable devices 3A and 4A will be described as having the same configuration. The wearable devices 3A and 4A include a camera 31A, an information acquisition unit 32, a sound collection unit 35, an operation unit 36, a communication unit 37, a storage unit 38, a display unit 39, and a control unit 40A. That is, the wearable devices 3A and 4A are different from the wearable device 3 in the configuration of the camera 31A and the control unit 40A.

  The camera 31A is a camera provided in the wearable devices 3A and 4A. The camera 31A includes an image sensor that converts light into an electrical signal, and a lens that forms light on the image sensor as a subject image. Based on the control of the control unit 40A, the camera 31A converts the light received by the optical system into an electrical signal by the imaging device, and acquires image data.

  The control unit 40A controls the operation of each unit of the wearable devices 3A and 4A. The control unit 40A changes the imaging setting in accordance with a signal (cooperation control signal) transmitted from the cooperation target imaging device 2A and an image (enlarged image) transmitted from the cooperation target imaging device 2A. The display point is different from the control unit 40. The control unit 40A functions as an operation determination unit 41, an information processing unit 42, a display control unit 43A, a recording control unit 44, and an imaging control unit 45A.

  The display control unit 43A controls display processing by the display unit 39. For example, the display control unit 43 causes the display panel of the display unit 39 to display a screen by inputting image data to the display unit 39. The display control unit 43 generates OSD data for causing the display unit 39 to display an on-screen display (OSD) including display of various icons and characters based on various setting information and the state of the wearable device 3. . The display control unit 23 inputs image data on which the OSD based on the OSD data is superimposed to the display unit 39. Further, the display control unit 43A displays the image (enlarged image) transmitted from the imaging device 2A on the display unit 39. That is, the display control unit 43A causes the display unit 39 to display an image of a partial area of the image data acquired by the imaging device 2A.

  The imaging control unit 45A controls various processes related to imaging. For example, the imaging control unit 45A controls the camera 31A to execute an imaging operation based on the operation signal. The imaging control unit 45 </ b> A changes various imaging settings based on the operation signal in the same manner as the imaging control unit 22 of the imaging device 2. For example, the imaging control unit 45A includes settings such as an exposure value (Ev value) and a white balance (WB) based on the operation signal. Further, the imaging settings change imaging settings such as aperture value (F value), shutter speed (SS), ISO sensitivity, AF mode, recording image quality, aspect ratio, high dynamic range (HDR), and photometry mode.

  Still further, the imaging control unit 45A acquires the cooperation control signal transmitted from the imaging apparatus 2A, and changes the imaging setting based on the cooperation control signal. That is, the imaging control unit 45A changes its own imaging setting to the same setting as the imaging setting in the imaging device 2A. Note that if the setting items in the imaging setting of the imaging unit 2A and the imaging setting for controlling the camera 31A do not match, the imaging control unit 45A matches only the matching items with the imaging settings of the imaging device 2A. The structure to change may be sufficient. If the setting items in the imaging setting of the imaging unit 2A and the imaging setting for controlling the camera 31A do not match, the imaging control unit 45A performs an operation on the received cooperative control signal and performs its own operation. The configuration may be such that the setting is changed to a setting corresponding to the setting item of the imaging setting.

  14 and 15 are flowcharts for explaining the operation of the imaging apparatus 2A. Note that the processing related to the mode selection of the image pickup apparatus 2A is the same as the example shown in FIG.

  FIG. 14 is a flowchart for explaining another example of the linked photographing process shown in step S16 of FIG.

  The main control unit 20A acquires image data by the imaging unit, and executes a live view for displaying the acquired image data on the display unit 19 (step S51).

  The main control unit 20A determines whether or not it has already been connected to the cooperation device (step S52). The cooperation device is a device that can acquire the sub data and can communicate with the imaging device 2A, and is the wearable device 3A or the wearable device 4A in this embodiment. That is, the main control unit 20A determines whether there is a wearable device 3A or a wearable device 4A in a communicable state. When it is determined that the device is already connected to the cooperation target device (step S52, YES), the main control unit 20A proceeds to the process of step S58.

  When it is determined that the main control unit 20A has not been connected to the cooperation device (step S52, NO), the main control unit 20A determines whether there is a cooperation device (step S53). For example, the main control unit 20A transmits a predetermined signal to a communicable range, and determines whether or not there is a cooperation device according to the response. When it determines with there being no cooperation apparatus (step S53, NO), 20 A of main control parts transfer to the process of step S51.

  When it is determined that there is a cooperation device (step S53, YES), the main control unit 20A transmits a connection request to the cooperation device. For example, when the main control unit 20A detects the wearable device 4A as the cooperation device in a state where the connection with the wearable device 4A is not established, the main control unit 20A transmits a connection request to the wearable device 4A. When the wearable device 4A receives a connection request from the imaging device 2A, the wearable device 4A determines whether or not to approve the connection of the imaging device 2A, and performs various communication arrangements with the imaging device 2A when the connection is approved. Thus, the connection with the imaging device 2A is established. The main control unit 20A may be configured to select a cooperation device according to an operation. For example, the main control unit 20A causes the display unit 19 to display a plurality of buttons 62 for allowing the user to select a cooperation device as illustrated in FIG. The main control unit 20A selects a cooperation device according to the operation of the button 62 by the touch sensor 16t. Further, for example, the main control unit 20A may be configured to select all devices that can be linked as linked devices. Further, for example, the main control unit 20A may have a configuration in which the main control unit 20A selects a preset device as a linkage device among all the devices that can be linked. In the following description, the cooperation device is assumed to be the wearable device 4A.

  The main control unit 20A determines whether or not a connection has been established with the wearable device 4A (step S55). When it is determined that a connection has not been established with the wearable device 4A (step S55, NO), the main control unit 20A proceeds to the process of step S51.

  When the main control unit 20A determines that a connection has been established with the wearable device 4A (step S55, YES), the main control unit 20A displays a list of biological information that can be acquired in the wearable device 4A from the wearable device 4A. Obtain (step S56). For example, the main control unit 20A acquires a list of biometric information that can be acquired in the wearable device 4A that the wearable device 4A transmits to the imaging device 2A when the connection is established. The main control unit 20A may be configured to acquire a list of biometric information that can be acquired in the wearable device 4A by transmitting a request to the wearable device 4A and receiving a response to the request.

  The main control unit 20A selects the biological information to be recorded (step S57). For example, the main control unit 20A selects the biological information to be recorded according to the operation from the biological information that can be acquired by the wearable device 4A. Specifically, the main control unit 20A displays a plurality of buttons 61 for causing the user to select biometric information to be acquired based on a list of biometric information that can be acquired by the wearable device 4A, as shown in FIG. 19 is displayed. The main control unit 20A selects the biological information corresponding to the user operation by recognizing whether or not the button 61 is selected according to the operation of the touch sensor 16t. Further, for example, the main control unit 20A may be configured to select all biological information that can be acquired in the wearable device 4A. Further, for example, the main control unit 20A may be configured to select biometric information set in advance from biometric information that can be acquired by the wearable device 4A.

  Next, the main control unit 20A determines whether or not to perform shooting control cooperation (step S58). For example, the main control unit 20A has a setting as to whether or not to perform shooting control cooperation, and determines whether or not to execute shooting control cooperation based on this setting. In addition, the main control unit 20A determines whether or not the linked device with which the connection has been established supports shooting control linkage. If the linked device with which the connection has been established supports shooting control linkage, the main control unit 20A performs shooting control linkage. It may be determined to be executed.

  When the main control unit 20A determines to execute the shooting control cooperation (step S58, YES), the main control unit 20A executes the shooting control cooperation described later (step S59). If the main control unit 20A determines not to perform the imaging control cooperation (NO in step S58), the main control unit 20A proceeds to the process of step S60.

  The main control unit 20A determines whether there is an instruction for a shooting operation (step S60). As described above, the main control unit 20A determines that an instruction to execute the photographing operation is input when the release button of the operation unit 16 is fully pressed. When the main control unit 20A determines that there is no instruction for the photographing operation (step S60, NO), the main control unit 20A proceeds to the process of step S51.

  When the main control unit 20A determines that there is an instruction for a shooting operation (step S60, YES), the main control unit 20A acquires image data as main data by executing the imaging operation (step S61).

  When executing the photographing operation, the main control unit 20A transmits a biometric information acquisition request to the wearable device 4A (step S62). When the wearable device 4A receives the biometric information acquisition request, the wearable device 4A transmits the biometric information to the imaging device 2A.

  After transmitting the biometric information acquisition request to the wearable device 4A, the main control unit 20A acquires biometric information as sub data transmitted from the wearable device 4A (step S63). The main control unit 20A may be configured to further acquire shooting information including shooting settings at the time of shooting as sub data. Further, the main control unit 20A may be configured to further acquire a thumbnail generated from the image data as sub data. The main control unit 20A may be configured to further acquire position information generated by GPS at the time of imaging as sub data.

  The main controller 20A generates an image file by filing the main data and the sub data as one file (step S64).

  The main control unit 20A records the filed image file on the recording medium M attached to the memory I / F 18 (step S65), and ends the cooperative shooting process.

  FIG. 15 is a flowchart for explaining the imaging control cooperation in step S59 of FIG.

  The main control unit 20A determines whether or not there is an operation input for changing the imaging setting (step S71). When there is no operation input for changing the imaging setting (step S71, NO), the main control unit 20A proceeds to the process of step S75.

  When there is an operation input for changing the imaging setting (YES in step S71), the main control unit 20A changes the imaging setting based on the operation signal (step S72).

  The main control unit 20A generates a cooperation control signal for controlling the cooperation device based on the imaging setting changed in step S72 (step S73). The main control unit 20A generates a cooperation control signal for reflecting the same change as the change in the imaging setting in step S72 to the wearable device 4A. The main control unit 20A may be configured to appropriately select setting items to be reflected according to the specifications of the wearable device 4A. Further, the main control unit 20A may be configured to select a setting item that reflects the change in the wearable device 4A according to an operation. For example, as shown in FIG. 16, as shown in FIG. 16, a plurality of buttons 63 for causing the user to select setting items for performing imaging control cooperation are displayed on the display unit 19. The main control unit 20A selects a setting item for performing imaging control cooperation according to the operation of the button 63 by the touch sensor 16t.

  The main control unit 20A transmits the generated cooperation control signal to the wearable device 4A (step S74).

  Next, the main control unit 20A determines whether or not to output an enlarged image (step S75). For example, the main control unit 20A has a setting as to whether or not to output an enlarged image, and determines whether or not to output an enlarged image based on this setting. Further, the main control unit 20A may determine whether or not the linked device with which the connection has been established includes a display unit, and may determine to output an enlarged image when the linked device includes a display unit. When determining that the enlarged image is not output (NO in step S75), the main control unit 20A ends the imaging control cooperation.

  When the main control unit 20A determines to output an enlarged image (step S75, YES), the main control unit 20A sets an enlarged area in the image data acquired in step S51, cuts out an image of the enlarged area, acquires an enlarged image, and enlarges the image. Is transmitted to the wearable device 4A (step S76), and the imaging control cooperation is terminated.

  FIG. 17 is a flowchart for explaining the operation of the cooperation device that operates in cooperation with the imaging apparatus 2A. Here, the operation of wearable device 4A as a cooperation device that operates in cooperation with imaging device 2A will be described.

  The control unit 40A of the wearable device 4A acquires the biological information of the wearer 4A by controlling the information acquisition unit 32 (step S81). When there are a plurality of pieces of biometric information that can be acquired, the control unit 40A may be configured to acquire preset information from among the plurality of pieces of biological information.

  The control unit 40A determines whether or not the imaging device 2A is already connected (step S82). When it determines with having connected with the imaging device 2A (step S82, YES), 40 A of control parts transfer to the process of step S87.

  When it is determined that the connection with the imaging device 2A is not completed (step S82, NO), the control unit 40A determines whether there is a connection request from the imaging device 2A (step S83). When the control unit 40A determines that there is no connection request from the imaging apparatus 2A (step S83, NO), the control unit 40A proceeds to the process of step S81.

  When it is determined that there is a connection request from the imaging device 2A (step S83, YES), the control unit 40A establishes a connection with the imaging device 2A (step S84).

  When the connection with the imaging device 2A is established, the control unit 40A transmits a list of biometric information that can be acquired by itself to the imaging device 2A (step S85). The control unit 40A may be configured to transmit the list of biological information acquired in step S81 to the imaging device 2A.

  40 A of control parts determine whether the cooperation control signal was received (step S86). When it is determined that the cooperation control signal has not been received (step S86, NO), the control unit 40A proceeds to the process of step S88.

  When it is determined that the cooperation control signal has been received (step S86, YES), the control unit 40A changes the imaging setting based on the cooperation control signal (step S87). That is, the control unit 40A changes its own imaging setting to the same setting as the imaging setting in the imaging device 2A.

  Next, the control unit 40A determines whether or not an enlarged image has been received (step S88). When it is determined that the enlarged image is not received (step S88, NO), the control unit 40A proceeds to the process of step S90.

  When it is determined that the enlarged image is received (step S88, YES), the control unit 40A displays the enlarged image on the display unit 39 (step S89). That is, the control unit 40A enlarges and displays a part of the image data displayed as a through image in the imaging device 2A.

  The control unit 40A determines whether there is a biometric information acquisition request (step S90). That is, the control unit 40A determines whether a biological information acquisition request transmitted from the imaging device 2A has been received. When it is determined that there is no biometric information acquisition request (step S90, NO), the control unit 40A proceeds to the process of step S81.

  When it is determined that there is a biometric information acquisition request (step S90, YES), the control unit 40A transmits the biometric information requested by the biometric information acquisition request to the imaging device 2A (step S91). The control unit 40A may be configured to transmit the biological information already acquired by the information acquisition unit 32 and stored in the storage unit 38 to the imaging device 2A, or newly acquire biological information by the information acquisition unit 32. Then, it may be configured to transmit to the imaging device 2A. Further, the control unit 40A may be configured to total the biological information acquired by the information acquisition unit 32 during a certain period and transmit the total result to the imaging device 2A as the biological information.

  40 A of control parts will determine whether operation | movement is complete | finished, if biometric information is transmitted (step S92). When the control unit 40A does not end the operation (step S92, NO), the control unit 40A returns to step S81. Moreover, 40 A of control parts complete | finish the process of FIG. 17, when complete | finishing operation | movement (step S92, YES).

  As described above, when an operation for changing the imaging setting is performed, the imaging device 2A changes the imaging setting and causes the wearable device 4A that has established the connection to perform the same control as the change of the imaging setting. The cooperation control signal is generated, and the generated cooperation control signal is transmitted to the wearable device 4A. The wearable device 4A changes the imaging setting for controlling the camera 31A based on the cooperation control signal acquired from the imaging device 2A. Thereby, the imaging device 2A can cause the wearable device 4A as the cooperation device to execute the same control as itself.

  According to such a configuration, for example, as illustrated in FIG. 18, the imaging apparatus 2 </ b> A performs imaging when it is possible to acquire image data 82 with appropriate exposure from the imaging settings when acquiring image data 81 that is not properly exposed. The change in setting is also reflected in the wearable device 4A. As a result, the wearable device 4A can change the imaging setting from the imaging setting that has acquired the image data 83 that is not properly exposed to the setting that can acquire the image data 84 that is appropriately exposed. Thereby, the imaging apparatus 2A can appropriately control the imaging setting of the camera 31A in a wearable apparatus that generally has few operation members or is difficult to operate. As a result, the convenience of the wearable device 3A can be enhanced.

  In addition, as described above, the imaging device 2A cuts out an enlarged image from image data as a through image, and transmits the extracted enlarged image to the wearable device 3A or 4A (herein described as the wearable device 3A) with which the connection has been established. . The wearable device 3A displays an enlarged image acquired from the imaging device 2A on the display unit 39. As a result, the imaging device 2A can display a partial image of the angle of view on the wearable device 3A as the cooperation device.

  According to such a configuration, for example, as illustrated in FIG. 19, the imaging device 2A sets the enlargement area 65 on the image data as the through image, cuts out the image of the enlargement area 65, and displays the image on the wearable device 3A. . As a result, the imaging device 2A can enlarge a part of the through image and display it on the wearable device 3A. Since the wearable device 3A is a clock type as described above, it is expected that the wearable device 3A is located near the imaging device 2A when the user performs an operation for focusing with the imaging device 2A. Therefore, for example, the imaging device 2A can display an enlarged image useful for confirming the focusing result on the wearable device 3A by setting the enlarged region 65 in the vicinity of the focus position (AF area) in the image data. it can.

  Note that the main control unit 20A of the imaging device 2A may be configured to change the position and size of the enlarged region 65 in accordance with the operation of the operation unit 16, for example. For example, the main control unit 20A of the imaging device 2A may be configured to change the position and size of the enlarged region 65 by a touch operation by the touch sensor 16t, for example.

  In the above-described embodiment, the imaging apparatus 2A has been described as generating and transmitting a cooperation control signal for reflecting the change of the imaging setting to the wearable apparatus 4A when the imaging setting is changed according to the operation. It is not limited to this configuration. For example, the imaging device 2A may be configured to generate and transmit a cooperation control signal for reflecting the change of the imaging setting also to the wearable device 4A when the imaging setting is changed by automatic processing such as AE processing.

  Further, the imaging device 2A transmits the subject distance determined by the AF processing (the distance from the principal point of the lens 11 to the subject to be focused) to the wearable device 4A as a cooperation control signal, so that the AF processing of the wearable device 4A is performed. It may be configured to reflect the subject distance determined by the imaging device 2A.

  Further, when the imaging device 2A determines to execute imaging in step S60 of FIG. 14, the imaging device 2A generates a signal for instructing the wearable device 4A to execute imaging and transmits the signal to the wearable device 4A. Good. In this case, the wearable device 4A performs imaging according to a signal from the imaging device 2A. Thereby, the imaging device 2A and the wearable device 4A can acquire image data almost simultaneously.

  Furthermore, the wearable device 4A may be configured to transmit the acquired image data and device information to the imaging device 2A as sub data. According to such a configuration, the imaging apparatus 2A can acquire biological information, environment information, and image data captured by the wearable apparatus 4A from the wearable apparatus 4A as sub data. Thereby, the imaging device 2A converts the image data as the main data acquired by itself and the biological information, the environment information, and the image data as the sub data acquired from the wearable device 4A into a single image file. Can be recorded.

  The wearable device 4A may be configured to perform moving image shooting. The wearable device 4A may be configured to change the imaging setting for moving image shooting in response to the cooperation control signal when the cooperative control signal is received from the imaging device 2A during moving image shooting.

  Furthermore, the wearable device 4A may be configured to insert a chapter into a moving image that is captured when a signal instructing execution of imaging is received from the imaging device 2A during moving image shooting.

  It should be noted that the functions described in the above embodiments are not limited to being configured using hardware, but can be realized by causing a computer to read a program describing each function using software. Each function may be configured by appropriately selecting either software or hardware.

  Such equipment and systems can record specific information, along with actions taken by the user at that time (or by the time), measurement environment, etc., at the time of inspections, reports, and evidence material creation. Can be used in the field. Needless to say, it can be applied to the fields of information acquisition and recording by rewriting image data as audio data or other sensor data.

  Note that the present invention is not limited to the above-described embodiment as it is, and can be embodied by modifying the constituent elements without departing from the scope of the invention in the implementation stage. Further, various inventions can be formed by appropriately combining a plurality of constituent elements disclosed in the embodiment. For example, some components may be deleted from all the components shown in the embodiment. Furthermore, you may combine suitably the component covering different embodiment.

  DESCRIPTION OF SYMBOLS 1 ... Imaging system, 2 ... Imaging apparatus, 3 ... Wearable apparatus, 4 ... Wearable apparatus, 11 ... Lens, 13 ... Signal processing part, 14 ... Image processing part, 15 ... Sound collecting part, 16 ... Operation part, 16t ... Touch Sensor 17, Communication unit 19, Display unit 20, Main control unit 21, Operation determination unit 22, Imaging control unit 23, Display control unit 24, Main data processing unit 25, Sub data processing unit 26 ... File conversion unit, 27 ... Recording control unit, 28A ... Imaging control cooperation unit, 31A ... Camera, 32 ... Information acquisition unit, 35 ... Sound collection unit, 36 ... Operation unit, 36t ... Touch sensor, 37 ... Communication unit, 38 ... Storage unit, 39 ... Display unit, 40 ... Control unit, 41 ... Operation determination unit, 42 ... Information processing unit, 43 ... Display control unit, 43A ... Display control unit, 44 ... Recording control unit, 45A ... Imaging control unit .

Claims (19)

A communication unit that communicates with the linked device;
A first acquisition unit for acquiring main data;
A second acquisition unit for acquiring sub data from the cooperation device;
A recording unit for recording the main data and the sub data as one file;
Equipped with,
The second acquisition unit is a recording device that acquires a list of the sub data that can be acquired in the cooperation device and selects the sub data acquired by the second acquisition unit from the list . The second acquisition unit acquires device information for identifying the cooperation device together with the sub data,
The recording apparatus according to claim 1, wherein the recording unit adds the device information to the file.   The recording apparatus according to claim 1, wherein the recording unit records a comparison result between the sub data and a preset reference value as a file together with the main data as sub data.   The recording apparatus according to claim 1, wherein the recording unit records a calculation result obtained by performing a predetermined calculation on the sub data acquired during a predetermined period as a file together with the main data as sub data.   The recording apparatus according to claim 3, wherein the recording unit calculates the reference value based on sub data acquired during a predetermined period. A communication unit that communicates with the linked device;
A first acquisition unit for acquiring main data;
A second acquisition unit for acquiring sub data from the cooperation device;
A recording unit for recording the main data and the sub data as one file;
Comprising
The recording unit adds a search tag generated based on the sub data to the file,
A recording apparatus further comprising a search unit that acquires a search tag and searches for the file to which the search tag that matches the acquired search tag is added. A communication unit that communicates with the linked device;
A first acquisition unit for acquiring main data;
A second acquisition unit for acquiring sub data from the cooperation device;
A recording unit for recording the main data and the sub data as one file;
Comprising
The first acquisition unit acquires image data as the main data,
The second acquisition unit includes at least one of biometric information indicating the state of the wearer of the cooperation device acquired by the cooperation device and environment information indicating an environment around the wearer of the cooperation device. As the secondary data,
The recording unit is a recording device that records the main data and the sub data as one image file. The recording apparatus according to claim 7 , wherein the biological information is a heart rate, a body temperature, a step count, an electroencephalogram, or a blood glucose level. The recording apparatus according to claim 7 , wherein the environmental information is atmospheric pressure, temperature, humidity, water pressure, or position information. A method of controlling a recording apparatus including a communication unit that communicates with a cooperation device,
Get the main data,
Acquire a list of sub data that can be acquired in the linked device,
Select the sub data to be acquired from the list,
Obtain sub data from the linked device,
A method for controlling a recording apparatus, wherein the main data and the sub data are recorded as one file. A recording system comprising: a wearable information processing device; and a recording device that cooperates with the wearable information processing device,
The wearable information processing apparatus includes:
A first communication unit that communicates with the recording device;
A first acquisition unit for acquiring sub data;
A supply unit for supplying the sub data to the recording device;
Comprising
The recording device comprises:
A second communication unit that communicates with the wearable information processing apparatus;
A second acquisition unit for acquiring main data;
A third acquisition unit for acquiring the sub data from the wearable information processing apparatus;
A recording unit for recording the main data and the sub data as one file;
Equipped with,
The recording system in which the second acquisition unit acquires a list of the sub data that can be acquired in the wearable information processing apparatus, and selects the sub data acquired by the second acquisition unit from the list . The first acquisition unit includes at least one of biometric information indicating a state of a wearer of the wearable information processing apparatus and environment information indicating an environment around the wearer of the wearable information processing apparatus. As the secondary data,
The second acquisition unit acquires image data as the main data,
The recording system according to claim 11 , wherein the recording unit records the main data and the sub data as one image file. A wearable information processing apparatus for supplying information to a recording apparatus,
A communication unit that communicates with the recording device;
An acquisition unit that supplies a list of sub data that can be acquired to the recording device and acquires the sub data selected in the recording device ;
A supply unit for supplying the sub data to the recording device;
A wearable information processing apparatus. The acquisition unit obtains at least one of biometric information indicating a state of a wearer of the wearable information processing apparatus and environment information indicating an environment around the wearer of the wearable information processing apparatus as the sub data. The wearable information processing apparatus according to claim 13 , acquired as: A method of controlling a recording apparatus including a communication unit that communicates with a cooperation device,
Get the main data,
Obtain sub data from the linked device,
Recording the main data and the sub data as one file;
Add a search tag generated based on the sub-data to the file,
A search tag is acquired, and the file to which the search tag that matches the acquired search tag is added is searched;
Control method of recording apparatus. A method of controlling a recording apparatus including a communication unit that communicates with a cooperation device,
Obtain image data as main data,
At least one or more of biometric information indicating the state of the wearer of the linked device acquired by the linked device from the linked device and environment information indicating the environment around the wearer of the linked device is used as sub data. Acquired,
Recording the main data and the sub data as one image file;
Control method of recording apparatus. A program executed by a recording device including a communication unit that communicates with a cooperation device,
In the recording device,
Get the main data,
Get a list of secondary data that can be acquired in the linked device,
Select the sub data to be acquired from the list,
Sub data is acquired from the linked device,
Recording the main data and the sub data as one file;
program. A program executed by a recording device including a communication unit that communicates with a cooperation device,
In the recording device,
Get the main data,
Sub data is acquired from the linked device,
Recording the main data and the sub data as one file;
A search tag generated based on the sub data is added to the file,
Obtain a search tag, and search for the file to which the search tag that matches the obtained search tag is added.
program. A program executed by a recording device including a communication unit that communicates with a cooperation device,
In the recording device,
Get image data as main data,
At least one or more of biometric information indicating the state of the wearer of the linked device acquired by the linked device from the linked device and environment information indicating the environment around the wearer of the linked device is used as sub data. Let's get
Recording the main data and the sub data as one image file;
program.