JP6874082B2 - Devices, device control methods, systems, and programs - Google Patents

Description

The present invention relates to devices, device control methods, systems, and programs .

Wearable information processing devices (wearable devices) worn by people are generally widespread. For example, as described in Patent Document 1, the sound applied to the wearer is collected, the operation mode corresponding to the wearer's work is set, and the sound collected voice data is set according to the wearer's operation. A wearable device that records the data in association with the set operation mode has been put into practical use.

Japanese Unexamined Patent Publication No. 2011-014081

The wearable device has a function of acquiring information on the wearer (for example, biological information). In addition, a recording device configured to be able to communicate with a wearable device has also been put into practical use. A recording device is a device that records images, sounds, or some other data as main data. In such a recording device, it is important to acquire information from the wearable device and process it in association with the information.

An object of the present invention is to provide a highly convenient device, a control method for the device, a system, and a program.

The device according to the embodiment has a communication unit that communicates with the linked device and acquires a list of sub-data that can be acquired by the linked device when communication is established with the linked device, and a first acquisition unit that acquires main data. To select the sub-data to be acquired by the second acquisition unit based on the second acquisition unit that acquires the sub-data from the linked device and the list of the sub-data that can be acquired by the linked device. A control unit that displays a button on a display unit for displaying the main data and associates the selected sub data with the main data at the time of acquiring the main data is provided .

It is possible to provide a highly convenient device, a control method for the device, a system, and a program.

FIG. 1 is an explanatory diagram for explaining an example of an imaging system according to an embodiment. FIG. 2 is an explanatory diagram for explaining an example of the configuration of the image pickup apparatus according to the embodiment. FIG. 3 is an explanatory diagram for explaining an example of the configuration of the wearable device according to the embodiment. FIG. 4 is an explanatory diagram for explaining a process related to mode selection of the image pickup apparatus according to the embodiment. FIG. 5 is an explanatory diagram for explaining an example of the cooperative shooting process by the imaging device according to the embodiment. FIG. 6 is an explanatory diagram for explaining an example of a process for allowing the user to select the biological information to be acquired. FIG. 7 is an explanatory diagram for explaining an example of the operation of the wearable device according to the embodiment. FIG. 8 is an explanatory diagram for explaining an example of an image file according to an embodiment. FIG. 9 is an explanatory diagram for explaining an example of utilizing sub-data included in the image file according to the embodiment. FIG. 10 is an explanatory diagram for explaining an example of utilizing sub-data included in the image file according to the embodiment. FIG. 11 is an explanatory diagram for explaining an example of an imaging system according to another embodiment. FIG. 12 is an explanatory diagram for explaining an example of the configuration of the image pickup apparatus according to another embodiment. FIG. 13 is an explanatory diagram for explaining an example of the configuration of the wearable device according to another embodiment. FIG. 14 is an explanatory diagram for explaining an example of the cooperative shooting process by the imaging device according to another embodiment. FIG. 15 is an explanatory diagram for explaining an example of imaging control cooperation by the imaging apparatus according to another embodiment. FIG. 16 is an explanatory diagram for explaining an example of a process for allowing the user to select a setting item for imaging control cooperation and a cooperation device. FIG. 17 is an explanatory diagram for explaining an example of the operation of the wearable device according to another embodiment. FIG. 18 is an explanatory diagram for explaining an example of imaging control cooperation according to another embodiment. FIG. 19 is an explanatory diagram for explaining an example of imaging control cooperation according to another embodiment.

(First Embodiment)
Hereinafter, the recording device, the control method of the recording device, the recording system, and the wearable information processing device according to the first embodiment will be described in detail with reference to FIGS. 1 to 10.

FIG. 1 is an explanatory diagram showing an example of an imaging system 1 as a recording system. The image pickup system 1 includes an image pickup device 2 as a recording device, a wearable device 3 as a wearable information processing device, and the like.

The image pickup device 2 is a camera that acquires image data by capturing a subject image. The image pickup device 2 can communicate with, for example, the wearable device 3. For example, the image pickup device 2 and the wearable device 3 are compatible with wireless LAN, Bluetooth (registered trademark), human body communication, and the like. The image pickup device 2 communicates with the wearable device 3 by using a communication means such as wireless LAN, Bluetooth, or human body communication.

The image pickup apparatus 2 performs operations such as changing settings for imaging and imaging a subject image according to an operation. Further, the imaging device 2 acquires the information (for example, biological information) of the wearer of the wearable device 3 acquired by the wearable device 3 from the wearable device 3. The imaging device 2 uses the above image data as the main data, biometric information acquired from the wearable device 3 as the sub data, and records the main data and the sub data as one file (image file).

The wearable device 3 is an information processing device that can acquire biological information of the wearer by being worn on the wearer's body. The wearable device 3 includes at least a communication unit that communicates with the image pickup device 2 and an information acquisition unit that acquires biological information of the wearable device 3. The wearable device 3 acquires the biological information of the wearer and transmits it to the image pickup device 2. The wearable device 3 is, for example, a wristband type, a wristwatch type, a spectacle type, an earphone type, or a device configured in a shape that can be worn on another human body. Some of them are incorporated into clothes, shoes, hats, belts, pillows, futons, sheets, beds, seats, etc. and used directly or through cloth such as clothes, etc., and in this case, they are not recognized as wearable devices. However, in the present invention, a device having a sensor unit capable of acquiring information on the environment from or close to the human body in a hands-free state is treated as a wearable device, and these are covered. In the present embodiment, the wearable device 3 will be described as a wristwatch type device.

FIG. 2 is a block diagram showing an example of the configuration of the image pickup apparatus 2.

As shown in FIG. 2, the image pickup device 2 includes a lens 11, an image sensor 12, a signal processing unit 13, an image processing unit 14, a sound collecting unit 15, an operation unit 16, a communication unit 17, a memory I / F18, and a main control. The unit 20 is provided.

The lens 11 forms an image of the transmitted light on the image sensor 12. The lens 11 includes an image pickup lens in which a plurality of lenses are combined, an aperture mechanism, a lens control unit that controls the operation of the image pickup lens and the aperture mechanism, and an operation member. The image pickup lens forms an image of light rays from the subject on the image pickup surface of the image pickup element 12. The imaging lens may be configured so that the focal length can be changed. The aperture mechanism is configured to be openable and closable, and adjusts the amount of light rays incident on the image sensor via the image sensor based on the control of the lens control unit. The lens control unit is configured to be able to communicate with the main control unit 20. The lens control unit controls the operation of the image pickup lens and the aperture mechanism, respectively, according to the input from the main control unit 20 or the operation of the operation member.

The image sensor 12 is provided at the rear of the lens 11, that is, on the inner side of the housing of the image sensor 2. The image pickup device 12 includes an image pickup surface formed by arranging a plurality of pixels that store electric charges by photoelectric conversion. A color filter is provided on the surface of each imaging pixel on which the light is incident. The image sensor 12 is composed of, for example, a Charge Coupled Devices (CCD) image sensor, a Complementary Metal Oxide Semiconductor (CMOS) image sensor, or another image sensor. The image pickup device 12 generates an image signal by converting a subject image focused on the image pickup surface through the lens 11 into an electric signal according to the amount of light. The plurality of pixels constituting the image pickup surface of the image pickup device 12 may be arranged in a plane shape or in a curved surface shape.

The signal processing unit 13 reads out the image signal generated by the image sensor 12 under the control of the main control unit 20. The signal processing unit 13 performs various signal processing on the read image signal based on the control of the main control unit 20. The signal processing unit 13 converts the signal-processed image signal into digital signal image data and inputs it to the main control unit 20.

As described above, the lens 11, the image sensor 12, and the signal processing unit 13 constitute the image pickup unit. The image pickup unit acquires image data as main data by taking an image of the light imaged on the image pickup surface by the lens 11 by the image pickup device 12. In addition, the imaging unit continuously acquires image data to be displayed as a through image. For example, the image pickup unit outputs the image data generated by the image pickup element 12 from the signal processing unit 13 at a cycle based on the control of the main control unit 20. As a result, it is possible to acquire a plurality of continuous image data that can be displayed as a through image.

The image processing unit 14 performs various image processing such as color correction, gamma (γ) correction, contrast correction, black-and-white / color mode processing, and through image processing on the subject image based on the control of the main control unit 20. .. Further, the image processing unit 14 compresses the image data by the Jpeg method based on the control of the main control unit 20 and converts it into JPEG data which is the image data of the Jpeg method. The image processing unit 14 inputs JPEG data to the main control unit 20.

The sound collecting unit 15 collects sound. For example, the sound collecting unit 15 is a stereo microphone. The sound collecting unit 15 acquires digital voice data by converting voice into an analog electric signal and converting the electric signal into a digital signal. The sound collecting unit 15 inputs the acquired voice data to the main control unit 20.

The operation unit 16 includes a plurality of operation members for the user to perform various operations of the image pickup device 2. The operating member includes, for example, a touch sensor 16t, a release button, a cross button, a power button, and various other buttons. The touch sensor 16t is, for example, a resistive touch sensor, a capacitance type touch sensor, or the like. That is, the touch sensor 16t is a designated position acquisition unit that acquires information indicating a designated position in a certain area. The touch sensor 16t is provided integrally with the display panel of the display unit 19 described later, detects a signal (touch position signal) indicating the touched position on the display panel, and transmits the detected touch position signal to the main control unit 20. input.

The release button is an operating member for instructing the user to perform various processes for acquiring an image to the image pickup apparatus 2. The operation unit 16 gives an instruction to execute the automatic exposure (AE) process, the automatic focusing (AF) process, and the like to the main control unit 20 when the release button is pressed halfway. Further, the operation unit 16 gives an instruction of an imaging operation to acquire an image by the imaging unit to the main control unit 20 when the release button is fully pressed.

The cross-shaped button is an operating member for instructing the image pickup device 2 to perform an up / down / left / right selection operation. For example, the operation unit 16 gives an instruction to select up / down / left / right in various menus to the main control unit 20 according to the operation of the cross-shaped button by the user.

The power button is an operating member for the user to switch the power of the image pickup apparatus 2 on and off.

The communication unit 17 is a circuit for communicating with other electronic devices. The communication unit 17 is configured to be able to communicate with the wearable device 3. For example, the communication unit 17 communicates with the wearable device 3 by a communication method such as wireless LAN, Bluetooth, or human body communication. The communication unit 17 receives data transmitted from an electronic device such as a wearable device 3, and supplies the received data to the main control unit 20. Further, the communication unit 17 receives data to be transmitted from the main control unit 20 to an electronic device such as the wearable device 3, and transmits the received data to the electronic device such as the wearable device 3.

The memory I / F18 has a card slot in which a recording medium M having a plurality of contact terminals can be inserted, and a contact terminal that is electrically connected to the contact terminals of the recording medium M when the recording medium M is inserted into the card slot. And. The recording medium M is, for example, a memory card. The memory I / F 18 relays data input / output between the recording medium M and the main control unit 20.

The display unit 19 displays the screen based on the control of the main control unit 20. The display unit 19 includes a display panel and a drive circuit for displaying a screen on the display panel. The display panel is, for example, a liquid crystal display, an organic EL display, or a display device for displaying another screen. The display panel functions as a touch panel (touch screen) by integrally combining the above-mentioned touch sensor 16t.

The main control unit 20 controls the operation of each unit of the image pickup apparatus 2. The main control unit 20 acquires biometric information as sub-data acquired by the wearable device 3, for example, by communicating with the wearable device 3 by the communication unit 17. Further, the main control unit 20 can transmit a control signal to the wearable device 3 by the communication unit 17, for example.

The main control unit 20 includes, for example, a CPU and a memory. The main control unit 20 realizes various functions by, for example, the CPU reading and executing the program and control data stored in the memory. The main control unit 20 functions as an operation determination unit 21, an imaging control unit 22, a display control unit 23, a main data processing unit 24, a sub data processing unit 25, a file conversion unit 26, and a recording control unit 27.

The operation determination unit 21 determines the operation signal supplied from the operation unit 16. That is, the operation determination unit 21 recognizes what kind of operation is instructed by the operation unit 16.

The image pickup control unit 22 controls various processes related to image pickup. For example, the image pickup control unit 22 controls the image pickup unit so as to execute the image pickup operation based on the operation signal. Further, the image pickup control unit 22 controls processing such as AF, AE, and auto white balance (AWB) based on the operation signal. Further, the image pickup control unit 22 changes the image pickup setting based on the operation signal. The image pickup setting is a setting related to an image pickup operation by the image pickup unit, signal processing by the signal processing unit, and image processing by the image processing unit. Specifically, the imaging setting includes a setting such as an exposure value (Ev value) and a white balance (WB). Further, the imaging setting may include settings such as aperture value (F value), shutter speed (SS), ISO sensitivity, AF mode, recording image quality, aspect ratio, high dynamic range (HDR), and metering mode. ..

Furthermore, the image pickup control unit 22 controls the acquisition of image data that can be displayed as a through image by the image pickup unit. For example, the image pickup control unit 22 controls the signal processing unit 13 so that the image data generated by the image pickup device 12 is read out at a preset cycle. As a result, the image pickup control unit 22 acquires a plurality of continuous image data that can be displayed as a through image by the image pickup unit.

The display control unit 23 controls the display process by the display unit 19. For example, the display control unit 23 causes the display panel of the display unit 19 to display the screen by inputting image data into the display unit 19. For example, the display control unit 23 causes the display unit 19 to display a through image by inputting image data that can be displayed as a through image into the display unit 19.

Further, the display control unit 23 displays OSD data for displaying the on-screen display (OSD) including the display of various icons and characters on the display unit 19 based on various setting information and the state of the image pickup device 2. Generate. For example, the display control unit 23 displays OSD data for displaying the shooting mode of the image pickup device 2, various setting information, the remaining battery level, the number of shots that can be taken, the shootable time, the AF area, and the like on the display device of the display unit 19. To generate. The display control unit 23 inputs the image data on which the OSD based on the OSD data is superimposed to the display unit 19.

The main data processing unit 24 is a processing unit that performs various processes related to the main data when creating an image file. The main data processing unit 24 converts the main data so as to correspond to the format of the image file for recording. The main data processing unit 24 converts the image data (main data) acquired by the imaging unit by the imaging operation into a format for recording as an image file. For example, in the case of setting to record JPEG data as an image file, the main data processing unit 24 converts the acquired image data into JPEG data by the image processing unit 14. Further, for example, in the case of setting to record Raw data as an image file, the main data processing unit 24 converts the acquired image data into Raw data.

The sub-data processing unit 25 is a processing unit that performs various processes related to the sub-data when creating an image file. The sub data processing unit 25 converts the sub data so as to correspond to the format of the image file for recording. The sub data processing unit 25 converts the biometric information (sub data) acquired from the wearable device 3 into a format for recording in an image file. The sub data processing unit 25 may be configured to handle shooting information including imaging settings at the time of shooting, thumbnails of image data as main data, position information acquired by GPS, and the like as sub data.

The file conversion unit 26 generates an image file by filing the main data processed by the main data processing unit 24 and the sub data processed by the sub data processing unit 25 as one file. Further, the file conversion unit 26 may be configured to generate a search tag (search tag) from the secondary data and further add the search tag to the image file.

The recording control unit 27 includes an intermediate buffer for temporarily recording an image. The recording control unit 27 records the image file filed by the file file unit 26 in the intermediate buffer. The recording control unit 27 writes the image file recorded in the intermediate buffer to the recording medium M mounted on the memory I / F18.

FIG. 3 shows an example of the configuration of the wearable device 3. The wearable device 3 includes an information acquisition unit 32, a sound collection unit 35, an operation unit 36, a communication unit 37, a storage unit 38, a display unit 39, and a control unit 40.

The information acquisition unit 32 acquires information stored as sub-data in an image file generated by the image pickup device 2 that operates in cooperation with the image pickup device 2. For example, the information acquisition unit 32 is a sensor capable of detecting information (biological information) indicating the state of the wearer when the wearable device 3 is worn on the wearer's body. The biological information is, for example, information such as the wearer's heart rate, body temperature, number of steps, brain waves, and blood glucose level. The information acquisition unit 32 detects one or more of these pieces of information. The information acquisition unit 32 inputs the acquired biological information to the control unit 40.

The sound collecting unit 35 collects sound. For example, the sound collecting unit 35 is a stereo microphone. The sound collecting unit 35 acquires digital voice data by converting voice into an analog electric signal and converting the electric signal into a digital signal. The sound collecting unit 35 inputs the acquired voice data to the control unit 40.

The operation unit 36 includes a plurality of operation members for the user to perform various operations of the wearable device 3. The operation unit 36 generates an operation signal based on the operation of the operation member by the user, and supplies the generated operation signal to the control unit 40. The operation unit 36 further includes a touch sensor 36t. The touch sensor 36t is a capacitive sensor, a thermo sensor, or a device that generates position information based on other methods. For example, the touch sensor 36t is provided integrally with the display panel of the display unit 39. The touch sensor 36t generates an operation signal based on the operation on the screen displayed on the display panel and supplies the operation signal to the control unit 40.

The communication unit 37 is a circuit for communicating with other electronic devices. The communication unit 37 is configured to be able to communicate with the image pickup apparatus 2. For example, the communication unit 37 communicates with the image pickup device 2 by a communication method such as wireless LAN, Bluetooth, or human body communication. The communication unit 37 receives the data transmitted from the electronic device such as the image pickup apparatus 2, and supplies the received data to the control unit 40. Further, the communication unit 37 receives data to be transmitted from the control unit 40 to the electronic device such as the image pickup device 2, and transmits the received data to the electronic device such as the image pickup device 2.

The storage unit 38 is a storage medium capable of storing various types of information. The storage unit 38 stores, for example, the information acquired by the information acquisition unit 32 based on the control of the control unit 40. That is, the storage unit 38 stores, for example, the biological information acquired by the information acquisition unit 32. The storage unit 38 is, for example, a semiconductor storage device such as a solid state drive (SSD). Further, the storage unit 38 may be configured as a memory I / F such as a card slot into which a recording medium such as a memory card can be inserted.

The display unit 39 displays the screen based on the image input from the control unit 40. The display unit 39 includes a display panel and a drive circuit for displaying an image on the display panel. The display panel is, for example, a liquid crystal display, an organic EL display, or a display device for displaying another screen. The display unit 39 displays the screen on the display panel based on the image input from the control unit 40. The display panel functions as a touch panel (touch screen) by integrally combining the above-mentioned touch sensor 36t.

The control unit 40 controls the operation of each unit of the wearable device 3. The control unit 40 includes, for example, a CPU and a memory. The control unit 40 realizes various functions by, for example, the CPU reading and executing programs, applications, and control data stored in the memory or the storage unit 38. The control unit 40 functions as an operation determination unit 41, an information processing unit 42, a display control unit 43, and a recording control unit 44.

The operation determination unit 41 determines the operation signal supplied from the operation unit 36. That is, the operation determination unit 41 recognizes what kind of operation is instructed by the operation unit 36.

The information processing unit 42 controls various types of information processing. For example, the information processing unit 42 processes data to be transmitted / received to / from the image pickup apparatus 2. For example, the information processing unit 42 analyzes the information transmitted from the image pickup device 2 and recognizes the control content transmitted from the image pickup device 2 to the wearable device 3. Further, the information processing unit 42 converts the data transmitted to the image pickup device 2 into a format that can be analyzed by the image pickup device 2.

In addition, the information processing unit 42 processes the biological information acquired by the information acquisition unit 32. For example, the information processing unit 42 converts the biological information acquired by the information acquisition unit 32 into a file in a recording format. Further, the information processing unit 42 may aggregate the biometric information acquired by the information acquisition unit 32 during a certain period of time, and generate a biometric information file from the aggregated result.

The display control unit 43 controls the display process by the display unit 39. For example, the display control unit 43 causes the display panel of the display unit 39 to display the screen by inputting image data into the display unit 39. The display control unit 43 generates OSD data for displaying the on-screen display (OSD) including the display of various icons and characters on the display unit 39 based on various setting information and the state of the wearable device 3. .. The display control unit 23 inputs the image data on which the OSD based on the OSD data is superimposed to the display unit 39.

The recording control unit 44 records a file of biometric information converted by the information processing unit 42.

4 and 5 are flowcharts for explaining the operation of the image pickup apparatus 2. FIG. 4 is a flowchart for explaining a process related to mode selection of the image pickup apparatus 2.

The main control unit 20 of the image pickup apparatus 2 determines whether or not the shooting mode is selected (step S11), whether or not the cooperative shooting mode is selected (step S12), and whether or not the playback mode is selected (step S12). S13) and whether or not the search mode is selected (step S14) are determined respectively.

When it is determined in step S11 that the shooting mode is selected (steps S11, YES), the main control unit 20 executes the shooting process (step S15), and proceeds to step S19. The photographing process is a process in which the imaging device 2 executes an imaging operation in response to an operation and records image data.

When it is determined in step S12 that the cooperative shooting mode is selected (step S12, YES), the main control unit 20 executes the cooperative shooting process (step S16), and proceeds to step S19. In the collaborative imaging process, the imaging device 2 executes an imaging operation in response to an operation to acquire image data as main data, and at the same time, biometric information as sub-data from the wearable device 3 which is a device to be linked (cooperative device). Is acquired, and the acquired main data and sub data are recorded as one image file.

When it is determined in step S13 that the reproduction mode is selected (step S13, YES), the main control unit 20 executes the reproduction process (step S17), and proceeds to step S19. The reproduction process is a process in which the image pickup apparatus 2 reproduces the file recorded on the recording medium M in response to the operation and displays it on the display unit 19.

When it is determined in step S14 that the search mode is selected (step S14, YES), the main control unit 20 executes the search process (step S18), and proceeds to step S19. The search process is a process in which the image pickup apparatus 2 searches the recording medium M for an image file corresponding to the search tag.

The image pickup apparatus 2 generates a search tag when recording the image file, and adds the generated search tag to the image file. When the image file generated in this way is recorded on the recording medium M, the image pickup apparatus 2 acquires a search tag and searches for an image file to which a search tag matching the acquired search tag is added. .. The image pickup device 2 acquires, for example, a search tag from the sound acquired by the sound collecting unit 15. Further, the image pickup device 2 may be configured to acquire a search tag from the wearable device 3, for example.

Further, for example, when a plurality of search tags are acquired, the image pickup apparatus 2 may have a configuration in which a search tag to be used for the search process is determined from the plurality of search tags according to the operation of the operation unit 16. Further, the image pickup apparatus 2 may have a configuration in which a search tag to be used for the search process is determined according to the operation of the operation unit 16 from a plurality of preset search tags. By generating tags based on biological information in this way and using them for search, it is possible to use them for classification of image files.

When it is determined in step S14 that the search mode is not selected (step S14, NO), the main control unit 20 determines whether or not to end the operation (step S19). If the main control unit 20 does not end the operation (step S19, NO), the main control unit 20 returns to step S11. Further, when the main control unit 20 ends the operation (YES in step S19), the main control unit 20 ends the process of FIG.

FIG. 5 is a flowchart for explaining the cooperative shooting process shown in step S16 of FIG.

The main control unit 20 acquires image data by the imaging unit and executes a live view in which the acquired image data is displayed on the display unit 19 (step S21).

The main control unit 20 determines whether or not it has been connected to the linked device (step S22). The linked device is a device capable of acquiring sub-data and communicating with the image pickup device 2, and is a wearable device 3 in the present embodiment. That is, the main control unit 20 determines whether or not there is a wearable device 3 in a communicable state. When it is determined that the device to be linked is already connected (step S22, YES), the main control unit 20 shifts to the process of step S28.

When the main control unit 20 determines that it is not already connected to the linked device (step S22, NO), it determines whether or not there is a linked device (step S23). For example, the main control unit 20 transmits a predetermined signal within a communicable range, and determines whether or not there is a cooperative device according to the response. When it is determined that there is no cooperating device (step S23, NO), the main control unit 20 shifts to the process of step S21.

When it is determined that there is a linked device (YES in step S23), the main control unit 20 transmits a connection request to the linked device. For example, when the main control unit 20 detects the wearable device 3 as a cooperative device in a state where the connection with the wearable device 3 is not established, the main control unit 20 transmits a connection request to the wearable device 3. When the wearable device 3 receives the connection request from the image pickup device 2, it determines whether or not to approve the connection of the image pickup device 2, and if it approves, makes various communication agreements with the image pickup device 2. To establish the connection with the image pickup device 2. In the following, the linked device will be described as a wearable device 3.

The main control unit 20 determines whether or not a connection has been established with the wearable device 3 (step S25). When it is determined that the connection with the wearable device 3 has not been established (step S25, NO), the main control unit 20 shifts to the process of step S21.

When the main control unit 20 determines that a connection has been established with the wearable device 3 (step S25, YES), the main control unit 20 lists the biological information that can be acquired by the wearable device 3 from the wearable device 3. Acquire (step S26). For example, the main control unit 20 acquires a list of biological information that can be acquired by the wearable device 3 transmitted to the image pickup device 2 when the wearable device 3 establishes a connection. Further, the main control unit 20 may be configured to transmit a request to the wearable device 3 and receive a response to the request to acquire a list of biological information that can be acquired by the wearable device 3. The main control unit 20 may be configured to recognize the type of the wearable device 3 and search for and acquire a list of biological information that can be acquired by the wearable device 3 from the network according to the type of the wearable device 3.

The main control unit 20 selects the biological information to be recorded (step S27). For example, the main control unit 20 selects the biological information to be recorded according to the operation from the biological information that can be acquired by the wearable device 3. Specifically, the main control unit 20 displays a plurality of buttons 61 for allowing the user to select the biometric information to be acquired as shown in FIG. 6 based on the list of biometric information that can be acquired by the wearable device 3. Display at 19. The main control unit 20 selects biological information according to the operation of the button 61 by the touch sensor 16t. Further, for example, the main control unit 20 may be configured to select all the biological information that can be acquired by the wearable device 3. Further, for example, the main control unit 20 may be configured to select preset biological information from the biological information that can be acquired by the wearable device 3.

Next, the main control unit 20 determines whether or not there is an instruction for shooting operation (step S28). As described above, the main control unit 20 determines that an instruction to execute the shooting operation has been input when the release button of the operation unit 16 is fully pressed. When the main control unit 20 determines that there is no instruction for the shooting operation (step S28, NO), the main control unit 20 shifts to the process of step S21.

When the main control unit 20 determines that there is an instruction for the shooting operation (step S28, YES), the main control unit 20 acquires the image data as the main data by executing the imaging operation (step S29).

When the main control unit 20 executes the photographing operation, the main control unit 20 transmits a biometric information acquisition request to the wearable device 3 (step S30). The biological information acquisition request is information that requires the wearable device 3 to transmit the biological information to the imaging device 2. The biometric information acquisition request includes information indicating the biometric information for which transmission is requested. The main control unit 20 adds information indicating the biometric information selected in step S27 to the biometric information acquisition request. As a result, the main control unit 20 requests the wearable device 3 to transmit the biometric information selected in step S27. When the wearable device 3 receives the request for acquiring the biological information, the wearable device 3 transmits the biological information to the imaging device 2.

After transmitting the acquisition request of the biological information to the wearable device 3, the main control unit 20 acquires the biological information as the sub data transmitted from the wearable device 3 (step S31). Further, the main control unit 20 may be configured to further acquire shooting information including imaging settings at the time of shooting as sub-data. Further, the main control unit 20 may be configured to further acquire thumbnails generated from the image data as sub data. Further, the main control unit 20 may be configured to further acquire the position information generated by GPS at the time of imaging as sub data.

The main control unit 20 generates an image file by creating a file of the main data and the sub data as one file (step S32).

The main control unit 20 records the filed image file on the recording medium M mounted on the memory I / F 18 (step S33), and ends the cooperative shooting process.

FIG. 7 is a flowchart for explaining the operation of the wearable device 3 as a cooperative device that operates in cooperation with the image pickup device 2.

The control unit 40 of the wearable device 3 acquires the biological information of the wearer of the wearable device 3 by controlling the information acquisition unit 32 (step S41). When there are a plurality of biometric information that can be acquired, the control unit 40 may be configured to acquire preset biometric information among the plurality of biometric information.

The control unit 40 determines whether or not it has been connected to the image pickup device 2 (step S42). When it is determined that the image pickup device 2 is already connected (YES in step S42), the control unit 40 shifts to the process of step S46.

When it is determined that the connection with the image pickup apparatus 2 has not been completed (step S42, NO), the control unit 40 determines whether or not there is a connection request from the image pickup apparatus 2 (step S43). When the control unit 40 determines that there is no connection request from the image pickup apparatus 2 (step S43, NO), the control unit 40 shifts to the process of step S41.

When the control unit 40 determines that there is a connection request from the image pickup device 2 (step S43, YES), the control unit 40 establishes a connection with the image pickup device 2 (step S44). The control unit 40 establishes a connection with the image pickup device 2 by making various communication arrangements with the image pickup device 2. The control unit 40 may be configured to perform an authentication process as to whether or not to establish a connection with the image pickup device 2. For example, the control unit 40 approves the connection of the image pickup device 2 when the image pickup device 2 that has transmitted the connection request is a device set as a cooperation target in advance. Further, the control unit 40 is configured to determine whether or not to approve the connection of the image pickup device 2 that has transmitted the connection request by transmitting and receiving a preset authentication code such as a PIN to and from the image pickup device 2. May be good.

When the connection with the imaging device 2 is established, the control unit 40 transmits a list of biometric information that it can acquire to the imaging device 2 (step S45). The control unit 40 may be configured to transmit the list of biological information acquired in step S41 to the imaging device 2.

The control unit 40 determines whether or not there is a biometric information acquisition request (step S46). That is, the control unit 40 determines whether or not the biometric information acquisition request transmitted from the image pickup apparatus 2 has been received. When the control unit 40 determines that there is no biometric information acquisition request (step S46, NO), the control unit 40 proceeds to the process of step S41.

When the control unit 40 determines that there is a biometric information acquisition request (YES in step S46), the control unit 40 transmits the biometric information requested by the biometric information acquisition request to the imaging device 2 (step S47). The control unit 40 may be configured to transmit the biological information already acquired by the information acquisition unit 32 and stored in the storage unit 38 to the imaging device 2, or newly acquire the biological information by the information acquisition unit 32. It may be configured to transmit the information to the image pickup apparatus 2. Further, the control unit 40 may be configured to aggregate the biological information acquired by the information acquisition unit 32 during a certain period and transmit the aggregated result to the imaging device 2 as the biological information.

When the control unit 40 transmits the biometric information, the control unit 40 determines whether or not to end the operation (step S48). If the control unit 40 does not end the operation (step S48, NO), the control unit 40 returns to step S41. Further, when the operation is terminated (step S48, YES), the control unit 40 terminates the process of FIG. 7.

As described above, the imaging device 2 establishes a connection with the wearable device 3 as a cooperative device, and acquires a list of sub-data (biological information) that can be acquired by the wearable device 3. The imaging device 2 selects sub-data to be recorded as a file, and transmits an acquisition request (biological information acquisition request) indicating the selected sub-data. When the wearable device 3 receives the acquisition request from the image pickup device 2, the wearable device 3 transmits the sub-data specified in the acquisition request to the image pickup device 2. The imaging device 2 acquires the main data (image data) in response to the recording instruction (shooting instruction), acquires the sub data (biological information) transmitted from the wearable device 3, and combines the main data and the sub data into one. Record as a file for recording. As a result, the image pickup device 2 can record the main data acquired in response to the recording instruction and the sub data acquired from the wearable device 3 as the cooperation device as one file.

FIG. 8 is an explanatory diagram for explaining an example of the image file 71. The image file 71 has a main data 72 and a sub data 73. The main data 72 includes, for example, image data 74. The sub-data 73 includes, for example, imaging information 75, biological information 76, thumbnail 77, and position information 78.

Further, the wearable device 3 may be configured to transmit information (device information) that can identify itself when transmitting biological information to the image pickup device 2. The device information is, for example, information that can identify the type of the wearable device 3. Further, the device information may be, for example, information assigned to each individual wearable device 3. For example, the MAC address or the like is used as the device information. The main control unit 20 of the image pickup device 2 may be configured to generate an image file 71 as sub-data 73 by associating the device information acquired from the wearable device 3 together with the biometric information with the biometric information 76. That is, when the main control unit 20 files and records the main data and the sub data as one recording file, the main control unit 20 adds the device information to the recording file as information indicating the source of the sub data. This makes it possible to identify the source of the secondary data from the recording file. That is, the imaging device 2 identifies the wearable device 3 to which the biological information 76 has been supplied from the image file 71 including the image data 74 as the main data 72 and the biological information 76 as the sub data 73 as in the present embodiment. can do.

Further, as described above, the biological information may be the result of information processing on the biological information acquired during a certain period. For example, the biological information may be any value such as an average value, an intermediate value, or a total value of the biological information acquired during a certain period. Further, the wearable device 3 may be configured to transmit the comparison result between the acquired biological information and the preset reference value to the imaging device 2 as the biological information. Furthermore, the wearable device 3 may be configured to calculate the above-mentioned reference value using the biological information acquired from the wearer. As a result, the image pickup apparatus 2 can acquire biological information indicating the difference between the wearer's state and the reference state.

Further, in the above embodiment, the user's posture, sleep, standing behavior, etc., which are relatively easy to obtain by taking advantage of the wearable terminal, such as being attached to the body or clothes and being able to be used unconsciously for a long time, there. Daily event information such as daily life information, meals, commuting, work, rest, heart rate, blood pressure, pulse wave, blood flow, body temperature, steps, brain waves, line-of-sight position, blinking, and biological information such as blood sugar level. The configuration to be treated as secondary data has been described, but the configuration is not limited to this configuration. Any information may be filed as secondary data. In particular, if it can be used for a long time unconsciously, there is a merit that the time change can be determined. From the time change, the average value can be obtained, and the standard according to the situation can be judged, and there is an advantage that the change from there and the abnormal value can be judged without difficulty. It is possible to judge data such as being more excited than usual, and there are many cases where comparison data with the set reference value is important, but sometimes there is a big merit that it is easier to handle than the device used by hand. .. This reference value may be a simple time average of the values obtained by wearing it for a while, but since it is biometric data, it is more accurate to reflect the rhythm of life, and it looks like the reference value in this state. Based on the result of classifying the time zone such as, it may be reflected as "compared to the average blood pressure after breakfast in winter". Of course, a general average value obtained from age, gender, etc. may be used as a reference. That fact (reference value and its basis) may be recorded, and the obtained data may be recorded, or the result of comprehensive judgment may be recorded. Such complicated processing may be partially assisted by another device, and the calculation location may be any device. On the other hand, a device that is held in the hand is suitable for acquiring the setting data of the device itself, the process leading up to the setting, and the environmental data around the device. In addition, although it cannot be hands-free, it is easy to operate by hand, so there is an important merit that more specific and quick operation can be performed.

Further, for example, the wearable device 3 may be configured to acquire environmental information such as atmospheric pressure, air temperature, humidity, water pressure, and position information acquired by GPS, and transmit it to the image pickup device 2 as secondary data. The environmental information is information indicating the surrounding environment of the user who wears the wearable device 3, but since it is wearable, it can be worn unconsciously in a hands-free state, so that it can be measured for a long time, its change, and so on. It is possible to acquire data that is close to the experience. The imaging device 2 acquires such environmental information from the wearable device 3 and files the acquired environmental information together with the image data as the main data as sub-data to obtain the surrounding environment when the image data is acquired. It can be kept as a record. For example, the climate can be inferred from humidity and temperature. In addition, the altitude of the shooting point can be estimated from the atmospheric pressure. In addition, the water depth at the shooting point can be estimated from the water pressure. In addition, the coordinates of the shooting point on the map can be estimated from the position information. The image pickup device 2 may have a configuration in which when the image file is reproduced, the environment at the time of shooting is estimated based on the sub data and displayed together with the image data. Furthermore, the imaging device 2 may be configured to generate a search tag based on the above-mentioned biological information or environmental information.

FIG. 9 is an explanatory diagram for explaining an example of utilizing the sub data included in the image file. Here, it is assumed that the atmospheric pressure and the heart rate in a certain period are recorded as secondary data. As shown in FIG. 9, for example, the image pickup apparatus 2 can display the graph 91 showing the altitude estimated from the atmospheric pressure based on the sub-data 73 and the graph 92 showing the heart rate on the display unit 19. Further, the image pickup apparatus 2 can display the heart rate or altitude value and the thumbnail of the image file in association with each other on the display unit 19. According to the example of FIG. 9, thumbnail 77a and thumbnail 77b are displayed in association with the heart rate, respectively. In this way, when the image file is reproduced, the image pickup device 2 displays information indicating the wearing state of the wearable device 3 at the time of shooting, the surrounding environment, and the like together with the image by using the secondary data, so that the image pickup device 2 varies depending on the user. Information can be provided. In the example of FIG. 9, an example of displaying the graph 91 showing the altitude and the graph 92 showing the heart rate with respect to the time axis has been described, but the configuration is not limited to this. The image pickup apparatus 2 may display information in any format as long as it displays information based on sub-data together with the image.

Further, in the above-described embodiment, the imaging device 2 has been described as having a configuration in which the sub data acquired by the wearable device 3 is acquired and recorded as a file together with the main data, but the present invention is not limited to this configuration. The image pickup device 2 may be configured to record the image data in a state in which the image data can be associated with the information generated by the wearable device 3. For example, the wearable device 3 may be configured to detect a posture of the wearer such as standing / walking, sitting, or lying down. Further, the wearable device 3 may be configured to generate a graph 93 showing a change in the posture of the wearer during a certain period as shown in FIG. 10 by plotting the detected posture with respect to time. Furthermore, the wearable device 3 may be configured to upload the generated graph to a server device (not shown).

When the image data is acquired, the image pickup device 2 acquires information for associating the acquired image data with the graph generated by the wearable device 3 as sub data from the wearable device 3, and files the image data together with the image data as the main data. Convert and record. Further, the image pickup device 2 uploads the image file to the server device. In this case, based on the sub-data of the image file uploaded from the imaging device 2, the server device is configured to perform a process of associating the image file with the graph uploaded from the wearable device 3 and recording the graph together with the graph. May be good. The process of associating the image file with the graph may be configured so that the image pickup device 2 transmits the image file to the wearable device 3 to cause the wearable device 3 to perform the process.

Furthermore, the imaging device 2 may be configured to cause the server device to generate a record based on the secondary data by uploading an image file in which biological information or environmental information is recorded as secondary data to the server device. For example, the imaging device 2 acquires the detection result of the wearer's posture of the wearable device 3 as the sub data at the time of recording the image data from the wearable device 3, records the image file, and records the recorded image file as the server. By uploading to the device, it is possible to cause the server device to generate an action record in which the posture of the wearer of the wearable device 3 and the image data are associated with each other. As a result, as shown in FIG. 10, an action record in which the image file 71a and the image file 71b are associated with each other can be left in the graph 93 showing the posture of the wearable device 3.

Furthermore, by comparing the action records of the wearable device 3 wearers on different dates, the server device or the wearable device 3 detects that the wearable device 3 wearer has taken an unusual action. May be good. As a result, the server device or the wearable device 3 can detect an event different from the usual one. As a result, the image pickup apparatus 2 can record the image data in association with the event detected in this way.

Further, the wearable device 3 may be configured to transmit an event detection notification to the image pickup device 2 when an unusual behavior by the wearable device 3 wearer is detected. The image pickup device 2 may be configured to urge the user to take a picture when an event detection notification is received from the wearable device 3. For example, the image pickup apparatus 2 may be configured to urge the user to take a picture by displaying predetermined information on the display unit 19. Further, for example, the image pickup device 2 may be configured to urge the user to take a picture by outputting a predetermined sound from a speaker (not shown) or the like.

Further, the image pickup device 2 has a wearable device 3 attached to the subject, and the subject is imaged by the image pickup device 2, so that the image data of the subject and the biological information acquired from the subject by the wearable device 3 are combined into one. It can be converted into a file as an image file. As a result, the image pickup device 2 can acquire an image file that can be used, for example, for analyzing the training load of an athlete.

Further, the image pickup device 2 files a medical record by converting biological information acquired by a medical device or the like as a cooperative device and image data obtained by capturing an image of, for example, a patient (or the affected part of the patient) into one image file. It is possible to obtain an image file that is useful to add to and record.

Although the wearable device 3 has been described as having a configuration in which biological information is transmitted to the imaging device 2 when a biological information acquisition request is received from the imaging device 2, the wearable device 3 is not limited to this configuration. The wearable device 3 may be configured to periodically transmit biological information to the image pickup device 2 when a connection with the image pickup device 2 is established. According to such a configuration, after the connection with the wearable device 3 is established, the imaging device 2 selects the biological information to be acquired according to the operation, and transmits the information indicating the selected biological information to the wearable device 3. As a result, biometric information is periodically acquired from the wearable device 3 before the imaging operation is executed. When the image pickup device 2 is configured to periodically acquire biometric information from the wearable device 3, the result of information processing on the biometric information acquired during a certain period is filed together with the image data as sub-data. It may be a configuration. Further, for example, the imaging device 2 may be configured to treat any kind of biological information such as an average value, an intermediate value, or a total value of biological information acquired during a certain period as biological information. Further, the imaging device 2 may be configured to file a file together with the image data as sub-data of the comparison result between the acquired biological information and the preset reference value. The image pickup device 2 may have a configuration in which the above reference value is calculated using the biological information acquired from the wearable device 3.

Furthermore, the image pickup device 2 may be configured to perform shooting control according to the sub data acquired from the wearable device 3. For example, the image pickup device 2 may be configured to predict the weather by acquiring environmental information from the wearable device 3 and control the WB according to the predicted weather. Further, the image pickup device 2 predicts the state of the wearer of the wearable device 3 by acquiring biological information from the wearable device 3, and controls the WB or the like according to the predicted state, so that the wearer of the wearable device 3 wears the wearable device 3. The state of can be reflected in the image.

In the above-described embodiment, the imaging device 2 has been described as having a configuration in which biological information is acquired from the wearable device 3, but the present invention is not limited to this configuration. The image pickup device 2 may also be configured to acquire the biological information of the operator. The imaging device 2 configured in this way associates its own device information with the biometric information acquired by itself, and associates the biometric information from the wearable device 3 with the device information acquired from the wearable device 3 to create a file. , The source of each biometric information can be clarified.

(Second Embodiment)
Hereinafter, the recording device, the control method of the recording device, the recording system, and the wearable information processing device according to the second embodiment will be described in detail with reference to FIGS. 11 to 19.

FIG. 11 is an explanatory diagram showing an example of an imaging system 1A as a recording system. The image pickup system 1A includes an image pickup device 2A as a recording device, wearable devices 3A and 4A as wearable information processing devices, and the like.

The image pickup device 2A is a camera that acquires image data by capturing a subject image. The image pickup device 2A is different from the image pickup device 2 in that the image pickup operation in the wearable device 3A or 4A can be controlled.

The wearable devices 3A and 4A are information processing devices that can acquire biological information of the wearer by being worn on the wearer's body. The wearable devices 3A and 4A include a communication unit that communicates with the image pickup device 2, an information acquisition unit that acquires biological information of the wearable device 3A wearer, an image pickup unit (camera) that acquires an image, and a display that displays an image. It has at least a part. The wearable devices 3A and 4A are devices configured, for example, a wristband type, a wristwatch type, a spectacle type, an earphone type, or a shape that can be worn on another human body. In the present embodiment, the wearable device 3A will be described as a watch type, and the wearable device 4 will be described as a spectacle type display device (FMD: Face Mount Display).

FIG. 12 is a block diagram showing an example of the configuration of the image pickup apparatus 2A.
As shown in FIG. 12, the image pickup device 2A includes a lens 11, an image sensor 12, a signal processing unit 13, an image processing unit 14, a sound collecting unit 15, an operation unit 16, a communication unit 17, a memory I / F18, and a main control. A unit 20A is provided.

The main control unit 20A controls the operation of each unit of the image pickup apparatus 2A. The main control unit 20A is different from the main control unit 20 in that the main control unit 20A includes an image pickup control cooperation unit 28A that controls the image pickup operation in the wearable device to be linked.

The image pickup control cooperation unit 28A performs a process of reflecting the change of the image pickup setting in the image pickup device 2 on the wearable device 3A or 4A as the image pickup control cooperation. For example, the imaging control cooperation unit 28A detects that the imaging setting has been changed by the imaging control unit 22, generates a control signal (cooperation control signal) according to the changed imaging setting, and generates the generated cooperation control signal. Send to the wearable device to be linked. Here, "according to the setting" does not necessarily match the setting exactly, and there are systems with specifications that emphasize the surrounding environment record rather than the object to be photographed, so a spoon that reflects it in the control a little. It may be controlled by adjustment. It is also important that not only the result of the image is reflected in the image, but also the 3D information of the image can be easily obtained and specified, and the intuitive operation can be reflected in other information acquisition. In addition, there is an advantage that the delicate operation unique to manually operated devices can reflect that commitment to devices that are difficult to operate by hand (wearables, remote devices, etc.). That is, an imaging unit that captures an image of a subject according to manual settings and acquires image data, a communication unit that communicates with a collaborative device having an information acquisition unit, and an imaging control unit that changes the imaging settings, including a GUI. There is also an image pickup device provided with a control cooperation unit that controls the information acquisition characteristics of the information acquisition unit in the cooperation device according to the change in the image pickup setting. This is because information acquisition can change the sound collection characteristics of voice by designating an image and specify the range of temperature measurement. Further, the information acquisition unit may acquire biological information, and in this case, the measurement characteristics such as sensitivity and timing may be changed according to the control of the manually operated device. That is, depending on the operation of the manually operated device, a finer judgment may be required depending on the information associated with the image obtained by the device, or conversely, a coarse timing may be sufficient. For example, when the image is acquired intermittently by manual operation, the biometric information may be acquired at that timing.

Further, the image pickup control cooperation unit 28A performs a process of displaying an image of a part of the image data (enlarged area) as a through image acquired by the image pickup unit on the wearable device 3A or 4A as the image pickup control cooperation. For example, the image pickup control cooperation unit 28A sets an enlarged area in the image data as a through image acquired by the image pickup unit, cuts out an image of the set enlarged area, and transfers the cut out image (enlarged image) to the wearable device 3A or 4A. Send.

FIG. 13 shows an example of the configuration of the wearable devices 3A and 4A. In order to simplify the description, the wearable devices 3A and 4A will be described as having the same configuration. The wearable devices 3A and 4A include a camera 31A, an information acquisition unit 32, a sound collection unit 35, an operation unit 36, a communication unit 37, a storage unit 38, a display unit 39, and a control unit 40A. That is, the wearable devices 3A and 4A differ from the wearable device 3 in the configurations of the camera 31A and the control unit 40A.

The camera 31A is a camera provided in the wearable devices 3A and 4A. The camera 31A includes an image pickup element that converts light into an electric signal, and a lens that forms an image of light from a subject on the image pickup element as a subject image. The camera 31A converts the light received by the optical system into an electric signal by the image sensor based on the control of the control unit 40A, and acquires the image data.

The control unit 40A controls the operation of each unit of the wearable devices 3A and 4A. The control unit 40A changes the imaging setting according to the signal (cooperation control signal) transmitted from the image pickup device 2A to be linked, and the image (enlarged image) transmitted from the image pickup device 2A to be linked. The point of displaying is different from that of the control unit 40. The control unit 40A functions as an operation determination unit 41, an information processing unit 42, a display control unit 43A, a recording control unit 44, and an image pickup control unit 45A.

The display control unit 43A controls the display process by the display unit 39. For example, the display control unit 43 causes the display panel of the display unit 39 to display the screen by inputting image data into the display unit 39. The display control unit 43 generates OSD data for displaying the on-screen display (OSD) including the display of various icons and characters on the display unit 39 based on various setting information and the state of the wearable device 3. .. The display control unit 23 inputs the image data on which the OSD based on the OSD data is superimposed to the display unit 39. Further, the display control unit 43A displays the image (enlarged image) transmitted from the image pickup apparatus 2A on the display unit 39. That is, the display control unit 43A causes the display unit 39 to display an image of a part of the image data acquired by the image pickup apparatus 2A.

The image pickup control unit 45A controls various processes related to image pickup. For example, the image pickup control unit 45A controls the camera 31A so as to execute the image pickup operation based on the operation signal. Further, the image pickup control unit 45A changes various image pickup settings based on the operation signal in the same manner as the image pickup control unit 22 of the image pickup apparatus 2. For example, the image pickup control unit 45A includes settings such as an exposure value (Ev value) and a white balance (WB) based on an operation signal. Further, the imaging settings change the imaging settings such as aperture value (F value), shutter speed (SS), ISO sensitivity, AF mode, recording image quality, aspect ratio, high dynamic range (HDR), and photometric mode.

Furthermore, the image pickup control unit 45A acquires the cooperation control signal transmitted from the image pickup apparatus 2A, and changes the above-mentioned imaging setting based on the cooperation control signal. That is, the image pickup control unit 45A changes its own image pickup setting to the same setting as the image pickup setting in the image pickup apparatus 2A. If the setting items do not match between the imaging settings in the imaging unit of the imaging device 2A and the imaging settings for controlling the camera 31A, the imaging control unit 45A adjusts only the matching items to the imaging settings of the imaging device 2A. The configuration may be changed. Further, when the setting items do not match between the imaging setting in the imaging unit of the imaging device 2A and the imaging setting for controlling the camera 31A, the imaging control unit 45A performs an operation on the received cooperation control signal and owns itself. The configuration may be changed to the setting corresponding to the setting item of the imaging setting.

14 and 15 are flowcharts for explaining the operation of the image pickup apparatus 2A. Since the processing related to the mode selection of the image pickup apparatus 2A is the same as the example shown in FIG. 4, the description thereof will be omitted.

FIG. 14 is a flowchart for explaining another example of the cooperative shooting process shown in step S16 of FIG.

The main control unit 20A acquires image data by the imaging unit and executes a live view in which the acquired image data is displayed on the display unit 19 (step S51).

The main control unit 20A determines whether or not it has been connected to the linked device (step S52). The linked device is a device capable of acquiring sub-data and communicating with the image pickup device 2A, and is a wearable device 3A or a wearable device 4A in the present embodiment. That is, the main control unit 20A determines whether or not there is a wearable device 3A or a wearable device 4A in a communicable state. When it is determined that the device to be linked is connected (step S52, YES), the main control unit 20A shifts to the process of step S58.

When the main control unit 20A determines that it is not already connected to the linked device (step S52, NO), it determines whether or not there is a linked device (step S53). For example, the main control unit 20A transmits a predetermined signal within a communicable range, and determines whether or not there is a cooperative device according to the response. When it is determined that there is no cooperating device (step S53, NO), the main control unit 20A shifts to the process of step S51.

When it is determined that there is a cooperating device (step S53, YES), the main control unit 20A transmits a connection request to the cooperating device. For example, when the main control unit 20A detects the wearable device 4A as a cooperative device in a state where the connection with the wearable device 4A is not established, the main control unit 20A transmits a connection request to the wearable device 4A. When the wearable device 4A receives the connection request from the image pickup device 2A, the wearable device 4A determines whether or not to approve the connection of the image pickup device 2A, and if it approves, makes various communication agreements with the image pickup device 2A. Establishes a connection with the image pickup device 2A. The main control unit 20A may be configured to select a linked device according to the operation. For example, as shown in FIG. 16, the main control unit 20A causes the display unit 19 to display a plurality of buttons 62 for allowing the user to select a linked device. The main control unit 20A selects a linked device according to the operation of the button 62 by the touch sensor 16t. Further, for example, the main control unit 20A may be configured to select all the devices that can be linked as the linked devices. Further, for example, the main control unit 20A may have a configuration in which the main control unit 20A selects a preset device as a link device from all the devices that can be linked. In the following description, the linked device will be described as a wearable device 4A.

The main control unit 20A determines whether or not a connection has been established with the wearable device 4A (step S55). When it is determined that the connection with the wearable device 4A has not been established (step S55, NO), the main control unit 20A shifts to the process of step S51.

When the main control unit 20A determines that the connection with the wearable device 4A has been established (step S55, YES), the main control unit 20A lists the biological information that can be acquired by the wearable device 4A from the wearable device 4A. Acquire (step S56). For example, the main control unit 20A acquires a list of biological information that can be acquired by the wearable device 4A transmitted to the image pickup device 2A when the wearable device 4A establishes a connection. Further, the main control unit 20A may be configured to acquire a list of biological information that can be acquired by the wearable device 4A by transmitting a request to the wearable device 4A and receiving a response to the request.

The main control unit 20A selects the biological information to be recorded (step S57). For example, the main control unit 20A selects the biological information to be recorded according to the operation from the biological information that can be acquired by the wearable device 4A. Specifically, the main control unit 20A displays a plurality of buttons 61 for allowing the user to select the biometric information to be acquired as shown in FIG. 16 based on the list of biometric information that can be acquired by the wearable device 4A. Display at 19. The main control unit 20A selects biometric information according to the user's operation by recognizing whether or not the button 61 is selected according to the operation of the touch sensor 16t. Further, for example, the main control unit 20A may be configured to select all the biological information that can be acquired by the wearable device 4A. Further, for example, the main control unit 20A may be configured to select preset biological information from the biological information that can be acquired by the wearable device 4A.

Next, the main control unit 20A determines whether or not to execute the shooting control cooperation (step S58). For example, the main control unit 20A has a setting of whether or not to execute the shooting control cooperation, and determines whether or not to execute the shooting control cooperation based on this setting. In addition, the main control unit 20A determines whether or not the linked device with which the connection has been established supports shooting control cooperation, and when the linked device with which the connection has been established supports shooting control cooperation, the shooting control cooperation is performed. It may be determined to execute.

When the main control unit 20A determines that the shooting control cooperation is to be executed (step S58, YES), the main control unit 20A executes the shooting control cooperation described later (step S59). Further, when the main control unit 20A determines that the shooting control cooperation is not executed (step S58, NO), the process proceeds to the process of step S60.

The main control unit 20A determines whether or not there is an instruction for shooting operation (step S60). As described above, the main control unit 20A determines that the instruction to execute the shooting operation is input when the release button of the operation unit 16 is fully pressed. When the main control unit 20A determines that there is no instruction for the shooting operation (step S60, NO), the main control unit 20A shifts to the process of step S51.

When the main control unit 20A determines that there is an instruction for the shooting operation (step S60, YES), the main control unit 20A acquires the image data as the main data by executing the imaging operation (step S61).

When the main control unit 20A executes the photographing operation, the main control unit 20A transmits a biometric information acquisition request to the wearable device 4A (step S62). When the wearable device 4A receives the request for acquiring the biological information, the wearable device 4A transmits the biological information to the imaging device 2A.

After transmitting the acquisition request for biometric information to the wearable device 4A, the main control unit 20A acquires the biometric information as sub-data transmitted from the wearable device 4A (step S63). Further, the main control unit 20A may be configured to further acquire shooting information including imaging settings at the time of shooting as sub-data. Further, the main control unit 20A may be configured to further acquire thumbnails generated from the image data as sub data. Further, the main control unit 20A may be configured to further acquire the position information generated by GPS at the time of imaging as sub data.

The main control unit 20A generates an image file by creating a file of the main data and the sub data as one file (step S64).

The main control unit 20A records the filed image file on the recording medium M mounted on the memory I / F 18 (step S65), and ends the cooperative shooting process.

FIG. 15 is a flowchart for explaining the imaging control cooperation in step S59 of FIG.

The main control unit 20A determines whether or not there is an operation input for changing the imaging setting (step S71). When there is no operation input for changing the imaging setting (step S71, NO), the main control unit 20A shifts to the process of step S75.

When there is an operation input for changing the imaging setting (step S71, YES), the main control unit 20A changes the imaging setting based on the operation signal (step S72).

The main control unit 20A generates a cooperation control signal for controlling the cooperation device based on the imaging setting changed in step S72 (step S73). The main control unit 20A generates a cooperative control signal for reflecting the same change as the change in the imaging setting in step S72 on the wearable device 4A. The main control unit 20A may be configured to appropriately select setting items to be reflected according to the specifications of the wearable device 4A. Further, the main control unit 20A may be configured to select a setting item for reflecting the change in the wearable device 4A according to the operation. For example, as shown in FIG. 16, a plurality of buttons 63 for allowing the user to select a setting item for performing imaging control cooperation as shown in FIG. 16 are displayed on the display unit 19. The main control unit 20A selects a setting item for imaging control cooperation according to the operation of the button 63 by the touch sensor 16t.

The main control unit 20A transmits the generated cooperation control signal to the wearable device 4A (step S74).

Next, the main control unit 20A determines whether or not to output an enlarged image (step S75). For example, the main control unit 20A has a setting of whether or not to output an enlarged image, and determines whether or not to output an enlarged image based on this setting. Further, the main control unit 20A may determine whether or not the linked device with which the connection has been established has a display unit, and may determine that the linked device outputs an enlarged image when the linked device has a display unit. When the main control unit 20A determines that the enlarged image is not output (step S75, NO), the main control unit 20A ends the imaging control cooperation.

When the main control unit 20A determines that the enlarged image is output (step S75, YES), the main control unit 20A sets an enlarged area in the image data acquired in step S51, cuts out the image in the enlarged area, acquires the enlarged image, and obtains the enlarged image. Is transmitted to the wearable device 4A (step S76), and the image control cooperation is terminated.

FIG. 17 is a flowchart for explaining the operation of the cooperative device that operates in cooperation with the image pickup device 2A. Here, the operation of the wearable device 4A as a cooperative device that operates in cooperation with the image pickup device 2A will be described.

The control unit 40A of the wearable device 4A acquires the biological information of the wearer of the wearable device 4A by controlling the information acquisition unit 32 (step S81). When there are a plurality of biometric information that can be acquired, the control unit 40A may be configured to acquire preset biometric information among the plurality of biometric information.

The control unit 40A determines whether or not the image pickup device 2A has been connected (step S82). When it is determined that the image pickup device 2A is already connected (YES in step S82), the control unit 40A shifts to the process of step S87.

When it is determined that the image pickup device 2A is not already connected (step S82, NO), the control unit 40A determines whether or not there is a connection request from the image pickup device 2A (step S83). When the control unit 40A determines that there is no connection request from the image pickup apparatus 2A (step S83, NO), the control unit 40A shifts to the process of step S81.

When the control unit 40A determines that there is a connection request from the image pickup device 2A (step S83, YES), the control unit 40A establishes a connection with the image pickup device 2A (step S84).

When the connection with the imaging device 2A is established, the control unit 40A transmits a list of biometric information that can be acquired by the control unit 40A to the imaging device 2A (step S85). The control unit 40A may be configured to transmit the list of biological information acquired in step S81 to the imaging device 2A.

The control unit 40A determines whether or not the cooperation control signal has been received (step S86). When the control unit 40A determines that the cooperation control signal has not been received (step S86, NO), the control unit 40A shifts to the process of step S88.

When the control unit 40A determines that the cooperation control signal has been received (step S86, YES), the control unit 40A changes the imaging setting based on the cooperation control signal (step S87). That is, the control unit 40A changes its own imaging setting to the same setting as the imaging setting in the imaging device 2A.

Next, the control unit 40A determines whether or not the enlarged image has been received (step S88). When the control unit 40A determines that the enlarged image has not been received (step S88, NO), the control unit 40A shifts to the process of step S90.

When the control unit 40A determines that the enlarged image has been received (step S88, YES), the control unit 40A displays the enlarged image on the display unit 39 (step S89). That is, the control unit 40A enlarges and displays a part of the image data displayed as a through image in the image pickup apparatus 2A.

The control unit 40A determines whether or not there is a biometric information acquisition request (step S90). That is, the control unit 40A determines whether or not the biometric information acquisition request transmitted from the image pickup apparatus 2A has been received. When the control unit 40A determines that there is no biometric information acquisition request (step S90, NO), the control unit 40A shifts to the process of step S81.

When the control unit 40A determines that there is a biometric information acquisition request (step S90, YES), the control unit 40A transmits the biometric information requested by the biometric information acquisition request to the imaging device 2A (step S91). The control unit 40A may be configured to transmit the biometric information already acquired by the information acquisition unit 32 and stored in the storage unit 38 to the imaging device 2A, or the biometric information is newly acquired by the information acquisition unit 32. It may be configured to transmit the information to the image pickup apparatus 2A. Further, the control unit 40A may be configured to aggregate the biological information acquired by the information acquisition unit 32 during a certain period and transmit the aggregated result as the biological information to the imaging device 2A.

When the control unit 40A transmits the biological information, it determines whether or not to end the operation (step S92). If the control unit 40A does not end the operation (step S92, NO), the control unit 40A returns to step S81. Further, when the operation is terminated (step S92, YES), the control unit 40A ends the process of FIG.

As described above, when the operation of changing the imaging setting is performed, the imaging device 2A changes the imaging setting and causes the wearable device 4A whose connection has been established to perform the same control as the change of the imaging setting. The cooperation control signal of the above is generated, and the generated cooperation control signal is transmitted to the wearable device 4A. The wearable device 4A changes the image pickup setting for controlling the camera 31A based on the cooperation control signal acquired from the image pickup device 2A. As a result, the image pickup apparatus 2A can cause the wearable apparatus 4A as a cooperative device to perform the same control as itself.

According to such a configuration, for example, as shown in FIG. 18, the image pickup apparatus 2A captures an image in which the image data 82 having the proper exposure can be acquired from the image pickup setting when the image data 81 having the non-proper exposure is acquired. The change in the setting is also reflected in the wearable device 4A. As a result, the wearable device 4A can change the imaging setting from the imaging setting that acquired the image data 83 that is not the proper exposure to the setting that can acquire the image data 84 that is the appropriate exposure. Thereby, the image pickup apparatus 2A can appropriately control the imaging setting of the camera 31A in the wearable apparatus which generally has few operating members or is difficult to operate. As a result, the convenience of the wearable device 3A can be enhanced.

Further, as described above, the imaging device 2A cuts out an enlarged image from the image data as a through image, and transmits the cut out enlarged image to the wearable device 3A or 4A (described here as the wearable device 3A) to which the connection is established. .. The wearable device 3A displays the enlarged image acquired from the image pickup device 2A on the display unit 39. As a result, the image pickup apparatus 2A can display an image of a part of the angle of view on the wearable apparatus 3A as a cooperative device.

According to such a configuration, for example, as shown in FIG. 19, the image pickup apparatus 2A sets an enlarged region 65 on the image data as a through image, cuts out the image of the enlarged region 65, and displays it on the wearable apparatus 3A. .. As a result, the image pickup apparatus 2A can enlarge a part of the through image and display it on the wearable apparatus 3A. Since the wearable device 3A is a watch type as described above, it is expected that the wearable device 3A is located near the image pickup device 2A when the user performs an operation for focusing by the image pickup device 2A. Therefore, for example, the image pickup device 2A can display the magnified image useful for confirming the focusing result on the wearable device 3A by setting the magnifying area 65 in the vicinity of the focusing position (AF area) in the image data. it can.

The main control unit 20A of the image pickup apparatus 2A may be configured to change the position and size of the enlarged region 65 according to the operation of the operation unit 16, for example. For example, the main control unit 20A of the image pickup apparatus 2A may be configured to change the position and size of the enlarged region 65 by, for example, a touch operation by the touch sensor 16t.

In the above embodiment, the image pickup device 2A has been described as generating and transmitting a cooperation control signal for reflecting the change in the image pickup setting to the wearable device 4A when the image pickup setting is changed according to the operation. It is not limited to this configuration. For example, the imaging device 2A may be configured to generate and transmit a cooperation control signal for reflecting the change in the imaging setting on the wearable device 4A when the imaging setting is changed by automatic processing such as AE processing.

Further, the imaging device 2A transmits the subject distance (distance from the principal point of the lens 11 to the subject in focus) determined by the AF process to the wearable device 4A as a linked control signal, thereby performing the AF process of the wearable device 4A. The configuration may reflect the subject distance determined by the image pickup apparatus 2A.

Further, even if the image pickup device 2A is configured to generate a signal for instructing the wearable device 4A to execute the image pickup and transmit the signal to the wearable device 4A when it is determined in step S60 of FIG. 14 to execute the image pickup. Good. In this case, the wearable device 4A executes imaging in response to a signal from the imaging device 2A. As a result, the image pickup apparatus 2A and the wearable apparatus 4A can acquire image data at substantially the same time.

Furthermore, the wearable device 4A may be configured to transmit the acquired image data and device information as sub-data to the image pickup device 2A. According to such a configuration, the image pickup apparatus 2A can acquire biological information, environmental information, and image data captured by the wearable apparatus 4A as sub-data from the wearable apparatus 4A. As a result, the imaging device 2A files the image data as the main data acquired by itself and the biological information, the environmental information, and the image data as the sub data acquired from the wearable device 4A as one image file. Can be recorded.

The wearable device 4A may be configured to execute moving image shooting. The wearable device 4A may be configured to change the imaging setting for moving image shooting according to the cooperation control signal when the cooperation control signal is received from the imaging device 2A during moving image shooting.

Furthermore, the wearable device 4A may be configured to insert chapters into the moving image being captured when a signal instructing execution of imaging is received from the imaging device 2A during the moving image shooting.

The functions described in each of the above-described embodiments are not limited to the configuration using hardware, and can be realized by loading a program describing each function into a computer using software. Further, each function may be configured by appropriately selecting either software or hardware.

Such devices and systems can record specific information at the time of inspection, report, and evidence document creation, along with the actions taken by the user at that time (or by), the measurement environment, etc., so that various industries can be used. It can be used in the field. It goes without saying that what is written as image data can be rewritten as voice data or other sensor data and applied to the fields of information acquisition and recording.

The present invention is not limited to the above embodiment as it is, and at the implementation stage, the components can be modified and embodied within a range that does not deviate from the gist thereof. In addition, various inventions can be formed by an appropriate combination of the plurality of components disclosed in the above-described embodiment. For example, some components may be removed from all the components shown in the embodiments. In addition, components from different embodiments may be combined as appropriate.

1 ... Imaging system, 2 ... Imaging device, 3 ... Wearable device, 4 ... Wearable device, 11 ... Lens, 13 ... Signal processing unit, 14 ... Image processing unit, 15 ... Sound collecting unit, 16 ... Operation unit, 16t ... Touch Sensor, 17 ... Communication unit, 19 ... Display unit, 20 ... Main control unit, 21 ... Operation judgment unit, 22 ... Imaging control unit, 23 ... Display control unit, 24 ... Main data processing unit, 25 ... Sub data processing unit, 26 ... File processing unit, 27 ... Recording control unit, 28A ... Imaging control cooperation unit, 31A ... Camera, 32 ... Information acquisition unit, 35 ... Sound collecting unit, 36 ... Operation unit, 36t ... Touch sensor, 37 ... Communication unit, 38 ... Storage unit, 39 ... Display unit, 40 ... Control unit, 41 ... Operation judgment unit, 42 ... Information processing unit, 43 ... Display control unit, 43A ... Display control unit, 44 ... Recording control unit, 45A ... Imaging control unit ..

Claims (18)

A communication unit that communicates with the linked device and acquires a list of sub-data that can be acquired by the linked device when communication with the linked device is established.
The first acquisition unit that acquires the main data,
A second acquisition unit that acquires sub-data from the linked device, and
Based on the list of the sub-data that can be acquired by the linked device, a button for selecting the sub-data acquired by the second acquisition unit is displayed on the display unit for displaying the main data and selected. A control unit that associates the sub data with the main data at the time of acquiring the main data,
A device equipped with. The second acquisition unit acquires device information for identifying the linked device together with the sub data, and obtains device information.
The device according to claim 1, wherein the control unit adds the device information to the main data. The device according to claim 1, wherein the control unit associates the sub data with a preset reference value and the main data. The device according to claim 1, wherein the control unit associates a calculation result obtained by performing a predetermined calculation on sub-data acquired during a predetermined period with the main data. The device according to claim 3, wherein the control unit calculates the reference value based on sub-data acquired during a predetermined period. The device according to claim 1, wherein the control unit controls switching of characteristics at the time of acquisition of the sub data in the linked device. A communication unit that communicates with the linked device and acquires a list of sub-data that can be acquired by the linked device when communication with the linked device is established.
The first acquisition unit that acquires the main data,
A second acquisition unit that acquires sub-data from the linked device, and
Based on the list of the sub-data that can be acquired by the linked device, a button for selecting the sub-data acquired by the second acquisition unit is displayed on the display unit for displaying the main data and selected. A search tag generated based on the sub-data is added to the main data at the time of acquiring the main data, a search tag is acquired, and the main data to which the search tag matching the acquired search tag is added is searched. Search section and
A device equipped with. The first acquisition unit acquires image data as the main data, and obtains image data.
The second acquisition unit obtains at least one or more of biological information indicating the state of the wearer of the linked device acquired by the linked device and environmental information indicating the environment around the wearer of the linked device. Obtained as the sub-data
The control unit displays a button for selecting at least one or more of the biometric information and the environmental information on the display unit for displaying the image data, and when the image data is acquired, the biometric information and the biometric information are displayed. At least one or more of the environmental information is associated with the image data.
The device according to claim 1. The device according to claim 8, wherein the biological information is a heart rate, a body temperature, a step count, an electroencephalogram, or a blood glucose level. The device according to claim 8, wherein the environmental information is atmospheric pressure, air temperature, humidity, water pressure, or position information. A control method for a device including a communication unit that communicates with a linked device and acquires a list of sub-data that can be acquired by the linked device when communication with the linked device is established.
Get the main data,
Based on the list of sub-data that can be acquired by the linked device, a button for selecting the sub-data to be acquired from the list is displayed on the display unit for displaying the main data.
The selected sub-data is acquired from the linked device at the time of acquisition of the main data,
The acquired sub-data is associated with the main data.
How to control the device. A system having a wearable information processing device and a device that cooperates with the wearable information processing device.
The wearable information processing device is
A first communication unit that communicates with the device,
The first acquisition unit that acquires secondary data,
A supply unit that supplies the sub data to the device,
Equipped with
The device is
A second communication unit that communicates with the wearable information processing device and acquires a list of sub-data that can be acquired by the wearable information processing device when communication with the wearable information processing device is established.
The second acquisition unit that acquires the main data,
A third acquisition unit that acquires the sub-data from the wearable information processing device, and
Based on the list of the sub-data that can be acquired by the wearable information processing apparatus, a button for selecting the sub-data acquired by the second acquisition unit is displayed on the display unit for displaying the main data. A control unit that associates the selected sub-data with the main data at the time of acquiring the main data,
A system equipped with. The first acquisition unit obtains at least one or more of biological information indicating the state of the wearer of the wearable information processing device and environmental information indicating the environment around the wearer of the wearable information processing device. Obtained as the sub-data
The second acquisition unit acquires image data as the main data, and obtains image data.
The system according to claim 12, wherein the control unit associates at least one or more of the biological information and the environmental information with the image data at the time of acquiring the image data. A control method for a device including a communication unit that communicates with a linked device and acquires a list of sub-data that can be acquired by the linked device when communication with the linked device is established.
Get the main data,
Based on the list of sub-data that can be acquired by the linked device, a button for selecting the sub-data to be acquired from the list is displayed on the display unit for displaying the main data.
The selected sub-data is acquired from the linked device at the time of acquisition of the main data ,
A search tag generated based on the acquired sub-data is added to the main data, and the search tag is added to the main data.
A search tag is acquired, and the main data to which the search tag matching the acquired search tag is added is searched.
How to control the device. It acquires image data as the main data,
From the linked devices, and biological information indicating the state of the wearer of the linked device to the linked device has acquired, and environment information indicating an environment surrounding the wearer of the linked device, at least one or more of the sub-data Get as
A button for selecting at least one or more of the biological information and the environmental information is displayed on the display unit for displaying the image data.
At the time of acquiring the image data, at least one or more of the biological information and the environmental information is associated with the image data.
The device control method according to claim 11. A program executed by a device including a communication unit that communicates with a linked device and acquires a list of sub-data that can be acquired by the linked device when communication with the linked device is established.
In the device
Get the main data
Based on the list of sub-data that can be acquired by the linked device, a button for selecting the sub-data to be acquired from the list is displayed on the display unit for displaying the main data.
The selected sub-data is acquired from the linked device at the time of acquisition of the main data,
The acquired sub-data is associated with the main data.
program. A program executed by a device including a communication unit that communicates with a linked device and acquires a list of sub-data that can be acquired by the linked device when communication with the linked device is established.
In the device
Get the main data
Based on the list of sub-data that can be acquired by the linked device, a button for selecting the sub-data to be acquired from the list is displayed on the display unit for displaying the main data.
The selected sub-data is acquired from the collaborative device at the time of acquisition of the main data .
A search tag generated based on the acquired sub-data is added to the main data, and the search tag is added to the main data.
A search tag is acquired, and the main data to which the search tag matching the acquired search tag is added is searched.
program. A program executed by a device having a communication unit that communicates with a collaborative device.
In the device
Image data is acquired as the main data,
From the linked devices, and biological information indicating the state of the wearer of the linked device to the linked device has acquired, and environment information indicating an environment surrounding the wearer of the linked device, at least one or more of the sub-data Let me get it as
A button for selecting at least one or more of the biological information and the environmental information is displayed on the display unit for displaying the image data.
At the time of acquiring the image data, at least one or more of the biological information and the environmental information is associated with the image data.
The program according to claim 16.

Images