JP6700944B2 - Imaging system, lens device, imaging device, and method of controlling imaging system - Google Patents

Description

  The present invention relates to an imaging system, a lens device, an imaging device, and a method for controlling the imaging system.

  In recent years, not only video cameras and compact cameras, but also interchangeable-lens type cameras have emphasized shooting moving images. In addition, the image blur correction performance of image pickup devices such as video cameras and compact cameras has improved year by year, and it has become possible to correct large blurring when walking or running. In an interchangeable lens type camera system, when a shift lens for image blur correction disposed in the lens is largely moved in order to correct a large blur on the wide angle side, optical performance such as peripheral light amount and MTF is deteriorated. There is. Therefore, in order to correct a large blur, it is necessary to perform electronic correction on the camera side as well. Large blurring is corrected by using the extra pixels of the image pickup device mounted on the camera for image blur correction.

  When the shake correction is performed by combining both the shift lens on the lens side and the electronic correction on the camera side, it is necessary to communicate data for shake correction on the lens side and the camera side. For example, when the shake detection and shake correction amount are calculated using the angular velocity sensor on the lens side and the shake amount is corrected by dividing the correction amount between the lens side and the camera side, the timing that becomes the center of the exposure time (exposure center of gravity timing) The shake correction amount is calculated with. Then, the correction amount is divided into an amount that is optically corrected by the shift lens on the lens side (optical image stabilization) and an amount that is electronically corrected by the camera side (electronic image stabilization), and electronic correction is performed from the lens side to the camera side. Will be transmitted. For that purpose, it is necessary to communicate the exposure time information of the camera to the lens side by a predetermined timing. In Patent Document 1, a blur residual signal processed by lens shake compensation to correct image distortion is transmitted from the lens to the camera, and data required for distortion compensation is calculated on the camera side using the blur residual amount to calculate image distortion. There is disclosed a technique for correcting the above.

JP, 2014-039131, A

  In the communication between the camera and the lens, in addition to shake correction, various kinds of information about the camera and the lens such as focus and aperture are exchanged. Depending on the load condition of communication, the transmission of information from the camera to the lens may be delayed by a predetermined timing. In Patent Document 1, a correction error occurs due to communication delay caused by congestion of communication between the lens side and the camera side. As described above, when it is necessary to acquire the shake correction data of the lens in accordance with the exposure time information of the camera, a delay occurs in communication, the transmission cannot be performed at a predetermined timing, and a deviation occurs in the calculation timing of the shake correction. The camera shake will not be corrected properly.

  It is an object of the present invention to provide an image pickup system capable of performing optimal image blur correction even if a delay occurs in communication between the main body of the image pickup apparatus and the lens device.

In order to solve the above problems, an imaging system according to an embodiment of the present invention includes a main body of an imaging device and a lens device. The lens device is detected by a first communication unit that communicates with the main body unit, a detection unit that detects a shake, a first correction unit that corrects an image shake of an image due to the shake, and the detection unit. A first control unit that acquires shake information and controls the first correction unit. The body portion Bei imaging means, second communication means for communicating with the lens unit, a setting unit for a shake detecting pre Symbol detection means and the first control means sets the timing of acquiring the For example Ru. The second communication means transmits the reference time information to the first communication means in the first communication, and the relative time information between the timing and the reference time in the second communication. To send . The first control means obtains the information of the shake detected by the detection means at the first timing based on the relative time, and when the second communication is not performed by the first timing, , The information of the shake detected by the detecting means at the second timing based on the information about the exposure time until the previous exposure and the third timing based on the delayed second communication.

  According to the present invention, it is possible to provide an image pickup system capable of performing optimum image blur correction even if a delay occurs in communication between the main body of the image pickup apparatus and the lens device.

It is a block diagram of an imaging device. FIG. 6 is a schematic diagram of communication between a lens and a camera for acquiring shake correction data. It is a schematic diagram when a delay occurs in communication between a lens and a camera. It is a schematic diagram when a moving average is used in communication between a lens and a camera. It is a flowchart figure of a lens process. It is a flowchart figure of a lens process. It is a schematic diagram of communication for acquisition of shake correction data in the second embodiment. It is a schematic diagram of communication for acquisition of shake correction data in the third embodiment.

(First embodiment)
FIG. 1 is a diagram showing an example of the configuration of an imaging system in which a lens is attachable/detachable according to the first embodiment. The imaging system has a camera unit that is a main body and a lens unit that can be attached to and detached from the camera unit. The lens unit portion for forming a subject image includes the angular velocity sensor 101 to the lens microcomputer 130. On the other hand, the camera unit section that captures a subject image includes the mount contact section 141 to the camera microcomputer 160.

  First, the lens unit section will be described. The taking lens 120 includes a fixed lens 121, a zoom lens (variable magnification lens) 122 that performs a magnification change operation, a diaphragm 123 that controls a light amount, a shift lens (correction member) 124 that performs a shake correction operation, and a focus position by focus and magnification change. A correction lens 125 is provided. The position sensor 107 is a position sensor (for correction amount detection) that detects the position of the shift lens 124 arranged in the lens.

  The angular velocity sensor 101 is an angular velocity sensor (gyro) that detects camera shake. The amplifier 102 is an amplifier that amplifies the output of the angular velocity sensor 101. The shift lens driver 106 is a driver that drives the shift lens 124. The position sensor amplifier 108 is an amplifier that amplifies the output of the position sensor 107. The lens microcomputer 130 is a lens system control microcomputer that performs lens control, and includes an A/D converter 103, a shake correction amount calculation unit 104, an adder 105, and an A/D converter 109.

  The A/D converter 103 is an analog/digital converter, converts the analog signal output from the angular velocity sensor 101 amplified by the amplifier 102 into a digital signal, and takes it into the lens microcomputer 130. When the output of the angular velocity sensor 101 is a digital output, it is captured by serial communication connection such as SPI or I2C without using the A/D converter. The shake correction amount calculation unit 104 calculates a shake correction amount based on the gyro data input from the A/D converter 103. The output from the shake correction amount calculation unit 104 is data after necessary control such as removal of drift components and high frequency noise from the gyro output and panning control. Further, the shake correction amount calculation unit 104 distributes the shake correction amount to each of the optical correction by the shift lens on the lens side and the electronic correction on the camera side.

  The A/D converter 109 is an analog/digital converter, and receives the analog signal output from the position sensor amplifier 108 and converts it into a digital signal. The adder 105 subtracts the position of the shift lens input from the A/D converter 109 from the shake correction amount assigned to the optical correction by the shift lens calculated by the shake correction amount calculation unit 104 to obtain a correction control amount. Is an adder for calculating The correction control amount calculated by the adder 105 is sent to the shift lens driver 106 as a drive signal, and the shift lens driver 106 drives the shift lens 124 based on the drive signal from the lens microcomputer 130.

The mount contact section 110 is an electrical contact section for connecting the lens unit section to the camera unit section (camera body), and is an electrical contact section for the power supply line and the serial communication line arranged on the mount on the lens side. Communication means. By mounting the lens on the camera, the lens is connected to the mount contact portion 141 arranged on the mount on the camera side, the power source, the GND line, and the communication line are connected, and data is transmitted and received.
Note that camera shake detection and image blur correction are performed on two orthogonal axes such as the horizontal direction and the vertical direction, but the configuration is the same, so only one axis is described here. The lens microcomputer 130 also controls the zoom lens 122, the aperture 123, and the focus position correction lens 125, but only the part relating to the image blur correction control (shift lens 124) is described here.

Next, the camera unit section (main body section) which is also the image pickup apparatus will be described. The mount contact section 141 on the camera side is a communication unit with the lens unit, and when connected to the lens unit, data is transmitted and received with the lens side. The image pickup device 151 is a sensor for image pickup (a CMOS type image pickup device), and the analog signal processing circuit 152 is an analog signal processing circuit for processing the output from the image pickup device 151 and inputting it to the camera signal processing circuit 153. is there.
The camera signal processing circuit 153 includes a vector detection unit 143 and an image correction unit 146.
The camera microcomputer 160 is a camera system control microcomputer, and has a vector correction calculation unit 144, an electronic shake correction calculation unit 142, a data setting unit 145, and an exposure time information notification unit 147. The vector correction calculation unit 144 calculates vector correction data from the vector data detected by the vector detection unit 143. The electronic shake correction calculation unit 142 receives the shake correction amount to be corrected by electronic correction from the lens via the mount contact unit 110 on the lens side and the mount contact unit 141 on the camera side. The data setting unit 145 creates correction data to be corrected by the image correction unit 146 and sets cutout data. The exposure time information notification unit 147 sets and notifies the time and timing information such as the reference time timing, the exposure gravity center timing, and the exposure timing to the camera signal processing circuit 153 and the lens side.

  When the lens unit and the camera body are connected, the vector detection unit 143 detects a vector component corresponding to the remaining unswing after the image stabilization operation is performed in the lens. The detected vector is sent to the camera microcomputer 160, and the vector correction calculator 144 calculates the correction amount. Then, when the communication between the lens and the camera is started by the connection with the lens, the output data for shake correction is transmitted from the lens to the camera. This data is a correction amount to be corrected by electronic correction, out of the image shake correction amounts calculated by the lens shake correction amount calculation unit 104. Then, the data setting unit 145 calculates the final electronic shake correction amount from the shake correction amount received by the electronic shake correction calculation unit 142 from the lens and the image shake correction data of the electronic correction calculated by the vector correction calculation unit 144. Then, the image correction unit 146 is set. As described above, the combination of the shift lens on the lens side and the electronic correction on the camera side corrects camera shake having a large amplitude, which occurs when taking a photograph while walking.

FIG. 2 shows a schematic diagram of communication between the lens and the camera for obtaining shake correction data. The horizontal axis of FIG. 2 represents the passage of time. The exposure of the camera is started within the vertical synchronization period and is exposed for a predetermined period. One field is from the falling edge of the vertical synchronizing signal to the falling edge of the next vertical synchronizing signal, and one piece of image data is acquired from the image pickup device 151 within this period. The center of the exposure period is set as the exposure center of gravity, and electronic image stabilization is performed using the shake amount at that timing.
The method of communicating the timing of the exposure gravity center timing set on the camera side to the lens side by communication between the camera and the lens is as follows. First, the reference time of the camera is set every vertical synchronization and the next vertical synchronization, and the camera notifies the lens of the reference time timing (A in the figure). The reference time is notified as information starting from the timing of the vertical synchronization signal, for example. By this notification, the reference time is set in the lens.

  Next, the timing of the exposure center of gravity of the camera imaging unit is communicated from the camera to the lens. Here, as the timing notification of the exposure center of gravity, the relative time from the reference time of the camera (here, it is the same as the reference time of the lens) is notified (B in the figure). This relative time is the time from the reference time to the exposure time timing. When the lens receives the timing notification of the exposure center of gravity, the remaining time from the time when the notification is received in the lens to the time of the exposure center of gravity is calculated, and the exposure center of gravity timing in the lens is obtained.

Next, at the exposure center-of-gravity timing (first timing) in the lens, the shake correction amount calculation unit 104 acquires the shake information detected by the angular velocity sensor 101, and the shake correction amount required for electronic image stabilization, etc. Data is calculated (C in the figure). The exposure barycentric timing in the lens is the same as the exposure barycentric timing of the image pickup unit of the camera here. After the correction amount is calculated, the lens notifies the camera of the correction amount based on the shake correction information at the time of the exposure center of gravity (D in the figure), and the camera body side performs electronic image stabilization using the correction amount.
As described above, if the notification of the exposure center-of-gravity timing and the data acquisition for electronic image stabilization are performed between the camera and the lens, optimum shake correction can be performed.

Here, when the amount of communication between the camera and the lens is large and there is congestion, the exposure center-of-gravity timing notification may not be in time for the timing of the exposure center of gravity. This state is shown in FIG.
When the timing notification B of the exposure center of gravity is delayed and the notification is received at the timing (B1 in the figure) after the exposure center of gravity, even if the shake correction data is immediately acquired at the timing of the delay, the timing of the exposure center of gravity is changed. It is out of alignment. Therefore, deviation occurs in the shake correction data for electronic image stabilization, and optimal electronic image stabilization cannot be performed. In this way, if the notification of the exposure center of gravity timing is delayed, optimal shake correction will not be performed.

  FIG. 4 shows a method of performing optimum shake correction when the exposure gravity center timing notification from the camera is delayed from the exposure gravity center timing. Here, the moving average of the exposure gravity center timing time is obtained based on the information about the exposure time in the previous exposure, and the shake correction data at the moving average time (second timing) is acquired (timing C1 in the figure). .. When the notification of the exposure center-of-gravity timing time is delayed (B1 in the figure), the shake correction data at the time of receiving the notification (third timing) is acquired as the data at the time of delay (C2 in the figure). Timing). Then, the actual exposure center of gravity time is compared with the moving average time and the delayed time (C1 and C2 are compared), and the shake correction data closer to the exposure center of gravity time (C) is set as the exposure center of gravity data. Is notified (D in the figure).

5 and 6 show the flow of processing when the notification of the exposure gravity center timing from the camera shown in FIG. 4 is delayed from the exposure gravity center timing. Here, the flowcharts of FIGS. 5 and 6 show processing on the lens side that receives communication from the camera.
At the timing of each vertical synchronization period, the lens microcomputer 130 determines whether or not a reference time timing notification has been received as information for setting the timing (S101). Since this notification is always received first in the order of communication, polling is continued until the notification is received. When the notification of the reference time timing is received, the process proceeds to S102, and the reference time in the lens processing is set so as to match the reference time of the camera (S102). Next, the moving average time of the exposure gravity center timing obtained by the moving average processing is set (S103). The value of the moving average time is a value obtained by the moving average processing of the exposure gravity center timing time received by the notification of the exposure so far. In addition to the moving average process, the value set in S103 may be a value calculated by multiplying by LPF, a weighted average value, or the like.
Next, it is determined by a timer process in the lens whether or not the moving average time of the exposure gravity center timing has elapsed (S104). If it has elapsed, the process proceeds to S105, and if it has not elapsed, the process proceeds to S115.

When the moving average time of the exposure gravity center timing has elapsed, shake correction data is acquired as data at the moving average time (S105). This is the shake correction data acquired at the timing of C1 in FIG.
Next, it is determined whether or not the notification of the exposure gravity center timing has been received (S106). If you have not received the notification, continue polling until you receive the notification. When the notification is received, the process proceeds to S107, and it is determined using a timer process in the lens whether or not the time from the reference time, which is the notified information, to the exposure gravity center timing has elapsed (S107). If the time of the exposure gravity center timing has elapsed, the process proceeds to S108, and if not, the process proceeds to S112.

When the time of the exposure center of gravity timing has elapsed, shake correction data is acquired as data at the time of delay (S108). This is the shake correction data acquired at the timing of C2 in FIG. Then, the shake correction data for this exposure is set (S109). As the shake correction data for this exposure, for example, the moving average time is compared with the delay notification time, the one closer to the original exposure time timing is selected, and the closer data is set as the shake correction data for this exposure. To do. Further, the setting method is not limited to this. May be calculated.
After setting the shake correction data, the camera side is notified of the data (S110), and the camera side performs electronic image stabilization processing based on the received data. Then, the moving average time is updated using the present exposure centroid timing time (S111), and the process is ended.

Next, in S107, when the exposure gravity center timing time has not yet elapsed, it is determined whether the exposure gravity center timing time has come (S112). If it is not determined that the exposure center of gravity timing time is reached, polling is continued until the exposure timing time is reached. When it is determined in S112 that the exposure center-of-gravity timing time has come, the process proceeds to S113, and shake correction data is acquired as data at the exposure center-of-gravity timing (S113). This is the shake correction data acquired at the timing of C in FIG. Then, the shake correction data acquired at the exposure gravity center timing is set as the shake correction data in this exposure (S114). In this case, since the exposure center-of-gravity timing data acquired in S113 becomes the shake correction data during the exposure period in this exposure, the shake correction data at the time of moving average becomes unnecessary.
Similarly, after setting the shake correction data, the camera side is notified of the data (S110), and the camera side performs electronic image stabilization processing based on the received data. Then, the moving average time is updated using the present exposure centroid timing time (S111), and the process is ended.

Next, the processing performed when it is determined in S104 that the moving average time of the exposure gravity center timing has not elapsed and the processing proceeds to S115 will be described.
First, it is determined whether or not the notification of the exposure gravity center timing is received (S115). When it is determined that the notification has not been received, the process returns to S104, and the polling is continued until the moving average time elapses or the notification of the exposure gravity center timing comes. When it is determined that the notification of the exposure gravity center timing is received, the process proceeds to S116.
When it is determined that the notification of the exposure gravity center timing is received in S115, the time from the reference time to the exposure gravity center timing is compared by the timer process in the lens, and it is determined whether the exposure gravity center timing time has elapsed (S116). If the exposure center-of-gravity timing time has elapsed, the process proceeds to S117, and if not, the process proceeds to S119.

If the exposure center-of-gravity timing time has elapsed, the delay-time data received after delaying the notification of the exposure center-of-gravity timing is acquired as the shake correction data (S117). In this case, the data for the moving average time has not been acquired yet, but the data for this delay is closest to the exposure time timing, so this data is set as shake correction data for this exposure (S118).
Similarly, after setting the shake correction data, the camera side is notified of the data (S110), and the camera side performs electronic image stabilization processing based on the received data. Then, the moving average time is updated using the present exposure centroid timing time (S111), and the process is ended.

  If the exposure centroid timing time has not yet elapsed in S116, it is determined whether the exposure centroid timing time has elapsed (S119). When the time has elapsed, the shake correction data at that time is acquired as the shake correction data at the exposure gravity center timing (S120). In this case, the exposure gravity center timing data is set as the shake correction data during the exposure period in the present exposure (S121). Therefore, data at the time of moving average is unnecessary. Similarly, after setting the shake correction data, the camera side is notified of the data (S110), and the camera side performs electronic image stabilization processing based on the received data. Then, the moving average time is updated using the present exposure centroid timing time (S111), and the process is ended.

  On the other hand, when it is determined in S119 that the time of the exposure gravity center timing has not elapsed, it is determined whether the moving average time has elapsed (S121). If the moving average time has not elapsed, the process returns to S119, and polling is performed until either the exposure gravity center timing time or the moving average time elapses. When the moving average time has elapsed in S121, the shake correction data at that time is acquired as the shake correction data at the time of moving average (S122). Next, it is determined whether or not the exposure gravity center timing time has elapsed (S123), and polling is continued until the time elapses. When the time has passed, the shake correction data at that time is acquired (S124). Then, the data acquired in S124 is set as the shake correction data at the exposure gravity center timing in this exposure (S125). Also in this case, the data at the time of moving average is unnecessary. Similarly, after setting the shake correction data, the camera side is notified of the data (S110), and the camera side performs electronic image stabilization processing based on the received data. Then, the moving average time is updated using the present exposure gravity center timing time (S111), and the process is ended. If it is determined in S119 that the exposure gravity center timing has not elapsed, the polling may be performed in S119 until the exposure gravity center timing elapses without proceeding to S122.

  As described above, according to the present embodiment, even when the exposure center-of-gravity timing notification between the camera and the lens is not in time for the exposure center-of-gravity timing, the shake correction data is supplemented by using the data at the moving average timing. , The optimum shake correction can be performed.

(Second embodiment)
Next, a second embodiment of the present invention will be described. In the second embodiment, description of parts having the same functions as in the first embodiment will be omitted, and only different parts will be described.
FIG. 7 shows a schematic diagram of communication between the lens and the camera for obtaining shake correction data. In the first embodiment, the shake correction data acquired during the exposure gravity center timing is basically used as the shake correction data during the exposure period. In the second embodiment, the average value during the exposure period is used as the shake correction data during the exposure period. In the notification of the exposure timing (B' in the figure), the camera notifies the lens of the information on the exposure start time and the exposure time, and the lens calculates the average value of the shake correction data during the period. Then, the average value of the shake correction data is set as the shake correction data (C3 in the figure).

Also in the second embodiment, the notification of the exposure timing needs to be notified before the start of the exposure period. However, if it is later than that, as in the first embodiment, the shake correction data for the period based on the information regarding the exposure time up to the previous time and the shake correction data for the period from the delayed exposure timing notification are acquired. Then, the deviation time from the actual start time and the deviation time from the actual exposure period are compared, and the data acquired during the moving average and the data acquired during the delay of the exposure timing notification are used to determine the closer one Use the data. Further, the shake correction data may be calculated by performing linear interpolation on the basis of the data acquired during the moving average and the data acquired during the delay of the exposure timing notification.
As described above, according to the present embodiment, even when the exposure timing notification between the camera and the lens is not in time for the exposure timing, it is possible to compensate for the shake correction data by using the moving average time timing data. Shake correction can be performed.

(Third Embodiment)
Next, a third embodiment of the present invention will be described. Also in the third embodiment, the description of the portions having the same functions as those in the first embodiment will be omitted, and only different portions will be described.
FIG. 8 shows a schematic diagram of communication between the lens and the camera for obtaining shake correction data. In the third embodiment, as the shake correction data during the exposure period, in addition to the exposure center-of-gravity data, several points of shake correction data acquired at equal intervals during the exposure period for rolling shutter distortion correction (RS distortion correction) are used. In the present embodiment, the total number of exposure points is nine, but the number of exposure points is not limited to nine. In the notification of the exposure timing (B' in the figure), the camera notifies the lens of the information of the RS distortion correction data acquisition start time and the acquisition interval time, and the lens processing acquires the shake correction data at the specified timing. Then, the shake correction data is set (C4 in the figure). The information of the RS distortion correction data acquisition start time and the acquisition interval time is the acquisition start time of the correction points and the difference time between the correction points when the control for correcting the image distortion due to the rolling shutter distortion at the plurality of correction points is performed. Is information indicating. As the shake correction data, for example, the average value of the shake correction data of several points acquired at equal intervals during the exposure period for RS distortion correction is set as the shake correction data.

Also in the third embodiment, the notification of the exposure timing needs to be notified before the start of the acquisition of the RS distortion correction data. However, if it is later than that, as in the first embodiment, several shake correction data in the period based on the information regarding the exposure time up to the previous time and the period from the delayed exposure timing notification are acquired. .. Then, the deviation time from the actual start time and the deviation time from the actual acquisition interval time are compared, and the data closer to the actual exposure period is acquired by the data acquisition during the moving average and the data acquisition during the delay. To use. Further, the shake correction data may be calculated by performing linear interpolation on the basis of the data acquired during the moving average and the data acquired during the delay of the exposure timing notification.
As described above, according to the present embodiment, even when the exposure timing notification between the camera and the lens is not in time for the RS distortion correction data acquisition timing, the shake correction data is obtained using the data at the moving average timing. By supplementing, optimum shake correction can be performed.

(Other embodiments)
The present invention supplies a program that implements one or more functions of the above-described embodiments to a system or apparatus via a network or a storage medium, and one or more processors in a computer of the system or apparatus read and execute the program. It can also be realized by the processing. It can also be realized by a circuit (for example, ASIC) that realizes one or more functions.

  Although the preferred embodiment of the present invention has been described above, the present invention is not limited to the above-described embodiment. For example, the same measure can be performed when the shake correction is performed by driving the image sensor in addition to the optical lens according to the shake amount, or when the shake correction is performed using both the optical lens and the image sensor. it can. The present invention can be variously modified and changed within the scope of the gist thereof.

101 angular velocity sensor 104 shake correction amount calculation unit 110 mount contact unit 124 shift lens 130 lens microcomputer 141 mount contact unit 142 electronic shake correction calculation unit 147 exposure time information notification unit 151 image sensor 160 camera microcomputer

Claims (16)

An imaging system comprising a main body of an imaging device and a lens device,
The lens device is
First communication means for communicating with the main body,
Detection means for detecting shake,
First correction means for correcting the image shake of the image due to the shake;
A first control means for controlling the first correction means by acquiring information on shake detected by the detection means,
The main body is
Imaging means,
Second communication means for communicating with the lens device;
Setting means for setting the timing at which the first control means acquires the shake detected by the detection means,
The second communication means is different from the first communication means.
In the first communication, send the information of the reference time,
In the second communication, information on the relative time between the timing and the reference time is transmitted,
The first control means obtains the information of the shake detected by the detection means at the first timing based on the relative time, and when the second communication is not performed by the first timing, , The second timing based on the information about the exposure time up to the previous exposure, and the third timing based on the delayed second communication, the information of the shake detected by the detection means is acquired. Imaging system. First communication means for communicating with the main body of the imaging device,
Detection means for detecting shake,
First correction means for correcting the image shake of the image due to the shake;
A first control means for controlling the first correction means by acquiring information on shake detected by the detection means,
The first communication means is the second communication means provided in the main body,
In the first communication, the information of the reference time is received,
In the second communication, receive the information of relative time,
The first control means obtains information on the shake detected by the detection means at a first timing based on the reference time and the relative time, and the second communication is performed by the first timing. If not, the shake information detected by the detecting means is acquired at the second timing based on the information about the exposure time up to the previous exposure and the third timing based on the delayed second communication. A lens device characterized by the above. The first control unit calculates a correction amount of an image blur correction unit that corrects image blur of an image included in the main body unit, and the third communication causes the first communication unit to perform the second communication. To the means, control to transmit the calculated correction amount,
The lens device according to claim 2, wherein the correction amount is calculated based on the information on the shake.   When the second communication is not performed by the first timing, the first control means compares the second timing and the third timing, and is close to the first timing. The lens apparatus according to claim 3, wherein the shake information acquired at the timing is set as the shake information, and the correction amount is calculated.   When the second communication is not performed by the first timing, the first control unit linearly interpolates the shake information at the second timing and the third timing, The lens device according to claim 3, wherein the correction amount is set as the shake information and the correction amount is calculated.   6. The lens device according to claim 2, wherein the reference time information is information starting from a timing of a vertical synchronization signal. The information of the relative time is information indicating the exposure center of gravity of the imaging unit,
The first timing is the timing of the exposure center of gravity of the imaging means,
The second timing is a timing based on a moving average of the exposure gravity center based on information about the exposure time until the previous exposure,
7. The lens device according to claim 2, wherein the third timing is a timing at which the delayed second communication is performed. The information of the relative time is information indicating the exposure start time and the exposure time,
The first timing is a period from the exposure start time to the exposure time elapses,
The second timing is a period based on a moving average of time from the exposure start time to the exposure time based on the information about the exposure time up to the previous exposure,
The third timing is a period from the time when the delayed second communication is performed until the exposure time elapses,
7. The lens device according to claim 2, wherein the shake information at each timing is an average of shake information acquired in each timing period. The information of the relative time is information indicating the acquisition start time of the correction point and the difference time between the correction points when performing control to correct the image distortion with a plurality of correction points,
The first timing is a plurality of timings for each difference time from the acquisition start time of the correction point,
The second timing is a plurality of timings based on a moving average of the acquisition start time of the correction points and the difference time between the correction points based on the information about the exposure time up to the previous exposure,
The third timing is a plurality of timings for each of the difference times from the time when the delayed second communication is performed,
7. The lens device according to claim 2, wherein the shake information at each timing is calculated based on the shake information acquired at the timing at a plurality of correction points at each timing. ..   10. The lens device according to claim 2, wherein the first control unit controls the image blur correction by driving the lens. An image pickup apparatus for communicating with a lens device, comprising: a first communication unit; and a detection unit for detecting shake,
Imaging means,
Second communication means for communicating with the lens device;
Setting means for setting the timing,
Second correction means for correcting image shake of an image due to shake,
Second control means for controlling the second correction means,
The second communication means is different from the first communication means.
In the first communication, send the information of the reference time,
In the second communication, information on the relative time between the timing and the reference time is transmitted,
The second communication means is from the first communication means,
In the third communication, the image blur correction amount is received and notified to the second control means,
The second control means is
When the second communication means performs the second communication by the timing set by the setting means, the second communication means performs the second communication based on the shake information detected by the detection means at the first timing based on the relative time. Controlling the second correction means in accordance with the image blur correction amount,
When the second communication unit does not perform the second communication by the timing set by the setting unit due to the delay of the second communication, the second communication unit based on the information about the exposure time up to the previous exposure. The second correction means is controlled according to the image shake correction amount based on the information of the shake detected by the detection means at the second timing and the third timing based on the delayed second communication. Imaging device.   The image pickup apparatus according to claim 11, wherein the reference time information is information having a timing of a vertical synchronization signal as a starting point. The information of the relative time from the reference time is information indicating the exposure center of gravity of the image pickup means,
The first timing is the timing of the exposure center of gravity of the imaging means,
The second timing is a timing based on a moving average of the exposure gravity center based on information about the exposure time until the previous exposure,
The imaging device according to claim 11, wherein the third timing is a timing at which the delayed second communication is performed. The information of the relative time from the reference time is information indicating the exposure start time and the exposure time,
The first timing is a period from the exposure start time to the exposure time elapses,
The second timing is a period based on a moving average of time from the exposure start time to the exposure time based on the information about the exposure time up to the previous exposure,
The third timing is a period from the time when the delayed second communication is performed until the exposure time elapses,
Information deflection at each timing, the image pickup apparatus according to claim 11 or 12, characterized in that the average of the acquired vibration information in the period of each timing. The information of the relative time from the reference time is information indicating the acquisition start time of the correction point and the difference time between the correction points when performing control to correct the image distortion with a plurality of correction points,
The first timing is a plurality of timings for each difference time from the acquisition start time of the correction point,
The second timing is a plurality of timings based on a moving average of the acquisition start time of the correction points and the difference time between the correction points based on the information about the exposure time up to the previous exposure,
The third timing is a plurality of timings for each of the difference times from the time when the delayed second communication is performed,
Information deflection at each timing, the image pickup apparatus according to claim 11 or 12, characterized in that it is calculated based on the obtained shake information of the timing of a plurality of correction points each timing. First communication means for communicating with the main body of the imaging device,
Detection means for detecting shake,
First correction means for correcting the image shake of the image due to the shake;
A lens device including: a first control unit that acquires information about a shake detected by the detection unit and controls the first correction unit;
Imaging means,
A control method executed by an imaging system having a main body of an imaging device, comprising: a second communication unit that communicates with the lens device.
A setting step of setting a timing at which the first control means acquires the shake detected by the detection means;
A first communication step of transmitting reference time information from the second communication means to the first communication means;
A second communication step of transmitting information on the relative time between the timing and the reference time from the second communication means to the first communication means;
And a step of acquiring information on a shake detected by the detection means at a first timing based on the reference time and the relative time,
When the second communication step is not performed by the first timing,
A step of acquiring information on a shake detected by the detecting means at a second timing based on information on an exposure time until the previous exposure;
And a step of acquiring information on shake detected by the detection means at a third timing based on the delayed second communication step.

Images