EP3427036B2 - Method for a high-resolution local imaging of a structure in a sample in order to detect reactions of an object of interest to altered environmental conditions - Google Patents
Method for a high-resolution local imaging of a structure in a sample in order to detect reactions of an object of interest to altered environmental conditions Download PDFInfo
- Publication number
- EP3427036B2 EP3427036B2 EP17710694.5A EP17710694A EP3427036B2 EP 3427036 B2 EP3427036 B2 EP 3427036B2 EP 17710694 A EP17710694 A EP 17710694A EP 3427036 B2 EP3427036 B2 EP 3427036B2
- Authority
- EP
- European Patent Office
- Prior art keywords
- sample
- light
- scanned
- luminescence
- zero point
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N21/00—Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
- G01N21/62—Systems in which the material investigated is excited whereby it emits light or causes a change in wavelength of the incident light
- G01N21/63—Systems in which the material investigated is excited whereby it emits light or causes a change in wavelength of the incident light optically excited
- G01N21/64—Fluorescence; Phosphorescence
- G01N21/645—Specially adapted constructive features of fluorimeters
- G01N21/6456—Spatial resolved fluorescence measurements; Imaging
- G01N21/6458—Fluorescence microscopy
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N21/00—Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
- G01N21/62—Systems in which the material investigated is excited whereby it emits light or causes a change in wavelength of the incident light
- G01N21/63—Systems in which the material investigated is excited whereby it emits light or causes a change in wavelength of the incident light optically excited
- G01N21/64—Fluorescence; Phosphorescence
- G01N21/6428—Measuring fluorescence of fluorescent products of reactions or of fluorochrome labelled reactive substances, e.g. measuring quenching effects, using measuring "optrodes"
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N21/00—Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
- G01N21/75—Systems in which material is subjected to a chemical reaction, the progress or the result of the reaction being investigated
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B21/00—Microscopes
- G02B21/0004—Microscopes specially adapted for specific applications
- G02B21/002—Scanning microscopes
- G02B21/0024—Confocal scanning microscopes (CSOMs) or confocal "macroscopes"; Accessories which are not restricted to use with CSOMs, e.g. sample holders
- G02B21/0036—Scanning details, e.g. scanning stages
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B21/00—Microscopes
- G02B21/0004—Microscopes specially adapted for specific applications
- G02B21/002—Scanning microscopes
- G02B21/0024—Confocal scanning microscopes (CSOMs) or confocal "macroscopes"; Accessories which are not restricted to use with CSOMs, e.g. sample holders
- G02B21/0052—Optical details of the image generation
- G02B21/0072—Optical details of the image generation details concerning resolution or correction, including general design of CSOM objectives
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B21/00—Microscopes
- G02B21/0004—Microscopes specially adapted for specific applications
- G02B21/002—Scanning microscopes
- G02B21/0024—Confocal scanning microscopes (CSOMs) or confocal "macroscopes"; Accessories which are not restricted to use with CSOMs, e.g. sample holders
- G02B21/0052—Optical details of the image generation
- G02B21/0076—Optical details of the image generation arrangements using fluorescence or luminescence
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B21/00—Microscopes
- G02B21/0004—Microscopes specially adapted for specific applications
- G02B21/002—Scanning microscopes
- G02B21/0024—Confocal scanning microscopes (CSOMs) or confocal "macroscopes"; Accessories which are not restricted to use with CSOMs, e.g. sample holders
- G02B21/008—Details of detection or image processing, including general computer control
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/58—Optics for apodization or superresolution; Optical synthetic aperture systems
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N21/00—Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
- G01N21/62—Systems in which the material investigated is excited whereby it emits light or causes a change in wavelength of the incident light
- G01N21/63—Systems in which the material investigated is excited whereby it emits light or causes a change in wavelength of the incident light optically excited
- G01N21/64—Fluorescence; Phosphorescence
- G01N21/6428—Measuring fluorescence of fluorescent products of reactions or of fluorochrome labelled reactive substances, e.g. measuring quenching effects, using measuring "optrodes"
- G01N2021/6439—Measuring fluorescence of fluorescent products of reactions or of fluorochrome labelled reactive substances, e.g. measuring quenching effects, using measuring "optrodes" with indicators, stains, dyes, tags, labels, marks
Definitions
- the invention relates to methods for high-resolution imaging of a structure marked with luminescence markers in a sample.
- the invention falls in the field of high-resolution scanning luminescence light microscopy, in which measures are taken that allow luminescence light emitted from the respective sample with higher spatial resolution than the diffraction limit at the wavelength of the luminescence light and at the wavelength of any excitation light with which the luminescence markers spatially be limited to the emission of luminescent light to be assigned to a location in the sample.
- the luminescence markers are often fluorescence markers which, after being excited by excitation light, emit fluorescent light as luminescence light. Then one speaks of fluorescence microscopy.
- luminescence prevention light with which the emission of luminescence light is prevented by those luminescence markers that are located outside the zero point.
- the luminescence light emitted from the sample can thus be assigned to the location of the zero point, because only luminescence markers arranged there are able to emit luminescence light.
- fluorescence markers previously excited with excitation light are de-excited again by means of stimulation light as fluorescence prevention light, except for those in the area of the zero point, by stimulated emission, so that only the fluorescence markers located in the area of the zero point can have emitted the subsequently measured fluorescence light.
- This fluorescent light can thus be assigned to the location of the zero point in the sample.
- the spatial distribution of the fluorescent markers in the sample is determined by scanning the sample with the zero. In this way, the structure and the spatial distribution of a structure marked with the fluorescent markers can be imaged in the sample.
- RESOLFT fluorescence microscopy uses fluorescence-preventing light that converts photochromic fluorescent markers from a fluorescent state to a non-fluorescent state, except for those near the null.
- fluorescence markers are subsequently excited with excitation light, only the fluorescence markers in the region of the zero point of the intensity distribution of the fluorescence-preventing light are accordingly excited by the excitation light to emit fluorescent light.
- the fluorescence light emitted by the fluorescence markers from the sample can be assigned to the location of the zero point of the intensity distribution of the fluorescence prevention light.
- the luminescence-inhibiting light acts on the luminescence markers in the sample with this high intensity already when the region of the zero point of the luminescence-inhibiting light approaches them, i. That is, even before they reach the area of the zero point for the first time and thus the luminescent light emitted by them is registered for the first time.
- the consequence of this can be that luminescence markers that tend to bleach cannot be used in the methods described, or at least not with very high intensities of the luminescence-preventing light, as would be desirable for maximizing the spatial resolution.
- the DE 10 2005 027 896 A1 teaches to apply the fluorescence prevention light in STED fluorescence microscopy in pulses with comparatively large time intervals or with rapid scanning of the respective sample with the zero point on the sample, so that the same areas of the sample are only exposed to the high intensity of the fluorescence prevention light in an optimized time repetition interval .
- the intensity of the fluorescent light available from the sample is increased because of the rate at which the fluorescent markers change from an excited intermediate state to a permanent or only slowly decaying dark state upon further excitation reach, is significantly reduced.
- the probability of bleaching of the fluorescent markers is reduced before they are first reached by the zero point and thus detected. This is because the probability of bleaching is correlated with the intensity of the fluorescent light obtained from each fluorescent marker. Because the fluorescent light is minimized to single photons, the risk of bleaching is also minimized. Basically, the from the DE 10 2011 051 086 A1 However, according to the known methods, the individual fluorescence markers are only reached from the zero point of the fluorescence prevention light after they have previously been exposed to the high intensities in the region of the adjacent intensity maxima.
- the assignment of the luminescence light along the measurement front can also be done with a spatial resolution beyond the diffraction limit, for example by assigning the registered photons to a single luminescence marker, as is done for example in a light microscopic method known as GSDIM.
- One way to increase the speed of imaging a structure of interest of a sample in scanning luminescence light microscopy is to scan the sample with multiple nulls of the luminescence-inhibiting light in parallel.
- the luminescence light emitted from the sample is assigned separately to the individual zero points of the luminescence-preventing light.
- From the DE 10 2006 009 833 B4 it is known to form an intensity distribution of luminescence prevention light with a grid of zeros by superimposing two mutually orthogonal line patterns of luminescence prevention light in the sample. This prevents interference between the line patterns, so that their intensity distributions add up.
- the desired zeros of the intensity distribution of the luminescence-preventing light remain at the crossing points of the line-shaped zeros of the two line gratings.
- most of the luminescence markers in the sample are exposed to high light intensities of the luminescence prevention light before they are reached by the zero point and thus detected for the first time.
- the luminescent markers must therefore be chosen to withstand these high light intensities without fading.
- Li D et al.: Extended-resolution structured illumination imaging of endocytic and cytoskeletal dynamics, Science 2015 Aug 28; 349(6251 ) disclose a method for high-resolution imaging of a structure marked with activatable fluorescence markers in a sample, the sample being scanned successively in different directions with coincident linear or planar zero points of light intensity distributions of fluorescence activation light and fluorescence excitation light, and the fluorescence light emitted by the sample being scanned with a camera is detected.
- an image of a structure of interest in the sample can be reconstructed, the spatial resolution of which is increased by the narrowing of the matching zero points of the fluorescence activation light and the fluorescence excitation light, from which no fluorescence light originates from the sample.
- the zero points of the fluorescence activation light and of the fluorescence excitation light acting at the same time as fluorescence deactivation light are of intensity maxima of the fluorescence activation light and the fluorescence excitation light.
- a method for spatially high-resolution imaging of a structure of a sample marked with luminescence markers in which the sample is exposed to excitation light and stimulation light as luminescence prevention light, as in STED fluorescence microscopy, in order to surround the area of the sample, the fluorescent light emitted and detected from the sample can be assigned to the region of a null point of the stimulation light.
- the sample is additionally exposed to excitation-preventing light whose intensity distribution has a local minimum that coincides with the zero point of the stimulation light.
- This excitation prevention light can in particular be switch-off light, which switches switchable luminescence markers outside the minimum of the excitation prevention light into an inactive state in which they cannot be excited to emit luminescence light with the excitation light.
- the luminescence markers can be switchable fluorescent dyes, such as are used in high-resolution RESOLFT fluorescence microscopy.
- the switchability of the luminescence markers is not primarily used to increase the spatial resolution, but to protect them from bleaching due to the high intensities of the stimulation light.
- Controlled light-exposure microscopy reduces photobleaching and phototoxicity in fluorescence live-cell imaging, Nature Biotechnology, Volume 25, No. 2, February 2007, pages 249 to 253 a method of confocal fluorescence microscopy is known in which a sample is scanned with focused excitation light in order to image a structure in the sample marked with luminescence markers. The excitation light is switched off in each position of the focused excitation light in the sample as soon as a number of photons emitted by the excited luminescence markers in the sample and registered with a detector reaches an upper limit that corresponds to a desired signal-to-noise ratio is equivalent to.
- the excitation light is also switched off if the number of emitted and registered photons does not reach a lower limit within a specified partial period of the maximum pixel dwell time, because this indicates that there is no relevant concentration of luminescence markers at the respective position of the focused excitation light . In this way, the exposure of the sample to excitation light is significantly reduced compared to exposure of the sample to the same amount of light in each position of the focused excitation light.
- From the DE 10 2013 100 147 A1 discloses a method for spatially high-resolution imaging of a structure of a sample that has a luminophore, in which the sample is exposed in a measurement area to an intensity distribution of luminescence-inhibiting light that has a local minimum. Thereafter, the sample in the measurement area is exposed to luminescence excitation light, which excites the luminophore from an electronic ground state into a luminescent state; and luminescent light emitted from the measurement area is registered. The registered luminescence light is assigned to the position of the local minimum in the sample.
- the electronic ground state of the luminophore is disturbed with the luminescence-preventing light in such a way that the luminophore has a reduced absorption cross section for the luminescence excitation light in the disturbed electronic ground state.
- the sample before registering the luminescence light in the measurement area, the sample can be exposed to STED light, which also has a local minimum in the center of the measurement area. If this local minimum is even smaller than the local minimum of the intensity distribution of the luminescence-preventing light, the spatial allocation of the luminescence light can thereby be even more limited, as a result of which the spatial resolution when imaging the structure is increased even further.
- the local minima of the STED light and the fluorescence prevention light are arranged concentrically with each other in all positions of the local minimum of the intensity distribution of the fluorescence prevention light in the sample.
- a method for determining the locations of individual molecules of a substance in a sample in which the individual molecules of the substance are in a fluorescent state in which they can be excited with excitation light to emit fluorescent light, and the distances of the individual molecules of the substance a comply with the minimum value.
- the individual molecules of the substance are excited with excitation light to emit fluorescent light, with an intensity distribution of the approaching light having at least one zero point.
- the fluorescent light from the excited individual molecules of the substance is registered for different positions of the at least one zero of the intensity distribution of the excitation light. In this case, the distances between the most closely adjacent positions of the at least one zero point, in which the fluorescent light is registered by the excited individual molecules of the substance, are not greater than half the minimum value.
- the locations of the individual molecules of the substance are then derived from the progression of the intensity of the fluorescent light from the respective molecule over the positions of the at least one zero point of the intensity distribution of the excitation light in the region of interest of the sample.
- WO 2010/069987 A1 discloses a method for the dynamic displacement of a light beam relative to an optical system that focuses the light beam. This method can be used in STED microscopy.
- fast adaptive raster patterns can be implemented that omit dark background areas or object areas that are uninteresting for other reasons, in order to achieve a higher image repetition rate through a reduced number of pixels.
- the US 2012/0104279 A1 describes a fluorescence light scanning microscope with a birefringent chromatic beam shaping device.
- the scanning microscope is in particular a STED microscope. Both excitation light and STED light pass through the birefringent chromatic beam-shaping device, with the beam-shaping device not impairing the formation of an intensity maximum of the excitation light in the focus of a downstream objective, but having the result that the STED light has an intensity distribution with an intensity minimum locally of the maximum intensity of the excitation light.
- a microscopic method with increased resolution is known in which a sample is scanned twice with an intensity maximum of excitation light in order to generate two images of the sample.
- the scanning points on which the two images are based are offset from one another by an increment below an optical resolution limit of the method, and the resulting differences in the images are evaluated to achieve increased spatial resolution.
- a corresponding method is also from the DE 10 2013 017 468 A1 known.
- a beam shaping device for shaping a beam with a central null point is known.
- This beam shaping device can be used in STED microscopy.
- a scan angle set when the beam is scanned across a sample is limited because it perturbs the relative delays of the beam set by various retardation plates to form the center null.
- the known method has the parallel formation of several zero points of fluorescence prevention light in order to examine the sample in parallel, ie simultaneously in several partial areas.
- a method according to the invention for high-resolution imaging of a structure marked with luminescence markers in a sample light that affects the emission of luminescence light by the luminescence markers is directed onto the sample with an intensity distribution that has a zero point adjacent to intensity maxima. Sections of the sample to be scanned are scanned with the zero, and luminescent light emitted from the region of the zero is registered and assigned to the location of the zero in the sample.
- a plurality of specimens of an object of interest are each arranged so that they overlap with one of the partial regions of the sample to be scanned, and the multiple specimens of the object of interest are subjected to changed environmental conditions in order to record the reactions of the object of interest thereto.
- the individual sections of the sample are affected during and/or before and after the changed environmental conditions sampled at the respective zero point.
- Dimensions of the portions of the sample to be scanned are limited to no more than 75% of a spacing of the intensity maxima in at least one direction and preferably in any direction in which the null is bounded by the intensity maxima in that direction.
- luminescence markers can in particular be fluorescent markers.
- other luminescence markers can also be used whose luminescence properties are based, for example, on chemiluminescence or electroluminescence. This includes the fact that the excitation of the luminescence markers to emit luminescence light in the method according to the invention is not restricted to specific mechanisms. In many cases, however, the luminescence markers will be excited to emit luminescence light by excitation light.
- the light that affects the emission of luminescence light by the luminescence markers can be luminescence prevention light, which prevents the emission of luminescence light by the luminescence markers, for example by converting the luminescence markers to a dark state or by de-exciting excited luminescence markers by stimulated emission and thus prevents the emission of luminescent light.
- the light that affects the emission of luminescent light by the luminescent markers can also be light that converts the luminescent markers from a non-luminescent state into another non-luminescent state in which they are particularly well protected from bleaching .
- the light that affects the emission of luminescence light by the luminescence markers can also be light that affects the emission of luminescence light by the luminescence markers not alone but only in conjunction with other light in such a way that these only still occurs from the area of the zero point of the intensity distribution of the light.
- the light that affects the emission of luminescence light by the luminescence markers is luminescence-enabling light that enables the emission of luminescence light by the luminescence markers in the first place, for example by stimulating the luminescence markers to luminescence, i.e. luminescence-excitation light , or converting the luminescent markers from a dark state to an excitable state.
- the zero point of the intensity distribution of the light that affects the emission of luminescence light by the luminescence marker is at least a local intensity minimum of the light. There will often be an intensity minimum in which the intensity of the light essentially goes back to zero. Ideally, the intensity of the light actually goes to zero at the center of the null. However, this is not a mandatory requirement. If the light is, for example, luminescence prevention light, it is sufficient if the intensity of the luminescence prevention light in the region of the zero remains so low that it does not lead to any, or at least no significant, i. H. at least not leading to a predominant prevention of the luminescence of the luminescence markers.
- the zero point is delimited by the regions in which the luminescence-preventing light at least essentially prevents the emission of luminescence light by the luminescence markers. Everything between these areas, in which the luminescence-preventing light at least essentially prevents the emission of luminescent light by the luminescent markers, is referred to here as "null point” or "area of the null point”.
- the intensity maxima which are adjacent to the zero point of the intensity distribution of the light affecting the emission of luminescence light by the luminescence markers, are mentioned in the plural, this should not rule out the case that the zero point is, for example, ring-shaped the zero extending intensity maximum is enclosed.
- a ring-shaped intensity maximum is shown in the form of two intensity maxima, which are adjacent to the zero point in the section on both sides.
- the null can be adjacent in one, two or three directions from the intensity maxima. It can therefore be a level, line or point zero point.
- the zero point can intersect a two-dimensional or one-dimensional sample in such a way that a line or point zero point in the dimensions of the sample is also adjacent to the intensity maxima on all sides.
- the partial areas of the sample to be scanned can be scanned in different directions with a zero point that is not adjacent to the intensity maxima in all dimensions of the sample, in order to maximize the spatial resolution when imaging in all directions.
- the dimensions of the partial regions of the sample to be scanned are limited in at least one direction and preferably in all directions in which the zero point in the sample is adjacent to the intensity maxima.
- the intensity maxima adjacent to the zero point in the sample are often of much higher light intensity than the areas of the intensity distribution of the light affecting the emission of luminescent light by the luminescent markers, which are directly adjacent to the zero point and in which the light is already reflected in the desired manner affects the emission of luminescent light by the luminescent markers, for example by preventing this emission.
- the very high intensities in the area of the maximum intensity are the result of the overall high intensity of the light, which in turn is a prerequisite for the region of the zero point in which the light has at least essentially no effect on the emission of luminescence light by the luminescence markers to be strongly spatially delimited.
- intermediate areas remain between the areas directly delimiting the zero point and the intensity maxima of the intensity distribution, in which the light intensity is significantly below the light intensity in the intensity maxima.
- These intermediate areas are used in a targeted manner in the method according to the invention, in that the dimensions of the scanned partial areas of the sample do not exceed 75% of the distance between the intensity maxima in this direction. If the dimensions of the scanned partial areas in the respective direction remain smaller than 50% of the spacing of the intensity maxima in the respective direction, no point of the scanned partial areas will be exposed to the full intensity of the light in the intensity maxima.
- the dimensions of the partial areas to be scanned in the respective direction between the intensity maxima can be a maximum of 300 nm, preferably a maximum of 200 nm and even more preferably about 100 nm.
- the sub-areas of the sample to be scanned can be sub-areas of the sample which, when the method according to the invention is carried out, alone, i. H. exclusively, and which are respectively aligned to regions of interest of the sample that overlap with the multiple instances of the object of interest.
- all specimens of the object of interest can in principle be subjected to the same changed environmental conditions.
- this makes it possible to detect and compare different reactions of the object of interest to the different changed environmental conditions.
- the reactions can differ both in terms of the reaction result and the reaction speed.
- the method according to the invention also enables faster repetitions of the scanning of the partial areas to be scanned with the zero point.
- the environmental conditions to which the specimens of the object of interest are exposed in the method according to the invention can be different physical environmental conditions, for example different temperatures, different electric, magnetic and electromagnetic fields and the like. However, the environmental conditions can also be changed by adding a chemical substance, ie they can include different chemical environmental conditions.
- the method according to the invention can be used to carry out drug screening, in which substances are searched for that cause the desired reactions in the object of interest. To this end, many specimens of the object of interest can be exposed individually or in larger subsets to different substances, which are examined for their suitability for eliciting the desired reaction.
- the high spatial resolution of the method according to the invention makes it possible, for example, to detect spatial changes in the object of interest as a result of the effect of the respective substance, which cannot be detected with many other methods or can only be detected indirectly and then with correspondingly greater effort.
- the plurality of specimens of the object of interest are arranged in a pattern defined in relation to fixed points of the sample in the second method according to the invention. It is then possible very efficiently to approach the sub-areas of the sample to be scanned with the zero point relative to the fixed points of the sample. This can also be done fully automatically. Arranging the objects of interest in the pattern can be done, for example, with the help of an immune reaction or the like.
- the partial areas of the sample to be scanned are usually scanned repeatedly with the zero point in order to record the reactions of the object of interest to the changing environmental conditions. It is preferred, at least when the scanning of the partial areas of the sample to be scanned is repeated, to arrange the zero point at no more than 3n or even no more than 2n locations per partial area to be scanned, where n is the number of spatial directions in which the partial areas of the sample to be scanned Sample to be scanned to image the object of interest with high resolution.
- Such a few null locations are sufficient to detect the location of individual luminescent markers in each sub-area to be scanned, if that is for each sub-area to be scanned registered luminescence light can each be assigned to a specific one of these luminescence markers. Such an assignment is possible if at any time only one of the luminescence markers emits the luminescence light, ie a temporal distinction is possible, or if the luminescence light can be assigned to individual luminescence markers based on its wavelength, for example.
- This embodiment of the method according to the invention thus makes use of the method known as MINFLUX.
- MINFLUX To determine the location of an individual luminescence marker in a plane, a zero of a light intensity distribution of excitation light is positioned at four different locations in the sample and the intensity of the luminescence light from the luminescence marker is recorded for this purpose.
- the object of interest which is arranged in multiple copies in the sample, can be a molecule, for example a protein molecule, a complex, but also a more complex biological entity such as a synapse, a membrane, another cell component or a whole virus act.
- the sequence of the successive scans of the partial areas with the respective zero point can be very fast, so that rapid changes in the object of interest can also be detected.
- the invention consciously accepts that the sub-areas of the sample that are scanned and thus imaged remain very small. Often they extend a distance of the order of the diffraction limit at the wavelength of light affecting the emission of luminescent light by the luminescent markers. Due to the significant reduction in the average light intensities affecting the scanned sub-areas, however, it is possible to successfully use luminescence markers that have a relatively strong tendency to bleach or to repeatedly scan the scanned sub-areas of the sample with the zero point of the intensity distribution.
- a partial area of the sample to be scanned can also be scanned with only very few positions of the zero point in the sample, for example to detect the displacement of an individual fluorescent marker in the sample due to changed environmental conditions.
- the dimensions of the partial areas of the sample to be scanned are not greater than 45%, 25% or even 10% of the distance between the intensity maxima in each direction in which the intensity maxima are adjacent to the zero point in the sample.
- the dimensions of the partial areas of the sample to be scanned are not greater than the distance in each direction in which the intensity maxima are adjacent to the zero point in the sample , over which the intensity of the light increases from the zero point in the respective direction to 50%, 25%, 10% or 5% of the intensity of the light in the adjacent intensity maxima.
- the maximum exposure of the luminescence markers in the area to be scanned is then also limited to 50%, 25%, 10% or 5% of the intensity of the light in the adjacent intensity maxima.
- the method according to the invention it often makes sense to image the specimens of the object of interest in the sample marked with the luminescence markers in a different way before scanning the partial areas of the sample to be scanned with the zero point, in order to determine the position of the partial areas of the sample to be scanned.
- the sub-areas of the sample to be scanned are those sub-areas of the sample that overlap with the specimens of the object of interest in such a way that particular details of the object or also developments of the object due to the changed environmental conditions appear in them.
- This imaging can take place with local or large-area excitation of the luminescence markers to emit luminescence light.
- a larger area of the sample with the zero point can also be scanned with an intensity of the light affecting the emission of luminescent light that is at least 50% lower and/or with a scanning speed that is at least 50% higher in order to determine the position of the sub-areas of the sample to be scanned.
- all points of the larger area of the sample are admittedly exposed to the high intensity of the light in the area of the intensity maxima.
- this intensity is deliberately reduced and/or it only acts on the luminescence markers over a shorter period of time.
- different scanning means are used for scanning a larger area of the sample than for scanning the individual partial areas of the sample to be scanned Sample.
- scanning means that are specially tailored to the scanning of the individual, narrowly defined sub-areas of the sample to be scanned can be used. Due to the small dimensions of the sub-areas in the sample to be scanned, these can be scanning means that do not allow large shifts in the light intensity distribution with the zero point, but that convert the shifts that they can cover very quickly and/or precisely. In this way, the partial areas to be scanned can be scanned very quickly, for example in order to track rapid changes in the objects of interest in the partial areas.
- a sample holder for the sample can be moved relative to a lens with which the light is directed onto the sample, while an electro -optical scanner, an acousto-optical deflector or a galvo mirror, i.e. a deflecting mirror with galvanometer drive is used.
- the device for scanning the individual partial areas of the sample to be scanned can be combined with an additional electro-optical or acousto-optical modulator as a phase shifter for shifting the zero point of the light intensity distribution.
- the light affecting the emission of luminescence light by the luminescence markers can be, in particular, luminescence prevention light, which prevents the emission of luminescence light by the luminescence markers outside the zero point.
- the luminescence-preventing light converts or switches luminescent markers in the form of switchable proteins into a dark state in which they cannot be excited to emit luminescent light.
- the luminescence prevention light can be directed onto the sample, in particular together with excitation light, which excites the luminescence markers to emit luminescence light and which has an intensity distribution with an intensity maximum in the region of the zero point of the luminescence prevention light. Except for the narrow limits for the sub-areas of the sample to be scanned, this corresponds to the usual procedure in STED, RESOLFT or GSD fluorescence light microscopy.
- the first method according to the invention is from the WO 2014/108455 A1 known concept of performing STED fluorescence microscopes with switchable luminescence markers in order to protect the luminescence markers from the high intensities in the region of the intensity maxima of the stimulation light by switching them to an inactive state, applied in a modified form. Specifically, before scanning the sub-areas of the sample to be scanned with the zero, additional switch-off light with such an intensity distribution is directed onto the sample that it switches the switchable luminescence markers in sub-areas of the sample adjoining the sub-areas to be scanned into an inactive state.
- These adjoining sub-areas adjoin the sub-areas to be scanned in the at least one direction in which the intensity maxima are adjacent to the zero point of the stimulation light in the sample.
- the luminescence markers are thus switched to the inactive state where the intensity maxima of the stimulation light occur and where without this protective measure the luminescence markers would be lost due to the high intensities of the stimulation light when scanning the partial areas of the sample to be scanned. Since the bleaching of the luminescence markers is omitted in this embodiment of the method according to the invention, it can also be carried out successively for partial regions to be scanned that are directly adjacent to one another or even overlap one another. In other words, the sample can be scanned with the partial areas to be scanned, the partial areas to be scanned being in turn scanned with the zero point at all or at least at selected positions in the sample.
- the intensity distribution of the switch-off light can have a local intensity minimum formed by destructive interference in the sub-area to be scanned subsequently, in which it at least essentially does not switch off the luminescence markers, i. i.e. by leaving the luminescence markers at least essentially in their active state, in which they can be excited by the excitation light.
- this active state may require or at least make it useful that before and/or with a time overlap with the direction of the turn-off light onto the sample, turn-on light is directed onto the respective sub-area of the sample to be scanned, which switches the switchable luminescence markers into their active state turns on.
- switchable luminescence markers When switched on and/or off, switchable luminescence markers often also emit luminescence light.
- This luminescent light can be registered and evaluated in the method according to the invention.
- the aim of this evaluation can be, for example, a decision as to whether the sub-area to be scanned, which is delimited by the respective adjacent sub-area, is even scanned with the zero point or whether it is only exposed to excitation light in its entirety, with the luminescence light then emitted being registered confocally, or whether it is not at all is applied with excitation light because the low intensity of the luminescence light registered when switching on and / or off indicates that no relevant concentration of luminescence markers in the respective part to be scanned is present.
- the evaluation can also have the aim of determining under which conditions the directing of the stimulation light onto the sample in each position of the zero point in the sub-areas to be scanned and the registration of the luminescence light emitted from the area of the zero point is meaningfully broken off.
- an upper and/or lower limit value for carrying out a RESCue method in the respective sub-area to be scanned can be defined as a function of the result of the evaluation.
- luminescence light emitted from the area of the zero point is registered with a point sensor whose position relative to the sample is not changed when scanning the respective partial area of the sample to be scanned. That is, when registering the luminescent light with the point sensor, the change in position of the zero point of the light intensity distribution of the light affecting the emission of luminescent light by the luminescent markers is not taken into account. This is possible because the dimensions of the partial areas to be scanned are regularly smaller than the detection area of a point sensor in relation to the sample. This also applies to a point sensor arranged confocally to the center point of the respective partial area to be scanned.
- the positionally fixed point sensor means that the zero point for scanning the respective partial area of the sample to be scanned is shifted by acting solely on the light affecting the emission of luminescence light by the luminescence markers. Any excitation light does not have to be shifted together with the light affecting the emission of luminescence light by the luminescence marker, since its intensity maximum also typically extends over the entire partial area of the sample to be scanned.
- the light affecting the emission of luminescence light by the luminescence markers can alternatively be luminescence-enabling light, which enables the emission of luminescence light by the luminescence markers outside the zero point in the first place.
- the light is luminescence excitation light as the only light that is directed onto the sample.
- the light is luminescent activation light, which converts the luminescent markers from a dark state to a luminescent excitable state, ie. H. activated.
- the light affecting the emission of luminescent light by the luminescent markers can also have both functions, i. H. of activation and excitation, and also have two components of different wavelengths.
- this sub-area is kept small according to the invention so that the luminescence markers located in the sub-area are not involved, or at least as little as possible to apply the high light intensities in the area of the intensity maxima adjacent to the zero point.
- the luminescence light emitted by the luminescence markers in the sample is typically detected with a camera, and the evaluation is carried out by unfolding the registered intensity distributions with regard to the current position of the zero point in the sample and the associated change in the intensity distribution of the luminescent light emitted from the sample and captured by the camera.
- luminescence marker emits the detected luminescence light from the sample in the partial areas to be scanned
- its position in the sample can also be determined very easily from the luminescence light registered for the various locations of the zero point, for example by fitting a function having a local extremum, where the location of the extremum of the fitted function is equated to the position of the luminescence marker sought. This procedure is possible both when the light that affects the emission of luminescence light by the luminescence markers and whose intensity distribution has the zero point is luminescence-preventing light and when it is luminescence-enabling light or excitation light.
- the intensity maxima of the luminescence prevention light adjacent to the zero point advantageously prevent luminescence light emitted by other luminescence markers in the vicinity from interfering with the position determination.
- the respective luminescence marker in the partial area to be scanned is only exposed to a minimal amount of light and is therefore only minimally photochemically stressed.
- the disadvantage of the method according to the invention that the sampled and thus imaged partial area remains very small, can be at least partially compensated for by the sample being scanned in several partial areas at the same time.
- a grid of zero points of the light affecting the emission of luminescence light by the luminescence marker can be used, as is fundamentally known.
- the grid of the zero points is not shifted so far that the sample is imaged as a whole, ie over the full grid dimension. Rather, the individual partial areas in which the sample is scanned also remain in this embodiment of the invention procedures separately. This is the only way to reduce the risk of bleaching of the luminescence markers in the scanned partial areas of the sample according to the invention.
- a plurality of specimens of the object of interest are arranged in each case overlapping with one of the plurality of partial areas of the sample to be scanned, a partial image of this object is obtained when each partial area is scanned. If these partial images are statistically distributed over the object and their number is large enough, an image of the entire object of interest can be reconstructed from them. It goes without saying that this assumes that the different specimens of the object of interest are at least largely the same.
- the specimens of the object of interest in the sample can also be imaged in a different way in order to determine their position and orientation relative to the scanned partial areas of the sample.
- a scanning luminescence light microscope for carrying out the method according to the invention has a light source for the light which affects the emission of luminescence light by the luminescence markers, light shaping means which direct the light with the intensity distribution onto the sample which has the zero point adjacent to the intensity maxima, scanning means, in order to scan a partial area of the sample to be scanned with the zero point, a detector which registers luminescence light emitted from the area of the zero point, and a controller for carrying out the method according to the invention.
- the detector may be a point detector, where the location of the point detector relative to the sample when scanning the sample portion to be scanned may be fixed, i. H. can detect the luminescence light emitted from the sample without it being descanned, because the partial area to be scanned usually has dimensions below the diffraction limit. Further scanning means can then be present, which differ from the scanning means for scanning the partial area of the sample to be scanned with the zero point and are provided for scanning a larger area of the sample.
- the scanning means for scanning the larger area of the sample in at least one direction can have a sample holder that can be moved relative to an objective of the light-shaping means, while the scanning means for scanning the partial area of the sample to be scanned in at least one direction have an electro-optical scanner, an acoustic optical deflector or a galvo mirror.
- the detector can also be a point detector, for example, which captures the unscanned luminescence light from the sample, or a flat detector, such as a camera, which captures the unscanned luminescence light from a fixed position relative to the sample.
- the light provided by the light source is stimulating light
- a further light source is provided for stimulating light
- the light-shaping means directing the stimulating light onto the sample with a light intensity distribution which has a maximum in the region of the zero point of the Having luminescence prevention light.
- a switch-off light source for switch-off light must also be provided in the scanning luminescence light microscope, with the light-shaping means directing the switch-off light onto the sample with such an intensity distribution that the switchable luminescence markers are in a sub-area adjacent to the area to be scanned portion of the sample turns off to an inactive state.
- the adjoining sub-area borders on the sub-area to be scanned in the at least one direction in which the intensity maxima are adjacent to the zero point of the stimulation light in the sample.
- a switch-on light source can be provided for switch-on light, which switches the switchable luminescence markers on to their active state, with the light-shaping means directing the switch-on light to a sub-area of the sample that encompasses the sub-area to be scanned before and/or with a temporal overlap with the direction of the switch-off light onto the sample.
- excitation light 1 has an intensity maximum 27 with maximum intensity I at a geometric focal point F.
- the intensity I is distributed over an area that extends far beyond the focal point F on all sides, the diameter of which corresponds to the diffraction limit at the wavelength lambda of the excitation light 1 and the numerical aperture NA of the lens used to focus the excitation light 1 into the focal point F according to lambda /NA corresponds.
- fluorescence prevention light 2 is additionally directed onto the sample, which has a zero point 4 adjacent to intensity maxima 3 .
- the fluorescence prevention light 2 prevents the emission of fluorescence light by fluorescence markers excited by the excitation light 1, for example in that the fluorescence markers are de-excited again by stimulated emission. Everywhere outside the region 5 of the null point 4 of the fluorescence prevention light 2, the intensity I of the fluorescence prevention light 2 is so great that this de-excitation occurs completely, that is, the ones arranged there Fluorescent markers do not emit fluorescent light. Conversely, "zero point 4" here means the entire area 5 within which the intensity I of the fluorescence prevention light 2 remains so small that it does not prevent the emission of fluorescence light by fluorescence markers arranged therein. 1 below shows the spatial distribution of the effective fluorescence excitation 6. This is limited to the area 5 of the zero point 4. If a sample is scanned with the zero point 4, fluorescent light emitted from the sample always comes from the area 5 and can be assigned to the sample according to this location.
- the fluorescent markers When the zero point 4 approaches a structure of interest marked with a fluorescent dye when scanning a sample, the fluorescent markers first reach the area of the intensity maxima 3 and the intensities of the excitation light 1 superimposed thereon before they reach the area 5 of the zero point 4.
- the fluorescent markers are repeatedly exposed to high light intensities before fluorescent light is registered by them for the first time. This can lead to the fluorescent markers already being bleached before they are reached by the zero point 4 for the first time. Repeated scanning of the same sample, for example to observe changes over time in the structure of interest in the sample marked with fluorescent markers, is often impossible due to this effect.
- the average load on the fluorescence markers in the scanned area which is caused by the high intensities of the fluorescence prevention light 2 in the area of the intensity maxima 3, in particular in connection with the intensity of the excitation light 1, decreases 1 occurs.
- This burden decreases further if the dimensions of the area to be scanned are restricted to half the distance D 0 of the intensity maxima 3 and less. If the dimensions are limited to less than D 0 /2, no point of this sub-area comes into the immediate area of the intensity maxima 3 when scanning the partial area of the sample to be scanned.
- the maximum intensity is of the fluorescence prevention light 2 applied to the sample within the area to be scanned is limited to about I 0 /2, where I 0 is the maximum intensity of the fluorescence prevention light 2 in the intensity maxima 3.
- FIG. 3 illustrates the scanning of a partial area 7 to be scanned of a sample 8 shown as a detail with the area 5 of the zero point 4 along a meandering path 9 here corresponds to a center point 10 of the partial area 7 to be scanned.
- the intensity maxima run accordingly, or to put it better, the ring-shaped intensity maximum 3 here runs around the in 3 illustrated position of the zero point 4 still through the scanned portion 7, which is indicated by a dashed line 11.
- this overlapping can be prevented by further limiting the partial area 7 to be scanned to less than D 0 /2.
- the limitation of the dimensions of the sub-area 7 to be scanned to approximately 2D 0 /3 given here also achieves a considerable reduction in the mean exposure of the sample 8 in the sub-area 7 to the fluorescence prevention light 2 .
- the 4 illustrates a partial area 7 of the sample 8 to be scanned that is limited to D 0 /2.
- the course of the ring-shaped maximum intensity 3 indicated by the dashed line 11 no longer reaches the partial area 7 at any position of the zero point 4 in the partial area 7 to be scanned 4 a spiral path 12 along which the partial area 7 to be scanned is scanned starting from the center point 10 .
- the fluorescent light emitted from the sample 8 and registered is assigned to the respective location of the zero point 4 in the sample.
- FIG 5 1 illustrates a scanning fluorescence light microscope 13 which is particularly suitable for carrying out a method according to the invention.
- the scanning fluorescence light microscope 13 has a light source 14 for the fluorescence prevention light 2, the cross section of which is expanded with expansion optics 15 and the wave fronts of which are modulated over its cross section with the aid of a phase plate 16 in such a way that, when focusing with an objective 45, it is reflected in the sample 8 Zero point 4 with adjacent intensity maxima 3 according to the 1 and 2 forms around the respective focal point F.
- a further light source 17 with expansion optics 18 is provided for the excitation light 1 .
- the excitation light 1 and the fluorescence prevention light 2 are combined with a dichroic mirror 19, so that the excitation light 1 in the region 5 of the zero point 4 of the fluorescence prevention light 2 has its intensity maximum 27 according to 1 having.
- the fluorescent light 20 emitted from the sample is coupled out with a dichroic mirror 26 and registered with a point detector 21 and assigned to the respective location of the zero point in the sample.
- scanning means 22 and 23 are provided for two mutually orthogonal scanning directions, which are controlled in a coordinated manner.
- the scanning means 22 and 23 influence only the direction of the excitation light 1 and the fluorescence prevention light 2, they could even exclusively in the optical path of the fluorescence prevention light 2 be arranged. Since the portion 7 of the sample 8 to be scanned has dimensions below the diffraction limit, even if the point detector 21 is stationary relative to the sample 8, the fluorescent light 20 emitted from the sample 8 from the area of the zero point of the fluorescence prevention light 2 always reaches the point detector 21, i.e. despite the displacement of the zero point using the scanning means 22 and 23.
- a scanning of the sample 8 that goes beyond the partial area 7 of the sample 8 to be scanned, which is scanned according to the invention in order, for example, to initially determine the position of a suitable partial area to be scanned, further scanning means are in the area a sample holder 24 is provided, which is indicated here only by corresponding displacement symbols 25.
- the zero point 4 of the intensity distribution of the fluorescence prevention light 2 can also be limited by intensity maxima 3 in a z-direction, in which the fluorescence prevention light 2 is directed onto the sample, in order to improve the spatial resolution during imaging of the structure of interest in the sample 8 also in this z-direction.
- the partial area 7 to be scanned must then also be limited in this z-direction to a maximum of 75%, preferably less than 50% of the distance between the intensity maxima of the light in this direction, or also in the z-direction starting at its center point 10 and increasing the distance to scan to this center 10.
- An increased spatial resolution when imaging the structure in the z-direction can also be achieved in the method according to the invention by other measures, for example by a 4Pi arrangement or by 2-photon excitation of the fluorescent markers to emit the fluorescent light or by others in the field of Fluorescence microscopy known measures. It also applies in principle that the methods described here can be supplemented by other measures known in the field of fluorescence microscopy.
- the confocal image according to Figure 6(a) was recorded from a sample in which a structure of interest was tagged with the luminescent marker nucleoporin gp210.
- the confocal image gives an overview of the structure of interest. Individual partial areas of the sample were selected from this overview, in which STED images were recorded using the method according to the invention. These partial areas are smaller than the focus of the excitation light. In the sub-areas, the structure of interest is imaged with high spatial resolution and at the same time high light yield.
- excitation light with a wavelength of 635 nm and a power of 5 ⁇ W was directed onto the sample in pulses with a repetition rate of 20 MHz.
- STED light with a wavelength of 775 nm was directed onto the sample in synchronized pulses with a pulse length of 1.2 ns and a power of 150 mW.
- the excitation light and the STED light were focused into the sample with a 1.4 NA oil inversion objective.
- the fluorescence light was focused onto a point detector using the oil inversion objective and another lens.
- ⁇ 1/2 denotes the number of images that can be recorded until the fluorescence signal has fallen to half of the original value due to bleaching.
- ⁇ 1/2 is plotted against the dimensions of the scanned portion of the sample in nanometers.
- the STED power was 160 mW, the excitation power 2 ⁇ W. Otherwise the STED conditions corresponded to those according to 6 .
- Illustrated scanning fluorescence microscope 13 has the following differences from that in figure 5 illustrated scanning fluorescence microscope.
- the point detector 21 is arranged behind the scanning means 22 and 23 as seen from the sample 8 so that the scanning means unscan the fluorescent light 20 coming from the sample 8 towards the point detector 21 .
- the scanning means 22 and 23 are provided both for scanning the partial area to be scanned with the zero point of the fluorescence prevention light 2 and for basically arranging or relocating the partial area in the sample 8 to be scanned.
- 8 8 also shows a fluorescent light detector 28 placed in front of the scanning means 22 and 23 from the sample of FIG. However, this is not a point detector, but a camera 29, ie a flat detector.
- This detector 28 can be provided in addition to the point detector 21 or instead of the point detector 21, with a dichroic mirror 30 deflecting the fluorescent light 20 to the detector 28 being arranged either temporarily or permanently between the objective 45 and the scanning means 22 and 23.
- a switch-off light source 31 is provided, which is assigned expansion optics 32 in order to use the zero point of the fluorescence prevention light before scanning the respective partial area to be scanned 2 off light 34 to provide.
- the turn-off light 34 is coupled in with the aid of a dichroic mirror 43, and its intensity distribution in the sample 8 is shaped with the beam-shaping means 33 in such a way that switchable luminescence markers contained in the sample 8 are switched to an inactive state in a partial area of the sample 8 adjacent to the partial area to be scanned switches. In this inactive state, the switchable luminescence markers in the sample 8 cannot be excited with the excitation light 1 to emit fluorescent light 20 .
- the scanning fluorescence microscope 13 In order to be able to stimulate the luminescence markers in the adjoining partial area to be scanned with the excitation light 1 to emit fluorescent light 20, they must be in their active state again. For this purpose, a spontaneous return of the luminescence markers from their inactive state to their active state can be awaited.
- the scanning fluorescence microscope 13 according to 8 but also has an additional turn-on light source 35 with expansion optics 36 to direct turn-on light 37 via a dichroic mirror 44 onto the sample 8, with which the luminescence markers in the next partial area to be scanned are initially switched to their active state.
- the sub-area of the sample 8 covered by the turn-on light 37 can be larger than the sub-area to be scanned next because the luminescence markers outside of the sub-area to be scanned next are then converted to their inactive state with the turn-off light 34 .
- the sample 8 can therefore be scanned in two stages, namely in large steps with the partial area to be scanned and in small steps with the zero point of the fluorescence prevention light 2 within each partial area to be scanned.
- the fluorescent light 20 registered when the luminescence markers are switched on or off can also be used to define an upper and/or lower limit value for the fluorescent light registered at the respective location of the zero point of the fluorescence prevention light 2 in the partial area to be scanned, when it is reached or If not reached, exposure of the sample 8 to the luminescence prevention light 2 and the excitation light 1 is terminated in the sense of a RESCue method.
- 9 12 shows a partial area 7 to be scanned and the intensity maximum 3 of the fluorescence prevention light running around it when the zero point of the fluorescence prevention light is in the center point 10 of the partial area 7 to be scanned.
- an annular adjoining partial area 39 is drawn in, in which the sample 8 is exposed to the switch-off light 34 before the partial area 7 is scanned, in order to convert the switchable luminescence markers located here into their inactive state.
- the sub-area 39 leaves out the sub-area 7, ie in the sub-area 7 the intensity of the switch-off light 34 is zero or at least so small that it is not sufficient to switch off the luminescence marker within the time for which the switch-off light 34 is directed onto the sample 8 .
- the switch-on light 37 is switched on before and/or overlapping in time with the switch-off light 34 over a circular sub-area 40, which comprises the sub-area 7 to be scanned. aimed at sample 8.
- FIG. 10 illustrates how the sample 8 can be scanned with the partial area 7 to be scanned. while showing Figure 10(a) several successive layers of the circular portion 7 according to 9 in the sample 8 and in one of these partial areas 7 the path 9, along which a square area of the sample 8 is scanned within the partial area 7.
- Figure 10(b) shows how the sample 8 can be completely covered with such square partial areas 41 and correspondingly completely imaged.
- FIG. 11(a) 12 illustrates another form of scanning the sample 8 with the portion 7.
- the successive positions of the circular portion 7 are provided in the sample 8 in a hexagonal array.
- the path 9 extends, along which each partial area 7 with the zero point of the luminescence prevention light is sampled, over a regular hexagon.
- Figure 11(b) shows how the entire sample 8 is recorded and correspondingly imaged with these regular hexagons 42 .
- each object of interest is indeed marked with several luminescence markers.
- the number of luminescence markers per object can be small and, for example, only two.
- two different areas of the object of interest, such as a protein can be marked with two identical or two different fluorescent markers in order to map the structure of the object in terms of how far these two areas of the object of interest are currently apart from one another.
- one of these objects is arranged in each of the sub-areas 7 .
- This arrangement 47 of precisely one object of interest in each sub-area can be based on an immune reaction, via which an object of interest is linked to the center point of the respective sub-area 7 to be scanned.
- the subsequent determination 48 of the locations of the luminescence markers in the sample 8 is carried out by scanning the partial areas 7 to be scanned with the zero point of the intensity distribution of the light that affects the emission of luminescence light through the luminescence markers, ie for example luminescence excitation light.
- the locations of the luminescence markers in the sample 8 can be determined from the intensities of the luminescence light that have been registered for the individual locations of the zero point in the sample 8 in relation to each of the partial areas 7 .
- this effect can be detected by repeating the determination 48.
- the determination 48 can be repeated several times, with these repetitions already beginning during the change 49 and also being able to continue thereafter, in order to record the dynamics of the reaction of the objects of interest to the changed environmental conditions.
- FIG. 13 shows a sample 8 in which a plurality of partial areas 7 to be scanned are arranged in a defined pattern 51 opposite fixed points 50 .
- the pattern 51 is a square pattern in which the partial areas 7 are regularly arranged in rows 52 and columns 53 .
- Each of the partial areas 7 to be scanned can be found using the fixed points 50 and approached with the zero point of the intensity distribution of the light affecting the emission of luminescent light by the luminescent markers.
- the objects of interest can be coupled in centers 54 of the partial areas 7 by the already mentioned immune reaction, so that an object of interest is arranged overlapping each of the partial areas 7 .
- 14 12 shows an object 55 of interest in a highly schematic manner, which is marked in two areas with two luminescence markers 56 and 57, which are shown differently here. What is shown is that the luminescence markers 56 and 57 are arranged at the two ends of the linear object 55 .
- 14a shows a stretched structure of the object 55 while Figure 14b a curved or folded structure of the object 55 shows.
- the change between the stretched structure according to 14a and according to the folded structure Figure 14b can be the reaction of the object 55 to changed environmental conditions, for example a changed pH value or the presence of a specific chemical substance.
- the change in the structure can be easily registered with the method according to the invention by detecting the distance between the two luminescence markers 56 and 57 .
- the positions of the two luminescence markers 56 and 57 in the sample can be determined simultaneously if the luminescence light they emit can be separated due to different wavelengths or in terms of time because the two luminescence markers 56 and 57 only temporarily emit luminescence light.
- a temporary emission of luminescent light by only one of the two luminescent markers 56 and 57, even if they are identical, can be achieved by various circumstances, for example by the luminescent markers 56 and 57 temporarily entering a dark state as a result of their excitation with luminescent excitation light or as switchable ones Luminescence markers are formed, which can be temporarily switched to a dark state with additional turn-off light.
- 15 outlines four locations 58 and 59 for a partial area 7 to be scanned, at which the zero point of the intensity distribution of the light affecting the emission of luminescence light can be arranged in order to determine the location of a single emitting luminescence marker 56, 57 in the partial area 7.
- the location 58 is at the center 54 of the sub-area 7, and the locations 59 are on a circular arc in the edge area of the sub-area 7.
- the light that affects the emission of luminescence light and that is directed onto the sample with the intensity distribution with the zero point is excitation light, i.e. that only hits the respective luminescence marker 56, 57 with low intensity, only very few photons are produced required by the respective luminescence marker 56, 57 to determine its position in the partial area 7 to determine. Even with sensitive luminescence markers, this allows a repeated position determination in order to detect reactions of the object 55 of interest to changing environmental conditions.
Landscapes
- Physics & Mathematics (AREA)
- Chemical & Material Sciences (AREA)
- General Physics & Mathematics (AREA)
- Analytical Chemistry (AREA)
- Optics & Photonics (AREA)
- Health & Medical Sciences (AREA)
- Immunology (AREA)
- Life Sciences & Earth Sciences (AREA)
- Biochemistry (AREA)
- General Health & Medical Sciences (AREA)
- Pathology (AREA)
- Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
- Engineering & Computer Science (AREA)
- Chemical Kinetics & Catalysis (AREA)
- Computer Vision & Pattern Recognition (AREA)
- General Engineering & Computer Science (AREA)
- Plasma & Fusion (AREA)
- Investigating, Analyzing Materials By Fluorescence Or Luminescence (AREA)
- Microscoopes, Condenser (AREA)
- Traffic Control Systems (AREA)
Description
Die Erfindung bezieht sich auf Verfahren zum hochaufgelösten Abbilden einer mit Lumineszenzmarkern markierten Struktur in einer Probe.The invention relates to methods for high-resolution imaging of a structure marked with luminescence markers in a sample.
Die Erfindung fällt auf das Gebiet der hochauflösenden Rasterlumineszenzlichtmikroskopie, bei der Maßnahmen getroffen werden, die es erlauben, aus der jeweiligen Probe emittiertes Lumineszenzlicht mit höherer Ortsauflösung als der Beugungsgrenze bei der Wellenlänge des Lumineszenzlichts und bei der Wellenlänge von etwaigem Anregungslicht, mit dem die Lumineszenzmarker räumlich begrenzt zur Emission von Lumineszenzlicht angeregt werden, einem Ort in der Probe zuzuordnen. Vielfach handelt es sich bei den Lumineszenzmarkern um Fluoreszenzmarker, die nach Anregung durch Anregungslicht Fluoreszenzlicht als Lumineszenzlicht emittieren. Dann spricht man von Fluoreszenzmikroskopie.The invention falls in the field of high-resolution scanning luminescence light microscopy, in which measures are taken that allow luminescence light emitted from the respective sample with higher spatial resolution than the diffraction limit at the wavelength of the luminescence light and at the wavelength of any excitation light with which the luminescence markers spatially be limited to the emission of luminescent light to be assigned to a location in the sample. The luminescence markers are often fluorescence markers which, after being excited by excitation light, emit fluorescent light as luminescence light. Then one speaks of fluorescence microscopy.
Bei bekannten Verfahren und Rasterlumineszenzlichtmikroskopen nach den Oberbegriffen der unabhängigen Patenansprüche wird zur Erhöhung der Ortsauflösung Licht, das sich auf die Emission von Lumineszenzlicht durch die Lumineszenzmarker auswirkt, mit einer Intensitätsverteilung auf die Probe gerichtet, die eine von Intensitätsmaxima benachbarte Nullstelle aufweist. Vielfach handelt es sich bei diesem Licht um Lumineszenzverhinderungslicht, mit dem die Emission von Lumineszenzlicht durch diejenigen Lumineszenzmarker verhindert wird, welche sich außerhalb der Nullstelle befinden. Das aus der Probe emittierte Lumineszenzlicht kann so dem Ort der Nullstelle zugeordnet werden, weil nur dort angeordnete Lumineszenzmarker in der Lage sind, Lumineszenzlicht zu emittieren.In known methods and scanning luminescence light microscopes, to increase spatial resolution, light affecting the emission of luminescence light by the luminescence markers is directed onto the sample with an intensity distribution that has a zero point adjacent to intensity maxima. In many cases, this light is luminescence prevention light, with which the emission of luminescence light is prevented by those luminescence markers that are located outside the zero point. The luminescence light emitted from the sample can thus be assigned to the location of the zero point, because only luminescence markers arranged there are able to emit luminescence light.
So werden bei der STED-Fluoreszenzmikroskopie zuvor mit Anregungslicht angeregte Fluoreszenzmarker mittels Stimulationslicht als Fluoreszenzverhinderungslicht bis auf diejenigen im Bereich der Nullstelle durch stimulierte Emission wieder abgeregt, so dass nur die im Bereich der Nullstelle befindlichen Fluoreszenzmarker das anschließend gemessene Fluoreszenzlicht emittiert haben können. Dieses Fluoreszenzlicht kann so dem Ort der Nullstelle in der Probe zugeordnet werden. Durch Abtasten der Probe mit der Nullstelle wird die räumliche Verteilung der Fluoreszenzmarker in der Probe bestimmt. Auf diese Weise können der Aufbau und die räumliche Verteilung einer mit den Fluoreszenzmarkern markierten Struktur in der Probe abgebildet werden.In STED fluorescence microscopy, fluorescence markers previously excited with excitation light are de-excited again by means of stimulation light as fluorescence prevention light, except for those in the area of the zero point, by stimulated emission, so that only the fluorescence markers located in the area of the zero point can have emitted the subsequently measured fluorescence light. This fluorescent light can thus be assigned to the location of the zero point in the sample. The spatial distribution of the fluorescent markers in the sample is determined by scanning the sample with the zero. In this way, the structure and the spatial distribution of a structure marked with the fluorescent markers can be imaged in the sample.
Bei der GSD-Fluoreszenzmikroskopie werden mit Fluoreszenzverhinderungslicht diejenigen Fluoreszenzmarker außerhalb des Bereichs der Nullstelle in einen elektronischen Dunkelzustand überführt und sind so durch Anregungslicht nicht zur Emission von Fluoreszenzlicht anregbar.In GSD fluorescence microscopy, those fluorescence markers outside the region of the zero point are converted to an electronic dark state with fluorescence prevention light and can thus not be excited by excitation light to emit fluorescence light.
Bei der RESOLFT-Fluoreszenzmikroskopie kommt Fluoreszenzverhinderungslicht zum Einsatz, das photochrome Fluoreszenzmarker aus einem fluoreszenten Zustand bis auf diejenigen im Bereich der Nullstelle in einen nicht fluoreszenten Zustand überführt. Bei anschließender Anregung der Fluoreszenzmarker mit Anregungslicht werden entsprechend nur die Fluoreszenzmarker im Bereich der Nullstelle der Intensitätsverteilung des Fluoreszenzverhinderungslichts von Anregungslicht zur Emission von Fluoreszenzlicht angeregt. So kann auch hier das von den Fluoreszenzmarkern aus der Probe emittierte Fluoreszenzlicht dem Ort der Nullstelle der Intensitätsverteilung des Fluoreszenzverhinderungslichts zugeordnet werden.RESOLFT fluorescence microscopy uses fluorescence-preventing light that converts photochromic fluorescent markers from a fluorescent state to a non-fluorescent state, except for those near the null. When the fluorescence markers are subsequently excited with excitation light, only the fluorescence markers in the region of the zero point of the intensity distribution of the fluorescence-preventing light are accordingly excited by the excitation light to emit fluorescent light. Here, too, the fluorescence light emitted by the fluorescence markers from the sample can be assigned to the location of the zero point of the intensity distribution of the fluorescence prevention light.
Bei allen bis hierher geschilderten Verfahren der hochauflösenden Rasterlumineszenzlichtmikroskopie besteht eine nicht unerhebliche Gefahr, die Lumineszenzmarker in der jeweiligen Probe vorübergehend oder gar dauerhaft zu bleichen, d. h. zu inaktivieren, so dass diese kein Lumineszenzlicht mehr emittieren. Diese Gefahr beruht auf der Tatsache, dass die Intensität des Lumineszenzverhinderungslichts, um alle Lumineszenzmarker außerhalb des Bereichs der Nullstelle an der Emission von Lumineszenzlicht zu hindern und um zugleich die räumlichen Abmessungen des Bereichs der Nullstelle, aus dem heraus die Lumineszenzmarker noch Lumineszenzlicht emittieren können, stark einzuengen, sehr hoch eingestellt werden muss. Das Lumineszenzverhinderungslicht wirkt mit dieser hohen Intensität bereits dann auf die Lumineszenzmarker in der Probe ein, wenn sich ihnen der Bereich der Nullstelle des Lumineszenzverhinderungslichts nähert, d. h., schon bevor sie zum ersten Mal in den Bereich der Nullstelle gelangen und damit zum ersten Mal von ihnen emittiertes Lumineszenzlicht registriert wird. Dies kann zur Folge haben, dass zum Bleichen neigende Lumineszenzmarker bei den beschriebenen Verfahren nicht eingesetzt werden können oder zumindest nicht mit sehr hohen Intensitäten des Lumineszenzverhinderungslichts, wie sie zur Maximierung der Ortsauflösung wünschenswert wären.With all the methods of high-resolution scanning luminescence light microscopy described so far, there is a not inconsiderable risk of temporarily or even permanently bleaching the luminescence markers in the respective sample, i. H. to inactivate so that they no longer emit luminescent light. This danger is due to the fact that the intensity of the luminescence-inhibiting light in order to prevent all luminescent markers outside the area of the null from emitting luminescent light and at the same time to limit the spatial dimensions of the area of the null from which the luminescent markers can still emit luminescent light is strong narrow, must be set very high. The luminescence-inhibiting light acts on the luminescence markers in the sample with this high intensity already when the region of the zero point of the luminescence-inhibiting light approaches them, i. That is, even before they reach the area of the zero point for the first time and thus the luminescent light emitted by them is registered for the first time. The consequence of this can be that luminescence markers that tend to bleach cannot be used in the methods described, or at least not with very high intensities of the luminescence-preventing light, as would be desirable for maximizing the spatial resolution.
Um der geschilderten Problematik des vorübergehenden und insbesondere des dauerhaften Bleichens bei der hochauflösenden Rasterlumineszenzlichtmikroskopie zu begegnen, sind verschiedene Ansätze verfolgt worden. Die
Zur Durchführung hochauflösender Fluoreszenzmikroskopie auch mit zum Bleichen neigenden Fluoreszenzmarkern lehrt die
Um bei der hochauflösenden Rasterlumineszenzlichtmikroskopie auch gegenüber Bleichen empfindliche Substanzen einsetzen zu können, ist es aus der
Eine Möglichkeit, die Geschwindigkeit beim Abbilden einer interessierenden Struktur einer Probe in der Rasterlumineszenzlichtmikroskopie zu erhöhen, ist es, die Probe mit mehreren Nullstellen des Lumineszenzverhinderungslichts parallel abzutasten. Dabei wird das aus der Probe emittierte Lumineszenzlicht den einzelnen Nullstellen des Lumineszenzverhinderungslichts getrennt zugeordnet. Aus der
Aus der
Aus
Aus
Aus der
Aus der
Aus der
Die
Aus der
Aus der
Aus der
Es ist die Aufgabe der Erfindung, Verfahren zum hochaufgelösten Abbilden einer mit Lumineszenzmarkern markierten Struktur in einer Probe sowie ein Rasterlumineszenzlichtmikroskop zur Durchführung solcher Verfahren aufzuzeigen, mit denen die Belastung der Lumineszenzmarker in der Probe durch hohe Lichtintensitäten grundsätzlich reduziert wird, so dass auch gegenüber hohen Lichtintensitäten empfindliche Lumineszenzmarker Verwendung finden können und eine Struktur in der jeweiligen Probe wiederholt abgebildet werden kann, um Reaktionen eines interessierenden Objekts auf veränderte Umgebungsbedingungen zu erfassen.It is the object of the invention to show methods for high-resolution imaging of a structure marked with luminescence markers in a sample and a scanning luminescence light microscope for carrying out such methods with which the exposure of the luminescent markers in the sample to high light intensities is fundamentally reduced, so that even compared to high light intensities sensitive luminescence markers can be used and a structure in the respective sample can be repeatedly imaged in order to record the reactions of an object of interest to changing environmental conditions.
Die Aufgabe der Erfindung wird durch Verfahren gemäß den unabhängigen Patentansprüchen gelöst. Die abhängigen Patentansprüche betreffen bevorzugte Ausführungsformen des ersten erfindungsgemäßen Verfahrens.The object of the invention is achieved by methods according to the independent patent claims. The dependent claims relate to preferred embodiments of the first method according to the invention.
Bei einem erfindungsgemäßen Verfahren zum hochaufgelösten Abbilden einer mit Lumineszenzmarkern markierten Struktur in einer Probe wird Licht, das sich auf die Emission von Lumineszenzlicht durch die Lumineszenzmarker auswirkt, mit einer Intensitätsverteilung auf die Probe gerichtet, die eine von Intensitätsmaxima benachbarte Nullstelle aufweist. Abzutastende Teilbereiche der Probe werden mit der Nullstelle abgetastet, und aus dem Bereich der Nullstelle emittiertes Lumineszenzlicht wird registriert und dem Ort der Nullstelle in der Probe zugeordnet. Dabei werden mehrere Exemplare eines interessierenden Objekts jeweils überschneidend mit einem der abzutastenden Teilbereiche der Probe angeordnet und die mehreren Exemplare des interessierenden Objekts werden veränderten Umgebungsbedingungen unterworfen, um hierauf erfolgende Reaktionen des interessierenden Objekts zu erfassen. Die einzelnen Teilbereiche der Probe werden während und/oder vor und nach den veränderten Umgebungsbedingungen mit der jeweiligen Nullstelle abgetastet. Abmessungen der abzutastenden Teilbereiche der Probe sind in mindestens einer Richtung und vorzugsweise in jeder Richtung, in der die Nullstelle durch die Intensitätsmaxima begrenzt ist, auf nicht mehr als 75 % eines Abstands der Intensitätsmaxima in dieser Richtung begrenzt.In a method according to the invention for high-resolution imaging of a structure marked with luminescence markers in a sample, light that affects the emission of luminescence light by the luminescence markers is directed onto the sample with an intensity distribution that has a zero point adjacent to intensity maxima. Sections of the sample to be scanned are scanned with the zero, and luminescent light emitted from the region of the zero is registered and assigned to the location of the zero in the sample. In this case, a plurality of specimens of an object of interest are each arranged so that they overlap with one of the partial regions of the sample to be scanned, and the multiple specimens of the object of interest are subjected to changed environmental conditions in order to record the reactions of the object of interest thereto. The individual sections of the sample are affected during and/or before and after the changed environmental conditions sampled at the respective zero point. Dimensions of the portions of the sample to be scanned are limited to no more than 75% of a spacing of the intensity maxima in at least one direction and preferably in any direction in which the null is bounded by the intensity maxima in that direction.
Soweit hier von Lumineszenzmarkern die Rede ist, kann es sich insbesondere um Fluoreszenzmarker handeln. Es können aber auch andere Lumineszenzmarker zum Einsatz kommen, deren Lumineszenzeigenschaften beispielsweise auf Chemilumineszenz oder Elektrolumineszenz basieren. Dies schließt ein, dass die Anregung der Lumineszenzmarker zur Emission von Lumineszenzlicht bei dem erfindungsgemäßen Verfahren nicht auf bestimmte Mechanismen festgelegt ist. Vielfach wird jedoch eine Anregung der Lumineszenzmarker zur Emission von Lumineszenzlicht durch Anregungslicht erfolgen.Insofar as luminescence markers are mentioned here, they can in particular be fluorescent markers. However, other luminescence markers can also be used whose luminescence properties are based, for example, on chemiluminescence or electroluminescence. This includes the fact that the excitation of the luminescence markers to emit luminescence light in the method according to the invention is not restricted to specific mechanisms. In many cases, however, the luminescence markers will be excited to emit luminescence light by excitation light.
Bei dem Licht, das sich auf die Emission von Lumineszenzlicht durch die Lumineszenzmarker auswirkt, kann es sich um Lumineszenzverhinderungslicht handeln, das die Emission von Lumineszenzlicht durch die Lumineszenzmarker verhindert, indem es beispielsweise die Lumineszenzmarker in einen Dunkelzustand überführt oder angeregte Lumineszenzmarker durch stimulierte Emission wieder abregt und so an der Emission von Lumineszenzlicht hindert. Bei dem Licht, das sich auf die Emission von Lumineszenzlicht durch die Lumineszenzmarker auswirkt, kann es sich aber auch um Licht handeln, das die Lumineszenzmarker aus einem nicht lumineszenten Zustand in einen weiteren nicht lumineszenten Zustand überführt, in dem sie vor Bleichen besonders gut geschützt sind. Weiterhin kann es sich bei dem Licht, das sich auf die Emission von Lumineszenzlicht durch die Lumineszenzmarker auswirkt, auch um solches handeln, das sich nicht allein sondern erst in Verbindung mit weiterem Licht so auf die Emission von Lumineszenzlicht durch die Lumineszenzmarker auswirkt, dass diese nur noch aus dem Bereich der Nullstelle der Intensitätsverteilung des Lichts erfolgt.The light that affects the emission of luminescence light by the luminescence markers can be luminescence prevention light, which prevents the emission of luminescence light by the luminescence markers, for example by converting the luminescence markers to a dark state or by de-exciting excited luminescence markers by stimulated emission and thus prevents the emission of luminescent light. However, the light that affects the emission of luminescent light by the luminescent markers can also be light that converts the luminescent markers from a non-luminescent state into another non-luminescent state in which they are particularly well protected from bleaching . Furthermore, the light that affects the emission of luminescence light by the luminescence markers can also be light that affects the emission of luminescence light by the luminescence markers not alone but only in conjunction with other light in such a way that these only still occurs from the area of the zero point of the intensity distribution of the light.
In einer anderen Ausführungsform handelt es sich bei dem Licht, das sich auf die Emission von Lumineszenzlicht durch die Lumineszenzmarker auswirkt, um Lumineszenzermöglichungslicht, das die Emission von Lumineszenzlicht durch die Lumineszenzmarker überhaupt erst ermöglicht, indem es beispielsweise die Lumineszenzmarker zur Lumineszenz anregt, also Lumineszenzanregungslicht ist, oder die Lumineszenzmarker aus einem Dunkelzustand in einen anregbaren Zustand überführt.In another embodiment, the light that affects the emission of luminescence light by the luminescence markers is luminescence-enabling light that enables the emission of luminescence light by the luminescence markers in the first place, for example by stimulating the luminescence markers to luminescence, i.e. luminescence-excitation light , or converting the luminescent markers from a dark state to an excitable state.
Bei der Nullstelle der Intensitätsverteilung des Lichts, das sich auf die Emission von Lumineszenzlicht durch die Lumineszenzmarker auswirkt, handelt es sich zumindest um ein lokales Intensitätsminimum des Lichts. Vielfach wird es sich um ein Intensitätsminimum handeln, in dem die Intensität des Lichts im Wesentlichen auf null zurückgeht. Im Idealfall geht die Intensität des Lichts im Zentrum der Nullstelle tatsächlich auf null zurück. Dies ist aber kein zwingendes Erfordernis. Wenn es sich bei dem Licht beispielsweise um Lumineszenzverhinderungslicht handelt, reicht es aus, wenn die Intensität des Lumineszenzverhinderungslichts im Bereich der Nullstelle so gering bleibt, dass sie zu keiner oder zumindest keiner wesentlichen, d. h. zumindest zu keiner überwiegenden, Verhinderung der Lumineszenz der Lumineszenzmarker führt. Die Nullstelle wird dabei durch die Bereiche begrenzt, in denen das Lumineszenzverhinderungslicht die Emission von Lumineszenzlicht durch die Lumineszenzmarker zumindest im Wesentlichen verhindert. Alles zwischen diesen Bereichen, in denen das Lumineszenzverhinderungslicht die Emission von Lumineszenzlicht durch die Lumineszenzmarker zumindest im Wesentlichen verhindert, wird hier mit "Nullstelle" oder "Bereich der Nullstelle" bezeichnet.The zero point of the intensity distribution of the light that affects the emission of luminescence light by the luminescence marker is at least a local intensity minimum of the light. There will often be an intensity minimum in which the intensity of the light essentially goes back to zero. Ideally, the intensity of the light actually goes to zero at the center of the null. However, this is not a mandatory requirement. If the light is, for example, luminescence prevention light, it is sufficient if the intensity of the luminescence prevention light in the region of the zero remains so low that it does not lead to any, or at least no significant, i. H. at least not leading to a predominant prevention of the luminescence of the luminescence markers. In this case, the zero point is delimited by the regions in which the luminescence-preventing light at least essentially prevents the emission of luminescence light by the luminescence markers. Everything between these areas, in which the luminescence-preventing light at least essentially prevents the emission of luminescent light by the luminescent markers, is referred to here as "null point" or "area of the null point".
Wenn hier von den Intensitätsmaxima, die der Nullstelle der Intensitätsverteilung des sich auf die Emission von Lumineszenzlicht durch die Lumineszenzmarker auswirkenden Lichts benachbart sind, im Plural die Rede ist, so soll hierdurch nicht der Fall ausgeschlossen sein, dass die Nullstelle von einem sich beispielsweise ringförmig um die Nullstelle erstreckenden Intensitätsmaximum umschlossen ist. In jedem Schnitt durch die Intensitätsverteilung des sich auf die Emission von Lumineszenzlicht auswirkenden Lichts zeigt sich ein solches ringförmiges Intensitätsmaximum in Form von zwei Intensitätsmaxima, die der Nullstelle in dem Schnitt auf beiden Seiten benachbart sind.If the intensity maxima, which are adjacent to the zero point of the intensity distribution of the light affecting the emission of luminescence light by the luminescence markers, are mentioned in the plural, this should not rule out the case that the zero point is, for example, ring-shaped the zero extending intensity maximum is enclosed. In each section through the intensity distribution of the light affecting the emission of luminescence light, such a ring-shaped intensity maximum is shown in the form of two intensity maxima, which are adjacent to the zero point in the section on both sides.
Die Nullstelle kann in ein, zwei oder drei Richtungen von den Intensitätsmaxima benachbart sein. Es kann sich also um eine ebenen- , linien- oder punkförmige Nullstelle handeln. Dabei kann die Nullstelle eine zwei- oder eindimensionale Probe so schneiden, dass auch eine linien- oder punktförmige Nullstelle in den Dimensionen der Probe allseitig von den Intensitätsmaxima benachbart ist. Zudem können die abzutastenden Teilbereiche der Probe mit einer Nullstelle, die nicht in allen Dimensionen der Probe von den Intensitätsmaxima benachbart ist, in unterschiedlichen Richtungen abgetastet werden, um die Ortsauflösung beim Abbilden in allen Richtungen zu maximieren. Die Beschränkung der Abmessungen der abzutastenden Teilbereiche der Probe erfolgt bei dem erfindungsgemäßen Verfahren in mindestens einer Richtung und vorzugsweise in allen Richtungen, in der/denen die Nullstelle in der Probe von den Intensitätsmaxima benachbart ist.The null can be adjacent in one, two or three directions from the intensity maxima. It can therefore be a level, line or point zero point. The zero point can intersect a two-dimensional or one-dimensional sample in such a way that a line or point zero point in the dimensions of the sample is also adjacent to the intensity maxima on all sides. In addition, the partial areas of the sample to be scanned can be scanned in different directions with a zero point that is not adjacent to the intensity maxima in all dimensions of the sample, in order to maximize the spatial resolution when imaging in all directions. In the method according to the invention, the dimensions of the partial regions of the sample to be scanned are limited in at least one direction and preferably in all directions in which the zero point in the sample is adjacent to the intensity maxima.
Die der Nullstelle in der Probe benachbarten Intensitätsmaxima sind vielfach von viel höherer Lichtintensität als die Bereiche der Intensitätsverteilung des sich auf die Emission von Lumineszenzlicht durch die Lumineszenzmarker auswirkenden Lichts, die direkt an die Nullstelle angrenzen und in denen sich das Licht bereits in der angestrebten Weise auf die Emission von Lumineszenzlicht durch die Lumineszenzmarker auswirkt, indem es diese Emission beispielsweise verhindert. Die sehr hohen Intensitäten im Bereich der Intensitätsmaxima sind Folge der insgesamt hohen Intensität des Lichts, welche wiederum Voraussetzung dafür ist, dass der Bereich der Nullstelle, in dem sich das Licht auf die Emission von Lumineszenzlicht durch die Lumineszenzmarker zumindest im Wesentlichen nicht auswirkt, stark räumlich eingegrenzt wird. In der Konsequenz verbleiben zwischen den die Nullstelle unmittelbar begrenzenden Bereichen und den Intensitätsmaxima der Intensitätsverteilung Zwischenbereiche, in denen die Lichtintensität deutlich unterhalb der Lichtintensität in den Intensitätsmaxima liegt. Diese Zwischenbereiche werden bei dem erfindungsgemäßen Verfahren gezielt genutzt, indem die Abmessungen der abgetasteten Teilbereiche der Probe 75 % des Abstands der Intensitätsmaxima in dieser Richtung nicht überschreiten. Wenn die Abmessungen der abgetasteten Teilbereiche in der jeweiligen Richtung kleiner bleiben als 50 % des Abstands der Intensitätsmaxima in der jeweiligen Richtung, wird kein Punkt der abgetasteten Teilbereiche der vollen Intensität des Lichts in den Intensitätsmaxima ausgesetzt. Aber auch schon bei einer Beschränkung auf 75 % des Abstands ergibt sich eine signifikante Beschränkung der mittleren Intensität des sich auf die Emission von Lumineszenzlicht auswirkenden Lichts, mit der die abzutastenden Teilbereiche der Probe beaufschlagt werden. Es versteht sich, dass die mittlere Intensität des Lichts, mit der die abzutastenden Teilbereiche der Probe beaufschlagt werden, umso weiter zurückgeht, desto weiter seine Abmessungen unter dem Abstand der Intensitätsmaxima in der jeweiligen Richtung bleiben. Absolut können die Abmessungen der abzutastenden Teilbereiche in der jeweiligen Richtung zwischen den Intensitätsmaxima maximal 300 nm, vorzugsweise maximal 200 nm und noch mehr bevorzugt etwa 100 nm betragen. Diese absoluten Angaben beziehen sich auf Wellenlängen des Lumineszenzlichts, des sich auf die Emission von Lumineszenzlicht durch die Lumineszenzmarker auswirkenden Lichts und/oder von etwaigem Anregungslicht im sichtbaren Bereich.The intensity maxima adjacent to the zero point in the sample are often of much higher light intensity than the areas of the intensity distribution of the light affecting the emission of luminescent light by the luminescent markers, which are directly adjacent to the zero point and in which the light is already reflected in the desired manner affects the emission of luminescent light by the luminescent markers, for example by preventing this emission. The very high intensities in the area of the maximum intensity are the result of the overall high intensity of the light, which in turn is a prerequisite for the region of the zero point in which the light has at least essentially no effect on the emission of luminescence light by the luminescence markers to be strongly spatially delimited. As a result, intermediate areas remain between the areas directly delimiting the zero point and the intensity maxima of the intensity distribution, in which the light intensity is significantly below the light intensity in the intensity maxima. These intermediate areas are used in a targeted manner in the method according to the invention, in that the dimensions of the scanned partial areas of the sample do not exceed 75% of the distance between the intensity maxima in this direction. If the dimensions of the scanned partial areas in the respective direction remain smaller than 50% of the spacing of the intensity maxima in the respective direction, no point of the scanned partial areas will be exposed to the full intensity of the light in the intensity maxima. However, even if the distance is limited to 75%, there is a significant limitation of the average intensity of the light that affects the emission of luminescent light and that is applied to the partial regions of the sample to be scanned. It goes without saying that the mean intensity of the light that is applied to the partial areas of the sample to be scanned decreases the more its dimensions remain below the distance between the intensity maxima in the respective direction. In absolute terms, the dimensions of the partial areas to be scanned in the respective direction between the intensity maxima can be a maximum of 300 nm, preferably a maximum of 200 nm and even more preferably about 100 nm. These absolute details relate to wavelengths of the luminescence light, the light affecting the emission of luminescence light by the luminescence markers and/or any excitation light in the visible range.
Bei den abzutastenden Teilbereichen der Probe kann es sich um Teilbereiche der Probe handeln, die bei einer Durchführung des erfindungsgemäßen Verfahrens allein, d. h. ausschließlich, abgetastet werden und die entsprechend auf interessierende Bereich der Probe, die mit den mehreren Exemplaren des interessierenden Objekts überlappen, ausgerichtet werden.The sub-areas of the sample to be scanned can be sub-areas of the sample which, when the method according to the invention is carried out, alone, i. H. exclusively, and which are respectively aligned to regions of interest of the sample that overlap with the multiple instances of the object of interest.
Bei dem erfindungsgemäßen Verfahren können grundsätzlich alle Exemplare des interessierenden Objekts den gleichen veränderten Umgebungsbedingungen unterworfen werden. Bevorzugt ist es jedoch, verschiedene Teilmengen der mehreren Exemplare des interessierenden Objekts in der Probe unterschiedlichen veränderten Umgebungsbedingungen zu unterwerfen. Dies ermöglicht es insbesondere, unterschiedliche Reaktionen des interessierenden Objekts auf die unterschiedlichen veränderten Umgebungsbedingungen zu erfassen und miteinander zu vergleichen. Dabei können die Reaktionen sowohl in Bezug auf das Reaktionsergebnis als auch die Reaktionsgeschwindigkeit unterschiedlich sein. Dabei erweist es sich als vorteilhaft, dass das erfindungsgemäße Verfahren auch schnellere Wiederholungen des Abtastens der abzutastenden Teilbereiche mit der Nullstelle ermöglicht.With the method according to the invention, all specimens of the object of interest can in principle be subjected to the same changed environmental conditions. However, it is preferred to subject different subsets of the multiple specimens of the object of interest in the sample to different changed environmental conditions. In particular, this makes it possible to detect and compare different reactions of the object of interest to the different changed environmental conditions. The reactions can differ both in terms of the reaction result and the reaction speed. In this context, it has proven to be advantageous that the method according to the invention also enables faster repetitions of the scanning of the partial areas to be scanned with the zero point.
Bei den Umgebungsbedingungen, denen die Exemplare des interessierenden Objekts bei dem erfindungsgemäßen Verfahren ausgesetzt werden, kann es sich um unterschiedliche physikalische Umgebungsbedingungen handeln, beispielsweise unterschiedliche Temperaturen, unterschiedliche elektrische, magnetische und elektromagnetische Felder und dergleichen. Die Umgebungsbedingungen können aber auch durch Hinzufügen einer chemischen Substanz verändert werden, also unterschiedliche chemische Umgebungsbedingungen umfassen. In einer konkreten Ausführungsform kann mit dem erfindungsgemäßen Verfahren ein Drug Screening durchgeführt werden, bei dem nach Substanzen gesucht wird, die gewünschte Reaktionen bei dem interessierenden Objekt hervorrufen. Dazu können viele Exemplare des interessierenden Objekts einzeln oder in größeren Teilmengen gegenüber unterschiedlichen Substanzen ausgesetzt werden, die auf ihre Eignung zum Hervorrufen der gewünschten Reaktion untersucht werden. Durch die hohe räumliche Auflösung des erfindungsgemäßen Verfahren ist es dabei beispielsweise möglich, räumliche Änderungen des interessierenden Objekts infolge des Einwirkens der jeweiligen Substanz zu erfassen, die mit vielen anderen Verfahren nicht oder nur indirekt und dann mit entsprechend größerem Aufwand zu erfassen sind.The environmental conditions to which the specimens of the object of interest are exposed in the method according to the invention can be different physical environmental conditions, for example different temperatures, different electric, magnetic and electromagnetic fields and the like. However, the environmental conditions can also be changed by adding a chemical substance, ie they can include different chemical environmental conditions. In a specific embodiment, the method according to the invention can be used to carry out drug screening, in which substances are searched for that cause the desired reactions in the object of interest. To this end, many specimens of the object of interest can be exposed individually or in larger subsets to different substances, which are examined for their suitability for eliciting the desired reaction. The high spatial resolution of the method according to the invention makes it possible, for example, to detect spatial changes in the object of interest as a result of the effect of the respective substance, which cannot be detected with many other methods or can only be detected indirectly and then with correspondingly greater effort.
Um beispielsweise das angesprochene Drug Screening besonders effizient durchzuführen, werden die mehreren Exemplare des interessierenden Objekts bei dem zweiten erfindungsgemäßen Verfahren in einem gegenüber Fixpunkten der Probe definierten Muster angeordnet. Dann ist es sehr effizient möglich, die abzutastenden Teilbereiche der Probe mit der Nullstelle relativ zu den Fixpunkten der Probe anzufahren. Dies kann auch vollautomatisiert geschehen. Das Anordnen der interessierenden Objekte in dem Muster kann beispielsweise mithilfe einer Immunreaktion oder dergleichen erfolgen.For example, in order to carry out the drug screening referred to particularly efficiently, the plurality of specimens of the object of interest are arranged in a pattern defined in relation to fixed points of the sample in the second method according to the invention. It is then possible very efficiently to approach the sub-areas of the sample to be scanned with the zero point relative to the fixed points of the sample. This can also be done fully automatically. Arranging the objects of interest in the pattern can be done, for example, with the help of an immune reaction or the like.
Bei dem erfindungsgemäßen Verfahren werden die abzutastenden Teilbereiche der Probe in aller Regel wiederholt mit der Nullstelle abgetastet, um die Reaktionen des interessierenden Objekts auf die sich verändernden Umgebungsbedingungen zu erfassen. Dabei ist es bevorzugt, zumindest bei einer Wiederholung des Abtastens der abzutastenden Teilbereiche der Probe, die Nullstelle an nicht mehr als 3n oder sogar nicht mehr als 2n Orten je abzutastendem Teilbereich anzuordnen, wobei n die Anzahl der Raumrichtungen ist, in denen die abzutastenden Teilbereiche der Probe abgetastet werden, um das interessierende Objekt hochaufgelöst abzubilden. Derart wenige Orte der Nullstelle sind ausreichend, um den Ort von einzelnen Lumineszenzmarkern in den einzelnen abzutastenden Teilbereichen zu erfassen, wenn das für jeden abzutastenden Teilbereich registrierte Lumineszenzlicht jeweils einem bestimmten dieser Lumineszenzmarker zugeordnet werden kann. Eine solche Zuordnung ist möglich, wenn zu jeder Zeit nur einer der Lumineszenzmarker das Lumineszenzlicht emittiert, d. h. eine zeitliche Unterscheidung möglich ist, oder wenn das Lumineszenzlicht beispielsweise aufgrund seiner Wellenlänge einzelnen Lumineszenzmarkern zugeordnet werden kann. Diese Ausführungsform des erfindungsgemäßen Verfahrens macht also von dem als MINFLUX bekannten Verfahren Gebrauch. Bei MINFLUX wird zum Bestimmen des Ortes eines einzelnen Lumineszenzmarkers in einer Ebene eine Nullstell einer Lichtintensitätsverteilung von Anregungslicht an vier verschiedenen Orten in der Probe positioniert und dazu die Intensität des Lumineszenzlichts von dem Lumineszenzmarker erfasst.In the method according to the invention, the partial areas of the sample to be scanned are usually scanned repeatedly with the zero point in order to record the reactions of the object of interest to the changing environmental conditions. It is preferred, at least when the scanning of the partial areas of the sample to be scanned is repeated, to arrange the zero point at no more than 3n or even no more than 2n locations per partial area to be scanned, where n is the number of spatial directions in which the partial areas of the sample to be scanned Sample to be scanned to image the object of interest with high resolution. Such a few null locations are sufficient to detect the location of individual luminescent markers in each sub-area to be scanned, if that is for each sub-area to be scanned registered luminescence light can each be assigned to a specific one of these luminescence markers. Such an assignment is possible if at any time only one of the luminescence markers emits the luminescence light, ie a temporal distinction is possible, or if the luminescence light can be assigned to individual luminescence markers based on its wavelength, for example. This embodiment of the method according to the invention thus makes use of the method known as MINFLUX. In MINFLUX, to determine the location of an individual luminescence marker in a plane, a zero of a light intensity distribution of excitation light is positioned at four different locations in the sample and the intensity of the luminescence light from the luminescence marker is recorded for this purpose.
Bei dem interessierenden Objekt, das in mehreren Exemplaren in der Probe angeordnet wird, kann es sich um ein Molekül, beispielsweise ein Proteinmolekül, einen Komplex, aber auch um eine komplexere biologische Einheit wie eine Synapse, eine Membran, einen anderen Zellbestandteil oder ein ganzes Virus handeln.The object of interest, which is arranged in multiple copies in the sample, can be a molecule, for example a protein molecule, a complex, but also a more complex biological entity such as a synapse, a membrane, another cell component or a whole virus act.
Die Abfolge der aufeinanderfolgenden Abtastungen der Teilbereiche mit der jeweiligen Nullstelle kann sehr schnell sein, so dass auch schnelle Veränderungen bei dem interessierenden Objekt erfasst werden können.The sequence of the successive scans of the partial areas with the respective zero point can be very fast, so that rapid changes in the object of interest can also be detected.
Die Erfindung nimmt bewusst in Kauf, dass die abgetasteten und damit abgebildeten Teilbereiche der Probe sehr klein bleiben. Vielfach erstrecken sie sich über eine Entfernung von der Größenordnung der Beugungsgrenze bei der Wellenlänge des sich auf die Emission von Lumineszenzlicht durch die Lumineszenzmarker auswirkenden Lichts. Durch die erhebliche Reduzierung der sich im Mittel auf die abgetasteten Teilbereiche auswirkenden Lichtintensitäten wird es jedoch möglich, auch relativ stark zum Bleichen neigende Lumineszenzmarker erfolgreich einzusetzen bzw. die abgetasteten Teilbereiche der Probe wiederholt mit der Nullstelle der Intensitätsverteilung abzutasten.The invention consciously accepts that the sub-areas of the sample that are scanned and thus imaged remain very small. Often they extend a distance of the order of the diffraction limit at the wavelength of light affecting the emission of luminescent light by the luminescent markers. Due to the significant reduction in the average light intensities affecting the scanned sub-areas, however, it is possible to successfully use luminescence markers that have a relatively strong tendency to bleach or to repeatedly scan the scanned sub-areas of the sample with the zero point of the intensity distribution.
Die Möglichkeit, die Probe in den Teilbereichen schnell wiederholt mit der Nullstelle der Intensitätsverteilung abzutasten, ermöglicht es auch, dynamische Vorgänge bei der interessierenden Struktur in der Probe zeitlich aufzulösen. Da die Lumineszenzmarker in der Probe durch das erfindungsgemäße Verfahren besonders wenig zum Bleichen neigen, also besonders viele Photonen von jedem einzelnen Fluoreszenzmarker in jedem abzutastenden Teilbereich der Probe erhalten werden, können besonders viele Bilder jedes abzutastenden Teilbereichs der Probe aufgenommen werden und damit auch längerfristige Veränderungen der interessierenden Struktur in der Probe beobachtet werden. In der Regel wird ein Teilbereich der Probe bei dem erfindungsgemäßen Verfahren in nicht mehr als 100 x 100 = 10.000 Bildpunkten abgetastet. Dies ist in wenigen Millisekunden möglich. Damit können Bildfrequenzen von 100 Hz und mehr realisiert werden.The possibility of quickly and repeatedly scanning the sample in the partial areas with the zero point of the intensity distribution also makes it possible to resolve dynamic processes in the structure of interest in the sample over time. Since the luminescence markers in the sample have a particularly low tendency to bleach as a result of the method according to the invention, i.e. a particularly large number of photons are obtained from each individual fluorescence marker in each partial area of the sample to be scanned, a particularly large number of images of each partial area of the sample to be scanned can be recorded and thus longer-term changes in the structure of interest can be observed in the sample. As a rule, a partial area of the sample is scanned in no more than 100×100=10,000 pixels in the method according to the invention. This is possible in a few milliseconds. This allows image frequencies of 100 Hz and more to be realized.
Bei dem erfindungsgemäßen Verfahren kann ein abzutastender Teilbereich der Probe aber auch mit nur sehr wenigen Positionen der Nullstelle in der Probe abgetastet werden, um beispielsweise die Verlagerung eines einzelnen Fluoreszenzmarkers in der Probe aufgrund von veränderten Umgebungsbedingungen zu erfassen.In the method according to the invention, a partial area of the sample to be scanned can also be scanned with only very few positions of the zero point in the sample, for example to detect the displacement of an individual fluorescent marker in the sample due to changed environmental conditions.
Vorteilhafterweise sind die Abmessungen der abzutastenden Teilbereiche der Probe in jeder Richtung, in der die Intensitätsmaxima der Nullstelle in der Probe benachbart sind, nicht größer als 45 %, 25 % oder gar 10 % des Abstands der Intensitätsmaxima in dieser Richtung. Bezogen auf die Intensität des sich auf die Emission von Lumineszenzlicht durch die Lumineszenzmarker auswirkenden Lichts ist es vorteilhaft, wenn die Abmessungen der abzutastenden Teilbereiche der Probe in jeder Richtung, in der die Intensitätsmaxima der Nullstelle in der Probe benachbart sind, nicht größer als die Strecke sind, über die die Intensität des Lichts ausgehend von der Nullstelle in der jeweiligen Richtung auf 50 %, 25 %, 10 % oder 5 % der Intensität des Lichts in den benachbarten Intensitätsmaxima ansteigt. Entsprechend wird dann auch die maximale Belastung der Lumineszenzmarker in dem abzutastenden Bereich auf 50 %, 25 %, 10 % oder 5 % der Intensität des Lichts in den angrenzenden Intensitätsmaxima beschränkt.Advantageously, the dimensions of the partial areas of the sample to be scanned are not greater than 45%, 25% or even 10% of the distance between the intensity maxima in each direction in which the intensity maxima are adjacent to the zero point in the sample. In relation to the intensity of the light affecting the emission of luminescence light by the luminescence marker, it is advantageous if the dimensions of the partial areas of the sample to be scanned are not greater than the distance in each direction in which the intensity maxima are adjacent to the zero point in the sample , over which the intensity of the light increases from the zero point in the respective direction to 50%, 25%, 10% or 5% of the intensity of the light in the adjacent intensity maxima. Correspondingly, the maximum exposure of the luminescence markers in the area to be scanned is then also limited to 50%, 25%, 10% or 5% of the intensity of the light in the adjacent intensity maxima.
Bei dem erfindungsgemäßen Verfahren ist es vielfach sinnvoll, die mit den Lumineszenzmarkern markierten Exemplare des interessierenden Objekts in der Probe vor dem Abtasten der abzutastenden Teilbereiche der Probe mit der Nullstelle auf andere Weise abzubilden, um die Lage der abzutastenden Teilbereiche der Probe festzulegen. Die abzutastenden Teilbereiche der Probe sind die Teilbereich der Probe, die mit den Exemplaren des interessierenden Objekts so überlappen, dass in ihnen besondere Details des Objekts oder auch Entwicklungen des Objekts aufgrund der geänderten Umgebungsbedingungen auftreten. Dieses Abbilden kann unter lokaler oder großflächiger Anregung der Lumineszenzmarker zur Emission von Lumineszenzlicht erfolgen.In the method according to the invention, it often makes sense to image the specimens of the object of interest in the sample marked with the luminescence markers in a different way before scanning the partial areas of the sample to be scanned with the zero point, in order to determine the position of the partial areas of the sample to be scanned. The sub-areas of the sample to be scanned are those sub-areas of the sample that overlap with the specimens of the object of interest in such a way that particular details of the object or also developments of the object due to the changed environmental conditions appear in them. This imaging can take place with local or large-area excitation of the luminescence markers to emit luminescence light.
Vor dem Abtasten der abzutastenden Teilbereiche der Probe kann auch ein größerer Bereich der Probe mit der Nullstelle mit einer um mindestens 50 % geringeren Intensität des sich auf die Emission von Lumineszenzlicht auswirkenden Lichts und/oder mit einer um mindestens 50 % höheren Abtastgeschwindigkeit abgetastet werden, um die Lage der abzutastenden Teilbereiche der Probe festzulegen. Bei diesem vorhergehenden Abtasten werden zwar alle Punkte des größeren Bereichs der Probe mit der hohen Intensität des Lichts im Bereich der Intensitätsmaxima beaufschlagt. Dafür wird aber diese Intensität gezielt zurückgenommen, und/oder sie wirkt nur über kürzere Zeit auf die Lumineszenzmarker ein.Before scanning the partial areas of the sample to be scanned, a larger area of the sample with the zero point can also be scanned with an intensity of the light affecting the emission of luminescent light that is at least 50% lower and/or with a scanning speed that is at least 50% higher in order to determine the position of the sub-areas of the sample to be scanned. In this preceding scanning, all points of the larger area of the sample are admittedly exposed to the high intensity of the light in the area of the intensity maxima. However, this intensity is deliberately reduced and/or it only acts on the luminescence markers over a shorter period of time.
In einer Ausführungsform der erfindungsgemäßen Verfahren werden zum Abtasten eines größeren Bereichs der Probe andere Abtastmittel verwendet als zum Abtasten der einzelnen abzutastenden Teilbereiche der Probe.In one embodiment of the method according to the invention, different scanning means are used for scanning a larger area of the sample than for scanning the individual partial areas of the sample to be scanned Sample.
Bei Verwendung unterschiedlicher Abtastmittel zum Abtasten des größeren Bereichs der Probe, um die abzutastenden Teilbereiche der Probe festzulegen, und zum anschließenden Abtasten der abzutastenden Teilbereiche der Probe können auf das Abtasten der einzelnen eng begrenzten abzutastenden Teilbereiche der Probe speziell abgestimmte Abtastmittel zum Einsatz kommen. Aufgrund der geringen Abmessungen der abzutastenden Teilbereiche in der Probe können dies Abtastmittel sein, die keine großen Verlagerungen der Lichtintensitätsverteilung mit der Nullstelle ermöglichen, die aber die von ihnen abdeckbaren Verlagerungen sehr schnell und/oder präzise umsetzen. So kann ein sehr schnell wiederholtes Abtasten der abzutastenden Teilbereiche erfolgen, um beispielsweise schnelle Veränderungen der interessierenden Objekte in den Teilbereichen zu verfolgen.If different scanning means are used to scan the larger area of the sample in order to define the sub-areas of the sample to be scanned, and for the subsequent scanning of the sub-areas of the sample to be scanned, scanning means that are specially tailored to the scanning of the individual, narrowly defined sub-areas of the sample to be scanned can be used. Due to the small dimensions of the sub-areas in the sample to be scanned, these can be scanning means that do not allow large shifts in the light intensity distribution with the zero point, but that convert the shifts that they can cover very quickly and/or precisely. In this way, the partial areas to be scanned can be scanned very quickly, for example in order to track rapid changes in the objects of interest in the partial areas.
Konkret kann zum Abtasten des größeren Bereichs der Probe in mindestens einer Richtung eine Probenhalterung für die Probe relativ zu einem Objektiv bewegt werden, mit dem das Licht auf die Probe gerichtet wird, während zum Abtasten der einzelnen abzutastenden Teilbereiche der Probe in mindestens einer Richtung ein elektro-optischer Scanner, ein akusto-optischer Deflektor oder ein Galvospiegel, d.h. ein Ablenkspiegel mit Galvanometerantrieb, verwendet wird. Die Einrichtung zum Abtasten der einzelnen abzutastenden Teilbereiche der Probe kann mit einem zusätzlichen elektro-optischen oder akusto-optischen Modulator als Phasenschieber zur Verlagerung der Nullstelle der Lichtintensitätsverteilung kombiniert werden.Specifically, to scan the larger area of the sample in at least one direction, a sample holder for the sample can be moved relative to a lens with which the light is directed onto the sample, while an electro -optical scanner, an acousto-optical deflector or a galvo mirror, i.e. a deflecting mirror with galvanometer drive is used. The device for scanning the individual partial areas of the sample to be scanned can be combined with an additional electro-optical or acousto-optical modulator as a phase shifter for shifting the zero point of the light intensity distribution.
Wie schon angesprochen wurde, kann es sich bei dem sich auf die Emission von Lumineszenzlicht durch die Lumineszenzmarker auswirkenden Licht insbesondere um Lumineszenzverhinderungslicht handeln, das außerhalb der Nullstelle die Emission von Lumineszenzlicht durch die Lumineszenzmarker verhindert. Beispielsweise überführt oder schaltet das Lumineszenzverhinderungslicht Lumineszenzmarker in Form von schaltbaren Proteinen in einen Dunkelzustand, in dem sie nicht zur Emission von Lumineszenzlicht anregbar sind. Das Lumineszenzverhinderungslicht kann insbesondere zusammen mit Anregungslicht auf die Probe gerichtet werden, das die Lumineszenzmarker zur Emission von Lumineszenzlicht anregt und das eine Intensitätsverteilung mit einem Intensitätsmaximum im Bereich der Nullstelle des Lumineszenzverhinderungslichts aufweist. Dies entspricht bis auf die engen Grenzen für die abzutastenden Teilbereiche der Probe dem üblichen Vorgehen bei der STED-, RESOLFT- oder GSD-Fluoreszenzlichtmikroskopie.As already mentioned, the light affecting the emission of luminescence light by the luminescence markers can be, in particular, luminescence prevention light, which prevents the emission of luminescence light by the luminescence markers outside the zero point. For example, the luminescence-preventing light converts or switches luminescent markers in the form of switchable proteins into a dark state in which they cannot be excited to emit luminescent light. The luminescence prevention light can be directed onto the sample, in particular together with excitation light, which excites the luminescence markers to emit luminescence light and which has an intensity distribution with an intensity maximum in the region of the zero point of the luminescence prevention light. Except for the narrow limits for the sub-areas of the sample to be scanned, this corresponds to the usual procedure in STED, RESOLFT or GSD fluorescence light microscopy.
Bei dem ersten erfindungsgemäßen Verfahrens wird das aus der
Die Intensitätsverteilung des Ausschaltlichts kann in dem jeweils anschließend abzutastenden Teilbereich ein durch destruktive Interferenz ausgebildetes lokales Intensitätsminimum aufweisen, in dem sie die Lumineszenzmarker zumindest im Wesentlichen nicht ausschaltet, d. h., in dem sie die Lumineszenzmarker zumindest im Wesentlichen in ihrem aktiven Zustand belässt, in dem sie durch das Anregungslicht anregbar sind. Je nach Auswahl der schaltbaren Lumineszenzmarker kann es dieser aktive Zustand erfordern oder zumindest sinnvoll machen, dass vor und/oder zeitlich überlappend mit dem Richten des Ausschaltlichts auf die Probe Einschaltlicht auf den jeweils abzutastenden Teilbereich der Probe gerichtet wird, das die schaltbaren Lumineszenzmarker in ihren aktiven Zustand einschaltet.The intensity distribution of the switch-off light can have a local intensity minimum formed by destructive interference in the sub-area to be scanned subsequently, in which it at least essentially does not switch off the luminescence markers, i. i.e. by leaving the luminescence markers at least essentially in their active state, in which they can be excited by the excitation light. Depending on the selection of the switchable luminescence markers, this active state may require or at least make it useful that before and/or with a time overlap with the direction of the turn-off light onto the sample, turn-on light is directed onto the respective sub-area of the sample to be scanned, which switches the switchable luminescence markers into their active state turns on.
Beim Einschalten und/oder Ausschalten emittieren schaltbare Lumineszenzmarker vielfach ebenfalls Lumineszenzlicht. Dieses Lumineszenzlicht kann bei dem erfindungsgemäßen Verfahren registriert und ausgewertet werden. Ziel dieser Auswertung kann beispielsweise eine Entscheidung darüber sein, ob der von dem jeweils angrenzenden Teilbereich begrenzte abzutastende Teilbereich überhaupt mit der Nullstelle abgetastet wird oder ob er nur insgesamt mit Anregungslicht beaufschlagt wird, wobei das dann emittierte Lumineszenzlicht konfokal registriert wird, oder ob er gar nicht mit Anregungslicht beaufschlagt wird, weil die geringe Intensität des beim Einschalten und/oder Ausschalten registrierten Lumineszenzlichts darauf hinweist, dass keine relevante Konzentration an Lumineszenzmarkern in dem jeweiligen abzutastenden Teilbereich vorliegt. Weiter kann die Auswertung das Ziel haben, festzulegen, unter welchen Bedingungen das Richten des Stimulationslichts auf die Probe in jeder Position der Nullstelle in dem von den angrenzenden Teilbereichen begrenzten abzutastenden Teilbereichen und das Registrieren des aus dem Bereich der Nullstelle emittierten Lumineszenzlichts sinnvollerweise abgebrochen wird. Das heißt, es kann zum Beispiel ein oberer und/oder unterer Grenzwert für die Durchführung eines RESCue-Verfahrens in dem jeweiligen abzutastenden Teilbereich abhängig von dem Ergebnis der Auswertung festgelegt werden.When switched on and/or off, switchable luminescence markers often also emit luminescence light. This luminescent light can be registered and evaluated in the method according to the invention. The aim of this evaluation can be, for example, a decision as to whether the sub-area to be scanned, which is delimited by the respective adjacent sub-area, is even scanned with the zero point or whether it is only exposed to excitation light in its entirety, with the luminescence light then emitted being registered confocally, or whether it is not at all is applied with excitation light because the low intensity of the luminescence light registered when switching on and / or off indicates that no relevant concentration of luminescence markers in the respective part to be scanned is present. The evaluation can also have the aim of determining under which conditions the directing of the stimulation light onto the sample in each position of the zero point in the sub-areas to be scanned and the registration of the luminescence light emitted from the area of the zero point is meaningfully broken off. This means that, for example, an upper and/or lower limit value for carrying out a RESCue method in the respective sub-area to be scanned can be defined as a function of the result of the evaluation.
In einer speziellen Ausführungsform der erfindungsgemäßen Verfahren wird aus dem Bereich der Nullstelle emittiertes Lumineszenzlicht mit einem Punktsensor registriert, dessen Lage gegenüber der Probe beim Abtasten des jeweiligen abzutastenden Teilbereichs der Probe nicht verändert wird. Das heißt, beim Registrieren des Lumineszenzlichts mit dem Punktsensor wird die Lageveränderung der Nullstelle der Lichtintensitätsverteilung des sich auf die Emission von Lumineszenzlicht durch die Lumineszenzmarker auswirkenden Lichts nicht berücksichtigt. Dies ist möglich, weil die Abmessungen der abzutastenden Teilbereiche regelmäßig kleiner als der Erfassungsbereich eines Punktsensors bezogen auf die Probe sind. Dies gilt auch für einen zum Mittelpunkt des jeweiligen abzutastenden Teilbereichs konfokal angeordneten Punktsensor. Selbst diesen erreicht regelmäßig das Lumineszenzlicht aus dem gesamten abzutastenden Teilbereich der Probe, weil dessen Abmessungen regelmäßig unterhalb der Beugungsgrenze bei der Wellenlänge des Lumineszenzlichts liegen. Der lagefeste Punktsensor bedeutet, dass die Nullstelle zum Abtasten des jeweiligen abzutastenden Teilbereichs der Probe durch Einwirken allein auf das sich auf die Emission von Lumineszenzlicht durch die Lumineszenzmarker auswirkende Licht verlagert wird. Auch etwaiges Anregungslicht muss nicht zusammen mit dem sich auf die Emission von Lumineszenzlicht durch die Lumineszenzmarker auswirkenden Licht verlagert werden, da sich auch sein Intensitätsmaximum typischerweise über den gesamten abzutastenden Teilbereich der Probe erstreckt.In a special embodiment of the method according to the invention, luminescence light emitted from the area of the zero point is registered with a point sensor whose position relative to the sample is not changed when scanning the respective partial area of the sample to be scanned. That is, when registering the luminescent light with the point sensor, the change in position of the zero point of the light intensity distribution of the light affecting the emission of luminescent light by the luminescent markers is not taken into account. This is possible because the dimensions of the partial areas to be scanned are regularly smaller than the detection area of a point sensor in relation to the sample. This also applies to a point sensor arranged confocally to the center point of the respective partial area to be scanned. The luminescent light from the entire partial area of the sample to be scanned regularly even reaches this, because its dimensions are regularly below the diffraction limit at the wavelength of the luminescent light. The positionally fixed point sensor means that the zero point for scanning the respective partial area of the sample to be scanned is shifted by acting solely on the light affecting the emission of luminescence light by the luminescence markers. Any excitation light does not have to be shifted together with the light affecting the emission of luminescence light by the luminescence marker, since its intensity maximum also typically extends over the entire partial area of the sample to be scanned.
Wie ebenfalls schon angesprochen wurde, kann es sich bei dem sich auf die Emission von Lumineszenzlicht durch die Lumineszenzmarker auswirkenden Licht alternativ um Lumineszenzermöglichungslicht handeln, das außerhalb der Nullstelle die Emission von Lumineszenzlicht durch die Lumineszenzmarker überhaupt erst ermöglicht. Dies schließt ein, dass es sich bei dem Licht um Lumineszenzanregungslicht als einziges Licht handelt, das auf die Probe gerichtet wird. Es schließt auch ein, dass das Licht Lumineszenzaktivierungslicht ist, das die Lumineszenzmarker aus einem Dunkelzustand in einen zur Lumineszenz anregbaren Zustand überführt, d. h. aktiviert. Das Licht, das sich auf die Emission von Lumineszenzlicht durch die Lumineszenzmarker auswirkt, kann auch beide Funktionen, d. h. des Aktivierens und des Anregens, haben und dazu auch zwei Komponenten unterschiedlicher Wellenlängen aufweisen. Wenn dann ein Teilbereich der Probe mit der Nullstelle der Intensitätsverteilung des Lichts, das sich auf die Emission von Lumineszenzlicht durch die Lumineszenzmarker auswirkt, abgetastet wird, wird dieser Teilbereich erfindungsgemäß klein gehalten, um die in dem Teilbereich befindlichen Lumineszenzmarker nicht oder doch zumindest möglichst wenig mit den hohen Lichtintensitäten im Bereich der an die Nullstelle angrenzenden Intensitätsmaxima zu beaufschlagen. Das Erfassen des von den Lumineszenzmarkern in der Probe emittierten Lumineszenzlichts erfolgt bei dieser Ausführungsform des erfindungsgemäßen Verfahrens typischerweise mit einer Kamera, und die Auswertung erfolgt durch Entfalten der registrierten Intensitätsverteilungen im Hinblick auf die aktuelle Lage der Nullstelle in der Probe und der damit verbundenen Änderung der Intensitätsverteilung des aus der Probe emittierten und mit der Kamera erfassten Lumineszenzlichts.As has also already been mentioned, the light affecting the emission of luminescence light by the luminescence markers can alternatively be luminescence-enabling light, which enables the emission of luminescence light by the luminescence markers outside the zero point in the first place. This implies that the light is luminescence excitation light as the only light that is directed onto the sample. It also includes that the light is luminescent activation light, which converts the luminescent markers from a dark state to a luminescent excitable state, ie. H. activated. The light affecting the emission of luminescent light by the luminescent markers can also have both functions, i. H. of activation and excitation, and also have two components of different wavelengths. If a sub-area of the sample with the zero point of the intensity distribution of the light that affects the emission of luminescence light by the luminescence markers is scanned, this sub-area is kept small according to the invention so that the luminescence markers located in the sub-area are not involved, or at least as little as possible to apply the high light intensities in the area of the intensity maxima adjacent to the zero point. In this embodiment of the method according to the invention, the luminescence light emitted by the luminescence markers in the sample is typically detected with a camera, and the evaluation is carried out by unfolding the registered intensity distributions with regard to the current position of the zero point in the sample and the associated change in the intensity distribution of the luminescent light emitted from the sample and captured by the camera.
Wenn in den abzutastenden Teilbereichen jeweils nur ein Lumineszenzmarker das erfasste Lumineszenzlicht aus der Probe emittiert, kann dessen Position in der Probe auch sehr einfach aus dem für die verschiedenen Orte der Nullstelle registrierten Lumineszenzlicht ermittelt werden, beispielsweise durch Anfitten einer ein lokales Extremum aufweisenden Funktion, wobei der Ort des Extremums der angefitteten Funktion der gesuchten Position des Lumineszenzmarkers gleichgesetzt wird. Dieses Vorgehen ist sowohl dann möglich, wenn es sich bei dem Licht, das sich auf die Emission von Lumineszenzlicht durch die Lumineszenzmarker auswirkt und dessen Intensitätsverteilung die Nullstelle aufweist, Lumineszenzverhinderungslicht ist, als auch dann, wenn es sich hierbei um Lumineszenzermöglichungs- oder Anregungslicht handelt. Im ersten Fall wird durch die an die Nullstelle angrenzenden Intensitätsmaxima des Lumineszenzverhinderungslichts in vorteilhafter Weise verhindert, dass von in der Nähe befindlichen anderen Lumineszenzmarkern emittiertes Lumineszenzlicht die Positionsbestimmung stört. Im zweiten Fall wird der jeweilige Lumineszenzmarker in dem abzutastenden Teilbereich nur mit einer minimalen Lichtmenge beaufschlagt und dadurch nur minimal photochemisch belastet.If only one luminescence marker emits the detected luminescence light from the sample in the partial areas to be scanned, its position in the sample can also be determined very easily from the luminescence light registered for the various locations of the zero point, for example by fitting a function having a local extremum, where the location of the extremum of the fitted function is equated to the position of the luminescence marker sought. This procedure is possible both when the light that affects the emission of luminescence light by the luminescence markers and whose intensity distribution has the zero point is luminescence-preventing light and when it is luminescence-enabling light or excitation light. In the first case, the intensity maxima of the luminescence prevention light adjacent to the zero point advantageously prevent luminescence light emitted by other luminescence markers in the vicinity from interfering with the position determination. In the second case, the respective luminescence marker in the partial area to be scanned is only exposed to a minimal amount of light and is therefore only minimally photochemically stressed.
Der Nachteil der erfindungsgemäßen Verfahren, dass der abgetastete und damit abgebildete Teilbereich der Probe jeweils sehr klein bleibt, kann zumindest teilweise dadurch kompensiert werden, dass die Probe in mehreren Teilbereichen zugleich abgetastet wird. Dabei kann insbesondere ein Raster von Nullstellen des sich auf die Emission von Lumineszenzlicht durch die Lumineszenzmarker auswirkenden Lichts zum Einsatz kommen, wie es grundsätzlich bekannt ist. Dabei wird das Raster der Nullstellen erfindungsgemäß aber nicht so weit verschoben, dass die Probe insgesamt abgebildet wird, d. h. über das volle Rastermaß. Vielmehr bleiben die einzelnen Teilbereiche, in denen die Probe abgetastet wird, auch bei dieser Ausführungsform des erfindungsgemäßen Verfahrens voneinander getrennt. Nur so wird die erfindungsgemäße Reduktion der Gefahr des Bleichens der Lumineszenzmarker in den abgetasteten Teilbereichen der Probe erreicht. Es versteht sich, dass dann, wenn diese parallelisierte Ausführungsform der Erfindung mit schaltbaren Lumineszenzmarkern durchgeführt wird, die jeweils nur in den abzutastenden Teilbereichen der Probe in ihrem fluoreszenten Zustand sind, die Probe ergänzend auch mit den abzutastenden Teilbereichen abgetastet werden kann, um sie vollständig abzubilden.The disadvantage of the method according to the invention, that the sampled and thus imaged partial area remains very small, can be at least partially compensated for by the sample being scanned in several partial areas at the same time. In particular, a grid of zero points of the light affecting the emission of luminescence light by the luminescence marker can be used, as is fundamentally known. According to the invention, however, the grid of the zero points is not shifted so far that the sample is imaged as a whole, ie over the full grid dimension. Rather, the individual partial areas in which the sample is scanned also remain in this embodiment of the invention procedures separately. This is the only way to reduce the risk of bleaching of the luminescence markers in the scanned partial areas of the sample according to the invention. It goes without saying that if this parallelized embodiment of the invention is carried out with switchable luminescence markers, which are only in their fluorescent state in the partial areas of the sample to be scanned, the sample can also be scanned with the partial areas to be scanned in order to image them completely .
Da bei dem erfindungsgemäßen Verfahren mehrere Exemplare des interessierenden Objekts jeweils überschneidend mit einem der mehreren abzutastenden Teilbereiche der Probe angeordnet werden, wird beim Abtasten jedes Teilbereichs ein Teilbild dieses Objekts gewonnen. Wenn diese Teilbilder statistisch über das Objekt verteilt sind und ihre Zahl ausreichend groß ist, kann aus ihnen ein Abbild des gesamten interessierenden Objekts rekonstruiert werden. Es versteht sich, dass dies voraussetzt, dass die verschiedenen Exemplare des interessierenden Objekts zumindest weitgehend übereinstimmen. Zur Zuordnung der Teilbilder zu bestimmten Punkten des interessierenden Objekts können die Exemplare des interessierenden Objekts in der Probe zusätzlich auf andere Weise abgebildet werden, um ihre Lage und Ausrichtung gegenüber den abgetasteten Teilbereichen der Probe zu bestimmen.Since, in the method according to the invention, a plurality of specimens of the object of interest are arranged in each case overlapping with one of the plurality of partial areas of the sample to be scanned, a partial image of this object is obtained when each partial area is scanned. If these partial images are statistically distributed over the object and their number is large enough, an image of the entire object of interest can be reconstructed from them. It goes without saying that this assumes that the different specimens of the object of interest are at least largely the same. In order to allocate the partial images to specific points of the object of interest, the specimens of the object of interest in the sample can also be imaged in a different way in order to determine their position and orientation relative to the scanned partial areas of the sample.
Ein Rasterlumineszenzlichtmikroskop zur Durchführung des erfindungsgemäßen Verfahrens weist eine Lichtquelle für das Licht, das sich auf die Emission von Lumineszenzlicht durch die Lumineszenzmarker auswirkt, Lichtformungsmittel, die das Licht mit der Intensitätsverteilung auf die Probe richten, welche die von den Intensitätsmaxima benachbarte Nullstelle aufweist, Abtastmittel, um einen abzutastenden Teilbereich der Probe mit der Nullstelle abzutasten, einen Detektor, der aus dem Bereich der Nullstelle emittiertes Lumineszenzlicht registriert, und eine Steuerung zur Durchführung der erfindungsgemäßen Verfahren auf.A scanning luminescence light microscope for carrying out the method according to the invention has a light source for the light which affects the emission of luminescence light by the luminescence markers, light shaping means which direct the light with the intensity distribution onto the sample which has the zero point adjacent to the intensity maxima, scanning means, in order to scan a partial area of the sample to be scanned with the zero point, a detector which registers luminescence light emitted from the area of the zero point, and a controller for carrying out the method according to the invention.
Der Detektor kann ein Punktdetektor sein, wobei die Lage des Punktdetektors gegenüber der Probe beim Abtasten des abzutastenden Teilbereichs der Probe fest sein kann, d. h. das aus der Probe emittierte Lumineszenzlicht erfassen kann, ohne dass dieses entscannt wird, weil der abzutastende Teilbereich in der Regel Abmessungen unterhalb der Beugungsgrenze aufweist. Dann können weitere Abtastmittel vorhanden sein, die sich von den Abtastmitteln zum Abtasten des abzutastenden Teilbereichs der Probe mit der Nullstelle unterscheiden und zum Abtasten eines größeren Bereichs der Probe vorgesehen sind.The detector may be a point detector, where the location of the point detector relative to the sample when scanning the sample portion to be scanned may be fixed, i. H. can detect the luminescence light emitted from the sample without it being descanned, because the partial area to be scanned usually has dimensions below the diffraction limit. Further scanning means can then be present, which differ from the scanning means for scanning the partial area of the sample to be scanned with the zero point and are provided for scanning a larger area of the sample.
Auch hier können die Abtastmittel zum Abtasten des größeren Bereichs der Probe in mindestens einer Richtung eine relativ zu einem Objektiv der Lichtformungsmittel bewegliche Probenhalterung aufweisen, während die Abtastmittel zum Abtasten des abzutastenden Teilbereichs der Probe in mindestens einer Richtung einen elektro-optischen Scanner, einen akusto-optischer Deflektor oder einen Galvospiegel umfassen können.Here, too, the scanning means for scanning the larger area of the sample in at least one direction can have a sample holder that can be moved relative to an objective of the light-shaping means, while the scanning means for scanning the partial area of the sample to be scanned in at least one direction have an electro-optical scanner, an acoustic optical deflector or a galvo mirror.
Der Detektor kann aber beispielsweise auch ein Punktdetektor sein, der das entscannte Lumineszenzlicht von der Probe erfasst, oder ein flächiger Detektor, wie eine Kamera, der das nicht entscannte Lumineszenzlicht aus einer festen Relativposition zu der Probe erfasst.However, the detector can also be a point detector, for example, which captures the unscanned luminescence light from the sample, or a flat detector, such as a camera, which captures the unscanned luminescence light from a fixed position relative to the sample.
Bei einem Rasterlumineszenzlichtmikroskop zur Durchführung eines erfindungsgemäßen STED-Verfahrens ist das von der Lichtquelle bereitgestellte Licht Stimulationslicht, und es ist eine weitere Lichtquelle für Anregungslicht vorgesehen, wobei die Lichtformungsmittel das Anregungslicht mit einer Lichtintensitätsverteilung auf die Probe richten, die ein Maximum im Bereich der Nullstelle des Lumineszenzverhinderungslichts aufweist.In a scanning luminescence light microscope for carrying out a STED method according to the invention, the light provided by the light source is stimulating light, and a further light source is provided for stimulating light, with the light-shaping means directing the stimulating light onto the sample with a light intensity distribution which has a maximum in the region of the zero point of the Having luminescence prevention light.
Zur Durchführung des erfindungsgemäßen Verfahrens, das von schaltbaren Lumineszenzmarkern Gebrauch macht, ist bei dem Rasterlumineszenzlichtmikroskop zusätzlich eine Ausschaltlichtquelle für Ausschaltlicht vorzusehen, wobei die Lichtformungsmittel das Ausschaltlicht mit einer solchen Intensitätsverteilung auf die Probe richten, dass es die schaltbaren Lumineszenzmarker in einem an den abzutastenden Teilbereich angrenzenden Teilbereich der Probe in einen inaktiven Zustand ausschaltet. Der angrenzende Teilbereich grenzt dabei in der mindestens einen Richtung, in der die Intensitätsmaxima der Nullstelle des Stimulationslichts in der Probe benachbart sind, an den abzutastenden Teilbereich an. Darüber hinaus kann eine Einschaltlichtquelle für Einschaltlicht vorgesehen sein, das die schaltbaren Lumineszenzmarker in ihren aktiven Zustand einschaltet, wobei die Lichtformungsmittel das Einschaltlicht vor und/oder zeitlich überlappend mit dem Richten des Ausschaltlichts auf die Probe auf einen den abzutastenden Teilbereich umfassenden Teilbereich der Probe richten.To carry out the method according to the invention, which makes use of switchable luminescence markers, a switch-off light source for switch-off light must also be provided in the scanning luminescence light microscope, with the light-shaping means directing the switch-off light onto the sample with such an intensity distribution that the switchable luminescence markers are in a sub-area adjacent to the area to be scanned portion of the sample turns off to an inactive state. The adjoining sub-area borders on the sub-area to be scanned in the at least one direction in which the intensity maxima are adjacent to the zero point of the stimulation light in the sample. In addition, a switch-on light source can be provided for switch-on light, which switches the switchable luminescence markers on to their active state, with the light-shaping means directing the switch-on light to a sub-area of the sample that encompasses the sub-area to be scanned before and/or with a temporal overlap with the direction of the switch-off light onto the sample.
Bei experimentellen Erprobungen des erfindungsgemäßen Verfahrens wurde eine Erhöhung der Ausbeute der Photonen von den Lumineszenzmarkern in der Probe um einen Faktor > 100 erzielt. Dies z. B. bedeutet, dass 100 mal mehr Bilder einer sich verändernden interessierenden Struktur aufgenommen werden können, um die Veränderungen zu dokumentieren. Für jedes einzelne Bild wird zudem weniger Zeit benötigt, weil auch anhaltend mehr Photonen pro Zeiteinheit von den Lumineszenzmarkern in der Probe emittiert werden.In experimental tests of the method according to the invention, an increase in the yield of the photons from the luminescence markers in the sample by a factor of >100 was achieved. This z. B. means that 100 times more images of a changing structure of interest can be taken to document the changes. In addition, less time is required for each individual image because more and more photons per unit of time are emitted by the luminescence markers in the sample.
Vorteilhafte Weiterbildungen der Erfindung ergeben sich aus den Patentansprüchen, der Beschreibung und den Zeichnungen. Die in der Beschreibung genannten Vorteile von Merkmalen und von Kombinationen mehrerer Merkmale sind lediglich beispielhaft und können alternativ oder kumulativ zur Wirkung kommen, ohne dass die Vorteile zwingend von erfindungsgemäßen Ausführungsformen erzielt werden müssen.Advantageous developments of the invention result from the patent claims, the description and the drawings. The advantages of features and combinations of several features mentioned in the description are merely exemplary and can have an effect alternatively or cumulatively without the advantages necessarily having to be achieved by embodiments according to the invention.
Die in den Patentansprüchen enthaltenen Bezugszeichen stellen keine Beschränkung des Umfangs der durch die Patentansprüche geschützten Gegenstände dar. Sie dienen lediglich dem Zweck, die Patentansprüche leichter verständlich zu machen.The reference signs contained in the claims do not constitute a limitation of the scope of the subject matter protected by the claims They only serve the purpose of making the patent claims easier to understand.
Im Folgenden wird die Erfindung anhand in den Figuren dargestellter bevorzugter Ausführungsbeispiele weiter erläutert und beschrieben.
- Fig. 1
- zeigt schematisch Intensitätsverteilungen von Anregungslicht und von Fluoreszenzverhinderungslicht als Beispiel für Licht, das sich auf die Emission von Lumineszenzlicht durch in einer Probe angeordnete Lumineszenzmarker auswirkt, sowie die resultierende effektive Anregung von Fluoreszenzmarkern in einer Probe zur Emission von Fluoreszenzlicht.
- Fig. 2
- zeigt für die Intensitätsverteilung des Fluoreszenzverhinderungslichts gemäß
Fig. 1 Abmessungen eines mit den Intensitätsverteilungen gemäßFig. 1 bei einem erfindungsgemäßen Verfahren abzutastenden Teilbereichs einer Probe. - Fig. 3
- ist eine schematische Darstellung eines abzutastenden Teilbereichs einer Probe in einer Draufsicht, wobei das Abtasten längs einer mäanderförmigen Bahn erfolgt.
- Fig. 4
- ist eine schematische Darstellung eines abzutastenden Teilbereichs einer Probe in einer Draufsicht, wobei das Abtasten längs einer Spiralbahn erfolgt.
- Fig. 5
- illustriert schematisch ein Fluoreszenzmikroskop als Beispiel für ein Rasterlumineszenzlichtmikroskop zur Durchführung des erfindungsgemäßen Verfahrens.
- Fig. 6
- zeigt (a) ein vorab aufgenommenes Konfokalbild einer Probe und (b) ein Teilbild der Probe, das erfindungsgemäß aufgenommen wurde, nachdem einzelne abzutastende Teilbereiche der Probe anhand des Konfokalbilds ausgewählt wurden.
- Fig. 7
- zeigt die Abhängigkeit zwischen der Anzahl der aufnehmbaren Bilder und den Abmessungen eines abgetasteten Teilbereichs der Probe.
- Fig. 8
- zeigt schematisch ein anderes Fluoreszenzmikroskop als in
Fig. 5 als weiteres Beispiel für ein Rasterlumineszenzlichtmikroskop zur Durchführung des erfindungsgemäßen Verfahrens. - Fig. 9
- ist eine schematische Darstellung eines abzutastenden Teilbereichs einer Probe bei gleichzeitiger Darstellung eines angrenzenden Teilbereichs, in dem mit dem Rasterfluoreszenzmikroskop Ausschaltlicht auf die Probe gerichtet wird.
- Fig. 10
- illustriert eine Anordnung mehrerer abzutastender Teilbereiche gemäß
Fig. 9 in der Probe, um diese mit den abzutastenden Teilbereichen abzutasten. - Fig. 11
- illustriert eine andere Anordnung abzutastender Teilbereiche in der Probe.
- Fig. 12
- ist ein Blockdiagramm zu einer Ausführungsform des erfindungsgemäßen Verfahrens.
- Fig. 13
- illustriert die Anordnung von abzutastenden Teilbereichen in einer Probe bei dem erfindungsgemäßen Verfahren gemäß
Fig. 12 . - Fig. 14
- illustriert schematisch eine Reaktion eines interessierenden Objekts auf sich verändernde Umgebungsbedingungen; und
- Fig. 15
- erläutert die Anordnung einer Nullstelle an nur wenigen Orten der Probe beim Antasten eines abzutastenden Teilbereichs.
- 1
- FIG. 12 schematically shows intensity distributions of excitation light and fluorescence-preventing light as an example of light affecting emission of luminescence by luminescence markers arranged in a sample and the resulting effective excitation of fluorescent markers in a sample to emit fluorescent light.
- 2
- shows for the intensity distribution of the fluorescence prevention light according to FIG
1 Dimensions of one with the intensity distributions according to1 part of a sample to be scanned in a method according to the invention. - 3
- FIG. 12 is a schematic representation of a partial area of a sample to be scanned in a plan view, with the scanning taking place along a meandering path.
- 4
- FIG. 12 is a schematic representation of a partial area of a sample to be scanned in a plan view, the scanning taking place along a spiral path.
- figure 5
- schematically illustrates a fluorescence microscope as an example of a scanning luminescence light microscope for carrying out the method according to the invention.
- 6
- shows (a) a previously recorded confocal image of a sample and (b) a partial image of the sample that was recorded according to the invention after individual partial areas of the sample to be scanned were selected using the confocal image.
- 7
- shows the relationship between the number of images that can be recorded and the dimensions of a scanned partial area of the sample.
- 8
- shows a different fluorescence microscope than in FIG
figure 5 as a further example of a scanning luminescence light microscope for carrying out the method according to the invention. - 9
- is a schematic representation of a partial area of a sample to be scanned with a simultaneous representation of an adjacent partial area in which switched-off light is directed onto the sample with the scanning fluorescence microscope.
- 10
- illustrates an arrangement of several partial areas to be scanned according to FIG
9 in the sample in order to scan it with the partial areas to be scanned. - 11
- illustrates a different arrangement of sub-areas in the sample to be scanned.
- 12
- is a block diagram of an embodiment of the method according to the invention.
- 13
- illustrates the arrangement of partial areas to be scanned in a sample in accordance with the method according to the
invention 12 . - 14
- schematically illustrates a response of an object of interest to changing environmental conditions; and
- 15
- explains the arrangement of a zero at only a few locations on the sample when probing a sub-area to be scanned.
In
Wenn sich die Nullstelle 4 beim Abtasten einer Probe einer mit Fluoreszenzfarbstoff markierten interessierenden Struktur annähert, gelangen die Fluoreszenzmarker zunächst in den Bereich der Intensitätsmaxima 3 und der damit überlagerten Intensitäten des Anregungslichts 1, bevor sie in den Bereich 5 der Nullstelle 4 gelangen. Insbesondere beim zeilenweisen Abtasten der Probe erfolgt eine wiederholte Beaufschlagung der Fluoreszenzmarker mit hohen Lichtintensitäten, bevor erstmalig Fluoreszenzlicht von ihnen registriert wird. Dies kann dazu führen, dass die Fluoreszenzmarker bereits gebleicht sind, bevor sie erstmalig von der Nullstelle 4 erreicht werden. Auch ein wiederholtes Abtasten derselben Probe, um beispielsweise zeitliche Veränderungen der mit Fluoreszenzmarkern markierten interessierenden Struktur der Probe zu beobachten, ist durch diesen Effekt häufig unmöglich.When the zero
Wenn jedoch der mit der Nullstelle 4 abgetastete Bereich der Probe auf maximal 3/4 oder 75 % eines Abstands D0 der Intensitätsmaxima 3, wie er in
Das Konfokalbild gemäß
Das in
Weiterhin ist bei dem Rasterfluoreszenzmikroskop 13 gemäß
Um die Lumineszenzmarker in dem angrenzenden abzutastenden Teilbereich mit dem Anregungslicht 1 zur Emission von Fluoreszenzlicht 20 anregen zu können, müssen sie wieder in ihrem aktiven Zustand vorliegen. Hierzu kann eine spontane Rückkehr der Lumineszenzmarker aus ihrem inaktiven Zustand in ihren aktiven Zustand abgewartet werden. Das Rasterfluoreszenzmikroskop 13 gemäß
Beim Ein- und/oder Ausschalten der Lumineszenzmarker in der Probe 8 mit dem Einschaltlicht 37 bzw. dem Ausschaltlicht 34 werden verschiedene schaltbare Lumineszenzmarker auch zur Emission von Fluoreszenzlicht 20 angeregt. Dieses Fluoreszenzlicht 20 gibt damit bereits Auskunft über die Konzentration der Lumineszenzmarker in dem jeweiligen Teilbereich der Probe 8. Diese Information kann entsprechend ausgewertet und für eine Entscheidung genutzt werden, ob es sich überhaupt lohnt, den nächsten abzutastenden Teilbereich mit der Nullstelle des Fluoreszenzverhinderungslichts 2 abzutasten oder nicht. Wenn es sich nicht lohnt, wird ein solches Abtasten auch nicht durchgeführt, um die Probe 8 nicht unnötig mit dem Fluoreszenzverhinderungslicht 2 zu beaufschlagen. Darüber hinaus kann das beim Ein- bzw. Ausschalten der Lumineszenzmarker registrierte Fluoreszenzlicht 20 auch genutzt werden, um einen oberen und/oder unteren Grenzwert für das an dem jeweiligen Ort der Nullstelle des Fluoreszenzverhinderungslichts 2 in dem abzutastenden Teilbereich registrierte Fluoreszenzlicht festzulegen, bei dessen Erreichen bzw. Nichterreichen die Beaufschlagung der Probe 8 mit dem Lumineszenzverhinderungslicht 2 und dem Anregungslicht 1 im Sinne eines RESCue-Verfahrens abgebrochen wird.When the luminescence markers in the
Letztlich zeigt
Die in
- 11
- Anregungslichtexcitation light
- 22
- Fluoreszenzverhinderungslichtfluorescence prevention light
- 33
- Intensitätsmaximummaximum intensity
- 44
- Nullstellezero
- 55
- Bereicharea
- 66
- Anregungexcitation
- 77
- abzutastender Teilbereichpart to be scanned
- 88th
- Probesample
- 99
- BahnRail
- 1010
- MittelpunktFocus
- 1111
- gestrichelte Liniedashed line
- 1212
- Spiralbahnspiral track
- 1313
- Rasterfluoreszenzmikroskopscanning fluorescence microscope
- 1414
- Lichtquellelight source
- 1515
- Aufweiteoptikexpansion optics
- 1616
- Phasenplattephase plate
- 1717
- weitere Lichtquelleanother light source
- 1818
- Aufweiteoptikexpansion optics
- 1919
- dichroitischer Spiegeldichroic mirror
- 2020
- Fluoreszenzlichtfluorescent light
- 2121
- Punktdetektorpoint detector
- 2222
- Abtastmittelscanning means
- 2323
- Abtastmittelscanning means
- 2424
- Probenhalterungsample holder
- 2525
- Verschiebungssymbolshift icon
- 2626
- dichroitischer Spiegeldichroic mirror
- 2727
- Intensitätsmaximummaximum intensity
- 2828
- Detektordetector
- 2929
- Kameracamera
- 3030
- dichroitischer Spiegeldichroic mirror
- 3131
- Ausschaltlichtquelleoff light source
- 3232
- Aufweiteoptikexpansion optics
- 3333
- Strahlformungsmittelbeam shaping agent
- 3434
- Ausschaltlichtoff light
- 3535
- Einschaltlichtquelleturn-on light source
- 3636
- Aufweiteoptikexpansion optics
- 3737
- Einschaltlichtturn on light
- 3838
- Steuerungsteering
- 3939
- angrenzender Teilbereichadjoining section
- 4040
- Teilbereichsubarea
- 4141
- Quadratsquare
- 4242
- Sechseckhexagon
- 4343
- dichroitischer Spiegeldichroic mirror
- 4444
- dichroitischer Spiegeldichroic mirror
- 4545
- Objektivlens
- 4646
- Markieren (Schritt)mark (step)
- 4747
- Anordnen (Schritt)arrange (step)
- 4848
- Bestimmen (Schritt)determine (step)
- 4949
- Ändern (Schritt)change (step)
- 5050
- Fixpunktfixed point
- 5151
- Mustersample
- 5252
- ReiheRow
- 5353
- SpalteSplit
- 5454
- MittelpunktFocus
- 5555
- Objektobject
- 5656
- Lumineszenzmarkerluminescence marker
- 5757
- Lumineszenzmarkerluminescence marker
- 5858
- Ortlocation
- 5959
- Ortlocation
- Ff
- Fokuspunktfocal point
- II
- Intensitätintensity
- D0D0
- AbstandDistance
Claims (18)
- Method of high-resolution imaging of a structure marked with luminescence markers (56, 57) in a sample (8),- wherein light, which has an effect on the emission of luminescence light by the luminescence markers (56, 57), is directed onto the sample (8) with an intensity distribution having a zero point (4) neighboured by intensity maxima (3),- wherein partial areas (7) to be scanned of the sample (8) are scanned with the zero point (4), and- wherein luminescence light emitted out of the area of the zero point (4) is registered and assigned to the location of the zero point (4) in the sample (8),characterised in- that several copies of an object (55) of interest are each arranged overlapping with one of the partial areas (7) to be scanned of the sample (8),- that the several copies of the object (55) of interest are subjected to varied surrounding conditions to monitor reactions of the object (55) of interest resulting therefrom, wherein the individual partial areas of the sample (8) are scanned during, and/or prior to and after the varied surrounding conditions with the respective zero point (4),- that dimensions of the partial areas (7) to be scanned of the sample (8) are delimited in at least one direction, in which the intensity maxima (3) are neighbouring the zero point (4) in the sample, such that they are not larger than 75 % of a distance (D0) of the intensity maxima (3) in this direction,- that the light, which has an effect on the emission of luminescence light by the luminescence markers (56, 57), is- luminescence enabling light,- luminescence inhibiting light, which inhibits the emission of luminescence light by the luminescence markers (56, 57) outside the zero point (4), and- that, prior to scanning the partial area (7) to be scanned of the sample (8) with the zero point (4), switch-off light (34) is additionally directed onto the sample (8) with such an intensity distribution that, in a partial area (39) of the sample (8) neighbouring the partial area (7) to be scanned, it switches off the luminescence markers, which are made as switchable luminescence markers, into an inactive state, wherein the neighbouring partial area (39) is neighbouring the partial area (7) to be scanned in the at least one direction in which the intensity maxima (3) are neighbouring the zero point (4) in the sample.
- Method of claim 1, characterised in that different subsets of the several copies of the object (55) of interest in the sample (8) are subjected to different varied surrounding conditions.
- Method of claim 1 or 2, characterised in that the surrounding conditions are varied by adding a chemical substance.
- Method of any of the preceding claims, characterised in that the several copies of the object (55) of interest are arranged in a pattern (51) defined with regard to fixed points (50) of the sample (8), and that the partial areas to be scanned of the sample (8) are approached with the zero point (4) relative to the fixed points (50) of the sample (8).
- Method of any of the preceding claims, characterised in that the partial areas (7) to be scanned of the sample (8) are repeatedly scanned with the zero point (4), wherein, optionally, at least in one repetition of the scanning of the partial areas to be scanned of the sample (8), the zero point (4) is arranged at not more than 3n or 2n locations per partial area (7) to be scanned, wherein n is the number of the spatial directions in which the partial areas to be scanned of the sample (8) are scanned.
- Method of any of the preceding claims, characterised in that the object (55) which is arranged in the sample (8) in several copies is selected from the group which includes molecules, proteins, complexes, synapses, membranes, cell components and viruses.
- Method of any of the preceding claims, characterised in that the dimensions of the partial area (7) to be scanned of the sample (8), in the at least one direction, in which the intensity maxima (3) are neighbouring the zero point (4) in the sample, are- not larger than 50 %, 45 %, 25 % or 10 % of the distance (D0) of the intensity maxima (3) in this direction, and/or- not larger than a way over which the intensity (I) of the light starting from the zero point (4) in this direction increases up to 50 %, 25 %, 10 % or 5 % of the intensity (I) of the light in the neighbouring intensity maxima (3).
- Method of any of the preceding claims, characterised in that, prior to scanning the partial area (7) to be scanned of the sample (8), the structure in the sample (8) is imaged in another way to determine the position of the partial area (7) to be scanned in the sample (8), wherein, optionally, prior to scanning the partial area (7) to be scanned of the sample (8), a larger partial area of the sample (8) is scanned with the zero point (4) at an intensity of the light reduced by at least 50 % and/or at a scanning speed increased by at least 50 %.
- Method of claim 8, characterised in that other scanning means are used for scanning the larger area of the sample (8) than for scanning the partial area (7) to be scanned of the sample (8), wherein, optionally,- for scanning the larger area of the sample (8) in at least one direction, a sample holder (24) is moved relative to an objective lens (17), by which the light is directed onto the sample (8), and/or- an electro-optical scanner, an acusto-optical deflector or a galvo mirror is used for scanning the partial area (7) to be scanned of the sample (8) in at least one direction.
- Method of any of the preceding claims, characterised in that, in case that the light, which has an effect on the emission of luminescence light by the luminescence markers (56, 57), is luminescence enabling light, the luminescence enabling light, enables the emission of luminescence light by the luminescence markers (56, 57) in that it excites the luminescence markers (56, 57) for luminescence and/or transfers the luminescence markers (56, 57) out of a dark state into an excitable state.
- Method of any of the claims 1 to 9, characterised in that, in caser that the light, which has an effect on the emission of luminescence light by the luminescence markers (56, 57), is luminescence inhibiting light, which inhibits the emission of luminescence light by the luminescence markers (56, 57) outside the zero point (4), the luminescence inhibiting light is stimulation light, which inhibits the emission of luminescence light by the luminescence markers (56, 57) outside the zero point (4) by stimulated emission, wherein the stimulation light is directed onto the sample (8) together with excitation light (1), which excites the luminescence markers (56, 57) for emission of luminescence light and which has an intensity distribution comprising a maximum (27) in the area of the zero point (4) of the luminescence inhibiting light.
- Method of any of the preceding claims, characterised in that the sample is scanned with the partial area (7) to be scanned, wherein the partial area (7) to be scanned is scanned with the zero point (4) at all or at selected positions of the partial area (7) to be scanned.
- Method of any of the preceding claims, characterised in that the intensity distribution of the switch-off light (34) has a local intensity minimum in the partial area (7) to be scanned, which is formed by destructive interference.
- Method of any of the preceding claims, characterised in that prior to and/or temporarily overlapping with the directing of the switch-off lights (34) onto sample (8), switch-on light (37) is directed onto the partial area (7) to be scanned of the sample (8), which switches the switchable luminescence markers (56, 57) into their active state.
- Method of any of the preceding claims, characterised in that luminescence light (20) emitted in switching on and/or switching off of the switchable luminescence markers (56, 57) is registered and evaluated, wherein the result of the evaluation, optionally, is- whether the partial area (7) to be scanned and neighboured by the neighbouring partial area (39), is scanned with the zero point (4), and/or- whether the excitation light (1) is directed onto the sample (8) in the partial area (7) to be scanned and neighboured by the neighbouring partial area (39), and/or- under which conditions the directing of the stimulation light onto the sample (8) in each position of the zero point (4) in the partial area (7) to be scanned and neighboured by the neighbouring partial area (39), and the registering of the luminescence light (20) emitted out of the area of the zero point (4) are terminated.
- Method of any of the preceding claims, characterised in that luminescence light emitted out of the area of the zero point (4) is registered with a point sensor (21), whose location with regard to the sample (8) is not altered in scanning the partial area (7) to be scanned of the sample (8).
- Method of any of the preceding claims, characterised in that the several partial areas (7) to be scanned of the sample (8) are scanned simultaneously.
- Method of high-resolution imaging of a structure marked with luminescence markers (56, 57) in a sample (8),- wherein light, which has an effect on the emission of luminescence light by the luminescence markers (56, 57), is directed onto the sample (8) with an intensity distribution having a zero point (4) neighboured by intensity maxima (3),- wherein partial areas (7) to be scanned of the sample (8) are scanned with the zero point (4), and- wherein luminescence light emitted out of the area of the zero point (4) is registered and assigned to the location of the zero point (4) in the sample (8),- wherein several copies of an object (55) of interest are each arranged overlapping with one of the partial areas (7) to be scanned of the sample (8),- wherein the several copies of the object (55) of interest are subjected to varied surrounding conditions to monitor reactions of the object (55) of interest resulting therefrom, wherein the individual partial areas of the sample (8) are scanned during, and/or prior to and after the varied surrounding conditions with the respective zero point (4),- wherein dimensions of the partial areas (7) to be scanned of the sample (8) are delimited in at least one direction, in which the intensity maxima (3) are neighbouring the zero point (4) in the sample, such that they are not larger than 75 % of a distance (D0) of the intensity maxima (3) in this direction,- wherein the several copies of the object (55) of interest are arranged in a pattern (51) defined with regard to fixed points (50) of the sample (8), and- wherein the partial areas to be scanned of the sample (8) are approached with the zero point (4) relative to the fixed points (50) of the sample (8).
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| DE102016104100 | 2016-03-07 | ||
| PCT/EP2017/055360 WO2017153430A1 (en) | 2016-03-07 | 2017-03-07 | Method for a high-resolution local imaging of a structure in a sample in order to detect reactions of an object of interest to altered environmental conditions |
Publications (3)
| Publication Number | Publication Date |
|---|---|
| EP3427036A1 EP3427036A1 (en) | 2019-01-16 |
| EP3427036B1 EP3427036B1 (en) | 2020-01-01 |
| EP3427036B2 true EP3427036B2 (en) | 2022-11-09 |
Family
ID=58277264
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| EP17710694.5A Active EP3427036B2 (en) | 2016-03-07 | 2017-03-07 | Method for a high-resolution local imaging of a structure in a sample in order to detect reactions of an object of interest to altered environmental conditions |
Country Status (5)
| Country | Link |
|---|---|
| US (1) | US10955348B2 (en) |
| EP (1) | EP3427036B2 (en) |
| JP (1) | JP7027316B2 (en) |
| CN (1) | CN108780045B (en) |
| WO (1) | WO2017153430A1 (en) |
Families Citing this family (18)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP7048582B2 (en) | 2016-10-10 | 2022-04-05 | マックス-プランク-ゲゼルシャフト ツア フェルデルング デア ヴィッセンシャフテン イー.ヴイ. | A method for spatially determining the position of separated molecules in a sample with high resolution, which can be excited by excitation light so as to emit luminescence light. |
| DE102017104736B9 (en) | 2017-03-07 | 2020-06-25 | MAX-PLANCK-Gesellschaft zur Förderung der Wissenschaften e.V. | Method and device for the spatial measurement of nanoscale structures |
| DE102017131249A1 (en) * | 2017-12-22 | 2019-06-27 | Leica Microsystems Cms Gmbh | A method of imaging a sample using a fluorescence microscope with stimulated emission depletion |
| PT110747B (en) * | 2018-05-18 | 2023-02-10 | Inst De Biologia Molecular E Celular Ibmc | DEVICE TO IMPROVE PERFORMANCE IN MICROSCOPY BY STIMULATED EMISSION DEPLETION (STED) USING A SINGLE PHASE MASK |
| EP3857284B1 (en) | 2018-09-27 | 2023-12-27 | Max-Planck-Gesellschaft zur Förderung der Wissenschaften e.V. | Method of and apparatus for forming and shifting a light intensity distribution in a focal area of an objective lens |
| NL2022223B1 (en) | 2018-12-17 | 2020-07-03 | Lumicks Tech B V | Microscopy method and system |
| US12031897B2 (en) | 2019-03-28 | 2024-07-09 | Memorial Sloan Kettering Cancer Center | Target-locking single-molecule nanoscopy |
| NL2023860B1 (en) | 2019-09-19 | 2021-05-25 | Univ Delft Tech | Pattern activated structured illumination localization microscopy |
| CN111024658A (en) * | 2019-11-27 | 2020-04-17 | 浙江大学 | Method and device for directional positioning of fluorescent molecules |
| DE102019008989B3 (en) * | 2019-12-21 | 2021-06-24 | Abberior Instruments Gmbh | Disturbance correction procedure and laser scanning microscope with disturbance correction |
| DE102020113998A1 (en) * | 2020-05-26 | 2021-12-02 | Abberior Instruments Gmbh | Method, computer program and device for determining positions of molecules in a sample |
| CN111579486B (en) * | 2020-06-04 | 2021-02-26 | 深圳大学 | Super-resolution imaging method and imaging system based on low-power stimulated emission loss |
| DE102020127385B3 (en) * | 2020-10-16 | 2022-03-10 | Abberior Instruments Gmbh | Process and device for the light microscopic multi-scale recording of biological samples |
| EP4092466A1 (en) * | 2021-05-21 | 2022-11-23 | Leica Microsystems CMS GmbH | Method for obtaining an operating value of an illumination parameter for examining a fluorescent sample, method for examining a fluorescent sample, microscope system and computer program |
| DE102021116504A1 (en) * | 2021-06-25 | 2022-12-29 | Abberior Instruments Gmbh | Method, computer program and device for estimating a position of an emitter or reflector in a sample |
| CN113884489B (en) * | 2021-09-29 | 2023-06-20 | 电子科技大学 | An automatic microscopic imaging method of thick liquid layer cells with grating ruler assisted positioning |
| EP4215970B1 (en) | 2022-01-21 | 2026-04-08 | Leica Microsystems CMS GmbH | Single-particle localization microscope |
| EP4455639A1 (en) | 2023-04-27 | 2024-10-30 | Leica Microsystems CMS GmbH | Single-particle localization microscope |
Citations (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| DE102016117096A1 (en) † | 2015-09-22 | 2017-03-23 | MAX-PLANCK-Gesellschaft zur Förderung der Wissenschaften e.V. | A method for high resolution local mapping of a structure in a sample |
Family Cites Families (29)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| DE10222779A1 (en) * | 2002-05-16 | 2004-03-04 | Carl Zeiss Jena Gmbh | Method and arrangement for examining samples |
| DE102005027896B4 (en) * | 2005-06-16 | 2012-03-15 | MAX-PLANCK-Gesellschaft zur Förderung der Wissenschaften e.V. | Method for optically measuring a sample |
| US7679741B2 (en) * | 2006-03-01 | 2010-03-16 | Leica Microsystems Cms Gmbh | Method and microscope for high spatial resolution examination of samples |
| DE102006062823B4 (en) | 2006-03-01 | 2010-11-25 | Leica Microsystems Cms Gmbh | Method and microscope for spatially high-resolution examination of samples |
| DE102006026203A1 (en) * | 2006-05-31 | 2007-12-06 | Carl Zeiss Microimaging Gmbh | Method for spatially high-resolution imaging |
| EP2145224B1 (en) | 2007-02-07 | 2020-09-16 | BAER, Stephen C. | Forming ligth beams and patterns with zero intensity central points |
| DE102008054317A1 (en) | 2008-11-03 | 2010-05-06 | Carl Zeiss Microlmaging Gmbh | combining microscopy |
| WO2010069987A1 (en) | 2008-12-19 | 2010-06-24 | Deutsches Krebsforschungszentrum | Method and device for dynamically shifting a light beam relative to an optic which focuses the light beam |
| DE202009007250U1 (en) | 2009-05-20 | 2009-11-26 | Deutsches Krebsforschungszentrum Stiftung des öffentlichen Rechts | Field changing means for generating complementary light intensity patterns |
| EP2317362B1 (en) | 2009-10-28 | 2020-01-15 | Carl Zeiss Microscopy GmbH | Microscopic method and microscope with improved resolution |
| DE102010028138A1 (en) | 2010-04-22 | 2011-10-27 | MAX-PLANCK-Gesellschaft zur Förderung der Wissenschaften e.V. | Determining the distribution of a substance by scanning with a measuring front |
| US8962241B2 (en) * | 2010-07-20 | 2015-02-24 | California Institute Of Technology | Triggered molecular geometry based bioimaging probes |
| DE102011051086A1 (en) * | 2011-06-15 | 2012-12-20 | MAX-PLANCK-Gesellschaft zur Förderung der Wissenschaften e.V. | Method for imaging fluorescent dye with labeled structure in sample, involves emitting fluorescent light in form of detectable photons, and assigning image of structure from location to photons over repetitive scanning of scanning area |
| WO2012171999A1 (en) * | 2011-06-15 | 2012-12-20 | MAX-PLANCK-Gesellschaft zur Förderung der Wissenschaften e.V. | Method and apparatus for imaging a structure marked with a fluorescent dye |
| DE102011055367B4 (en) | 2011-11-15 | 2017-02-09 | MAX-PLANCK-Gesellschaft zur Förderung der Wissenschaften e.V. | Method and device for tracking a movement of a particle, in particular a single molecule, in a sample |
| US9291562B2 (en) | 2011-11-15 | 2016-03-22 | Max-Planck-Gesellschaft Zur Foerderung Der Wissenschaften E.V. | Method and apparatus for tracking a particle, particularly a single molecule, in a sample |
| WO2013130792A2 (en) | 2012-02-28 | 2013-09-06 | Northwestern University | Prodrugs of fluorinated mevalonates to inhibit the mevalonate pathway of streptococcus pneumoniae |
| DE102013100172A1 (en) * | 2013-01-09 | 2014-07-10 | MAX-PLANCK-Gesellschaft zur Förderung der Wissenschaften e.V. | A method for spatially high resolution imaging of a luminophor structure of a sample |
| DE102013100174A1 (en) * | 2013-01-09 | 2014-07-10 | MAX-PLANCK-Gesellschaft zur Förderung der Wissenschaften e.V. | A method for spatially high resolution imaging of a luminophor structure of a sample |
| US9435993B2 (en) * | 2013-03-24 | 2016-09-06 | Bruker Nano, Inc. | Three dimensional microscopy imaging |
| DE102013208926A1 (en) * | 2013-05-14 | 2014-11-20 | Carl Zeiss Microscopy Gmbh | Method for 3D high-resolution localization microscopy |
| CN104152341B (en) * | 2013-05-14 | 2016-04-27 | 上海市东方医院 | Fluorescent quantitative poly chain reaction 384 hole PCR plate coordinate application of sample box |
| DE102013022538B3 (en) | 2013-09-03 | 2018-12-13 | Georg-August-Universität Göttingen Stiftung Öffentlichen Rechts | Method for creating a microscope image and microscopy device |
| JP6613552B2 (en) * | 2013-09-09 | 2019-12-04 | 株式会社ニコン | Super-resolution observation apparatus and super-resolution observation method |
| DE102013114860B3 (en) | 2013-12-23 | 2015-05-28 | MAX-PLANCK-Gesellschaft zur Förderung der Wissenschaften e.V. | Method and device for determining the locations of individual molecules of a substance in a sample |
| JP6400933B2 (en) * | 2014-04-04 | 2018-10-03 | 浜松ホトニクス株式会社 | Stimulated radiation suppression microscope |
| DE102015105018A1 (en) | 2015-03-31 | 2016-10-06 | Laser-Laboratorium Göttingen e.V. | Method and scanning fluorescence light microscope for multi-dimensionally high-resolution imaging of a structure or a path of a particle in a sample |
| US9632297B1 (en) * | 2015-11-04 | 2017-04-25 | Abberior Instruments Gmbh | Device for separately modulating the wave fronts of two components of a light beam and microscope comprising the device |
| CN105352926B (en) * | 2015-11-10 | 2018-11-16 | 深圳大学 | A kind of system of random scanning |
-
2017
- 2017-03-07 EP EP17710694.5A patent/EP3427036B2/en active Active
- 2017-03-07 CN CN201780016034.1A patent/CN108780045B/en active Active
- 2017-03-07 WO PCT/EP2017/055360 patent/WO2017153430A1/en not_active Ceased
- 2017-03-07 JP JP2018538858A patent/JP7027316B2/en active Active
-
2018
- 2018-09-06 US US16/123,280 patent/US10955348B2/en active Active
Patent Citations (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| DE102016117096A1 (en) † | 2015-09-22 | 2017-03-23 | MAX-PLANCK-Gesellschaft zur Förderung der Wissenschaften e.V. | A method for high resolution local mapping of a structure in a sample |
Non-Patent Citations (7)
| Title |
|---|
| BALZAROTTI ET AL.: "Nanometer resolution imaging and tracking of fluorescent molecules with minimal photon fluxes", SCIENCE, vol. 355, 10 February 2017 (2017-02-10), pages 606 - 612, DOI: 10.1126/science.aak9913 † |
| BINGEN P. ET AL.: "Parallelized STED fluorescence nanoscopy", OPTICS EXPRESS, vol. 24, no. 24, 21 November 2011 (2011-11-21), pages 23716 - 23726 † |
| DANZL ET AL.: "Coordinate-targeted fluorescence nanoscopy with multiple off states", NATURE PHOTONICS, vol. 10, no. 2, 18 January 2016 (2016-01-18), pages 122 - 129 † |
| GÖTTFERT ET AL.: "Strong signal increase in STED fluorescence microscopy by imaging regions of subdiffraction exten t", PNAS, vol. 114, no. 9, 28 February 2017 (2017-02-28), pages 2125 - 2130, DOI: 10.1073/pnas.1621495114 † |
| GÖTTFERT: "STED microscopy with scanning fields below the diffraction limit", DISSERTATION, 1 December 2015 (2015-12-01), Georg-August-Universität, Göttingen, Retrieved from the Internet <URL:http://ediss.uni-goettingen.de/bitstream/handle/11858/00-1735-0000-002B-7CAC-1/Goettfert_PhD_Thesis.pdf?sequence=1> † |
| Keller, "Optimal de-excitation patterns for RESOLFT-Microscopy, Dissertation, 2006 † |
| Rittweger et al., „STED microscopy reveals crystal colour centres with nanometric resolution", Nature Photonics, Vol. 3,Seiten 144-147, 22.02.2009 † |
Also Published As
| Publication number | Publication date |
|---|---|
| US20190011367A1 (en) | 2019-01-10 |
| EP3427036B1 (en) | 2020-01-01 |
| EP3427036A1 (en) | 2019-01-16 |
| JP7027316B2 (en) | 2022-03-01 |
| US10955348B2 (en) | 2021-03-23 |
| JP2019507921A (en) | 2019-03-22 |
| WO2017153430A1 (en) | 2017-09-14 |
| CN108780045A (en) | 2018-11-09 |
| CN108780045B (en) | 2021-10-29 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| EP3427036B2 (en) | Method for a high-resolution local imaging of a structure in a sample in order to detect reactions of an object of interest to altered environmental conditions | |
| DE102016117096C5 (en) | Method for high-resolution local imaging of a structure in a sample | |
| EP3372990B1 (en) | Method and device for the spatial measurement of nanoscale structures | |
| DE102013114860B3 (en) | Method and device for determining the locations of individual molecules of a substance in a sample | |
| DE102011055367B4 (en) | Method and device for tracking a movement of a particle, in particular a single molecule, in a sample | |
| EP2561336B1 (en) | Determination of the distribution of a substance by scanning with a measuring front | |
| EP2102695B1 (en) | Method and arrangement for collimated microscopic imaging | |
| DE102016119263B4 (en) | A method for spatially high-resolution determination of the location of a singled, excitable light for the emission of luminescent light molecule in a sample | |
| WO2009024529A1 (en) | Sted fluorescence microscopy having two-photon excitation | |
| EP2837929A2 (en) | Method and fluorescent light microscope for the high-resolution three-dimensional representation of the structure of a specimen | |
| EP2803977A1 (en) | Method for high resolution 3D locating microscopy | |
| EP1944600A2 (en) | Increased resolution luminescence microscopy | |
| DE102005034443A1 (en) | Sample e.g. cell particle, luminescence microscopy method, involves prevailing one of sample regions for image of sample, so that image has local resolution which is enhanced in relation to excitation radiation distribution | |
| DE102008024568A1 (en) | Spatial resolution imaging of structure of interest in specimen involves marking specimen structure, imaging the specimen, exposing the specimen to light, registering the fluorescent light and determining position of molecules of substance | |
| EP4151988A1 (en) | Method and device for high-resolution optical scanning of a sample | |
| DE10325460A1 (en) | Spatially high-resolution imaging | |
| EP1862839A1 (en) | Microscope with improved resolution | |
| DE102016119264A1 (en) | A method for spatially high-resolution determination of the location of a singled, excitable light for the emission of luminescent light molecule in a sample | |
| DE102015109305B3 (en) | Raster luminescence light microscope with luminescence-preventing light and other light lattices | |
| DE102020116547A1 (en) | Method for localizing individual molecules of a dye in a sample and for generating high-resolution images of a structure in a sample | |
| WO2004090617A2 (en) | High three-dimensional resolution representation | |
| EP4158316A1 (en) | Method and device for determining positions of molecules in a sample | |
| EP3365662B1 (en) | Method and device for high precision imaging of a structure of a sample marked with fluorescence markers | |
| DE102009008646A1 (en) | Method for detecting chromophore in two-dimensional sample in field of e.g. ultramicroscopy, involves detecting subset of chromophore from direction that is perpendicular to line and/or to surface in sample | |
| DE102020134797B3 (en) | Method for imaging a structure of interest in a sample and a microscope with an array detector for carrying it out |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: UNKNOWN |
|
| STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE |
|
| PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
| STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE |
|
| 17P | Request for examination filed |
Effective date: 20181001 |
|
| AK | Designated contracting states |
Kind code of ref document: A1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
| AX | Request for extension of the european patent |
Extension state: BA ME |
|
| RIN1 | Information on inventor provided before grant (corrected) |
Inventor name: DR. WESTPHAL, VOLKER Inventor name: WESTPHAL, VOLKER Inventor name: GOETTFERT, FABIAN Inventor name: HELL, STEFAN W. |
|
| DAV | Request for validation of the european patent (deleted) | ||
| DAX | Request for extension of the european patent (deleted) | ||
| RIC1 | Information provided on ipc code assigned before grant |
Ipc: G02B 21/00 20060101ALI20190730BHEP Ipc: G02B 27/58 20060101ALI20190730BHEP Ipc: G01N 21/64 20060101AFI20190730BHEP |
|
| GRAP | Despatch of communication of intention to grant a patent |
Free format text: ORIGINAL CODE: EPIDOSNIGR1 |
|
| STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: GRANT OF PATENT IS INTENDED |
|
| INTG | Intention to grant announced |
Effective date: 20190911 |
|
| GRAS | Grant fee paid |
Free format text: ORIGINAL CODE: EPIDOSNIGR3 |
|
| GRAA | (expected) grant |
Free format text: ORIGINAL CODE: 0009210 |
|
| STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE PATENT HAS BEEN GRANTED |
|
| AK | Designated contracting states |
Kind code of ref document: B1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
| REG | Reference to a national code |
Ref country code: GB Ref legal event code: FG4D Free format text: NOT ENGLISH |
|
| REG | Reference to a national code |
Ref country code: CH Ref legal event code: EP Ref country code: CH Ref legal event code: NV Representative=s name: RIEDERER HASLER AND PARTNER PATENTANWAELTE AG, LI Ref country code: AT Ref legal event code: REF Ref document number: 1220388 Country of ref document: AT Kind code of ref document: T Effective date: 20200115 |
|
| REG | Reference to a national code |
Ref country code: IE Ref legal event code: FG4D Free format text: LANGUAGE OF EP DOCUMENT: GERMAN |
|
| REG | Reference to a national code |
Ref country code: DE Ref legal event code: R096 Ref document number: 502017003367 Country of ref document: DE |
|
| REG | Reference to a national code |
Ref country code: CH Ref legal event code: PK Free format text: BERICHTIGUNGEN |
|
| REG | Reference to a national code |
Ref country code: DE Ref legal event code: R083 Ref document number: 502017003367 Country of ref document: DE |
|
| RIN2 | Information on inventor provided after grant (corrected) |
Inventor name: HELL, PROF. DR. STEFAN W. Inventor name: GOETTFERT, DR. FABIAN Inventor name: WESTPHAL, DR. VOLKER |
|
| REG | Reference to a national code |
Ref country code: NL Ref legal event code: MP Effective date: 20200101 |
|
| REG | Reference to a national code |
Ref country code: LT Ref legal event code: MG4D |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: FI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200101 Ref country code: NO Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200401 Ref country code: RS Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200101 Ref country code: NL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200101 Ref country code: PT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200527 Ref country code: LT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200101 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: HR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200101 Ref country code: GR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200402 Ref country code: SE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200101 Ref country code: LV Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200101 Ref country code: IS Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200501 Ref country code: BG Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200401 |
|
| REG | Reference to a national code |
Ref country code: DE Ref legal event code: R026 Ref document number: 502017003367 Country of ref document: DE |
|
| PLBI | Opposition filed |
Free format text: ORIGINAL CODE: 0009260 |
|
| PLAX | Notice of opposition and request to file observation + time limit sent |
Free format text: ORIGINAL CODE: EPIDOSNOBS2 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: CZ Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200101 Ref country code: ES Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200101 Ref country code: SK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200101 Ref country code: MC Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200101 Ref country code: EE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200101 Ref country code: SM Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200101 Ref country code: DK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200101 Ref country code: RO Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200101 |
|
| 26 | Opposition filed |
Opponent name: SCHMIDT, MARTIN MICHAEL Effective date: 20201001 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: LU Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20200307 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: IE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20200307 Ref country code: IT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200101 |
|
| PLBB | Reply of patent proprietor to notice(s) of opposition received |
Free format text: ORIGINAL CODE: EPIDOSNOBS3 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: PL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200101 Ref country code: SI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200101 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: TR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200101 Ref country code: MT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200101 Ref country code: CY Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200101 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: MK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200101 Ref country code: AL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200101 |
|
| PUAH | Patent maintained in amended form |
Free format text: ORIGINAL CODE: 0009272 |
|
| STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: PATENT MAINTAINED AS AMENDED |
|
| 27A | Patent maintained in amended form |
Effective date: 20221109 |
|
| AK | Designated contracting states |
Kind code of ref document: B2 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
| REG | Reference to a national code |
Ref country code: DE Ref legal event code: R102 Ref document number: 502017003367 Country of ref document: DE |
|
| REG | Reference to a national code |
Ref country code: AT Ref legal event code: MM01 Ref document number: 1220388 Country of ref document: AT Kind code of ref document: T Effective date: 20220307 |
|
| P01 | Opt-out of the competence of the unified patent court (upc) registered |
Effective date: 20230528 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: AT Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20220307 |
|
| PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: CH Payment date: 20250401 Year of fee payment: 9 |
|
| REG | Reference to a national code |
Ref country code: CH Ref legal event code: U11 Free format text: ST27 STATUS EVENT CODE: U-0-0-U10-U11 (AS PROVIDED BY THE NATIONAL OFFICE) Effective date: 20260401 |
|
| PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: GB Payment date: 20260324 Year of fee payment: 10 |
|
| PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: DE Payment date: 20260210 Year of fee payment: 10 |
|
| PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: BE Payment date: 20260323 Year of fee payment: 10 |
|
| PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: FR Payment date: 20260325 Year of fee payment: 10 |