Maria A.
Vorontsova
a,
Peter G.
Vekilov
*ab and
Dominique
Maes
*c
aDepartment of Chemical and Biomolecular Engineering, University of Houston, Houston, Texas 77204, USA. E-mail: vekilov@uh.edu
bDepartment of Chemistry, University of Houston, Houston, Texas 77204, USA
cStructural Biology Brussels, SBB, Vrije Universiteit Brussel, 1050 Brussels, Belgium. E-mail: dommaes@vub.ac.be
First published on 26th July 2016
We put forth an algorithm to track isolated micron-size solid and liquid particles that produce time-dependent asymmetric intensity patterns. This method quantifies the displacement of a particle in the image plane from the peak of a spatial cross-correlation function with a reference image. The peak sharpness results in subpixel resolution. We demonstrate the utility of the method for tracking liquid droplets with changing shapes and micron-size particles producing images with exaggerated asymmetry. We compare the accuracy of diffusivity determination with particles of known size by this method to that by common tracking techniques and demonstrate that our algorithm is superior. We address several open questions on the characterization of diffusive behaviors. We show that for particles, diffusing with a root-mean-square displacement of 0.6 pixel widths in the time between two successive recorded frames, more accurate diffusivity determinations result from mean squared displacement (MSD) for lag times up to 5 time intervals and that MSDs determined from non-overlapping displacements do not yield more accurate diffusivities. We discuss the optimal length of image sequences and demonstrate that lower frame rates do not affect the accuracy of the estimated diffusivity.
Over the years several computer algorithms for particle tracking from a sequence of microscopic images have been developed.20–22 On each image, particles are identified and the coordinates of their centers are determined, resulting in a time series of positions. General tracking methods deal with cases in which the intensity profile of a particle is radially symmetric. As such the center is allocated to the point of maximum intensity or the intensity centroid. More sophisticated techniques use a variety of fitting algorithms to provide sub-pixel resolution of the particle coordinates. As the peak of the point spread function of a diffraction-limited spot can, in most cases, be approximated by a Gaussian function, many fitting algorithms use Gaussian profiles.23–25 The radial centering technique uses the direction of the gradient in a radially symmetric intensity pattern to identify the intensity center.26,27 This technique does not employ iterative nonlinear fitting and is faster than fitting algorithms.
Several recently studied systems appear to challenge even advanced particle tracking algorithms. For instance, in images of micron-size liquid droplets the recorded intensity patterns are asymmetric and fluctuate with a characteristic time comparable to their diffusion time. Another example comes from particle tracking by oblique illumination microscopy, a method that records the intensity scattered from submicron and micron-size particles28–30 in which the identification of the particle center is hampered by the asymmetry of the scattered intensity pattern. To quantify the diffusive motion for such particles and droplets, here we put forth a fast and easy to implement SPT algorithm. We employ a local spatial cross-correlation function to identify the displacement of a particle between two frames.31,32 We implement radial centering26,27 of the computed cross-correlation functions to evaluate the travelled distance with sub-pixel resolution. In its current implementation, the method is only applicable to relatively dilute solutions since it requires non-overlapping trajectories of the tracked particles. Importantly, the proposed algorithm does not rely on the identification of the particle center in any single image, but reconstructs the particle trajectory from the displacements between pairs of images.
We demonstrate that particle tracking by this method enables an accurate characterization of the dynamic behavior of single particles. We employ the proposed algorithms to obtain trajectories of submicron and micron-size particles and droplets of protein dense liquid. From the recorded trajectories, we evaluate the diffusion coefficient of spherical latex particles of known size, using least squares fits of the mean square displacement as a function of time,33–37 and compare its value to the diffusivity determined by dynamic light scattering. We use the correspondence between the two values as a quantitative indicator of the performance of the method. Applying this criterion, we demonstrate that the proposed cross-correlation method yields a more accurate estimate of particle diffusivity than several common tracking methods.
Two protein solutions were tested in our work. Glucose isomerase (Microcrystal Oy, Helsinki, Finland) solution was prepared at a concentration of 90 mg ml−1 in 100 mM Na-HEPES (N-2-hydroxyethylpiperazine-N-2-ethanesulfonic acid, Fisher, US) buffer at pH = 7.0 containing 200 mM MgCl2 (Fisher, US). Lysozyme powder (Affymetrix, US) was dissolved in 20 mM HEPES buffer at pH 7.8 and dialyzed over two days. Tested solutions contained 20 mg ml−1 lysozyme and 15% v/v ethanol (Fisher, US). Both protein solutions were aged for 1–2 weeks prior to the experiments to ensure large cluster size in the range 1–2 μm.38
Dynamic light scattering data were collected using an ALV goniometer equipped with a He–Ne laser (632.8 nm) and an ALV-5000/EPP Multiple tau Digital Correlator (ALV-GmbH, Langen, Germany). The intensity correlation functions were acquired for 60 s at 90°; for details see ref. 28 and 30.
(1) The coordinates of the intensity centroid (xc, yc) were determined as
![]() | (1) |
![]() | (2) |
(2) The Gaussian center was determined as the maximum (xc,yc) of the Gaussian profile
![]() | (3) |
(3) The radial centering technique relies on the fact that in a radially-symmetric intensity pattern the intensity gradient at any point is directed towards the center of the tracked particle. We followed the procedure by Parthasarathy26,27 and used the MATLAB code published in the ESI of ref. 26.
As examples of time-dependent intensity patterns, here we use images of diffusing solid spheres, rods, and liquid droplets obtained with oblique illumination dark-field microscopy, sometimes referred to as Brownian microscopy or Nanosight technology.28,30,38–41 In this technique, solution samples are held in a thin cuvette under a microscope, Fig. 1. The illuminating beam extends at an angle with the microscope optical axis, adjusted to avoid the microscope objective lens. Light scattered from particles in the viewfield is captured by the objective lens and recorded using a video camera. The reliance on scattered light offers several important advantages. First, particles with refractive indices close to that of the solution and with sizes smaller than the diffraction limit are detectable. Second, owing to stronger scattering, reflected in the Rayleigh law, larger particles produce stronger signals and can be detected on a background of smaller scatterers. Lastly, particles out of the image plane are detectable, leading to better population statistics.
To produce time-dependent asymmetric scattered intensity patterns with oblique illumination microscopy, we use spherical particles with near-micron diameters (these particles are too small for continuous monitoring with bright-field microscopy), which produce asymmetric intensity patterns because of the asymmetric illumination. To test the performance of commonly used tracking algorithms (intensity maximum (IM), radial centering (R), intensity centroid (IC), and Gaussian centering (G), described in detail in the Materials and Methods section), we monitor the diffusive motion of four classes of particles. We use spherical latex particle with diameters 0.1, 0.424 and 1 μm and gold nanorods with 1 μm length and 100 nm diameter.
The selection of images in Fig. 2a, in which we have indicated the particle centers identified by each of the four techniques, reveals that the IM, R, and G algorithms yield consistent results for the submicron size particles: the center locations are identical and the particle trajectories, displayed in Fig. 2b, similar. The IC method misjudges the center locations owing to the low-intensity of the scattered pattern. The accuracy of this method depends heavily on the background estimation and can be improved by background correction, but this drastically increases the expended computational time.31 The Gaussian centering method failed to converge for the intensity patterns of 0.424 and 1.0 μm particles, comprising several concentric rings.
Where applicable, these methods produce disparate center locations and trajectories for spheres of diameter 0.424 and 1.0 μm and for 1 μm long nanorods. Inspection of the images in Fig. 2a suggests that the errors of the tested methods are rooted in the lack of radial symmetry of the intensity patterns, accompanied by fast changes in the location of the intensity maxima.
Inverting the FFT of the products yields the cross-correlation function of the two images, or the autocorrelation function of the reference image (Fig. 3d). The displacement of the intensity maximum of the cross-correlation function from that of the autocorrelation function of the reference image is taken as a measure of the displacement vector of the tracked particle between the two images. In Fig. 3e we superimpose the reference and the target images and position the tail of the displacement vector
at the apparent center of the reference image. As evidence of the reliability of the SCC method, the vector head points to the center of the target image.
To achieve subpixel resolution, we apply radial centering26,27 in the vicinity of the cross-correlation maximum, where this function is quasi radially symmetric. The radial centering technique uses the fact that the orientation of the gradient at any point on a radially symmetric intensity pattern is in the direction of the intensity center. Furthermore, in cases where the shape of the intensity profile changes drastically within a sequence of images, resulting in a decaying peak of the spatial cross-correlation function, a second reference image may be selected. Thus, if for the first group of k images image 1 is used as a reference, for images numbered k + 1 through 2k, we use image k as a reference. To choose k, we note that large k values bring down the signal-to-noise ratio since they correspond to longer particle displacement. On the other hand small values of k result in a higher and narrower peak of the spatial cross-correlation function, conducive to more accurate localization.
Note that the choice of a reference image, 1 in Fig. 3, is arbitrary and can be changed at any moment of particle tracking. Re-selection of the reference image allows for the elimination of the effects of the rotation of strongly asymmetric particles or the changing shape of liquid droplets on the tracking of their translations. If a rod-like particle rotates with a characteristic time shorter than the chosen translational lag times, or if a liquid particle changes shape with a similarly short characteristic time, the rotation and shape change, respectively, will average out and not affect the determination of the particle trajectory. If the two characteristic times, however, are comparable or longer than the monitored lag times, the resulting evolution of the speckle pattern will induce a gradual decay of the maximum intensity of the cross-correlation function. This intensity decay can be used as an indication for a change in the reference image with respect to which the translational motions of the studied particle are computed.
In its current version, the SCC method is applicable to relatively dilute solutions and suspensions, which produce sequences of images that can be cropped so that a single particle is left in them. In the next step we will consider solutions at higher concentrations resulting in images displaying several particles. The cross correlation function of pairs of such images will display several peaks. Displacements of all imaged particles between successive images will be computed from the shifts of the peaks corresponding to each particle in the cross correlation function.
In Fig. 4b we compare the trajectories of liquid droplets of variable shape resulting from the SCC method to those produced by radial centering. Similarly, in Fig. 3b we plot the SCC trajectories of spherical particles of three sizes and nanorods. For these five classes of diffusing objects, the SCC trajectories are more compact. In view of the unrealistic shifts of the droplet centers identified by radial centering in the images in Fig. 4a, and by the other three tracking methods in Fig. 3a, we conclude that the SCC trajectories are better fits to the actual particle motions. The proposed SCC method is robust: cross-correlation functions of overexposed images, such as the ones in Fig. 4a and Movies I and II (ESI†), possess sharp intensity peaks that allow accurate determination of the particle displacement.
![]() | (4) |
We evaluate D as the slope of the correlation between and the duration tn of n steps. We compute tn = nt, where t is the time between two consecutive images in the sequence, from which the displacement is computed. With this, D is the slope of the relation
![]() | (5) |
Besides evaluating the accuracy of the SCC algorithm, we use data on the diffusive motion of known particles to address several outstanding questions related to the characterization of diffusive dynamics. These are: (1) the utility of one-dimensional particle displacement data. (2) The significance of using non-overlapping n step sets for MSD determination. (3) The optimal values of the duration over which particle displacement should be averaged, the number of points included in the least-squares fit,35,37,56–59 the frequency of particle localization, and the length of particle monitoring. In addition, we test the relative accuracy of two diffusivity estimators, the least squares method, discussed above, and the maximum likelihood estimator, based on the mean displacement over the shortest captured time interval.
Often, projections of Brownian trajectories on a single dimension are used to determine the diffusivity from , where
or
. To address the validity of this data reduction scheme, we compute the mean squared displacements along the x and y axes, respectively, as
![]() | (6a) |
![]() | (6b) |
![]() | (7) |
In Fig. 5a we display the projection in the plane of the image of the trajectory of a latex particle with diameter 1 μm. The particle coordinates with respect to the center of the autocorrelation function of the first image were evaluated using the SCC method from 5000 images collected at constant Δt = 20 ms. This Δt is 20-fold shorter than the characteristic diffusion time of the particle τD. The corresponding root-MSD between two successive frames is 190 nm, equal to 0.57 pixel widths. The particle trajectory is highly asymmetric, suggesting the presence of a strong drift roughly parallel to the x axis. The MSDs over tn = nΔt from 0 to 100 s, computed using eqn (4) are displayed in Fig. 5b. The MSD values increase monotonically with tn for tn < 48 s and then decrease and reach values close to zero. This nonlinear behavior is far from the straight line predicted by the Einstein relation.60–62 Similar behaviors were reported by Vestergaard et al.37 They are a consequence of the high correlations of the displacements at longer times and of the limited statistics provided by data of a single particle. The points in the curve have a statistical uncertainty that increases with n (the point at t = 100 s is not even an average value, but corresponds to a single data point).
![]() | ||
Fig. 5 Evaluation of the accuracy of the SCC method. (a) Trajectory of a 1 μm latex sphere determined by the SCC method from a sequence of images recorded at 50 frames s−1 for 100 s. (b) Mean squared displacement (MSD) ![]() ![]() ![]() |
The particle diffusivity, D, values evaluated from the MSDs in Fig. 5b, are displayed in Fig. 5c. We determined each D value by a least-squares fit of the data ranging from the lowest tn = 0.02 to a highest tn varying from 0.04 to 20 s, and plotted the resulting D as a function of the highest tn used in the fit. The upper limit of the highest tn range, 20 s, was chosen somewhat arbitrarily to evaluate the effects of longer tn on the D determination. Evidence presented below suggests that the accuracy of D determination decreases monotonically at tn > 5 s, significantly shorter than the chosen limit, and no peculiarities occur near this limit.
We compared these D values to the results of the determination by DLS, carried out in a solution identical to the one characterized in Fig. 5a and b. DLS yields the autocorrelation function g2 of the scattered light. The function g2 identifies the characteristic time of decay of the scattered intensity, which, in Newtonian solutions, equals the characteristic diffusion time tp of the suspended particles. The diffusivity is determined as the product (q2tp)−1, where q is the scattering wave vector. In general, the D values in Fig. 5c deviate from the DLS value (4.51 ± 0.18) × 10−13 m2 s−1. At lag times tn < 1 s, the deviation is <10%. The best correspondence is achieved at tn near 1 s. At lag times longer than this, the deviation increases and reaches up to 30%. At lag times >10 s, the deviation decreases and reaches below 10% at tn = 18 s.
To evaluate the statistical significance of the observations on the accuracy of the diffusivity determination at different lag time ranges, observed in Fig. 5c, we carried out identical determinations with a total of 20 particles. We divided the diffusivities determined in each tn range in four groups: those that are within, respectively, 10, 20, and 30% of the DLS value, and those that deviate by more than 30% from it. Clearly, the diffusivities in the first group are a subset of those in the second, and the latter are a subset of the 30% group. In Fig. 5d we plot the number of diffusivities in each group scaled with the total number of tested particles (this ratio is equal to the relative frequency of the respective deviations from the DLS value) as a function of the upper limit of the tn range.
The data in Fig. 5d reveal that for lag times shorter than 3 s about half of the tested particles yielded diffusivities within 10%, and about 85%, within 30%, of the DLS value. These data allow for the evaluation of the quality of the procedures for the determination of D. Thus, D values determined over shorter lag time ranges are more accurate. This may appear counterintuitive since fewer data points seem to produce a better result. In fact, even the shortest MSD, , represents an average over the entire particle trajectory. To understand these observations, we note that recent theoretical analyses59 demonstrated that the ratio
![]() | (8) |
The first three columns in Fig. 6 demonstrate that a greater number of particles yield diffusivities closer to the DLS value with the SCC method than with the intensity maximum or radial centering methods.
As expected, the radial centering technique produces more accurate D estimates than the intensity maximum method. In addition, the two older techniques exhibit frequency maxima at lag times of several seconds. These maxima contradict the predictions of the theoretical analysis35,59 of diffusivity determination from particle trajectories and the contradiction suggests inaccurate identification of the particle coordinates, similar to the sequence illustrated in Fig. 2. A closer inspection of the SCC data at short lag times in the semi-logarithmic plots in Fig. 7a reveals that diffusivities evaluated from MSD correlations with lag times of about 0.1 s (5 fitting points) are more accurate than those with the shorter tested lag times, 0.02 s (1 fitting point resulting in the Maximum Likelihood Estimate of D), 0.04 s, etc. This slight discord with the theoretical prediction is due to the finite accuracy of particle tracking by the SCC method. The theoretical root-mean-square displacement of the particle during this optimal lag time of 0.1 s is 429 nm, corresponding to 1.3 pixels.
The data in the rightmost column represent MSDs computed from independent displacements using eqn (7) and SCC-produced trajectories to evaluate the diffusivity of individual particles. The frequency dependencies on the lag time are noisier, reflecting noisier dn2(tn) correlations that are likely due to significantly reduced statistics.55 The numbers of particles yielding diffusivities closer to the DLS value with this method is comparable to the numbers of particle processed with the “classical” SCC method with overlapping displacements. This similarity suggests that the use of independent displacements does not produce a significant advantage.55
The diffusivities reflected in the statistics in Fig. 6 were computed from two-dimensional displacements in the image plane (bottom row) and from displacements exclusively along the x or y axes (top and middle row, respectively). The quality of the diffusivity data evaluated from trajectories identified by the intensity maximum technique does not appear to display significant differences between the three methods to compute displacements. The radial centering technique produces highest data quality with two-dimensional displacements. The higher accuracy of the SCC method allows finer distinctions. While the diffusivities evaluated from the two-dimensional data are more accurate (the initial values of the 10, 20, and 30% curves are higher, and the areas under them are greater) than those evaluated from x-data, the diffusivities evaluated from the displacements along the y axis are even more accurate (e.g., 75% of the particles yield diffusivities within 10% of the DLS value). Examination of the trajectories of the 20 particles revealed that they are similar to those in Fig. 5a and exhibit significant drift nearly parallel to the x-direction. The inability to accurately account for this drift biases the displacements in the x-direction, and by inclusion, the two-dimensional displacements. The displacements in the y direction are relatively free from such bias.
Slower frame rates ensure longer displacements between two successive images resulting in a high signal to noise ratio of the particle trajectory and should induce more accurate diffusivity data. On the other hand, with a fixed image sequence length, slower frame rates extend the duration of data acquisition and enhance the effects of drift, vibrations, temperature variations and other destructive factors. To evaluate the effects of frame rates on the quality of the diffusivity data, we compare the accuracy of diffusivity determinations from image sequences collected with frame rates varying from 5 to 50 frames s−1. The time interval between two successive frames ranges from 200 to 20 ms with a corresponding two-dimensional root-MSD ranging from 1.8 to 0.57 pixel widths. The data in Fig. 7b demonstrate that the frame rate does not affect the accuracy of diffusivity determinations. We conclude that we do not need the better signal to noise ratio of a coarser sampling, a testament to the high accuracy of the SCC tracking method.
We demonstrate the utility of the method for tracking liquid droplets with changing shapes and micron-size particles producing images with exaggerated asymmetry. We evaluate the accuracy of the method by comparing the diffusivity of particles of known size determined by this method to the value determined by dynamic light scattering. We compare the results with the intensity maximum and radial centering methods. We show that the diffusivity evaluations using trajectories determined using the spatial-cross-correlation (SCC) method are significantly closer to the expected value than those determined using the intensity maximum or radial centering methods.
We address several open questions on the characterization of diffusive behaviors. We show that in the presence of a drift, one dimensional trajectories in the direction perpendicular to the dominant convective flow yield more accurate diffusivity values. We show that MSDs determined from non-overlapping displacements do not yield more accurate diffusivities than methods employing overlapping displacements. We show that for particles diffusing with a root-mean-square displacement of 0.6 pixel widths in the time interval between two successive frames, more accurate diffusivity determinations result from mean squared displacement (MSD) for lag times equal to five time intervals.
We show that sequences of 1000 images lead to more accurate diffusivity determinations than those of 50, 100, 250 or 500 images. Extending the sequence length to 2500 and 5000 images does not improve the determination accuracy. We show that with constant movie length, larger frame rates do not affect the accuracy of diffusivity determinations.
We envision the applicability of the SCC tracking method to all classes of objects with variable image shapes: cells, liquid droplets, particles of anisotropic shapes or optical density,64,65 particles with non-uniform fluorescent labeling, and others. If an anisotropic particle rotates with a characteristic time shorter than the chosen translational lag times, or if a liquid particle changes shape with a similarly short characteristic time, the rotation and shape change, respectively, will average out and will not affect the speckle pattern. If the two characteristic times are comparable or longer than the monitored lag times, the resulting evolution of the speckle pattern will induce a gradual decay of the maximum intensity of the cross-correlation function. This intensity decay can be used as an indication for a change in the reference image with respect to which the sequence of cross-correlation functions is computed. A thorough benchmarking against these more complex particles will be performed in a forthcoming paper.
Footnote |
† Electronic supplementary information (ESI) available. See DOI: 10.1039/c6sm00946h |
This journal is © The Royal Society of Chemistry 2016 |