Open Access Article
Vincent
Niggel
,
Maximilian R.
Bailey
,
Carolina
van Baalen
,
Nino
Zosso
and
Lucio
Isa
*
Laboratory for Soft Materials and Interfaces, Department of Materials, ETH Zurich, CH-8093, Zurich, Switzerland. E-mail: lucio.isa@mat.ethz.ch
First published on 31st March 2023
Tracking the three-dimensional rotation of colloidal particles is essential to elucidate many open questions, e.g. concerning the contact interactions between particles under flow, or the way in which obstacles and neighboring particles affect self-propulsion in active suspensions. In order to achieve rotational tracking, optically anisotropic particles are required. We synthesise here rough spherical colloids that present randomly distributed fluorescent asperities and track their motion under different experimental conditions. Specifically, we propose a new algorithm based on a 3-D rotation registration, which enables us to track the 3-D rotation of our rough colloids at short time-scales, using time series of 2-D images acquired at high frame rates with a conventional wide-field microscope. The method is based on the image correlation between a reference image and rotated 3-D prospective images to identify the most likely angular displacements between frames. We first validate our approach against simulated data and then apply it to the cases of: particles flowing through a capillary, freely diffusing at solid–liquid and liquid–liquid interfaces, and self-propelling above a substrate. By demonstrating the applicability of our algorithm and sharing the code, we hope to encourage further investigations in the rotational dynamics of colloidal systems.
Since seminal efforts in the 90's, e.g.,8,9 tracking particle translation from microscopy images has today become a common task, recently also exploiting machine-learning approaches,10,11 with ramifications across different disciplines.12 In contrast, tracking the rotational motion of colloidal particles has received significantly less attention.13 Tracking rotation is in fact easily achievable for shape-anisotropic particles,1,3,14–21 but it is impossible for uniform spherical colloids. However, colloidal spheres are ubiquitous model systems and unravelling their rotational motion plays an important role in a broad range of physical problems, e.g. in dense quiescent suspensions approaching dynamical arrest (glass transition),22–24 for individual self-propelling colloids in proximity to a confining wall25 or at higher concentrations, where dynamic clustering occurs,26,27 and for concentrated systems under shear.28 Moreover, the presence of potential coupling between rotational and translational motion renders the accurate characterisation of the former highly important in many additional situations.29–31
The key impediment to the direct evaluation of a particle's orientation is the requirement for optical anisotropy,13 as exploited in earlier depolarised light-scattering studies,32 which is however not common for most spherical colloids. Optical anisotropy can nonetheless be achieved by incorporating a non-centered fluorescent component within the particles during synthesis23,24,33 or after synthesis, e.g. by photobleaching,34 or by preparing asymmetrically-coated particles, i.e. Janus particles.35–38 More recently, Ilhan et al. demonstrated the tracking of the 3-D rotations of colloidal particles having an overall spherical shape, but presenting a non-uniform fluorescence signal due to the presence of fluorescent asperities onto their surfaces (raspberry particles).39 They then used these particles to probe the effect of surface roughness on the rotational dynamics of a colloidal suspension approaching the glass transition.40
Currently, most experimental approaches to directly measure 3-D rotation require three-dimensional imaging, typically achieved by performing z-scans with a confocal microscope. Besides the requirement for sophisticated equipment, this approach is ill-suited for the rapid tracking of particle rotations, as images from different focal planes must be acquired continuously (z-stacks), introducing significant delays in the effective volumetric frame rate. Ideally, the acquisition rate of the image stacks should be much faster than the characteristic time of rotation to avoid image distortions, which limits investigations to slow dynamics, contrasting with the various situations where particles undergo rapid rotations, e.g. under flow.
Here, we demonstrate a method to track the 3-D rotations of optically heterogeneous colloids, i.e. raspberry particles similar to those used by Ilhan et al.39,40 and whose translational motion is restricted to the xy plane, from 2-D wide-field microscopy images at fast acquisition times. In contrast to the method used by Ilhan and co-workers, who directly tracked the fluorescent asperities in 3-D, we retrieve the 3-D angular displacements by analysing the local changes in the particles’ surface texture resulting from said rotations. This approach has been previously used to investigate the rotations of macroscopic objects,41,42 but, to the best of our knowledge, it has not yet been applied to colloidal systems. In the following, we describe the detailed steps of our approach, and evaluate the effects of imaging and tracking parameters on its accuracy against the ground truth by using simulated images. We conclude by applying our method to three distinct experimental cases of widespread interest, namely: particles under flow in a microchannel, free particles diffusing at a glass–water and at an oil–water interface, and active particles self-propelling above a glass substrate.
00
000–5
00
000, 20 wt% in H2O) were acquired from Sigma-Aldrich. Ethanol (EtOH, absolute for analysis, 1 L) was acquired from Merck. An ammonium hydroxyde aqueous solution (NH4OH in water, 25% v/v, 1 L) was acquired from VWR Chemicals. The small silica particles used as asperities, i.e. “berries”, (200 nm, 10 mg mL−1 in water) were acquired from nanoComposix. The small polystyrene particles used as fluorescent berries (Fluospheres) were acquired from ThermoFischer scientific.
Janus catalytic microswimmers were obtained by metal deposition onto the fluorescent raspberry particles produced as described above. First, 60 μL of a 0.5 mg mL−1 particle solution was spread onto a microscopy slide that had been exposed to air plasma for 2 minutes at 5 × 10−2 mbar (Harrick, Plasma cleaner PDC-32G). After drying, the particles were coated by a 5 nm Pt layer using a sputter-coating machine (Safematic, CCU-010). The resulting Janus particles were subsequently detached from the glass slide by 2 minutes of ultra-sonication in 50 mL double-deionised water, and finally concentrated into a volume of 0.5 mL.
:
1 ratio with isopropanol (Sigma Aldrich), and ultrasonicated for 2 minutes. Subsequently, 0.5 μL of the spreading solution was injected at the water–hexadecane interface through the oil phase using a micro syringe pipette with a flat PFTE tip (Hamilton, 701 N Micro SYR Pipette). Particles at the interface were finally imaged using a water Dip-In objective (CFI Apochromat NIR 60X W) mounted on an Nikon LV-ECON upright microscope equipped with Hamamatsu Orca Flash 4.0 v3 camera. A sketch of the experimental setup can be found in Fig. SI2-B, ESI.† The 498 × 420 pixel images were acquired at 20 fps.
We first test the method on simulated images and then apply it to different experimental situations. Details on the simulation of the raspberry particles can be found in the ESI† (Fig. SI5–SI13). A schematic outlining the different steps of our method is presented in Fig. 1. We start from a 2-D image I(x, y) at time t, which shows a top view of a simulated raspberry-like particle, and compare it to a later image I1(x, y) at time t + dt, which shows a top view of the same particle after rotation by a specified angle. I(x, y) is defined as the reference image, while I1(x, y) will be used to generate the rotated images for comparison.
To retrieve the angular displacements, a direct orthonormal coordinate system with in-plane axes x and y, and a normal, out-of-plane axis z must first be defined. We also need to define the 3-D rotation matrix, which in our case is Rθxθyθz = RθzRθyRθx. This rotation is the composition of a first rotation Rθx of angle θx around the x axis, followed by a rotation Rθy of angle θy around the y axis and finally a rotation Rθz of angle θz around the z axis. Having defined the coordinate system, it is now possible to apply different transforms and create the prospective images.
The images I(x, y) and I1(x, y) are first cropped and resized to decrease computational times while retaining sufficient information and spatial resolution. Since we assume that the recorded images are projections of a spherical particle with randomly distributed fluorescent asperities onto a plane above its equator, the information is denser at the particle center than at its border (i.e., the pixels in the center of the projection correspond to a smaller area of the particle surface and thus allow for the detection of smaller out-of-plane rotations, see Fig. SI16, ESI†). This consideration allows identifying a suitable range for cropping, whose choice influences the precision of the measured angles as well as the range of angular displacements that can be extracted (see Fig. SI17, ESI†). Usually, our cropping is slightly bigger than the size of the mask we will apply in a later step (see Fig. SI18, ESI†). After this first processing step, we thus obtain two new images Ir(x, y) and I1r(x, y). Since we assume that the particle radius R is known and that the spherical particles are centered in the image, we can associate each (x, y) pixel of I1r(x, y) to a height z, where with
if x2 + y2 < R2 and z = 0 everywhere else. We can then compute the new position [x1, y1, z1] = Rθxθyθz[x, y, z] of each pixel of I1r and, by using a linear interpolant, we can create the rotated image I2 from the rotation Rθxθyθz of I1r (see Fig. SI19, ESI†).
At this stage, we apply the same mask to Ir and I2 to remove unwanted information from the images. The mask is the rotated image of a disk with the same rotation Rθxθyθz. This disk mask selects data with a circular symmetry from our original square images, and it is necessary to discard pixels that are further away from the particle center and that are excluded in our correlation process (see Fig. SI15, ESI†). We then assess the correlation between the masked reference image Im and the rotated image I2m by using the corr2 function from MATLAB based on the pixel intensity of the images. This procedure is performed for all combinations of angles (θx, θy, θz) defined by the user and the most likely 3-D rotation is defined as the rotation which maximises the correlation between Im and I2m.
A detailed discussion on the applicability of the method, on the influence of the image, tracking and experimental parameters is presented in the ESI† (Fig. SI20–SI27) together with the 3D rotation registration codes. The codes for simulation and 3D rotation registration are custom written in and run on Matlab R2020b on a Lenovo P52 (Intel Core, i7-8850H CPU @ 2.60 GHz (6 Core), 16 GB RAM).
We begin by analysing the rotation of raspberry particles with a small number of large berries (Fig. 2A). From the calculated angular displacements, we observe that all methods are able to track the ground-truth rotation around all axes, however, the spread in the measured θz,comp is greater than for the two other rotations. We also note that, in all dimensions, our correlation-based approach appears to provide higher precision than SVD using the locations of berries. This is not a consequence of the SVD method, but is instead due to increased errors in locating and tracking single asperities. In fact, the automatic berry tracking method we use presents issues when the asperities are too close to each other, or when individual berries disappear out of the field of view due to the rotation (Fig. SI30, ESI†). Manually selecting the berry centres reduces the degree of matching error compared to the automated case, as reflected in the increased precision of the rotations extracted using SVD, nonetheless, the process is time-consuming and can still lead to tracking errors from limited spatial resolution or due to human error.
We then increase the number of berries while decreasing their average size, and evaluate the precision of our correlation-based method compared to the SVD method applied on berry centres which are localised with automated tracking (Fig. 2B). The performance of our method appears to improve with an increasing number of smaller berries, due to the larger number of features available to compute the correlation. This contrasts with the clearly decreased precision of the alternative approach using SVD, which likely arises due to an amplification of tracking issues for displacements that start to approach the inter-asperity distance.
From the comparison of our method with alternatives using SVD on the tracked asperity centres, we find that an image-correlation-based method provides higher precision in tracking the rotation of raspberry particles around all 3-D axes. However, we note that our method rotates images by discrete angles, whereas SVD provides a continuous range of angular displacements. The size of the discrete space evaluated increases the prospective images by N3 (assuming each dimension is evaluated with the equal number of angles N), and is therefore an important parameter to evaluate to optimise computation time. A systematic study of the influence of other parameters on tracking accuracy is given in the Supporting Information as previously mentioned (Fig. SI20–SI27, ESI†). Moreover, as previously outlined, this method works for any textured surface that does not have any rotational symmetry. It is therefore applicable to systems other than raspberry-like particles (Fig. SI31, ESI†).
![]() | ||
Fig. 3 (A) Example image with 3 particles on the bottom of a rectangular glass capillary and corresponding trajectories for an injection rate of 60 μL h−1. The white scale bar represents 20 μm. (B) Positional and angular coordinates of the three particles shown in A as a function of time. (C) Average rolling speed x (blue circles), y (red diamonds) and z (green triangles) of the particles as a function of the injection rate. The black diamonds show the expected values for pure rolling with = 360° × , with vp the experimental average velocity of the particles for the different injection rates (see Fig. SI32, ESI†) and Rp the particle radius. The black dashed line shows a linear fit of the pure rolling speed vs. injection rate. The error bars correspond to the standard deviation of the data. | ||
Given the geometry of the problem, at the centre of the channel at its bottom surface, the flow induces translation along the channel (x-axis) and rotation along the principal shear direction (y-axis). We first localize and track the particles’ centres using the in-built MATLAB imfindcircles function and show that they move with a constant velocity vp in the x direction and only exhibit small positional fluctuations in the y direction (see Fig. 3B). Moreover, the density difference with the fluid causes them to sediment to the channel bottom wall and we neglect displacements in the z direction. Using our image correlation approach for 3-D rotation registration, we are then able to track the angular displacements in x, y, and z over time (also see Fig. 3B). We find that the particles steadily rotate around the y axis with a constant angular velocity as they roll on the channel's bottom surface. Both the translational and the rolling velocity
grow linearly with the externally imposed flow rate (see Fig. 3C and Fig. SI32, ESI†). However, the measured values of rotation around the y-axis are below the theoretical prediction for pure rolling (see black symbols in Fig. 3C), indicating that they also slide on the glass capillary surface. Rotations around the two other axes are significantly smaller, and thus the particle motion is essentially confined in 1D. The data suggest a constant ratio of sliding to rolling motion under these experimental conditions, i.e., a constant ratio between the values of the black and red diamonds as a function of injection rate in Fig. 3C, which would be interesting to characterize further beyond these initial experiments as a function of particle and substrate properties. This method can be extended to denser suspensions flowing in a thin capillary, allowing comparison between the translational and rotational velocities beyond the dilute case (see Fig. SI34, ESI†)
Fig. 4A–D show the trajectories (A) and the angular coordinates (B–D) as a function of time of three particles freely diffusing in water in proximity to a glass substrate. The data clearly show that the particles are rotating in three dimensions, with larger total angular displacements for in-plane (z) rotations. The situation is different when similar particles are instead adsorbed at a fluid–fluid interface. Recording the x, y and z angular coordinates as a function of time shows that the out-of-plane rotation (x and y) is greatly suppressed, with particles only fluctuating around their initial angular position (F–G), while the in-plane, z rotation is unrestricted (H). Additionally, at fluid interfaces, drift is more likely to be present, causing a combination of diffusive and advective translational motion, as seen in the particle trajectories (E) and in the corresponding mean square displacements (Fig. SI35, ESI†).
The time series of the angular positions can be used to calculate the mean squared angular displacements (MSAD) of the particles, which we report in Fig. 4I. Here we plot the MSAD down to ≈0.1 s because the angular displacements at shorter times are below the tracking resolution of our method, but in principle, for sufficiently large angular displacements, the MASD can be calculated all the way down to the camera acquisition rate. We note that in the case of a particle freely diffusing above a substrate, the MSAD of the rotations in x, y, and z are comparable (see Fig. 4I, orange curves, and Fig. SI36, ESI†). We also stress that the MSAD we show is the cumulative MSAD (see Fig. SI38, ESI†) and that the value we compute is practically independent of the rotation order (see Fig. SI39, ESI†). By fitting the MSAD, averaged over the three particles, we obtain a rotational diffusion coefficient
R = 0.0141 rad2 s−1 (see ESI,† section “Freely-rotating particles” for more details).
At the water–hexadecane interface, we see that the particles undergo in-plane rotational diffusion with a diffusion coefficient comparable to that of the particles close to the substrate (solid blue line in Fig. 4I,
R = 0.0176 rad2 s−1). Conversely, the rotations of the particles in the x- and y-directions are significantly hindered, and the MASD shows a clearly sublinear time dependence and a plateau at long times (dashed blue line in Fig. 4I).
Rough raspberry silica particles adsorbed at fluid interfaces have been shown to exhibit contact-line pinning, such that, after spreading, particles are effectively trapped at a given orientation relative to the interface and can only locally fluctuate without freely rotating out of the interface plane. This scenario follows previous literature studies that ascribe it to contact-line pinning induced by surface heterogeneities for many different particle types, e.g.45–49 Since contact-line pinning effectively confines particle rotation in 2-D at the fluid interface, under these experimental conditions, our 3-D approach can be directly compared to additional approaches to track 2-D rotation, such as 2-D image rotation, or methods based on Fourier transforms (ref. 50, 51). Despite allowing for 3-D rotation of the images to determine the maximum correlation, our method compares favourably with alternatives that only track rotations in 2-D, as can be seen in Fig. 4J. More information on the methods we used for the 2-D rotation tracking can be found in Fig. SI40 and SI41, ESI.†
Fig. 5 shows that we are able to record the rotational motion of the particles as they self-propel. We first perform control experiments in the absence of a chemical fuel (H2O2), and find that the presence of an ∼5 nm Pt cap already affects the out-of-plane particle rotation in comparison to the same particles without a Pt cap (see Fig. 5B, C and I). This is in good agreement with previous Brownian dynamics simulations, which found a preferential cap-down configuration due to a quenching of thermal rotation, caused by gravitational torque arising from the asymmetry in particle density.59
As described above, with the introduction of H2O2, the Janus raspberry microswimmers produce chemical gradients, which also affect their rotational dynamics in the presence of a confining boundary.60 Specifically, angular fluctuations around the x- and y-axes appear to be further damped when the particles become active (see Fig. 5F, G and I). Furthermore, asymmetries present from the berries and potentially uneven Pt film coverage introduce chirality to the microswimmers’ motion, in turn affecting the particle rotation in-plane and increasing the corresponding MSAD (see Fig. 5E, H and I). Examples of Janus raspberry particles with and without hydrogen peroxide are shown in the Movies SM4 and SM5, ESI,† respectively.
We can finally compare the angular displacements obtained using our image correlation-based method with values extracted from particle displacements, assuming that rotations are restricted to 2-D. If the orientation vector of the catalytic cap is assumed to be identical to the direction of motion of the particle, consecutive angular displacements can be determined from the translational motion of the particles.61–63 However, as shown in Fig. 5J, the latter approach performs worse than our methodology at short time-intervals due to the overestimation of detected angular displacements deriving from positional fluctuations (see Fig. SI43, ESI†). Finally, it is worth stressing that the orientation of the microswimmers may not be truly restricted in 2-D in some cases, and might be better described by an intermediate between unrestricted 3-D and confined 2-D rotation, depending on their swimming properties.64 Therefore, by decoupling the measurement of angular displacement from motion, our method is applicable to a wider range of active matter systems, removing the required assumption of e.g. confined 2-D rotation or a constant modulus of velocity.
Using simulated data, we have also evaluated the impact of errors in the estimation of particle size or particle center localisation on our method's precision, and we showed that adjusting the coverage of fluorescent features allows for improved tracking performance. We found that it is also important that radius of the particles is properly defined, and the particle centre is tracked accurately not to affect the precision of the analysis. The selection of these parameters is highly dependent on the experimental conditions used, and therefore evaluating the performance of the model using simulated data, i.e. generated by the code that we provide, prior to application to experimental data is advised.
We finally illustrated that our 3-D registration rotation method is applicable to a broad range of experimental situations, enabling extraction of detailed information on rotational dynamics. For instance, we showed that particles in a glass capillary undergo both rolling and sliding on the surface under flow. Elucidating the contact conditions of particles under shear will help shed light on open questions in the rheology of dense suspensions where the relative roles of sliding and rolling friction, adhesion and hydrodynamic lubrication are under scrutiny.28 In particular, we envisage that our approach may be used to visualise whether the relative rotations between neighbouring particles are affected by contacts under shear, e.g. imaged in the stagnation plane of a rheo-confocal setup.65 Even if the contact region cannot be imaged with high-resolution, rotations are in any case detected using the central part of the particle images, which would still allow for rotation mapping. We also showed that the rotation of particles at an oil–water interface can be directly measured, which offers additional insight into the motion of particles at fluid interfaces,47,66 towards the realization of materials with tailored interfacial mechanical properties.67 Last but not least, we showed that the direct measurement of the rotation of active particles in 3-D offers better accuracy than methods based on their translational motion, and holds promise to provide useful inputs in extracting dynamics and interactions within ensembles of microswimmers.68 We expect that growing interest will continue developing in characterizing the rotational dynamics of colloidal particles under different conditions, and hope that our method will enable soft matter community to explore new questions.
Footnote |
| † Electronic supplementary information (ESI) available: Additional details of experimental procedures and report of additional syntheses. See DOI: https://doi.org/10.1039/d3sm00076a |
| This journal is © The Royal Society of Chemistry 2023 |