Fabian
Ott
a,
Tobias
Meyer-Zedler
a,
Michael
Schmitt
b and
Jürgen
Popp
*ab
aMember of Leibniz Health Technologies, Member of the Leibniz Center for Photonics in Infection Research (LPI), Leibniz Institute of Photonic Technology (Leibniz-IPHT), Albert-Einstein-Str. 9, 07745 Jena, Germany
bInstitute of Physical Chemistry (IPC) and Abbe Center of Photonics (ACP), Member of the Leibniz Center for Photonics in Infection Research (LPI), Friedrich Schiller University Jena, Helmholtzweg 4, 07743 Jena, Germany. E-mail: juergen.popp@uni-jena.de
First published on 20th November 2024
Here we present a highly customisable image-based fuzzy logic control (FLC) method for pressure-driven droplet microfluidics. The system is designed to position droplets of different sizes in microfluidic chips of varying channel size in the centre of the region of interest (ROI) using two parallel multiple input single output (MISO) FLCs. Overall, 95.1% of the droplets with an average displacement of 2.5 μm could be kept within the ROI during the pre-defined time intervals of up to 10 s. This is achieved by pre-determined pressure values that are kept constant during this time. The control principle was tested on different pressure controllers and microfluidic chips varying in material, channel layout and cross section. Droplet volumes ranged from a few hundred picolitres to a tenth of a microlitre. The droplets were composed of deionised water or contained two concentrations of S. cerevisiae. The average processing time was 12.5 seconds. This makes the method suitable for studying several hundred pre-sorted droplets from high-throughput screening (HTS) experiments.
Parallel monitoring of large number of droplets can be performed in observation chambers for longer periods of time.15 In contrast the aim of this work is to automatically analyze and move individual droplets of interest for longer time spans. To combine droplet microfluidics with different microscopic imaging modalities, it is necessary to overcome the obstacle of their different operating and acquisition frequencies. In general, pressure-driven droplet microfluidics means continuous generation of droplets at constant velocity and kHz rates.16 This requires the use of high-speed cameras with correspondingly short exposure times to avoid motion blur.17 The flow rate of the droplets is subject to certain fluctuations18 and vortices form within the droplets.19,20 Therefore, measurements that require switching between widefield and confocal imaging modalities with long acquisition times are extremely challenging.
However, there are ways to extend the observation time. One approach is to follow the droplets of interest.21 Another technique uses the movement of the microscope stage in the opposite direction to the flow.17 A further option is to stop the droplets with valves.22,23
Here we introduce an image-based FLC algorithm to set ΔP close to zero in the center of ROI (Fig. 1). This allows the droplet to be held in position for a period of time, extending the timeframe for imaging. We chose pressure regulators which have several advantages over syringe-based systems. Firstly, the flow has less fluctuations.24 Second, the response time to parameter changes is faster.4,25 Thirdly, sample exchange is straight forward.
![]() | ||
Fig. 1 Basic operation principle, a) pressure controller, b) microfluidic chip with sample reservoirs for pre-sorted droplets, c) microscope camera, d) image processing and FLC algorithm. |
We expect that our method will provide a deeper insight into the contents of the microfluidic droplets with high precision. For example, the morphology of cells could be studied or movement patterns analyzed. Furthermore, this basic principle can be extended to complex channel geometries. This provides a new tool for controlling pressure-based droplet microfluidics for lab-on-a-chip systems, where on-demand control and manipulation is paramount.
![]() | ||
Fig. 4 a) Input MSF – contour position for 1024 px main ROI; b) input MSF – contour velocity; c) output MSF – pressure change; d) rule base. |
![]() | ||
Fig. 5 a) Time distribution microfluidic states; b) droplet size distribution; c) pressure difference while Hold; d) position shift while Hold. |
Init took a total of 3 h:24 m:41 s, the initialization of a droplet takes 5.1 s on average. The initialization time depends on the pressure difference (ΔP) between the inlet and outlet. Alternatively, the maximum ΔP of the pressure regulator could be applied at the beginning instead of gradually increasing it. Then the flow velocity would immediately increase and the droplets would move into the ROI much faster. However, this increases the probability that droplets will pass through the detection area without being positioned. Furthermore, if the distance between the droplets is small, this would facilitate the system to oscillate. Another decisive factor is when a droplet is transported into the channel. If the ratio of continuous to disperse phase is shifted in favor of the disperse phase, the probability that a droplet will flow into the channel increases. As the two phases have different densities, a phase separation occurs in the reservoir and the denser continuous phase (1.61 g cm−3) is therefore transported into the channel first. To test the setup thoroughly, samples with a polydisperse size distribution were prepared for this experiment. This means that an indeterminate number of droplets do not fulfil the differentiation criteria. In case of a sample with a well-defined monodisperse distribution, the limit values can be set precisely so that every droplet is processed, which reduces the average initialization time.
Center (4 h:15 min:58 s) takes an average of 6.4 s and is therefore the longest process step. A reduction in pressure to zero mbar results in a sudden decrease in the flow rate. The manufacturer of the pressure controller states that both the rise and fall of 100 mbar take 17 ms.27 In some cases setting pinlet and poutlet to zero is not sufficient to slow down the droplet exactly in the detection area. Ideally, the flow should stop immediately when the pressure difference is set to zero. However, due to the elasticity of the tube connectors, sample reservoir, sealing ring and the microfluidic chip, there is a compliance which causes a delay time before the flow velocity in the microchannel approaches zero.23 The silicone tubing between the controller and the sample reservoir makes the largest contribution. In order to shorten delay time and thus also response time of the system, the above-mentioned components should have the lowest possible elasticity and the connection distances should be kept as short as possible. If the delay time is too long or the flow velocity is too high, the droplet passes the ROI without being controlled by the FLC. To avoid this case, the rules of the FLC could be further extended, e.g. with MSFs for the current pressure and associated rules. However, such an adaptation requires many attempts to optimally adapt the rules to the system. Another potential cause for this phenomenon is that the center_stablizing_timer is reset when neither the cLx nor cRx are detected in a single frame. This issue could be solved by implementing a moving average to suppress false negative detections.
The hold time of 3 h:10 m is specified by the defined hold times of 1 s, 3 s, 5 s and 10 s. However, this hold time can also be specified by the acquisition time defined by the microscope imaging software and synchronized by triggering for the respective imaging modality used. Typical acquisition times for brightfield images are in the range of μs to ms. However, it is planned to combine the application presented here with non-linear imaging modalities such as two-photon excited fluorescence (TPEF) and coherent anti-Stokes Raman scattering (CARS). Depending on pixel dwell time and resolution, acquisition times in the seconds range can be expected for these non-linear modalities.28,29
The state For (38 m:51 s) lasted on average 1 s. However, the image acquisition process itself can also take several seconds, depending on the resolution and number of images required, for example, in the case of z-stacks or time series. In that case the times required for droplet handling and imaging are of comparable order of magnitude. It should be noted that the total acquisition time is not well suited for high throughput approaches with hundred thousand of droplets. Nevertheless, a few hundred droplets can be examined within a reasonable time frame. In the event that a considerable number of samples is present, it is advisable to presort them according to the characteristics of interest.30,31
The histogram depicted in Fig. 5b encompasses droplets whose standard deviation (SD) of droplet_length between Center, Hold and For was ≤12 px. This comparison of lengths is necessary to eliminate droplets from the evaluation that might have left the detection area during the Hold phase or have been caused by false positive contour detection. A total of 55 droplets (ROI 512 px) and 63 droplets (ROI 1024 px) were excluded from the analysis. This means a mean relative error of 4.9% for holding both droplet contours inside the ROI. To reduce this error, the detection could be further improved. Instead of just comparing the droplet contour per frame with the previous, a more robust tracking algorithm could be implemented. A balance should be found between the image processing time and the response time of the microfluidic system. In any case, for the optical system a factor of 2.068 px μm−1 was determined with the calibration target. This means that the largest group of 512 px ROI is 109 μm in length. The second largest population with a length of approx. 157 μm belongs to the 1024 px ROI, as does the third largest with 400 μm. The absolute minimum length was 71 μm, and the maximum was 442 μm. This means that min_droplet_length and max_droplet_length have been undercut and exceeded. The reason for this is that the discriminators decide while Init, but the values of the diagram originate from the For state. Another consideration is droplet deformation at high flow velocities, which causes a contour modification between flowing and floating droplets.20 The length discriminators also serve to achieve a more effective regulation. For this, min_droplet_length must be at least 10% greater than the channel width and height. This ensures that it fills the channel cross-section. Similarly, max_droplet_length must be at least 10% smaller than the ROI. Otherwise the control distance of the MSF contour position will be insufficient. A simplified approximation is Vdroplet = droplet_length × width_channel × height_channel for estimating the droplet volume. Vdroplet extends from 262.7 pl up to 1.6 nl. It is possible to control both smaller and larger volumes, but there are some limitations. These include the channel cross-section, the pressure range of the controller and the ROI defined by the optical system. Furthermore, other pressure controllers can be used with the presented algorithm. If these controllers do not support negative pressures, it is possible to configure the MSFs to an overpressure regime to provide the necessary pressure difference.
The droplets are positioned by the ΔP between the two liquid surfaces in the sample reservoirs (Fig. 5c). This pressure difference results from several factors, including the liquid height in the reservoirs, the channel geometry, the number, size, distribution and composition of the droplets and the continuous phase.20 A rapid change in ΔP is also an indicator of leaks in the fluidic or pneumatic system. Furthermore, impurities such as dust can lead to an increase. This was almost certainly the case between the 25th and 75th droplet (Fig. 5c, ROI 512 px), where there was a sudden, abrupt increase followed by a drop below the starting level. The system can compensate for impurities of this kind. The controller has a maximum ΔP limitation. If the foreign particle cannot be sufficiently deformed by this differential or exceeds the adhesion force, a blockage will occur in the channel.
The displacement of the droplets during Hold (Fig. 5d) is calculated from the averaged difference between cLinv and cR from each first execution of the states Hold and For. It is clear that the scatter width of the boxplots increases with longer hold time. Furthermore, the data clearly demonstrate that droplet are drifting towards the outlet (Table 1, column: average, minimum, maximum). When grouped by time, it is clear that the SD increases with longer holding times. When the data is grouped according to sample type, it becomes clear that the average shift decreases. The mean and SD increase with increasing ROI size when grouped. This shift has several causes.
Group | Sample | N | Average | SD | Minimum | Median | Maximum |
---|---|---|---|---|---|---|---|
Time | 1 s | 582 | 0.2 | 3.0 | −12.1 | 0.2 | 25.9 |
3 s | 579 | 1.3 | 10.8 | −54.4 | 1.7 | 71.8 | |
5 s | 569 | 0.3 | 12.3 | −40.1 | −0.2 | 64.1 | |
10 s | 552 | 3.0 | 16.9 | −49.8 | 1.9 | 81.0 | |
Sample | H2O | 750 | 1.7 | 12.4 | −54.4 | 1.0 | 81.0 |
S. cer. 1![]() ![]() |
772 | 1.3 | 12.6 | −48.1 | 0.5 | 79.1 | |
S. cer. 1![]() ![]() |
760 | 0.6 | 10.8 | −49.8 | 0.2 | 64.1 | |
ROI | 512 px | 1145 | 0.7 | 11.4 | −49.8 | 0.2 | 52.9 |
1024 px | 1137 | 1.7 | 12.5 | −54.4 | 1.0 | 81.0 |
Firstly, the values of the pressure controller fluctuate around the set target value. Secondly, the difference in density between the continuous and disperse phases can cause individual droplets to escape from the channel into the reservoirs. This results in a pressure change in the channel. To correct any shifts that occur as a result, the system must be readjusted accordingly. A permanent control can be carried out when imaging in brightfield mode. If the image modality does not allow constant illumination, it can be interrupted for repositioning and continued afterwards. An alternative solution is to implement parallel acquisition of the camera for positioning and other imaging modalities. In conclusion image recognition of the droplet contours is the most important factor for successful positioning. The algorithm is currently designed to recognize the first contour that fulfills the criteria. The response time of the microfluidic controller for the pressure change of ±100 mbar is approx. 17 ms, the communication time between computer and controller is approx. 22 ms. The edge detection and FLC process requires approx. 10 ms. Each pressure value change is based on the analysis of two consecutive images and the edge information obtained from them. Thus, image processing time and response time of the microfluidic controller are on the same time scale. To make the system less error-prone in terms of recognition, all droplet contours in the ROI could be recognized. This would double the FLC MSF contour position width, which would also double the control path of the FLC system. This would reduce the probability that a droplet is not detected. However, there is a disadvantage in that it will take longer to process the images. This must be coordinated with the response time of the microfluidic system. The measurements with S. cerevisiae have demonstrated that contour recognition is not significantly affected by cellular content and positioning can be carried out successfully. We assume that the functionality remains guaranteed for cell types with the same or smaller diameter and the same or lower cell concentrations. It is clear that higher cell density implies a lower shift during Hold (Table 1, group: sample; average). However, further measurements with different cell densities are needed to confirm this assumption.
This system has been designed to analyze in detail pre-sorted droplets from HTS experiments, e.g., in an antibiotic susceptibility assay.32 In such experiments, millions of droplets are generated and presorting is performed by e.g., fluorescence33 or elastic light scattering34 at up to kHz rate, which results in several hundred up to thousand droplets, which need to be automatically analysed in detail.
Another application includes the automated evacuation of pre-sorted droplets from microfluidic chips for transfer to a culture substrate.35
Two MISO FLCs are executed in parallel to calculate the pressure values for centering. The average time for initializing, centering and forwarding a single droplet was 12.5 s. This period of time makes it necessary to presort droplets of interest from previous HTS. We successfully held 95.1% of 2400 droplets within the ROI for a hold time between 1 s and 10 s. During this time the droplets shifted by an average of 2.5 μm with a standard deviation of 11.9 μm. This is better than recently published stop-flow methods, which result in residual flow velocities of 10–200 μm s−1.23 In the hold span the image modality can be changed and acquisition can be carried out. An advantage of the system is the mobility and access to droplets. This makes it possible to use contained cells for subsequent cultivation after label-free image analysis. We will further develop the system's potential by adapting it to a microfluidic chip capable of generating, merging, storing droplets and observing them at different time points.
Footnote |
† Electronic supplementary information (ESI) available. See DOI: https://doi.org/10.1039/d4lc00583j |
This journal is © The Royal Society of Chemistry 2025 |