Anish G.
Patel
a,
Luke
Johnson
b,
Raymundo
Arroyave
*b and
Jodie L.
Lutkenhaus
*ab
aArtie McFerrin Department of Chemical Engineering, Texas A&M University, College Station, TX, USA. E-mail: Jodie.lutkenhaus@tamu.edu
bDepartment of Materials Science and Engineering, Texas A&M University, College Station, TX, USA. E-mail: rarroyave@tamu.edu
First published on 29th March 2019
Multifunctional energy storage devices can greatly impact public safety and flexible electronics. For example, mechanically strong energy devices can prevent catastrophic failure in batteries or act as structural elements, simultaneously dissipating energy and bearing a load. Herein we report on a nanoarchitectonics approach, which implements an optimal experimental design framework to optimize the electrochemical and mechanical properties of a composite electrode. First, functional analysis was used to determine the weight percentages of the electrode components as control variables of interest in this material system. A utility function was then developed to measure the trade-offs between the electrochemical and mechanical properties. Finally, Gaussian process regression was used to model initial experimental data and optimal compositions were predicted using expected improvement acquisition methods.
Design, System, ApplicationToday's growing energy demands require unique solutions. Structural energy and power devices offer one such solution by providing a device that can accomplish two objectives at once: storing energy and withstanding mechanical loads. This device would reduce the mass and volume required to power electric vehicles or enable flexible electronics that are common in wearable technology. However, there is a lack of suitable materials due to an inherent trade-off between the electrochemical and mechanical performance. Therefore, materials design is a promising strategy for discovering novel materials for structural energy storage devices. In this paper we present the use of data driven modelling for the design of multifunctional materials consisting of reduced graphene oxide, aramid nanofibers, and carbon nanotubes for their use as structural electrodes in supercapacitors. Experimental data were used along with Gaussian process regression to predict and optimize the performance of the electrodes in an iterative manner. This work reports on the design of multifunctional materials using materials informatics for efficient exploration and exploitation of the design space. |
Recently, we have studied structural supercapacitors containing reduced graphene oxide (rGO) and Kevlar aramid nanofibers (ANFs).18,19 Reduced graphene oxide, derived from graphene oxide (GO), is a well-studied two-dimensional carbon material that is commonly used in supercapacitors due to its excellent electrical conductivity, high surface area, and good chemical stability.31,32 Bulk Kevlar fibers have a Young's modulus of 90 GPa and a tensile strength of 3.8 GPa making them ideal additives for enhancing the stiffness and strength of composite materials.33 ANFs are nanoscale Kevlar fibers formed from the dissolution of the bulk fibers.34 They are promising building blocks for nanocomposite materials due to their excellent mechanical properties and easy processability. Incorporating ANFs with rGO allows for the nanofibers to act as a mechanically reinforcing nanofiller that also prevents the restacking of graphene sheets.19 This is due to hydrogen bonding35,36 and aromatic stacking37,38 (or π–π stacking), which lead to strong interactions between the two materials. These interactions result in greatly improved mechanical performance.18,19,35,36 ANFs have also been shown to improve the mechanical properties in other composites.18,19,35,36,39–42
Carbon nanotubes (CNTs) are of interest here as additives to the rGO/ANF electrode for several reasons. CNTs are rod-like nanoparticles that are well known for their high electrical conductivity and exceptional mechanical performance making them an ideal nanomaterial for composite electrodes.43–45 Carbon nanotubes have been used as supercapacitor electrodes46 but they are more commonly used as additives to increase the electrochemical performance and/or mechanical capabilities (i.e. flexible electrodes).47–50 While graphene is an excellent electrode material for supercapacitors, its propensity to agglomerate and restack significantly impedes electrochemical stability.5,51 Therefore, the use of an additive that prevents restacking, such as CNTs, leads to an improvement in the electrochemical performance. It has been shown that CNTs act as a conductive bridge between graphene sheets to prevent agglomeration and promote conductive pathways.52,53 Carbon nanotubes have also been used in composites with polyaniline49 and manganese oxide50 to achieve similar results.
There has been a rapid increase in the use of machine learning in materials science, which has led to the acceleration of the materials discovery process.24,27,54–60 The need for materials informatics partly arises from the large cost of running experiments when attempting to find optimal compositions. For example, fabricating and fully characterizing one of the aforementioned rGO/ANF electrodes can take two weeks.18 Materials informatics provides powerful tools that can take advantage of previously generated data to better understand the relationships between processing, properties, and performance in order to predict new materials without the traditional costs associated with experimental work. Currently, there has been no work on using data science to better understand current materials, discover new materials, or guide experimental design in the area of structural energy materials. Due to recent successful implementation of informatics in materials science,24–26,28–30,61,62 machine learning methods are a promising alternative to traditional experimental approaches used for fabricating multifunctional energy storage electrodes.
Here we present the first use of machine learning on the design of structural electrodes for energy and power. We first refine and re-examine Wetzel's utility metric in order to broaden its applicability to a wider design space. By doing so, we present a customizable utility function that allows the user to adjustably weight the electrochemical and the mechanical performance metrics. This utility function guides the design of the electrodes toward different regions of the design space based on the application. The primary degrees of freedom in the material system considered in this work are the weight percentages of the electrode's constituents (rGO/ANFs/CNTs). Herein, we focus on the combination of data science and experiments to establish high-level connections between the composition and the electrochemical and mechanical properties. Data driven models, in the form of Gaussian processes, are used to establish links between composition and performance without any knowledge of the complex physical interactions within the electrode. These models are used to predict compositions with promising combinations of properties which are then validated experimentally, within a Bayesian optimization framework. This process is performed multiple times, creating a feedback loop for efficient exploration of the design space. We apply this methodology to the rGO/ANF/CNT supercapacitor system as a test case.
A functional diagram for a structural electrode is used to better understand the relationships between inputs and outputs at the component level, Fig. 1a. Also, it is used to inform decisions concerning the best way to manipulate functions and sub-functions to achieve objectives and goals. At the component level, Fig. 1a, the function of a structural electrode is to store and deliver energy to a system while still being safe and stable after sustaining mechanical loads and forces. This requires the consideration of both electrochemical and mechanical requirements.21
As stated above, the three potential materials of interest for designing a multifunctional energy storage device are rGO, ANFs, and CNTs. The system chart, Fig. 1b, summarizes the fundamental functional interactions between the various levels of the process–structure–property (PSP) hierarchy for composite electrodes that contain these components. For example, composition directly affects the composite interactions and porosity of the structure, which, in-turn, affect the electrochemical and mechanical properties listed.
In order to effectively design a new material, the mechanical and electrochemical properties should be combined into a single performance metric (U, which varies from 0 to 1) through a utility function which combines electrochemical utility (ECU) and mechanical utility (MU). Eqn (1)–(3) define the utility based on a combination of various performance metrics where a is a weighting coefficient (which varies from 0 to 1), C is the specific capacitance of the electrode at different scan rates ν, T is the toughness, σ is the ultimate tensile strength, E is the Young's modulus, and ε is the strain at break. These performance metrics were normalized by the typical values for pure reduced graphene oxide electrodes and pure ANF films denoted by subscript rGO and subscript ANF, respectively. This means that the ternary composite materials are compared against pure reduced graphene oxide, a commonly investigated material for supercapacitor electrodes, and pure ANF which is known for its mechanical properties. This allows the utility function to reflect the change in the performance relative to the highest performing unary component. ECU describes the capacitance values at 6 different scan rates (ν = 1, 5, 10, 20, 50, and 100 mV s−1) to take both energy storage and rate capability into account. MU examines 4 important metrics for structural materials and combines them with equal weighting. The value of a is chosen to bias the relative importance of electrochemical performance against mechanical performance based on the intended application. For this work, a was set to 0.5.
U = (1 − a)ECU + (a)MU | (1) |
(2) |
(3) |
While using one set of experimental data is beneficial, there are also challenges to this approach. The experimental data available only explore a small portion of the entire design space as shown in Fig. 2. This may cause problems in modeling the entire space because the model will have inaccurate predictions away from the data heavy corner. However, it is not necessary to explore the entire design space. Previous studies in the area of multifunctional composites showed that using ANFs or CNTs as additives (in small quantities) provides a large enhancement in the mechanical and electrochemical performance, respectively.33,35,36,39–42,50,53 Also, exploring high graphene content composites better tailors this analysis to energy storage applications since graphene acts as the primary electroactive component in the composite. Reducing the design space to consider only high graphene content and low ANF and CNT content will provide the best analysis into multifunctional energy storage devices with the current experimental dataset available.
Fig. 3 Schematic showing feedback between the experimental data and the computational model. EI is expected improvement and EGO is efficient global optimization. |
In order to effectively create a model from this dataset, appropriate representations of the expected response surface of such a model must be established. GPMs describe the expected behavior of the experiment's response surface according to the sensitivity of the data to each control variable and the (statistical) correlation between points in the design space. The GPM is a non-parametric model such that there is no assumed functional form of the solution. As such, the model avoids the issue of underfitting or overfitting. Sensitivity and correlation are encoded in a “kernel function” through the use of hyperparameters which represent the characteristic length and correlation distance of the response surface, respectively. Selection of the kernel's functional form (Matern, radial basis functions (RBFs), etc.) is often based on the expected nature of the response surface a priori. Multiple kernels were tested and compared based on their predicted surfaces. With an appropriate kernel and relevant hyperparameters defined, the GPM was fit to a dataset by finding hyperparameter values that minimized the error between the response surface and the data points. The GPM, with optimized hyperparameters, is then used to predict the mean and variance of the response surface for the entire design space. The models are obtained from Scikit-learn, a free machine learning library. Kennedy et al. also detailed the Bayesian calibration process employed in Gaussian process regression.66
Predicted response surfaces of GPMs were then used, in conjunction with a leave-one-out (LOO) cross validation technique, to find the most predictive feature set. Four feature sets (ANFs/rGO, ANFs/CNTs, rGO/CNTs, rGO/ANFs/CNTs) were analyzed using this technique. In the LOO analysis, one point was removed from the dataset and the model was trained on the remaining data. The error of the model was calculated as the difference between the model's predicted value and the actual value at the removed point. This process was repeated until all data points have been sampled. Each feature set was analyzed with this approach and the resulting distributions of errors were compared to select the best feature set. A summary of these analyses is given in the Results and discussion section.
Once the final GPM and feature set combination were determined, the mean and variance predictions of the model were used with acquisition criteria to select new potential experiments. The choice of acquisition criteria depends on the objective of the design problem. Since the objective of this work was to optimize the performance of a supercapacitor electrode, criteria that sought the optimum value in a design space were chosen: upper confidence bound (UCB), probability of improvement (PI), and expected improvement (EI). It is important to note that materials informatics methods can also be used to identify properties that conflict with the design goal, as these would also provide valuable knowledge; however, they are used here to identify the best composition for future experimental design work.
UCB, the simplest approach, selects new experimental points by finding the maximum value when the mean and variance surfaces are added together. While easy to calculate, UCB has the drawback of a slow convergence rate if the predicted variance dominates the mean response. PI selects the next experiment by finding the point in the design space that has the largest region of probability distribution above a predefined target value of optimization. This target value is typically selected as the best point found so far plus a constant value. The magnitude of this constant term determines the behavior of the search criteria with large values promoting exploration and small values promoting exploitation. The main issue with PI is the need to select this target offset a priori. EI extends the idea of PI by including information about the centroid of the same area considered by PI. By using the centroid, EI considers both probability and magnitude of the improvement.67 This provides a balance between exploration and exploitation in which points that have lower probability but larger magnitudes of improvement can be selected over points with higher probability but lower potential improvement in the response surface. Analysis of these acquisition criteria for this particular design problem can be seen in section 3.2 below. Finally, the efficacy of EGO to balance exploration of the design space and exploitation of promising areas has been thoroughly proven by Jones et al.64 Thus, the model can obtain a global optimality and avoid local minima.
All code and data pertaining to this work is available on Github under the repository titled Design-of-Multifunctional-Supercapacitor-Electrodes-using-an-Informatics-Approach. (https://github.com/AnishGPatel/Design-of-Multifunctional-Supercapacitor-Electrodes-using-an-Informatics-Approach).
The composite electrode's thickness was characterized using scanning electron microscopy (SEM, JEOL JSM-7500F). Average thicknesses of 15–30 μm were obtained. Cross-sectional SEM imaging of the composite revealed a tightly packed and layered structure, Fig. 4d and e. However, the ANFs and CNTs were not directly observed due to their small size and low loading in the composite. CNTs were characterized using transmission electron microscopy (TEM, JEOL JEN-2010), Fig. S1.† Samples were prepared by drop casting a solution of CNTs in DMSO directly onto a TEM grid.
Electrochemical characterization was carried out using cyclic voltammetry (CV) on both a Gamry potentiostat and Arbin instrument (Gamry Interface 1000, Gamry Instruments and Arbin Battery Testing Instrument). The electrochemical performance was tested using a two-electrode symmetric coin cell with 6 M KOH as the electrolyte. The coin cell consisted of, from bottom to top, a bottom metal covering, carbon paper current collector, electrode, electrolyte, separator (Celgard 3501), electrolyte, electrode, current collector, spacer, spring, and metal covering. The electrodes were prepared by cutting a 16 mm circle sample out of the composite electrode. Cyclic voltammetry was conducted at varying scan rates from a voltage of 0 to 1 V. Specific capacitance (F g−1) was calculated from CV curves using eqn (4), where m is the mass of the two electrodes (g), ν is the scan rate (V s−1), ΔV is the voltage range (V), Vl is the low-voltage cutoff (V), Vh is the high-voltage cutoff (V), and I is the current (A). Fig. 4f shows a CV curve for an rGO/ANF/CNT composite with 90.25 wt% rGO, 4.75 wt% ANFs, and 5 wt% CNTs at 20 mV s−1. The electrode stores energy through the electric double layer (EDL) capacitance. This is evident through the lack of redox peaks in the CV curves and the rectangular shape of the curve, which indicates ideal capacitive behavior.
(4) |
The mechanical performance was evaluated using quasi-static uniaxial tensile testing using a dynamic mechanical analyser (DMA Q800, TA Instruments). The electrode was cut into rectangular strips approximately 2.5 mm in width and 20 mm in height, with thicknesses ranging from 15 to 30 μm. The electrode samples were gripped using a thin film tension clamp with a clamp compliance of about 0.2 μm N−1, and the tensile tests were conducted in controlled strain rate mode with a preload of 0.02 N and a strain ramp rate of 0.1% min−1. A typical stress–strain curve of an rGO/ANF/CNT composite with 90.25 wt% rGO, 4.75 wt% ANFs, and 5 wt% CNTs obtained from tensile testing is shown in Fig. 4g. The mechanical properties obtained from the stress–strain curve include Young's modulus, strength, ultimate strain, and toughness.
Feature selection was used to find the most predictive feature set. Four combinations of the three features (ANF/rGO, ANF/CNT, rGO/CNT, rGO/ANF/CNT) were tested using leave-one-out cross validation, as shown in Fig. 5d. The unary feature sets were disregarded due to their inability to describe complete compositions. Unary feature sets would prevent experimental validation of predicted compositions. Each feature set performed almost identically. The leave-one-out error for the complete feature set (rGO/ANF/CNT) was 19.9% while the errors for the feature sets ANF/rGO, ANF/CNT, and rGO/CNT were 19.6%, 20.1%, and 19.3%, respectively. The uniformity in errors is expected because all four feature sets contain enough information to define the entire system in terms of composition due to mass conservation constraints. The complete feature set with all three features (rGO wt%, ANF wt%, and CNT wt%) was used as it contained the most information and performed as good as the other feature sets. Leave-one-out cross-validation trains the model by using all the experimental data except for one data point and then validates using the data point that was initially left out. This is then repeated until each data point is used to validate the feature set. Analysis of variance (ANOVA) was used to compare the variance between the 4 feature sets. There was no statistical difference between the errors of the different feature sets meaning that the averages of the errors of the four feature sets obtained using leave-one-out cross validation are all equal.
The three acquisition criteria, expected improvement (EI), probability of improvement (PI), and upper confidence bound (UCB) (white star, blue square, and green triangle, respectively, in Fig. 6b and c), all point to different locations on the utility surface. UCB (green triangle) indicates the point that has the maximum possible utility value when examining both the mean and variance, PI (blue square) describes the highest probability of improvement, and EI (white star) takes both the probability and magnitude of improvement into consideration. In this work, EI is selected as the acquisition criterion instead of PI due to its lack of sensitivity to the target offset value. The selection points for PI and UCB are plotted in Fig. 6b and c along with EI selection points for comparison. Both UCB and EI recommend testing in areas that have high variance, or areas that have not been experimentally probed. This is because the model requires more information across the design space (exploration) before it can begin to search for a maximum (exploitation). PI indicates a composition near the highest experimental utility composition because it exhibits a high chance of very minor improvement. The EI predicted optimal composition for the first iteration was 74 wt% rGO, 14.5 wt% ANFs, and 11.5 wt% CNTs. As shown in Fig. 3, the predicted composition was synthesized experimentally and its mechanical and electrochemical properties were characterized according to the methods described in sections 2.3 and S1.† The properties of the new composition are then used to update the mean and variance of the utility predictions. This process constitutes one iteration and is repeated to find the composition with the highest utility.
The first iteration was found to have the highest utility of the predicted compositions of U = 0.875 for 74 wt% rGO, 15.5 wt% ANFs, and 11.5 wt% CNTs, Fig. 7b. Not only that this was the highest predicted utility, but it was also higher than the utilities obtained from the initial experimental data. The model was able to find a composition that had a 5.5% improvement in utility over the best performing composite (92.625 wt% rGO, 4.875 wt% ANFs, and 2.5 wt% CNTs) from the initial experimental data. The new composition also had a Young's modulus of 18.9 GPa and a strength of 66.3 MPa, which corresponded to an increase of 78.8% and 34.0%, respectively, relative to the highest performing initial experimental composition. However, the capacitance at 1 mV s−1 was 117.2 F g−1, representing a 29.6% decrease. This is because the model equally weights the mechanical and electrochemical performance while the initial experimental data prioritize the electrochemical performance over the mechanical performance due to being focused around high rGO loadings.
Fig. 7 (a) Predicted utility function after 6 iterations and (b) utility of samples with composition predicted by EI at each iteration. |
The model next explored relatively high ANF content compositions (such as 70 wt% rGO, 22 wt% ANFs, and 8 wt% CNTs) only to find the utility in those areas to be fairly low. This is due to the low surface area of the electrically conductive material in the composite resulting from the low rGO content. This caused low capacitance values and poor cycle stability leading to a reduced ECU. The model then recommended relatively high CNT content compositions (such as 70 wt% rGO, 0 wt% ANFs, and 30 wt% CNTs). While the high CNT content electrodes performed well electrochemically (due to the CNTs contribution to the capacitance), the mechanical properties were found to be low due to the lack of a mechanical nanofiller. This led to reduced interactions between the electrode components and a reduced mechanical utility.
After 6 iterations, the utility surface predicted using the model, Fig. 7a, changed drastically as compared to the predicted utility using only the initial experimental data, Fig. 6a. These results are significant because we were able to find the highest utility composition (74 wt% rGO, 15.5 wt% ANFs, and 11.5 wt% CNTs) in an area of the design space that would not have been explored as rapidly when using only experimental approaches. The use of materials informatics reduced the number of experiments that would have been required to find this optimal composition when compared to systematically exploring the design space. Furthermore, the model gives additional insight into the trade-offs between the electrochemical and mechanical performance when considering composite materials by predicting maxima and minima in the response surface at certain compositions.
Footnote |
† Electronic supplementary information (ESI) available. See DOI: 10.1039/c8me00060c |
This journal is © The Royal Society of Chemistry 2019 |