Rohit
Attri
a,
Indrajit
Mondal
b,
Bhupesh
Yadav
b,
Giridhar U.
Kulkarni
*b and
C. N. R.
Rao
ab
aNew Chemistry Unit and School of Advanced Materials (SAMat), Jawaharlal Nehru Centre for Advanced Scientific Research, Bangalore 560064, India. E-mail: kulkarni@jncasr.ac.in
bChemistry and Physics of Materials Unit and School of Advanced Materials (SAMat), Jawaharlal Nehru Centre for Advanced Scientific Research, Bangalore 560064, India
First published on 21st November 2023
Closely mimicking the hierarchical structural topology with emerging behavioral functionalities of biological neural networks in neuromorphic devices is considered of prime importance for the realization of energy-efficient intelligent systems. In this article, we report an artificial synaptic network (ASN) comprising of hierarchical structures of isolated Al and Ag micro–nano structures developed via the utilization of a desiccated crack pattern, anisotropic dewetting, and self-formation. The strategically designed ASN, despite having multiple synaptic junctions between electrodes, exhibits a threshold switching (Vth ∼ 1–2 V) with an ultra-low energy requirement of ∼1.3 fJ per synaptic event. Several configurations of the order of hierarchy in the device architecture are studied comprehensively to identify the importance of the individual metallic components in contributing to the threshold switching and energy-minimization. The emerging potentiation behavior of the conductance (G) profile under electrical stimulation and its permanence beyond are realized over a wide current compliance range of 0.25 to 300 μA, broadly classifying the short- and long-term potentiation grounded on the characteristics of filamentary structures. The scale-free correlation of potentiation in the device hosting metallic filaments of diverse shapes and strengths could provide an ideal platform for understanding and replicating the complex behavior of the brain for neuromorphic computing.
New conceptsNeuromorphic devices built using hierarchical systems hold great potential when it comes to closely mimicking the biological neural network, both functionally and structurally. However, such systems reported in the literature having a network of artificial synapses possess limited structural hierarchy, and are also energy expensive. Here, we report a simple cost-effective process to design an artificial synaptic network (ASN) comprising self-formed hierarchical structures of Al and Ag of different length scales. The ASN hosting network of nanogaps structurally resembles the biological synaptic network and shows energy consumption per synapse of the same order. The ASN potentiated using electrical pulses emulates synaptic plasticity over a wide-range of current compliance (ICC) where the behavior of the conductance (G) profile with ICC can be classified based on the strength of filamentary nanostructures. We have performed a detailed study of relating the G during the potentiation and its sustenance afterward, which is lacking in the literature. The current device provides an ideal platform for studying the complex cognitive behavior of the brain; the Al islands in the ASN could be used for probing the in situ evolution of dynamic Ag filaments under ICC and for introducing external sensory signals. |
Examples of artificial synaptic devices from the literature are paradigms for neuromorphic computing tasks beyond the von-Neumann architecture.15–17 Development of several such novel two- or three-terminal devices using different dimensionality materials for efficient neuromorphic computing can be found in the recent review by Song et al.18 These devices often lack the inherent dynamically evolving hierarchical topology of the biological neural network. They are rigid and generally arranged in a crossbar array using highly sophisticated patterning techniques.19 These recipes require sequential processing involving rigorous steps and are not always straightforward for high throughput scalability.20 In contrast, the scale-free structural hierarchy of highly interconnected neurons within different regions of the brain is the basis of various cognitive functionalities.21 In this regard, the emergent behaviour of self-assembled or self-formed networks of nanomaterials with built-in resistive switches has been studied and seems to be promising.22–25 By definition, the fabrication of an active element is straightforward, involving simple synthesis routes and depositing on pre-made electrodes. Several such hierarchical systems, such as networks of nanowires with core–shell structures,26,27 atomic switches,22,24 and single-walled carbon nanotubes,28,29 as well as percolating tunnelling gaps in metallic nanoparticles30–32 have been shown to imitate biologically plausible properties like self-organisation,24,30 adaptability,27,33 leaky integrate and fire,34 long-range temporal correlations, and small-worldness.31 It is perceived that hierarchical features give more versatility in terms of how the G behaviour can be manipulated over wide ranges. However, random networks of nanostructures explored thus far possess only limited structural hierarchy.35
What is desirable is an active element having a higher-order hierarchical structure, much like the biological system, where plasticity emerges from dynamical filamentary connections of varying strength depending on the extent of potentiation or pulse characteristics. Self-formed dewetted structures exhibiting resistive switching are predicted to be an ideal platform for emulating brain-like behaviour. It has been shown that dewetted Ag structures facilitate various learning activities under optimised operating conditions.23,36–38 Such a system can host a diverse range of filaments where the formation would invoke electromigration by atomic diffusion in nanogaps, making numerous connections. Given the highly dynamic nature of the filaments, the contact electrodes are to be in close proximity for good retention, which restricts complete exploitation of the diversity of the formed filaments. Developing an artificial synaptic network (ASN), which is scale-free and offers a wide range of G tuning while being energy efficient, is therefore of paramount importance.
In this context, we have developed an in-plane device architecture with the active element consisting of tens of μm wide Al islands separated by a network of cracks (12–20 μm) filled with Ag agglomerates (a few hundred nm) as well as nanoparticles (diameter ∼ 27 nm). Thus, the produced hierarchical structure exhibits volatile threshold resistive switching at nominal threshold voltages (Vth) of ∼1–2 V, in spite of the large device span (0.5 mm). Scanning electron and optical microscopy characterisation was performed to unravel the conducting filament formation in the tiny nanogaps. Under optimised pulsing conditions, STP and LTP states have been realised with a minimised energy consumption per synapse of ∼1.3 fJ. The present architecture enables scale-free fabrication of neuromorphic devices while maintaining favourable operating conditions. Additionally, the larger Al islands could serve as contact pads for signal manipulation.
Fig. 2 deals with I–V characteristics and the associated parameters. During the forward sweep, as the applied voltage increased beyond 48 V, the device D2 (without c-Al, see Fig. 2(a)) switched from the high resistance state (HRS, I ∼ pA) to a low resistance state (LRS), limited by the set compliance, ICC (105 nA, blue curve). This amounts to forming of devices under an applied electric field, Vth (forming) ∼48 V. Such systems with metal nanostructures separated by nanogaps tend to host conducting filaments under the influence of the electric field, often enhanced due to electromigrated atoms forming sharp tips (see Fig. S10, ESI†).8 These connections are only momentary; as the applied voltage is reduced, the filaments retrieve opening up nanogaps, and hence, the device resets back to the HRS (see the red curve in Fig. 2(a)). The Vth value observed from the forming step is somewhat higher; however, the threshold value comes down substantially in the following sweeps to a narrower range of around 10 to 15 V as the accumulated electromigratory metal from repeated sweeps fills the larger gaps (see Fig. S6c and S10, ESI†). It may be observed that in consecutive sweeps, the current increases only gradually with voltage nearly overlapping with other curves till the respective Vth is reached. This current is an additive result of tunnelling processes across the numerous nanogaps present in the active element of the device.
Fig. 2 I–V characteristics of devices fabricated without (a), and with (b) c-Al with ICC set at 105 nA (the forming step, dark shade; color saturation increasing with successive sweeps in a narrow voltage range). Schematic of the device architecture along with the corresponding FESEM image (scale bar, 1 μm) is presented on the right. (c) Distribution in the threshold voltage (Vth) values for the control devices, without (blue), and with (purple) c-Al. The median (squares) and median absolute deviation (MAD as error bar) of the experimentally derived Vth data (circle) are also shown. (d) FESEM image of D1 post electrical stress showing outgrowth (red arrows) in nanogaps intervening Ag agglomerates (yellow dash line) emulated as a network of artificial synapses. Green arrows indicate filamentary growth. (e) Energy consumption per synapse. Dashed line stands for a typical value of 10 fJ observed in the case of biological synapses. Device D6 did not show a switching behaviour and is not included. Error bars correspond to the spread in the number of synapses around an agglomerate (see Fig. S13 and S14, ESI† for details). |
Unlike D2, the device D1 with a hierarchical c-Al/Ag agglomerate/Ag nanoparticle structure exhibited an abrupt resistive switching when the forming voltage exceeds ∼2.35 V (Fig. 2(b)). It is striking that this value is ∼20 times lower compared to that in the case of D2, without c-Al. However, in spite of the presence of c-Al, D3 exhibits higher forming (9.3 V) and switching voltages, 4 to 6.5 V, clearly due to the absence of Ag nanoparticles that enable facile filament formation. The important role of the agglomerates becomes apparent while referring to D5 (only nanoparticles in between Al islands), where the forming and switching voltages are way higher being in the range of tens of volts. Similar is the scenario with D4 and D6 in the absence of intervening Al islands. D6 without c-Al as well as Ag agglomerates simply failed to exhibit a resistive switching behavior. Indeed, the switching behavior and the associated Vth values play a decisive role in defining the pulsing conditions to be used for a neuromorphic device. The above observations are captured in Fig. 2(c). Device D1 with Ag agglomerates and nanoparticles present in c-Al exhibits a low Vth with a narrow spread, as indicated by its median absolute deviation (MAD) value. However, in the absence of c-Al in D2, not only its Vth is high, the MAD value is also higher, indicating a larger Vth spread. It is evident that the Vth value is significantly higher in all the devices without the c-Al structure, even in the presence of Ag nanostructures. A similar trend is also observed with the forming voltage, as depicted in Fig. S11 (ESI†). Conductive AFM images of D1 in HRS clearly show a high conduction path offered by c-Al facilitating Ag filament formation in the micro-gap regions at such low Vth (see Fig. S12, ESI†). Wu et al. have shown the growth of Ag filaments under a constant voltage bias of 30 V in a planar device with Ag–Al electrodes where the active element was a hybrid layer of Al2O3 nanoparticle arrays in a polyimide (PI) matrix across an active area ∼1.8 × 105 μm2.42 This may be compared with the present study which employs more than 30 times lesser Vth (0.82 V) for the device active area nearly 14 times higher (25 × 105 μm2)! Other literature values from Ag filament based two-terminal devices are listed in Table S1 (ESI†).
The device architecture bears a resemblance to the biological neural network where Ag agglomerates could be considered as spatially distributed neurons and the nanogaps separating them as the synapses (see Fig. 2(d) and Fig. S10d, ESI†). Under the effect of an electric field, Ag nanoparticles tend to form filamentary structures while the agglomerates deform into protrusions (see red and green markings in Fig. 2(d)). The resulting connections could be considered as information transmission pathways similar to biological synapses. The energy required to form such filamentary connections is derived from the analysis detailed in Fig. S13 and S14 (ESI†). Energy consumption per synapse is shown in Fig. 2(e) for devices D1–D4, and the values are comparable with the typical value per synaptic event in biological systems.43 Device D1 having a hierarchical c-Al/Ag agglomerate/Ag nanoparticle structure exhibits the lowest value of energy consumption per synapse, ∼1.3 fJ. Thus, D1 with a hierarchical active element has much to offer. In neuromorphic systems, the conduction paths are generally filamentary and highly dynamic in nature and for their retention, the contact electrodes are to be in close proximity, which not only brings restrictions on device geometry (top contacts versus in-plane) but also on the size of the active volume (area) of the device. Larger device volumes (area) also demand higher threshold voltages. In c-Al, the presence of Al islands interlacing the network of gaps filled with Ag nanostructures plays a crucial role in keeping the parameters under check.
The setup used for measuring the temporal characteristics of the device D1 is shown in Fig. 3(a). The voltage pulse train consisted of 10 or 20 pulses (total time, tp, 1.48 and 3.09 s, respectively) with magnitude VP of 1 V, width, tw and interval, ti of 50 ms each, riding on a constant reading voltage VR of 10 mV, such that during pulsing, the device switches to LRS limited by the set ICC (also see Fig. S15, ESI†). The Ag filament formation and percolative conduction in LRS (see the dashed red line in Fig. 3(a)) as allowed by the set ICC was monitored in terms of rise in conductance, G, of the device (see Fig. 3(b)). Beyond the pulse duration, the sustenance of G would critically depend on the strength of the filaments formed. Accordingly, for low ICC values (0.25 to 0.75 μA, see Fig. 3(c)), the rise in G is found to be quite gradual and non-monotonous, while the same becomes relatively steady and steeper with increasing ICC (1 to 5 μA). With further increase in ICC (30 to 300 μA, see Fig. 3(d)), the rise is not only abrupt but is also noticeably much higher (∼50 to 300 μS) even with a lesser number of pulses (from 20 to 10) (also see Fig. S16, ESI†). The number of pulses was reduced not to overburden the device with electrical stress.
Besides the strength, the ICC value also determines the life of the filaments. The G value attained at the end of pulsing, GLanuch or briefly GL, is a cumulative effect of filament formation, connectivity, and breakage. While its magnitude stands for the number and strengths of the filamentary connections formed, the longevity measured as the retention time (tr) signifies the degree of potentiation in the context of the neuromorphic action. For low ICC values, GL is small, typically ∼1 to 3 μS, and the G retention is limited up to a few seconds only, and the curve being quite bumpy. This time domain may be referred to as short-term potentiation (STP). For ICC of a few μA, we see an overall improvement in GL and also in G behavior during retention, which is much more pronounced for tens and hundreds of μA of ICC. Thus, the change in the behavior of GL from being gradual and small to becoming steep and high, and the accompanying changes in the tr behavior (from a few seconds to a few minutes) together mark the STP–LTP transition.
We have made a detailed analysis of the G profile in order to gain a better understanding of how the building up of the profile during pulsing influences the profile during retention (beyond pulsing) observed at different ICC values. For this purpose, GL (Fig. 4(a)) and tr (Fig. 4(b)) are plotted as a function of total electrical energy E, calculated as ICC × VP × tp, imparted to the device. The GL value increases nearly linearly at lower electrical stresses (∼0.8 to 9.3 μJ) and then remains somewhat constant (∼20 μS) up to 31 μJ and tends to increase again. Almost concomitantly, the tr value is seen undergoing similar changes in the range ∼1 to 104 μJ. The dip in values seen towards the end may arise due to the instability of weak filaments and may have some contribution from the decrease in the length of the pulse train (20 to 10 pulses). Beyond this range, the increase in tr is steep, ranging to a few minutes. Interestingly, this turn-around behavior at ∼100 μJ corresponds roughly to GL reaching the quantum conductance value (G0 ∼ 77.5 μS) (see the dashed blue line, Fig. 4(a)). The schematic in Fig. 4(d) illustrates the nature of events possibly at play in the device active elements, c-Al/Ag agglomerates/Ag nanoparticles. For a device in HRS, the observed conductance, albeit being low, is cumulative of all tunnelling across nanogap junctions present in the active element. With the electrical stress inducing filamentary growth into the junction regions, the gaps are effectively reduced, giving rise to a steady increase in conductance, monitored as GL. With increasing ICC, this value reaching a plateau (at ∼20 μS) while the tr value dropping are indicative of some junctions getting excessively annealed. However, a further increase in ICC establishes direct contacts, including the possibility of atomic contacts exhibiting quantum conductance. In this sense, in the present device, the STP regime is dominated by potentiation via tunnelling junctions, while LTP involves current flow through direct contacts, which is in line with the literature.13
The building up of the G profile during pulsing is captured here as the average of the G profile values collected during the pulse train period, GAverage or briefly GA. As shown in Fig. 4(c), GL varies just as GA itself over a wide range (0.8 to 292 μS). Thus, the GA value provides an insight into how the G profile builds up utilising the underlying nanostructure guided by the pulsing conditions. Electrical pulsing induces atomic electromigration resulting in filamentary growth into tunnel gaps,44 while the accompanying Joule heating may lead to annealing or even breaking of the contacts.45 With higher ICC (>70 μA), the filamentary connections can come live with initial pulses only leading to a steep rise in G and its saturation, which may continue till the pulse train is completed (see schematic, Fig. 4(d)). Thus, its GA would come close to GL. How the G profile reaching saturation early on, may influence tr will be discussed in the next section.
Both ICC and pulse characteristics decide the nature of filamentary paths and, in turn, the time profile of the conductance (G-profile). Accordingly, G profile data were collected (on another D1 device) at different ICC values (0.5 to 20 μA) and at each value, the number of pulses was varied (Np, 5 to 60), while keeping other parameters fixed. In the example data set with ICC of 0.5 μA shown in Fig. S17 (ESI†), the G rise is quite non-monotonous and so is the decay, the GL value being quite low (less than 3 μS) even at high NP. During consecutive acquisitions under similar pulsing conditions, the device was allowed to relax back to HRS after its retention, so as to avoid any remnant effect. Fig. 5(a) shows how at a given ICC value, GA increases with increasing NP, nearly linear for all ICC values except at 20 μA, where G saturates early (NP, 20). The estimation of GA from G profiles is detailed in Fig. S18 (ESI†). The influence of Np on GA is evident from the plot of the slopes of the GA–Np linear fits versus ICC shown in Fig. 5(b). The variation is exponential with the applied pulse, having contributions from the formation of new filaments and strengthening of the existing set of filaments.
Further, we have analysed the data by plotting tr against GL, as depicted in Fig. 5(c). The data points fall into different groups (see shaded regions) based on the ICC values. At 5 μA of ICC, tr varies from a few seconds to tens of seconds and GL from ∼7 to 17 μS indicated by the violet band. The range of tr gradually enhanced to a few hundreds of seconds, and GL from ∼10 to 40 μS at higher ICC of 10 μA, respectively. The trend of tr with GL indicates potentiation with increasing ICC. However, tr drops to a few seconds at 20 μA of ICC, indicating some filament fatigue, possibly from an overdose of electrical stress. The behaviour of tr with GL is similar to what is observed in Fig. 4(b), suggesting a low effect of NP variations on the G profile behaviour compared to ICC (refer to Fig. 4(d)). Apart from the complete decay of GL indicated by tr, the initial decay of GL at different ranges of ICC (see Fig. 4(d)) could also be significant in the context of fine grading of plasticity beyond roughly categorising as STP and LTP, as often the initial decay could be much faster. For this purpose, we chose the tr value corresponding to G reaching 90% of the GL value (in other words, tr measured till G ∼ 0.1 GL) as a representative figure and plotted it as a function of GL for different ICC (see Fig. 5(d)). It is observed that for all ICC till 20 μA, G drops to 0.1 of the corresponding GL within ∼50 seconds, while rest of the decay may prolong as seen with the total tr variation in Fig. 5(c). However, for 10 μA ICC, some data points of G decaying to 0.1 GL took up to 150 seconds, which indicates that the electrical stress is strong enough to cause significant potentiation but not to burn the filaments.
Fig. 6 depicts a plot relating the building up of the G profile during pulsing in the form of GA with the final state attained at the end of pulsing as GL. It is remarkable that the data points from all the ICC and the NP value studies are spread around the linear relationship of GL with GA (see the green band, Fig. 6), suggesting a scale-free temporal correlation between the two quantities. The spread of GL becomes narrower with increasing ICC as the strengths of the filaments improve.
Fig. 6 Correlation of GL with GA of the G profile with varied Np in the ICC range of 0.25 to 300 μA. Data are sourced from Fig. 4 and 5. |
A discussion of the above results is worthwhile. The I–V characteristics in Fig. 2 highlight the role of c-Al in effectively reducing Vth and in turn, the energy consumption per synapse of the ASN. The polygon-shaped Al islands intensify the local electric field at regions with high curvatures, which may guide the facile filamentary growth (refer to Fig. S12, ESI†), similar to the one reported by Boland and co-workers for activating the Ag nanowire network by varying the electrode shape.46 The nature of Ag filaments formed during pulsing can broadly explain the observed G behaviour. The gradual and bumpy G profile (GL, 1 – 3 μS) with pulses indicates thin filamentary growth in tunnel gaps at play, which get strengthened and extend further with GL (up to 20 μS), followed by non-monotonically decaying G as the structures relax. An abrupt and sturdy profile with initial pulses only, at GL above G0, marks the formation of stable thick filaments which may not build up with further pulses and whose G retention is usually steady and lasts longer. These two scenarios can be easily identified at low and high ICC in the schematic presented in Fig. 4(d), and also the ICC or NP determining the filamentary growth is widely reported in the ECM literature.7,12,13,47 The turnover of the G profile from gradual towards steeper with ICC may facilitate the filament density, but excessive electrical stress ends up annihilating them due to low ampacity expected of thin filaments, which results in a step in GL along with significantly low tr. Saturation of GA beyond 20 pulses in Fig. 5(a) can also be related to a similar phenomenon. The tr bands in Fig. 5(c) are seen to be overlapping in some regions of GL, indicating iso-G states which could be achieved by manipulating the combination of filament density and strength.12 However, a detailed in situ microscopic investigation is to be carried out to gain further insight into the influence of pulse characteristics on behaviour of the G profile in a hierarchical structure-based ASN. The current device features the short-term plasticity over a wide GL range (see Fig. 5(d)), which is the basis of various cognitive activities.48 Tunable relaxation behaviour of ASN with volatility could be utilised for complex computing tasks employing a neuromorphic approach and hardware security.49,50 We believe that developing ASN devices in close resemblance to the biological brain would allow us to understand the complex mechanism of cognitive learning emerging from the plasticity of a network of synapses. The futuristic scope of the work could be relating to emulating complex associative learning wherein the c-Al islands will be exploited as input electrodes to feed different stimuli simultaneously as multiple sensory signals.
Footnote |
† Electronic supplementary information (ESI) available: Figures supporting main text. See DOI: https://doi.org/10.1039/d3mh01367g |
This journal is © The Royal Society of Chemistry 2024 |