Chronic exposure to cigarette smoke extract increases nicotine withdrawal symptoms in adult and adolescent male rats

Abstract

The aim of the current study was to determine whether non-nicotine constituents of cigarette smoke contribute to nicotine dependence in adolescent and adult male Sprague Dawley rats. For 10 days animals were given three times daily intravenous injections of nicotine (1.5 mg/kg/day) or cigarette smoke extract (CSE) containing an equivalent dose of nicotine. Both spontaneous and mecamylamine-precipitated withdrawal were then measured. Chronic treatment with CSE induced significantly greater somatic and affective withdrawal signs than nicotine in both adolescents and adults. Mecamylamine-precipitated somatic signs were similar at both ages. In contrast, animals spontaneously withdrawn from chronic drug treatment exhibited significant age differences: whereas adolescents chronically treated with nicotine did not show somatic signs, those treated with CSE showed similar physical withdrawal to those of adults. Mecamylamine did not precipitate anxiety-like behavior at either age. However, both adolescents and adults showed significant anxiety in a light-dark box test 18 h after spontaneous withdrawal. Anxiety-like behavior was still evident in an open field test 1 month after termination of drug treatment, with adolescents showing significantly greater affective symptoms than adults. Our findings indicate that non-nicotine constituents of cigarette smoke do contribute to dependence in both adolescents and adults and emphasize the importance of including smoke constituents with nicotine in animal models of tobacco dependence.

Introduction

Physiological dependence is a key aspect of compulsive drug use [1]. Smoking cessation can result in both somatic withdrawal signs, including insomnia and bradycardia, and affective signs such as craving, restlessness, irritability, anxiety, and difficulty concentrating [2]. These withdrawal signs can emerge within 20 min after cessation and may persist for months [2, 3].

Most tobacco use begins during adolescence [3]. Whereas teen smoking has declined in the United States within the last decade, the use of electronic cigarettes (e-cigarettes) has escalated [4–6]. Clinical studies report that teens are sensitive to withdrawal from cigarette use, showing signs of dependence soon after initiation and before establishing daily use [7, 8]. Teens can also become addicted to e-cigarettes with dependence correlating highly with salivary cotinine, a nicotine metabolite [6, 9, 10]. Although there are limited data on withdrawal from e-cigarettes, there are likely several common features between cigarette and e-cigarette withdrawal, such as craving, tolerance, and impaired control [11]. In one study of adults, ∼25% of e-cigarette users had withdrawal symptoms upon quitting which were less severe than that caused by quitting tobacco cigarettes [12]. A recent study of adolescents suggests similar levels of dependence in users of e-cigarettes and combustible cigarettes [13].

Animal studies have shown that nicotine withdrawal symptoms in adult rodents are similar to those of humans smokers [14–16]. However, there are substantial differences in the findings of clinical and preclinical studies of withdrawal in adolescents. Whereas teenagers are very sensitive to the effects of smoking cessation [7, 8], rodent adolescents show fewer somatic and affective signs of nicotine withdrawal than adults [17–19]. One possible reason for this discrepancy is that most animal studies use nicotine alone without non-nicotine constituents found in cigarette smoke. Studies in which tobacco smoke is chronically administered via inhalation induces physical dependence in both adult and pre-adolescent rats [20–22]. Others have shown that inhibition of monoamine oxidase, as occurs with tobacco smoke [23, 24], potentiates nicotine withdrawal [25, 26]. However, none of these studies have done systematic comparisons across drugs and ages, as our current study does.

Use of aqueous cigarette smoke extract (CSE) permits the study of the collective effects of thousands of cigarette smoke constituents on withdrawal. In solution form it allows control of daily drug exposure, which may not be possible via inhalational exposure. We have previously found that CSE self-administration is associated with increased stress-induced reinstatement as compared to nicotine alone [24, 27], which may indicate that tobacco constituents sensitize animals to stress responses and to the negative effects of tobacco dependence. The present study tests this hypothesis by comparing the effects of daily exposure to CSE and nicotine on both somatic and affective signs of spontaneous and precipitated withdrawal in adolescent and adult male rats. This work is part of the dissertation of the first author [28].

Materials and methods

The materials and methods used in this study have been described previously [28].

Animals

Male Sprague Dawley rats (Charles River Labs, Hollister CA) were delivered at postnatal day (P)17 with dam or at P81 and were housed 2–3 per cage in a humidity- and temperature-controlled vivarium with a 12 h light cycle, with lights turned on at 7 a.m. daily. Pups were weaned at P21 and similarly housed. To reduce surgical stress, animals were handled for 2 days prior to catheterization surgery. Adolescents were free-fed while adults were food restricted to be kept at a 95% free-feeding weight during the duration of experiments. All experimental procedures followed NIH guidelines and were approved by the Institutional Animal Care and Use Committee of the University of California, Irvine.

Drugs

Nicotine hydrogen tartrate (Sigma, St. Louis, MO) was dissolved in sterile saline and adjusted to pH 7.2–7.4, with dose calculated as free base. Mecamylamine HCl (Tocris Bioscience, Bristol, United Kingdom) was dissolved in sterile saline with dose calculated as salt. CSE was produced by bubbling commercial cigarette smoke (Camel unfiltered, R.J. Reynolds Co.) through sterile saline, as described previously [24, 29]. The final CSE solution was adjusted to pH 7.2–7.4 and was prepared each day immediately before experimental testing to minimize potential degradation of the constituents. CSE was regularly analyzed by GC-MS (UCI Mass Spectrometry Facility), with some samples also sent to an outside facility (UCSF Clinical Pharmacology Laboratory), to verify nicotine content.

Surgery

Adults (P85–87) and adolescents (P26–28) were anesthetized with equithesin (0.0035 mL/g body weight) and implanted with indwelling jugular vein catheters based on previously published methods [24]. Animals were anesthetized with Equithesin (0.3 mL/100 g, i.p. for adults, 0.25 mL/100 g, i.p. for adolescents) and a chronic catheter was passed subcutaneously from the animal’s back to the jugular vein where the tubing was inserted. Wounds were closed with clips, antiseptic ointment applied, and Baytril (0.1 mL/150 g, i.m.) was injected to prevent infection. During the 2–3 days recovery period, and for the remainder of the study, animals were flushed daily with heparinized saline solution (1 mL of 1,000 units/mL heparin into 30 mL bacteriostatic saline).

Chronic drug treatment

Following recovery from surgery, adult (P89-91) and adolescent rats (P30-32) were weighed daily and given passive intravenous injections of saline, nicotine or CSE in an operant chamber programmed to deliver one injection per minute for 15 min (15 infusions per session), to yield a total of 0.5 mg/kg nicotine (free base) or CSE nicotine content per session [total of 0.5 mg/kg nicotine (free base) or CSE nicotine content per session (33.33 μg/kg nicotine content/infusion; 70 μL/infusion in 3.92 s for adults and 35 μL/infusion in 1.96 s for adolescents)]. Rats received three daily infusion sessions (9 a.m., 12 p.m., 3 p.m.) totaling 1.5 mg/kg/day of nicotine content for 10 consecutive days, including weekends. The dose of nicotine delivered is within the range of prior self-administration studies with nicotine and CSE in adolescents and adults [30].

Spontaneous somatic withdrawal

For spontaneous somatic withdrawal, rats underwent withdrawal scoring before surgery and drug treatment began, and 1, 4, 18, and 48 h after the last drug injection. Somatic symptoms were assessed for 30 min following 30 min habituation to the open field chamber (17″ × 17″ × 12″) (Med Associates, St. Albans, VT). An observer blind to drug groups scored the following symptoms: body shakes, tremors, eye blinks, genital licks, gasps, head shakes, ptosis, teeth chattering, yawns, and writhes [30]. Withdrawal was defined as a significant increase in total withdrawal symptoms as compared to the saline group at the same time point. Catheter patency was verified by rapid anesthesia following infusion of 0.1 mL of propofol (Abbott Laboratories, Chicago, IL) after scoring the 4 h withdrawal time point. Animals without patent catheters were excluded from analysis.

Precipitated somatic withdrawal

To investigate nAChR involvement in CSE withdrawal, a separate group of animals received an injection of saline or mecamylamine (1 mg/kg. s.c.), a non-selective nAChR antagonist, immediately following the last drug infusion, and were placed in the open field chamber and scored for somatic withdrawal symptoms for 60 min. Withdrawal was defined as a significant increase in total withdrawal symptoms as compared to the vehicle treated group. Catheter patency was verified for rapid anesthesia by infusing 0.1 mL of propofol (Abbott Laboratories, Chicago, IL) immediately following the test. Animals without patent catheters were excluded from analysis.

Spontaneous affective withdrawal

Spontaneous affective withdrawal was measured 18 h following the last drug infusion using the light-dark box test for anxiety-like behavior. Animals were isolated in a plexiglass cage (16″ × 16″ × 12″) in the behavior testing room for 10 min, then were placed in the dark side of a light-dark box (17″ × 8.5″ × 12″ each side) (Med Associates, St. Albans, VT) and the time spent in the light versus dark chambers was recorded for 5 min [31]. Anxiety-like behavior was defined as an increase in the time spent in the dark side as compared to the saline group. The same groups of animals were tested for anxiety-like behavior using analysis of center time in an open field 30 days following the last drug infusion. Animals were isolated in a plexiglass cage in the behavior testing room for 10 min, then were placed in the center of an open-field chamber (43.2 cm × 43.2 cm × 30.5 cm) and the time spent in the center versus the periphery was recorded for 5 min. Anxiety-like behavior was defined as a decrease in the time spent in the center of the open field chamber as compared to the saline group.

Precipitated affective withdrawal

To measure precipitated affective withdrawal, animals were injected with saline or mecamylamine (1 mg/kg, s.c.) immediately following the last drug infusion and isolated in a plexiglass cage for 20 min. After isolation, and a 5 min room habituation, the rats were placed in the dark side of a light-dark box (Med Associates, CA) and the time spent in the dark versus light chambers was recorded for 5 min. Anxiety-like behavior was defined as an increase in the time spent in the dark compartment as compared to vehicle treated groups.

Data analysis

Age differences in mean total spontaneous somatic withdrawal symptoms following chronic nicotine or CSE treatment were analyzed with a 3-way ANOVA for Age × Drug × Time, with repeated measures on Time. Significant main effects were analyzed further with ANOVAs and Bonferroni-corrected paired or unpaired t-tests, where appropriate. For spontaneous affective withdrawal, the % time spent in the dark side and the % time spent in the center were analyzed with a 2-way ANOVA for Age x Drug. Significant main effects were analyzed further with Bonferroni-corrected unpaired t-tests. For precipitated withdrawal, differences in mean total precipitated somatic withdrawal symptoms and % time spent in the dark side were analyzed with a 3-way ANOVA for Age x Drug x Antagonist dose. Significant main effects were analyzed further with ANOVAs and unpaired t-tests.

Results

Spontaneous somatic withdrawal

3-way ANOVA revealed overall effects of Age (F_1,50 = 8.185, p = 0.006), Drug (F_2,50 = 26.626, p = 0.000), Time (F_3,150 = 4.698, p = 0.004), with Age × Drug (F_2,50 = 3.436, p = 0.04) and Time × Drug (F_6,150 = 3.508, p = 0.002) interactions. Adults treated with CSE showed significant spontaneous somatic signs earlier than those treated with nicotine (Figure 1A). Overall ANOVA showed significant effects of Drug (F_2,26 = 14.894, p = 0.001). CSE withdrawal, defined as significantly different from saline-treated controls, was evident 4 h after the last CSE infusion (p = 0.006) and was significantly greater than that of rats treated with nicotine alone (p = 0.03). Significant nicotine and CSE withdrawal were seen 18 h (p = 0.029, p = 0.006, respectively), and at 48 h (p = 0.005, p = 0.001, respectively) after the last drug infusion.

FIGURE 1

Spontaneous cessation of CSE, but not nicotine, resulted in somatic withdrawal in adolescent rats (Figure 1B). There were significant Drug (F_2,24 = 17.041, p < 0.001) and Time effects (F_3,72 = 6.589, p = 0.001), and a significant Time × Drug interaction (F_6,72 = 4.674, p < 0.001). As has been reported previously [18, 19], adolescent rats did not show somatic withdrawal signs after a moderate dose or schedule of chronic nicotine treatment at any time point. Adolescent animals treated with CSE showed significantly higher somatic withdrawal signs than those treated with saline at 1, 18, and 48 h (p = 0.047, p < 0.001, p = 0.006, respectively) or nicotine at 4 and 18 h (p = 0.025, p = 0.001).

Adults treated with saline showed higher somatic signs than adolescents at 18 h (F_1,16 = 4.923, p = 0.041). Adults treated with nicotine showed higher somatic signs than adolescents at 1 h (F_1,17 = 4.554, p = 0.048), 18 h (F_1,17 = 5.074, p = 0.038), and 48 h (F_1,17 = 6.412, p = 0.021). Adults treated with CSE showed higher somatic signs than adolescents at 48 h (F_1,17 = 4.715, p = 0.044) but not at earlier time points.

Precipitated somatic withdrawal

Precipitated somatic withdrawal was higher in both adolescents and adults chronically treated with CSE than those treated with nicotine (Figure 2). Overall ANOVA showed significant Drug (F_1,74 = 16.819, p < 0.001) and Pretreatment effects (F_1,74 = 123.144, p < 0.001), with a significant Drug × Pretreatment interaction (F_1,74 = 14.871, p < 0.001). No significant Age effect or interaction was observed, in contrast to spontaneous withdrawal. Whereas injection with mecamylamine (1 mg/kg, s.c.) increased somatic withdrawal signs in animals treated with CSE or nicotine (p < 0.001). precipitated withdrawal signs were significantly higher in those treated with CSE (p < 0.001).

FIGURE 2

Spontaneous anxiety-like behavior

Eighteen hours after the last drug infusion, CSE-treated rats showed greater affective withdrawal signs than those treated with nicotine (Figure 3A). Although there was a significant effect of Drug (F_1,51 = 18.281, p < 0.001), there was no Age or Age × Drug interaction. Chronic CSE treatment significantly increased the time animals spent in the dark compartment as compared to chronic treatment with saline (p < 0.001) or nicotine (p = 0.001). There were no significant differences in total ambulatory counts, showing that the anxiety-related behavior did not result from locomotor effects (Figure 3B).

FIGURE 3

Thirty days after cessation of drug treatments, animals still showed anxiety-like behaviors, as measured by time spent in the center of an open field (Figure 4A). At this time, there was an overall effect of Drug (F_2,48 = 5.724, p < 0.001) with a strong trend for an Age effect (F_1,48 = 3.876, p = 0.055) and Age × Drug interaction (F_2,48 = 3.171, p = 0.051). Adults showed an overall effect of Drug (F_2,22 = 23.021, p = 0.01), with CSE-treated rats spending less time in the center of the field than those treated with nicotine (p = 0.009) but not saline. Adolescents showed an overall Drug effect (F_2,26 = 20.694, p < 0.001), with CSE-treated rats spending less time in the center of the field than saline- or nicotine-treated animals (p < 0.001). Adolescents treated with CSE also spent significantly less time in the center field than adults treated with CSE (p = 0.032), showing that adolescents are more susceptible to long-term anxiogenic effects of chronic CSE treatment than adults. The anxiety-like behaviors following long-term drug withdrawal did not result from locomotor effects, as there were no overall Drug or Age effects for total ambulatory counts (Figure 4B).

FIGURE 4

Precipitated anxiety-like behavior

Mecamylamine did not precipitate anxiety-like behavior in rats treated with CSE or nicotine (Figure 5A). Total ambulatory counts showed a significant effect of Age (F_1,55 = 9.139, p = 0.004), with adolescents treated with CSE moving less than adults (p < 0.05) (Figure 5B).

FIGURE 5

Discussion

The current study shows that CSE enhances spontaneous somatic and affective withdrawal in adult and adolescent rats as compared to chronic treatment with nicotine alone [28]. Since there was equivalent nicotine content across drug groups, this indicates that the non-nicotinic constituents in CSE contribute to neuroadaptations that occur during the formation of dependence, resulting in a greater withdrawal syndrome upon cessation. Animals treated with CSE showed higher mecamylamine-precipitated somatic withdrawal than animals treated with nicotine alone, suggesting that cigarette smoke constituents may enhance somatic withdrawal via a nAChR-based mechanism. Whereas termination of CSE treatment increased anxiety as compared to treatment with nicotine alone, the role of nAChRs is less clear, since mecamylamine did not precipitate affective withdrawal following either CSE or nicotine treatment.

Methodological issues

The study of tobacco use with preclinical models has been challenging as it is difficult to find an appropriate method to treat animals in a way that best mimics human smoking [28]. Although studies with smoke inhalation have demonstrated withdrawal after chronic treatment in adult and adolescent rats, these studies best model passive tobacco smoke inhalation [21, 32]. Another common way to chronically treat animals with nicotine is with an osmotic pump which maintains constant infusions over a chronic period [15–19]. This method does not model the daily perturbations of tobacco use in smokers, however. Nor does it permit alterations in the level of drug delivery as a developing animal grows. The treatment paradigm in the present study was via passive intravenous infusion, an approach that allowed daily preparation of CSE, which has non-nicotinic constituents of unknown stability. A further advantage of this intravenous administration protocol is that it allows easy control of the dose of nicotine that animals receive daily, which is particularly important in adolescent animals that are experiencing a rapid growth spurt. Thus, in contrast to earlier studies [18, 19, 33], the current infusion methodology allows direct comparison of the effects of equivalent chronic drug doses in adolescent and adult rats. A prior study in adolescent mice has shown that similar behavioral results can be obtained following chronic nicotine administration via osmotic minipumps or daily injections [34].

Nicotine withdrawal

Adolescent rodents have been shown previously to be less sensitive than adults to the effects of nicotine withdrawal [18, 19, 34]. This contrasts clinical studies that show adolescents have greater withdrawal than adults when quitting smoking [7, 8, 35]. We have replicated the finding that somatic symptoms following withdrawal of chronic nicotine treatment are lower in adolescent rats than adults. In contrast, we found no age differences in somatic symptoms when withdrawal was precipitated with mecamylamine. This contrasts with other reports in which mecamylamine-precipitated somatic withdrawal signs were less intense in adolescent rodents than adults [19, 34].

Neither adolescent nor adult rats showed significant withdrawal-induced anxiety either 18 h or 30 days following cessation of nicotine treatment, nor did mecamylamine precipitate anxiety-like behavior. These findings contrast with earlier reports; however, those studies used higher doses of nicotine [34, 36, 37].

CSE withdrawal

Withdrawal symptoms in both adolescent and adult rats were significantly more pronounced following chronic treatment with CSE than with nicotine. In contrast to nicotine-exposed adolescents who exhibited no somatic signs, spontaneous withdrawal from CSE produced adolescent somatic symptoms of similar intensity to those seen in adults. In contrast, no age difference was seen in mecamylamine-precipitated somatic signs in chronically CSE treated rats.

Eighteen hours following spontaneous withdrawal from CSE, both age groups showed enhanced anxiety-like behavior in a light-dark box test as compared to nicotine-treated rats or saline controls. Anxiety-like behavior in an open field test was still evident 30 days after spontaneous CSE withdrawal and was greater in adolescents than adults. Thus, the withdrawal syndrome that adolescents experience following chronic CSE exposure may be different from that in adults, with greater affective than somatic symptoms and a different time course. Similar long-term elevation in anxiety-like behavior has been seen in adult male mice following chronic inhalation exposure to cigarette smoke [32], and in adolescent rats given chronic daily nicotine injections [38, 39].

Although chronic treatment with CSE increased spontaneous anxiety-like behavior in adult and adolescent rats, mecamylamine did not precipitate affective withdrawal in either age group. This contrasts with what was observed for somatic withdrawal symptoms. There are several other reports that spontaneous and mecamylamine-induced withdrawal may not yield identical effects on the same behavioral test [15, 19, 40, 41]. The reason for this is not clear but may reflect the differential affinity of mecamylamine for multiple nAChRs [42].

Nicotinic receptors (nAChRs)

Prior studies have shown that different nAChRs have prominent roles in somatic and affective withdrawal symptoms. Mice with null mutation of β4 or α5 nAChRs subunits have fewer somatic signs of withdrawal [43, 44]. In contrast, elimination of β2 or α6 nAChR subunits attenuates affective withdrawal symptoms [43, 45]. We have previously shown that rats undergoing a chronic CSE treatment procedure identical to that used in the current study exhibit changes in nAChR binding in various brain regions 1 h after the last drug infusion [46]. Daily nicotine treatment did not significantly increase nAChR binding in any brain region at either age, a finding that contrasts with prior studies using higher drug doses and/or more chronic treatments [47–49]. Daily CSE exposure selectively increased adolescent α4β2 nAChR binding in medial amygdala and α7 nAChR binding in central amygdala and lateral hypothalamus. CSE also increased α3β4 nAChR binding in the medial habenula and interpeduncular nucleus, and α7 binding in the medial amygdala, independent of age. Almost all the brain regions in which CSE induced significant changes in nAChR binding have been associated with nicotine withdrawal behavior [50, 51]. The medial habenula—interpeduncular nucleus pathway is particularly implicated in both somatic and affective signs of nicotine withdrawal [52–54]. Interpeduncular nucleus GABAergic neurons are dynamically regulated during nicotine withdrawal, with resulting anxiety-like and somatic symptoms [55]. Furthermore, infusion of a β4-selective nAChR antagonist into the interpeduncular nucleus elicits somatic signs of nicotine withdrawal [56]. Thus, the CSE-induced increases in α3β4 nAChR binding seen in the medial habenula—interpeduncular nucleus pathway at both ages may underlie the observed increases in somatic withdrawal signs. Although the animals were currently exposed to CSE by passive exposure, it should be noted that we have previously noted that adult rats who self-administered CSE exhibit functional changes in α3β4 nAChRs mediating reinstatement of drug-seeking behavior [57].

Non-nicotine constituents

Although substantial work has been done on the identity of non-nicotine constituents that impact nicotine reinforcement and reward [24, 26, 58–62], there are few studies that have looked at the impact of individual constituents on nicotine withdrawal. One exception is monoamine oxidase inhibitors (MAOIs) in tobacco which reduce enzyme activity in the brains of smokers [63] and are present in CSE extracts [24, 64]. In rats, chronic MAOI treatment induces a prolonged conditioned placed aversion associated with nicotine withdrawal [25]. Furthermore, acute inhibition of MAO-A induces significantly greater nicotine somatic withdrawal signs than in control rats [26]. Thus, it may be MAOIs within CSE that induce greater somatic and affective withdrawal symptoms observed in the current study. Further experiments are required to examine the impact of MAOI inhibition on nicotine withdrawal in adolescents, and to determine whether there are similar alterations in α3β4 nAChRs observed in chronic CSE studies [40, 57].

Limitations

The current study has a few limitations. One of the major challenges in studying smoking in animals is using a model that best models smoking in humans, with use of CSE being no exception. In this study we used three times daily intravenous injections of drugs rather than the more commonly used osmotic minipump. There were advantages to this approach, including mimicking human consumption patterns, regular refreshing of CSE solution and matching drug intake to body weight in growing adolescents. However, given this different route of administration, we cannot fully compare our findings with those of earlier studies. Furthermore, although adolescent and adult animals were given matching doses, blood levels of nicotine and cotinine have been found to be lower than adults, impacting the validity of age comparisons [65]. Another limitation is that CSE contains only the aqueous constituents of cigarette smoke, and not the remaining ∼60% of non-aqueous components [28, 66]. The extracts commonly used in tobacco research are prepared in an organic solvent in order to dissolve the tar phase of the smoke [67, 68]. Since the current experimental paradigm requires intravenous infusion of CSE, an organic solvent was not practical.

One final limitation is the absence of female animals in our experimental design. As with the current study, most prior studies of nicotine withdrawal have focused on male rodents. However, substantial sex differences have been observed in both clinical and preclinical studies. Adult women are more likely than men to relapse after quitting cigarette use because of withdrawal symptoms, including tension, anxiety and craving [69, 70]. Adolescent females also report higher levels of stress and depression during withdrawal than their male counterparts [71]. Preclinical studies have similarly shown that adult, but not adolescent, females exhibit greater somatic and affective withdrawal symptoms than males [36, 72]. Enhanced withdrawal-induced anxiety in females is associated with greater corticosterone and ACTH release than males, indicating a more activated stress response [36, 73]. A recent study has shown that sex differences in glutamate and GABA response in the interpeduncular nucleus may mediate behavioral differences in withdrawal [74]. Given our current findings that CSE induces greater somatic and affective withdrawal signs in both adult and adolescent males as compared to nicotine alone, it will be very important to repeat this study in females.

Conclusion

Clinical studies in adults have indicated that smoking cigarettes produces higher levels of dependence than vaping e-cigarettes [12]. Similarly, adult mice chronically exposed to cigarette smoke show greater somatic and affective symptoms of withdrawal than those exposed to e-cigarette vapor [75]. In the present study, we have confirmed that non-nicotine tobacco constituents in CSE administered intravenously enhance both physical and affective symptoms of nicotine withdrawal in adult rats. We have previously shown that these constituents do not impact nicotine self-administration, but do enhance reinstatement induced by the pharmacological stressor, yohimbine [24, 27] and elevate and increase intracranial self-stimulation thresholds to a greater degree than high doses of nicotine alone [64]. Thus, tobacco constituents appear to increase the negative impact of withdrawal from chronic nicotine.

Given the recent substantial increase in e-cigarette use by teenagers [4–6], it is important to evaluate whether this mode of nicotine delivery produces similar levels of dependence to that of tobacco cigarettes. To date there have been no direct comparisons of the effect of tobacco smoke constituents. We have confirmed that chronic nicotine treatment results in higher somatic withdrawal signs in adolescents than adults. We have also shown that chronic nicotine, at this low dose, does not result in different anxiety-like behaviors in adolescents and adults following acute and long-term withdrawal. We now show that chronic CSE induces greater levels of both physical and affective dependence in adolescent rats than equivalent doses of nicotine alone. Our findings agree with prior studies that nicotine alone produces very little physical dependence in adolescent rodents [18, 19]. However, tobacco constituents increase somatic withdrawal symptoms in adolescents to levels observed in adults. Adolescents also show similar anxiety to adults immediately following spontaneous withdrawal of CSE and continue to exhibit this 1 month later at a level greater than that of adults. These findings complement our earlier observations that cigarette smoke constituents enhance yohimbine-induced reinstatement of nicotine seeking behavior in adolescents [27]. Future studies will be required to determine the mechanism of CSE action in enhancing withdrawal signs. However, it seems likely that elevated levels of α3β4 nAChR binding in the habenulo-peduncular pathway underlies the increased somatic symptoms of withdrawal in both adolescents and adults. Overall, our findings indicate the importance of using CSE, instead of nicotine alone, in preclinical models of tobacco dependence.

References

• 1

  Wise RA Koob GF . The development and maintenance of drug addiction. Neuropsychopharmacology (2014) 39:254–62. 10.1038/npp.2013.261

  • CrossRef
  • Google Scholar

• 2

  Hughes JR . Measurement of the effects of abstinence from tobacco: a qualitative review. Psychol Addict Behaviors (2007) 21:127–37. 10.1037/0893-164X.21.2.127

  • CrossRef
  • Google Scholar

• 3

  Centers for Disease Control and Prevention. Surgeon general’s report: the health consequences of smoking—50 years of progress (2014). Available from: https://www.cdc.gov/tobacco/data_statistics/sgr/50th-anniversary/index.htm (Accessed August 24, 2018).

  • Google Scholar

• 4

  Cullen KA Gentzke AS Sawdey MD Chang JT Anic GM Wang TW et al E-cigarette use among youth in the United States, 2019. JAMA (2019) 322:2095–103. 10.1001/jama.2019.18387

  • CrossRef
  • Google Scholar

• 5

  Miech R Leventhal A Johnston L O’Malley PM Patrick ME Barrington-Trimis J . Trends in use and perceptions of nicotine vaping among US youth from 2017 to 2020. JAMA Pediatr (2021) 175:185–90. 10.1001/jamapediatrics.2020.5667

  • CrossRef
  • Google Scholar

• 6

  Glantz S Jeffers A Winickoff JP . Nicotine addiction and intensity of e-cigarette use by adolescents in the US, 2014 to 2021. JAMA Netw Open (2022) 5:e2240671. 10.1001/jamanetworkopen.2022.40671

  • CrossRef
  • Google Scholar

• 7

  DiFranza JR Savageau JA Fletcher K O’Loughlin J Pbert L Ockene JK et al Symptoms of tobacco dependence after brief intermittent use: the development and assessment of nicotine dependence in youth–2 study. Arch Pediatr Adolesc Med (2007) 161:704–10. 10.1001/archpedi.161.7.704

  • CrossRef
  • Google Scholar

• 8

  Dierker L Mermelstein R . Early emerging nicotine-dependence symptoms: a signal of propensity for chronic smoking behavior in adolescents. J Pediatr (2010) 156(5):818–22. 10.1016/j.jpeds.2009.11.044

  • CrossRef
  • Google Scholar

• 9

  Vogel EA Prochaska JJ Rubinstein ML . Measuring e-cigarette addiction among adolescents. Tob Control (2020) 29(3):258–62. 10.1136/tobaccocontrol-2018-054900

  • CrossRef
  • Google Scholar

• 10

  Camara-Medeiros A Diemert L O'Connor S Schwartz R Eissenberg T Cohen JE . Perceived addiction to vaping among youth and young adult regular vapers. Tob Control (2021) 30(3):273–8. 10.1136/tobaccocontrol-2019-055352

  • CrossRef
  • Google Scholar

• 11

  Bold KW Sussman S O'Malley SS Grana R Foulds J Fishbein H et al Measuring e-cigarette dependence: initial guidance. Addict behaviors (2018) 79:213–8. 10.1016/j.addbeh.2017.11.015

  • CrossRef
  • Google Scholar

• 12

  Hughes JR Callas PW . Prevalence of withdrawal symptoms from electronic cigarette cessation: a cross-sectional analysis of the us population assessment of tobacco and Health. Addict behaviors (2019) 91:234–7. 10.1016/j.addbeh.2018.07.002

  • CrossRef
  • Google Scholar

• 13

  Lin C Gaiha SM Halpern-Felsher B . Nicotine dependence from different e-cigarette devices and combustible cigarettes among US adolescent and young adult users. Int J Environ Res Public Health (2022) 19:5846. 10.3390/ijerph19105846

  • CrossRef
  • Google Scholar

• 14

  Bauzo RM Bruijnzeel AW . Animal models of nicotine withdrawal: intracranial self-stimulation and somatic signs of withdrawal. Psychiatr Disord Methods Protoc (2012) 829:257–68. 10.1007/978-1-61779-458-2_16

  • CrossRef
  • Google Scholar

• 15

  Damaj MI Kao W Martin BR . Characterization of spontaneous and precipitated nicotine withdrawal in the mouse. J Pharmacol Exp Ther (2003) 307(2):526–34. 10.1124/jpet.103.054908

  • CrossRef
  • Google Scholar

• 16

  Malin DH . Nicotine dependence: studies with a laboratory model. Pharmacol Biochem Behav (2001) 70:551–9. 10.1016/S0091-3057(01)00699-2

  • CrossRef
  • Google Scholar

• 17

  Natividad LA Tejeda HA Torres OV O’Dell LE . Nicotine withdrawal produces a decrease in extracellular levels of dopamine in the nucleus accumbens that is lower in adolescent versus adult male rats. Synapse (2010) 64:136–45. 10.1002/syn.20713

  • CrossRef
  • Google Scholar

• 18

  O’Dell LE Bruijnzeel AW Smith RT Parsons LH Merves ML Goldberger BA et al Diminished nicotine withdrawal in adolescent rats: implications for vulnerability to addiction. Psychopharmacology (2006) 186:612–9. 10.1007/s00213-006-0383-6

  • CrossRef
  • Google Scholar

• 19

  Shram MJ Siu EC Li Z Tyndale RF Lê AD . Interactions between age and the aversive effects of nicotine withdrawal under mecamylamine-precipitated and spontaneous conditions in male Wistar rats. Psychopharmacology (2008) 198:181–90. 10.1007/s00213-008-1115-x

  • CrossRef
  • Google Scholar

• 20

  Chellian R Behnood-Rod A Wilson R Wilks I Knight P Febo M et al Exposure to smoke from high-but not low-nicotine cigarettes leads to signs of dependence in male rats and potentiates the effects of nicotine in female rats. Pharmacol Biochem Behav (2020) 196:172998. 10.1016/j.pbb.2020.172998

  • CrossRef
  • Google Scholar

• 21

  Small E Shah HP Davenport JJ Geier JE Yavarovich KR Yamada H et al Tobacco smoke exposure induces nicotine dependence in rats. Psychopharmacology (2010) 208:143–58. 10.1007/s00213-009-1716-z

  • CrossRef
  • Google Scholar

• 22

  Yamada H Bishnoi M Keijzers KF van Tuijl IA Small E Shah HP et al Preadolescent tobacco smoke exposure leads to acute nicotine dependence but does not affect the rewarding effects of nicotine or nicotine withdrawal in adulthood in rats. Pharmacol Biochem Behav (2010) 95:401–9. 10.1016/j.pbb.2010.02.018

  • CrossRef
  • Google Scholar

• 23

  Bacher I Houle S Xu X Zawertailo L Soliman A Wilson AA et al Monoamine oxidase a binding in the prefrontal and anterior cingulate cortices during acute withdrawal from heavy cigarette smoking. Arch Gen Psychiatry (2011) 2:817–26. 10.1001/archgenpsychiatry.2011.82

  • CrossRef
  • Google Scholar

• 24

  Costello MR Reynaga DD Mojica CY Zaveri NT Belluzzi JD Leslie FM . Comparison of the reinforcing properties of nicotine and cigarette smoke extract in rats. Neuropsychopharmacology (2014) 39:1843–51. 10.1038/npp.2014.31

  • CrossRef
  • Google Scholar

• 25

  Guillem K Vouillac C Koob GF Cador M Stinus L . Monoamine oxidase inhibition dramatically prolongs the duration of nicotine withdrawal-induced place aversion. Biol Psychiatry (2008) 63:158–63. 10.1016/j.biopsych.2007.04.029

  • CrossRef
  • Google Scholar

• 26

  Villégier AS Salomon L Granon S Changeux JP Belluzzi JD Leslie FM et al Monoamine oxidase inhibitors allow locomotor and rewarding responses to nicotine. Neuropsychopharmacology (2006) 31:1704–13. 10.1038/sj.npp.1300987

  • CrossRef
  • Google Scholar

• 27

  Gellner CA Carreño D Belluzzi JD Leslie FM . Impact of tobacco smoke constituents on nicotine-seeking behavior in adolescent and adult male rats. Front Psychiatry (2023) 14:1096213. 10.3389/fpsyt.2023.1096213

  • CrossRef
  • Google Scholar

• 28

  Reynaga DD . Nicotine craving and withdrawal: impact of cigarette smoke constituents and age. Irvine: University of California (2017).

  • Google Scholar

• 29

  Gellner CA Reynaga DD Leslie FM . Cigarette smoke extract: a preclinical model of tobacco dependence. Curr Protoc Neurosci (2016) 77:1–9. 10.1002/cpns.14

  • CrossRef
  • Google Scholar

• 30

  Gellner CA Belluzzi JD Leslie FM . Self-administration of nicotine and cigarette smoke extract in adolescent and adult rats. Neuropharmacology (2016) 109:247–53. 10.1016/j.neuropharm.2016.06.026

  • CrossRef
  • Google Scholar

• 31

  Malin DH Lake JR Newlin-Maultsby P Roberts LK Lanier JG Carter VA et al Rodent model of nicotine abstinence syndrome. Pharmacol Biochem Behav (1992) 43:779–84. 10.1016/0091-3057(92)90408-8

  • CrossRef
  • Google Scholar

• 32

  Ponzoni L Moretti M Sala M Fasoli F Mucchietto V Lucini V et al Different physiological and behavioural effects of e-cigarette vapour and cigarette smoke in mice. Eur Neuropsychopharmacol (2015) 25:1775–86. 10.1016/j.euroneuro.2015.06.010

  • CrossRef
  • Google Scholar

• 33

  Wilmouth CE Spear LP . Withdrawal from chronic nicotine in adolescent and adult rats. Pharmacol Biochem Behav (2006) 85:648–57. 10.1016/j.pbb.2006.10.021

  • CrossRef
  • Google Scholar

• 34

  Kota D Martin BR Robinson SE Damaj MI . Nicotine dependence and reward differ between adolescent and adult male mice. J Pharmacol Exp Ther (2007) 322:399–407. 10.1124/jpet.107.121616

  • CrossRef
  • Google Scholar

• 35

  Zhan W Dierker LC Rose JS Selya A Mermelstein RJ . The natural course of nicotine dependence symptoms among adolescent smokers. Nicotine Tob Res (2012) 14:1445–52. 10.1093/ntr/nts031

  • CrossRef
  • Google Scholar

• 36

  Stoker AK Olivier B Markou A . Role of α7-and β4-containing nicotinic acetylcholine receptors in the affective and somatic aspects of nicotine withdrawal: studies in knockout mice. Behav Genet (2012) 42:423–36. 10.1007/s10519-011-9511-0

  • CrossRef
  • Google Scholar

• 37

  Torres OV Gentil LG Natividad LA Carcoba LM O’Dell LE . Behavioral, biochemical, and molecular indices of stress are enhanced in female versus male rats experiencing nicotine withdrawal. Front Psychiatry (2013) 4:38. 10.3389/fpsyt.2013.00038

  • CrossRef
  • Google Scholar

• 38

  Iniguez SD Warren BL Parise EM Alcantara LF Schuh B Maffeo ML et al Nicotine exposure during adolescence induces a depression-like state in adulthood. Neuropsychopharmacology (2009) 34:1609–24. 10.1038/npp.2008.220

  • CrossRef
  • Google Scholar

• 39

  Jobson CL Renard J Szkudlarek H Rosen LG Pereira B Wright DJ et al Adolescent nicotine exposure induces dysregulation of mesocorticolimbic activity states and depressive and anxiety-like prefrontal cortical molecular phenotypes persisting into adulthood. Cereb Cortex (2019) 9:3140–53. 10.1093/cercor/bhy179

  • CrossRef
  • Google Scholar

• 40

  Grabus SD Martin BR Damaj MI . Nicotine physical dependence in the mouse: involvement of the alpha7 nicotinic receptor subtype. Eur J Pharmacol (2005) 515:90–3. 10.1016/j.ejphar.2005.03.044

  • CrossRef
  • Google Scholar

• 41

  Stoker AK Semenova S Markou A . Affective and somatic aspects of spontaneous and precipitated nicotine withdrawal in C57BL/6J and BALB/cByJ mice. Neuropharmacology (2008) 54:1223–32. 10.1016/j.neuropharm.2008.03.013

  • CrossRef
  • Google Scholar

• 42

  Papke RL Ono F Stokes C Urban JM Boyd RT . The nicotinic acetylcholine receptors of zebrafish and an evaluation of pharmacological tools used for their study. Biochem Pharmacol (2012) 184:352–65. 10.1016/j.bcp.2012.04.022

  • CrossRef
  • Google Scholar

• 43

  Jackson KJ Martin BR Changeux JP Damaj MI . Differential role of nicotinic acetylcholine receptor subunits in physical and affective nicotine withdrawal signs. J Pharmacol Exp Ther (2008) 325:302–12. 10.1124/jpet.107.132977

  • CrossRef
  • Google Scholar

• 44

  Salas R Pieri F De Biasi M . Decreased signs of nicotine withdrawal in mice null for the beta4 nicotinic acetylcholine receptor subunit. J Neurosci (2004) 24:10035–9. 10.1523/JNEUROSCI.1939-04.2004

  • CrossRef
  • Google Scholar

• 45

  Jackson KJ McIntosh JM Brunzell DH Sanjakdar SS Damaj M . The role of alpha6-containing nicotinic acetylcholine receptors in nicotine reward and withdrawal. J Pharmacol Exp Ther (2009) 331:547–54. 10.1124/jpet.109.155457

  • CrossRef
  • Google Scholar

• 46

  Cano M Reynaga DD Belluzzi JD Loughlin SE Leslie F . Chronic exposure to cigarette smoke extract upregulates nicotinic receptor binding in adult and adolescent rats. Neuropharmacology (2020) 181:108308. 10.1016/j.neuropharm.2020.108308

  • CrossRef
  • Google Scholar

• 47

  Doura MB Gold AB Keller AB Perry DC . Adult and periadolescent rats differ in expression of nicotinic cholinergic receptor subtypes and in the response of these subtypes to chronic nicotine exposure. Brain Res (2008) 1215:40–52. 10.1016/j.brainres.2008.03.056

  • CrossRef
  • Google Scholar

• 48

  Slotkin TA Cousins MM Seidler FJ . Administration of nicotine to adolescent rats evokes regionally selective upregulation of CNS alpha 7 nicotinic acetylcholine receptors. Brain Res (2004) 1030:159–63. 10.1016/j.brainres.2004.10.009

  • CrossRef
  • Google Scholar

• 49

  Trauth JA Seidler FJ McCook EC Slotkin TA . Adolescent nicotine exposure causes persistent upregulation of nicotinic cholinergic receptors in rat brain regions. Brain Res (1999) 851:9–19. 10.1016/S0006-8993(99)01994-0

  • CrossRef
  • Google Scholar

• 50

  Marcinkiewcz CA Prado MM Isaac SK Marshall A Rylkova D Bruijnzeel AW . Corticotropin-releasing factor within the central nucleus of the amygdala and the nucleus accumbens shell mediates the negative affective state of nicotine withdrawal in rats. Neuropsychopharmacology (2009) 34:1743–52. 10.1038/npp.2008.231

  • CrossRef
  • Google Scholar

• 51

  Pandey SC Roy A Xu T Mittal N . Effects of protracted nicotine exposure and withdrawal on the expression and phosphorylation of the CREB gene transcription factor in rat brain. J Neurochem (2001) 77:943–52. 10.1046/j.1471-4159.2001.00309.x

  • CrossRef
  • Google Scholar

• 52

  Salas R Sturm R Boulter J De Biasi M . Nicotinic receptors in the habenulo-interpeduncular system are necessary for nicotine withdrawal in mice. J Neurosci (2009) 29:3014–8. 10.1523/JNEUROSCI.4934-08.2009

  • CrossRef
  • Google Scholar

• 53

  Görlich A Antolin-Fontes B Ables JL Frahm S Ślimak MA Dougherty JD et al Reexposure to nicotine during withdrawal increases the pacemaking activity of cholinergic habenular neurons. Proc Natl Acad Sci (2013) 110:17077–82. 10.1073/pnas.1313103110

  • CrossRef
  • Google Scholar

• 54

  Zhao-Shea R DeGroot SR Liu L Vallaster M Pang X Su Q et al Increased CRF signalling in a ventral tegmental area-interpeduncular nucleus-medial habenula circuit induces anxiety during nicotine withdrawal. Nat Commun (2015) 6:6770. 10.1038/ncomms7770

  • CrossRef
  • Google Scholar

• 55

  Klenowski PM Zhao-Shea R Freels TG Molas S Tapper AR . Dynamic activity of interpeduncular nucleus GABAergic neurons controls expression of nicotine withdrawal in male mice. Neuropsychopharmacology (2022) 47:641–51. 10.1038/s41386-021-01107-1

  • CrossRef
  • Google Scholar

• 56

  Zhao-Shea R Liu L Pang X Gardner PD Tapper AR . Activation of GABAergic neurons in the interpeduncular nucleus triggers physical nicotine withdrawal symptoms. Curr Biol (2013) 23:2327–35. 10.1016/j.cub.2013.09.041

  • CrossRef
  • Google Scholar

• 57

  Cross SJ Reynaga DD Cano M Belluzzi JD Zaveri NT Leslie FM . Differences in mechanisms underlying reinstatement of cigarette smoke extract-and nicotine-seeking behavior in rats. Neuropharmacology (2020) 162:107846. 10.1016/j.neuropharm.2019.107846

  • CrossRef
  • Google Scholar

• 58

  Belluzzi JD Wang R Leslie FM . Acetaldehyde enhances acquisition of nicotine self-administration in adolescent rats. Neuropsychopharmacology (2005) 30:705–12. 10.1038/sj.npp.1300586

  • CrossRef
  • Google Scholar

• 59

  Hoffman AC Evans SE . Abuse potential of non-nicotine tobacco smoke components: acetaldehyde, nornicotine, cotinine, and anabasine. Nicotine Tob Res (2013) 15:622–32. 10.1093/ntr/nts192

  • CrossRef
  • Google Scholar

• 60

  Arnold MM Loughlin SE Belluzzi JD Leslie FM . Reinforcing and neural activating effects of norharmane, a non-nicotine tobacco constituent, alone and in combination with nicotine. Neuropharmacology (2014) 85:293–304. 10.1016/j.neuropharm.2014.05.035

  • CrossRef
  • Google Scholar

• 61

  Smith TT Schaff MB Rupprecht LE Schassburger RL Buffalari DM Murphy SE et al Effects of MAO inhibition and a combination of minor alkaloids, β-carbolines, and acetaldehyde on nicotine self-administration in adult male rats. Drug and alcohol dependence (2015) 155:243–52. 10.1016/j.drugalcdep.2015.07.002

  • CrossRef
  • Google Scholar

• 62

  Smith TT Rupprecht LE Cwalina SN Onimus MJ Murphy SE Donny EC et al Effects of monoamine oxidase inhibition on the reinforcing properties of low-dose nicotine. Neuropsychopharmacology (2016) 41:2335–43. 10.1038/npp.2016.36

  • CrossRef
  • Google Scholar

• 63

  Sved AF Weeks JJ Grace AA Smith TT Donny EC . Monoamine oxidase inhibition in cigarette smokers: from preclinical studies to tobacco product regulation. Front Neurosci (2022) 16:886496. 10.3389/fnins.2022.886496

  • CrossRef
  • Google Scholar

• 64

  Harris AC Muelken P Alcheva A Stepanov I LeSage MG . Cigarette smoke extract, but not electronic cigarette aerosol extract, inhibits monoamine oxidase in vitro and produces greater acute aversive/anhedonic effects than nicotine alone on intracranial self-stimulation in rats. Front Neurosci (2022) 16:868088. 10.3389/fnins.2022.868088

  • CrossRef
  • Google Scholar

• 65

  Craig EL Zhao B Cui JZ Novalen M Miksys S Tyndale RF . Nicotine pharmacokinetics in rats is altered as a function of age, impacting the interpretation of animal model data. Drug Metab Disposition (2014) 42:1447–55. 10.1124/dmd.114.058719

  • CrossRef
  • Google Scholar

• 66

  Schumacher JN Green CR Best FW Newell MP . Smoke composition. an extensive investigation of the water-soluble portion of cigarette smoke. J Agric Food Chem (1977) 25:310–20. 10.1021/jf60210a003

  • CrossRef
  • Google Scholar

• 67

  Ambrose V Miller JH Dickson SJ Hampton S Truman P Lea RA et al Tobacco particulate matter is more potent than nicotine at upregulating nicotinic receptors on SH-SY5Y cells. Nicotine Tob Res (2007) 9:793–9. 10.1080/14622200701485117

  • CrossRef
  • Google Scholar

• 68

  Brennan KA Laugesen M Truman P . Whole tobacco smoke extracts to model tobacco dependence in animals. Neurosci Biobehavioral Rev (2014) 47:53–69. 10.1016/j.neubiorev.2014.07.014

  • CrossRef
  • Google Scholar

• 69

  Schnoll RA Patterson F Lerman C . Treating tobacco dependence in women. J Women's Health (2007) 16:1211–8. 10.1089/jwh.2006.0281

  • CrossRef
  • Google Scholar

• 70

  Xu J Azizian A Monterosso J Domier CP Brody AL London ED et al Gender effects on mood and cigarette craving during early abstinence and resumption of smoking. Nicotine Tob Res (2008) 10:1653–61. 10.1080/14622200802412929

  • CrossRef
  • Google Scholar

• 71

  Colby SM Tiffany ST Shiffman S Niaura RS . Are adolescent smokers dependent on nicotine? a review of the evidence. Drug and alcohol dependence (2000) 59:83–S95. 10.1016/S0376-8716(99)00166-0

  • CrossRef
  • Google Scholar

• 72

  Hamilton KR Berger SS Perry ME Grunberg NE . Behavioral effects of nicotine withdrawal in adult male and female rats. Pharmacol Biochem Behav (2009) 92:51–9. 10.1016/j.pbb.2008.10.010

  • CrossRef
  • Google Scholar

• 73

  Gentile NE Andrekanic JD Karwoski TE Czambel RK Rubin RT Rhodes ME . Sexually diergic hypothalamic–pituitary–adrenal (HPA) responses to single-dose nicotine, continuous nicotine infusion, and nicotine withdrawal by mecamylamine in rats. Brain Res Bull (2011) 85:145–52. 10.1016/j.brainresbull.2011.03.001

  • CrossRef
  • Google Scholar

• 74

  Carcoba LM Uribe KP Ortegon S Mendez IA DeBiasi M O'Dell LE . Amino acid systems in the interpeduncular nucleus are altered in a sex‐dependent manner during nicotine withdrawal. J Neurosci Res (2022) 100:1573–84. 10.1002/jnr.24826

  • CrossRef
  • Google Scholar

• 75

  Torres OV Pipkin JA Ferree P Carcoba LM O’Dell LE . Nicotine withdrawal increases stress-associated genes in the nucleus accumbens of female rats in a hormone-dependent manner. Nicotine Tob Res (2015) 17:422–30. 10.1093/ntr/ntu278

  • CrossRef
  • Google Scholar