- Open Access
Supporting maintenance of sugar-sweetened beverage reduction using automated versus live telephone support: findings from a randomized control trial
International Journal of Behavioral Nutrition and Physical Activity volume 15, Article number: 97 (2018)
Although reducing sugar-sweetened beverage (SSB) intake is an important behavioral strategy to improve health, no known SSB-focused behavioral trial has examined maintenance of SSB behaviors after an initial reduction. Guided by the RE-AIM framework, this study examines 6–18 month and 0–18 month individual-level maintenance outcomes from an SSB reduction trial conducted in a medically-underserved, rural Appalachia region of Virginia. Reach and implementation indicators are also reported.
Following completion of a 6-month, multi-component, behavioral RCT to reduce SSB intake (SIPsmartER condition vs. comparison condition), participants were further randomized to one of three 12-month maintenance conditions. Each condition included monthly telephone calls, but varied in mode and content: 1) interactive voice response (IVR) behavior support, 2) human-delivered behavior support, or 3) IVR control condition. Assessments included the Beverage Intake Questionnaire (BEVQ-15), weight, BMI, and quality of life. Call completion rates and costs were tracked. Analysis included descriptive statistics and multilevel mixed-effects linear regression models using intent-to-treat procedures.
Of 301 subjects enrolled in the 6-month RCT, 242 (80%) were randomized into the maintenance phase and 235 (78%) included in the analyses. SIPsmartER participants maintained significant 0–18 month decreases in SSB. For SSB, weight, BMI and quality of life, there were no significant 6–18 month changes among SIPsmartER participants, indicating post-program maintenance. The IVR-behavior participants reported greater reductions in SSB kcals/day during the 6–18 month maintenance phase, compared to the IVR control participants (− 98 SSB kcals/day, 95% CI = − 196, − 0.55, p < 0.05); yet the human-delivered behavior condition was not significantly different from either the IVR-behavior condition (27 SSB kcals/day, 95% CI = − 69, 125) or IVR control condition (− 70 SSB kcals/day, 95% CI = − 209, 64). Call completion rates were similar across maintenance conditions (4.2–4.6 out of 11 calls); however, loss to follow-up was greatest in the IVR control condition. Approximated costs of IVR and human-delivered calls were remarkably similar (i.e., $3.15/participant/month or $38/participant total for the 12-month maintenance phase), yet implications for scalability and sustainability differ.
Overall, SIPsmartER participants maintained improvements in SSB behaviors. Using IVR to support SSB behaviors is effective and may offer advantages as a scalable maintenance strategy for real-world systems in rural regions to address excessive SSB consumption.
Clinicaltrials.gov; NCT02193009; Registered 11 July 2014. Retrospectively registered.
Health concerns surrounding the excessive consumption of sugar-sweetened beverage (SSB) intake is arguably one of the most publicized and controversial topics among current public health issues. SSB currently contributes approximately 7% of total energy intake for United States adults ; and rank third in overall food sources of energy and rank first in sources of carbohydrate . Of additional importance are the significantly higher SSB intakes among rural adults  and the inverse relationship between intake of added sugars and educational attainment . For example, in the Appalachian region targeted by this research, residents consume over three times the national average of SSB . Our Appalachian data suggest overall consumption of added sugar comprises an estimated 21% of total energy intake among adults ; and, similar to national data, SSB is the largest contributor to added sugar intake in this region.
There are strong scientific data indicating associations among SSB and numerous health issues such as obesity, type 2 diabetes, cardiovascular disease, caries and oral health [7,8,9,10,11]. There is also extensive debate regarding the proposed solutions to excessive SSB intake. When compared to macro-level approaches to reduce SSB consumption [12,13,14,15], behavioral programs are generally viewed as much more acceptable, met with less political opposition, and regarded as a necessary complement to any higher level (e.g., community, policy) strategy. However, effective behavioral interventions targeting SSB reduction are only useful if post-program behavior changes are maintained and if real-world systems can implement and sustain the programs. Although attaining and maintaining current recommendations for SSB intake over long periods of time is an important behavioral strategy to improve health, no known SSB-focused behavioral trial has examined maintenance of SSB behaviors .
Maintenance, at the individual level, refers to the long-term effects of a program on outcomes six or more months after the most recent intervention contact . Behavioral maintenance represents a key challenge for the prevention and treatment of chronic disease . Likewise, maintenance of change following interventions is not often reported, especially in community-based interventions [19, 20]. Extended care provides prolonged participant contact to prevent relapse following initial behavior change and is a viable strategy to address long-term maintenance of health behaviors following an intervention . Telephone-delivered extended care programs represent a potentially effective and low-cost way for promoting long-term health behavior change in rural communities [21, 22].
Though little is known about maintenance effects and use of extended care strategies to support SSB behaviors, the weight loss literature provides some useful insight. The use of extended care is recommended to address the issue of maintenance ; however, a systematic review of the effectiveness of technology-based (internet, telephone and interactive television) weight-loss maintenance interventions found mixed results . Overall, the review found technology based extended care was more effective than usual care, but not as effective as personal contact. Nonetheless, when considering extended care programs in rural communities, it is necessary to explore different delivery methods because of increased travel to reach participants and potential costs associated with personal contact for both the delivery system and participants [24, 25].
Automated telephone calls utilizing interactive voice response (IVR) systems may represent a cost-effective and acceptable strategy to facilitate ongoing engagement in SSB and other health behaviors with individuals in rural areas [26, 27]. Several studies support the use of IVR calls for chronic disease self-management , physical activity promotion [29, 30], and smoking cessation . However, there is limited research related to the use of IVR delivered telephone calls as a maintenance strategy, especially when compared to human-delivered telephone calls [23, 31]. Likewise, there is a dearth of behavioral maintenance interventions that compare human to automated strategies and also examine cost and scalability, or the capacity of a system or process to accommodate a growth in the number of participants.
In addition to examining individual level maintenance, it is also critical to understand reach and implementation dimensions as these factors influence the potential of real-world systems sustaining extended care strategies. The RE-AIM (reach, effectiveness, adoption, implementation, maintenance) framework helps guide the evaluation of behavioral interventions, highlighting the importance of both internal and external validity elements . Evidenced across numerous systematic RE-AIM reviews, information on implementation indicators are typically underreported, including information on intervention cost [33,34,35]. Combined with the challenges of individual-level behavioral maintenance, there is also a gap in the literature around the cost and scalability of effective maintenance strategies [36, 37]. This gap is even wider in rural underserved regions, where behavioral and health disparities persist.
SIPsmartER is a theory-based, 6-month, multi-component health literacy intervention designed to reduce SSB intake among rural Appalachian adults . Using a randomized controlled trial (RCT), SIPsmartER has been shown to be effective from baseline to 6-months. Relative to matched-contact comparison group targeting physical activity behaviors (e.g. MoveMore), SIPsmartER participants significantly decreased SSB intake, improved overall dietary and beverage quality, and demonstrated improvement in a δ13C added sugar intake biomarker [39,40,41]. SIPsmartER also yielded small, yet significant, improvements in weight and BMI. At completion of the 6-month intervention, participants were further randomized to one of three 12-month maintenance conditions (i.e., behavior-specific IVR calls, behavior-specific human-delivered support calls, IVR call control condition) . Data from this maintenance phase have not yet been reported.
Guided by the RE-AIM evaluation framework, this manuscript focuses on the reach, maintenance of effects, and implementation of maintenance. The primary aim of this manuscript is to explore individual-level maintenance of outcomes. As such, the first objective is to compare 0–18 and 6–18 month outcomes [i.e., SSB intake, weight, BMI, quality of life (QOL)] between SIPsmartER participants and matched-contact comparison participants, regardless of randomized maintenance condition. We hypothesized that 0–6 month improvements in SSB intake, weight, BMI, and QOL would be sustained in the 12-month maintenance phase for SIPsmartER participants. The second objective is to examine individual-level outcomes by randomized maintenance condition among SIPsmartER participants. We hypothesize that maintenance effects for both the behavior-specific IVR calls and behavior-specific human-delivered support calls would be superior when compared to the IVR call control condition. Secondary aims are to explore reach and implementation indicators of the maintenance phase, including call completion rates and costs.
This RCT took place between 2012 and 2015 and occurred in eight southwestern Virginian counties. These targeted rural, Appalachia counties are federally designated as a medically underserved area  and have an average rurality status of 6.3 on the 9-point Rural-Urban Continuum Codes (1 = urban, 9 = completely rural) . Similarly, these counties consistently score lowest on the Health Opportunity Index (i.e., less opportunity) .
The Virginia Tech Institutional Review board approved all study procedures. Participants were informed of the random allocation process and provided written consent to participate. Gift cards were provided at the baseline, 6-month and 18-month assessments (i.e., $25, $50, and $75, respectively).
Study design, eligibility & intervention descriptions
The consort diagram illustrates participant flow and randomization (Fig. 1). As described below, this 2-phased study included two time points of randomization.
Phase 1, 6-month behavioral intervention
In Phase 1, and using a simple randomization protocol, eligible participants were randomly assigned to the SIPsmartER (n = 155) or MoveMore comparison condition (n = 146). Eligibility criteria for Phase 1 enrollment included English-speaking adults who were 18 years of age or older, consumed > 200 SSB kcals/day, reported no contraindications for physical activity, had regular access to a telephone, and who were not concurrently enrolled in another nutrition or physical activity program. Throughout the targeted counties a variety of active (e.g., recruitment at health departments) and passive (e.g., flyers, newspaper ads, word of mouth) recruitment strategies were used. Full recruitment, reach, and representativeness data are presented elsewhere .
Both the SIPsmartER and MoveMore conditions were 6-month behavioral modification programs that included three small group sessions, one teach-back call, 11 IVR telephone calls, completion of personalized action plans and self-monitoring log sheets. A detailed account of the structure, theoretical constructs, and content of the classes and IVR calls is described elsewhere [38, 46, 47]. Both conditions were guided by Theory of Planned Behavior and health literacy concepts and strategies, and were designed for broad dissemination [48,49,50,51,52].
SIPsmartER condition. Individuals enrolled in SIPsmartER participated in a 6-month behavioral modification program aimed to decrease SSB intake, with the primary goal of achieving the SSB recommendation of less than 8 fluid ounces per day [53, 54]. SIPsmartER was the main program of interest in this RCT and SSB behavior was the primary outcome. In this maintenance manuscript, we also mainly focus on the outcome of the SIPsmartER condition, and use MoveMore as the comparison condition in applicable hypothesis driven analysis.
MoveMore condition. Individuals enrolled in MoveMore participated in a 6-month behavioral modification program aimed to increase physical activity, with the primary goal of achieving 150 min of moderate intensity PA and muscle strengthening activities on two or more days per week.
During Phase 1, when two subsequent intervention activities were missed, a research staff member would attempt to re-engage the participant with a live telephone call to complete the content of the missed activity (i.e. class and/or IVR call) using a semi-structured script. Average IVR call completion rate was 51% during Phase 1 . Even though the IVR support component was designed for automation and scalability, a substantial number of calls during Phase 1 were attempted and delivered by a research team member. This finding, along with maintenance literature indicating that technology based extended care were not as effective as personal contact , informed the Phase 2 maintenance conditions.
Phase 2, 12-month maintenance period
In Phase 2, and the focus of this manuscript, participants were further randomized to one of three 12-month maintenance conditions. Each condition included monthly telephone calls, but varied in mode and content: 1) IVR behavior support, 2) human-delivered behavior support, or 3) IVR control condition. Eligibility criteria for Phase 2 included enrollment in Phase 1 and completion of at least one IVR call during the initial 6-month intervention. Furthermore, Phase 2 participants were stratified into four groups based on the following criteria: a) completed 6-month assessment and completed < 6 IVR calls (i.e. < 50% calls), b) completed 6 month assessment and completed > 6 IVR calls, c) did not complete 6 month assessment and completed < 6 IVR calls or d) did not complete 6 month assessment and completed > 6 IVR calls). Subsequently, randomization into a maintenance condition occurred within each stratum. This process promoted a balanced prognosis for call participation within each of the maintenance conditions. Within the SIPsmartER and MoveMore comparison condition, the planned allocation ratio was 2:2:1, respectively, for IVR behavior support, human-delivered behavior support, and IVR control condition.
IVR behavioral support condition. Participants in this group received TPB informed telephone support calls from an automated IVR system. The 11 monthly calls were structurally similar to the 11 IVR calls received in the initial 6-month intervention [38, 46]. During each maintenance call, participants reported their behavior (SIPsmartER reported ounces of SSB; MoveMore reported minutes of PA), received tailored feedback based on goal maintenance and could elect to set a new maintenance goal. Participants then either identified new barriers and strategies pertaining to their behavior or kept the same ones identified previously. The call ended with a short TPB-based message that reinforced key information presented during Phase 1.
Human-delivered behavioral support condition. Participants in this group received TPB-based telephone support calls that included 11 monthly calls from an appointed member of the research team. The scripted call followed an identical format as the IVR behavioral condition described above.
IVR control condition. Participants in the control group received 11 monthly IVR calls that included monthly updates on the study such as, “it’s been three months since we’ve seen you,” and delivered entertaining science facts such as, “sunshine can help your sleep patterns.” Participants did not report their current behavior, set goals, or hear a TPB-based support message. Additionally, information specific to SSB or PA was not addressed in the control call.
In both the IVR and human-delivered behavioral support conditions, maintenance calls were attempted three times, either by the IVR system or by a research assistant. After the third attempt, the call was categorized as not completed and no further attempts were made to reach the participant that month. To promote retention at the 18-month assessment time, all participants received a birthday card and a season’s greeting card during the maintenance phase.
Eligibility and demographic information was collected during the screening process prior to enrollment in Phase 1. The screening instrument included questions about sex, age, race/ethnicity, education level, family/household income, employment status, health care coverage, marital status, number of children in the home, county of residence, SSB intake and contraindications for physical activity. Health literacy was assessed using the Newest Vital Sign at baseline .
All outcomes were measured during health screenings in community-based settings (e.g., public health buildings, Extension offices, churches) that occurred at baseline, 6-months and 18-months. The primary outcome, SSB intake, was measured by the BEVQ-15, a validated food-frequency instrument that assesses beverage consumption over the past month . SSB intake is calculated by summing five items including regular soft drinks, sweetened juice beverage/drink, sweetened tea, coffee with sugar, and energy and sports drinks. Weight was measured without shoes and light clothing using a calibrated digital Tanita scale (Model: 310GS). Height was measured with a research-grade stadiometer. The Centers for Disease Control Healthy Days module was used to assess quality of life .
Implementation was defined as the number of telephone calls completed over the 12-month maintenance intervention (out of a possible 11). Bi-monthly research team meetings and on-line tracking forms were used to monitor fidelity to established protocols, including human-delivered behavior calls attempts and completion. For the IVR calls, records were maintained related to the cost of hosting the platform during the duration of the maintenance phase. Implementation costs of the maintenance conditions were tracked through monthly financial records, including invoices from our IRV vendor, as well as research assistants’ salary information and call attempt and time log records.
All data were entered into SPSS statistical analysis software (version 22.0, 2012, International Business Machines Corporation, Pittsburgh, PA) and validated scoring procedures were applied to compute outcome variable scores. Descriptive statistics were used to summarize demographic characteristics and participation rates [e.g. means, standard deviations (SD), medians and interquartile range (IQR)], as well as costs. Chi square tests of association or Fisher’s exact tests (categorical variables) and ANOVA (continuous variables) were used to compare demographics between participants enrolled and not enrolled in Phase 2 and to examine differences in engagement rates among randomized conditions.
Multilevel mixed-effects linear regressions analyses were performed using Stata software to account for clustering of individuals within county cohorts (version 13, 2013, StataCorp LP, College Station, TX). The mixed-effect models controlled for individual baseline characteristics, dummies of time and condition, and a time by condition dummy interaction. All models calculated robust standard errors for county/cohort cluster. The baseline covariates controlled in the models were chosen a priori and included age, gender, race/ethnicity, income, education level, health literacy level, employment status, number of children, smoking status, and BMI . For analytical purposes, all women who were pregnant at any study point were excluded from the maintenance analysis.
Our initial analyses included 18-month present at follow-up (completers only), as well as intention-to-treat using last-observation-carried-forward. These analytic procedures yielded similar results, with the expected largest effect sizes found in the present at follow-up analysis. Therefore, intention-to-treat results, the more conservative effects, are reported in this manuscript [59, 60]. We also report Cohen’s d effect sizes for the relative mean treatment effects between the randomized conditions .
This trial was powered to detect a small effect size of 0.34 for 0–6 month changes in SSB intake between the SIPsmartER and MoveMore conditions (i.e., 80% power, 0.05 type 1 error). Since this trial was not specifically designed or powered to detect maintenance effects, the analyses and interpretation of findings are considered exploratory.
Of 301 subjects enrolled in Phase 1, 242 (80.4%) were further randomized in the maintenance phase (Fig. 1). Of the 124 SIPsmartER participants in the maintenance phase, randomization included 49 in the IVR-behavior support condition, 47 in the human-delivered behavior support condition, and 28 in the IVR control condition. Of the 118 MoveMore participants in the maintenance phase, randomization included, 48 in the IVR-behavior support condition, 47 in the human-delivered behavior support condition, and 23 in the IVR control condition.
Of those randomized in the maintenance phase, 57 were lost to follow-up and 195 (81%) returned for the 18-month assessment. The loss to follow up between SIPsmartER (23 of 124; 19%) and MoveMore (24 of 118; 20%) conditions were similar. However, the loss to follow up was greatest for the IVR control group (18 of 51; 35%), followed by the human-delivered behavior support condition (18 of 94; 19%), and was lowest among the IVR behavioral support condition (11 of 97; 11%). Seven pregnant women (i.e., four in SIPsmartER and three in MoveMore) were excluded from all additional maintenance phase analyses, resulting in 235 participants.
Table 1 illustrates the demographic characteristics of participants included in this maintenance phase analysis, including the 120 SIPsmartER and 115 MoveMore participants. The majority of the participants were aged 25–64, female, Caucasian, and had an annual household income <$35,000. The average baseline BMI was around 33, with 22% classified as overweight and 57% as obese. To describe representativeness, Table 1 also explores differences among participants enrolled in the maintenance phase to those originally enrolled in the trial but not into the maintenance phase. In the SIPsmartER condition, compared to those who were not randomized into the maintenance phase, those included in the maintenance phase were older and more likely to be classified as unable to work/on disability. In the MoveMore comparison condition, there were no significant demographic difference between those who enrolled and did not enroll in the maintenance phase.
Maintenance of effects
Table 2 describes the adjusted changes in 0–6 months, 6–18 months, and 0–18 months outcomes and relative effects between the SIPsmartER and MoveMore comparison conditions, regardless of randomized maintenance condition. SIPsmartER participants maintained significant 0–18 month decreases in SSB intake by 256 (95% CI = − 339, − 174, p < 0.01) kcals/day when compared to the 96 (95% CI = − 149, − 43, p < 0.01) kcals/day decrease among the MoveMore comparison participants (p < 0.01)(Cohen’s d effect size = 0.47) (Fig. 2). The 0–18 month relative effects between conditions for weight and BMI changes were not significant, yet the magnitude of change for SIPsmartER was similar to the 0–6 month outcomes. The trends for improvements in outcomes among the MoveMore comparison condition in the 6–18 month maintenance phase, though not significant, is noteworthy and has implications for interpreting between condition effects. For SSB, weight, BMI and quality of life outcomes, the 6–18 month changes were not significant, implying a maintenance of the effects achieved at conclusion of Phase 1 among SIPsmartER participants.
For the SIPsmartER condition only, adjusted changes in 6–18 month outcomes by randomized maintenance assignment are described in Table 3. Within each condition, there were no statistically significant 6–18 month changes for any of the outcomes. However, the IVR-behavior group reported significantly greater reductions in SSB kcals/day during the 6–18 month maintenance phase, compared to IVR control condition, (− 98, 95% CI = − 196, − 0.55) (p < 0.05) (Cohen’s d effect size = 0.42). There were no significant differences in SSB kcal/day between the human-delivered behavior support condition and IVR control condition (− 70, 95% CI = − 209, 64, NS) (Cohen’s d effect size = 0.25) or between the IVR-behavior vs human-delivered behavior conditions (27, 95% CI = − 69, 125, NS)(Cohen’s d effect size = 0.12) (Fig. 3). Finally, there were no significant differences among the randomized maintenance conditions for weight, BMI, or quality of life.
Among all 235 participants in both the SIPsmartER and MoveMore conditions, call completion rates were not significantly different among randomized maintenance conditions. Of the 11 possible calls, average completion rates were 4.6 (SD = 4.5; Median = 4.0; IQR = 9.0) IVR-behavior calls, 4.4 (SD = 3.4; Median = 4.0; IQR = 5.0) human-delivered behavior calls, and 4.2 (SD = 4.2; Median = 2.5; IQR = 8.3) IVR control calls (F = 0.17, p = 0.85). Specific to the 120 SIPsmartER participants, average completion rates were also not significantly different (F = 1.52, p = 0.22), including 5.2 (SD = 4.4; Median = 5.0; IQR = 9.0) IVR-behavior calls, 4.0 (SD = 3.2; Median = 3.0; IQR = 5.5) human-delivered behavior calls, and 5.0 (SD = 4.1; Median = 4.0; IQR = 7.0) IVR control calls.
Of the 235 maintenance participants, 191 participants were enrolled in the IVR conditions. The average monthly cost of hosting the IVR system was $600/month or $7200 total per the 12 months. This equates to $3.14/participant per month or $37.68/participant total for the 12-month IVR maintenance condition.
A total of 94 participants were allocated in the human-delivered behavior condition. Verified through financial statements, research staff time was estimated at $25/h ($0.41/min). According to tracking records, it took on average 2.5 attempts to reach the participants. We used an estimate of 2 min each time a call was attempted, including preparation time of the research staff. The average length of the human-delivered behavior calls was estimated at 7 min, an amount of time similar to the length of the IVR calls (i.e., 6.9 + 1.9) minutes) . Therefore, the costs incurred for the human-delivered behavior condition were estimated using the following approach: (1) attempts to reach participants on phone = 2.5 attempts * 2.5 min * $0.41 min * 94 total participants = $192.70, (2) once on the phone = 7 min * $0.41 min * 36 participants (average actually reached) = $103.32, (3) total per month = $296.02/month or $3552.24 total per the 12 months, (4) since 94 participants enrolled, this equates to $3.15/participant per month or $37.78/participant total for the 12-month human-delivered behavior maintenance condition.
As further addressed in the discussion, the cost of maintaining the IVR system is fixed. However, the cost of human-delivered behavior maintenance condition is variable.
Prior systematic reviews have defined maintenance of behavior change as a statistically significant between-groups difference in favor of the intervention group at the end of the intervention and at follow-up for at least one behavioral outcome . Following this criteria, our trial demonstrated overall maintenance of effects for the primary SSB outcome among SIPsmartER participants. Given the link between SSB and numerous chronic health conditions (e.g., type 2 diabetes, cardiovascular disease, caries and oral health) [7,8,9,10,11], our finding establishes that an individual-level intervention integrating behavioral theory and health literacy concepts can maintain SSB reductions among residents in a high-risk rural region.
When considering the three maintenance conditions for the SIPsmartER participants, we found the IVR behavioral support condition offered statistically significant advantages over the IVR control group for the SSB outcome. This finding supports prior literature which suggests that extended care interventions delivered via telephonic approaches and with continued action planning and tailored feedback can promote maintenance in outcomes . On the contrary, the human-support delivered maintenance calls were not significantly different than IVR control or IVR behavior. This finding can be compared to prior weight loss literature that suggests technology facilitated approaches are typically more effective than usual care, but not more effective than personal contact [23, 63, 64]. However, given our small sample size, findings should be interpreted somewhat cautiously. Nonetheless, the SSB outcome findings in this exploratory secondary analysis, in combination with the implementation findings, support the promise of behavioral maintenance strategies delivered via IVR in rural regions.
Given the design of this trial, interpreting the secondary BMI and weight outcomes is complex. We hypothesized that 0–6 month improvements in SSB intake, weight, and BMI outcomes would be sustained in the 12-month maintenance phase for SIPsmartER participants. Arguably, one could also hypothesize that the MoveMore comparison group participants could achieve and maintain weight loss. As previously described, this community-based research trial was designed to assess SSB as the primary outcome (not weight) and provide the potential for all enrolled participants to benefit. In the 0–6 month phase, the SIPsmartER group achieved small, yet significant, improvements in weight and BMI; however, the MoveMore comparison group did not experience similar improvements. In contrast, during the 6–18 month maintenance phase, the MoveMore comparison condition had trends for improving weight and BMI outcomes, though not significant, whereas the SIPsmartER group shows relatively little change. The study design is important to consider when interpreting the relative between condition maintenance effects. Regardless, from a clinical significance perspective, the overall average weight and BMI changes are modest . From a public health perspective, additional efforts and a fully powered study is needed to understand how maintenance of SSB behaviors influences clinical outcomes, including weight. Though our exploratory maintenance study has limitations in the design and power for weight-related outcomes, our findings suggest that focusing solely on individual-level SSB behavior change is insufficient to achieve and maintain clinically significant improvements in weight.
Our findings on the relative costs of the maintenance conditions may not be surprising when considered through the lens of scalability. First, related to ongoing implementation costs, the cost of IVR system maintenance is fixed—once activated the monitoring cost is consistent over time and does not vary as additional participants are added unless additional monitoring and phone lines are necessary. Second, and in contrast, the cost of the human-delivered behavior maintenance condition are variable—each new participant increases costs at an incremental rate. When considered together, taking these interventions to scale in a community or clinical setting the automated system costs per participant go down with additional participants whereas the per participant cost of human-delivered systems remains the same. Two additional considerations related to cost are wage rates and start-up costs. We used actual rates of research assistant time. If the human-delivered calls were implemented in a practice setting, this rate could be variable if replaced with market wage rate of staff that would ultimately implement the intervention. Also, since the start-up costs for both interventions—training and quality assurance methods for staff implementing the human-delivered interventions and initial construction of the IVR system were incurred in the first 6-month phase of the trial, they were not included in our maintenance estimates—though they would surely be considered in the decision making processes for community or clinical organizations when making adoption decisions. Despite these considerations, implementation and maintenance costs are known to be one of the most underreported aspects of informing the translation of evidence-based programs into real-world practice settings [22, 36, 37]. Our goal was to address this gap in the literature, while being transparent about the multitude of factors to consider when estimating and interpreting costs to implement and maintain IVR versus human-delivered maintenance support calls.
Though call completion rates in our study were similar across conditions, the overall 40% uptake rate (4 to 5 out of 11 calls completed) remains lower than desired. However, we found that the retention rate for participants in the IVR-behavioral condition was superior to that of the human delivered behavioral support. This finding may appear to contradict other studies of technology-based maintenance interventions which report low utilization of technology [66, 67]. This finding may be explained by the fact that our IVR technology was introduced and applied at the start of the intervention, not solely introduced at the maintenance phase. However, utilization rates of in-person and other human-delivered interventions are also known to decrease over time . Our study is unique in comparing retention rates between human and technology-delivered interventions and our findings may also be the result of focusing our intervention efforts on rural participants. Nonetheless, given the recent acceleration of e/m health options, additional focus on retention rates and developing and testing strategies that can be used to reduce attrition continues to be an area in need of future research.
The study has several limitations. First, the findings may have limited generalizability beyond the targeted region of rural southwest Virginia. Second, SSB outcomes are based on self-reported outcomes, yet a validated measure was used. Importantly, self-reported SSB outcomes from the main Phase 1 trial were also supported by improvement in a δ13C added sugar intake biomarker changes , which further supports the validity of self-reported changes in this manuscript. Third, the MoveMore comparison condition and lack of a true control condition influences our findings, especially interpretations of between condition effects for the secondary weight-related outcomes. Similarly, the lack of no contact control group should be considered when interpreting the maintenance findings. Fourth, since participants who did not complete any IVR calls were not further randomized into the maintenance phase, our adherence and effects may be somewhat inflated. Finally, our exploratory study was not specifically powered to determine maintenance effects, hence the findings should be interpreted somewhat cautiously. Nonetheless, our study provides key information needed to inform the sample size of future studies examining maintenance of SSB effects and differences between maintenance conditions. Our study limitations should be interpreted within context of the study strengths, including the targeted high need rural region, RCT design, and conservative analysis using intent-to-treat procedures.
This exploratory study reveals several key areas of future research. Given the persistent disparities in access to care in rural regions, there is a high need for additional research on technology-based maintenance interventions in underserved and geographically dispersed communities. Furthermore, the maintenance and extended care literature is rather complex, including multifaceted issues related to maintenance data interpretation and extended care treatment allocation . In our study, we included individuals in the maintenance phase based on participation in at least one prior IVR call, not based on 6-month achievement of behavioral or anthropometric outcomes. This was a practical decision based on the desire to promote overall retention rates. However, further analyses are warranted to account for those individuals who achieved versus did not achieve improvements in the 6-month phase, as these findings could reveal additional insights about the 18-month maintenance of effects. Likewise, within each stratum described above we randomly assigned individuals into the maintenance phase conditions. Regardless of participation level in the IVR component during the initial 6 months, participants were randomized into one of the three conditions (e.g., those with either low or high engagement in the IVR could have been randomized to human-support delivered maintenance calls). While this randomized approach was scientifically justified to test our maintenance hypotheses, other pragmatic options should also be considered in future studies. For example, rather than random assignment, a stepped care model should be considered such that the most effective and least resource intensive maintenance support is provided . Participants in our trial who were adequately engaged with the IVR could have remained in the IVR maintenance condition, whereas those who were less engaged in the IVR and/or failed to achieve outcomes could have been allocated to a human-delivered condition. Evaluating reach, effectiveness and implementation outcomes from a stepped care allocation scheme may also be useful to real-world systems. Finally, from a socio-ecological perspective, additional research is needed to integrate evidence-based individual-level behavioral programs aimed at achieving and maintaining SSB reduction, like SIPsmartER, with higher level environmental- and policy-level approaches [12,13,14,15]. This multi-level effort is even more critical when extending the focus from SSB behavior change to the long-term improvement of complex chronic health conditions impacted by excessive SSB intake (e.g., obesity, type 2 diabetes, cardiovascular disease, caries and oral health).
In conclusion, relative to comparison participants, the primary SSB outcome from this RCT was maintained among SIPsmartER participants. Brief monthly behavioral based maintenance calls delivered via human support offered no advantage over behavioral based IVR calls, with regard to outcomes, completion or retention rates, or costs. While additional research is certainly warranted, our findings suggest that using IVR to support SSB behaviors offers advantages as an effective, scalable, and affordable maintenance strategy in rural regions.
body mass index
interactive voice response
Kit BK, Fakhouri THI, Park S, Nielsen SJ, Ogden CL. Trends in sugar-sweetened beverage consumption among youth and adults in the United States: 1999–2010. Am J Clin Nutr. 2013;98(1):180–8. https://doi.org/10.3945/ajcn.112.057943.
O’Neil CE, Keast DR, Fulgoni VL, Nicklas TA. Food sources of energy and nutrients among adults in the US: NHANES 2003–2006. Nutrients. 2012;4(12):2097. https://doi.org/10.3390/nu4122097.
Sharkey JR, Johnson CM, Dean WR. Less-healthy eating behaviors have a greater association with a high level of sugar-sweetened beverage consumption among rural adults than among urban adults. Food Nutr Res. 2011;55(1):5819. https://doi.org/10.3402/fnr.v55i0.5819.
Thompson FE, McNeel TS, Dowling EC, Midthune D, Morrissette M, Zeruto CA. Interrelationships of added sugars intake, socioeconomic status, and race/ethnicity in adults in the United States: National Health Interview Survey, 2005. J Am Diet Assoc. 2009;109(8):1376–83. https://doi.org/10.1016/j.jada.2009.05.002.
Zoellner J, Krzeski E, Harden S, Cook E, Allen K, Estabrooks P. Qualitative application of the theory of planned behavior to understand beverage consumption behaviors among adults. J Acad Nutr Diet. 2012;112(11):1774–84. https://doi.org/10.1016/%20j.jand.2012.06.368.
Hedrick VE, Davy BM, You W, Porter KJ, Estabrooks PA, Zoellner JM. Dietary quality changes in response to a sugar-sweetened beverage–reduction intervention: results from the talking health randomized controlled clinical trial. Am J Clin Nutr. 2017;105(4):824–33. https://doi.org/10.3945/ajcn.116.144543.
Malik VS, Pan A, Willett WC, Hu B. Sugar-sweetened beverages and weight gain in children and adults: a systematic review and meta-analysis. Am J Clin Nutr. 2013;98(4):1084–102. https://doi.org/10.3945/ajcn.113.058362.
Greenwood DC, Threapleton DE, Evans CE, et al. Association between sugar-sweetened and artificially sweetened soft drinks and type 2 diabetes: systematic review and dose-response meta-analysis of prospective studies. Br J Nutr. 2014;112(5):725–34. https://doi.org/10.1017/S0007114514001329.
Imamura F, O’Conner L, Ye Z, et al. Consumption of sugar sweetened beverages, artificially sweetened beverages, and fruit juice and incidence of type 2 diabetes: systematic review, meta-analysis, and estimation of population attributable fraction. BMJ. 2015;351:h3576. https://doi.org/10.1136/bmj.h3576.
Cheungpasitporn W, Thongprayoon C, Edmonds PJ, et al. Sugar and artificially sweetened soda consumption linked to hypertension: a systematic review and meta-analysis. Clin Exp Hypertens. 2015;37(7):587–93. https://doi.org/10.3109/10641963.2015.1026044.
Bernabe E, Vehkalahti MM, Sheiham A, Aromaa A, Suominen AL. Sugar-sweetened beverages and dental caries in adults: a 4-year prospective study. J Den. 2014;42(8):952–8. https://doi.org/10.1016/j.jdent.2014.04.011.
Greathouse KL, Chriqui J, Moser RP, Agurs-Collins T, Perna FM. The association of soda sales tax and school nutrition laws: a concordance of policies. Public Health Nutr. 2013:1–6. https://doi.org/10.1017/S1368980013003029.
Novak N, Brownell K. Taxation as prevention and as a treatment for obesity: the case of sugar-sweetened beverages. Curr Pharm Design. 2011;17(12):1218–22. https://doi.org/10.2174/138161211795656783.
Chriqui JF, Chaloupka FJ, Powell LM, Eidson SS. A typology of beverage taxation: multiple approaches for obesity prevention and obesity prevention-related revenue generation. J Public Health Policy. 2013;34(3):403–23. https://doi.org/10.1057/jphp.2013.17.
Edwards RD. Commentary: soda taxes, obesity, and the shifty behavior of consumers. Prev Med. 2011;52(6):417–8. https://doi.org/10.1016/j.ypmed.2011.04.011.
Vargas-Garcia EJ, Evans CEL, Prestwich A, Sykes-Muskett BJ, Hooson J, Cade JE. Interventions to reduce consumption of sugar-sweetened beverages or increase water intake: evidence from a systematic review and meta-analysis. Obes Rev. 2017;18(11):1350–63. https://doi.org/10.1111/obr.12580.
Glasgow RE, Klesges LM, Dzewaltowski DA, Bull SS, Estabrooks P. The future of health behavior change research: what is needed to improve translation of research into health promotion practice? Ann Behav Med. 2004;27(1):3–12. https://doi.org/10.1207/s15324796abm2701_2.
Orleans CT. Promoting the maintenance of health behavior change: recommendations for the next generation of research and practice. Health Psychol. 2000;19(1, Suppl):76–83. https://doi.org/10.1037/0278-6133.19.Suppl1.76.
Burke V, Mansour J, Beilin L, Mori T. Long-term follow-up of participants in a health promotion program for treated hypertensives (ADAPT). Nutr Metab Cardiovasc Dis. 2008;18(3):198–206. https://doi.org/10.1016/j.numecd.2006.10.004.
Fjeldsoe B, Neuhaus M, Winkler E, Eakin E. Systematic review of maintenance of behavior change following physical activity and dietary interventions. Health Psychol. 2011;30(1):99–109. https://doi.org/10.1037/a0021974.
Middleton KM, Patidar SM, Perri MG. The impact of extended care on the long-term maintenance of weight loss: a systematic review and meta-analysis. Obes Rev. 2012;13(6):509–17. https://doi.org/10.1111/j.1467-789X.2011.00972.x.
Radcliff TA, Bobroff LB, Lutes LD, et al. Comparing costs of telephone vs face-to-face extended-care programs for the management of obesity in rural settings. J Acad Nutr Diet. 2012;112(9):1363–73. https://doi.org/10.1016/j.jand.2012.05.002.
Lee S, Lindquist R. A review of technology-based interventions to maintain weight loss. Telemed J E Health. 2015;21(3):217–32. https://doi.org/10.1089/tmj.2014.0052.
Patterson PD, Moore CG, Probst JC, Shinogle JA. Obesity and physical inactivity in rural America. J Rural Health. 2004;20(2):151–9. https://doi.org/10.1111/j.1748-0361.2004.tb00022.x.
Meit M, Knudson A, Gilbert T, et al. The 2014 update of the rural-urban chartbook. Bethesda: Rural Health Reform Policy Research Center; 2014.
Bailey A, Porter K, Hill J, Chen Y, Estabrooks P, Zoellner J. The impact of health literacy on rural adults’ satisfaction with components of an intervention to improve sugar-sweetened beverage behaviors. Health Educ Res. 2016;31(4):492–508 https://doi.org/10.1093/her/cyw024.
Estabrooks PA, Smith-Ray RL. Piloting a behavioral intervention delivered through interactive voice response telephone messages to promote weight loss in a pre-diabetic population. Patient Educ Couns. 2008;72(1):34–41. https://doi.org/10.1016/j.pec.2008.01.007.
Piette JD, McPhee SJ, Weinberger M, Mah CA, Kraemer FB. Use of automated telephone disease management calls in an ethnically diverse sample of low-income patients with diabetes. Diabetes Care. 1999;22(8):1302–9. https://doi.org/10.2337/diacare.22.8.1302.
King AC, Friedman R, Marcus B, et al. Ongoing physical activity advice by humans versus computers: the community health advice by telephone (CHAT) trial. Health Psychol. 2007;26(6):718–27. https://doi.org/10.1037/0278-622.214.171.1248.
Reid RD, Pipe AL, Quinlan B, Oda J. Interactive voice response telephony to promote smoking cessation in patients with heart disease: a pilot study. Patient Educ Couns. 2007;66(3):319–26. https://doi.org/10.1016/j.pec.2007.01.005.
Foley P, Levine E, Askew S, et al. Weight gain prevention among black women in the rural community health center setting: the shape program. BMC Public Health. 2012;12(1):305. https://doi.org/10.1186/1471-2458-12-305.
Glasgow RE, Vogt TM, Boles SM. Evaluating the public health impact of health promotion interventions, the RE-AIM framework. Am J Public Health. 1999;89(9):1322–7. https://doi.org/10.2105/AJPH.89.9.1322.
Gaglio B, Shoup JA, Glasgow RE. The RE-AIM framework: a systematic review of use over time. Am J Public Health. 2013;103(6):e38–46. https://doi.org/10.2105/AJPH.2013.301299.
Harden SM, Gaglio B, Shoup JA, et al. Fidelity to and comparative results across behavioral interventions evaluated through the RE-AIM framework: a systematic review. Syst Rev. 2015;4:155. https://doi.org/10.1186/s13643-015-0141-0.
Allen K, Zoellner J, Motley M, Estabrook P. Understanding the internal and external validity of health literacy interventions: a systematic literature review using the RE-AIM framework. J Health Commun. 2011;16(Suppl 3):55–72. https://doi.org/10.1080/10810730.2011.604381.
Akers JD, Estabrooks PA, Davy BM. Translational research: bridging the gap between long-term weight loss maintenance research and practice. J Am Diet Assoc. 2010;110(10):1511–22. https://doi.org/10.1016/j.jada.2010.07.005.
Goode AD, Reeves MM, Eakin EG. Telephone-delivered interventions for physical activity and dietary behavior change an updated systematic review. Am J Prev Med. 2012;42(1):81–8. https://doi.org/10.1016/j.amepre.2011.08.025.
Zoellner J, Chen Y, Davy B, et al. Talking health, a pragmatic randomized-controlled health literacy trial targeting sugar-sweetened beverage consumption among adults: rationale, design & methods. Contemp Clin Trials. 2014;37(1):43–57. https://doi.org/10.1016/j.cct.2013.11.003.
Davy BM, Jahren AH, Hedrick VE, You W, Zoellner JM. Influence of an intervention targeting a reduction in sugary beverage intake on the delta13C sugar intake biomarker in a predominantly obese, health-disparate sample. Public Health Nutr. 2017;20(1):25–9. https://doi.org/10.1017/S1368980016001439.
Zoellner J, Hedrick V, You W, et al. Effects of a behavioral and health literacy intervention to reduce sugar-sweetened beverages: a randomized-controlled trial. Int J Behav Nutr Phys Act. 2016;13:38. https://doi.org/10.1186/s12966-016-0362-1.
Hedrick VE, Davy BM, Myers EA, You W, Zoellner JM. Changes in the healthy beverage index in response to an intervention targeting a reduction in sugar-sweetened beverage consumption as compared to an intervention targeting improvements in physical activity: results from the talking health trial. Nutrients. 2015;7(12):10168–78. https://doi.org/10.3390/nu7125525.
Virginia Medically Underserved Areas (VMUAs). http://www.vdh.virginia.gov/content/uploads/sites/76/2016/06/VMUA.pdf. Accessed 6 Apr 2012.
USDA. Economic Research Service. Rural Classifications. https://www.ers.usda.gov/topics/rural-economy-population/rural-classifications.aspx. Accessed 23 Oct 2017.
Virginia Department of Health. Division of Rural Health. http://www.vdh.virginia.gov/content/uploads/sites/76/2016/06/2013VSRHP-final.pdf. Accessed 23 Oct 2017.
Estabrooks P, You W, Hedrick V, Reinholt M, Dohm E, Zoellner J. A pragmatic examination of active and passive recruitment methods to improve the reach of community lifestyle programs: the talking health trial. Int J Behav Nutr Phys Act. 2017;14(1):7. https://doi.org/10.1186/s12966-017-0462-6.
Zoellner JM, Porter KJ, Chen Y, et al. Predicting sugar-sweetened behaviours with theory of planned behaviour constructs: outcome and process results from the SIPsmartER behavioural intervention. Psychol Health. 2017;32(5):509–29. https://doi.org/10.1080/08870446.2017.1283038.
Porter K, Chen Y, Estabrooks P, Noel L, Baily A, Zoellner J. Using teach-Back to understand participant behavioral self-monitoring skills across health literacy levels and behavioral condition. J Nutr Educ Behav. 2015;48(1):20–6. https://doi.org/10.1016/j.jneb.2015.08.012.
Golbeck AL, Ahlers-Schmidt CR, Paschal AM, Dismuke SE. A definition and operational framework for health numeracy. Am J Prev Med. 2005;29(4):375–6. https://doi.org/10.1016/j.amepre.2005.06.012.
US Department of Health and Human Services, Health Resources and Services Adminstration. Health Literacy Web site. https://www.hrsa.gov/about/organization/bureaus/ohe/health-literacy/index.html. Updated August 2016. Accessed 23 Oct 2017.
Develop and Test Materials. Centers for Disease Control and Prevention Web site. http://www.cdc.gov/healthliteracy/developmaterials/index.html. Updated December 9, 2016. Accessed 16 Feb 2017.
Aufderheide P, Part II. Conference proceedings and next steps. Aspen Institute report of the National Leadership Conferenceon Media Literacy. Washington: Communications and society program of the aspen institute; 1993.
Ajzen I. The theory of planned behavior. Organ Behav Human Decis Process. 1991;50:179–211. https://doi.org/10.1016/0749-5978(91)90020-T.
Popkin BM, Armstrong LE, Bray GM, Caballero B, Frei B, Willett WC. A new proposed guidance system for beverage consumption in the United States. Am J Clin Nutr. 2006;83(3):529–42. https://doi.org/10.1093/ajcn/83/3/529.
Johnson RK, Appel LJ, Brands M, et al. Dietary sugars intake and cardiovascular health: a scientific statement from the American Heart Association. Circulation. 2009;120(11):1011–20. https://doi.org/10.1161/CIRCULATIONAHA.109.192627.
Weiss B, Mays M, Martz W, et al. Quick assessment of literacy in primary care: the newest vital sign. Ann Fam Med. 2005;3:514–22. https://doi.org/10.1370/afm.405.
Hedrick V, Savla J, Comber D, et al. Development of a brief questionnaire to assess habitual beverage intake (BEVQ-15): sugar-sweetened beverages and total beverage energy intake. J Acad Nutr Diet. 2012;112(6):840–9. https://doi.org/10.1016/j.jand.2012.01.023.
CDC Health-Related Quality of Life (HRQOL–14) “Healthy Days Measure”. Centers for Disease control and Prevention Web site. https://www.cdc.gov/hrqol/hrqol14_measure.htm. Updated May 26, 2016. Accessed 17 Oct 2017.
Raab GM, Day S, Sales J. How to select covariates to include in the analysis of a clinical trial. Control Clin Trials. 2000;21(4):330–42. https://doi.org/10.1016/S0197-2456(00)00061-1.
Rubin DB. Multiple imputations for nonresponse in surveys. New York: John Wiley & Sons, Inc.; 1987.
Laird N, Ware J. Random effects models for longitudinal data. Biometrics 1982;38(963–74). doi: https://doi.org/10.2307/2529876
Borenstein M, Cooper H. Effect sizes for continuous data. In: Cooper H, Hedges L, Valentein J, editors. The Handbood of research synthesis and Meta analysis. 2nd ed. New York, NY: Sage Foundation; 2009. p. 221–35.
Perri MG, Limacher MC, Durning PE, et al. Extended-care programs for weight management in rural communities: the treatment of obesity in underserved rural settings (TOURS) randomized trial. Arch Intern Med. 2008;168(21):2347–54. https://doi.org/10.1001/archinte.168.21.2347.
Svetkey LP, Stevens VJ, Brantley PJ, et al. Comparison of strategies for sustaining weight loss: the weight loss maintenance randomized controlled trial. J Am Med Assoc. 2008;299(10):1139–48. https://doi.org/10.1001/jama.299.10.1139.
Wieland LS, Falzon L, Sciamanna CN, et al. Interactive computer-based interventions for weight loss or weight maintenance in overweight or obese people. Cochrane Database Syst Rev. 2012;8(8). https://doi.org/10.1002/14651858.CD007675.pub2.
Wing RR, Lang W, Wadden TA, et al. Benefits of modest weight loss in improving cardiovascular risk factors in overweight and obese individuals with type 2 diabetes. Diabetes Care. 2011;34(7):1481–6. https://doi.org/10.2337/dc10-2415.
Thorndike AN, Sonnenberg L, Healey E, Myint-U K, Kvedar JC, Regan S. Prevention of weight gain following a worksite nutrition and exercise program: a randomized controlled trial. Am J Prev Med. 2012;43(1):27–33. https://doi.org/10.1016/j.amepre.2012.02.029.
Cussler EC, Teixeira PJ, Going SB, et al. Maintenance of weight loss in overweight middle-aged women through the internet. Obesity. 2008;16(5):1052–60. https://doi.org/10.1038/oby.2008.19.
Katula JA, Vitolins MZ, Morgan TM, et al. The healthy living partnerships to prevent diabetes study: 2-year outcomes of a randomized controlled trial. Am J Prev Med. 2013;44(4):S324–32. https://doi.org/10.1016/j.amepre.2012.12.015.
Carels RA, Darby L, Cacciapaglia HM, et al. Applying a stepped-care approach to the treatment of obesity. J Psychosom Res. 2005;59(6):375–83. https://doi.org/10.1016/j.jpsychores.2005.06.060.
The authors would like to acknowledge the contributions of the entire Talking Health team, including all the staff and graduate students.
The project described was supported by National Institutes of Health, National Cancer Institute (R01CA154364). The content is solely the responsibility of the authors and does not necessarily represent the official views of the National Institutes of Health.
Availability of data and materials
The datasets used and/or analysed during the current study are available from the corresponding author on reasonable request.
Ethics approval and consent to participate
The Virginia Tech Institutional Review Board (FWA00000572) approved this study. Written informed consent was provided by participants. IRB number for protocol is 12–090.
Consent for publication
Not applicable, individual level data are not reported.
The authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
About this article
Cite this article
Zoellner, J.M., You, W., Estabrooks, P.A. et al. Supporting maintenance of sugar-sweetened beverage reduction using automated versus live telephone support: findings from a randomized control trial. Int J Behav Nutr Phys Act 15, 97 (2018). https://doi.org/10.1186/s12966-018-0728-7
- Randomized controlled trial
- Rural population
- Behavioral research