Skip to main content

Process evaluation of TXT2BFiT: a multi-component mHealth randomised controlled trial to prevent weight gain in young adults

Abstract

Background

TXT2BFiT was one of the first few innovative mHealth programs designed for young adults (18–35 years) with demonstrated efficacy in weight management. However, research is lacking to understand intervention effectiveness, especially in complex, multi-component mHealth programs. This paper investigates participant perceptions of and engagement with the mHealth program components in the TXT2BFiT to understand program effects.

Methods

Process evaluation data were collected continuously for the study duration. The TXT2BFiT program was a multi-component lifestyle program delivered intensively for 3-month followed by a 6-month maintenance phase. Program components included personalised coaching calls, text messages, emails, smartphone apps and website access. Process evaluation measures included frequency of use of components and frequency for number of components used (online survey data); dose delivered and engagement with program components (researcher logs and web platform reports); frequency, timing and difficulties experienced with program components (online survey data) and overall perceptions of program components (online survey data and semi-structured telephone interviews). Qualitative data analysis was performed using NVivo10.

Results

Over 80 % of participants completed post-intervention (3-months, intervention, n = 110, control n = 104) and follow-up surveys (9-months, intervention, n = 96, control n = 104). Thirty intervention participants completed semi-structured telephone interviews. Participants reported high use of coaching calls, text messages and emails and no issues in content delivery from these components. These components were described as helping them to achieve their goals. Website and app use and engagement was low for the duration of the program. Participants would prefer incorporation of the self-monitoring apps and website resources into one smartphone application that can be individualised by entry of their personal data.

Conclusions

Our process evaluation has allowed a comprehensive understanding of use and preference for different program components. The high value placed on the coaching calls is consistent with a desire for personalisation of the mHealth program and even further tailoring of text messages and emails. The findings of this study will be used to revise TXT2BFiT for future users.

Trial registration

The trial is registered with the Australian New Zealand Clinical Trials Registry (ACTRN12612000924853).

Background

Young adults aged 18–35 years are highly susceptible to weight gain [13], with the highest incidence of overweight and obesity compared to other age groups [4]. This is believed to be driven by their interactions with the obesogenic environment leading to unhealthy lifestyle behaviours such as poor dietary behaviours [5, 6] and sedentary lifestyles [7, 8], often associated with influence of digital technology [9].

While there may be negative impacts from the explosion of technology, this also provides opportunities for innovative and real-time delivery of health-related information. Smartphone ownership has increased substantially in recent years, with 65 % of Australians [10] and 64 % of Americans [11] owning a smartphone. Young adults record highest ownership at 85 % in the USA [12]. About three-quarters of 18–29 year old smartphone owners have used their phone in the last year to seek information about a health condition [12]. Smartphone intervention delivery, or mobile-health (mHealth) [13], could potentially provide a cost-effective intervention channel that allows real-time delivery of health information and serves as an effective tool for behaviour change to a wide ranging population [14].

mHealth or electronic-health (eHealth) programs have demonstrated success in the promotion of a range of healthy behaviours, including weight management [14, 15]. However, our recent systematic review showed only six of 22 interventions for weight gain prevention in young adults used new technology [16]. Of these six, only three studies reported the reasons why technology achieved or failed to achieve the desired outcomes of the interventions [1719].

Process evaluation is an important step for understanding intervention effectiveness, especially in complex, multi-component mHealth programs [20]. Identifying and understanding how participants engage with and use the different components with respect to both the form of technology e.g. social media platforms, text messaging and smartphone apps and the content delivered can inform program improvement and ultimately, its effectiveness. Process evaluation can give insights to possible underlying factors for why a program fails or succeeds in effecting change [21]. Assuring that there is maximum participant engagement and satisfaction with program components can also enhance program retention [22].

Two recent process evaluations of technology-focused interventions in young adults have been published, beginning an evidence base to inform most effective program delivery to young adults [23, 24]. Both studies quantitatively reported how engagement with social networking intervention components was highly variable and declined over time. However, qualitative insights from Merchant et al., found many participants passively engage with social networking, not captured in quantitative engagement data [24].

TXT2BFiT was a multi-component mHealth lifestyle program custom designed for young adults (18–35 years) [25]. The program was delivered intensively for 3-months with personalised coaching calls, text messages, emails, smartphone apps and website access, followed by a 6-month maintenance phase. Program efficacy was tested in a randomised controlled trial (RCT) design, with weight reduction and improvements in lifestyle behaviours seen at 3-months [26] and maintained at 9-months (data unpublished). TXT2BFiT was one of the first few innovative mHealth programs. We also conducted a process evaluation of TXT2BFiT to gain understanding of program engagement, program fidelity and program component contribution to observed effects. Specifically, this paper investigates participant perceptions of and engagement with the mHealth program components in the TXT2BFiT to understand program effects.

Methods

TXT2BFiT participants

The TXT2BFiT study was conducted with healthy, non-pregnant 18–35 year-olds living in an urban environment in Australia recruited via primary care and print and electronic media [27]. Eligible participants had a BMI between 23.0 and 31.9 kg/m2 with dietary and physical activity behaviours that failed to meet national recommendations. Participants were required to have a mobile phone capable of receiving text messages and access to the internet at least weekly. Inclusion and exclusion criteria have been described in detail elsewhere [26]. Materials and methods of the TXT2BFiT 9-month trial were approved by the Human Research Ethics Committee in September 2012 (Approval number 15226).

TXT2BFiT design

Details about the TXT2BFiT study protocol and recruitment are reported in separate publications [2527]. In brief, the two-arm parallel RCT tested efficacy of our m-health lifestyle program for weight maintenance in young adults. The 9-month study consisted of a 3-month intervention period and 6-month maintenance period and it was conducted between November 2012 and April 2015. The 3-month TXT2BFiT intervention program comprised eight gender-specific weekly motivational text messages personalised according to stage-of-change for nutrition and physical activity strategies aimed to facilitate behaviour change around weight maintenance; weekly emails, five personalized coaching calls over 3-months; continuous access to purpose-designed smartphone applications; and community blog and support resources available on the study website. Two Accredited Practising Dietitians (APD) conducted the personalised coaching calls incorporating intervention participants’ stage-of-change and motivational interviewing techniques to set personal goals, discuss barriers and enablers, feedback on participant progress and set new goals. Participants set one goal to prevent weight gain and maintain their body weight within the normal BMI range (18.5–24.9 kg m−2) or to move towards a normal range. Participants also set between one and three goals relating to their diet or physical activity. All goals set over the five coaching calls and two booster calls were participant directed with dietitian input if required. Intervention participants were also mailed an 18-page printed booklet that included dietary information and sample meal plans as well as a two-page handout summarizing the Australian National Dietary and Physical Activity Guidelines given to controls [28, 29]. During maintenance phase, month four to nine, one monthly text message, one monthly email and two booster coaching calls at 5-months and 8-months were provided to intervention participants.

Control participants received the mailed two-page handout only, one introductory call (week 0) to introduce the program (no coaching given), four text messages i.e. one every three weeks and access to a website with only electronic versions of the two-page handout, consent form, study information statement and contact information.

All participants enrolled in the TXT2BFiT study were sent a link to online surveys at 3-months and at 9-months that included questions on use, frequency, timing, difficulties and overall experience with all program components. Control participants were asked similar questions for the minimal components of the program they were exposed to (text messaging and website use) for consistency of survey method.

Frequency of use of components and frequency for number of components used

All participants completing the online surveys were asked “what parts of the program did you use?” This included use of the components i.e. coaching calls, text messages, emails, smartphone applications, printed booklet, community blog and each of the seven resources available on the website. Resources included “easy, healthy eating on a budget”, “emergency meal tool kit”, “meal planning worksheet”, “commit yourself: physical activity planner”, “tips for take-out meals”, “seasonal guide to fruit and vegetables” and “staying healthy over the holidays”.

Dose delivered and engagement with program components

Data on dose delivered and engagement with program components were continuously collected for monitoring purposes for the duration of the study and stored in a database. Data included completed coaching calls, text messages delivered and replied to, emails delivered, download and logins to smartphone applications, and posts on the community blog.

Coaching calls were considered completed and engaged with, if all main aspects of the coaching call guide had been delivered to the participant (previous behavioural goals assessed and new behavioural goals set if appropriate). Delivery reports were downloaded from the text message web platform (MessageMedia®) and data synthesized on number of text messages delivered and on the number failed to be delivered per participant (dose delivered). Intervention participants were asked to reply ‘OK’ to 16 text messages during the intensive phase (months 1–3) and to each of the six text messages sent during the maintenance phase (months 4–9), while control participants were asked to reply ‘OK’ to all four text messages sent during the intensive phase. Engagement was determined by the number of replies per participant. Emails were considered delivered if no undelivered email was returned (dose delivered). Smartphone application downloads (dose delivered) and logins (engagement) were retrieved, as were details of the posts by researchers and participants on the community blog section of the website (engagement).

Frequency, timing and difficulties experienced with program components

The delivery frequency of the text messages and emails were assessed by asking “were text messages/emails sent often enough?” with an option to report the number of text messages or emails per day they would have preferred to receive. Preference for the delivery time of text messages and emails were assessed by asking “was the time of day that text messages/emails were sent appropriate?” Participants were also asked to report any difficulty experienced using the text messages, emails, smartphone applications or website.

Overall perceptions of program components

The online surveys asked participants if they had any other comments about the TXT2BFiT program. In addition, between March 2014 and April 2015 all individuals, who participated in the TXT2BFiT intervention arm were invited via email at the completion of the intervention to participate in the semi-structured telephone interview qualitative sub-study. The process evaluation sub study was approved by the Human Research Ethics Committee in February 2014 (Approval number 2014/091). The aim of the semi-structured interviews was to explore participant's experiences with and use of program components to corroborate the quantitative effects observed. Participants were asked questions about which aspects of the program they found useful in helping them achieved their goals and which aspects of program could be improved for future study implementation.

Both participants who completed or did not complete the 9-month TXT2BFiT intervention arm were contacted by email, but participants who had officially withdrawn were excluded. Participants responded via email and gave informed consent. Those who did not respond were followed up by a telephone call within two weeks of the email. If they did not respond to the telephone call, no further contact was made. The semi-structured interviews were administered by telephone, lasting approximately 15–20 min and participants were reimbursed for their time with a small AU$10 gift voucher. The interviews were audio recorded for the purpose of transcription and data analysis.

Data sources, analysis and statistics

A summary of all process evaluation data and their definitions is provided in Table 1. Descriptive statistics were reported for quantitative data. De-identified qualitative data were coded using the NVivo Software program (QSR International Pty Ltd. Version 10, 2012, Victoria, Melbourne). One researcher (SP) trained in qualitative research methods conducted, transcribed and coded all participant comments and interviews, allowing for data immersion and obtaining an overall sense of the data. Content inductive analysis was used for each mHealth component, and categories ranked per mHealth component [30]. An open coding approach was adopted, forming a general description of the research topic through generating categories and subcategories as they emerged [31]. This systematic approach is appropriate for semi-structured interviews to determine trends and patterns. Discussion with a second researcher (MA-F) familiar with the data finalised and confirmed emerging categories. Verbatim quotes from interviews that best represented the key findings for each category were highlighted for subsequent reporting purposes.

Table 1 Summary of data sources and definitions

Results

Participants’ profile

The total randomized sample were aged 27.7 ± 4.9 (SD) years, female (61 %, 152/248), English speaking only (69 %, 172/248), university educated (62 %, 153/248) and living in a socio-economically advantaged area (75 %, 187/248). Participants were overweight on the basis of BMI classification (BMI 27.1 ± 2.5 (SD) kg m −2). There was no significant difference in baseline characteristics between participants who completed post-intervention (3-months, intervention, n = 110, control n = 104) [26] and follow-up surveys (9-months, intervention, n = 96, control n = 104) and participants that did not.

Frequency of use of components

Frequency of TXT2BFiT program component use for intervention participants at 3-months and 9-months is shown in Fig. 1. At 3-months coaching calls were used by all participants, deceasing to 60 % at 9-months. Text message and email frequency of use remained consistently high for the 9-month duration. The printed booklet was used by 66 % of participants during the 3-month intervention. Smartphone applications, resources and the community blog were used by less than 25 % of participants at both 3-months and 9-months.

Fig. 1
figure 1

Use of all program components at post-intervention (3-months, n = 110) and follow-up (9-months, n = 96) in intervention group

At 3-months 35 % of control participants reported using the two page handout summarising the Australian National Nutrition and Physical Activity guidelines and 78 % reported using the four text messages (data not shown).

Frequency for number of components used

At 3-months, 32 % of intervention participants reported using any combination of four program components, with 75 % or higher using three to five components (Fig. 2). This decreased to three components at 9-months (27 %), with more than 60 % using two to four components.

Fig. 2
figure 2

Frequency for number of components of the TXT2BFiT program assessed at post-intervention (3-months, n = 110) and follow-up (9-months, n = 96) in intervention group. (Website resources were treated as one component and participants using ≥ 1 were allocated one component)

Dose delivered and engagement with program components

Coaching calls

Overall 92 % (574/625) were completed at 3-months and 81 % (187/230) at 9-months (Table 2). Intervention participants completed on average 4.6 of five coaching calls, with 82 % completing all five at 3-months. Intervention participants completed 1.6 of two coaching calls on average, with 77 % completing both between 4-months and 9-months. All control participants completed the introductory telephone call.

Table 2 Participant engagement, dose delivered, frequency, timing and difficulties experienced of TXT2BFiT program components by intervention groups

Text messages and emails

Text message delivery was 98 % (11543/11808) during the 3-month intervention period, and 96 % at 9-months (660/690) (Table 2). Text messages requiring a response during the first 3-months (16 text messages), were responded to an average 8.8 times, with 20 % of participants replying to all. All maintenance messages during months four to nine requested a response (six text messages), and reply declined to an average 1.9 times and 6 % replied to all. Email delivery was at 100 % for the duration of the study, with no email undelivered (Table 2).

Of the 500 control text messages scheduled 3 % were not delivered. Most control participants replied to two or more of the four text messages (114/125, 91 %), with 62 % (78/125) replying to all four text messages (Table 2).

Smartphone applications and website

Slightly over half (52 %) of participants downloaded the smartphone applications and less than half (43 %) of participants reported using the website (Table 2). The monitored community blog was the least used component, with only four participants contributing and ten posts made. Topics included shared experiences, tips and questions.

Frequency, timing and difficulties experienced with program components

Text messages and emails

Participants reported text messages and emails were sent often enough during the 3-month program (96 and 93 % respectively) (Table 2). The vast majority were satisfied with the timing of the text messages and emails (94 and 96 % respectively). A very small number reported delays in delivery of text messages due to service provider error and delays in delivery of emails (going to junk folders as an example).

Smartphone applications and website

Difficulties reported with program components were highest in the smartphone applications (28 % of participants) (Table 2). Participants described the applications as “clunky” and hard to navigate. Difficulty in initially downloading the smartphone application was the next most reported problem and followed by difficulty logging in. The design and difficulty issues participants reported contributed to their low app usage. A small number reported difficulty with website login and accessing the healthy weight tracker.

Overall perceptions of program components

Fifty intervention participants at 3-months and 40 intervention participants at 9-months completed the open ended survey question asking “did you have any other comments about the TXT1BFiT program?” (Data not shown). Feedback was positive overall, with the coaching calls referred to as the most helpful component due to the accountability and motivation elicited by the coaching calls. Suggestions included further personalisation of other components, such as the text messages and emails.

Over two-thirds of control participants provided comments in both the 3-month (n = 40) and 9-month survey (n = 38). Control participants reported more contact was required to increase motivation and the program as they received it was not helpful. The “lack of regular support” was reinforced with 9-months comments, however, some participants mentioned it was the “kick start” required for a healthier lifestyle.

Personal goal of participation in the program

Ethical approval was granted after 42 eligible intervention participants had completed the intervention and were outside the two-week window required for participation in the process evaluation interviews. Seventy-three intervention participants were invited to take part in semi-structured telephone interviews. Thirty participants (41 %, (30/73) participation rate) accepted the invitation (13 males, 17 females). Intervention participants who took part in the semi-structured telephone interviews did not differ from those who did not take part. Participant perceptions of the program are presented in Table 3.

Table 3 Components, categories and attributes from the semi-structured interviews with TXT2BFiT participantsa

Weight loss was the primary reason for enrolling in the TXT2BFiT program, with some participants mentioning sustainable weight loss (Table 3). Improving physical activity and eating habits to improve health were commonly mentioned mostly in combination. Participants used words such as ‘habits’, ‘behaviours’, ‘sustainable’, ‘long-term changes’ and ‘maintain’ in relation to reducing weight, and improving physical activity and eating habits.

Coaching calls

The coaching calls were reported as the most helpful component (Table 3). Participants thought the calls were professional and personalised, acting as an external motivator. They described how the information was “all really cool, sensible stuff” and it was important for them to be consulting with a trained professional (APD). Accountability was a common theme. Participants mentioned a positive sense of accountability to the APD, and how someone “checking in” and “to bounce ideas off” helped them towards achieving their goal(s). Participants felt they could direct the coaching calls to meet their requirements, but they also mentioned how the calls were a collaboration and if an approach or goal wasn’t working for them, they could re-work their goal with the APD and it was within a non-judgmental environment.

Text messages

Participants liked the text messages as they provided “sound bite information” (Table 3). Tip and hint based text messages were preferred by participants as they were practical. Fact based messages were less preferred because most participants acknowledged that their nutrition and physical activity issues were not from a knowledge deficit. The easier the text messages were to implement into daily life, the more achievable and sensible they were perceived. The four behaviours targeted in the text messages were not relevant to all participants, and greater personalisation was suggested. However, despite some text messages being irrelevant to the participant’s goal, they still regarded them as a reminder. Participants were reminded of targeted behaviours at appropriate times (i.e. energy dense take-away consumption on a Friday and Saturday evening at 5 PM), which they described as contributing to positive habits forming. Text messages were viewed as easy to read, brief information that was not burdensome to participants.

Emails

Participants associated emails with work and spam (Table 3). Most weekly emails were viewed as impersonal and only scanned over, but the email sent as a summary of the individual coaching call was well received. This email was personalised with the agreed upon goals for the next coaching call and contained personally relevant links to study materials (website resources and/or smartphone applications). As this email was anticipated, it was reported as always read, regardless of length and would often be printed out for display.

Website and smartphone applications

The least helpful component mentioned was the smartphone applications for reasons such as logging in difficulties and navigation issues (Table 3). Participants did not engage with the smartphone applications, as they did not compare to other commercially available smartphone applications. They expected greater self-monitoring capabilities linked to the goals that they were working on with the APD in the coaching calls. Similarly, the website was not frequently used and issues were raised around access and difficulty logging in. Participants said the resources were easily accessible on the website. However, most participants prefer to use their smartphone to access the website and a new mobile version was requested.

External motivators and improvements

Participants reported using commonly available smartphone applications and self-monitoring devices such as My Fitness Pal and Fitbit (Table 3). Furthermore, most had some social support, including that of family, partners or memberships to gyms or sporting groups. Participants reported preferring an individualised program, with coaching calls the central feature and text messages, emails and website components tailored to their personal goals. A need for a more gradual decline in contact between the 3-month program and the maintenance phase was commonly mentioned.

Discussion

To our knowledge this is the first study to elucidate young adults’ perceptions of and engagement with a mHealth program. Not surprisingly we discovered the desire for personalised intervention, evident by the high value placed on the behavioural coaching calls with a dietitian and text messages and summarising emails tailored to their personal nutrition and physical activity goals. Participants would prefer that the four apps for self-monitoring and website resources all be incorporated into one smartphone application that can be individualised by entry of their personal data. The findings of this study will be used to revise TXT2BFiT for future users.

Findings from this process evaluation suggested the phone coaching calls were most valued and other mHealth components acted to supplement the coaching calls. Coaching calls were added to the program and the frequency of text messaging increased in response to feedback from our first pilot study. There is already well established evidence supporting the effıcacy of telephone delivered interventions to promote physical activity and dietary change [32]. Participants had clear goals of what they hoped to achieve during the program, which aligned with the aims of the TXT2BFiT study. Personally tailored eHealth programs with health professional input and use of a structured program has been shown to enhance weight loss results [33, 34]. Studies have suggested that successful interventions for the prevention of weight gain instil skills in goal setting, planning and self-monitoring [35] which were a key component of the coaching calls. The seven mHealth components of the program contained 18 (data unpublished) behaviour change techniques (BCT), of the 26 recommended for positive behaviour change [36]. Over 75 % of participants reported using a combination of three to five components in the intervention period, and therefore would have been exposed to a large proportion of these BCTs known to elicit change.

Text messages and emails were the other main aspect of the program participants found helpful to achieve their goals. While actually not a mobile component, the nutrition booklet was also engaged with and used by participants. Interventions with text messages components have been shown to be beneficial in relation to weight loss [15]. Participants preferred behaviour-based messages as opposed to knowledge-based messages. Practical behaviour-based messages were reported to be implemented frequently when received, and even more likely when the message was related to a goal discussed in the coaching call. This is in line with current evidence suggesting self-monitoring, goal checking, prompting behavioural cues and goal reset are important for behavioural maintenance [37, 38]. Benefits of text messages and emails are that they can be tailored by the health professional to meet the needs of the participant and supplement the human interaction of the coaching call and enhance effectiveness [39]. A recent eHealth mini-online education lessons intervention for young adults used stage-of-change targeted emails (‘nudges’) to reinforce the fruit and vegetable, physical activity and stress management behaviours targeted in the lessons. The process evaluation revealed most adhering participants were moderately motivated by the lessons, however, no process evaluation data was presented on the email nudges [40]. For the TXT2BFiT study, the text messages addressed only the four key lifestyle interventions: sugary beverages, take-away foods, fruit and vegetables and physical activity. The database of goals set during the five coaching calls will be analysed along with other avenues such as crowd sourcing [41] with an on-line community of young adults, to inform future additional message development and facilitate further personalisation.

Barrier and facilitators discussed in the coaching calls and identified in other young adult populations such as budget constraints, peer pressure and time management [42, 43] can be incorporated in future message content. Participants asked for a more gradual decline in contact frequency between the intervention and maintenance phase. Whether longer duration of delivery of program components could enhance the changes already made and could result in maintenance beyond 9 months of this study is yet to be discerned.

Several recent studies used process evaluations to determine factors related to mHealth [24, 26, 44, 45] and eHealth [23, 46] implementation in young adults and other populations. The community blog in this study was not engaged with by participants, however, recent research has suggested many participants may passively engage with social networking i.e. read blog posts, but not respond or contribute [24]. If the community blog posts by research staff had continued, a greater dose of the intervention component, or more participants reporting use may have resulted. Morrison et al., [45] showed that goal-tracking smartphones applications have the potential to improve individuals’ engagement with their personal health goals when used as a supplement to existing web-based intervention components consisting of weekly feedback on personalised healthy eating and physical activity plans. The smartphone applications offered self-monitoring features [47], but one app had been developed for each behaviour in isolation in the belief participants might work on only one or two behaviours at a time. As it was clear weight loss was a primary goal for many, energy balance was important so linkage between diet and physical activity data was desired. This was the reason they reverted to commercially available smartphone applications. Researchers in the UK have developed an acceptable and feasible smartphone application incorporating goal setting, self-monitoring of diet and activity, and feedback via one weekly text message [48]. This integrated smartphone application approach alone was effective in pilot testing for weight loss in 50 women over a 6 month period. As researchers it is difficult to offer comparable quality and features as in commercial smartphone applications. Creating partnerships with commercial providers could provide participants an evidence based program, designed using up-to-date technology, however, ethical issues arise in relation to data ownership. It should also be noted that the most popular app in Australia that was reported as being used in this study failed to produce weight loss over a 6-month period when trialled in the primary care setting in the US [49]. Self-monitoring smartphone apps designed by researchers, however, have demonstrated weight-loss efficacy [50]. The qualitative research does indicate that participants prefer smartphones for delivery of their intervention, including the phone feature in particular, so that moving all resources from the website into an app format would meet with approval.

Strengths and limitations

This study provides insights not yet reported in mHealth literature. Qualitative studies using process evaluation to inform recruitment strategies [51], and understand motivators and barriers to behaviour change [42, 52, 53] for weight management in young adults is emerging. However, qualitative process evaluation research has been lacking in weight gain prevention interventions for young adults. A strength of this process evaluation is its comprehensiveness. It incorporates of multiple sources of data, measuring a range of process evaluation dimensions and indicators such as dose delivered and engagement. It also measures the different program components, which is very important considering the multicomponent characteristics of the TXT2BFiT program. Retention was high in this study with more than 80 % of participants completing the online surveys at 9-months. Despite our efforts, we were unable to contact participants lost to follow-up (i.e. not completing survey but did not officially dropout) if it was due to the delivery of the mHealth program. Research from an older rural population suggests unrealistic program expectations may inhibit initiation and continuation of behaviour change for weight management [54]. For the qualitative interviews, 42 participants were not contacted for telephone interviews due to delay in ethical approval. Lastly, the population in this intervention were mostly well-educated and from higher socio-economic backgrounds. Young adults less educated and from lower socio-economic backgrounds may require education-based health messages to improve nutrition knowledge.

Conclusions

Obesity is a multifaceted public health issue; young adults are at increased risk, and prevention requires personalised solutions. mHealth programs have the benefit of offering the participating individual multiple components, thus being able to cater for a wide-range of needs. The TXT2BFiT has demonstrated efficacy in reducing and/or maintaining weight and improved dietary and physical activity behaviours. Our process evaluation has allowed a comprehensive understanding of use and preference for different program components. Future work will be required to translate the array of TXT2bFiT components to meet the needs of most young adults, to support them to stay healthy and active.

Abbreviations

APD:

Accredited practising dietitian

BCT:

Behaviour change techniques

eHealth:

Electronic health

mHealth:

mobile health

RCT:

Randomised controlled trial

USA:

United States of America

References

  1. Burke GL, Bild DE, Hilner JE, Folsom AR, Wagenknecht LE, Sidney S. Differences in weight gain in relation to race, gender, age and education in young adults: the CARDIA Study. Coronary Artery Risk Development in Young Adults. Ethn Health. 1996;1(4):327–35. doi:10.1080/13557858.1996.9961802.

    Article  CAS  Google Scholar 

  2. Ng M, Fleming T, Robinson M, Thomson B, Graetz N, Margono C, et al. Global, regional, and national prevalence of overweight and obesity in children and adults during 1980–2013: a systematic analysis for the Global Burden of Disease Study 2013. Lancet. 2014;384(9945):766–81. doi:10.1016/S0140-6736(14)60460-8.

    Article  Google Scholar 

  3. Lewis CE, Jacobs DR, McCreath H, Kiefe CI, Schreiner PJ, Smith DE, et al. Weight gain continues in the 1990s: 10-year trends in weight and overweight from the CARDIA study. Am J Epidemiol. 2000;151(12):1172–81.

    Article  CAS  Google Scholar 

  4. Allman-Farinelli MA, Chey T, Bauman AE, Gill T, James WP. Age, period and birth cohort effects on prevalence of overweight and obesity in Australian adults from 1990 to 2000. Eur J Clin Nutr. 2008;62(7):898–907. doi:10.1038/sj.ejcn.1602769.

    Article  CAS  Google Scholar 

  5. Irazusta A, Hoyos I, Irazusta J, Ruiz F, Díaz E, Gil J. Increased cardiovascular risk associated with poor nutritional habits in first-year university students. Nutrition Research. 2007;27(7):387–94. doi:http://dx.doi.org/10.1016/j.nutres.2007.05.007.

  6. Li KK, Concepcion RY, Lee H, Cardinal BJ, Ebbeck V, Woekel E, et al. An examination of sex differences in relation to the eating habits and nutrient intakes of university students. J Nutr Educ Behav. 2012;44(3):246–50. doi:10.1016/j.jneb.2010.10.002.

    Article  Google Scholar 

  7. Anderson LM, Quinn TA, Glanz K, Ramirez G, Kahwati LC, Johnson DB, et al. The effectiveness of worksite nutrition and physical activity interventions for controlling employee overweight and obesity: a systematic review. Am J Prev Med. 2009;37(4):340–57. doi:10.1016/j.amepre.2009.07.003.

    Article  Google Scholar 

  8. Keating XD, Guan J, Pinero JC, Bridges DM. A meta-analysis of college students’ physical activity behaviors. J Am Coll Heal. 2005;54(2):116–25. doi:10.3200/jach.54.2.116-126.

    Article  Google Scholar 

  9. Freeman B, Kelly B, Vandevijvere S, Baur L. Young adults: beloved by food and drink marketers and forgotten by public health? Health Promot Int. 2015. doi:10.1093/heapro/dav081.

    Google Scholar 

  10. Google, Ipsos MediaCT, Mobile Marketing Association, Interactive Advertising Bureau. Our Mobile Planet: Australia Understanding the Mobile Consumer 2013. http://www.fusion.com.au/ourdigitalstate/2012/our_mobile_planet_australia_en.pdf. Accessed 17-November-2015.

  11. Pew Research Centre. Mobile Technology Fact Sheet. In: Smartphone owners in 2014. 2014. http://www.pewinternet.org/fact-sheets/mobile-technology-fact-sheet/. Accessed 19-01-2015.

  12. Pew Research Centre. The Smartphone Difference. 2015. http://www.pewinternet.org/2015/04/01/us-smartphone-use-in-2015/. Accessed 17-November-2015.

  13. World Health Organisation. mHealth New horizons for health through mobile technologies: second global survey on eHealth. Geneva: World Health Organisation; 2011.

    Google Scholar 

  14. Hutchesson MJ, Rollo ME, Krukowski R, Ells L, Harvey J, Morgan PJ, et al. eHealth interventions for the prevention and treatment of overweight and obesity in adults: a systematic review with meta-analysis. Obes Rev. 2015. doi:10.1111/obr.12268.

    Google Scholar 

  15. Siopis G, Chey T, Allman-Farinelli M. A systematic review and meta-analysis of interventions for weight management using text messaging. J Hum Nutr Diet. 2015;28 Suppl 2:1–15. doi:10.1111/jhn.12207.

    Article  Google Scholar 

  16. Partridge SR, Juan SJH, McGeechan K, Bauman A, Allman-Farinelli M. Poor quality of external validity reporting limits generalizability of overweight and/or obesity lifestyle prevention interventions in young adults: a systematic review. Obes Rev. 2015;16(1):13–31. doi:10.1111/obr.12233.

    Article  CAS  Google Scholar 

  17. Dour CA, Horacek TM, Schembre SM, Lohse B, Hoerr S, Kattelmann K, et al. Process evaluation of Project WebHealth: a nondieting Web-based intervention for obesity prevention in college students. J Nutr Educ Behav. 2013;45(4):288–95. doi:10.1016/j.jneb.2012.10.001.

    Article  Google Scholar 

  18. Hebden L, Cook A, van der Ploeg HP, King L, Bauman A, Allman-Farinelli M. A mobile health intervention for weight management among young adults: A pilot randomised controlled trial. J Hum Nutr Diet. 2013;27(4):322–32. doi:10.1111/jhn.12155.

    Article  Google Scholar 

  19. Dennis EA, Potter KL, Estabrooks PA, Davy BM. Weight Gain Prevention for College Freshmen: Comparing Two Social Cognitive Theory-Based Interventions with and without Explicit Self-Regulation Training. J Obes. 2012;2012:1–10. doi:10.1155/2012/803769.

    Article  Google Scholar 

  20. Moore GF, Audrey S, Barker M, Bond L, Bonell C, Hardeman W et al. Process evaluation of complex interventions: Medical Research Council guidance. BMJ (Clinical research ed). 2015;350:h1258. doi:10.1136/bmj.h1258.

  21. Bauman A, Nutbeam D. Evaluation in a Nutshell: A Practical Guide to the Evaluation of Health Promotion Programs. 2nd ed. Sydney: McGraw-Hill Companies, Inc.; 2014.

    Google Scholar 

  22. Hawkins RP, Kreuter M, Resnicow K, Fishbein M, Dijkstra A. Understanding tailoring in communicating about health. Health Educ Res. 2008;23(3):454–66. doi:10.1093/her/cyn004.

    Article  Google Scholar 

  23. Laska MN, Sevcik SM, Moe SG, Petrich CA, Nanney MS, Linde JA, et al. A 2-year young adult obesity prevention trial in the US: Process evaluation results. Health Promot Int. 2015. doi:10.1093/heapro/dav066.

    Google Scholar 

  24. Merchant G, Weibel N, Patrick K, Fowler JH, Norman GJ, Gupta A, et al. Click “like” to change your behavior: a mixed methods study of college students’ exposure to and engagement with Facebook content designed for weight loss. J Med Internet Res. 2014;16(6):e158. doi:10.2196/jmir.3267.

    Article  Google Scholar 

  25. Hebden L, Balestracci K, McGeechan K, Denney-Wilson E, Harris M, Bauman A, et al. ‘TXT2BFiT’ a mobile phone-based healthy lifestyle program for preventing unhealthy weight gain in young adults: study protocol for a randomized controlled trial. Trials. 2013;14(75):1745–6215. doi:10.1186/1745-6215-14-75.

    Google Scholar 

  26. Partridge SR, McGeechan K, Hebden L, Balestracci K, Wong AT, Denney-Wilson E, et al. Effectiveness of a mHealth lifestyle program with telephone support (TXT2BFiT) to prevent unhealthy weight gain in young adults: randomized controlled trial. JMIR Mhealth Uhealth. 2015;3(2), e66. doi:10.2196/mhealth.4530.

    Article  Google Scholar 

  27. Partridge SR, Balestracci K, Wong AT, Hebden L, McGeechan K, Denney-Wilson E, et al. Effective Strategies to Recruit Young Adults Into the TXT2BFiT mHealth Randomized Controlled Trial for Weight Gain Prevention. JMIR Res Protocol. 2015;4(2):e66. doi:10.2196/resprot.4268.

    Article  Google Scholar 

  28. Australian Government Department of Health Aged Care. An active way to better health. National physical activity guidelines for adults. Canberra: ACT. 1999. http://www.webcitation.org/6UgO0DcHr. Accessed 24-08-2014.

  29. National Health Medical Research Council. Australian dietary guidelines incorporating the Australian guide to healthy eating - providing the scientific evidence for healthier Australian diets. Canberra: ACT: National Health and Medical Research Council. 2011. http://www.webcitation.org/6Xm0A0GWp. Accessed 24-08-2014.

  30. Vaismoradi M, Turunen H, Bondas T. Content analysis and thematic analysis: Implications for conducting a qualitative descriptive study. Nurs Health Sci. 2013;15(3):398–405. doi:10.1111/nhs.12048.

    Article  Google Scholar 

  31. Elo S, Kyngäs H. The qualitative content analysis process. J Adv Nurs. 2008;62(1):107–15. doi:10.1111/j.1365-2648.2007.04569.x.

    Article  Google Scholar 

  32. Goode AD, Reeves MM, Eakin EG. Telephone-delivered interventions for physical activity and dietary behavior change: an updated systematic review. Am J Prev Med. 2012;42(1):81–8. doi:10.1016/j.amepre.2011.08.025.

    Article  Google Scholar 

  33. Raaijmakers LC, Pouwels S, Berghuis KA, Nienhuijs SW. Technology-based interventions in the treatment of overweight and obesity: A systematic review. Appetite. 2015;95:138–51. doi:10.1016/j.appet.2015.07.008.

    Article  Google Scholar 

  34. Schulz DN, Kremers SP, De Vries H. Tailored eHealth Lifestyle Promotion: Which Behavioral Modules Do Users Prefer? J Health Commun. 2015;20(6):663–72. doi:10.1080/10810730.2015.1012243.

    Article  Google Scholar 

  35. Strong KA, Parks SL, Anderson E, Winett R, Davy BM. Weight gain prevention: identifying theory-based targets for health behavior change in young adults. J Am Diet Assoc. 2008;108(10):1708–15. doi:10.1016/j.jada.2008.07.007.

    Article  Google Scholar 

  36. Michie S, Ashford S, Sniehotta FF, Dombrowski SU, Bishop A, French DP. A refined taxonomy of behaviour change techniques to help people change their physical activity and healthy eating behaviours: the CALO-RE taxonomy. Psychol Health. 2011;26(11):1479–98. doi:10.1080/08870446.2010.540664.

    Article  Google Scholar 

  37. Wing RR, Tate DF, Gorin AA, Raynor HA, Fava JL. A self-regulation program for maintenance of weight loss. N Engl J Med. 2006;355(15):1563–71. doi:10.1056/NEJMoa061883.

    Article  CAS  Google Scholar 

  38. Rothman AJ, Sheeran P, Wood W. Reflective and automatic processes in the initiation and maintenance of dietary change. Ann Behav Med. 2009;38 Suppl 1:S4–17. doi:10.1007/s12160-009-9118-3.

    Article  Google Scholar 

  39. Tang J, Abraham C, Greaves C, Yates T. Self-directed interventions to promote weight loss: a systematic review of reviews. J Med Internet Res. 2014;16(2):e58. doi:10.2196/jmir.2857.

    Article  Google Scholar 

  40. Kattelmann KK, Bredbenner CB, White AA, Greene GW, Hoerr SL, Kidd T et al. The Effects of Young Adults Eating and Active for Health (YEAH): A Theory-Based Web-Delivered Intervention. Journal of nutrition education and behavior. 2014;46(6):S27-S41. doi:http://dx.doi.org/10.1016/j.jneb.2014.08.007.

  41. Kristan J, Suffoletto B. Using online crowdsourcing to understand young adult attitudes toward expert-authored messages aimed at reducing hazardous alcohol consumption and to collect peer-authored messages. Transl Behav Med. 2015;5(1):45–52. doi:10.1007/s13142-014-0298-4.

    Article  Google Scholar 

  42. Ashton LM, Hutchesson MJ, Rollo ME, Morgan PJ, Thompson DI, Collins CE. Young adult males’ motivators and perceived barriers towards eating healthily and being active: a qualitative study. Int J Behav Nutr Phys Act. 2015;12(1):93. doi:10.1186/s12966-015-0257-6.

    Article  Google Scholar 

  43. Nikolaou CK, Hankey CR, Lean ME. Weight changes in young adults: a mixed-methods study. Int J Obes (Lond). 2015;39(3):508–13. doi:10.1038/ijo.2014.160.

    Article  CAS  Google Scholar 

  44. Dennison L, Morrison L, Conway G, Yardley L. Opportunities and challenges for smartphone applications in supporting health behavior change: qualitative study. J Med Internet Res. 2013;15(4):e86. doi:10.2196/jmir.2583.

    Article  Google Scholar 

  45. Morrison LG, Hargood C, Lin SX, Dennison L, Joseph J, Hughes S, et al. Understanding usage of a hybrid website and smartphone app for weight management: a mixed-methods study. J Med Internet Res. 2014;16(10):e201. doi:10.2196/jmir.3579.

    Article  Google Scholar 

  46. Demment MM, Graham ML, Olson CM. How an Online Intervention to Prevent Excessive Gestational Weight Gain Is Used and by Whom: A Randomized Controlled Process Evaluation. J Med Internet Res. 2014;16(8):e194. doi:10.2196/jmir.3483.

    Article  Google Scholar 

  47. Hebden L, Cook A, van der Ploeg HP, Allman-Farinelli M. Development of Smartphone Applications for Nutrition and Physical Activity Behavior Change. JMIR Res Protocol. 2012;1(2):e9. doi:10.2196/resprot.2205.

    Article  Google Scholar 

  48. Carter MC, Burley VJ, Nykjaer C, Cade JE. Adherence to a smartphone application for weight loss compared to website and paper diary: pilot randomized controlled trial. J Med Internet Res. 2013;15(4):e32. doi:10.2196/jmir.2283.

    Article  Google Scholar 

  49. Laing BY, Mangione CM, Tseng CH, Leng M, Vaisberg E, Mahida M, et al. Effectiveness of a smartphone application for weight loss compared with usual care in overweight primary care patients: a randomized, controlled trial. Ann Intern Med. 2014;161(10 Suppl):S5–12. doi:10.7326/m13-3005.

    Article  Google Scholar 

  50. Martin CK, Miller AC, Thomas DM, Champagne CM, Han H, Church T. Efficacy of SmartLoss(SM), a smartphone-based weight loss intervention: Results from a randomized controlled trial. Obesity (Silver Spring). 2015;23(5):935–42. doi:10.1002/oby.21063.

    Article  Google Scholar 

  51. Corsino L, Lin P-H, Batch BC, Intille S, Grambow SC, Bosworth HB et al. Recruiting young adults into a weight loss trial: Report of protocol development and recruitment results. Contemp Clin Trials. 2013;35(2):1–7. doi:http://dx.doi.org/10.1016/j.cct.2013.04.002.

  52. Mendis K, Forster T, Paxton K, Hyland K, Yelverton J, McLean R, et al. Large and forgotten in rural Australia: assessment, attitudes and possible approaches to losing weight in young adult males. BMC Public Health. 2014;14:243. doi:10.1186/1471-2458-14-243.

    Article  Google Scholar 

  53. Gokee LaRose J, Gorin AA, Clarke MM, Wing RR. Beliefs about weight gain among young adults: potential challenges to prevention. Obesity (Silver Spring). 2011;19(9):1901–4. doi:10.1038/oby.2011.203.

    Article  Google Scholar 

  54. Kozica S, Lombard C, Teede H, Ilic D, Murphy K, Harrison C. Initiating and continuing behaviour change within a weight gain prevention trial: a qualitative investigation. PLoS One. 2015;10(4):e0119773. doi:10.1371/journal.pone.0119773.

    Article  Google Scholar 

Download references

Acknowledgements

Funding to conduct this trial was received from the Hospitals Contribution Fund (HCF) Medical Research Foundation (reference number MAUsyd1008201111), listed on the Australian Competitive Research Grants Register Category 1. This work was also supported by the Commonwealth Government of Australia via an Australian Postgraduate Award Scholarship to SRP, and LH was supported by a National Health and Medical Research Council (NHMRC) Scholarship between 2011 and 2013. MFH was partly funded by an NHMRC Senior Research Fellowship.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Stephanie R. Partridge.

Additional information

Competing interests

The authors declare that they have no competing interests.

Authors’ contributions

SRP, LH, AW, KB and MA-F carried out the TXT2BFiT nine month (9-month) parallel-group RCT. SRP made a substantial contribution to the design of the process evaluation, carried out all interviews, transcription, qualitative analysis and drafted the manuscript. LH, AW, KB, KM, MH and AB participated in the design of the study. MA-F and PP conceived the study, and participated in its design and coordination and helped to draft the manuscript. All authors read and approved the final manuscript.

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Partridge, S.R., Allman-Farinelli, M., McGeechan, K. et al. Process evaluation of TXT2BFiT: a multi-component mHealth randomised controlled trial to prevent weight gain in young adults. Int J Behav Nutr Phys Act 13, 7 (2016). https://doi.org/10.1186/s12966-016-0329-2

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12966-016-0329-2

Keywords