- Research
- Open access
- Published:
The feasibility and RE-AIM evaluation of the TAME health pilot study
International Journal of Behavioral Nutrition and Physical Activity volume 14, Article number: 106 (2017)
Abstract
Background
Conducting 5 A’s counseling in clinic and utilizing technology-based resources are recommended to promote physical activity but little is known about how to implement such an intervention. This investigation aimed to determine the feasibility and acceptability, using the RE-AIM (Reach, Effectiveness, Adoption, Implementation, Maintenance) framework, of a pragmatic, primary care-based intervention that incorporated 5 A’s counseling and self-control through an activity monitor.
Methods
Primary care patients (n = 40) 55–74 years of age were recruited and randomized to receive a pedometer or an electronic activity monitor (EAM), Jawbone UP24, to monitor activity for 12 weeks. Participants were also invited to a focus group after completing the intervention. Stakeholders (n = 36) were recruited to provide feedback.
Results
The intervention recruitment rate was 24.7%. The attrition rate was 20% with a significantly higher rate for the pedometer group (p = 0.02). The EAM group increased their minutes of physical activity by 11.1 min/day while the pedometer maintained their activity (0.2 min/day), with no significant group difference. EAM participants liked using their monitor and would continue wearing it while the pedometer group was neutral to these statements (p < 0.05). Over the 12 weeks there were 490 comments and 1094 “likes” given to study peers in the corresponding application for the UP24 monitor. Some EAM participants enjoyed the social interaction feature while others were uncomfortable talking to strangers. Participants stated they would want counseling from a counselor and not their physician or a nurse. Other notable comments included incorporating multiple health behaviors, more in-person counseling with a counselor, and having a funding source for sustainability.
Conclusions
Overall, the study was well-received but the results raise a number of considerations. Practitioners, counselors, and researchers should consider the following before implementing a similar intervention: 1) utilize PA counselors, 2) target multiple health behaviors, 3) form a social support group, 4) identify a funding source for sustainability, and 5) be mindful of concerns with technology.
Trial registration
clinicaltrials.gov- NCT02554435. Registered 24 August 2015.
Background
Habitual physical activity (PA) can reduce risk for cardiovascular diseases (CVD) [1,2,3,4,5,6], but most older adults fall far below the recommended 30 min of moderate intensity PA at least 5 times a week [7,8,9]. There are several reasons why older adults do not get enough PA including social influences, competing priorities, personal beliefs and motivation [10]. The American Heart Association encourages the implementation of individual clinical and population-level strategies to target these barriers and reduce physical inactivity [11]. One such strategy is to implement 5 A’s counseling within the primary care clinic [11].
The 5 A’s stand for assess, advise, agree, assist, and arrange [11, 12]. Five A’s counseling was developed by the Counseling and Behavioral Interventions Work Group of the United States Preventive Services Task Force to provide brief counseling within the primary care setting [12]. This form of counseling is recommended over comprehensive counseling because it is short in duration and more feasible for a busy clinic [11, 13,14,15,16,17]. The assist component is particularly impactful because the clinician provides behavioral change techniques, such as problem solving and social support, that aid in changing PA behavior [18]. Shaping knowledge and providing feedback through counseling are effective behavioral strategies [19] but the addition of technology is recommended to enhance counseling for individuals at moderate risk for CVD [11].
Activity monitors have the potential to enhance primary care interventions by motivating individuals to change their PA behaviors [20] while lessening the burden on clinical staff [11, 21]. Two types of activity monitors are commonly used for PA promotion: pedometers and electronic activity monitors (EAMs). Pedometers are low-tech devices that provide immediate feedback on PA and have been shown to be feasible and acceptable within primary care interventions [22,23,24]. Conversely, EAMs are high-tech devices that can provide PA feedback, individualization, and behavior change techniques (e.g. action planning, social comparison, and cues to action) [20, 25]. There is preliminary evidence that these monitors are feasible in community interventions [25]. EAMs have potential in primary care because they offer effective behavior change techniques that may be overlooked in clinic-based counseling and they facilitate social support [26]. Positive social interaction, such as providing encouragement, can further promote PA because it provides emotional support [27, 28]. Furthermore, it allows older adults to learn PA tips from their peers [29] and it is associated with long-term behavior maintenance [30].
The American Heart Association recommends a 2-tiered approach to promote lifestyle changes, like PA, in the healthcare system. The first tier is to provide low-intensity 5 A’s counseling and the second tier is to utilize technology-based resources [11]. However, the adoptability of a primary care-based intervention that incorporates counseling and activity monitoring has not been studied in depth. There is also limited information on how to successfully combine and implement these types of interventions in a real world setting [31].
To increase the likelihood that research findings will be utilized in the clinic, interventions need to be pragmatic [32,33,34,35] and they should be assessed for their impact on the population-level [36]. The pragmatic nature of a study can be illustrated with the Pragmatic Explanatory Continuum Indicator Summary (PRECIS) figure. It’s recommended that the PRECIS figure should be created while designing an intervention to determine if it is explanatory or pragmatic. Population-level impact can be assessed through RE-AIM indicators [37]. RE-AIM is a public health framework that describes the reach, effectiveness, adoption, implementation, and maintenance of a program [36]. The purpose of the current study was to determine the feasibility and acceptability of the TAME health (Testing Activity Monitors’ Effect on health) pilot intervention within the RE-AIM framework using dimension indicators outlined by Harden et al. [37] TAME health is a pragmatic, primary care-based pilot intervention that incorporates 5 A’s counseling and self-control through an activity monitor. Furthermore, we aimed to compare feasibility and acceptability results between two types of activity monitors: pedometer (Digi-walker CW-700/701, YAMAX, San Antonio, TX) and EAM (UP24 by Jawbone, San Francisco, CA).
Methods
TAME Health is a short-term pilot study. The methodology for this study has been previously described in-depth, [38] and the study is registered online at clinicaltrials.gov (NCT02554435). The methodology related to feasibility and acceptability outcomes is described briefly below.
Recruitment
Study participants (N = 40) were recruited from two primary care clinics affiliated with The University of Texas Medical Branch (UTMB). Clinic patients were recruited by direct solicitation from the clinic lobby and flyers posted throughout the clinic. Patients were screened for eligibility in person or over the phone. Patients were deemed eligible if the following criteria were met: age (55–74 years), physically inactive (self-reported less than 60 min/week of planned PA), body mass index between 25 and 35, healthy enough for exercise measured by the PA Readiness Questionnaire Plus (Par-Q+) [39] and access to a smart device. After participants were deemed eligible an initial assessment was scheduled.
In an effort to assess adoptability, stakeholders (n = 36) were also recruited. Stakeholders were staff and faculty members of the medical institution who could provide input on clinic-based practice. They were recruited via an institutional email list to take part in a focus group meeting.
Intervention procedures
All study participants underwent 5 A’s counseling from a counselor during their first assessment prior to randomization. The counselor was trained in exercise physiology and motivational interviewing. Counseling lasted approximately 5 to 10 min and the counselor followed a script (Additional file 1). In addition to the traditional 5 A’s, the counselor also provided an exercise prescription that summarized the goals and action plans agreed upon during counseling [40]. After counseling, participants were randomized to the pedometer group or the EAM group using a random number generator [41].
Participants in the pedometer group received the Digi-Walker CW-700/701 digital pedometer (YAMAX, San Antonio, TX). The participants also received an activity log to record their daily steps, activity time, and distance walked measured by the pedometer.
Participants randomized to the EAM group received an UP24 wearable device manufactured by Jawbone. They were instructed to install the corresponding UP application (app) to their smart device and wear the bracelet monitor daily. The UP24 was chosen for the intervention due to its popularity and the potential for interactive tools such as Jawbone’s “Smart coach” to be utilized [20, 42]. In addition to monitoring PA behavior, the UP24 also measures sleep and the app allows for participants to track their diet and weight. All participants were given an anonymous UP app account and encouraged to socialize with other participants in the group through the app.
Assessment procedures
Feasibility was operationalized through evaluation of attrition, the number of days logged for activity, reported adverse events, report of technical difficulties, and social interactions in the UP app. Logged days of activity were taken from the pedometer log and from the Jawbone online data file. The effectiveness of the intervention to increase minutes of PA was measured with a SenseWear Armband. Although the Jawbone UP24 measures minutes of PA, the Sense Wear Armband was used as an assessment tool to ensure PA was measured the same way in both study groups. The SenseWear armband is validated to estimate steps per day and minutes of moderate to vigorous physical activity [43, 44]. Participants were instructed to wear the armband for a 7-day period at baseline and at 12 weeks. Participants were not excluded from the study if the objective measurement of PA was greater than 60 min per day. The effectiveness of the participants to self-regulate their behaviors was measured by the Exercise Goal-Setting Scale and Exercise Planning and Scheduling Scale [45]. Both scales are self-report and were administered at baseline and at 12 weeks.
Acceptability was determined through questionnaires and focus groups. Questionnaires included 16 items for the pedometer group and 37 items for the Jawbone group which allowed participants to answer on a range from 1 (strongly disagreed) to 5 (strongly agreed) for each acceptability statement. Statements were modeled on items previously developed by Vandelanotte et al. [46] There were additional questions related to the acceptability of different EAM features which resulted in more questionnaire items for the Jawbone group compared to the pedometer group (see Table 3). Focus groups were chosen over exit-interviews to allow the opportunity for EAM participants to meet their peers with whom they interacted through the app. Participant focus groups included 2–8 individuals and were based on a structured guide (Additional file 2). The discussions were led by two trained Masters-level interns who were well-versed on the study protocol and the study activity monitors. Focus groups were broken up by intervention group and clinic location.
Additional focus groups were conducted with stakeholders. These discussions were led by the principal investigator, ZHL. During the focus group, stakeholders were prompted to fill out two brief quantitative surveys. After the focus group, stakeholders had the opportunity to test the UP24 monitor for 4-weeks and provide feedback on usability.
Feasibility and acceptability results were organized into dimensions of RE-AIM [37]. Indicators of Reach included the recruitment rate, participant characteristics, and focus group participation rates. Effectiveness included follow-up results of PA and self-regulation, percent attrition, rates of adverse events, and quantitative acceptability results. Qualitative comments about the delivery of the interventions were used as indicators of Adoption. Implementation indicators included the report of technical difficulties, number of logged activity days, and participant perceptions of the intervention. Maintenance was divided into individual and organizational. Indictors of individual maintenance included quantitative and qualitative results of each monitor’s usability. Stakeholder perceptions of the intervention were used as an indicator of potential organizational maintenance.
Statistical analyses
The Statistical Package for the Social Sciences (SPSS, version 20) and NVivo 11 Pro (QSR International) were used to perform the quantitative and qualitative analyses, respectively. The α-level was set at 0.05. Descriptive statistics across intervention groups were calculated by means, medians, and frequencies. Comparisons between groups for feasibility and acceptability were analyzed by an Independent T-Tests and Chi-Square tests. PA, exercise goals, and exercise planning was assessed with an analysis of covariance using the intent-to-treat principle (carrying baseline measurements forward) and controlled for baseline values of the dependent variable. Although exercise goals and planning were self-reported, results are presented in means and standard deviation [47]. Cohen’s d effect sizes were calculated using the change mean change in PA, exercise goals, and exercise planning.
Thematic analyses were conducted to analyze data from the focus groups [48]. We chose thematic analysis because we wanted to describe participant and stakeholder perspectives of the main study components. Initial codes were developed prior to the focus groups and new codes were added based on new data. All focus groups were audio-recorded and data transcripts were written out by the principal investigator. The moderators were asked to verify any inaudible segments.
Pragmatic evaluation
The PRECIS-2 figure (Additional file 3) was used to illustrate the explanatory and pragmatic components of the study [33, 34]. Study components, including eligibility, recruitment, setting, organization, flexibility-delivery, flexibility adherence, follow-up, primary outcome, and primary analysis, were rated on a 1–5 scale with 5 being the most pragmatic. The figure for this study was rated by Principal Investigator and illustrated that this intervention was largely pragmatic.
Results
Complete demographic information is illustrated in Table 1. Feasibility and acceptability results are described below by each dimension of the RE-AIM framework [36, 37]. Complete quantitative results are presented in Tables 2 and 3. Feedback from the focus groups was centered around 4 major themes: TAME health, self-monitoring, social support on the UP app, and counseling from the counselor or from a health care provider. Example quotes from the focus groups are presented in Table 4.
Reach
Recruitment rate is displayed in Fig. 1. A total of 162 individuals were screened for eligibility over 8 months (October 2015–June 2016), and 42 were eligible. Two eligible participants dropped out before randomization due to care-giver responsibilities and work commitments. The resulting recruitment rate was 24.7%. Twenty-seven (67.5%) participants were recruited in-person at the clinic, 8 (20%) were recruited through flier postings, and 5 (12.5%) were referred by a friend or employee that heard of the study from the clinic. Eight (20%) participants were not clinic patients. Four of these individuals were referrals while 4 were recruited in-person while at the clinic with their family.
At baseline, participants had a mean age of 63.7 ± 5.3 years (EAM: 64.0 ± 5.1, Pedometer: 63.2 ± 5.7). Most participants were female (total: 75%, EAM: 85%, Pedometer: 65%), non-Hispanic White (total: 65%, EAM: 60%, Pedometer: 70%), and had a college degree (total: 55%, EAM: 50%, Pedometer: 60%). The EAM group and the pedometer group averaged 22.6 ± 24.5 and 40.0 ± 33.9 min of moderate or vigorous PA a day, respectfully. There were no significant group differences among these variables. Stakeholders were predominately clinical faculty and professors (33%). Other stakeholder positions included physician, nurse, social worker, graduate student, epidemiologist, researcher, research coordinator, post-doctoral fellow, and administrator.
There were 6 scheduled focus group meetings for study participants. Of the 36 study participants that were invited to take part in a focus group, 11 participated (8 EAM, 3 Pedometer). Four participants were not invited because they ended the intervention several weeks after the majority of participants. Although focus groups were planned, several of the meetings (4 out of 6) resulted in a one-on-one interview due to low attendance. These interviews followed the same structured question guide. There were two scheduled stakeholder focus group meetings that reached 36 individuals.
Effectiveness
Over 12 weeks the EAM and pedometer group increased their minutes of moderate or vigorous PA by 11.1 and 0.2 min per day, respectively. The groups were not statistically different in their rate of PA at 12 weeks (p = 0.29, d = 0.78). Groups were significantly different in exercise goal-setting and planning scales (p < 0.01). The EAM group increased 8.3 ± 9.8 and 3.6 ± 7.6 points in goal-setting and planning while the pedometer group increased by 1.7 ± 5.3 and 0.3 ± 4.1 points, respectively. The resulting effect size was large for goal-setting (d = 0.84) and planning (d = 0.55).
Overall attrition was 20%, which differed significantly between groups (p = 0.02). Two participants (pedometer group) were lost to follow up and 6 participants (EAM: 1, Pedometer: 5) did not finish the intervention. The EAM participant dropped out due to physical health issues. Reasons for pedometer participants not completing the intervention included: randomized to the pedometer but wanted the EAM (n = 1), physical health issues (n = 2), lost interest (n = 1), and replaced broken pedometer with an EAM (n = 1). Participants that dropped out had a significantly higher goal-setting score at baseline. In addition to the drop-outs, two participants (EAM: 1, Pedometer: 1) did not complete the final assessment but provided PA data and/or subjective data.
There were no moderate or severe adverse events related to the study. However, there were four moderate unrelated adverse events during the study.
Only 7 stakeholders agreed to wear the UP 24 and all but 1 provided feedback. Of these, 3 only tested the monitor and did not take part in a focus group. Study participants and stakeholders agreed that the study and UP24 monitor were mostly acceptable. EAM users agreed that they liked using the monitor and that they would continue wearing it while pedometer users were neutral to these statements (p < 0.05).
Adoption
Participants felt that the doctor’s office was too regimented, and this study is something they did for themselves, not for their doctor. Moreover, the participants expressed that PA is separate from primary care. As one participant stated “I’ve got a great primary care physician here but I love that it was separate from that… because that’s my medical and this is my health (Female, 61).” The study participants enjoyed counseling from the counselor and would not want counseling from a health care provider. However, they would like if the counselor was part of the health care team and had access to their medical record. Participants wanted more in-person counseling sessions and counseling on other health behaviors. The EAM group found all of the 5A’s components helpful while the pedometer group found “Advise” the most helpful. The exercise prescription after counseling was also helpful to participants.
Stakeholders liked the counseling format but stressed it would need to be individualized to the patient. Practitioners often use one of the 5A’s components but do not recognize it as 5A’s counseling. Stakeholders also commented that the physician would not have time to conduct the “arrange” call but it could be done by a clinical staff member. Like study participants, stakeholders liked the exercise prescription. They would alter the prescription to have more “I will…” language, more planning details, and prescribe both steps per day and minutes of PA.
Implementation
There were 28 reports of technical issues across 21 participants during the intervention. All broken or lost monitors were replaced and all other technical issues were resolved. Five pedometers were lost, 5 pedometers broke, and participants sought help from the research staff for assistance with getting data from the pedometer on 3 occasions. There were 2 reports that the UP24 would not hold a charge, 5 reports of UP24 Bluetooth connectivity issues, 3 reports that the UP24 would not record activity and 1 UP24 was lost. During the intervention 4 participants got a new phone or downloaded the UP app on a different device. Three of these participants sought assistance from the research staff while 1 participant created their own UP account and was no longer connected to the rest of the group. Over the 12 weeks participants logged an average of 72.6 days of activity. There was no difference between groups in logging at least 80% of activity days.
Overall participants reported liking the TAME health program. Participants found it educational to know how active they were in a day and the monitor they used (pedometer or EAM) became a part of them. One of the most motivational aspects that participants reported was having a goal in mind. Despite enjoying the program, participants wanted a multiple behavior change intervention that also targeted water consumption, diet, and sleep.
Maintenance: individual
Both monitors were admired for being easy to use, convenient, and discreet. Of the participants that used the UP app, some liked that it synced with another device while others wanted direct feedback on the monitor. The app was reported by most to be user friendly. Participants in both study groups questioned the accuracy of the devices and how they recorded the activity. Both groups also complained that the device could irritate the skin. EAM users disliked the number of technical and syncing issues, as well as the interface on Android versus Apple products. Furthermore, EAM users were confused by some of the biometrics presented in the UP app. In particular, the counselor explained the concept of active and resting energy expenditure during the assess portion of counseling. Yet, participants didn’t understand how “resting burn” (estimated resting energy expenditure) could be higher than “active burn” (estimated active energy expenditure). Pedometer users disliked that the pedometer would only count steps when worn in a certain position. In the face of complications, participants would continue to use the type of device they wore.
Over the 12 week intervention there were 490 comments to study peers and 299 self-comment (comments on the user’s own activity) on the UP app. There were 1094 “likes” given and 104 “likes” on the user’s own activity. Ten participants did not give any “likes” or comments to their peers and only 3 of these 10 had at least 1 self-comment. Despite this, every participant received at least 1 comment and 1 like from one of their peers. The most comments and “likes” given by a single participant was 315 and 434, respectively. During the 12 weeks, participants had 10 to 19 peers to interact with. Comment examples are presented in Fig. 2. Some EAM participants reported enjoying the socializing features and used them regularly. Others did not use any of the social support features, reporting that they did not know the other participants or their health status.
Stakeholders believed that self-monitoring may be very beneficial for some patients but not others. They were concerned with the cost of the monitors and their accuracy. For pedometers, stakeholders felt that it may work with an older population but pedometers have limitations. Some limitations cited by the stakeholders include: flimsy, bulky, sensitive to measurement, difficult to read, short battery life, and easy to lose. Stakeholders felt that the EAM is carefree, easy to wear, and it has some attractive features (i.e. competition, Smartcoach). However, there may be a technology barrier for use by patients.
Maintenance: organizational
Prior to the focus group presentation, 90.6% of stakeholders believed that counseling is effective to change behavior while 53.1% actually counselled patients on becoming more physically active. Similarly, 84.8% of stakeholders believed that activity monitors can change behavior while 18.8% advised patients to use an activity monitor. After the presentation, stakeholders somewhat agreed that they would recommend an EAM over a pedometer for their patients (3.4 ± 1.2 out of 5) and that the intervention can be implemented into their clinic (3.3 ± 1.1 out of 5). Despite this, stakeholders had positive reactions to TAME health. They felt that counseling is already a part of practice behavior and the other aspects of the study can be implemented into the clinic if there was a funding source, like grants or insurance, to supply patients with monitors.
Discussion
The purpose of this pilot study was to evaluate the feasibility and the acceptability of a pragmatic, primary care-based PA intervention within the context of the RE-AIM framework. Overall, the study was feasible with adequate retention, sufficient number of days of recorded activity, and no study-related adverse events. The study was reasonably acceptable for participants and stakeholders. Notable comments include incorporating multiple health behaviors, more in-person counseling with a counselor (not a health care provider), and having a funding source to supply activity monitors to patients. Based on the feasibility and acceptability scores, the EAM intervention appears to be more feasible and acceptable than the pedometer intervention on some indicators of reach, effectiveness, implementation, and maintenance.
Our reach, effectiveness, and implementation findings are comparable to other primary care-based studies and interventions that utilized an EAM. Our retention rate of 80% is within the 60.7 to 95% retention rate cited in other primary care-based studies [23, 49, 50] and an EAM yields a lower attrition rate than health education alone [51]. Similar to a Fitbit-based intervention [52], we saw no adverse events related to the intervention. Only 1% of our participants had an unrelated event which is lower than the 2–19% reported in primary care-based studies [22, 50]. Like participants in other studies [52,53,54,55,56,57,58], EAM participants in the present study met the 80% recommended wear time. Reports of technical issues using activity monitors vary widely from 16% [52] to 90% [57]. Approximately 50% of our participants reported an issue which is line with the 58% of chronically-ill patients that used an EAM system [31].
In terms of individual maintenance, there was less social interaction among TAME health participants compared to a previous evaluation of 35 community-dwelling adults aged 55 to 79 years using the UP app (under review). Over a 12-week intervention, the 35 participants produced 1759 comments and 3153 “likes”. With the most “likes” and comments given by one participant 986 and 344, respectively. In this evaluation, 31 out of 35 participants socialized with the app. In the present study, half of the participants that used the UP app did not give support to other participants but social interaction was still prevalent (490 comments and 1094 likes). Both the current study and previous investigation of adults 55 years of age and older found that older adults organically produce over 400 comments in 12 weeks, which is more than the reported 259 comments from college-aged adults over 12 weeks [59]. These investigations also suggest that participants naturally provide emotional support to their peers through “likes”, which are viewed as a virtual empathy tool [26].
Other indicators of potential individual maintenance in our TAME health study were similar to other activity monitor interventions. We found that participants found the EAM more helpful and participants were more likely to purchase a similar EAM. Based on previous investigations, evidence suggests that older participants find a Fitbit EAM three times more helpful than a pedometer [52], they would continue to use an EAM [60], and they would purchase an EAM over a pedometer [61]. Our participants also had similar sentiments in that the monitor made them more aware of their activity, the pedometer was enjoyable because it was simple, the EAM is easy to use and put on but can cause some irritation [57, 61].
TAME health participants and stakeholders expressed opinions related to adoption and organizational maintenance that reflect known barriers and considerations of behavioral counseling in primary care. It is suggested that counseling include multiple sessions and targets multiple health behaviors [13, 32, 62]. Patients find advising helpful but they also value all constructs of 5A’s counseling which are not often performed by practitioners [63]. There is some evidence that practitioners perceive self-monitoring effective to change behavior and easier than counseling [64]. Health care providers lack the time and skills necessarily to complete effective PA counseling [65, 66].
Considerations for implementation
Our results raise a number of considerations. PA counseling in primary care is incentivized under Patient Protection and the Affordable Care Act and obesity counseling is covered, with stipulations, under The Centers for Medicare and Medicaid Services [65]. However, TAME health participants agreed that they would prefer counseling from a counselor over their primary care physician. The first consideration is to incorporate PA counselors in primary care. As we observed, recruiting and identifying individuals in the primary care clinic provides great reach to patients and caregivers alike and, therefore, primary care should continue to act as a platform to initiate behavioral counseling [18, 21, 67, 68]. Use of designated PA counselors in primary care is feasible and has been shown to produce favorable changes in body fat and PA [69]. Behavioral health providers are already members of the primary care team and consult with medical providers but they are underutilized for health behavior change [70]. Alternatively, community health workers (e.g. allied health professionals) could undergo specialized training and be included as part of the routine primary care practice to promote PA [11, 71]. Moreover, targeting multiple health behaviors in counseling should be considered [13, 32, 62].
Practitioners, counselors, and researchers should also consider forming a support group where patients can meet. Social support is associated with PA maintenance among older adults [72] but some individuals may be apprehensive of virtual support [29]. Our participants expressed that if they met with fellow participants, they would have socialized in the app and would not feel hesitation.
Identifying a funding source that provides monitors and technical support to patients to sustain the intervention should also be considered. We found that some individuals are willing to buy their own monitor but a funding source may still be necessary to supply technical support. Similarly, practitioners, counselors, and researchers should be conscious of potential concerns using technology. Ease of use and offering a variety to patients should be considered in selecting technologies. Further, users must be mindful of the longevity of available technologies. The SenseWear armband and the Jawbone UP24 used in this study are no longer manufactured for commercial use. Other comparable monitors are available (e.g. Fitbit, Withings, Misfit) but the type should be based on available resources and patient needs.
Strengths and limitations
The major strength of this study is that it assessed the feasibility and acceptability of a recommended intervention to prevent CVD. It was also a comparative evaluation of two common types of activity monitors that uses a mixed-methods approach. Furthermore, we presented the pragmatic nature of the intervention and presented the results within the RE-AIM framework which directly provide a foundation for optimizing future intervention implementation and adoption.
This study is limited to the reports from participants that completed the study. With one exception, there is no acceptability information from participants who dropped out or were lost to follow up. Furthermore, there was low reporting for qualitative results and we cannot draw conclusions for participants that completed the study but did not provide feedback. Based on inclusion criteria and recruitment strategy, the results are also not generalizable to all patients and potential stakeholders, including patients that do not have access to a smart device. Furthermore, the results may not be generalizable to sedentary older adults as intended. Our sample was recruited based on self-reported PA but objective assessment from the Sense Wear found that the sample as a whole averaged 30 min of PA a day. Lastly, this is a short-term pilot study that was not able to objectively assess maintenance and should not be taken to indicate efficacy.
Conclusion
The TAME health pilot study used the RE-AIM framework to evaluate the feasibility and acceptability of a pragmatic, primary care-based, PA intervention that incorporated 5 A’s counseling and activity monitoring. Overall, the study was well-received but the Jawbone UP24 appears to be more feasible and acceptable in some respects than a pedometer. Practitioners, counselors, and researchers should consider the following before implementing a similar intervention: 1) utilize PA counselors, 2) target multiple health behaviors, 3) form a social support group, 4) identify a funding source for sustainability, and 5) be mindful of concerns with technology.
Abbreviations
- CVD:
-
Cardiovascular disease
- EAM:
-
Electronic activity monitors
- PA:
-
Physical activity
References
Ahmed HM, Blaha MJ, Nasir K, Rivera JJ, Blumenthal RS. Effects of physical activity on cardiovascular disease. Am J Cardiol. 2012;109:288–95.
McGavock JM, Eves ND, Mandic S, Glenn NM, Quinney HA, Haykowsky MJ. The role of exercise in the treatment of cardiovascular disease associated with type 2 diabetes mellitus. Sports Med. 2004;34:27–48.
Perez-Terzic CM. Exercise in cardiovascular diseases. PM R. 2012;4:867–73.
Swift DL, Lavie CJ, Johannsen NM, Arena R, Earnest CP, O'Keefe JH, Milani RV, Blair SN, Church TS. Physical activity, cardiorespiratory fitness, and exercise training in primary and secondary coronary prevention. Circ J. 2013;77:281–92.
Vanhees L, De Sutter J, GeladaS N, Doyle F, Prescott E, Cornelissen V, Kouidi E, Dugmore D, Vanuzzo D, Börjesson M, et al. Importance of characteristics and modalities of physical activity and exercise in defining the benefits to cardiovascular health within the general population: recommendations from the EACPR (Part I). Eur J Prev Cardiol. 2012;19:670–86.
Ströbl V, Knisel W, Landgraf U, Faller H. A combined planning and telephone aftercare intervention for obese patients: effects on physical activity and body weight after one year. J Rehabil Med. 2013;45:198–205.
Troiano RP, Berrigan D, Dodd KW, Mâsse LC, Tilert T, McDowell M. Physical activity in the United States measured by accelerometer. Med Sci Sports Exerc. 2008;40:181–8.
Sun F, Norman IJ, While AE. Physical activity in older people: a systematic review. BMC Public Health. 2013;13:449.
Berkemeyer K, Wijndaele K, White T, Cooper AJ, Luben R, Westgate K, Griffin SJ, Khaw KT, Wareham NJ, Brage S. The descriptive epidemiology of accelerometer-measured physical activity in older adults. Int J Behav Nutr Phys Act. 2016;13:2.
Franco MR, Tong A, Howard K, Sherrington C, Ferreira PH, Pinto RZ, Ferreira ML. Older people's perspectives on participation in physical activity: a systematic review and thematic synthesis of qualitative literature. Br J Sports Med. 2015;
Spring B, Ockene JK, Gidding SS, Mozaffarian D, Moore S, Rosal MC, Brown MD, Vafiadis DK, Cohen DL, Burke LE, et al. Better Population Health Through Behavior Change in Adults A Call to Action. Circulation. 2013;128:2169–76.
Whitlock EP, Orleans CT, Pender N, Allan J. Evaluating primary care behavioral counseling interventions: an evidence-based approach. Am J Prev Med. 2002;22:267–84.
Huijg JM, Gebhardt WA, Verheijden MW, van der Zouwe N, de Vries JD, Middelkoop BJC, Crone MR. Factors Influencing Primary Health Care Professionals' Physical Activity Promotion Behaviors: A Systematic Review. Int J Behav Med. 2015;22:32–50.
Eakin E. Promoting physical activity among middle-aged and older adults in health care settings. J Aging Phys Act. 2001;9:S29–37.
French DP, Olander EK, Chisholm A, Mc Sharry J. Which Behaviour Change Techniques Are Most Effective at Increasing Older Adults' Self-Efficacy and Physical Activity Behaviour? A Systematic Review. Ann Behav Med. 2014;48:225–34.
Lin JS, O'Connor E, Evans CV, Senger CA, Rowland MG, Groom HC. Behavioral Counseling to Promote a Healthy Lifestyle in Persons With Cardiovascular Risk Factors: A Systematic Review for the US Preventive Services Task Force. Ann Intern Med. 2014;161:568–U573.
Gagliardi AR, Faulkner G, Ciliska D, Hicks A. Factors contributing to the effectiveness of physical activity counselling in primary care: A realist systematic review. Patient Educ Couns. 2015;98:412–9.
Goldstein MG, Whitlock EP, DePue J. Planning Comm Addressing M: Multiple behavioral risk factor interventions in primary care summary of research evidence. Am J Prev Med. 2004;27:61–79.
Michie S, Richardson M, Johnston M, Abraham C, Francis J, Hardeman W, Eccles MP, Cane J, Wood CE. The behavior change technique taxonomy (v1) of 93 hierarchically clustered techniques: building an international consensus for the reporting of behavior change interventions. Ann Behav Med. 2013;46:81–95.
Lyons EJ, Lewis ZH, Mayrsohn BG, Rowland JL. Behavior change techniques implemented in electronic lifestyle activity monitors: a systematic content analysis. J Med Internet Res. 2014;16:e192.
Berra K, Rippe J, Manson JE. Making Physical Activity Counseling a Priority in Clinical Practice. J Am Med Assoc. 2015;
Harris T, Kerry SM, Victor CR, Ekelund U, Woodcock A, Iliffe S, Whincup PH, Beighton C, Ussher M, Limb ES, et al. A Primary Care Nurse-Delivered Walking Intervention in Older Adults: PACE (Pedometer Accelerometer Consultation Evaluation)-Lift Cluster Randomised Controlled Trial. PLoS Med. 2015;12
Mutrie N, Doolin O, Fitzsimons CF, Grant PM, Granat M, Grealy M, Macdonald H, MacMillan F, McConnachie A, Rowe DA, et al. Increasing older adults' walking through primary care: results of a pilot randomized controlled trial. Fam Pract. 2012;29:633–42.
Kolt GS, Schofield GM, Kerse N, Garrett N, Ashton T, Patel A. Healthy Steps Trial: Pedometer-Based Advice and Physical Activity for Low-Active Older Adults. Ann Fam Med. 2012;10:206–12.
Lewis ZH, Lyons EJ, Jarvis JM, Baillargeon J. Using an electronic activity monitor system as an intervention modality: A systematic review. BMC Public Health. 2015;15:585.
de la Pena A, Quintanilla C. Share, like and achieve: the power of Facebook to reach health-related goals. Int J Consum Stud. 2015;39:495–505.
Kullgren JT, Harkins KA, Bellamy SL, Gonzales A, Tao YY, Zhu JS, Volpp KG, Asch DA, Heisler M, Karlawish J. A Mixed-Methods Randomized Controlled Trial of Financial Incentives and Peer Networks to Promote Walking Among Older Adults. Health Educ Behav. 2014;41:43S–50S.
Heaney CA, Israel BA. Social networks and social support. Health Behav health Educ Theory Res Pract. 2008;4:189–210.
Immonen M, Sachinopoulou A, Kaartinen J, Konttila A. Using Technology for Improving the Social and Physical Activity-Level of the Older Adults. Constr Ambient Intell. 2012;277:201–5.
Jeffery RW, Drewnowski A, Epstein LH, Stunkard AJ, Wilson GT, Wing RR, Hill DR. Long-term maintenance of weight loss: Current status. Health Psychol. 2000;19:5–16.
Verwey R, van der Weegen S, Spreeuwenberg M, Tange H, van der Weijden T, de Witte L. Process evaluation of physical activity counselling with and without the use of mobile technology: A mixed methods study. Int J Nurs Stud. 2016;53:3–16.
Zabaleta-del-Olmo E, Bolibar B, Garcia-Ortiz L, Garcia-Campayo J, Llobera J, Bellon JA, Ramos R. Building interventions in primary health care for long-term effectiveness in health promotion and disease prevention. A focus on complex and multi-risk interventions. Prev Med. 2015;76:S1–4.
Loudon K, Zwarenstein M, Sullivan F, Donnan P, Treweek S. Making clinical trials more relevant: improving and validating the PRECIS tool for matching trial design decisions to trial purpose. Trials. 2013;14:115.
Loudon K, Treweek S, Sullivan F, Donnan P, Thorpe KE, Zwarenstein M. The PRECIS-2 tool: designing trials that are fit for purpose. BMJ. 2015;350:h2147.
Thorpe KE, Zwarenstein M, Oxman AD, Treweek S, Furberg CD, Altman DG, Tunis S, Bergel E, Harvey I, Magid DJ, Chalkidou K. A pragmatic-explanatory continuum indicator summary (PRECIS): a tool to help trial designers. J Clin Epidemiol. 2009;62:464–75.
Glasgow RE, Vogt TM, Boles SM. Evaluating the public health impact of health promotion interventions: the RE-AIM framework. Am J Public Health. 1999;89:1322–7.
Harden SM, Gaglio B, Shoup JA, Kinney KA, Johnson SB, Brito F, Blackman KC, Zoellner JM, Hill JL, Almeida FA, et al. Fidelity to and comparative results across behavioral interventions evaluated through the RE-AIM framework: a systematic review. Syst Rev. 2015;4:155.
Lewis ZH, Ottenbacher KJ, Fisher SR, Jennings K, Brown AF, Swartz MC, Lyons EJ. Testing Activity Monitors' Effect on Health: Study Protocol for a Randomized Controlled Trial Among Older Primary Care Patients. JMIR Res Protoc. 2016;5:e59.
Warburton D, Jamnik V, Bredin S, Gledhill N, Collaboration P-QR. The Physical Activity Readiness Questionnaire (PAR-Q+) and electronic Physical Activity Readiness Medical Examination (ePARmed-X+). Health Fit J Can. 2011;4:3–23.
Sallis R. Exercise is medicine: a call to action for physicians to assess and prescribe exercise. Phys Sportsmed. 2015;43:22–6.
Urbaniak GC, Plous S. Research randomizer. In: The Creators; 1999.
Fitbit, Jawbone, Nike had 97 percent of fitness tracker retail sales in 2013. http://mobihealthnews.com/28825/fitbit-jawbone-nike-had-97-percent-of-fitness-tracker-retail-sales-in-2013/. Accessed 23 Feb 2016.
Berntsen S, Hageberg R, Aandstad A, Mowinckel P, Anderssen SA, Carlsen KH, Andersen LB. Validity of physical activity monitors in adults participating in free-living activities. Br J Sports Med. 2010;44:657–64.
An HS, Jones GC, Kang SK, Welk GJ, Lee JM. How valid are wearable physical activity trackers for measuring steps? Eur J Sport Sci. 2017;17:360–8.
Rovniak LS, Anderson ES, Winett RA, Stephens RS. Social cognitive determinants of physical activity in young adults: a prospective structural equation analysis. Ann Behav Med. 2002;24:149–56.
Vandelanotte C, De Bourdeaudhuij I. Acceptability and feasibility of a computer-tailored physical activity intervention using stages of change: project FAITH. Health Educ Res. 2003;18:304–17.
van Stralen MM, de Vries H, Mudde AN, Bolman C, Lechner L. The Long-Term Efficacy of Two Computer-Tailored Physical Activity Interventions for Older Adults: Main Effects and Mediators. Health Psychol. 2011;30:442–52.
Braun V, Clarke V. Using thematic analysis in psychology. Qual Res Psychol. 2006;3:77–101.
Iliffe S, Kendrick D, Morris R, Griffin M, Haworth D, Carpenter H, Masud T, Skelton DA, Dinan-Young S, Bowling A, et al. Promoting physical activity in older people in general practice: ProAct65+cluster randomised controlled trial. Br J Gen Pract. 2015;65:E731–8.
Dawes D, Ashe M, Campbell K, Cave D, Elley CR, Kaczorowski J, Sohal P, Ur E, Dawes M. Preventing Diabetes in Primary Care: A Feasibility Cluster Randomized Trial. Can J Diabetes. 2015;39:111–6.
Ashe MC, Winters M, Hoppmann CA, Dawes MG, Gardiner PA, Giangregorio LM, Madden KM, McAllister MM, Wong G, Puyat JH, et al. "Not just another walking program": Everyday Activity Supports You (EASY) model-a randomized pilot study for a parallel randomized controlled trial. Pilot Feasibility Stud. 2015;1:1–12.
Cadmus-Bertram LA, Marcus BH, Patterson RE, Parker BA, Morey BL. Randomized Trial of a Fitbit-Based Physical Activity Intervention for Women. Am J Prev Med. 2015;49:414–8.
Fitzsimons CF, Kirk A, Baker G, Michie F, Kane C, Mutrie N. Using an individualised consultation and activPAL feedback to reduce sedentary time in older Scottish adults: results of a feasibility and pilot study. Prev Med. 2013;57:718–20.
Hurling R, Catt M, Boni MD, Fairley BW, Hurst T, Murray P, Richardson A, Sodhi JS. Using internet and mobile phone technology to deliver an automated physical activity program: randomized controlled trial. J Med Internet Res. 2007;9:e7.
Tabak M, OP DAH, Hermens H: Motivational cues as real-time feedback for changing daily activity behavior of patients with COPD. In Patient education and counseling, vol. 94. pp. 372-378; 2014:372–378.
Naslund JA, Aschbrenner KA, Barre LK, Bartels SJ. Feasibility of popular m-health technologies for activity tracking among individuals with serious mental illness. Telemed e-Health. 2015;21:213–6.
Verwey R, van der Weegen S, Spreeuwenberg M, Tange H, van der Weijden T, de Witte L. A monitoring and feedback tool embedded in a counselling protocol to increase physical activity of patients with COPD or type 2 diabetes in primary care: study protocol of a three-arm cluster randomised controlled trial. BMC Fam Pract. 2014;15:93.
Feehan L, Clayton C, Carruthers E, Li L. Feasibility of using fitbit flex to motivate people with rheumatoid arthritis to be physically active. Ann Rheum Dis. 2014;73:1204–5.
Cavallo DN, Tate DF, Ries AV, Brown JD, DeVellis RF, Ammerman AS. A Social Media-Based Physical Activity Intervention A Randomized Controlled Trial. Am J Prev Med. 2012;43:527–32.
McMahon SK, Lewis B, Oakes M, Guan W, Wyman JF, Rothman AJ. Older Adults' Experiences Using a Commercially Available Monitor to Self-Track Their Physical Activity. JMIR Mhealth Uhealth. 2016;4:e35.
Mercer K, Giangregorio L, Schneider E, Chilana P, Li M, Grindrod K. Acceptance of Commercially Available Wearable Activity Trackers Among Adults Aged Over 50 and With Chronic Illness: A Mixed-Methods Evaluation. JMIR Mhealth Uhealth. 2016;4:e7.
Krist AH, Baumann LJ, Holtrop JS, Wasserman MR, Stange KC, Woo M. Evaluating Feasible and Referable Behavioral Counseling Interventions. Am J Prev Med. 2015;49:S138–49.
Shuval K, DiPietro L, Skinner CS, Barlow CE, Morrow J, Goldsteen R, Kohl HW 3rd. 'Sedentary behaviour counselling': the next step in lifestyle counselling in primary care; pilot findings from the Rapid Assessment Disuse Index (RADI) study. Br J Sports Med. 2014;48:1451–5.
Pears S, Morton K, Bijker M, Sutton S, Hardeman W. Team VBIP: Development and feasibility study of very brief interventions for physical activity in primary care. BMC Public Health. 2015;15:333. 2015, 15
AuYoung M, Linke SE, Pagoto S, Buman MP, Craft LL, Richardson CR, Hutber A, Marcus BH, Estabrooks P, Gorin SS: Integrating Physical Activity in Primary Care Practice. Am J Med. 2016;129(10):1022–29.
Yarnall KS, Pollak KI, Østbye T, Krause KM, Michener JL. Primary care: is there enough time for prevention? Am J Public Health. 2003;93:635–41.
Jacobson DM, Strohecker L, Compton MT, Katz DL. Physical activity counseling in the adult primary care setting: position statement of the American College of Preventive Medicine. Am J Prev Med. 2005;29:158–62.
Bock C, Diehl K, Schneider S, Diehm C, Litaker D. Behavioral counseling for cardiovascular disease prevention in primary care settings: a systematic review of practice and associated factors. Med Care Res Rev. 2012;69:495–518.
Fortier MS, Hogg W, O'Sullivan TL, Blanchard C, Sigal RJ, Reid RD, Boulay P, Doucet E, Bisson E, Beaulac J, Culver D. Impact of integrating a physical activity counsellor into the primary health care team: physical activity and health outcomes of the Physical Activity Counselling randomized controlled trial. Appl Physiol Nutr Metab. 2011;36:503–14.
Funderburk JS, Shepardson RL. Recent advances in primary care behavioral health. Curr Opin Psychol. 2015;5:37–41.
Costa EF, Guerra PH, dos Santos TI, Florindo AA. Systematic review of physical activity promotion by community health workers. Prev Med. 2015;81:114–21.
Cress ME, Buchner DM, Prohaska T, Rimmer J, Brown M, Macera C, DiPietro L, Chodzko-Zajko W. Best practices for physical activity programs and behavior counseling in older adult populations. J Aging Phys Act. 2005;13:61–74.
Acknowledgements
The authors would like to acknowledge Demi Arnold and Kaitlin Dresser for the assistance with recruitment. As well as Hannah Ives and Jennifer Valdez for moderating focus groups.
Funding
This study was supported by a Predoctoral Fellowship Grant from the American Heart Association (16PRE27090012). The funding source had no role in the study design, data collection, management, analysis, interpretation, or preparation of the manuscript.
Availability of data and materials
The datasets used and/or analyzed during the current study available from the corresponding author on reasonable request.
Author information
Authors and Affiliations
Contributions
ZHL designed and managed the study, gathered and analyzed the data, and wrote the manuscript. KJO, SF, KJ, AFB, and EJL assisted in the study design. KJ analyzed physical activity data. MCS and EM assisted with study recruitment and management. All authors read and approved the final manuscript.
Corresponding author
Ethics declarations
Ethics approval and consent to participate
This study was approved by the Institutional Review Board at the University of Texas Medical Branch and all participants provided informed consent.
Consent for publication
Not applicable
Competing interests
While the American Heart Association funded this study, MCS’s spouse has an equity interest in Apple Inc., a company that may potentially benefit from the research results. In addition, ZHL is employed by Beachbody, a company that may potentially benefit from the research results. UTMB’s Conflicts of Interest Committee has reviewed these conflicts and a management plan was implemented to prevent any appearance of a conflict of interests. Any inquiries regarding this management plan can be directed to UTMB’s Office of Institutional Compliance, (409) 747–8701.
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Additional files
Additional file 1:
Five A’s Counseling Script. (DOCX 27 kb)
Additional file 2:
Focus Group Guide. (DOCX 11 kb)
Additional file 3:
PRECIS-2 Figure. (DOCX 221 kb)
Rights and permissions
Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.
About this article
Cite this article
Lewis, Z.H., Ottenbacher, K.J., Fisher, S.R. et al. The feasibility and RE-AIM evaluation of the TAME health pilot study. Int J Behav Nutr Phys Act 14, 106 (2017). https://doi.org/10.1186/s12966-017-0560-5
Received:
Accepted:
Published:
DOI: https://doi.org/10.1186/s12966-017-0560-5