Reflections on physical activity intervention research in young people – dos, don’ts, and critical thoughts
International Journal of Behavioral Nutrition and Physical Activity volume 13, Article number: 25 (2016)
Physical activity has been associated with many benefits throughout the life course. As levels of physical activity appear to be insufficient in large populations, the development of effective interventions to promote or maintain activity levels in young people are therefore of key public health concern. Physical activity intervention research in young people is challenging, but this should not be a reason to continue conducting inferior quality evaluations. This paper highlights some of the key issues that require more careful and consistent consideration to enable future research to achieve meaningful impact.
This paper critically evaluates, amongst others, current research practice regarding intervention development, targeting, active involvement of the target population, challenge of recruitment and retention, measurement and evaluation protocols, long-term follow-up, economic evaluation, process evaluation, and publication. It argues that funders and researchers should collaborate to ensure high quality long-term evaluations are prioritised and that a trial’s success should be defined by its quality, not its achieved effect.
The conduct and publication of well-designed evaluations of well-defined interventions is crucial to advance the field of youth physical activity promotion and make us better understand which intervention strategies may or may not work, why, and for whom.
Physical activity has been associated with many benefits throughout the life course. In young people, this includes improved mental health , motor skill development , cardiovascular risk profile , weight development , bone health , cognitive functioning , and quality of life or self-esteem . However, levels of physical activity appear to be insufficient in large populations  and decline rapidly from late childhood through adolescence . The development of effective interventions to promote or maintain activity levels in young people are therefore of key public health concern [10, 11].
The past 20 years has seen an explosion of publications on physical activity interventions in young people. There is also a concomitant increase in the reviews of these evaluations, many of which identify methodological weaknesses related to both internal and external validity [12–15]. Despite these frequent calls for improved methodological rigour to enable establishment of a higher quality evidence base, many studies continue to add to the existing mountain of poor evidence. This leaves the evidence base fragile and open to substantial criticism and debate [12, 13, 16, 17], and provides challenges to truly inform policy and practice on what action to take. Based on our own experience of reviewing the evidence and (the challenges of) conducting intervention research in young people, this commentary aims to provide a critical platform for those embarking on or engaged in intervention research, and argues why and how rigour throughout the intervention research process matters. This includes intervention development and implementation, evaluation and dissemination. The issues described below may seem obvious for many, and are certainly not new. But for a variety of reasons they are too often ignored or flawed, which may ruin study conduct, result in false negative or positive findings, and provide moot new knowledge.
Investing in the future
To map or not to map?
The use of structured processes to guide intervention development is becoming increasingly more common, which we welcome [18, 19]. When thoughtfully considered and well-conducted, it provides a useful guide to developing an intervention based on the best available and most relevant evidence. However, they are at risk of becoming a ‘completion’ exercise (exemplified by repetitive performance objectives and matrices), suggesting a premise of rigorous development but failing to deliver. Yet, when conducted well, it helps ensure the intervention targets the most important and salient behaviours and is acceptable to those delivering and experiencing it, creates a pathway to understanding how the intervention may work (by developing a hypothesised causal model), and helps identify gaps to be addressed prior to embarking on full scale evaluations.
The whole forest or just a tree?
As public health gains are thought to be greatest when achieving population-level shifts in exposures with minimal harm , targeting whole populations may be our best bet. In contrast, certain population subgroups may benefit most from increased physical activity, such as girls and overweight youth, and targeting them may help reduce health inequalities. Review evidence suggests that girls particularly benefit from single-sex interventions [21, 22], although recent primary research indicates that both sexes benefit from population approaches, with girls benefitting more than boys [23, 24]. Although targeted interventions may be ‘easier’ to implement than population-based approaches, they also tend to be more intensive for the participants to engage with (e.g. face-to-face session vs. environmental change). The lack of like-for-like comparisons makes it difficult to draw firm conclusions regarding the need for, and value of, targeting. In addition, research into other behaviours suggests that a whole population approach overcomes isolation, stigmatization and detrimental mental health consequences , an issue particularly relevant in adolescent and overweight populations but largely ignored in the physical activity literature. Due consideration should therefore be given to the need for a universal or targeted approach, the acceptability and effectiveness of different approaches available to targeting, and the potential positive and negative consequences of either.
Listen to others and their opinions
As researchers we make decisions about other peoples’ lives, expecting them to be keen on adopting our ideas. It is therefore crucial that from early in the research process we seek and integrate the views of those expected to deliver and participate in the intervention, both through research (e.g. focus groups) and in an advisory role (e.g. Patient and Public Involvement). Qualitative research is increasingly included in intervention projects, but there are few examples where early and ongoing engagement has substantially influenced the predefined intervention or evaluation . Active engagement however aids the development of an acceptable and attractive intervention (and evaluation) strategy, and increases the likelihood of a successful trial, effectiveness, and intervention sustainability. Well-conducted feasibility and pilot trials with detailed process evaluations are therefore a crucial part of the trial development process [18, 27].
Fun, fun, fun
If asked, the magic intervention ingredient identified by young people is FUN [28, 29], whether it is with their family or with friends. The big step-up for intervention research is to find a focus resulting in sustained engagement rather than just momentary fun. Various psychological models link sustained enjoyment to autonomous forms of motivation (e.g. Self Determination Theory) , also in young people . Interventions targeting autonomous forms of motivation, such as identified regulation and intrinsic motivation, have shown promise, particularly in changing specific physical activity behaviours (for example in the context of physical education) and for adolescents . For promoting overall physical activity, the magical task therefore lies in finding the ideal (combination of) interventions to foster this fundamental psychological need. This may range from curriculum changes (controlled motivation with wide reach) to providing free choice (volitional motivation with potentially limited reach). Whatever it will be, an intervention delivering on sustained fun is likely to be engaging and to promote ongoing involvement, while being enjoyable to deliver and evaluate.
Going the extra mile
A variety of logistical and resource constraints (e.g. availability of objective monitors, financial limitations, staff availability, potential for blinding), time limitations (e.g. ethical approval, recruitment challenges, school term restrictions, time-limited funding), and ethical considerations (e.g. consent requirements, measurement burden) often underlie compromises in methodological quality. Although understandable, continuing on this trajectory will unlikely lead to significant advancements. Substantial investment in fewer well-prepared and feasibility-tested high quality evaluations is therefore needed. Whether an efficacy trial or pragmatic evaluation, set in school or community settings, these projects should focus on evaluating well-defined interventions in representative samples, including valid and preferably objective measures along the hypothesised causal pathway and ensuring high internal and external validity.
To recruit and to retain
Recruitment and retention is challenging, particularly when working with young people. We face a challenge of changing attitudes; from overly enthusiastic children to the overarching adolescent tendency of denial. Substantial investment in optimising participant recruitment and retention is worthwhile, while at the same time being realistic about what is achievable (to funders) and ensuring continued participation across all population subgroups to optimise external validity. Surprisingly little is known about effective recruitment and retention , and an increased understanding of effective ways of retaining adolescent participants over time is urgently needed. We therefore strongly encourage researchers to accurately report on their recruitment and retention strategies and their actual or perceived effectiveness to inform future trials. It is important to specifically consider retention on the main outcome measure, particularly where this involves objectively measured physical activity. Issues with monitor refusal, non-return, non-wear or insufficient wear time rapidly reduces the sample available for the main effect analysis, and the study’s ability to draw valid conclusions.
Timing is everything
Many projects depend on the school year, even when the school is not used as the setting for intervention delivery, limiting study time to around 35 ‘normal’ weeks. As project delays are not uncommon (delayed ethical approval, challenging recruitment, or intervention implementation issues), this time limitation encourages some to prioritise collecting baseline data in intervention participants. Although understandable, this imbalance can compromise data comparability and study power. Diverse weather conditions, differential monitor reactivity, and other disturbances, such as ‘special days’ held at typical times of the year (e.g. parties and sports days), can result in unwanted group differences. Simultaneous data collection in all study groups and scheduling multiple measurement periods within individual schools  helps to minimize the impact of these disturbances, and should be considered.
Keep it real
While there is utility in showing that an active travel intervention increases frequency of active travel, whether it actually impacts on total daily physical activity should be assessed as well. Behavioural compensation at other times of the day has been observed, and may partially explain the limited effect observed when physical activity is measured at day-level . An additional investigation of the impact on more upstream ‘harder’ outcomes (e.g. cardiovascular indicators, academic/cognitive performance, aerobic fitness), well-being, and time spent sedentary will create a fuller picture of how our interventions impact children’s lives and health, and may help generate traction at the policy level.
Happily ever after…?
Assessing the longer-term impact of youth physical activity interventions is widely considered important [11, 12], but rarely done . Anecdotal evidence highlights challenges with obtaining funding, participant retention, and publication (due to retention issues and null-findings) as reasons for this lack of evidence. Planning for long-term follow-up at the design and funding stage is one important way of overcoming barriers. Importantly, funding agencies should consider setting aside funds for the long-term follow-up of high quality informative trials, or supporting fewer trials in total but more with long-term measures. Although some argue that long-term follow-up is most relevant when studies show short-term effects , we argue that follow-up should be contingent on the methodological quality of the original trial, irrespective of effect. For example, sufficient time needs to have lapsed to be able to observe health effects based on subtle behavioural changes that may even have a lag-time to effects themselves .
Money makes the world go round
To truly influence policy and practice, it is insufficient to solely continue focussing on physical activity effects. Inclusion of health-related outcomes and an economic evaluation, particularly where the intervention involves multiple agencies and delivers, is essential . The few cost-effectiveness evaluations available indicate that physical activity promotion in young people is likely to be cost-effective [14, 36]. Building up a solid evidence base based on high quality evaluations is likely to create substantial political traction and will guide decisions on utilisation of limited public health expenditure [37, 38].
Studying the effect of the intervention on physical activity behaviour and key secondary outcomes (e.g. health markers) is a logical priority in the evaluation process. However, in order to truly progress our understanding of how and why interventions do (or do not) work and how they might need to be adapted, continued evaluation is crucial.
The intervention delivery intention-behaviour gap
The extent to which intervention components were delivered in the manner intended, is poorly understood and rarely documented . Process evaluations aid examination of the quantity and quality of what was actually implemented in practice, and why [40, 41]. Despite best intentions, differing contexts such as practical challenges and personal/institutional preferences commonly lead to varied delivery across settings. Understanding this variation, its reasons and consequences using mixed methods research in the context of a high quality evaluation will improve interpretation of intervention effects, and the development and delivery of future interventions. Improved understanding of the importance of context for intervention implementation and effect will also help explain why replication trials commonly do not replicate the original trial findings. In the school setting, the role of professional development and motivation of the teachers responsible for intervention delivery is particularly crucial. We additionally need to further develop our thinking on how interventions can be developed more flexibly to allow for adaption to context, and with that possible higher acceptability, and the implications this has for evaluation designs.
Look under the bonnet
Our understanding of what intervention elements are effective, and how, is limited at best [42, 43]. Designing a study to enable the investigation of intervention mediation is becoming more common, but is still not commonplace. A key prerequisite is the inclusion of measures along the hypothesised causal pathway, included at appropriate times and in all study populations. This should include measures of potential mediating mechanisms, the specific behaviours targeted, objectively measured total physical activity, and objective measures of more distal outcomes. Pre-specified and adequately powered analyses plans should not only focus on the main intervention effects, but also on studying the mediating mechanisms and potential moderators, or subgroup effects . Only then can we start to answer the question: “For whom, why, and under what circumstances do interventions work?”
The whole truth, and nothing but the truth
Finally, treat your data with the respect it deserves. Plan for your analyses before seeing the data, and stick with it. Be clear and consistent about primary and secondary outcomes, and pre-plan subgroup analyses. An intervention project is a rich resource that can give rise to a large number of publications focussing on a diverse set of research questions. Despite the demand of high-impact journals towards minimalistic paper length, irrespective of the outcome we recommend publishing a single paper with the main findings for all primary and secondary outcomes, including potential moderating effects . Only by applying consistent and rigorous processes to the statistical analyses and subsequent unrestricted reporting of the results, whatever they are, can we truly understand the extent and complexity of the intervention effects.
In this paper, we have outlined some of the key areas we believe the research field of physical activity promotion in young people may want to focus their efforts on in order to increase the quality and potential impact of the work produced. Table 1 provides a summary of the actions that should be considered to improve the level of evidence produced by future research. Although there are other issues to be addressed and alternative actions in relation to the key issues discussed are entirely plausible, taking the actions suggested will lead to a major step forwards in increasing the quality of the current evidence base.
We argue that researchers and funders should prioritise the conduct and publication of high quality and long-term evaluations of physical activity promotion in young people, while reducing the output of lower quality ones. In this situation, whether or not the trial is successful should be defined by the delivery of a well-defined intervention in the context of a high quality evaluation, including a process evaluation and use of validated measures of factors along the hypothesised causal pathway. Irrespective of effect, the conduct and publication of well-designed evaluations of well-defined interventions is crucial to advance our field and make us better understand which intervention strategies may or may not work, why, and for whom.
Brown HE, Pearson N, Braithwaite RE, Brown WJ, Biddle SJ. Physical activity interventions and depression in children and adolescents : a systematic review and meta-analysis. Sports Med. 2013;43(3):195–206. doi:10.1007/s40279-012-0015-8.
Morgan PJ, Barnett LM, Cliff DP, Okely AD, Scott HA, Cohen KE, et al. Fundamental movement skill interventions in youth: a systematic review and meta-analysis. Pediatrics. 2013;132(5):e1361–83. doi:10.1542/peds.2013-1167.
Andersen LB, Riddoch C, Kriemler S, Hills AP. Physical activity and cardiovascular risk factors in children. Br J Sports Med. 2011;45(11):871–6. doi:10.1136/bjsports-2011-090333.
Wareham NJ, van Sluijs EM, Ekelund U. Physical activity and obesity prevention: a review of the current evidence. Proc Nutr Soc. 2005;64(2):229–47.
Boreham CA, McKay HA. Physical activity in childhood and bone health. Br J Sports Med. 2011;45(11):877–9.
Esteban-Cornejo I, Tejero-Gonzalez CM, Sallis JF, Veiga OL. Physical activity and cognition in adolescents: A systematic review. J Sci Med Sport. 2014. doi:10.1016/j.jsams.2014.07.007.
Ekeland E, Heian F, Hagen KB, Abbott J, Nordheim L. Exercise to improve self-esteem in children and young people. Cochrane database of systematic reviews (Online). 2004(1):CD003683. doi:10.1002/14651858.CD003683.pub2.
Cooper AR, Goodman A, Page AS, Sherar LB, Esliger DW, van Sluijs EM, et al. Objectively measured physical activity and sedentary time in youth: the International children’s accelerometry database (ICAD). Int J Behav Nutr Phys Act. 2015;12:113. doi:10.1186/s12966-015-0274-5.
Dumith SC, Gigante DP, Domingues MR, Kohl 3rd HW. Physical activity change during adolescence: a systematic review and a pooled analysis. Int J Epidemiol. 2011;40(3):685–98.
Heath GW, Parra DC, Sarmiento OL, Andersen LB, Owen N, Goenka S, et al. Evidence-based intervention in physical activity: lessons from around the world. Lancet. 2012;380(9838):272–81. doi:10.1016/S0140-6736(12)60816-2.
Gillis L, Tomkinson G, Olds T, Moreira C, Christie C, Nigg C, et al. Research priorities for child and adolescent physical activity and sedentary behaviours: an international perspective using a twin-panel Delphi procedure. Int J Behav Nutr Phys Act. 2013;10:112. doi:10.1186/1479-5868-10-112.
Kriemler S, Meyer U, Martin E, van Sluijs EM, Andersen LB, Martin BW. Effect of school-based interventions on physical activity and fitness in children and adolescents: a review of reviews and systematic update. Br J Sports Med. 2011;45(11):923–30.
van Sluijs EMF, McMinn AM, Griffin SJ. Effectiveness of interventions to promote physical activity in children and adolescents: systematic review of controlled trials. BMJ. 2007;335(7622):703.
Wu S, Cohen D, Shi Y, Pearson M, Sturm R. Economic analysis of physical activity interventions. Am J Prev Med. 2011;40(2):149–58. doi:10.1016/j.amepre.2010.10.029.
Symonds JD. Larger scale trials are needed to show what really works. BMJ. 2012;345:e7030. doi:10.1136/bmj.e7030.
Metcalf B, Henley W, Wilkin T. Effectiveness of intervention on physical activity of children: systematic review and meta-analysis of controlled trials with objectively measured outcomes (EarlyBird 54). BMJ. 2012;345:e5888.
Dobbins M, Husson H, DeCorby K, LaRocca RL. School-based physical activity programs for promoting physical activity and fitness in children and adolescents aged 6 to 18. Cochrane Database Syst Rev. 2013;2:CD007651. doi:10.1002/14651858.CD007651.pub2.
Craig P, Dieppe P, Macintyre S, Michie S, Nazareth I, Petticrew M, et al. Developing and evaluating complex interventions: the new Medical Research Council guidance. BMJ. 2008;337:a1655. doi:10.1136/bmj.a1655.
Bartholomew KL, Parcel GS, Kok G, Gottlieb NH, Fernandez ME. Planning Health Promotion Programs. An Intervention Mapping Approach. 3rd ed. San Fransisco, CA: Jossey-Bass; 2011.
Rose G. The strategy of preventive medicine. Oxford: Oxford University Press; 1992.
Pearson N, Braithwaite R, Biddle SJ. The effectiveness of interventions to increase physical activity among adolescent girls: a meta-analysis. Acad Pediatr. 2015;15(1):9–18. doi:10.1016/j.acap.2014.08.009.
Biddle SJ, Braithwaite R, Pearson N. The effectiveness of interventions to increase physical activity among young girls: a meta-analysis. Prev Med. 2014;62:119–31. doi:10.1016/j.ypmed.2014.02.009.
Grydeland M, Bergh IH, Bjelland M, Lien N, Andersen LF, Ommundsen Y, et al. Intervention effects on physical activity: the HEIA study - a cluster randomized controlled trial. Int J Behav Nutr Phys Act. 2013;10:17. doi:10.1186/1479-5868-10-17.
Martinez-Vizcaino V, Sanchez-Lopez M, Notario-Pacheco B, Salcedo-Aguilar F, Solera-Martinez M, Franquelo-Morales P, et al. Gender differences on effectiveness of a school-based physical activity intervention for reducing cardiometabolic risk: a cluster randomized trial. Int J Behav Nutr Phys Act. 2014;11(1):154. doi:10.1186/s12966-014-0154-4.
Shochet IM, Dadds MR, Holland D, Whitefield K, Harnett PH, Osgarby SM. The efficacy of a universal school-based program to prevent adolescent depression. J Clin Child Psychol. 2001;30(3):303–15. doi:10.1207/S15374424JCCP3003_3.
O’Cathain A, Thomas KJ, Drabble SJ, Rudolph A, Hewison J. What can qualitative research do for randomised controlled trials? A systematic mapping review. BMJ open. 2013;3(6). doi:10.1136/bmjopen-2013-002889.
Moore GF, Audrey S, Barker M, Bond L, Bonell C, Hardeman W, et al. Process evaluation of complex interventions: Medical Research Council guidance. BMJ. 2015;350:h1258. doi:10.1136/bmj.h1258.
Neumark-Sztainer D, Martin SL, Story M. School-based programs for obesity prevention: what do adolescents recommend? Am J Health Promot. 2000;14(4):232–5. iii.
Loman DG. Promoting physical activity in teen girls: insight from focus groups. MCN Am J Matern Child Nurs. 2008;33(5):294–9. doi:10.1097/01.NMC.0000334896.91720.86. quiz 300–1.
Ryan RM, Deci EL. Intrinsic and Extrinsic Motivations: Classic Definitions and New Directions. Contemp Educ Psychol. 2000;25(1):54–67. doi:10.1006/ceps.1999.1020.
Owen KB, Smith J, Lubans DR, Ng JY, Lonsdale C. Self-determined motivation and physical activity in children and adolescents: a systematic review and meta-analysis. Prev Med. 2014;67:270–9. doi:10.1016/j.ypmed.2014.07.033.
Schoeppe S, Oliver M, Badland HM, Burke M, Duncan MJ. Recruitment and retention of children in behavioral health risk factor studies: REACH strategies. Int J Behav Med. 2014;21(5):794–803. doi:10.1007/s12529-013-9347-5.
Murray DM, Stevens J, Hannan PJ, Catellier DJ, Schmitz KH, Dowda M, et al. School-level intraclass correlation for physical activity in sixth grade girls. Med Sci Sports Exerc. 2006;38(5):926–36. doi:10.1249/01.mss.0000218188.57274.91.
Lai SK, Costigan SA, Morgan PJ, Lubans DR, Stodden DF, Salmon J, et al. Do school-based interventions focusing on physical activity, fitness, or fundamental movement skill competency produce a sustained impact in these outcomes in children and adolescents? A systematic review of follow-up studies. Sports Med. 2014;44(1):67–79. doi:10.1007/s40279-013-0099-9.
Goodman A, Sahlqvist S, Ogilvie D, iConnect C. New walking and cycling routes and increased physical activity: one- and 2-year findings from the UK iConnect Study. Am J Public Health. 2014;104(9):e38–46. doi:10.2105/AJPH.2014.302059.
Gesell SB, Sommer EC, Lambert EW, Vides de Andrade AR, Whitaker L, Davis L, et al. Comparative effectiveness of after-school programs to increase physical activity. J Obes. 2013;2013:576821. doi:10.1155/2013/576821.
Babey SH, Wu S, Cohen D. How can schools help youth increase physical activity? An economic analysis comparing school-based programs. Prev Med. 2014;69 Suppl 1:S55–60. doi:10.1016/j.ypmed.2014.10.013.
Beets MW, Weaver RG, Moore JB. Understanding the real value of youth physical activity promotion. Prev Med. 2015;72:130–2. doi:10.1016/j.ypmed.2014.11.009.
Naylor PJ, Nettlefold L, Race D, Hoy C, Ashe MC, Wharf Higgins J, et al. Implementation of school based physical activity interventions: A systematic review. Prev Med. 2015;72C:95–115. doi:10.1016/j.ypmed.2014.12.034.
Durlak JA, DuPre EP. Implementation matters: a review of research on the influence of implementation on program outcomes and the factors affecting implementation. Am J Community Psychol. 2008;41(3–4):327–50.
Moore G, Audrey S, Barker M, Bond L, Bonell C, Cooper C, et al. Process evaluation in complex public health intervention studies: the need for guidance. J Epidemiol Community Health. 2014;68(2):101–2. doi:10.1136/jech-2013-202869.
Lubans DR, Foster C, Biddle SJ. A review of mediators of behavior in interventions to promote physical activity among children and adolescents. Prev Med. 2008;47(5):463–70. doi:10.1016/j.ypmed.2008.07.011.
van Stralen MM, Yildirim M, te Velde SJ, Brug J, van Mechelen W, Chinapaw MJ, et al. What works in school-based energy balance behaviour interventions and what does not? A systematic review of mediating mechanisms. Int J Obes. 2011;35(10):1251–65. doi:10.1038/ijo.2011.68.
Sun X, Briel M, Walter SD, Guyatt GH. Is a subgroup effect believable? Updating criteria to evaluate the credibility of subgroup analyses. BMJ. 2010;340:c117. doi:10.1136/bmj.c117.
Prayle AP, Hurley MN, Smyth AR. Compliance with mandatory reporting of clinical trial results on ClinicalTrials.gov: cross sectional study. BMJ. 2012;344:d7373. doi:10.1136/bmj.d7373.
Acknowledgement of funding
This work was supported by the Medical Research Council [Unit Programme number MC_UU_12015/7] and the Centre for Diet and Activity Research (CEDAR), a UKCRC Public Health Research: Centre of Excellence (RES-590–28-0002). Funding from the British Heart Foundation, Economic and Social Research Council, Medical Research Council, the National Institute for Health Research, and the Wellcome Trust, under the auspices of the UK Clinical Research Collaboration, is gratefully acknowledged.
The authors declare that they have no competing interests.
This commentary is based on the authors’ experience in developing and conducting intervention research and reviewing the existing intervention literature. A combined view on the key issues as presented at international conferences was taken as the initial starting point, after which EvS drafted the manuscript with critical input from SK. Both authors read and approved the final manuscript for submission.
About this article
Cite this article
van Sluijs, E.M.F., Kriemler, S. Reflections on physical activity intervention research in young people – dos, don’ts, and critical thoughts. Int J Behav Nutr Phys Act 13, 25 (2016). https://doi.org/10.1186/s12966-016-0348-z