- Review
- Open access
- Published:
An assessment of self-reported physical activity instruments in young people for population surveillance: Project ALPHA
International Journal of Behavioral Nutrition and Physical Activity volume 8, Article number: 1 (2011)
Abstract
Background
The assessment of physical activity is an essential part of understanding patterns and influences of behaviour, designing interventions, and undertaking population surveillance and monitoring, but it is particularly problematic when using self-report instruments with young people. This study reviewed available self-report physical activity instruments developed for use with children and adolescents to assess their suitability and feasibility for use in population surveillance systems, particularly in Europe.
Methods
Systematic searches and review, supplemented by expert panel assessment.
Results
Papers (n = 437) were assessed as potentially relevant; 89 physical activity measures were identified with 20 activity-based measures receiving detailed assessment. Three received support from the majority of the expert group: Physical Activity Questionnaire for Children/Adolescents (PAQ-C/PAQ-A), Youth Risk Behaviour Surveillance Survey (YRBS), and the Teen Health Survey.
Conclusions
Population surveillance of youth physical activity is strongly recommended and those involved in developing and undertaking this task should consider the three identified shortlisted instruments and evaluate their appropriateness for application within their national context. Further development and testing of measures suitable for population surveillance with young people is required.
Background
Physical activity in young people has become a major issue in public health as evidence emerges on the important role of physical activity in many health conditions, including overweight and obesity, type 2 diabetes, cardiovascular disease risk, skeletal health, and mental health. In particular, the issue of obesity in youth, and the link between this condition and type 2 diabetes, as well as the increases in diabetes [1] is topical and currently demanding much attention in physical activity research [2].
Establishing links between physical activity and health outcomes is a fundamental phase of the behavioural epidemiology framework proposed by Sallis and Owen [3]. An early phase of this framework is to identify valid and reliable ways to assess physical activity. If suitable assessment methods can be developed, and health outcomes identified that are associated with physical activity, this logically leads to research identifying factors associated with physical activity ('correlates') and interventions to increase physical activity. However, much of this is predicated on the use of suitable tools for assessing levels of physical activity.
In addition to assessing physical activity in research studies, where researchers may have the opportunity of conducting lengthy and detailed assessments, tools are also needed for assessing population level prevalence [4]. This is the focus of the present paper. Usually such instruments have to be brief as they may sit alongside other health assessments within population surveillance systems [5].
Assessment Using Self-Report
Until the development of movement sensors, such as pedometers and accelerometers, the assessment method of choice for physical activity has been self-report. Consequently, there are a large number of instruments, with varying degrees of formatting and development, with many aimed at assessment in young people. However, this approach to measurement is fraught with difficulties and consequently there are many poorly developed instruments alongside those that have a history of more robust design and development.
There are many good sources of discussion concerning issues in self-reported assessment of physical activity, in both youth and adults (e.g., [6–10]). Moreover, there are many methods that can be used, including questionnaires/surveys and diaries. Survey methods can require self or proxy completion, the latter, for example, by parents for young children.
In the analysis of self report surveys that follows, we focused on instruments that might be suitable for assessment in large-scale population surveillance, usually for the purpose of estimating the prevalence of physical activity. Prevalence estimates refer to the proportion of the population estimated within physical activity time-based categories (e.g., percentage meeting national guidelines, such as 60 minutes of MVPA each day of the week). This contrasts with possible outputs such as mean estimates of time spent in specific types of physical activity behaviours, or total physical activity behaviour, or 'dose'.
Such assessments are usually part of a wider public health surveillance system. The USA Centres for Disease Control [11] stated that "Public health surveillance systems should be evaluated periodically, and the evaluation should include recommendations for improving quality, efficiency, and usefulness." This will include an evaluation of the type of assessment (e.g., objective or self-report), and continued assessment of the nature of the instrument being used. To this end, Project ALPHA was established, with one aim being to provide guidance on the measurement of physical activity in young people using self-report instruments and assess their suitability for population surveillance monitoring, particularly in the European context (see http://sites.google.com/site/alphaprojectphysicalactivity/). That is, instruments relevant for populations of these types of countries.
In evaluating, as well as developing, self-report instruments for surveillance of physical activity in youth, consideration needs to be given to several key issues [12], including:
-
What domains of physical activity are being assessed? These could be general (total physical activity) or in specific contexts, such as school or leisure-time.
-
Does the instrument assess the frequency, intensity, duration and type of activity?
-
Does the instrument assess the temporal dimension of physical activity (e.g., activity at different times of the day)?
-
Over what period are participants being asked to recall their activity?
-
Is the instrument suitable for the age group it is aimed at? This will require the testing of items for appropriateness of the language used and consideration of the cognitive capacities of the child being assessed.
-
Is the instrument appropriate in respect of ease of completion and participant burden, given that large samples will be required to be tested for population surveillance and prevalence?
-
Is the instrument suitably valid and reliable?
This paper addresses the assessment of physical activity for children and adolescents for population level surveillance using self-report instruments. With technological improvements and reductions in costs, population surveillance may, in future, routinely use more objective instruments, such as accelerometers. However, even if this is the case, concomitant assessment of some aspects of physical activity (e.g., type) will require self-report assessment, alongside objective methods.
The purpose of this paper, therefore, is to review existing self-report instruments purporting to assess physical activity in young people. Instruments will be appraised and a short list of measures that may be suitable for population surveillance, with the ability to provide suitable prevalence estimates, will be considered with the purpose of making recommendations on usage, particularly in a European context.
Method
Search Strategy
Literature searches, using tailored search terms appropriate to each database, were conducted using Web of Science, Medline, PubMed, PsycINFO, SportDISCUS, and SIGLE. Typical search terms included physical activity, exercise, sport, children, adolescent, boys, girls, infants, measurement, surveillance, and survey. Search terms followed the same order of (1) behaviour terms, (2) population terms, and (3) method terms. The census date for searches was June 2008. We also searched the reference lists of key texts and reviews published since 2000 (e.g., [13–19]), plus the special issues on physical activity measurement in Medicine and Science in Sports and Exercise (1997, 29 (6) Supplement; 2000, 32 (2) Supplement) and Research Quarterly for Exercise and Sport (2000, 71 (2)).
We also contacted 42 people across 37 European countries asking them to identify any population based survey instruments that were used to measure physical activity in young people within their country. Ten people replied but no new instruments were identified through this process.
Inclusion criteria for instruments to be considered for further evaluation required that studies a) reported the use of a self-report measure of physical activity and b) targeted participants less than 19 years of age. Studies only assessing physical fitness or employing only objective measures were excluded.
The search strategy resulted in 24,190 titles which were initially screened for duplicates and potential relevance. After this initial screening, 1839 titles and abstracts were assessed against the inclusion/exclusion criteria. In total 437 papers were assessed as potentially relevant and full papers were obtained. From these a total of 89 physical activity measures were identified. The measures were grouped as activity-based instruments (n = 67), time-based instruments (n = 5), proxy instruments (n = 17) and observation instruments (n = 1). Activity-based instruments are structured around a list of activities with minimal reference to time of day. By contrast, time-based instruments divide the day into time blocks and respondents provide the dominant activity/energy expenditure for each time block. Proxy instruments are completed on behalf of the individual (often by a parent) and observational tools are used to record behaviour by an observer.
Data Synthesis
Information about each instrument was extracted and tabulated, including instrument name, indicative references, details of physical activity assessment (including physical activity dimensions assessed, recall period, method and structure of the instrument, number of items, other relevant information, and measurement format), age of participants, indicative countries in which it has been used, and information on reliability and validity. From the initial long table a short list of 20 activity-based instruments and 2 time-based instruments was constructed (Additional file 1, Table S1). Observational and proxy measures were not considered appropriate tools for population surveillance. The inclusion criterion for short-listing was that some level of reliability and/or validity had been demonstrated. After further consideration, based mainly on participant burden and the necessity for the instruments to be suitable for population level surveillance, the two time-based instruments were dropped from further analysis.
The short-listed instruments were summarised within a further table that included instrument name, a rating of validity and reliability, a summary of physical activity assessment (e.g., time frame, number of items, time to complete), age range, use since 1998 (Y/N), previous use in large scale survey (Y/N), availability of European data (Y/N), and comments/qualifications (see Table 1).
Validity and reliability of each instrument was assessed by two of the researchers using criteria shown in Table 2. The absolute value of the statistic reported was assessed first, followed by any other criteria used.
Expert Assessment
Five international experts in the area of physical activity measurement were invited to contribute to the review by scrutinising a table containing 89 instruments, and provide critical feedback on the short list of 20 instruments. A briefing and discussion took place face-to-face with all experts together. At the meeting, criteria for electronic searches and the assessment of reliability and validity were outlined and discussed. The experts then provided feedback some weeks later after further scrutiny away from the meeting. Specifically, the experts were asked to identify the instruments in the short list table most appropriate for use in population surveillance, with additional comments if necessary. Specifically, they were requested to specify if the instrument was in their 'top 5', and then provide reasons for their decision, including whether they had personal experience of using the scale or whether additional issues needed to be noted (e.g., better for some ages than others; ease of administration) (see Table 3). Finally, they were requested to specify if any other instrument might be missing from the short list. Key papers for each instrument were made available online. Four of the five experts were able to respond by the deadline.
Results
Of the 20 instruments receiving detailed assessment, 4 had no reported reliability data, and a further 3 instruments had weak reliability (see Table 1). For validity, few, if any, were expected to report strong validity due to the nature of self-report instruments with young people. Only two instruments (SHAPES, Finnish Twin Cohort Study) received a strong rating for validity based on strength of statistical value as set out in Table 2. However, these instruments were seen to have limitations for population surveillance. SHAPES was considered to be too long for population surveillance systems, with 45 items, and the Finnish instrument has only been tested with a limited age range.
Three scales received support, based on judgments from the expert group and the authors. The three instruments selected were the PAQ-C/PAQ-A, YRBS, Teen Health Survey. All of these received support from at least 3 of the 4 experts. No other instrument was supported by more than one expert.
PAQ-C/PAQ-A (Physical Activity Questionnaire)
There are two versions of this scale, with one for children (C) aged 8-14 y [20], and one for adolescents (A) aged 14-20 y [21]. For example, the PAQ-C requests responses for the last 7 days by asking participants to check a list of activities for frequency of participation on a scale from 'no', 1-2 times per week, 3-4, 5-6, to 7 times or more. Questions are also asked about physical activity in PE lessons, recess, at lunch time, right after school, and evenings, as well as 'the last weekend'. A measure of frequency of participation is requested for each day, ranging from 'none' to 'very often'.
The PAQ-C is a self-administered 7-day recall questionnaire. It is intended to measure habitual moderate-to-vigorous physical activity in children and was developed for use in the Saskatchewan Pediatric Bone Mineral Accrual Study [18]. The PAQ-A is a slightly modified version for adolescents. The instruments were produced using appropriate development methods, moreover they are fairly short and easy to use, thus were viewed as suitable for use in surveillance and monitoring. Validity data exist, using objective assessment of physical activity. However, the PAQ is designed for assessment only during the school year, and there are no data showing use in Europe.
YRBS (Youth Risk Behaviour Surveillance Survey)
The YRBS was developed in the early 1990s and has been extensively used since, including for large scale surveillance across a good range of children and youth in the USA [22, 23] (see http://www.cdc.gov/HealthyYouth/yrbs/index.htm). Respondents can report physical activity for the past year or past week, and it comprises only five items for both moderate and vigorous physical activity. A measure of sedentary behaviour is also included, and this may prove useful as the focus on sedentary behaviour increases [24]. Validity data was good for this instrument, including convergent validity with accelerometry.
The Teen Health Survey
This is a 2-item instrument developed for adolescents. Items were shortened and adapted from the YRBS and tested alongside other instruments for possible use in primary health care [25]. Items also formed part of the CITY100 (Correlates of Indoor Tanning in Youth) survey [26]. The recall period is either the previous 7 days or typical week, and data exist showing moderate-to-good associations with accelerometry. Its applicability to younger children (i.e., pre-teens) has not been tested and may be questionable.
Other instruments that received some support from the expert group did so usually for reasons of ease of administration. These included the APARQ (but has weak validity), the instrument used in the large HBSC study (has limited validity against objective measures of physical activity), CLASS (has weak reliability), and, as stated earlier, SHAPES (meets many of the criteria but has too many items for surveillance), and the Finnish Twin Cohort Study (limited age range).
Discussion and Conclusions
A robust and useful measure of physical activity is crucial to good population surveillance which, in turn, is a central component of a comprehensive public health response aimed at increasing levels of participation. There is significant interest across Europe to advance both the quality and the comparability of measures of activity in adults and young people [27]. In recent years much work has been undertaken to develop a suitable, internationally recognised, tools for population surveillance and measurement in adult populations [28, 29]. However, for young people, assessment using self-report instruments remains particularly problematic for the reasons stated previously and less work has been undertaken to identify and, if needed, develop suitable tools. In young people, measurement error is of a particular concern due to issues of recall. In addition, instruments are only likely to pick up types of physical activity that can easily be recalled and are therefore 'retrievable' from memory. This may miss some of the short and sporadic bursts of activity common for younger children.
Objective methods for the assessment of physical activity are now more common and more feasible, largely because both the cost and complexity have been addressed. This has resulted in trials of their use assessing large samples of young people [30, 31], nonetheless it is likely that self report instruments will be required for some time yet, if mainly for reasons of cost. Even if accelerometers become the instrument of choice, self-report instruments will continue to be required as information on both the type and context of physical activity is also important. Moreover, the design of effective interventions requires an understanding of what physical activity people do alongside how much they do. The PAQ scales may be best placed for this as far as the selected scales are concerned.
For use in population level surveillance systems and tracking trends over time, physical activity measures need to demonstrate not only validity and reliability but also ease of administration, particularly if administered in a larger survey assessing other health behaviours. These all present challenges and, as such, there is no existing instrument that easily satisfies all criteria. That said, following a detailed evaluation, three instruments were identified as potentially most suitable for use: PAQ-C/PAQ-A, YRBS, Teen Health Survey (itself a shortened modification of the YRBS). Those undertaking population surveillance of youth physical activity are recommended to consider these instruments and to evaluate their appropriateness for the type of assessment that may be required. While population surveillance of youth physical activity is strongly recommended, it is evident from this review that further research is needed to establish suitable measures and demonstrate effective use in national surveillance systems aimed at young people. Such work should be encouraged particularly where is can also combine with an objective assessment.
Abbreviations
- APARQ:
-
Adolescent Physical Activity Recall Questionnaire
- CLASS:
-
Children's Leisure Activities Study Survey
- MVPA:
-
Moderate to Vigorous Physical Activity
- PAQ:
-
Physical Activity Questionnaire
- SHAPES:
-
School Health Action Planning and Evaluation System
- USA:
-
United States of America.
References
Massó-González EL, Johansson S, Wallander M-A, GarcÃa-RodrÃguez LA: Trends in the prevalence and incidence of diabetes in the UK: 1996-2005. Journal of Epidemiology & Community Health. 2009, 63: 332-6.
Stensel DJ, Gorely T, Biddle SJH: Youth health outcomes. Youth physical activity and sedentary behavior: Challenges and solutions. Edited by: Smith AL, Biddle SJH. 2008, Champaign, IL: Human Kinetics, 31-57.
Sallis JF, Owen N: Physical activity and behavioral medicine. 1999, Thousand Oaks, CA: Sage
Bauman A, Phongsavan P, Schoeppe S, Owen N: Physical activity measurement: A primer for health promotion. Promotion and Education. 2006, 13 (2): 92-103. 10.1177/10253823060130020103.
Bull FC, Bauman A: Consistent risk factor monitoring systems underpins good public health practice. Preventive Medicine. 2008, 47 (2): 154-5. 10.1016/j.ypmed.2008.05.004.
Sallis JF, Saelens BE: Assessment of physical activity by self-report: Status, limitations, and future directions. Research Quarterly for Exercise and Sport. 2000, 71: 1-14.
Matthews CE: Use of self-report instruments to assess physical activity. Physical activity assessments for health-related research. Edited by: Welk GJ. 2002, Champaign, IL: Human Kinetics, 107-23.
Pettee KK, Storti KL, Ainsworth BE, Kriska AM: Measurement of physical activity and inactivity in epidemiologic studies. Epidemiological methods in physical activity studies. Edited by: Lee I-M. 2009, New York: Oxford University Press, 15-33.
Bassett DR, Fitzhugh EC: Establishing validity and reliability of physical activity assessment instruments. Epidemiological methods in physical activity studies. Edited by: Lee I-M. 2009, New York: Oxford University Press, 34-55.
Corder K, Ekelund U: Physical activity. Paediatric exercise science and medicine. Edited by: Armstrong N, Van Mechelen W. 2008, Oxford: Oxford University Press, 129-43. 2nd
Centres for Disease Control Guidelines Working Group: Updated guidelines for evaluating public health surveillance systems: Recommendations from the Guidelines Working Group. Morbidity and Mortality Weekly Reports. 2001, July 27(50(RR13)), [http://www.cdc.gov/mmwr/preview/mmwrhtml/rr5013a1.htm]
Dollman J, Okely AD, Hardy L, Timperio A, Salmon J, Hills AP: A hitchhiker's guide to assessing young people's physical activity: Deciding what method to use. Journal of Science and Medicine in Sport. 2009, 12: 518-25. 10.1016/j.jsams.2008.09.007.
Welk GJ, editor: Physical activity assessments for health-related research. 2002, Champaign, IL: Human Kinetics
Armstrong N, Welsman JR: The physical activity patterns of European youth with reference to methods of assessment. Sports Medicine. 2006, 36 (12): 1067-86. 10.2165/00007256-200636120-00005.
Bauman AE, Nelson DE, Pratt M, Matsudo V, Schoeppe S: Dissemination of physical activity evidence, programs, policies, and surveillance in the international public health arena. American Journal of Preventive Medicine. 2006, 31 (4, Supplement 1): 57-65. 10.1016/j.amepre.2006.06.026.
Kohl HW, Fulton JE, Caspersen CJ: Assessment of physical activity among children and adolescents: A review and synthesis. Preventive Medicine. 2000, 31: S54-S76. 10.1006/pmed.1999.0542.
Oliver M, Schofield GM, Kolt GS: Physical activity in preschoolers: Understanding prevalence and measurement issues. Sports Medicine. 2007, 37 (12): 1045-70. 10.2165/00007256-200737120-00004.
Trost SG: Measurement of physical activity in children and adolescents. American Journal of Lifestyle Medicine. 2007, 1: 299-314. 10.1177/1559827607301686.
Sirard JR, Pate RR: Physical activity assessment in children and adolescents. Sports Medicine. 2001, 31 (6): 439-54. 10.2165/00007256-200131060-00004.
Crocker PRE, Bailey DA, Faulkner RA, Kowalski KC, McGrath R: Measuring general levels of physical activity: Preliminary evidence for the Physical Activity Questionnaire for older children. Medicine and Science in Sports and Exercise. 1997, 29: 1344-9.
Kowalski KC, Crocker PRE, Kowalski NP: Convergent validity of the Physical Activity Questionnaire for Adolescents. Pediatric Exercise Science. 1997, 9: 342-52.
Brener ND, Collins JL, Kann L, Warren CW, Williams BI: Reliability of the Youth Risk Behavior Survey Questionnaire. American Journal of Epidemiology. 1995, 141 (6): 575-80.
Caspersen CJ, Pereira MA, Curran KM: Changes in physical activity patterns in the United States, by sex and cross-sectional age. Medicine and Science in Sports and Exercise. 2000, 32: 1601-9.
Spanier PA, Marshall SJ, Faulkner GE: Tackling the obesity pandemic: A call for sedentary behaviour research. Canadian Journal of Public Health. 2006, 97 (3): 255-7.
Prochaska JJ, Sallis JF, Long B: A physical activity screening measure for use with adolescents in primary care. Archives of Pediatric and Adolescent Medicine. 2001, 155: 554-9.
Butcher K, Sallis JF, Mayer JA, Woodruff S: Correlates of physical activity guideline compliance for adolescents in 100 U.S. cities. Journal of Adolescent Health. 2008, 42 (4): 360-8. 10.1016/j.jadohealth.2007.09.025.
Daugbjerg SB, Kahlmeier S, Racioppi F, Martin-Diener E, Martin B, Oja P, et al: Promotion of physical activity in the European region: Content analysis of 27 national policy documents. Journal of Physical Activity and Health. 2009, 6: 805-17.
Bauman A, Bull FC, Chey T, Craig CL, Ainsworth BE, Sallis JF, et al: The International Prevalence Study on Physical Activity: Results from 20 countries. International Journal of Behavioral Nutrition and Physical Activity. 2009, 6: 21-10.1186/1479-5868-6-21.
Bull FC, T M, Armstrong T: Global physical activity questionnaire (GPAQ): 9 country reliability and validity study. Journal of Physical Activity and Health. 2009, 6: 790-804.
Riddoch CJ, Mattocks C, Deere K, Saunders J, Kirkby J, Tilling K, et al: Objective measurement of levels and patterns of physical activity. Archives of Disease in Childhood. 2007, 92: 963-9. 10.1136/adc.2006.112136.
Mattocks C, Ness A, Leary S, Tilling K, Blair SN, Shield J, et al: Use of accelerometers in a large field-based study of children: Protocols, design issues, and effects on precision. Journal of Physical Activity & Health. 2008, 5 (Suppl 1): S98-S111.
Acknowledgements
This work was part of Project ALPHA, supported by the EU Commission Director General Public Health [DG SANCO] as Work Package 4.4 (PI: Professor Fiona Bull). This package was led by the British Heart Foundation National Centre for Physical Activity & Health at Loughborough University, UK. Supporting researchers on the project were Charlotte Benjamin, Dr Sally Pears, and Michelle Taylor.
The contributions of the expert panel (Adrian Bauman, Mai Chin A Paw, Cora Craig, Russ Jago, and Pekka Oja) are gratefully acknowledged
Author information
Authors and Affiliations
Corresponding author
Additional information
Competing interests
The authors declare that they have no competing interests.
Authors' contributions
SJHB led the day-to-day management of the project, carried out some of the analyses and led the writing of the manuscript. TG was closely involved in the day-to-day management of the project, carried out some of the analyses and contributed to the writing of the manuscript. NP conducted some of the analyses and contributed to the writing of the manuscript. FCB was the PI for the grant, led initial project planning, reviewed data analysis, and contributed to the writing of the manuscript. All authors read and approved the final manuscript.
Electronic supplementary material
12966_2010_398_MOESM1_ESM.DOCX
Additional file 1: Table S1: Table of activity-based instruments selected for detailed assessment. Detail on each selected instrument. (DOCX 42 KB)
Rights and permissions
Open Access This article is published under license to BioMed Central Ltd. This is an Open Access article is distributed under the terms of the Creative Commons Attribution 2.0 International License (https://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
About this article
Cite this article
Biddle, S.J., Gorely, T., Pearson, N. et al. An assessment of self-reported physical activity instruments in young people for population surveillance: Project ALPHA. Int J Behav Nutr Phys Act 8, 1 (2011). https://doi.org/10.1186/1479-5868-8-1
Received:
Accepted:
Published:
DOI: https://doi.org/10.1186/1479-5868-8-1