Validation of the Netherlands physical activity questionnaire in Brazilian children
© Bielemann et al; licensee BioMed Central Ltd. 2011
Received: 23 November 2010
Accepted: 21 May 2011
Published: 21 May 2011
Physical activity instruments can be subjective or objective. There is a need to assess the reliability of these instruments, especially for researches in children. The aim of this study was to determine the validity of the Netherlands Physical Activity Questionnaire (NPAQ).
Population under study were Brazilian children aged 4 to 11 years old, enrolled in a population-based study. Data collection took place in two distinct moments: 1) application of the NPAQ by face-to-face interviews with mothers' children and 2) utilization of accelerometers by children as the reference method. GT1M Actigraph accelerometer was worn for five consecutive days. Validity analyses were performed by sensitivity and specificity and ROC (Receiver Operator Characteristic) curve.
Two hundred and thirty nine children participated in both phases of the study. A total of 73.2% children achieved the recommendation of 60 min/day of moderate to vigorous physical activity. The mean and median of the NPAQ score were 25.5 and 26, respectively. The score ranged from 7 to 35 points. The correlation coefficient between the NPAQ and the time spent in moderate to vigorous physical activities was 0.27. Based on the area under the ROC curve, the median value presented the best indicators of sensitivity (59.4%) and specificity (60.9%), and the area under curve was 0.63. The predictive capacity of the NPAQ to identify active children was high regardless the cut-off point chosen. This capacity was even higher if the score was higher than 30.
Based on sensitivity and specificity values, the NPAQ did not show satisfactory validity. The comparison of the reliability of the NPAQ with other instruments is limited, but correlation coefficients found in this study are similar to others. Physical activity level of children estimated from the NPAQ must be interpreted cautiously, and objective measures such as accelerometers should be encouraged.
Childhood physical activity may be beneficial for the life course [1, 2]. Physical activity practice plays a role on the body weight during childhood and in the life cycle including the impact on the obesity-related diseases [1, 3]. Thus, the use of reliable approaches to estimate childhood physical activity is warranted.
Physical activity can be estimated either objectively or subjectively. Accelerometers are objective instruments that have been used to estimate physical activity in epidemiological studies [4, 5]. These motion sensors have been shown to be effective when compared to subjective methods of physical activity assessment . Questionnaires are subjective methods, feasible, fast and cheap as compared with accelerometer . While logistics and cost aspects impair the use of motion sensors in large samples, subjective instruments are more prone to bias, mainly among children .
Due to the inability of children to report their physical activity accurately , questionnaires are usually administered to another person, such as a parent or a teacher . Studies on the validity of questionnaires to estimate physical activity in children are available, but usually statistical analyses present weak points [6, 9].
The Netherlands Physical Activity Questionnaire (NPAQ) is an instrument in which parents report their children preference for some activities. Some of these activities are closely related to physical activity, such as playing sports, while others address sedentary behaviors such as reading. The score obtained from this questionnaire was originally tested as a numerical variable, indicating the likelihood of a child being in higher or lower categories of physical activity . However, the ability of the questionnaire to discriminate between active and inactive children has not been assessed. This questionnaire was chosen because it contains a small number of questions, it includes usual activities performed by Brazilian children, it is workable in large scale studies and allows the assessment of cut-off points or specific questions that are more likely to categorize children as sufficiently active or not. Thus, the aim of the present study is to identify cut off points of the NPAQ to accurately categorize children as physically active or inactive. We used accelerometry as the gold standard measure of physical activity for comparison.
Study Design and Sampling
A cross-sectional population based sample of children was undertaken in Pelotas, a medium-sized (323,000 inhabitants; 93% living in the urban area) Southern Brazilian city. Pelotas has a Gini index (an income inequality index) and a mean family income similar to the rest of the country.
The sample size calculation was based on sensitivity and specificity values estimated by the Fletcher's equation. The following parameters were considered: a) sensitivity and specificity of 75%; b) acceptable error of 10 percentage points; c) physical activity prevalence of 60% (defined by achieving or not the cut-off point of at least 60 min/day of moderate to physical activities, which is in accordance with current recommendations[12, 13]); d) confidence level of 95% and; d) number of children in the population (i.e. 37 thousand children in the urban area of Pelotas according to Brazilian Institute of Geography and Statistics - IBGE). Based on these parameters, 72 active children would be necessary - corresponding to 120 children sampled for the sensitivity - and 72 inactive children - corresponding to a total of 180 children for the specificity. We added 20% to compensate for refusals and losses. Thus, 216 children were the final sample size estimated.
Children were selected through a multi-stage sampling process. Firstly, all 404 census tracts of the city were sorted according to their mean income. Each census tracts comprises approximately 300 households and information on the income was provided by the Brazilian Institute of Geography and Statistics IBGE. Because this study is part of a larger health survey, and other outcomes required larger samples, a total 130 census tracts were selected with probability proportional to their size. In the next step, all households from the selected census tracts were listed and 10 of them from each tract were selected systematically. All children from 4 to 10 years of age residents in the sampled households were eligible to take part in this study. This age group was chosen because there are few studies with Brazilian preschool and school children. Besides, there is not a valid physical activity questionnaire for this age-group available in Portuguese.
Interviews were carried out with mothers from January to May, 2010. When mothers could not be contacted, the questionnaire was responded by another person responsible for looking after the child. In such cases, women related to the child (mother-in-law, grandmother, aunt, sister, etc.) were preferred, and in case of unavailability of any of them, the father was invited to participate.
The Netherlands Physical Activity Questionnaire (NPAQ) was administered to respondents during face-to-face interviews. The questionnaire was translated into Portuguese and has been used in Brazilian children with no evidence of understanding problems. Some activity examples used in the questionnaire were altered to represent usual Brazilian activities, but the original structure of the questionnaire was unchanged . The third question, which refers to the enjoyment of playing sports, had its score reversed. Furthermore, the fifth question, which refers to the enjoyment of reading, was modified to represent enjoyment of reading magazines, drawing or painting. Each of the seven questions had a score of one to five points. The less active option (example: "He always like to play inside the school or the house") socred one and the most active option (example: "He always like to play outside or in the yard") scored five points. The final score was the sum of all scores.
Questions about demographics and socioeconomic characteristics about the respondent and the child were also collected. The variables studied were sex and age of the child, age and schooling of the respondents, and income and socioeconomic status of the child's family. The Brazilian Association of Research Institute (ABEP), which considers household assets, full-time housekeepers, and head-of-family's schooling was used to determine socioeconomic status. ABEP divides families into five categories, from A (wealthiest) to E (poorest) .
Physical activity measured by accelerometry
Children's physical activity was measured by accelerometers (Actigraph GT1M - LLC, Fort Walton Beach, FL, USA) from February to August of 2010. Children were oriented to wear hip accelerometers from Saturday to Wednesday, during 24 h/day, except while bathing or swimming. The epoch was set to 5 s, because longer intervals may not capture important bouts of children activities. Participants were instructed to register in a diary if they did not wear the device for more than 1 hour.
Data from the accelerometers were processed in Actilife 4.4.1 software and analyzed in the MAHUffe (http://www.mrc-epid.cam.ac.uk). The first (Saturday) and last day (Wednesday) were excluded from analyses. Furthermore, those with < 600 min/day of data or >10 min of consecutive zero counts were excluded. The following thresholds were used to classify physical activity intensities: a) sedentary activities - 0 - 100 counts per minute (cpm); b) light activities - 101 to 1999 cpm; c) moderate activities - 2000 to 4999 cpm; d) vigorous activities - ≥5000 cpm. The lower limit for the moderate activities threshold corresponds (in children) to a walking pace of around 3-4 km/h . Only activities of at least moderate intensity and duration of ≥10 min (a buffer of at most 2 min in activities below moderate intensity was allowed) were counted to the score of minutes per day of physical activity.
Variables analyzed from the accelerometer data were total counts, counts per minute, mean time spent in sedentary and moderate to vigorous activities, and sufficient physical activity (yes/no).
Descriptive analyses of demographic and socioeconomic variables are presented. Association between the score of each question of the questionnaire and the prevalence of sufficient physical active (i.e. ≥60 min/day of moderate to vigorous activities) was analyzed by chi-square tests. Pearson correlation coefficients were calculated between the NPAQ results and the accelerometer variables. Sensitivity, specificity and predictive values for different cut-off points of the questionnaire were calculated using data from the accelerometer as a reference method. The ROC (Receiver Operator Characteristic) curve was built from the results of this later analysis.
The study was approved by the Ethics Committee of the Medicine School of Federal University of Pelotas.
Written informed consent was obtained from every mother prior to the interviews.
Description of the sample
A total of 369 children, out of the 379 located participated in the study (2.6% of non-response rate). The accelerometer was used by 239 children (45 children (12.6%) refused to participate, 48 (13.0%) could not be located and 37 (10.0%) did not provide valid data on the accelerometer). Therefore, the final response rate was 64.8%.
Description of the sample in terms of demographic and socioeconomic variables. Pelotas, Brazil, 2010.
Sample interviewed and accelerometry data
< 30 years
≥ 40 years
Description of the physical activity variables from the Netherlands Physical Activity Questionnaire (NPAQ) and accelerometer. Pelotas, Brazil, 2010.
NPAQ score (points)
Mean counts per minute
Daily minutes of sedentary activity
Daily minutes of moderate activity
Daily minutes of vigorous activity
Daily minutes of moderate to vigorous activity
Comparison between instruments
Correlation coefficients between each question and score of NPAQ and accelerometry information. Pelotas, Brazil, 2010.
Mean counts per minute
Daily minutes of sedentary activity
Daily minutes of moderate activity
Daily minutes of vigorous activity
Daily minutes of moderate to vigorous activity
Prevalence of sufficient physical activity according to categories of response to the Netherlands Physical Activity Questionnaire
Always or Almost always (1 or 2 points)
About equal (3 points)
Almost always or Always (4 or 5 points)
Prefers to play alone
Prefers to play with other children
Prefers quiet games like puzzle, cards, toys fit
Prefers vigorous game like running, climbing things, jump rope
Dislikes playing sports
Likes playing sports like soccer and ride a bicycle
Is more introverted, quiet, likes to stay home
Is more extroverted, likes to outgoing
Likes drawing, painting or reading magazines
Dislikes drawing, painting or reading magazines
Prefers to play inside the house or school
Prefers to play outside or in the yard
Less physically active compared to other children of same age
More physically active compared to other children of same age
Validity of the NPAQ in Brazilian children
Sensitivity and specificity of the Netherlands Physical Activity Questionnaire according to different cut-off points.
Positive and negative predictive values to different cut-off points of the Netherlands Physical Activity Questionnaire
Positive predictive value (CI95%)
Negative predictive value (CI95%)
The present population based-study verified the validity of a subjective instrument (NPAQ) compared to an objective instrument (accelerometer) to assess physical activity of Brazilian children. The results indicate that the median value of the NPAQ was the most accurate to classify children as sufficient active or inactive. However, sensitivity and specificity values were low and the area under the ROC was small. One should consider that the prevalence of sufficient physical activity estimated by accelerometer was high, thus, the positive predictive value was also high.
Some methodological issues regarding the use of the accelerometer shall be highlighted. Parents' concern about the accelerometers and lack of cooperation of children to wear the devices and might have contributed to the non-response rate. Mean daily time of accelerometer data ranged from 600 to 1200 min, and 50% of children wore it for less than 950 min. Therefore, children did not wear the monitors 24 h/day, as recommended, and physical activity level might be underestimated. Few studies described the mean time of wearing accelerometer. Only two studies that described this analysis (both with adolescents) were located. The first one was carried out in the same city of the current study (Pelotas), and the mean time of registered activities was 921 min/day with a range of 620 to 1266 min . Another study took place in Madrid and the mean time of registered activities was 789 min in the second day of use . Accelerometers are recommended to be worn during at least three days and during each day at least 600 min of activities must be recorded to represent physical activity patterns in children . Other studies addressing validity and prevalence of physical activity have adopted the criteria of 600 min/day of accelerometer data as the minimum to be acceptable [19, 20].
The high prevalence of sufficient physical activity found in this study indicate that three every four children achieve the guideline of 60 min/day of moderate to vigorous physical activities. The higher the physical activity level, the lower the adiposity level [19, 20], thus, having a physical activity level higher than the current recommendation may, in fact, be desirable.
The choice of a cutoff point to dichotomize the children in active or inactive was necessary to run the validity analyses. The threshold used (60 min/day of moderate to vigorous activities) is in accordance with current recommendations for this age group [12, 13]. The need for an instrument to be used in children is explained by the importance to accurately evaluate physical activity in this age group , and also because of the diversity of instruments that had their validities inadequately analyzed . In the present study, the NPAQ validity was analyzed by sensitivity and specificity tests, and ROC curve.
The proposal of the NPAQ is to identify patterns of a given set of behaviors, thus, limiting the inherent recall error that arises when an instrument aims to evaluate the exact time and frequency of physical activities . Nonetheless, based on the values of sensitivity and specificity, the results shall be interpreted with caution because of the high probability of misclassification.
According to the authors from the NPAQ, the ability of the questionnaire to distinguish between active and inactive children is mainly observed in the extremes of the score distribution . In the current study, the likelihood of children with high score in the NPAQ to be considered active by accelerometry was high (the prevalence of sufficient physical activity in children in the highest tertile of NPAQ was 86% - data not shown). It should be highlighted that, despite the fact that NPAQ cannot classify children according to the current recommendation (i.e. minutes of moderate to vigorous activities), it clearly shows that the higher the NPAQ score, the higher the prevalence of sufficient physical activity. Thereby, this questionnaire is useful to distinguish groups of children more likely to be inactive.
Some authors consider correlation coefficients from 0.3 to 0.5 to be an indicative that the instrument is valid . Thus, the correlation coefficients found in the present study are in accordance with other studies, but it indicates only weak associations [22–24]. This analysis showed that the last question of the NPAQ had the highest correlation coefficient. This question asks the mother to compare her child's physical activity level to other children of the same age. Similar results based on this question were observed in adolescents .
As the use of questionnaires to estimate children's physical activity level has important limitations, the use of objective measures must be encouraged, mainly in low and middle income countries. Although physical activity is an unstable behavior, accelerometers are valid instruments. In addition, the assessment of physical fitness, which is more stable than physical activity, could also be evaluated in studies that aim to determine the etiological association between physical activity and diseases .
The NPAQ showed poor sensitivity and specificity in Brazilian children aged 4 to 11 years old. However, the questionnaire has a good predictive value when used in populations with high prevalence of sufficient physical activity. Moreover, the values of the correlation coefficients were similar to those found in other questionnaires assessing physical activity. The questionnaire may be useful to classify individuals into active or inactive. This is important especially in pediatric populations, which performs specific activities and motivations differ from other age groups.
The authors acknowledge the Brazilian agency Coordenação de Aperfeiçoamento de Pessoal de Nível Superior (CAPES) for an academic scholarship to RB during the period of this study.
- McCurdy LE, Winterbottom KE, Mehta SS, Roberts JR: Using nature and outdoor activity to improve children's health. Current problems in pediatric and adolescent health care. 2010, 40: 102-117. 10.1016/j.cppeds.2010.02.003.View Article
- Biro FM, Wien M: Childhood obesity and adult morbidities. The American journal of clinical nutrition. 2010, 91: 1499S-1505S. 10.3945/ajcn.2010.28701B.View Article
- Olstad DL, McCargar L: Prevention of overweight and obesity in children under the age of 6 years. Applied physiology, nutrition, and metabolism = Physiologie appliquee, nutrition et metabolisme. 2009, 34: 551-570. 10.1139/H09-016.View Article
- Cliff DP, Reilly JJ, Okely AD: Methodological considerations in using accelerometers to assess habitual physical activity in children aged 0-5 years. Journal of science and medicine in sport/Sports Medicine Australia. 2009, 12: 557-567.View Article
- De Vries SI, Van Hirtum HW, Bakker I, Hopman-Rock M, Hirasing RA, Van Mechelen W: Validity and reproducibility of motion sensors in youth: a systematic update. Medicine and science in sports and exercise. 2009, 41: 818-827. 10.1249/MSS.0b013e31818e5819.View Article
- Oliver M, Schofield GM, Kolt GS: Physical activity in preschoolers: understanding prevalence and measurement issues. Sports medicine (Auckland, NZ. 2007, 37: 1045-1070. 10.2165/00007256-200737120-00004.View Article
- Welk GJ, Corbin CB, Dale D: Measurement issues in the assessment of physical activity in children. Research quarterly for exercise and sport. 2000, 71: S59-73.View Article
- Corder K, Ekelund U, Steele RM, Wareham NJ, Brage S: Assessment of physical activity in youth. J Appl Physiol. 2008, 105: 977-987. 10.1152/japplphysiol.00094.2008.View Article
- Schmidt ME, Steindorf K: Statistical methods for the validation of questionnaires--discrepancy between theory and practice. Methods of information in medicine. 2006, 45: 409-413.
- Janz KF, Broffitt B, Levy SM: Validation evidence for the Netherlands physical activity questionnaire for young children: the Iowa bone development study. Research quarterly for exercise and sport. 2005, 76: 363-369.
- Fletcher RH, Fletcher SW: Clinical Epidemiology: the essentials. 2005, 4
- Biddle S, Sallis J, Cavill N: Young and Active? Young people and health-enhancing physical activiy - evidence and implications. 1998, London
- U. S. Department of Health and Human Services: 2008 Physical Activity Guidelines for Americans. 2008, Washington
- Associação Brasileira de Empresas de Pesquisa: Critério de Classificação Econômica Brasil. 2010
- Trost SG, Ward DS, Moorehead SM, Watson PD, Riner W, Burke JR: Validity of the computer science and applications (CSA) activity monitor in children. Medicine and science in sports and exercise. 1998, 30: 629-633.View Article
- Reichert FF, Menezes AM, Kingdom Wells JC, Ekelund E, Rodrigues FM, Hallal PC: A methodological model for collecting high-quality data on physical activity in developing settings-the experience of the 1993 Pelotas (Brazil) Birth Cohort study. Journal of physical activity & health. 2009, 6: 360-366.
- Martinez-Gomez D, Warnberg J, Welk GJ, Sjostrom M, Veiga OL, Marcos A: Validity of the Bouchard activity diary in Spanish adolescents. Public health nutrition. 2009, 13: 261-268.View Article
- Penpraze V, Reilly JJ, MacLean CM, Montgomery C, Kelly LA, Paton JY, Aitchison T, Grant S: Monitoring of Physical Activity in Young Children: How Much is Enough?. Pediatr Exerc Sci. 2006, 18: 483-491.
- Owen CG, Nightingale CM, Rudnicka AR, Sattar N, Cook DG, Ekelund U, Whincup PH: Physical activity, obesity and cardiometabolic risk factors in 9- to 10-year-old UK children of white European, South Asian and black African-Caribbean origin: the Child Heart And health Study in England (CHASE). Diabetologia. 2010, 53: 1620-1630. 10.1007/s00125-010-1781-1.View Article
- Ekelund U, Sardinha LB, Anderssen SA, Harro M, Franks PW, Brage S, Cooper AR, Andersen LB, Riddoch C, Froberg K: Associations between objectively assessed physical activity and indicators of body fatness in 9- to 10-y-old European children: a population-based study from 4 distinct regions in Europe (the European Youth Heart Study). The American journal of clinical nutrition. 2004, 80: 584-590.
- Shephard RJ: Limits to the measurement of habitual physical activity by questionnaires. British journal of sports medicine. 2003, 37: 197-206. 10.1136/bjsm.37.3.197. discussion 206.View Article
- Burdette HL, Whitaker RC, Daniels SR: Parental report of outdoor playtime as a measure of physical activity in preschool-aged children. Archives of pediatrics & adolescent medicine. 2004, 158: 353-357. 10.1001/archpedi.158.4.353.View Article
- Bastos JP, Araujo CL, Hallal PC: Prevalence of insufficient physical activity and associated factors in Brazilian adolescents. Journal of physical activity & health. 2008, 5: 777-794.
- Treuth MS, Hou N, Young DR, Maynard LM: Validity and reliability of the Fels physical activity questionnaire for children. Medicine and science in sports and exercise. 2005, 37: 488-495. 10.1249/01.MSS.0000155392.75790.83.View Article
- Reichert FF, Menezes AM, Araujo CL, Hallal PC: Self-reporting versus parental reporting of physical activity in adolescents: the 11-year follow-up of the 1993 Pelotas (Brazil) birth cohort study. Cadernos de saude publica/Ministerio da Saude, Fundacao Oswaldo Cruz, Escola Nacional de Saude Publica. 2010, 26: 1921-1927.
- Ekelund U: Cardiorespiratory fitness, exercise capacity and physical activity in children: are we measuring the right thing?. Archives of disease in childhood. 2008, 93: 455-456. 10.1136/adc.2007.135202.View Article
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.