Validation of a maternal questionnaire on correlates of physical activity in preschool children
© McMinn et al; licensee BioMed Central Ltd. 2009
Received: 9 February 2009
Accepted: 2 December 2009
Published: 2 December 2009
Valid measures of physical activity correlates in preschool children are lacking. This study aimed to assess the validity, factor structure and internal consistency of a maternal questionnaire on potential correlates of four-year-old children's physical activity.
The questionnaire was designed to measure the following constructs: child personal factors; parental support and self-efficacy for providing support; parental rules and restrictions; maternal attitudes and perceptions; maternal behaviour; barriers to physical activity; and the home and local environments. Two separate studies were conducted. Study I included 24 mothers of four-year-old children who completed the questionnaire then participated in a telephone interview covering similar items to the questionnaire. To assess validity, the agreement between interview and questionnaire responses was assessed using Cohen's kappa and percentage agreement. Study II involved 398 mothers of four-year-old children participating in the Southampton Women's Survey. In this study, principal components analysis was used to explore the factor structure of the questionnaire to aid future analyses with these data. The internal consistency of the factors identified was assessed using Cronbach's alpha.
Kappa scores showed 30% of items to have moderate agreement or above, 23% to have fair agreement and 47% to have slight or poor agreement. However, 89% of items had fair agreement as assessed by percentage agreement (≥ 66%). Limited variation in responses to variables is likely to have contributed to some of the low kappa values. Six questions had a low kappa and low percentage agreement (defined as poor validity); these included questions from the child personal factors, maternal self-efficacy, rules and restrictions, and local environment domains. The principal components analysis identified eleven factors and found several variables to stand alone. Eight of the composite factors identified had acceptable internal consistency (α ≥ 0.60) and three fell just short of achieving this (0.60 > α > 0.50).
Overall, this maternal questionnaire had reasonable validity and internal consistency for assessing potential correlates of physical activity in young children. With minor revision, this could be a useful tool for future research in this area. This, in turn, will aid the development of interventions to promote physical activity in this age group.
The promotion of physical activity in children is a key public health issue due to its potential contribution to the prevention of obesity , osteoporosis , the metabolic syndrome  and cardiovascular disease and its association with positive effects on mental health . Recent evidence suggests that children and adolescents are not undertaking recommended amounts of physical activity [5, 6], emphasising the need to develop ways of encouraging children to be more active. Evidence that physical activity tracks from early childhood [7, 8] suggests that health behaviours (including activity) may develop in early life, making an argument for focusing promotion efforts on preschool children. However, the few intervention studies that have targeted this age group have not reported significant effects . To develop effective interventions to promote physical activity in this age group, an understanding of the determinants or correlates of this behaviour is required but this is currently limited. Research into physical activity correlates in young children has mostly focused on demographic and biological factors  warranting further research across a range of domains.
An important aspect of research into the correlates of physical activity in children is the use of valid and reliable measures, both of physical activity and of the correlates being investigated. Using measures with acceptable levels of validity and reliability reduces measurement error and strengthens the conclusions that can be drawn. Studies have investigated the psychometric properties of measures of correlates in adolescents [11–17] and older children (aged 8-12 years) [18–22] but not preschool children. We therefore aimed to assess the psychometric properties of a maternal questionnaire designed to measure a range of factors that might be associated with preschool children's physical activity. The questionnaire was based on a literature search on the correlates of young (< 8 years) children's physical activity and guided by Social Cognitive Theory which identifies personal, behavioural and environmental (social and physical) influences on children's health behaviour . Drawing on these, the questionnaire was designed to measure the following domains: child personal factors; parental support and self-efficacy for providing support; parental rules and restrictions; maternal attitudes and perceptions; maternal behaviour; barriers to physical activity; the home environment; and the local environment. Additionally, questions on whether or not the child attended preschool/nursery and what mode of transport mothers chose when making short trips were included to give some indication of the child's lifestyle.
The validation of measures of physical activity correlates in children is problematic, largely due to there being no established 'gold standard' with which to compare a new measure. Some validation studies of child-report questionnaires have used alternative sources of information, such as parents  or teachers , as the criterion measure for comparison. However, the accuracy of these criterion measures is unclear. Other validation studies have investigated different aspects of validity such as factorial validity [15, 16, 24], which is used to assess which questions contribute the greatest variation in responses and to detect the underlying structure of a set of variables. This can be used either to reduce a set of questions on a particular construct or to guide the grouping of individual variables into constructs for analyses. While this can provide useful information, on its own, it does not verify whether the new questionnaire is measuring what it is supposed to. Some studies have also looked at the relationship between measures of correlates and levels of children's physical activity to further validate questionnaires [17, 19, 20]. However, this seems counter-intuitive as it is investigating whether the variables in a questionnaire are associated with physical activity before it has been established whether the questionnaire is accurately measuring these variables. As there does not appear to be one ideal way to validate questionnaires on the correlates of physical activity in children, using a combination of methods is likely to give the best estimates of validity.
The aims of the studies presented here were to assess the validity of a maternal questionnaire on the potential correlates of physical activity among preschool children and to explore the factor structure of the questionnaire data, and the internal consistency of the factors identified, to guide future analyses with these data. To our knowledge, this is the first study to investigate the validity and reliability of a questionnaire on the potential correlates of physical activity in preschool children.
The questionnaire was developed for use in the Southampton Women's Survey (SWS), a cohort study designed to investigate how women's anthropometry, lifestyle, and nutrition, before and during pregnancy, affect the development of their offspring . Participants are monitored during their pregnancy then followed up after the birth of their child. When the children are four years old, a sub-sample is seen for a dual energy x-ray absorptiometry (DXA) scan , forming the source of participants for a secondary study investigating the association between bone health and obesity. This part of the SWS also aims to investigate the association between objectively measured physical activity and obesity and the correlates of physical activity. The questionnaire was therefore developed for this part of the study to collect data on the potential correlates of physical activity.
Description of questionnaire items/constructs
Name of variable/group of variables1
No. of items
Child personal factors
Would you describe your child as: physically active; restless; well-behaved; inquisitive/outgoing (strongly disagree to strongly agree).
Enjoyment of physical activity
Agreement with: my child enjoys being physically active (strongly disagree to strongly agree).
Preference for physical activity
Does your child prefer to: play indoors or play outdoors; play with toys or watch TV; watch TV or play a running a game with siblings or friends.
How often (never to very often) do you or your partner: encourage child to do PA; do PA with child; provide transport so child can go somewhere to do PA; watch child participate in PA; tell child PA is good for health?
Maternal self-efficacy for social support
Agreement (strongly disagree to strongly agree) with: I think it is difficult to: encourage child to go outside and play; encourage child to play active game instead of watching TV; play active game with child on a busy day; take child out to play when it's cold and wet; take child out to play when it's hot; play active game with child at the weekend; play active game with child when tired.
Parental rules & restrictions
How often (never to very often) do you or your partner apply the following rules: not allowed to watch TV at meal times; go to bed at a set time; not allowed to play ball games in house; not allowed to eat snacks while watching TV; not allowed to play in playground without adult supervision; not allowed to run or cycle in house; not allowed to play in garden without adult supervision.
How often (never to very often) do you or your partner restrict the time child spends: watching TV/video; playing computer games; playing outside; using computer.
Maternal attitudes & perceptions
Importance of child PA
Agreement with: I think it is important that my child participates in PA (strongly disagree to strongly agree).
Concern about TV watching
Agreement with: I am concerned about the amount of TV my child watches (strongly disagree to strongly agree).
PA compared to siblings
Compared to your other child(ren), would you say that your 4-year-old is: as active, more active, less active, not applicable (no other children).
PA compared to peers
Compared with children the same age and sex, would you say that your child is: generally less active; similarly active; generally more active.
Barriers to physical activity
How often (never to very often) is child's PA limited due to: fees for clubs/swimming pools being too high; difficult to get to PA places; child lacks skills to do PA; child not interested in doing PA; weather is too bad; too busy; scared child will get hurt; no playgrounds near home; no other children to play with; no adult to supervise child whilst playing.
How many children younger and older than 4-year-old live at home; do you live with the father of your 4-year-old; are there any other adults living in your home.
TV/PC in bedroom
Does child have: TV; video/DVD player; computer in bedroom (yes/no).
Does household have any cars/vans available for use (yes/no).
Perceived local environment
Agreement (strongly disagree to agree) with: heavy traffic on local streets; concerned about strangers; somewhere at home where child can go out and play; concerned about road safety; public transport is limited; playgrounds close to home where child can play; playgrounds at child's nursery; other children near home who child can play with.
Does child attend day care, nursery or preschool (yes, full time; yes, part time; no, he/she is at home with me; no, he/she is at home with other adult; other).
Transport for short trips
When making short trips (less than 1/2 mile) alone/with child, what form of transport do you usually use (public transport; car; walking; bicycling; other).
Two separate studies were undertaken: Study I assessed the validity of the questionnaire and Study II explored the factor structure of the questionnaire to aid future analyses of the questionnaire variables. Study I was conducted on a small convenience sample (n = 24) during the first few months that the questionnaire was distributed to the SWS participants. To assess the validity of each question, we interviewed participants who had completed the questionnaire and used the interview data as a criterion measure with which to compare the questionnaire data. Conducting interviews with participants allowed them to clarify the meaning of the questions and expand on their answers, giving a richer response to the questions with which to compare their original questionnaire responses. Following initial feedback from Study I, some amendments were made to the questionnaire. The amended version of the questionnaire was then distributed in the SWS and it was this revised version that was used for Study II (a copy of this can be found in additional file 1). Study II (n = 389) was an exploratory factor analysis using principal components analysis (PCA). This analysis focused on the groups of questions in the questionnaire that were thought to reflect pre-determined constructs. Detailed information on the participants, data collection and statistical analyses for the two studies are described below.
Study I: Validity Analysis
Participants and Data Collection
Participants for this study were primarily recruited from the SWS sub-sample attending the four-year visit (n = 20) with additional recruitment of mothers of four-year-old children (n = 4) from another study being conducted around the same time in Cambridgeshire, UK . The inclusion of participants from the latter study was to help recruit a broader mix of people. Ethical approval for data collection in the SWS was obtained from Southampton and South West Hampshire Local Research Ethics Committee and in the Cambridgeshire physical activity study from the Cambridge Research Ethics Committee.
The 20 participants recruited from the SWS were given the questionnaire when they attended a study visit (between September 2005 and February 2006) and asked for their consent to be contacted regarding the validation of the questionnaire. The additional four participants from the Cambridgeshire study were recruited between June and September 2006. Participants received the questionnaire by post and were asked for their consent to be contacted about the validation study on collection of the completed questionnaires. Participants from both studies who consented to being contacted were telephoned by a researcher, within around six weeks (median (inter-quartile range): 6.1 (4.0 to 9.4) weeks), to further inform them about the study and invite them to participate in a telephone interview. The interviews were conducted using a semi-structured schedule designed to cover the same questions as the questionnaire, asked in a similar way. Participants were encouraged to elaborate on their answers and asked for feedback on the layout and phrasing of the questionnaire. Two pilot interviews were conducted before the main data collection and minor revisions were made to the interview schedule following this. Data from these pilot interviews were not included in the present analysis. After obtaining verbal informed consent (on tape), interviews were tape-recorded and fully transcribed. Participants' responses to each question were coded, blind to participants' questionnaire responses, by two researchers independently. For most questions, responses were coded as positive, neutral or negative, although other coding schemes were used for some questions where appropriate (e.g. yes/no). Consensus was reached by discussion in the case of disagreement.
Data on descriptive characteristics of participants' four-year-old children were recorded as part of the original studies they were participating in. In the SWS, height and weight were measured using Leicester height measures and Seca digital scales, respectively. In the Cambridgeshire study, height and weight were measured using a calibrated stadiometer and Tanita TBF-531 scales, respectively. Other descriptive data were gathered with the questionnaire.
Analyses were conducted using Stata version 8.0 (StataCorp LP, College Station, Texas). Descriptive statistics for the sample were calculated for both child and parent characteristics using standard summary statistics as appropriate. The inter-rater agreement for the interview codings and the agreement between the interview codings (agreed on by both authors) and the questionnaire responses for each item were calculated using Cohen's kappa (for nominal categorical variables) or weighted kappa (for ordinal categorical variables). The level of agreement was categorised according to the cut-offs proposed by Landis & Koch  as poor (< 0.00), slight (0.00-0.20), fair (0.21-0.40), moderate (0.41-0.60), substantial (0.61-0.80), or almost perfect (0.81-1.00). As a limitation of Cohen's kappa is that it is dependent on the frequency of different responses , the percentage agreement between the interview and questionnaire responses was also calculated for each item. A cut-off of 66% was used to indicate fair agreement [18, 37].
Study II: Principal components analysis and internal consistency
Participants and Data Collection
Participants for this part of the analyses were those in the SWS sub-sample who attended a study visit between March 2006 and February 2008 and completed the amended version of the questionnaire (n = 398).
Using Stata version 10 (StataCorp LP, College Station, Texas), a PCA was conducted on each group of variables in the questionnaire designed to reflect a particular construct. These included: children's personality and enjoyment of physical activity; child's physical activity preferences; parental support; maternal self-efficacy for social support; parental rules; parental restrictions; barriers to children's physical activity; and the local environment. For each analysis, factors with an eigenvalue less than 1.00 were dropped. Also, any individual variables that had a high percentage of variance (≥ 60%) unexplained by the factors that emerged were removed from the analysis as this suggested that the variable was not well explained by the common factors identified . Variables that were found to have low validity in Study I and had not been revised for the amended version of the questionnaire were also excluded from the PCA.
Factor loadings for variables that remained in the analysis were rotated using varimax (orthogonal) rotation. Variables had to have a loading of 0.30 or greater to be assigned to a factor. For each factor that was identified, a Cronbach's alpha was calculated to assess the internal consistency of the factor. A Cronbach's alpha of ≥ 0.60 was used to indicate acceptable internal consistency [18, 39].
Study I Results
Participant characteristics for Studies I and II
Study I (n = 24)
Study II (n = 398)
Mother's age in years (Mean ± SD)
34.6 ± 4.0
35.0 ± 3.6
Mother's BMI (Median & IQR)
25.1 (22.3 to 29.1)
25.3 (22.5 to 29.4)
Child's BMI (Mean ± SD)
16.0 ± 1.1
16.2 ± 1.8
Gender of 4-year-old (% boys)
House-ownership (% own/buying house)
Age mother finished full-time education (Median & IQR)
19 (16 to 22)
18 (16 to 21)
Father lives in household (% yes)
Ethnicity (% white)
Agreement between questionnaire and interview responses (criterion validity)
Name of factor1
Items with low kappa2 & low % agreement
Child personal factors
Enjoyment of PA
Preference for PA
Does child prefer to play with toys or watch TV
Maternal self-efficacy for social support
Difficult to: take my child out to play when it's cold and wet; play an active game with my child on a busy day
Parental rules & restrictions
Not allowed to run or cycle in the house
Restrictions on playing computer games/using the computer3
Maternal attitudes & perceptions
Importance of child PA
Concern about TV watching
PA compared to siblings
PA compared to peers
Barriers to physical activity
All 1.00 except 1* (perfect)
TV/PC in bedroom
Perceived local environment
I am concerned about 'stranger danger'.
Transport for short trips
Study II Results
399 participants received the new version of the questionnaire between March 2006 and February 2008. One asked to withdraw leaving 398 (99.7%) who returned a completed questionnaire. Characteristics for this sample are given in Table 2. The sample was mostly comparable to the interview sample but a lower proportion of mothers owned their home, lived with the father of their four-year-old and a lower proportion of the four-year-old children were boys. Comparisons of participant characteristics between those included in the analysis (n = 398) and those in the four-year sub sample who attended the visit prior to March 2006 (total n = 419) showed no significant differences in child's gender, child's age or mother's ethnicity.
Factor structure of pre-determined constructs in the questionnaire
% variance explained
Child personality/PA enjoyment
Describe child as physically active, child enjoys physical activity
Describe child as restless and as well-behaved (reversed)
Variables removed 2 : describe child as outgoing
Encourage child to do PA; do PA with child; provide transport to places where child can do PA; watch child participate in PA
Variables removed 2 : tell child PA is good for health
Maternal self-efficacy for social support (Difficult to...)
Encourage child to go outside and play; encourage child to play active game instead of watch TV; play active game with child at weekend
Variables removed 2 : take child outside to play when it is hot; play active game with child when feeling tired
Parental rules (Child can...)
Watch TV at meal times; go to bed when they want to; eat snacks while watching TV
Play ball games in the house; run or ride a tricycle/scooter in the house
Play in the park/playground with older children
Variables removed: play in the garden without adult supervision 3
Restrict child's computer use; restrict child playing computer games
Variables removed 2 : restrict child playing outside; restrict child's TV viewing
Barriers to PA
Child is not interested in the activity; weather is too bad; I am too busy; scared child will get hurt
Fees for clubs/swimming pools are too high; difficult to get to PA places; no play areas/parks near home; no other children for child to play with
Variables removed 2 : child lacks skills to do PA; no adult available to supervise child
Other children near home who child can play with; play areas, parks or gyms close to home where child can play
Heavy traffic on local streets; concerned about road safety in area
Variables removed2: somewhere at home where child can play outside3; public transport is limited in our area.
One variable in the parental support construct had a high unexplained variance suggesting that it did not fit with the other parent support variables and should be analysed as an individual variable. The remaining items in the parental support construct, however, all loaded onto one factor which had good internal consistency. Two maternal self-efficacy variables and two barriers variables were also excluded from the PCA on these constructs due to having a high unexplained variance. The remaining variables in each of these constructs were found to load onto one factor and both had acceptable internal consistency.
For the questions on parental restrictions, those relating to restricting children playing outside and restricting children's television viewing were found to have a high unexplained variance and therefore were not part of the rest of the construct. Removal of these variables made a PCA analysis on the remaining 'restriction' variables redundant as only two variables remained. These variables combined had acceptable internal consistency (see Table 4).
The questions on parental rules were initially found to load onto three factors, however, the third factor had a low Cronbach's alpha (α = 0.16). One of the variables in the third factor was found to have little variation in responses (88.8% were in one answer category) and this is likely to have contributed to the low Cronbach's alpha. Re-running the analysis without this variable produced the same three factors, with the third factor now only containing a single variable. These results suggest that a two-factor structure is more appropriate for these questions in this dataset with the variable in the third factor being treated as an individual item. Similar results were found for the questions on the local environment. Although three factors were initially identified, the third factor had a low Cronbach's alpha (α = 0.12) and was found to contain a variable with limited variability (87.2% were in one answer category). When analyses were re-run without this variable, a two-factor structure emerged, with the remaining variable from the original third factor having a high unexplained variance by these two factors (see Table 4). This suggests that the latter should be treated as a separate variable in analyses.
Valid and reliable measures of physical activity correlates in young children are lacking but are needed if we are to understand which factors might be usefully targeted in interventions to promote physical activity in this age group. The studies presented in this paper investigated the validity, factor structure and internal consistency of a maternal questionnaire on the correlates of physical activity in four-year-old children. The first study showed that there was reasonable agreement between most of the questionnaire items and responses to the same or similar questions given during telephone interviews, providing some evidence that the questionnaire is valid. Further evidence of validity was shown from the PCA in Study II which identified eight factors with acceptable internal consistency that reflected different constructs within the questionnaire. Together these results suggest that, with some minor revisions, this questionnaire could be a useful tool for measuring potential correlates of preschool children's physical activity.
Child personal factors
Despite the mixed kappa scores, the agreement between the questionnaire and interview responses regarding child personal factors was generally good indicating reasonable validity of these questions. The one question in this domain that performed less well was the question regarding whether children preferred to watch television or play with their toys. Several interview participants commented that their child often did these activities at the same time, making it difficult to answer this question. The question might therefore need to be rephrased in some way to reflect this. This question has previously been used in older children  and it might be more appropriate in older age groups where children are able to report their own preferences. The PCA identified two factors from the questions on child personality and enjoyment of physical activity while whether or not mothers described their child as outgoing did not seem to be part of either factor. It may be that this item should stand alone in analyses but it is also possible that the inclusion of more items within the personality construct might show that this individual variable is part of another composite factor not addressed by the current questions.
The main focus of the questionnaire was on potential parental influences on preschool children's physical activity. The majority of these questions had high agreement between the interview and questionnaire responses with the low kappa scores tending to correspond to variables with little variation. These results provide good evidence of the validity of these items. Four items, however, had poor validity. The low agreement for the question on mothers' self-efficacy for taking their child out to play when it was cold and wet may be explained by the participants who commented in the interview that this question was not really applicable as they would not take their child out to play in this weather. The question therefore perhaps needs to be rephrased to only cover cold weather rather than cold and wet weather. The poor agreement for mothers' self-efficacy for playing an active game with their child on a busy day was due to participants reporting greater difficulty in doing this in the questionnaire than during the interview, however, it is not clear why this was the case. The question is fairly broad therefore perhaps revising it to be more specific could help improve its validity. The revision of the question relating to whether children were allowed to run or cycle in the house to whether children were allowed to run or ride a tricycle in the house, based on feedback from the interviews, is likely to have improved the validity of this question. Similarly, the addition of a non-applicable option to the questions on restricting children's computer use is thought to have increased the validity of these questions.
The finding that the questions on parental support generally reflected one construct is supported by findings from Saunders et al  who identified one factor representing both parent and peer support in a principal components analysis of a questionnaire designed for fifth grade (10-11 year-old) children. A confirmatory factor analysis by Ommundsen et al , however, suggested that parental support questions were better divided into two factors: parental encouragement and parental social support. The sample in this latter study consisted of both children (aged 9-10 years) and adolescents (aged 15-16 years) and it may be that the factor structure of these questions differs for younger children. Previous research on the association between parental support and preschool children's physical activity has mostly focused specifically on parental encouragement and persuasion . Further research is therefore needed on the factor structure of a broader range of parental support questions relating to preschool children to confirm the findings reported in the analysis in this paper.
A single factor also emerged from the PCA of the questions on maternal self-efficacy for social support, however, two questions had a high unexplained variance by this factor suggesting that they do not belong to the same construct. Some studies that have investigated the factor structure of questions on children's or adolescents' self-efficacy for physical activity have reported that these questions load onto one factor [19, 42] while one study that included a greater number of questions (17 compared with < 10) reported a three-factor structure for self-efficacy questions . It may therefore be the case that the two maternal self-efficacy questions in this analysis found to have a high unexplained variance by the factor structure identified might reflect other factors relating to maternal self-efficacy that more questions would help uncover.
The parental rules questions were found to load onto three underlying factors, two relating to indoor rules and one relating to outdoor rules (consisting of one variable). Sallis et al  reported independent associations between indoor and outdoor rules and preschool children's physical activity, supporting the breakdown of parental rules into more than one factor. However, the fact that two of the rules factors in this analysis related to indoor rules suggests that the rules construct can be broken down further. This implies that different types of rules may reflect different constructs and these could potentially be differentially associated with preschool children's physical activity. It is therefore important that rules-related questions are not simply combined into one composite factor as this could result in associations with physical activity being missed. Similar results were found for the questions on parental restrictions, with restrictions on television watching, computer use and computer game playing, and playing outside being identified as three separate variables, respectively.
Barriers to preschool children's physical activity
The barriers questions all had relatively low kappa scores, ranging from poor to fair, but the percentage agreement was generally high providing evidence that these questions are reasonably valid. The finding that these barriers questions reflected several underlying factors is supported by the results of a confirmatory factor analysis of a questionnaire on psychosocial correlates of physical activity in adolescents which also found barriers to physical activity to consistent of several different factors . As with parental rules and restrictions, this suggests that there are different types of barriers to physical activity which may be differentially associated with children's physical activity and should therefore be assessed as separate constructs.
Home and local environment
All of the home environment questions had good agreement between the interview and questionnaire responses indicating good validity. The local environment questions also generally had good agreement but one question regarding concern about 'stranger danger' was found to have poor validity. Some participants said in the interview that 'stranger danger' was not a concern to them as their child never went out without an adult. However, most of these participants indicated in the questionnaire that stranger danger was a concern, possibly suggesting that their responses to the questionnaire were more about general concerns while in the interview they responded specifically about their concern for their child. There may also have been some effect of social norms where participants felt that they should be concerned about strangers but felt comfortable expressing no concern about strangers in the interview when they could explain their reasons for this. Rewording this question or the response categories to this question in light of this could therefore help improve its validity.
The finding that different aspects of the local environment reflect different constructs is supported by the results of a study of 11-year-old children's perception of the physical activity environment, which found good internal consistency for scores on neighbourhood safety and the neighbourhood social environment . This emphasises the need to have a range of questions that cover different potential influences in the local environment so that all underlying constructs are captured.
An issue that arose in both studies presented in this paper was the limited variation in responses for some variables. In the PCA, this issue affected the Cronbach's alpha of some of the factors identified and may have impacted on the factor loadings for the variables with limited variation. In the validity assessment, this issue is likely to have contributed to some of the low kappas, such as those for whether there is a garden at home where the child can play (88% of interview participants answered positively), car ownership (100% had a car), and whether the child's physical activity is important (91% of interview participants answered positively). As a result, greater weight was given to the percentage agreement between the interview and questionnaire responses than to the kappa values. Although kappa statistics are generally preferred over percentage agreement as they reflect the level of agreement after taking chance into account, the low variability in responses in this dataset limits the stability of the kappa statistic. Basing the results of the validity analysis on the kappa values may therefore be misleading.
Strengths and Limitations
The validation of measures of physical activity correlates in children is hampered by the lack of a 'gold standard' with which to compare the new measure. One option is to compare the questionnaire responses to a physical activity outcome therefore measuring the predictive validity of the questionnaire. However, we felt that this approach was not appropriate for the current study as our aim was to assess how well the questionnaire measured the potential correlates of physical activity that we were trying to measure, not assess whether these questionnaire items were indeed associated with children's physical activity. We therefore chose to investigate the criterion validity of the questionnaire by comparing the questionnaire responses to responses given in a telephone interview. Interviews have previously been used to validate questionnaires that assess health states or behaviours [44, 45] and the literature on qualitative interviewing highlights the use of interviews to gain more in-depth responses than those achieved from survey questions. Using telephone interviews as the criterion measure was therefore a strength of this study as they gave greater insight into participants' answers and provided important feedback, aiding the revision of questions that performed less well in the analyses. However, there are some limitations of this validation approach, such as the questionnaire and interview data coming from the same source making it likely that there is correlated error between the two measures. Also, there is the possibility of interviewer and interpretation bias, although attempts were made to minimise the former by conducting two pilot interviews and the latter by double-coding the interview responses, independently of the questionnaire responses.
The large number and variety of potential correlates covered in the questionnaire being validated were strengths of this study. It is important to acknowledge that the sample for the validity assessment was small and not fully representative of the larger sample in Study II. The larger sample used in Study II, however, was comparable to the rest of the four-year SWS sub-sample seen for a visit before March 2006 and to the population of Southampton as a whole in terms of ethnicity. This implies that the results of the studies are applicable to the target study population.
This paper has shown that a maternal questionnaire on the correlates of young children's physical activity has reasonable validity overall and acceptable internal consistency for most of the factors identified from the principal components analysis. With some minor revisions, this questionnaire might be a useful tool for investigating physical activity correlates in young children in populations with similar characteristics to the study population. Further analyses are needed to show how generalisable these results are to other populations and to explore whether the factors measured by the questionnaire are associated with preschool children's physical activity.
The Southampton Women's Survey and the Cambridgeshire physical activity study were both funded by the Medical Research Council. The authors would like to thank Lyn Greenaway and the rest of the Southampton Women's Survey Study Team for their involvement in participant recruitment and data collection. The authors would also like to thank Kirsten Corder and Alice Tompson for their help with participant recruitment and data collection in the Cambridgeshire physical activity study and Stephen Sharp for his advice on the statistical analyses. Lastly, the help and contribution made by the mothers who participated in this study was invaluable and greatly appreciated.
- Flynn MAT, McNeil DA, Maloff B, Mutasingwa D, Wu M, Ford C, Tough SC: Reducing obesity and related chronic disease risk in children and youth: a synthesis of evidence with 'best practice' recommendations. Obes Rev. 2006, 7: 7-66. 10.1111/j.1467-789X.2006.00242.x.View ArticleGoogle Scholar
- Biddle SJ, Gorely T, Stensel DJ: Health-enhancing physical activity and sedentary behaviour in children and adolescents. J Sports Sci. 2004, 22: 679-701. 10.1080/02640410410001712412.View ArticleGoogle Scholar
- Brage S, Wedderkopp N, Ekelund U, Franks P, Wareham N, Andersen L: Features of the metabolic syndrome are associated with objectively measured physical activity and fitness in Danish children. Diabetes Care. 2004, 27: 2141-2148. 10.2337/diacare.27.9.2141.View ArticleGoogle Scholar
- Andersen LB, Harro M, Sardinha LB, Froberg K, Ekelund U, Brage S, Anderssen SA: Physical activity and clustered cardiovascular risk in children: a cross-sectional study (The European Youth Heart Study). Lancet. 2006, 368: 299-304. 10.1016/S0140-6736(06)69075-2.View ArticleGoogle Scholar
- Duncan MJ, Al-Nakeeb Y, Woodfield L, Lyons M: Pedometer determined physical activity levels in primary school children from central England. Prev Med. 2007, 44: 416-420. 10.1016/j.ypmed.2006.11.019.View ArticleGoogle Scholar
- Sanchez A, Norman GJ, Sallis JF, Calfas KJ, Cella J, Patrick K: Patterns and correlates of physical activity and nutrition behaviors in adolescents. Am J Prev Med. 2007, 32: 124-130. 10.1016/j.amepre.2006.10.012.View ArticleGoogle Scholar
- Pate RR, Baranowski T, Dowda M, Trost SG: Tracking of physical activity in young children. Med Sci Sports Exerc. 1996, 28: 92-96. 10.1097/00005768-199601000-00019.View ArticleGoogle Scholar
- Iannotti RJ, Sallis JF, Chen R, Broyles SL, Elder JP, Nader PR: Prospective analyses of relationships between mothers' and children's physical activity. J Phys Act Health. 2005, 2: 16-34.Google Scholar
- van Sluijs EMF, McMinn AM, Griffin SJ: Effectiveness of interventions to promote physical activity in children and adolescents: systematic review of controlled trials. BMJ. 2007, 335: 703-707. 10.1136/bmj.39320.843947.BE.View ArticleGoogle Scholar
- Hinkley T, Crawford D, Salmon J, Okely AD, Hesketh K: Preschool Children and Physical Activity: A Review of Correlates. Am J Prev Med. 2008, 34: 435-441. 10.1016/j.amepre.2008.02.001.View ArticleGoogle Scholar
- Dunton GF, Jamner MS, Cooper DM: Assessing the perceived environment among minimally active adolescent girls: validity and relations to physical activity outcomes. Am J Health Promot. 2003, 18: 70-73.View ArticleGoogle Scholar
- Evenson KR, Birnbaum AS, Bedimo-Rung AL, Sallis JF, Voorhees CC, Ring K, Elder JP: Girls' perception of physical environmental factors and transportation: reliability and association with physical activity and active transport to school. Int J Behav Nutr Phys Act. 2006, 3: 28-10.1186/1479-5868-3-28.View ArticleGoogle Scholar
- Motl RW, Dishman RK, Trost SG, Saunders RP, Dowda M, Felton G, Ward DS, Pate RR: Factorial validity and invariance of questionnaires measuring social-cognitive determinants of physical activity among adolescent girls. Prev Med. 2000, 31: 584-594. 10.1006/pmed.2000.0735.View ArticleGoogle Scholar
- Norman GJ, Sallis JF, Gaskins R: Comparability and reliability of paper- and computer-based measures of psychosocial constructs for adolescent physical activity and sedentary behaviours. Res Q Exerc Sport. 2005, 76: 315-323.View ArticleGoogle Scholar
- Motl RW, Dishman RK, Felton G, Pate RR: Self-motivation and physical activity among black and white adolescent girls. Med Sci Sports Exerc. 2003, 35: 128-136. 10.1097/00005768-200301000-00020.View ArticleGoogle Scholar
- Motl RW, Dishman RK, Saunders RP, Dowda M, Felton G, Pate RR: Measuring enjoyment of physical activity in adolescent girls. Am J Prev Med. 2001, 21: 110-117. 10.1016/S0749-3797(01)00326-9.View ArticleGoogle Scholar
- Wu T, Ronis DL, Pender N, Jwo J: Development of questionnaires to measure physical activity cognitions among Taiwanese adolescents. Prev Med. 2002, 35: 54-64. 10.1006/pmed.2002.1049.View ArticleGoogle Scholar
- Hume C, Ball K, Salmon J: Development and reliability of a self-report questionnaire to examine children's perceptions of the physical activity environment at home and in the neighbourhood. Int J Behav Nutr Phys Act. 2006, 3: 16-10.1186/1479-5868-3-16.View ArticleGoogle Scholar
- Sherwood NE, Taylor WC, Treuth M, Klesges LM, Baranowski T, Zhou A, Pratt C, McClanahan B, Robinson TN, Pruitt L, Miller W: Measurement characteristics of activity-related psychosocial measures in 8- to 10-year-old African-American girls in the Girls health Enrichment Multisite Study (GEMS). Prev Med. 2004, 38: S60-S68. 10.1016/j.ypmed.2003.12.030.View ArticleGoogle Scholar
- Saunders RP, Pate RR, Felton G, Dowda M, Weinrich MC, Ward DS, Parsons MA, Baranowski T: Development of questionnaires to measure psychosocial influences on children's physical activity. Prev Med. 1997, 26: 241-247. 10.1006/pmed.1996.0134.View ArticleGoogle Scholar
- Raustorp A, Stahle A, Gudasic H, Kinnunen A, Mattsson E: Physical activity and self-perception in school children assessed with the Children and Youth - Physical Self-Perception Profile. Scand J Med Sci Sports. 2005, 15: 126-134. 10.1111/j.1600-0838.2004.406.x.View ArticleGoogle Scholar
- Stevens J, Cornell CE, Story M, French SA, Levin S, Becenti A, Gittelsohn J, Going SB: Development of a questionnaire to assess knowledge, attitudes and behaviors in American Indian children. Am J Clin Nutr. 1999, 69: 773S-781S.Google Scholar
- Ward DS, Saunders RP, Pate RR: The role of theory in understanding physical activity behavior. Physical Activity Interventions in Children and Adolescents. Edited by: Ward DS, Saunders RP, Pate RR. 2007, Champaign: Human Kinetics, 21-41.Google Scholar
- Dishman RK, Motl RW, Saunders RP, Dowda M, Felton G, Ward DS, Pate RR: Factorial invariance and latent mean structure of questionnaires measuring social-cognitive determinants of physical activity among black and white adolescent girls. Prev Med. 2002, 34: 100-108. 10.1006/pmed.2001.0959.View ArticleGoogle Scholar
- Inskip HM, Godfrey KM, Robinson SM, Law CM, Barker DJP, Cooper C, SWS Study Group: Cohort profile: The Southampton Women's Survey. Int J Epidemiol. 2006, 35: 42-48. 10.1093/ije/dyi202.View ArticleGoogle Scholar
- Salmon J, Telford A, Crawford D: The Children's Leisure Activities Study (CLASS): Summary report. 2004, Melbourne: Centre for Physical Activity and Nutrition Research, Deakin UniversityGoogle Scholar
- Riddoch C, Edwards D, Page A, Froberg K, Anderssen SA, Wedderkopp N, Brage S, Cooper AR, Sardinha LB, Harro M, Klasson Heggebø L, van Mechelen W, Boreham C, Ekelund U, Andersen L, team at EYHS 2005: The European Youth Heart Study - Cardiovascular Disease Risk Factors in Children: Rationale, Aims, Study Design, and Validation of Methods. J Phys Act Health. 2005, 2: 115-129.Google Scholar
- Wareham NJ, Jakes RW, Rennie KL, Mitchell J, Hennings S, Day NE: Validity and repeatability of the EPIC-Norfolk Physical Activity Questionnaire. Int J Epidemiol. 2002, 31: 168-174. 10.1093/ije/31.1.168.View ArticleGoogle Scholar
- Trost SG, Sallis JF, Pate RR, Freedson PS, Taylor WC, Dowda M: Evaluating a model of parental influence on youth physical activity. Am J Prev Med. 2003, 25: 277-282. 10.1016/S0749-3797(03)00217-4.View ArticleGoogle Scholar
- Sallis JF, Alcaraz JE, McKenzie TL, Hovell MF: Predictors of change in children's physical activity over 20 months: Variations by gender and level of adiposity. Am J Prev Med. 1999, 16: 222-229. 10.1016/S0749-3797(98)00154-8.View ArticleGoogle Scholar
- Christakis DA, Ebel BE, Rivara FP, Zimmerman FJ: Television, video, and computer game usage in children under 11 years of age. J Pediatr. 2004, 145: 652-656. 10.1016/j.jpeds.2004.06.078.View ArticleGoogle Scholar
- Sallis JF, Taylor WC, Dowda M, Freedson PS, Pate RR: Correlates of vigorous physical activity for children in grades 1 through 12: comparing parent-reported and objectively measured physical activity. Pediatr Exerc Sci. 2002, 14: 30-44.Google Scholar
- Wareham NJ, Jakes RW, Rennie KL, Schuit J, Mitchell J, Hennings S, Day NE: Validity and repeatability of a simple index derived from the short physical activity questionnaire used in the European Prospective Investigation into Cancer and Nutrition (EPIC) study. Public Health Nutr. 2003, 6: 407-413. 10.1079/PHN2002439.View ArticleGoogle Scholar
- Corder K, van Sluijs EMF, Wright A, Whincup P, Wareham NJ, Ekelund U: Is it possible to assess free-living physical activity and energy expenditure in young people by self-report?. Am J Clin Nutr. 2009, 89: 862-870. 10.3945/ajcn.2008.26739.View ArticleGoogle Scholar
- Landis JR, Koch GG: The Measurement of Observer Agreement for Categorical Data. Biometrics. 1977, 33: 159-174. 10.2307/2529310.View ArticleGoogle Scholar
- Chinn S, Burney PGJ: On Measuring Repeatability of Data from Self-Administered Questionnaires. Int J Epidemiol. 1987, 16: 121-127. 10.1093/ije/16.1.121.View ArticleGoogle Scholar
- Portney L, Waktins M: Foundations of Clinical Research: Applications to Practice. 2000, Upper Saddle River, New Jersey: Prentice-Hall, 2Google Scholar
- StataCorp: Stata Multivariate Statistics Reference Manual: Release 10. 2007, College Station, Texas: Stata PressGoogle Scholar
- Sim J, Wright C: Research in Health Care: Concepts, Designs and Methods. 2000, Cheltenham: Stanley Thornes LtdGoogle Scholar
- Neighbourhood Statistics. [http://www.neighbourhood.statistics.gov.uk/dissemination/LeadHome.do]
- Ommundsen Y, Page A, Po-Wen K, Cooper AR: Cross-cultural, age and gender validation of a computerised questionnaire measuring personal, social and environmental associations with children's physical activity: The European Youth Heart Study. Int J Behav Nutr Phys Act. 2008, 5: 29-10.1186/1479-5868-5-29.View ArticleGoogle Scholar
- Pirasteh A, Hidarnia A, Asghari A, Faghihzadeh S, Ghofranipour F: Development and validation of psychosocial determinants measures of physical activity among Iranian adolescent girls. BMC Public Health. 2008, 8: 150-10.1186/1471-2458-8-150.View ArticleGoogle Scholar
- Sallis JF, Nader PR, Broyles SL, Berry CC, Elder JP, McKenzie TL, Nelson JA: Correlates of physical activity at home in Mexican-American and Anglo-American preschool children. Health Psychol. 1993, 12: 390-398. 10.1037/0278-6184.108.40.2060.View ArticleGoogle Scholar
- Landkroon AP, de Weerd S, van Vliet-Lachotzki E, Steegers EA: Validation of an internet questionnaire for risk assessment in preconception care. Public Health Genomics. 2009.Google Scholar
- Donker T, van Straten A, Marks I, Cuijpers P: A brief web-based screening questionnaire for common mental disorders: development and validation. J Med Internet Res. 2009, 11: e19-10.2196/jmir.1134.View ArticleGoogle Scholar
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.