Skip to main content
Download PDF
Download ePub

Item response modeling: a psychometric assessment of the children’s fruit, vegetable, water, and physical activity self-efficacy scales among Chinese children

International Journal of Behavioral Nutrition and Physical Activity volume 14, Article number: 126 (2017) Cite this article

Abstract

Background

This study aimed to evaluate the psychometric properties of four self-efficacy scales (i.e., self-efficacy for fruit (FSE), vegetable (VSE), and water (WSE) intakes, and physical activity (PASE)) and to investigate their differences in item functioning across sex, age, and body weight status groups using item response modeling (IRM) and differential item functioning (DIF).

Methods

Four self-efficacy scales were administrated to 763 Hong Kong Chinese children (55.2% boys) aged 8-13 years. Classical test theory (CTT) was used to examine the reliability and factorial validity of scales. IRM was conducted and DIF analyses were performed to assess the characteristics of item parameter estimates on the basis of children’s sex, age and body weight status.

Results

All self-efficacy scales demonstrated adequate to excellent internal consistency reliability (Cronbach’s α: 0.79-0.91). One FSE misfit item and one PASE misfit item were detected. Small DIF were found for all the scale items across children’s age groups. Items with medium to large DIF were detected in different sex and body weight status groups, which will require modification. A Wright map revealed that items covered the range of the distribution of participants’ self-efficacy for each scale except VSE.

Conclusions

Several self-efficacy scales’ items functioned differently by children’s sex and body weight status. Additional research is required to modify the four self-efficacy scales to minimize these moderating influences for application.

Background

The alarming rates of chronic diseases have been attributed to dietary habits and physical activity (PA) patterns [1, 2]. Increasing fruit and vegetable consumption, replacing sweetened beverages with water, and engaging in sufficient PA facilitate chronic disease prevention [3]. Furthermore, the dietary and PA practices tend to initiate and develop during childhood at which time it is desired to foster healthier habits [4].

Self-efficacy, a central component of Bandura’s social cognitive theory, is concerned with people’s beliefs and capabilities to perform or maintain actions at designated levels and has been advanced as an important individual determinant of human behavior [5]. Perceived self-efficacy for fruit, vegetable, and water intakes and PA were strong predictors of corresponding behaviors [6, 7] and key variables mediating change from interventions [8, 9]. Increasing self-efficacy has been adopted as an effective intervention strategy [10,11,12]. Questionnaires on self-efficacy for fruit (FSE), vegetable (VSE), and water intakes (WSE), and PA (PASE) in existing studies have varied in numbers and types of items, subscales and psychometric characteristics. For example, PASE was measured by a 8-item PASE [13,14,15] developed by Motl and colleagues [16] or a modified version [17], while other studies [18, 19] used the scale developed by Saunders et al. [20], or self-constructed questionnaires [12, 21]. While, some of these self-efficacy scales showed acceptable/adequate internal consistency (Cronbach’s alpha coefficient (α) higher than 0.70) and test-retest reliability (TRT larger than 0.60) [13,14,15,16,17,18,19,20], others did not [22].

Valid and reliable measures are needed to test the associations between self-efficacy and behavior and to examine the possible mediating effect of self-efficacy in behavior change programs. Levels of self-efficacy have been reported to be significantly different by children’s sex, age, and body weight status [23,24,25]. True differences in the validity of the measurement scale may make it difficult to compare parameter estimates across these different groups when comparing the results across studies. Furthermore, understanding the group-related differences in item validity across demographic or body weight status groups could help design interventions tailored to specific items in different groups and thereby enhance program effectiveness.

Classical test theory (CTT), the traditional method for evaluating scales, is sample-dependent, and thereby cannot assess the functioning of item responses across different groups. Item response modeling (IRM) is a psychometric analysis method that provides model-based measurements. IRM links the individuals’ difficulty of response to each item, provides the distribution of respondents across the scale, and enables differential item functioning (DIF) analysis [26]. While, item functioning of children’s FSE and VSE has been evaluated by sex and ethnic groups in American children [27], no one has analyzed item functioning across age and body weight status groups for FSE and VSE, nor conducted this kind of analysis for WSE and PASE, nor among Chinese children.

This study evaluated the psychometric properties of FSE, VSE, WSE, and PASE and investigated item differences in their psychometric properties across sex, age, and body weight status groups using IRM and DIF.

Methods

Participants

The sample was from the validation study of the Physical Activity Questionnaire for Older Children among Chinese children [28]. Children (n = 798, 55.8% males) aged 8-13 years old were recruited from six Hong Kong primary schools that agreed to participate in the study. The schools were located in different administrative districts with varied socio-economic status (SES) (two from high SES, one from medium SES, and three from low SES districts) according to local statistics [29]. Students were excluded if they had any contraindication to participating in PA or eating a normal diet. A subsample of 94 children (54.3% males) was randomly selected to complete the questionnaires twice within 7-10 days to assess the scale test-retest reliability. The ethic committee of Hong Kong Baptist University approved this study.

Measures

A standard translation and back translation procedure was used with three bilingual language speakers (i.e., English and Cantonese). Minor wording revisions were made according to cognitive interviewing feedback from five primary students to ensure that target children could understand the instructions and items. All participants completed the questionnaire set in schools under the administration of research assistants.

Body weight status

Children’s height and weight, measured by physical education teachers, were retrieved from the latest school records. Height was measured to the nearest 0.1 cm and weight was measured to the nearest 0.1 kg. Body mass index (BMI, kg/m2) was calculated as weight in kilograms divided by height in meters squared. According to international age- and sex- specific cutoff points, body weight status of participating children were classified into underweight [30], healthy, overweight and obese [31] groups based on their BMI values.

Self-efficacy for fruit (FSE), vegetable (VSE) and water (WSE)

Validated self-efficacy scales for fruit, vegetable and water intakes were used to assess children’s FSE, VSE and WSE [32]. The scales consisted of 12, 8, and 5 items with dichotomous “sure” and “not sure” response categories and demonstrated acceptable internal consistency for FSE (α = 0.75) and VSE (α = 0.70) and marginal level of internal consistency for WSE (α = 0.55) in an American sample [32]. Construct validity was assessed through correlation among the self-efficacy scores and fruit and vegetable consumption, preferences and outcome expectancies (r = 0.10-0.21) [32]. Each item of the self-efficacy scales asked about the participant’s confidence in consuming fruit, vegetables or water under diverse circumstances. A FSE sample item included “How sure are you that you can eat 1 portion of fruit for a snack at home at least four days a week?” A VSE sample item included: “How sure are you that you can eat 3 portions of vegetables at least 4 days a week?” A WSE sample item included “How sure are you that you can drink 4 glasses or bottles of water for at least one day?” Considering item response difficulty, all items featured three response options in this study (1 = I am not sure; 2 = I am a little bit sure; 3 = I am very sure). The internal consistency in this sample was 0.86, 0.85, 0.79 for FSE, VSE, and WSE, respectively.

Self-efficacy for physical activity (PASE)

Children’s PASE was assessed by a validated Physical Activity Self-efficacy scale [33]. The scale had 12 items and demonstrated adequate internal consistency (α = 0.81) in the original validation study [33]. Weak but comparable correlations (r = 0.09-0.11) were found between PASE and minutes of moderate- to vigorous- activity. Similar to the FSE, VSE and WSE, children responded how sure they were that they could engage in PA in various conditions with a 3-response category (1 = I am not sure; 2 = I am sure a little; 3 = I am sure a lot). Sample items included “How sure are you that you can be physically active more than 30 minutes for at least 4 days a week, even when the weather outside is bad?” “How sure are you that you can ask your friends to be physically active with you more than 30 minutes for at least 4 days a week?” The scale in this sample presented excellent internal consistency (α = 0.91).

Statistical analyses

Classical test theory (CTT)

First, CTT was used to evaluate the scales and item characteristics using SPSS 20.0 (IBM, Chicago, IL, USA). Item means were calculated to assess item difficulty. Cronbach’s alpha coefficient (α) was computed to assess scale internal consistency; values greater than 0.70 are deemed acceptable for general research purposes [34]. Item discrimination was evaluated using corrected item total correlations (CITC) that were calculated by the correlation coefficients between the scores on the item and the sum of scores of all the other items in a scale. Poorly discriminating items were identified with CITC lower than 0.30 [35]. The intraclass correlation coefficient with a two-way random model was computed to determine test-retest reliability; a minimum threshold of 0.70 was considered adequate [36].

Item response modeling (IRM)

Exploratory factor analysis was used to examine the primary assumption of IRM, unidimensionaltiy, for each subscale. The assumption of unidimensionalty was met if the scree plots showed one dominant factor, the first factor explained at least 20% of scale variance, and the factor loadings were >0.30 [37].

IRM models illustrate respondents’ latent trait based on their patterns of item responses. Both respondents’ trait levels and items’ psychometric properties are specified in IRM models. The degree of difficulty in agreeing with an item or endorsing a category is modeled as a function of person trait and item parameters. There are different mathematical forms of item characteristic functions and the number of parameters estimated for IRM models, but all IRM models include one or more item parameters to describe the probability of a certain score on an item, given a person’s latent traits [38, 39].

Polytomous IRM models, are used when items present multiple response choices, such as in attitude surveys and personality assessment tests [40, 41]. Only polytomous models are discussed here because the self-efficacy scale items present three response categories. Polytomous models model the probability for any item of endorsing one response category over another. Polytomous models include additional parameters, referred to as category boundary, threshold parameter or step difficulty which indicate the probabilities of responding at or above a given category. For an item with k response options, there are k–1 thresholds between the response options. For example, an item with three response options (I am not sure, I am a little bit sure, and I am very sure) will require two threshold estimates: (1) the step from “I am not sure” to “I am a little bit sure”, and (2) from “I am a little bit sure” to “I am very sure”, One goal of fitting a polytomous model is to determine the location of such thresholds along the latent trait continuum.

Due to the number of the subscales and responses, multidimensional polytomous models, was selected to assess respondents’ latent traits. Two polytomous models were considered: the partial credit (PCM) [42] and the rating scale models (RSM) [43, 44]. RSM is a special case of the PCM where the response scale is fixed for all items. That is, the response threshold parameters are assumed to be identical across items. For the present study, the final choice of a model was determined by comparing the deviance of the two competing multidimensional polytomous models using a Chi-square test.

Item fit was evaluated using infit and outfit mean square item fit indices (MNSQ) which have non-negative values. Infit is an information-weighted form of outfit. Infit MNSQ (information-weighted fit statistic) and outfit MNSQ (outlier-sensitive fit statistic) are based on information-weighted sum of squared standardized residuals and non-weighted sum of squared standardized residuals, respectively [45]. An infit or outfit MNSQ value of around one suggests the observed variance is similar to the expected variance. Mean square values greater than one or smaller than one indicate the observed variance is greater or smaller than expected, respectively. Infit or outfit MNSQ values greater than 1.3 indicate poor item fit when sample size is smaller than 500 [46]. With respect to thresholds, outfit MNSQ values greater than 2.0 indicate misfits, identifying candidates for collapsing with a neighboring category [45, 47].

Item-person maps, often called Wright maps (with units referred to as log odds), present both the distributions of scale items with that of the respondents on the same scale. Person, item and threshold estimates were placed in the same map where “x” on the left side represented the distribution of person trait estimates along the self-efficacy continuum with the student scoring the highest self-efficacy placed at the top of the figure. Item and threshold difficulties were presented on the right side, with the more difficult response items and categories placed at the top. I k denotes threshold k for item I.

Differential item functioning (DIF)

Participants with the same underlying trait level may have different probabilities of endorsing an item. DIF is an indicator when an item performed differently between groups of individuals. For example, a finding of DIF by sex means that a male and a female with the same latent trait level responded differently to an item, indicating that the respondents’ interpretation of the item differed for men and women.

DIF was assessed by adding a group main effect and an item-by-group interaction term to the model [27, 48,49,50]. Whether an overall scale demonstrated DIF was indicated by a significant chi-square for the item-by-group interaction term. The ratio of the item-by-group parameter estimates to the corresponding standard error identified which items displayed DIF. DIF was indicated when the estimate to standard error ratio exceeded 1.96. The magnitude of DIF was determined by examining the differences of the item-by-group interaction parameter estimates. Because the sum of the parameters was constrained to be zero, if only two groups were considered, the magnitude of DIF difference was twice the estimates of the first reference group. For example, the estimate of the sex by item effect for Item 1 for males was −0.2, and then the estimate of the group by item effect for Item 1 for females was 0.2. The difference in item difficulty between older and younger children was −0.4. If comparison was made among three or more groups, the magnitude of DIF was the differences in estimates of the corresponding groups. Items that displayed statistically significant DIF were placed into one of three categories depending on the effect size: small DIF (difference < 0.426), intermediate DIF (0.426 < difference < 0.638), and large DIF (difference > 0.638) [51, 52]. ACER ConQuest [53] was used for all IRM analyses.

Results

Descriptive statistics

Participants’ characteristics are shown in Table 1. Thirty-five children (4.4%) did not complete any of the items and were excluded from analyses, resulting in a sample of 763 children with 55.2% boys. Participants were classified into younger children aged 8-10 years (43.5%) and older children aged 11-13 years (56.5%). Body weight status was categorized into three groups with 96 (13.1%) underweight children, 417 (56.8%) children with healthy weight, and 221 (30.1%) overweight/obese children.

Table 1 Participants’ characteristics (N = 763)
Full size table

Classical test theory (CTT)

The percentages of variance explained by the one-factor solution were 39.7%, 49.0%, 54.5% and 49.7% for FSE, VSE, WSE and PASE, respectively. Each scree plot revealed one dominant factor and factor loadings were higher than 0.30 for all the scales.

As presented in Table 2, CTT revealed that item difficulty (item means) ranged from 1.51 (0.76) to 2.59 (0.65) based on the scale ranging from 1 to 3, indicating that on average the responses were moderately difficult to agree with. Internal consistencies were excellent for PASE (α = 0.91), good for FSE (α = 0.86) and VSE (α = 0.85), and adequate for WSE (α = 0.79). CITCs were acceptable to high (0.40 to 0.74). The test-retest reliabilities were acceptable: 0.80 for FSE, 0.78 for VSE, 0.71 for WSE, and 0.79 for PASE.

Table 2 Item description, and estimated of differential item functioning where significant
Full size table

IRM model fit

The relative fit of multidimensional RSM and multidimensional PCM was evaluated by considering the deviance difference, where df was equal to the difference in the number of estimated parameters between the two models. The chi-square (χ2) deviance statistic was calculated by considering differences in model deviances (RSM: 46,107.92; PCM: 45,903.92) and differences in numbers of parameters (RSM: 48; PCM: 84) for the nested models. The chi-square test of the deviance differences showed that RSM significantly reduced model fit (∆ deviance = 204.01, df = 36, p < 0.0001). Thus, the analyses indicated that the multidimensional RSM did not perform as well as the multidimensional PCM. As a result, further analyses reflect those from PCM.

Item fit

A summary of misfit indicators (MNSQ) and item difficulties are shown in Table 3. The MNSQ values greater than 1.3 indicate poor item fit. One VSE item (item 1, infit mean square = 1.60) and one PASE item (infit mean square for item 1 = 1.33) did not meet the recommended criterion value of 1.3. Both items were also misfits in the differential item functioning analyses when the subgroups were students’ sex (VSE Item 1 infit mean square = 1.35; PASE Item 1 infit mean square = 1.32), age (VSE Item 1 infit mean square = 1.63; PASE Item 1 infit mean square = 1.68), and weight status (VSE Item 1 infit mean square = 1.39; PASE Item 1 infit mean square = 1.46).

Table 3 Item description, item difficulty, and misfit item(s)
Full size table

Item-person fit Wright map

Table 4 presents the PCM item-person maps. The participants’ self-efficacy estimates (confidence for fruit, vegetable, water intakes, and PA engagement), and the item and item threshold difficulty distributions are on the same logit scale. The difficulty distribution is ideally presented with a normal distribution from −3.0 to +3.0. As shown in the figure, FSE and VSE approached a normal distribution. There were small portions of participants with higher and lower levels of WSE and PASE (logits >3.0/ < −3.0).

Table 4 Wright map of item thresholds for FSE, VSE, WSE, and PASE
Full size table

The items were distributed in the centre of the Wright diagram. Item difficulties showed that the logits ranged from – 0.719 to 1.171 for FSE, from −0.841 to 0.556 for VSE, from −0.413 to 0.345 for WSE, and from −1.515 to 0.748 for PASE, respectively. The distributions nearly overlapped between item threshold and person measures (indicating the full distribution of individuals was measured by items across the whole distribution, as desired) for three of the self-efficacy scales, except VSE. Participants at the lower and higher ends of VSE did not coincide with the item’s first and second threshold.

Differential item functioning (DIF)

Children’s sex groups

Item difficulty differences across sex, age, and body weight status groups are presented in Table 2. Small DIF was detected for items 1, 5, 7, 8, 10 as well as moderate DIF for item11 in FSE across sex groups. Among these items, boys found it easier to endorse items 10 and 11, but more difficult to endorse the others. Only item 6 in VSE had significant DIF by sex at −0.20, a small DIF effect: it was easier for boys to endorse item 6. Item 1 of WSE was detected with a small DIF effect, easier for girls. Five items had significant DIF (small: item 10; moderate: item 2; large: items 1, 3, and 4) in PASE. It was easier for boys to endorse items 3, 4, and 10.

Children’s age groups

Older children aged 11-13 years were more likely to endorse item 5 (small DIF at 0.18) and item 7 in FSE (small DIF at 0.25), but less likely to endorse item 11 with small DIF at −0.30. Two items had small DIF in VSE (items 5 and 6) and WSE (items 2 and 3) among different age groups, respectively. Older children found that somewhat easier to endorse item 5 of VSE and item 2 of WSE. Small DIF was indicated for six items (items 1, 2, 3, 5, 9, 10) of PASE between younger and older children. It was easier for older children to endorse items 1, 3, and 5.

Children’s body weight status

Between underweight and healthy weight children, small DIF was detected for items 2 (easier for healthy weight children) and 9 of FSE, item 2 (easier for healthy weight children) and 4 of VSE, items 1 and 4 (easier for healthy weight children) of WSE, and items 3 (easier for healthy weight children) and 6 of PASE as well as medium DIF detected for items 1 and 6 (easier for healthy weight children) of VSE, item 5 (easier for healthy weight children) of WSE. In comparison of underweight and overweight/obese children, items 7 (easier for underweight children) and 11 of FSE, items 2, 4 (easier for underweight children) and 5 of VSE, item 1 (easier for underweight children) of WSE, and items1, 2, 4, 5 and 8 of PASE (easier for underweight children for item 1, 2, and 8) were examined with small DIF; items 1 (easier for underweight children) and 6 of VSE, item 5 of WSE, and item 3 of PASE showed medium DIF. Between healthy and overweight and obese children, small DIF was indicated for items 2, 7, 10, and 11 of FSE (easier for healthy children for item 2 and 7), items 5 of VSE, and items 3, 4, 5 of PASE; and medium DIF were indicated for items 1 and 2 (both easier for healthy children) of PASE. No large DIF was found across different body weight status groups.

Discussion

The present study investigated the psychometric properties of FSE, VSE, WSE and PASE scales using CTT and IRM, and their stability across sex, age and body weight status groups based on IRM using the partial credit model. CTT results showed that the examined scales had adequate to excellent internal consistency and adequate test-retest reliability. The item difficulties were moderately easy to difficult. Items in the scales were considered discriminating. The symmetric distribution of items and item thresholds for individuals from the Wright map indicated the utilization of three-point responses nearly covered the participants from low to high levels of each self-efficacy scale except VSE, suggesting the items in VSE should be revised or new ones developed to cover the more difficult and easy levels.

One item (item1) in VSE and one items (item1) in PASE were identified as misfit items. These items also exhibited DIF across different groups. Item 1 of VSE (i.e., “How sure are you that you can eat 1 portion of a vegetable at lunch at least one time on a school day?”) and item 1 of PASE (i.e., “How sure are you that you have the ability to do physical activities like running, dancing, bicycling, or jumping rope?”) showed moderate DIF on the basis of children’s body weight status. Compared with overweight/obese children, underweight children tended to have 1 portion of a vegetable at least once on a school day. Children with healthy weight were more likely to engage in various kinds of PA than overweight and obese children. These findings suggest children’s perceived confidence to comply with the healthy lifestyle differed across different body weight status, consistent with the previous studies [25, 54, 55]. Since these two items did not behave the same way across these groups, they should be substantially revised or deleted from the scales.

DIF presented distinct difficulties by children’s sex groups. Given items with small DIF are generally not of major concern [56], we only discuss items with medium/large DIF because they require more attention in the future studies. Ignoring small DIF effects, there was moderate DIF for item 11 of FSE, and item 2 of PASE, and large DIF for items 3 and 5 of PASE. Boys showed higher confidence that they could participate in team sports (e.g., basketball, softball) than girls, but not in flexibility/rhythm-related activities (e.g., dancing, jumping rope). These DIF suggest sex-specific tailoring of an intervention to boys and girls based on their differences of food and activity preferences, as suggested by existing research [57, 58].

DIF across demographic variables could be due to differences in ability to comprehend the meaning of the specific items or actual differences in the efficacy level to adopt healthy eating behaviors or engage in PA. Moderate DIF across body weight status groups and moderate to large DIF across sex groups indicate the need to re-check and revise items to produce non-significant DIF or reduce DIF to a considerably lower level [59]. Developing the sex and body weight status specific self-efficacy scales should be considered.

VSE items and thresholds did not cover the higher and lower difficult to endorse ends of confidence. This may require rewriting existing items or adding new items to extend the end of the distribution of items and thresholds. For example, a VSE item at average difficulty, “I can eat 1 portion of a vegetable at lunch at least one time on a school day”, might be revised into “I can eat 1 portion of a vegetable at lunch at least three times on school days” , which would appear to have greater difficulty. An item with large difficulty, e.g., “I can eat 3 portions of vegetables at least 4 days a week”, could be transformed to possibly low difficulty, e.g., “I can eat 3 portions of vegetables at least one day a week”.

In the study, WSE contained 5 items and the logits of item difficulties ranged from −0.413 to 0.345. WSE showed narrower item distribution compared with the other three ones. To cover a wider range of latent trait, more diverse WSE items should be developed in future studies. For example, items addressing confidence in overcoming different types of barriers to have more water [32] (e.g., social impediments [60] referred to as coping SE [61], or emotional state). Additionally, types of item which could enhance the distributional properties could also be examined in the future.

Several limitations of the study should be mentioned. Even though existing and previously validated instruments were used and demonstrated good internal consistency in this study, validity of the scales are not available among the target children. Further validation studies should be implemented to evaluate the application of scales in different cultural settings among Chinse children (e.g., children from urban and rural areas in mainland China). Furthermore, IRM’s complexity requires a large sample size. Recommendations have been ranged from 200 per group [62] to 500 per group [63]. Possible limitations of small sample size should be acknowledged in the current study. Further investigation should retest the findings by recruiting more participants. Moreover, further investigation could be undertaken with other DIF-detection procedures (e.g., non-uniform differential item functioning).

Conclusion

FSE, VSE, WSE and PASE demonstrated acceptable factorial validity, test-retest reliability, and adequate to excellent internal consistency by CTT. IRM provides useful insights on item difficulty estimates that were not dependent on the sample. The latent variables indicated adequate fit to the data, however, the items and thresholds did not adequately cover the easier and more difficult to endorse ends of VSE. A revised VSE questionnaire is needed to provide full range of self-efficacy difficulty estimates. Several items of the four examined self-efficacy scales exhibited moderate or large differential item functioning on the basis of children’s sex and body weight status. Additional psychometric work remains to be done while scales can be used in diverse groups with due caution. Further formative work for questionnaire is necessary.

Abbreviations

BMI:

Body mass index

CITC:

Corrected item total correlations

CTT:

Classical test theory

DIF:

Differential item functioning

FSE:

Self-efficacy for fruit

IRM:

Item response modeling

MNSQ:

Mean square item fit indices

PA:

Physical activity

PASE:

Self-efficacy for physical activity

PCM:

Partial credit model

RSM:

Rating scale model

SES:

Socio-economic status

TRT:

Test-retest reliability

VSE:

Self-efficacy for vegetable

WSE:

Self-efficacy for water

References

  1. Boeing H, Bechthold A, Bub A, Ellinger S, Haller D, Kroke A, et al. Critical review: vegetables and fruit in the prevention of chronic diseases. Eur J Nutr. 2012;51:637–63.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  2. Sothern M, Loftin M, Suskind R, Udall J, Blecker U. The health benefits of physical activity in children and adolescents: implications for chronic disease prevention. Eur J Pediatr. 1999;158:271–4.

    Article  CAS  PubMed  Google Scholar 

  3. Ford ES, Bergmann MM, Kroger J, Schienkiewitz A, Weikert C, Boeing H. Healthy living is the best revenge findings from the European prospective investigation into cancer and nutrition-Potsdam study. Arch Intern Med. 2009;169:1355–62.

    Article  PubMed  Google Scholar 

  4. Kelder SH, Perry CL, Klepp K-I, Lytle LL. Longitudinal tracking of adolescent smoking, physical activity, and food choice behaviors. Am J Public Health. 1994;84:1121–6.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  5. Bandura A. Self-efficacy. In: Ramachaudran VS, editor. Encyclopedia of human behavior. New York: Academic Press; 1994. p. 71-81.

  6. De Bourdeaudhuij I, Velde ST, Brug J, Due P, Wind M, Sandvik C, et al. Personal, social and environmental predictors of daily fruit and vegetable intake in 11-year-old children in nine European countries. Eur J Clin Nutr. 2008;62:834–41.

    Article  PubMed  Google Scholar 

  7. McAuley E, Blissmer B. Self-efficacy determinants and consequences of physical activity. Exerc Sport Sci Rev. 2000;28:85–8.

    CAS  PubMed  Google Scholar 

  8. Anderson ES, Winett RA, Wojcik JR, Williams DM. Social cognitive mediators of change in a group randomized nutrition and physical activity intervention social support, self-efficacy, outcome expectations and self-regulation in the guide-to-health trial. J Health Psychol. 2010;15:21–32.

    Article  PubMed  Google Scholar 

  9. Calfas KJ, Sallis JF, Oldenburg B, Ffrench M. Mediators of change in physical activity following an intervention in primary care: PACE. Prev Med. 1997;26:297–304.

    Article  CAS  PubMed  Google Scholar 

  10. Luszczynska A, Tryburcy M, Schwarzer R. Improving fruit and vegetable consumption: a self-efficacy intervention compared with a combined self-efficacy and planning intervention. Health Educ Res. 2007;22:630–8.

    Article  PubMed  Google Scholar 

  11. Haerens L, Deforche B, Maes L, Cardon G, Stevens V, De Bourdeaudhuij I. Evaluation of a 2-year physical activity and healthy eating intervention in middle school children. Health Educ Res. 2006;21:911–21.

    Article  PubMed  Google Scholar 

  12. Story M, Sherwood NE, Himes JH, Davis M, Jacobs DR, Cartwright Y, et al. An after-school obesity prevention program for African-American girls: the Minnesota GEMS pilot study. Ethn Dis. 2003;13:S1–54.

    Google Scholar 

  13. Dishman RK, Motl RW, Sallis JF, Dunn AL, Birnbaum AS, Welk GJ, et al. Self-management strategies mediate self-efficacy and physical activity. Am J Prev Med. 2005;29:10–8.

    Article  PubMed  PubMed Central  Google Scholar 

  14. Saunders RP, Motl RW, Dowda M, Dishman RK, Pate RR. Comparison of social variables for understanding physical activity in adolescent girls. Am J Health Behav. 2004;28:426–36.

    Article  PubMed  Google Scholar 

  15. Barr-Anderson DJ, Young DR, Sallis JF, Neumark-Sztainer DR, Gittelsohn J, Webber L, et al. Structured physical activity and psychosocial correlates in middle-school girls. Prev Med. 2007;44:404–9.

    Article  PubMed  Google Scholar 

  16. Motl RW, Dishman RK, Trost SG, Saunders RP, Dowda M, Felton G, et al. Factorial validity and invariance of questionnaires measuring social-cognitive determinants of physical activity among adolescent girls. Prev Med. 2000;31:584–94.

    Article  CAS  PubMed  Google Scholar 

  17. Liang Y, Lau PW, Huang WY, Maddison R, Baranowski T. Validity and reliability of questionnaires measuring physical activity self-efficacy, enjoyment, social support among Hong Kong Chinese children. Prev Med Rep. 2014;1:48–52.

    Article  PubMed  PubMed Central  Google Scholar 

  18. Ryan GJ, Dzewaltowski DA. Comparing the relationships between different types of self-efficacy and physical activity in youth. Health Educ Behav. 2002;29:491–504.

    Article  PubMed  Google Scholar 

  19. Winters ER, Petosa RL, Charlton TE. Using social cognitive theory to explain discretionary,“leisure-time” physical exercise among high school students. J Adolesc Health. 2003;32:436–42.

    Article  PubMed  Google Scholar 

  20. Saunders RP, Pate RR, Felton G, Dowda M, Weinrich MC, Ward DS, et al. Development of questionnaires to measure psychosocial influences on children's physical activity. Prev Med. 1997;26:241–7.

    Article  CAS  PubMed  Google Scholar 

  21. Wu TY, Pender N. Determinants of physical activity among Taiwanese adolescents: an application of the health promotion model. Res Health Nursing. 2002;25:25–36.

    Article  CAS  Google Scholar 

  22. Sallis JF, Pinski RB, Grossman RM, Patterson TL, Nader PR. The development of self-efficacy scales for healthrelated diet and exercise behaviors. Health Educ Res. 1988;3:283–92.

    Article  Google Scholar 

  23. Bere E, Brug J, Klepp K-I. Why do boys eat less fruit and vegetables than girls? Public Health Nutr. 2008;11:321–5.

    PubMed  Google Scholar 

  24. Granner ML, Sargent RG, Calderon KS, Hussey JR, Evans AE, Watkins KW. Factors of fruit and vegetable intake by race, gender, and age among young adolescents. J Nutr Educ Behav. 2004;36:173–80.

    Article  PubMed  Google Scholar 

  25. Rosenkoetter E, Loman DG. Self-efficacy and self-reported dietary behaviors in adolescents at an Urban School with no competitive foods. J Sch Nurs. 2015;31:345–52.

    Article  PubMed  Google Scholar 

  26. Bolt D, Stout W. Differential item functioning: its multidimensional model and resulting SIBTEST detection procedure. Behaviormetrika. 1996;23:67–95.

    Article  Google Scholar 

  27. Watson K, Baranowski T, Thompson D. Item response modeling: an evaluation of the children's fruit and vegetable self-efficacy questionnaire. Health Educ Res. 2006;21:i47–57.

    Article  PubMed  Google Scholar 

  28. Wang JJ, Baranowski T, Lau WP, Chen TA, Pitkethly AJ. Validation of the physical activity questionnaire for older children (PAQ-C) among Chinese children. Biomed Environ Sci. 2016;29:177–86.

  29. Census and Statistics Department. Hong kong 2011 population census - summary results. 2011. Retrived from: http://www.censtatd.gov.hk/hkstat/sub/sp170.jsp?productCode=B1120055. Accessed 25 May 2016.

  30. Cole TJ, Flegal KM, Nicholls D, Jackson AA. Body mass index cut offs to define thinness in children and adolescents: international survey. BMJ. 2007;335:194.

    Article  PubMed  PubMed Central  Google Scholar 

  31. Cole TJ, Bellizzi MC, Flegal KM, Dietz WH. Establishing a standard definition for child overweight and obesity worldwide: international survey. BMJ. 2000;320:1240.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  32. Baranowski T, Watson KB, Bachman C, Baranowski JC, Cullen KW, Thompson D, et al. Self efficacy for fruit, vegetable and water intakes: expanded and abbreviated scales from item response modeling analyses. Int J Behav Nutr Phys Act. 2010;7:1.

    Article  Google Scholar 

  33. Jago R, Baranowski T, Watson K, Bachman C, Baranowski JC, Thompson D, et al. Development of new physical activity and sedentary behavior change self-efficacy questionnaires using item response modeling. Int J Behav Nutr Phys Act. 2009;6:1.

    Article  Google Scholar 

  34. Cronbach LJ. Coefficient alpha and the internal structure of tests. Psychometrika. 1951;16:297–334.

    Article  Google Scholar 

  35. Nunnally JC. Bernstein, IH. Psychometric theory. New York: McGraw-Hill; 1994.

  36. McGraw KO, Wong SP. Forming inferences about some intraclass correlation coefficients. Psychol Methods. 1996;1:30–46.

    Article  Google Scholar 

  37. Reeve BB, Mâsse LC. Item response theory modeling for questionnaire evaluation. In Methods for testing and evaluating survey questionnaires. Edited by Presser S, Rothgeb JM, Couper MP, Lessler JT, Martin E, Martin J, Singer E. Hoboken: John Wiley & Sons; 2004. p. 247-273.

  38. Hambleton RK, Swaminathan H, Rogers HJ. Fundamentals of item response theory. Newbury Park: Sage Publications, Inc.; 1991.

    Google Scholar 

  39. Embretson S, Reise S. Item response theory for psychologists. Mahwah: Lawrence Erlbaum Associates, Inc.; 2000.

    Google Scholar 

  40. Costa PT, McCrae RR. The revised NEO personality inventory (NEO PI R) and NEO five factor inventor (NEO FFI). Odessa: Psychological Assessment Resources; 1992.

    Google Scholar 

  41. Chernyshenko OS, Stark S, Chan K-Y, Drasgow F, Williams B. Fitting item response theory models to two personality inventories: issues and insights. Multivariate Behav Res. 2001;36:523–62.

    Article  CAS  PubMed  Google Scholar 

  42. Wright BD, Masters GN. Rating scale analysis. Chicago: MESA Press; 1982.

    Google Scholar 

  43. Andrich D. Application of a psychometric rating model to ordered categories which are scored with successive integers. Appl Psychol Meas. 1978;2:581–94.

    Article  Google Scholar 

  44. Andrich D. A rating formulation for ordered response categories. Psychometrika. 1978;43:561–73.

    Article  Google Scholar 

  45. Bond T, Fox CM. Applying the Rasch model. 2nd ed. Mahwah: Lawrence Erlbaum Associates; 2001.

    Google Scholar 

  46. Smith R, Schumacker R, Bush M. Using item mean squares to evaluate fit to the Rasch model. J Outcome Meas. 1998;2:66–78.

    CAS  PubMed  Google Scholar 

  47. Linacre JM. Investigating rating scale category utility. J Outcome Meas. 1999;3:103–22.

    CAS  PubMed  Google Scholar 

  48. Baranowski T, Missaghian M, Broadfoot A, Watson K, Cullen K, Nicklas T, et al. Fruit and vegetable shopping practices and social support scales: a validation. J Nutr Educ Behav. 2006;38:340–51.

    Article  PubMed  Google Scholar 

  49. Chen T-A, O’Connor TM, Hughes SO, Frankel L, Baranowski J, Mendoza JA, et al. TV parenting practices: is the same scale appropriate for parents of children of different ages? Int J Behav Nutr Phys Act. 2013;10:1.

    Article  Google Scholar 

  50. Chen T-A, O'Connor TM, Hughes SO, Beltran A, Baranowski J, Diep C, et al. Vegetable parenting practices scale. Item response modeling analyses. Appetite. 2015;91:190–9.

    Article  PubMed  PubMed Central  Google Scholar 

  51. Wilson M. Constructing measures: an item response modeling approach. Mahwah: Lawrence Erlbaum Associates; 2005.

    Google Scholar 

  52. Paek I. Investigations of differential item functioning: comparisons among approaches, and extension to a multidimensional context [doctoral dissertation]. Berkeley: University of California, Berkeley; 2002.

    Google Scholar 

  53. Wu ML, Adams R, Wilson M, Haldane S. ConQuest [computer software]. Berkeley: ACER; 2003.

    Google Scholar 

  54. Trost SG, Kerr L, Ward DS, Pate RR. Physical activity and determinants of physical activity in obese and non-obese children. Int J Obes Relat Metab Disord. 2001;25:822–9.

    Article  CAS  PubMed  Google Scholar 

  55. Kitzman-Ulrich H, Wilson DK, Van Horn ML, Lawman HG. Relationship of body mass index and psychosocial factors on physical activity in underserved adolescent boys and girls. Health Psychol. 2010;29:506–13.

    Article  PubMed  Google Scholar 

  56. Angoff WH. Perspectives on differential item functioning methodology. In: Holland PW, Wainer H, editors. Differential item functioning. Hillsdale: Lawrence Erlbaum and Associates; 1993. p. 3–24.

    Google Scholar 

  57. Wilson DK, Williams J, Evans A, Mixon G, Rheaume C. Brief report: a qualitative study of gender preferences and motivational factors for physical activity in underserved adolescents. J Pediatr Psychol. 2005;30:293–7.

    Article  PubMed  PubMed Central  Google Scholar 

  58. Pérez-Rodrigo C, Ribas L, Serra-Majem L, Aranceta J. Food preferences of Spanish children and young people: the enKid study. Eur J Clin Nutr. 2003;57:S45–S8.

    Article  PubMed  Google Scholar 

  59. Allalouf A. Revising translated differential item functioning items as a tool for improving cross-lingual assessment. Appl Meas Educ. 2003;16:55–73.

    Article  Google Scholar 

  60. Maibach E, Murphy DA. Self-efficacy in health promotion research and practice: conceptualization and measurement. Health Educ Res. 1995;10:37–50.

    Article  Google Scholar 

  61. Brug J, de Vet E, de Nooijer J, Verplanken B. Predicting fruit consumption: cognitions, intention, and habits. J Nutr Educ Behav. 2006;38(2):73–81.

    Article  PubMed  Google Scholar 

  62. Scott NW, Fayers PM, Aaronson NK, Bottomley A, de Graeff A, Groenvold M, et al. A simulation study provided sample size guidance for differential item functioning (DIF) studies using short scales. J Clin Epidemiol. 2009;62:288–95.

    Article  PubMed  Google Scholar 

  63. Embretson SE, Reise SP. Item response theory. Mahwah: Lawrence Erlbaum Associates, Inc.; 2000.

    Book  Google Scholar 

Download references

Acknowledgments

The authors want to thank Amanda Pitkethly, and Shuge Zhang for their assistance in data collection.

Funding

This research was supported by the General Research Fund (GRF) from Research Grants Council of Hong Kong (grant no. 244913).

Availability of data and materials

The dataset supporting the conclusions of this article is included within the article.

Author information

Author notes

    Authors and Affiliations

    1. Mass Sports Research Center, China Institute of Sport Science, Beijing, China

      Jing-Jing Wang

    2. HEALTH Research Institute, University of Houston, Houston, TX, 77204, USA

      Tzu-An Chen

    3. Children’s Nutrition Research Center, Department of Pediatrics, Baylor College of Medicine, Houston, TX, 77030, USA

      Tom Baranowski

    4. Department of Physical Education, Faculty of Social Sciences, Hong Kong Baptist University, Academic and Administration Building, 15, Road, Kowloon Tong, Hong Kong, China

      Patrick W.C. Lau

    Authors
    1. Jing-Jing Wang
      View author publications

      You can also search for this author in PubMed Google Scholar

    2. Tzu-An Chen
      View author publications

      You can also search for this author in PubMed Google Scholar

    3. Tom Baranowski
      View author publications

      You can also search for this author in PubMed Google Scholar

    4. Patrick W.C. Lau
      View author publications

      You can also search for this author in PubMed Google Scholar

    Contributions

    JJW and PWL conceived the study. JJW conducted data collection. JJW and TAC analysed and interpreted the data. JJW and TAC wrote the manuscript. TB and PWL edited the manuscript critically. All authors read and approved the final manuscript.

    Corresponding author

    Correspondence to Patrick W.C. Lau.

    Ethics declarations

    Ethics approval and consent to participate

    The study was approved by Hong Kong Baptist University Committee on the Use of Human and Animal Subjects in Teaching and Research. Written informed consent was obtained prior to the study.

    Consent for publication

    Not applicable.

    Competing interests

    The authors declare that they have no competing interests.

    Publisher’s Note

    Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

    Rights and permissions

    Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

    Reprints and Permissions

    About this article

    Check for updates. Verify currency and authenticity via CrossMark

    Cite this article

    Wang, JJ., Chen, TA., Baranowski, T. et al. Item response modeling: a psychometric assessment of the children’s fruit, vegetable, water, and physical activity self-efficacy scales among Chinese children. Int J Behav Nutr Phys Act 14, 126 (2017). https://doi.org/10.1186/s12966-017-0584-x

    Download citation

    • Received:

    • Accepted:

    • Published:

    • DOI: https://doi.org/10.1186/s12966-017-0584-x

    Keywords

    • Self-efficacy
    • Eating behaviors
    • Physical activity
    • Item response modeling
    • Differential item functioning

    International Journal of Behavioral Nutrition and Physical Activity

    ISSN: 1479-5868

    Contact us