Skip to main content

Reliability and validity of the Healthy Home Survey: A tool to measure factors within homes hypothesized to relate to overweight in children

Abstract

Background

The contribution of the environment to the obesity epidemic is well recognized. Parents have control over their home environment and can, therefore, support healthy dietary and activity habits in their children by manipulating factors such as access to energy-dense foods, availability of physical activity equipment, and restricting screen time. This paper describes the development of the Healthy Home Survey and its reliability and validity. The Healthy Home Survey was designed to assess characteristics of the home environment that are hypothesized to influence healthy weight behaviors in children including diet and physical activity.

Methods

We recruited 85 families with at least one child between 3–8 years. The Healthy Home Survey was administered to parents via telephone and repeated in a random sample of 45 families after 7 days. In-home observations were performed within 14 days of the first Healthy Home Survey interview. Percent agreement, Kappa statistics, Intra-class correlation coefficients and sensitivity analyses were used to evaluate reliability and validity evidence.

Results

Reliability and validity estimates for the Healthy Home Survey were varied, but generally high (0.22–1.00 and 0.07–0.96 respectively), with lower scores noted for perishable foods and policy items. Lower scores were likely related to actual change in the perishable foods present and the subjective nature or clarity of policy questions and response categories.

Conclusion

Initial testing demonstrated that the Healthy Home Survey is a feasible, reliable, and valid assessment of the home environment; however, it has also highlighted areas that need improvement. The Healthy Home Survey will be useful in future research exploring the relationship between the home environment and child weight.

Background

Worldwide, it is estimated that 10% of school-age children are currently overweight or obese with rates continuing to rise[1]. In the US, the most recent data suggest that 34% of children are overweight (>85th percentile) and 17% are obese (>95th percentile)[2]. Given these alarming trends, increased attention has been focused on understanding the etiology of obesity and possible management strategies, particularly the contribution of the environment [1, 3–5]. The current environment has been described as "toxic" or "obesogenic'" due to the presence of an almost unlimited, convenient supply of highly palatable, energy dense foods, coupled with conditions that encourage sedentary behaviors and discourage physical activity [1, 4, 6]. Most environmental research to date has focused on the impact of macro-level environments such as neighborhoods and communities on healthy weight behaviors. Such research has launched a wave of 'active living' initiatives that promote building, neighborhood and road network designs that encourage communities to become more active [7–9].

Micro-level, or 'home' environments are also likely to correlate to overweight in children, but there has been less attention in this area of research [1, 6, 10]. Physical and social parameters of the home environment hypothesized to influence children's diets include the foods available in the home, parents' own eating habits, and feeding practices parents employ [11–14]. For example, the availability and accessibility of foods in the home may be a major factor influence on childhood diet, since children's food intake is largely dependent upon provision of food by others [15, 16]. Studies in this area have found that an increase in the availability of foods is related to the consumption of those foods [16–19]. Many studies have considered fruits and vegetables specifically, finding that when fruits and vegetables were available, children were more likely to eat them.

In addition to making healthy foods available and accessible in the home, most researchers would agree that parents can encourage their children to eat more healthfully by adopting appropriate feeding behaviors and practices. Research has shown that what parents eat themselves (i.e., parental modeling) has a strong influence on children's food preferences and intake [11, 20–23]. Also, parental restriction has been positively associated with overeating, or eating in the absence of hunger, especially in girls [24]. The few studies examining parental disinhibition [25] and neglect [26] suggest that both may lead to poorer dietary habits in children. Family meals are also likely to influence diet in children with evidence showing that skipping breakfast (or eating breakfast less often) is related to increased body mass index (BMI) in children [27–30] and eating family dinners is associated with more healthful dietary intake patterns, including greater consumption of fruits and vegetables [31].

Access to and provision of environments which encourage or discourage physical activity are also likely to influence childhood body composition, although this area has received somewhat less attention compared to food and eating behaviors. As with diet, a child's activity may be influenced by both social and physical parameters in the home, such as parents' own physical activity habits, parents' rules and policies around play, encouragement to play, restriction of sedentary activities and provision of areas for active play. Environmental determinants of children's physical activity have been examined in a recent review by Ferreira et al[32]. Parental physical activity (i.e. role modeling) has been studied extensively, but with mixed results. Father's activity was most consistently associated with child physical activity. Time spent outdoors, although less studied, was an area consistently associated with higher activity levels in children. Another major area of focus has been the impact of TV watching, with many studies finding positive correlations between the amount of time spent watching TV and BMI [33]. Discrepancies in findings regarding the TV-childhood obesity relationship may be due to low quality measurements of TV exposure [34, 35]. Given the challenges in measuring the amount of time spent watching TV, assessment of factors such as the number and location of TVs and parental restriction of access to TVs should be explored as possible predictors of sedentary behaviors.

Interventions that focus on improving the physical and social environments in the homes of children need to be tested. One impediment to this research is the lack of tools with sound reliability and validity evidence that can be used to measure factors within the home that may relate to healthy weight behaviors in children. The Healthy Home Survey (HHS) was developed to address this measurement gap. The purpose of this paper is to describe the development of the HHS, as well as the reliability and validity testing of this instrument.

Methods

Survey development

Development of the Healthy Home Survey began with a review of the literature for confirmed or hypothesized associations between physical and social characteristics of the home environment and healthy weight in children. An unrestricted list of potential questionnaire items was generated to measure characteristics of the home environment related to food, physical activity and media. Specific domains included food availability (presence/absence, variety and quantity), eating environment and policies, physical activity environment, physical activity policies, media environment and media policies.

The list of potential questionnaire items was circulated to 5 experts in the field. Feedback was requested with regard to the relevance of the items and the factors of interest, clarity of wording, and identification of items which should be added or removed. After incorporating this feedback, the questionnaire was pre-tested in a sample of five parents of children ages 3–8 years to ensure that representatives of the study sample understood the meaning of each item, as well as the clarity of the wording and response options. Amendments were made as needed [Additional file 1].

Since this was the first phase of the HHS development, a number of open response items were included in order to capture all potentially important responses. For example, food availability questions asked the participant to describe all foods that they had in their homes within each food category; fruit (fresh, dried, frozen, canned/jarred), vegetables (fresh, frozen, canned/jarred), sweet snacks (e.g. cookies, ice-cream, Twinkies, muffins, cake), salty snacks (e.g. peanuts, chips, tortillas, pretzels), candy (hard candy, chocolate bars) and soda (not diet). Other response options were chosen to accommodate characteristics of each item. Eating practices, for example, queried number of days the child ate breakfast at home; thus, the response was the number of days (0–7). More subjective items, such as "do you reward your child with desserts" were given Likert-type scale response options (e.g., all of the time, most of the time, some of the time, rarely or never). A copy of the questionnaire is available from the first author by request.

Sample

We recruited 85 families with at least one child between the ages of 3–8 years using newspaper advertisements, list-serves and community postings. Inclusion criteria were: having at least one child between ages 3 and 8 years old living in the home; residing within 20 miles of the University of North Carolina (UNC) at Chapel Hill; having lived in residence at least 6 months with no plans to move residences within the next 3 months; and agreement to participate in the home visits and assessments. If there was more than one eligible child in a family, the eldest child was allocated to be the study reference child. We certify that all applicable institutional and governmental regulations concerning the ethical use of human volunteers were followed during this research. All study procedures were reviewed and approved by the UNC Institutional Review Board.

Procedures

A combination of telephone interviews and home visits were used to produce reliability and validity evidence for the HHS. The survey was administered by telephone to the parent that originally responded to advertisements while in their home. Start and stop times were recorded in order to calculate duration of the interview and assess feasibility. Approximately 50% of participants (n = 45) were randomly selected to receive a second telephone interview to evaluate test re-test reliability of the measure. Participants were assigned to receive the second interview using alternating allocation as they responded to recruitment advertisements. The second telephone call was planned for 7 days (+/- 1 day) after the first call.

Approximately 7 days (but no more than 14 days) after the initial telephone interview, a home visit was planned so that researchers could objectively measure the physical items. Height, weight, physical activity, and diet data were collected for the reference child and parent in order to examine possible associations between these variables and characteristics of the home environment; however, these results are not presented in this paper.

Data was collected by a team of 3 researchers, following training for the collection of both the telephone interview and home visit data. Two staff performed each home visit and any subjective decisions (e.g. 'usability of the dinning room table' or 'adequate play space') were determined through consensus of both researchers. Staff were continuously monitored and supervised throughout data collection to ensure quality control.

Participants were asked to report all food and drink items within each food category. Researchers then confirmed their relevance to each category based on pre-determined lists of foods and drinks, training and consensus. Prompts were provided to aid completeness (e.g. "what about raisins in your baking cupboard" when enquiring about dried fruit).

Statistical Analysis

Food availability variables (i.e., 'variety' and 'quantity') were derived from the data. Variety refers to the number of different types of foods within each category. If the participant responded "yes" to the presence of fruit in their home, they would be asked to describe the fruits including an estimation of the quantity. For example, if a participant reported having 2 apples, 2 bananas and 1 orange, the variety score for fruit would equal 3. Quantity was derived by looking at typical food and package sizes (e.g. small, medium, and large). Local grocery store and manufacturer websites were used to determine the range of size options available in order to set a standard size (quantity) for each food item in the database. For example, we found that boxed raisins were typically available in small and large size options. Based on the median weight for each of these sizes available from different manufactures, standard sizes for boxes of raisins were set at 1.5 oz for small and 13.5 oz for large. The Nutrition Epidemiology Core at UNC Clinical Nutrition Resource Center (DK056350) used the University of Minnesota Nutrition Data System for Research to calculate the number of servings of food available.

Statistical analyses were performed using SAS (v9.1, SAS Institute Inc, Cary, NC, 2003). Percent agreement, Kappa statistics [36, 37] proportion of positive and negative agreement [38, 39] sensitivity, specificity and single measure Intraclass correlation coefficients (ICC) [40] were used to evaluate reliability and validity evidence. For items with more than two ordered response options, weighted kappa was estimated. As a guide, we followed the benchmarks suggested by Landis and Koch [15] for agreement: < 0.00 = poor, 0.00 – 0.20 = slight, 0.21 – 0.40 = fair, 0.41 – 0.60 = moderate, 0.61 – 0.80 = substantial and 0.81 – 1.0 = almost perfect. Response prevalence for several items was skewed; therefore the prevalence and bias adjusted Kappa (PABAK) [38] was calculated for any item where 85% or more of the sample responded in one direction. The proportion of positive agreement is the number of "yes" agreements (person responds "yes" at both phone 1 and phone 2) divided by the average number of "yes" responses from the two phone interviews. The proportion of negative agreement is the number "no" agreements (person responds "no" at both phone 1 and phone 2) divided by the average number of "no" responses from the two phone interviews. These separate indexes allow for distinction in item performance that a single estimate (e.g. kappa or PABAK) may obscure. For example, agreement may be high for an item when a person responds "yes" (Ppos = 75%), but if someone says "no" on one occasion they may be unlikely to respond "no" during another interview (Pneg = 50%). This may be important if trying to identify a specific group or behavior. For sensitivity and specificity, the home visit was used as the criterion measure. Sensitivity is the proportion of people reporting "yes" during phone interview 1 that were confirmed as 'yes' during the home visit. Specificity is the proportion of people reporting "no" during phone interview 1 that were confirmed as 'no' during the home visit. All ICCs are single measure estimates and were calculated using the INTRACC macro developed for SAS by Hamer [41].

Results

Participant characteristics

The mean age of children and parents was 5.05 (S.D. 1.34) and 35.81 (S.D. 5.99) years respectively. There were slightly more boys (56%) than girls and more female primary caregivers (98%) compared to males. For children, mean body mass index (BMI- weight (kg)/height2 (m)) percentile was 64% (28.01). For primary care givers, average BMI was 26.81 (S.D. 6.70). Most participants were White (72.9%) or African American (23.5%) and lived in detached homes (83.7%). A range of household incomes were reported with 10.5% reporting less than $19,000, 19.8% reporting $20,000–$49,000; 50.0% reporting $50,000–$100,000 and 12.8% reporting greater than $100,000. Seven percent of participants declined to report annual household income (Data not shown).

Feasibility

All 85 families completed the initial telephone interview. The mean duration of these interviews was 34.4 (SD 9.2) minutes. All 45 families asked to complete a second telephone interview did so. The mean duration of the second interview was 29.0 (SD 8.6) minutes and, on average, they took place 7.6 days (SD 1.3) after the initial telephone interview. More than 95% of intended home visits (81/85) were completed. Four home visits could not be completed due to scheduling problems that prevented the completion of visits within the predetermined time frame. The mean number of days between the first interview and the home visit was 7.9 (SD 3.6) days (in line with the prescribed protocol of 7–14 days).

Food availability: presence/absence

Table 1 shows the test re-test reliability and validity of food availability items (yes/no). For reliability, percent agreement was almost perfect for all items (ranging between 84.44% – 95.56%). Kappa scores were more variable, ranging from -0.02 to 0.86. Responses to many of the items with lower kappa values were skewed, with 85% or more of the sample reporting they were available in the home. Prevalence and bias adjusted Kappas (PABAK) were greater than 0.75 for each of these items. The proportion of positive and negative agreement ranged from 0.91 to 0.98 and 0.00 to 0.91 respectively.

Table 1 Food Availability: Yes/No

There was greater than 80% agreement between the phone and home visit for all food categories. Kappa scores varied ranging from -0.02 to 0.87. PABAK was 0.73 or greater where presented. Sensitivity was generally high (range 0.83 to 0.96), while specificity ranged from 0.00 to 1.00).

Food availability: Variety and number of servings

Similar to presence or absence of food availability, test re-test reliability for food variety was high (substantial to almost perfect) for most items (Table 2). One exception was fresh fruit, with an ICC of only 0.37 (95% CI = 0.09–0.59). Validity for the variety of food items was similar to reliability (ICC ranging between 0.30 – 0.82), with a lower ICC also observed for fresh fruit. In addition, results for sweet snacks were considered as only fair (ICC = 0.30; 95% CI = 0.09–0.49).

Table 2 Single measure Intraclass correlation coefficients and 95% confidence intervals for food variety and servings

Reliability results for the number of servings of each item are also shown in Table 2. ICCs ranged from 0.22–0.91 and were lowest for fresh (ICC 0.22, 95% CI = 0.07–0.48) and dried fruit (ICC 0.39, 95% CI = 0.11–0.61). Validity estimates for servings were lowest for sweet snacks (ICC 0.32, 95% CI = 0.12–0.50) and fresh vegetables (ICC 0.30, 95% CI = 0.09–0.48), and highest for frozen fruit (ICC 0.83, 95% CI 0.76–0.89) and frozen vegetables (ICC 0.74, 95% CI = 0.63–0.83).

Food environment

Reliability and validity estimates for food environment items are shown in Table 3. Percent agreement for reliability (mean = 86%) and validity (mean = 71%) ranged from 58% to 98%. Agreement across phone interviews was generally good with most Kappa estimates above 0.60, with the lowest scores found for fresh fruit (κ = 0.49, 95% CI = 0.19–0.79). Kappa estimates for validity were low (all but one less than 0.50). Sensitivity was, however, greater than 0.75 for four items.

Table 3 Reliability and validity estimates for Food environment items from the HHS

Eating practices and eating, media and physical activity policies

Table 4 shows the reliability scores for policies and practices within the home related to eating, media and physical activity. It was not possible to assess criterion validity, since these items are not physically observable. For eating practices, there was generally good agreement between telephone responses with ICCs ranging from 0.64 to 0.92. The lowest, but still moderate, kappa and ICC values were noted for items asking parents to estimate the number of days per week the child eats lunch watching TV and eats snacks watching TV.

Table 4 Eating practices and eating, media and physical activity policies (reliability only)

Kappa scores for eating policies varied (range 0.36–0.75), although most were considered at least moderate. Three items were noted as having substantially lower percent agreement, Kappa, and/or ICC estimates. Whether a child was only permitted to eat at set meal times had the lowest percent agreement (42.22%) while policy of having second helpings (ICC 0.32, 95% CI = 0.04–0.56) and whether a parent considers themselves to eat healthy (ICC 0.44, 95% CI = 0.17–0.65) had questionable ICC and kappa values.

Kappa and ICC estimates for media and physical activity policy items ranged from 0.41 to 0.86. The highest reliability estimates were noted for the three "reward" media items. The lowest Kappa and ICC were for restriction of outdoor play in the yard (κ = 0.41; ICC = 0.54).

Physical activity and media environment

Reliability and validity results for physical activity and media environment items are shown in Table 5. The mean kappa value for the physical activity and media environment reliability was 0.81. The presence of a bike or riding toy was found to have a low Kappa (κ = 0.29, 95% CI = -21–0.79), but high percent agreement (91%) due to the fact that 98% of parents reported the presence of a bike or riding toy. Similar results were observed for the validation of the bike item. A low kappa (κ = 0.06, 95% CI = -0.11–0.22) was also noted for 'adequate play space inside' suggesting discordance between observers and parental rating. Validity estimates for yard size (κ = 0.49, 95% CI = -0.31–0.66) and computer in child's bedroom (κ = 0.53, 95% CI = -0.21–0.86) while acceptable, were lower than expected.

Table 5 Reliability and validity estimates for physical activity and media environment items from the HHS

Discussion

To our knowledge, this study was the first to develop and evaluate a tool which measures both physical and social factors within the home setting that influence diet, physical activity, and sedentary behaviors of children. The instrument was found to be feasible and the majority of items demonstrated substantial to almost perfect agreement between the two phone interviews and between the first phone interview and the home assessment.

Assessment of the home environment did have some challenges. One area in particular that needs to be revisited is the assessment of food availability in the home, especially the quantity or number of servings available. Calculating servings required a number of assumptions. As described previously, package sizes were captured as small, medium, or large. In order to calculate the number of servings, these general sizes had to be translated into more exact volume or weight quantities. This methodology likely affected the reliability and validity of these items. Although the HHS was not intended to provide a complete food inventory, it may be valuable to capture more detailed package size information in future work with this instrument.

Although the majority of items in the survey had moderate to high reliability, somewhat lower scores were noted for variety and quantity of fresh fruit, 'fruit in view', 'seconds policy', 'set meal times', 'parent eats healthy', and 'restrict outdoor play'. Low reliability scores for variety and quantity of fresh fruit (and possibly fruit in view) may reflect actual changes due to consumption or purchase during those 7 days between the first and second telephone interviews, since fresh fruits usually perish within this time frame. While current data do not allow separation of the variance attributed to natural change, it will be important to determine so that data collection methods and questionnaire items could be modified to improve the quality of data collected. We believe that measurement of the variety and quantity of foods may be a better indicator of the quality of foods in the home compared to if presence or absence alone is measured. For example, a dictomous measure could report that fruit is available in a home when just one apple is present. On the other hand, a measure of the quantity of different fruits would distinguish whether a home contained just one apple or a variety of different fruits. For the purpose of this tool evaluation study, we did not take into account the variables which are likely to influence quantity or quality, including the number of days since shopping, or the number of people living in the home. Such factors would be considered when using the measure as a means to describe a family's home environment.

Low reliability for the three questions about eating and media policies may be the result of confusion about the meaning of these questions. For example, data collectors noted that a number of participants needed additional clarification about the 'seconds policy' question before being able to answer, suggesting that some questions need to be revised. Other items with lower scores for reliability were of a more subjective nature (e.g. parent self-report of whether they eat healthy).

In general, moderate to high validity was observed; although slightly lower scores were noted for some items on variety and the food environment. The variety items with the lowest validity were salty and sweet snacks and fresh fruit. Lower validity for items measuring snack variety may have been a function of how individual participants versus trained data collectors reported similar items either together or separately. For example, if a participant had 1 bag of potato chips and 1 bag of tortilla chips in their pantry, they may have reported "2 bags of chips." Trained data collectors would have distinguished between the two and recorded 1 bag of each. As a result, calculated variety based on participant report and direct observation would be different. Food environment items that demonstrated lower validity included 'fruit in view', 'adequate play space inside' and items ascertaining the degree of accessibility of candy, soda, and snacks. The subjective nature of these items likely impacted validity estimates. For example, when interpreting what is meant by 'accessible', data collectors considered foods to accessible if children could reach the item without assistance, including if there was a chair nearby to help them reach higher items. It is possible that parents' did not take this into consideration or that they believed that their child did not have access because they never attempted or were not permitted to retrieve them. In an attempt to reduce such error, parents were told that accessibility was not related to permission. A further item asked the parent to report whether the child was allowed to "help themselves to snacks", which we specified was related to permission.

Quantity scores (number of servings) for vegetables were of lower validity compared to food variety. Serving sizes were based on the original package size, rather than the amount that remained in a package, except for foods that are sold as loose items (e.g. fresh vegetables). We reported package size by category (e.g. small, medium or large). Consequently, this variable was more subject to interpretation. Additionally, vegetables are perishable and an estimated bag size will change with consumption. Thus, similar to reliability, assessment of some food items may be measuring actual change rather than validity of the item scores.

An area for future work is the development of items associated with the physical activity environment, including both social and physical factors. Compared to the diet area, less is known about the role of the home environment on physical activity behavior. Future work with this instrument should identify other environmental characteristics that could be related to this behavior and to BMI levels.

Assessment of the family home environment has been popular for many years in child development research. The HOME (Home Observations for Measurement of the Environment) instrument was developed over three decades ago to measure the quantity and quality of stimulation and support available to children within their homes to facilitate optimal development. Multiple versions of this questionnaire for specific age ranges now exist, and it is used both as a measurement tool and as a means to evaluate the intervention effectiveness [42]. Recent data collected using the HOME found positive associations between items within HOME that relate to opportunity for productive activity (e.g., availability of books and games) and weight gain in children[43]. More specifically, those children who gained weight had fewer opportunities for productive activity and watched more television compared to those who did not gain weight. This study also found that children who gained weight were more likely to have parents with more controlling parenting styles. While such relationships with weight status have been observed by using the HOME tool, that instrument does not specifically target factors that influence healthy weight behaviors. More recently, Gattshall et al [44]developed and examined a survey to assess home environments in overweight children. Results demonstrated generally good reliability (physical activity items ICC = 0.43–0.96; food/diet items 0.01–0.90), but it is not possible to compare validity scores to the HHS, since Gattshall did not assess criterion validity.

Other researchers have focused more specifically on assessing the home food environment as a proxy for diet intake. This is a growing area of research, but there remains to be a lack of published manuscripts detailing the evaluation of such measures [16, 21, 45], and few measures exist with adequate evidence for reliability and validity of scores. Recently, Campbell et al., [22] measured predictors of childhood diet within family homes using an adolescent- and parental-report questionnaire that included assessments of food availability, child feeding practices, parental modeling and television exposure. This questionnaire was completed by a large sample and demonstrated good internal reliability; however, test re-test reliability and criterion validity were not assessed.

Measures of the home physical activity environment are even less common than those of food. Hume et al [46] recently developed and assessed an adolescent self-report questionnaire to measure perception of home and neighborhood physical activity environments. Items were both physical (e.g., presence and size of yard) and social (e.g., encouragement to be active). Test re-test reliability (9-day interval) was examined in a small sample of children and most items were found to have moderate to good agreement (physical environment ICC = 0.8–0.94; social environment 0.16–1.00). This tool may be a useful measure of youth perceptions of the physical activity environment and as a predictor of healthy weight behaviors in the home; however, the validity of the assessments is not known.

Measurement of the home media environment has received attention due to interest in the relationship between media and sedentary behaviors[47, 48]. Many questionnaires have measured the duration of watching TV, and some have reasonable reliability and validity evidence. However, few of these also considered and evaluated social environments related to screen time. Salmon et. al. [48] examined the sedentary environment, including the physical media environment as well as social factors like rules and restrictions, surrounding media behaviors from both the parents' and the children's perspectives. Scores from these instruments showed moderate to good test re-test reliability, but again, validity was not assessed.

Compared to earlier questionnaires, the Healthy Home Survey takes a more holistic approach, examining a variety of physical and social factors that might influence diet, physical activity, and sedentary behaviors in children. The instrument includes many items that have not been measured or evaluated in previous studies. For some of these new items, an open response approach was needed. This approach will enable us to further develop the tool with evidence based identification of valid and discriminate items. One downside is that this approach required a lot of time for coding and analysis; however we believe that, at this stage, open response within categories added to the richness of the data. Many of the items on the HHS were subjective, and these items often had lower reliability and validity scores. These challenges highlight the need for further development of the HHS.

This study is limited in that the population was fairly homogenous with families of moderately high social economic status. It is likely that these families were more highly motivated than those that did not volunteer to take part in the study. Further testing is required in a more diverse sample. In addition, we were not able to validate items within the HHS that related to household policies (e.g., rules regarding TV exposure and dieting behaviors) since they could not be physically observed in a single observation episode. Unlike institutions such as schools, manuals or written policy guidelines that must be adhered to within family homes typically do not exist.

Conclusion

The HHS was designed to assess multiple factors hypothesized to relate to healthy weight behaviors in children. We believe that the assessment of more than one factor is important and relevant, given the multiple factors that influence overweight in children. Although this work has provided a major step forward in the development of an instrument to assess weight-related factors in the home micro-environment, additional work is needed to improve the measurement quality of selected items and to determine usefulness in a broader range of demographic groups. More work is also needed to understand the discriminatory power and clustering of items and the potential for deletion of items to produce a shorter instrument. In addition the sensitivity of the HHS to change (e.g., intervention effects) needs to be examined, and usefulness in diverse families evaluated. Although more research is needed, the work described here has moved forward efforts to create a reliable and valid instrument to measure aspects of the home micro-environment hypothesized to contribute to obesity in children.

References

  1. Lobstein T, Baur L, Uauy R: Obesity in children and young people: a crisis in public health. Obes Rev. 2004, 5 (s1): 4-85. 10.1111/j.1467-789X.2004.00133.x.

    Article  Google Scholar 

  2. Ogden CL, Carroll MD, Curtin LR, McDowell MA, Tabak CJ, Flegal KM: Prevalence of Overweight and Obesity in the United States, 1999-2004. JAMA. 2006, 295 (13): 1549-1555. 10.1001/jama.295.13.1549.

    Article  CAS  Google Scholar 

  3. Giles-Corti B, Donovan RJ: Relative Influences of Individual, Social Environmental, and Physical Environmental Correlates of Walking. Am J Public Health. 2003, 93 (9): 1583-1589.

    Article  Google Scholar 

  4. Poston II WSC, Foreyt JP: Obesity is an environmental issue. Atherosclerosis. 1999, 146 (2): 201-209. 10.1016/S0021-9150(99)00258-0.

    Article  Google Scholar 

  5. Weinsier RL, Hunter GR, Heini AF, Goran MI, Sell SM: The etiology of obesity: relative contribution of metabolic factors, diet, and physical activity. Am J Med. 1998, 105 (2): 145-150. 10.1016/S0002-9343(98)00190-9.

    Article  CAS  Google Scholar 

  6. Swinburn B, Egger G, Raza F: Dissecting obesogenic environments: The development and application of a framework for identifying and prioritizing environmental interventions for Obesity. Prev Med. 1999, 29 (6): 563-570. 10.1006/pmed.1999.0585.

    Article  CAS  Google Scholar 

  7. Brownson RC, Boehmer TK, Luke DA: Declining rates of physical activity in the United States: What are the contributors?. Ann Rev Pub Health. 2005, 26: 421-443. 10.1146/annurev.publhealth.26.021304.144437.

    Article  Google Scholar 

  8. Kumanyika SK: Minisymposium on obesity: Overview and Some Strategic Considerations. Ann Rev Pub Health. 2001, 22 (1): 293-308. 10.1146/annurev.publhealth.22.1.293.

    Article  CAS  Google Scholar 

  9. Saelens BE, Sallis JF, Frank LD: Environmental correlates of walking and cycling: findings from the transportation, urban design and planning literatures. Ann Behav Med. 2002, 25: 80-91. 10.1207/S15324796ABM2502_03.

    Article  Google Scholar 

  10. Swinburn BA, Caterson L, Seidell JC, James WPT: Diet, nutrition and the prevention of excess weight gain and obesity. Public Health Nutr. 2004, 7 (1A): 123-146. 10.1079/PHN2003585.

    CAS  Google Scholar 

  11. Birch LL, Davison KK: Family environmental factors influencing the developing behavioral controls of food intake and childhood overweight. Pediatr Clin North Am. 2001, 48 (4): 893-907. 10.1016/S0031-3955(05)70347-3.

    Article  CAS  Google Scholar 

  12. Birch LL, Fisher JO: Development of Eating Behaviors Among Children and Adolescents. Pediatrics. 1998, 101 (3): 539-549.

    CAS  Google Scholar 

  13. Davison KK, Birch LL: Childhood overweight: a contextual model and recommendations for future research. Obes Rev. 2001, 2 (3): 159-171. 10.1046/j.1467-789x.2001.00036.x.

    Article  CAS  Google Scholar 

  14. Faith MS, Scanlon KS, Birch LL, Francis LA, Sherry B: Parent-Child Feeding Strategies and Their Relationships to Child Eating and Weight Status. Obes Rev. 2004, 12 (11): 1711-1722.

    Article  Google Scholar 

  15. Glanz K, Sallis JF, Saelens BE, Frank LD: Healthy nutrition environments: Concepts and measures. Am J Health Promot. 2005, 19 (5): 330-333.

    Article  Google Scholar 

  16. Bryant M, Stevens J: Measurement of food availability in the home. Nutr Rev. 2006, 64 (2): 67-76. 10.1301/nr.2006.feb.67-76.

    Article  Google Scholar 

  17. Patterson RE, Kristal AR, Shannon J, Hunt JR, White E: Using a brief household food inventory as an environmental indicator of individual dietary practices. Am J Public Health. 1997, 87 (2): 272-275.

    Article  CAS  Google Scholar 

  18. Raynor HA, Polley BA, Wing RR, Jeffery RW: Is dietary fat intake related to liking or household availability of high and low fat foods?. Obes Res. 2004, 12 (5): 816-823.

    Article  Google Scholar 

  19. Reynolds KD, Hinton AW, Shewchuk R, Hickey CA: Social cognitive model of fruit and vegetable consumption in elementary school children. J Nutr Educ. 1999, 31: 23-30.

    Article  Google Scholar 

  20. Gibson EL, Wardle J, Watts CJ: Fruit and vegetable consumption, nutritional knowledge and beliefs in mothers and children. Appetite. 1998, 31 (2): 205-228. 10.1006/appe.1998.0180.

    Article  CAS  Google Scholar 

  21. Campbell KJ: Associations between the home food environment and obesity-promoting eating behaviors in adolescence. Obesity. 2007, 15 (3): 719-730.

    Article  Google Scholar 

  22. Campbell KJ, Crawford DA, Ball K: Family food environment and dietary behaviors likely to promote fatness in 5-6 year-old children. In J Obes. 2006, 30 (8): 1272-1280. 10.1038/sj.ijo.0803266.

    Article  CAS  Google Scholar 

  23. Lee Y, Mitchell DC, Smiciklas-Wright H, Birch LL: Diet Quality, Nutrient Intake, Weight Status, and Feeding Environments of Girls Meeting or Exceeding Recommendations for Total Dietary Fat of the American Academy of Pediatrics. Pediatrics. 2001, 107 (6): e95-10.1542/peds.107.6.e95.

    Article  CAS  Google Scholar 

  24. Fisher JO, Birch LL: Restricting access to foods and children’s eating. Appetite. 1999, 32: 405-419. 10.1006/appe.1999.0231.

    Article  CAS  Google Scholar 

  25. Contento IR, Zybert P, Williams SS: Relationships of cognitive restraint of eating and disinhibition to the quality of food choices of Latina women and their young children. Prev Med. 2005, 40: 326-336. 10.1016/j.ypmed.2004.06.008.

    Article  Google Scholar 

  26. Lissau I, Breum L, Sørensen TIA: Maternal attitude to sweet eating habits and risk of overweight in offspring: a ten-year prospective population study. Int J Obes. 1993, 17: 125-129.

    CAS  Google Scholar 

  27. Albertson AM, Anderson GH, Crockett SJ, Goebel MT: Ready-to-eat cereal consumption: Its relationship with BMI and nutrient intake of children aged 4 to 12 years. J Am Diet Assoc. 2003, 103: 1613-1619. 10.1016/j.jada.2003.09.020.

    Article  Google Scholar 

  28. Nicklas T, Yang SJ, Baranowski T, Zakeri I, Berenson G: Eating patterns and obesity in children. Am J Prev Med. 2003, 25 (1): 9-16. 10.1016/S0749-3797(03)00098-9.

    Article  Google Scholar 

  29. Pastore DR, Fisher M, Friedman SB: Abnormalities in weight status, eating attitudes, and eating behaviors among urban high school students: correlations with self-esteem and anxiety. J Adolesc Health. 1996, 18, 18 (5): 312-319. 10.1016/1054-139X(95)00321-I.

  30. Andersen LF, Lillegaard ITL, Overby N, Lytle L, Klepp KI, Johansson L: Overweight and obesity among Norwegian schoolchildren: Changes form 1993 to 2000. Scand J Publ Health. 2005, 33: 99-106. 10.1080/140349404100410019172.

    Article  Google Scholar 

  31. Gillman MW, Rifas-Shiman SL, Frazier AL, Rockett HRH, Camargo CA, Field AE, Berkey CS, Colditz GA: Family Dinner and Diet Quality Among Older Children and Adolescents. Arch Fam Med. 2000, 9 (3): 235-240. 10.1001/archfami.9.3.235.

    Article  CAS  Google Scholar 

  32. Ferreira I, Van der Horst K, Wendel-Vos W, Kremers S, Van Lenthe FJ, Brug J: Environmental correlates of physical activity in youth - a review and update. Obes Rev. 2007, 8 (2): 129-154. 10.1111/j.1467-789X.2006.00264.x.

    Article  CAS  Google Scholar 

  33. Marshall SJ, Biddle SJH, Gorely T, Cameron N, Murdey I: Relationships between media use, body fatness and physical activity in children and youth: a meta-analysis. Int J Obes. 2004, 28 (10): 1238-1246. 10.1038/sj.ijo.0802706.

    Article  CAS  Google Scholar 

  34. Dietz WH, Gortmaker SL: TV or not TV: fat is the question. Pediatrics. 1993, 91 (2): 499-501.

    CAS  Google Scholar 

  35. Vandewater EA, Shim MS, Caplovitz JAG: Linking obesity and activity level with children's television and video game use. J Adolesc. 2004, 27 (1): 71-85. 10.1016/j.adolescence.2003.10.003.

    Article  Google Scholar 

  36. Cohen J: A coefficient of agreement for nominal scales. Educ Psychol Measure. 1960, 20: 37-46. 10.1177/001316446002000104.

    Article  Google Scholar 

  37. Cohen J: Weighted kappa: Nominal scale agreement with provision for scaled disagreement or partial credit. Psychol Bull. 1968, 70: 213-220. 10.1037/h0026256.

    Article  CAS  Google Scholar 

  38. Byrt T, Bishop J, Carlin JB: Bias, prevalence and kappa. J Clin Epidemol. 1993, 46 (5): 423-429. 10.1016/0895-4356(93)90018-V.

    Article  CAS  Google Scholar 

  39. Cicchetti DV, Feinstein AR: High agreement but low kappa: II. Resolving the paradoxes. J Clin Epidemiol. 1990, 43 (6): 551-558. 10.1016/0895-4356(90)90159-M.

    Article  CAS  Google Scholar 

  40. Shrout PE, Fleiss JL: Intraclass correlations: uses in assessing rater reliability . Psychol Bull. 1979 , 86: 420-428. 10.1037/0033-2909.86.2.420.

    Article  CAS  Google Scholar 

  41. Hamer RM: A SAS macro for computing intraclass correlation coefficients. Edited by: Robert M. Hamer: Associate Professor of Psychiatry and Biostatistics VCU. 1991, Copyright (C) 1990, all rights reserved., [http://ewe3.sas.com/techsup/download/stat/intracc.sas]

    Google Scholar 

  42. Bradley RH: Children’s home environments, health, behavior, and intervention efforts: A review using the HOME inventory as a marker measure. Genet Soc Gen Psychol Mon. 1993, 119: 437–490.

    Google Scholar 

  43. O'Brien M, Nader PR, Houts RM, Bradley R, Friedman SL, Belsky J, Susman E: The ecology of childhood overweight: a 12-year longitudinal analysis. Int J Obes. 2007

    Google Scholar 

  44. Gattshal ML, Shoup JA, Marshall JA, Crane LA, Estabrooks PA: Validation of a survey instrument to assess home environments for physical activity and healthy eating in overweight children. International Journal of Behavioral Nutrition and Physical Activity. 2008, 5 (2): doi:10.1186/1479-5868-5-3.

    Google Scholar 

  45. Befort C, Kaur H, Nollen N, Sulliva D, Nazir N, Choi WS, Hornberger L, Ahluwalia JS: Fruit, Vegetable, and Fat Intake among Non- Hispanic Black and Non-Hispanic White Adolescents: Associations with Home Availability and Food Consumption Settings. J Am Diet Assoc. 2006, 106 (3): 367-373. 10.1016/j.jada.2005.12.001.

    Article  Google Scholar 

  46. Hume C, Ball K, Salmon J: Development and reliability of a self-report questionnaire to examine children's perceptions of the physical environment at home and in the neighbourhood. Int J Behav Nutr Phys Act. 2006, 3: 16-21. 10.1186/1479-5868-3-16.

    Article  Google Scholar 

  47. Saelens BE, Sallis JF, Nader PR, Broyles SL, Berry CC, Taras HL: Home Environmental Influences on Children's Television Watching from Early to Middle Childhood. J Develop Behav Peds. 2002, 23 (3): 127-132.

    Article  Google Scholar 

  48. Salmon J, Timperio A, Telford A, Carver A, Crawford D: Association of Family Environment with Children’s Television Viewing and with Low Level of Physical Activity. Obes Res. 2005, 13: 1939 –1951.

    Article  Google Scholar 

Download references

Acknowledgements

We would like to acknowledge the following experts for their invaluable input towards assessing the content validity of the HHS: Dr Anne-Marie Sega-Riz; Dr Alice Ammerman; Dr Penny Gordan-Larsen; Dr Kelly Evenson and Dr Tom Baronowski. Funding for this research was provided by an unrestricted grant from "Get Kids in Action", a partnership between the Gatorade Company and The University of North Carolina at Chapel Hill, School of Public Health.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Maria J Bryant.

Additional information

Competing interests

The authors declare that they have no competing interests.

Authors' contributions

MB, JS, DW, AV and RT made substantial contributions to conception and design of the HHS; DH led the data analysis, with assistance from RT and MB; and all authors contributed to preparation of the manuscript. All authors read and approved the final manuscript.

Electronic supplementary material

12966_2007_167_MOESM1_ESM.doc

Additional file 1: Healthy Home Survey operator manual. Script and procedures for administration of the HEALTHY HOME SURVEY. (DOC 144 KB)

Rights and permissions

This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Reprints and permissions

About this article

Cite this article

Bryant, M.J., Ward, D.S., Hales, D. et al. Reliability and validity of the Healthy Home Survey: A tool to measure factors within homes hypothesized to relate to overweight in children. Int J Behav Nutr Phys Act 5, 23 (2008). https://doi.org/10.1186/1479-5868-5-23

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/1479-5868-5-23

Keywords