Development and validation of a screening instrument to assess the types and quality of foods served at home meals
International Journal of Behavioral Nutrition and Physical Activity volume 9, Article number: 10 (2012)
Although there is growing interest in assessing the home food environment, no easy-to-use, low cost tools exist to assess the foods served at home meals, making it difficult to assess the meal component of the food environment. The aim of this study was to develop and validate a user-friendly screener to assess the types of foods served at home meals.
Primary food preparing adults (n = 51) participated in a validation study in their own homes. Staff and participants independently completed a screener as participants cooked dinner. The screener assessed the types of foods offered, method(s) of preparation, and use of added fats. Two scale scores were created: 1) to assess offerings of foods in five food groups (meat and other protein, milk, vegetables, fruit, grains), 2) to assess the relative healthfulness of foods based on types offered, preparation method, and added fats. Criterion validity was assessed comparing staff and participant reports of individual foods (kappa (k)) and scale scores (Spearman correlations).
Criterion validity was high between participants' and staffs' record of whether major food categories (meat and other protein, bread and cereal, salad, vegetables, fruits, dessert) were served (k = 0.79-1.0), moderate for reports of other starches (e.g., rice) being served (k = 0.52), and high for the Five Food Group and Healthfulness scale scores (r = 0.75-0.85, p < .001).
This new meal screening tool has high validity and can be used to assess the types of foods served at home meals allowing a more comprehensive assessment of the home food environment.
Studies have shown that compared to foods consumed at home, away-from-home foods are higher in fat and calories  and contribute to poorer dietary quality and overweight status [2–6]. Thus, health and nutrition experts recommend limiting eating out and encourage more frequent home meal preparation . The importance of the home environment in influencing food intake and weight status has prompted the development of new valid instruments to assess food availability within the home food environment [8, 9]. Although these instruments assess foods available in the home, no validated instruments exist to assess what types of foods are served specifically at meals within the home. Foods served at meals may include a subset of those available within the home. Moreover, little is known about how these foods are prepared which may be important in regard to fat content.
The family meal component of the home food environment has been gaining national attention, particularly because research has shown that family meals positively impact the dietary intake of children [10–17] and may be associated with overweight status, particularly among young children [10, 15, 18, 19]. Because almost 70% of calories and 80% of snacks consumed by children ages 6-11 years are eaten in the home , developing measures to assess the types of foods served at home meals is an important first step in gaining a better understanding of the influence of the home environment on children's food intake . Although assessment of dietary intake at specific meals could be conducted with traditional methods of dietary recall interviews, this methodology is expensive and time- and labor-intensive. Thus, a practical, easy-to-use valid instrument is needed for these assessments as the health promotion field encourages and advocates healthy lifestyle changes for families.
The purpose of this study was to develop and validate a self-administered screening instrument to assess the types of foods served at meals in the home setting. Additional goals included developing an instrument that was easy to self-administer using a format that captured a variety of foods, and that could provide summary indicators of food quality.
Primary meal preparing adults (one per home where a child between the ages of 8 and 18 years resided) were recruited from the community using flyers posted at 19 Minneapolis Park and Recreation Centers to complete the screening instrument as they made a typical evening meal ("meal" was undefined) in their home. Participants were also invited to participate in three other studies at the time of screening, including validation of a home food inventory  and validation of home physical activity and media equipment  using similar methodology. Trained research staff traveled to the participants' homes to obtain written consent and independently complete the instrument while observing the participant preparing the meal. The screener typically took 5-15 min to complete, depending on the number of ingredients included in the meal. Participants did not receive "training" on how to complete the screener as the intent was for the screener's written directions to be self-explanatory to facilitate independent completion. Instructions indicated to list all foods and beverages prepared or made available as part of the evening meal, even if only one person ate it. Participants received a $30 gift card for their participation. The University of Minnesota's Institutional Review Board approved this study.
The validation sample consisted of 51 adults aged 23-53 years (M = 39.4, SD = 7.0; 94% female). Sixty-eight percent of the sample was white, followed by African American (14%), American Indian (6%), mixed race/ethnicity (6%), Latino (4%), and Asian (2%). Over half (62%) had a college degree, 26% had some college or vocational training and 12% had a high school degree or less.
Meal screener: development
Development of the screening instrument began with the investigators drafting items to reflect categories of foods that might be served at home meals and those likely to be useful to assess relative healthfulness. Preset food categories were used to facilitate instrument completion, scoring and analysis. Opinions from four internationally-respected nutrition experts were requested for further instrument development and assessment of face validity (see acknowledgements). The instrument was then revised to more finely discriminate between more and less healthful foods (e.g., by providing more options for sauces that were clearer in regard to fat content), account for mixed dishes, and clarify the instructions. Field testing of the instrument was conducted with five adults to inform revisions for the final version regarding ease of completion and to identify any foods that were difficult to include on the form.
Meal screener: final version
The final screener included an open-ended section for participants to write in foods that were served at the evening meal. Examples were provided to indicate that they should list main course, side dishes, beverages and dessert, if applicable. This initial step provided the participant with a reminder of what was served to assist with subsequent questions regarding preparation. The next section of the screener asked specific questions about the types of foods served and method of preparation in preset major food categories: 1) meat or other protein, 2) bread or cereal, 3) starches other than bread (e.g., pasta, noodles, potatoes, rice, pizza dough), 4) salad, 5) vegetables (other than potato), 6) fruit, 7) dessert, and 8) beverages. Foods within each major food category (e.g., pork (as food subcategory) within the meat/protein major food category) were presented in a checklist format (yes/no if served) and included a checklist for preparation options and added fats (e.g., butter, sauce).
Table 1 describes the specific foods included in each major food category. For example, for the protein category, a participant would check "yes" if meat or other protein was served (i.e., served major food category) and then be prompted to check the specific type of food that was served within that category (e.g., poultry food subcategory). Then, he/she was instructed to check response options regarding method of preparation and whether or not fats were added during the cooking or serving process.
Two scale scores were created to summarize home meal quality; one to assess offerings of foods within the five major food groups of the Food Guide Pyramid  (meat or other protein, milk, vegetables, fruit, grains) and another to assess the healthfulness of foods based on types of foods offered, preparation method, and added fats. For the Five Food Group score, participants were given one point for serving at least one food in each food group (range = 0-5). To more fully examine food offerings to include methods of food preparation and added fats, for the Healthfulness scale score, participants were given a point for serving a food from each of the major food categories and a point for a healthy preparation method (e.g., baking); a point was subtracted if a high-calorie sauce was added (range = 0-10). The screener is available from the corresponding author upon request.
Criterion validity was assessed by comparing participants' and research staffs' responses on the screener. Consistent in research of criterion validity, the research staff report was considered the "gold standard"  as they were trained on how to use the screener. Kappa and Spearman correlation statistics were used to evaluate these comparisons for individual foods, food categories and scale scores (Five Food Group and Healthfulness scores), respectively. Kappa statistics greater than 0.60 reflect substantial agreement. To summarize these results, we calculated the average kappas (across individual foods) within major food categories. All analyses were conducted in SAS (v9.1, SAS Institute, Inc., Cary, NC, 2003).
As shown in Table 2, the most frequently served major food categories at the home evening meal were meat or other protein and vegetables. Less than half of participants reported serving bread, salad or fruits. Dessert was served by about half of participants while beverages were served by almost all participants. In regard to the Five Food Group score, about one-third (37%) of participants reported serving foods from four of the five food groups, followed by foods from three food groups (27%), five food groups (18%), and two food groups (12%); 4% reported serving from one food group, and 2% did not serve foods from any of the five food groups. The Healthfulness scale score average was about 5 out of 10 (M = 4.6, SD = 1.8).
Table 2 provides a description of criterion validity (kappa statistics) with comparisons of agreement between the trained staff data (gold standard) and participants' data regarding whether or not a food was served from a major food category (e.g., meat or other protein; column 3), across foods within each major food category (food subcategory, column 4), method of preparation (column 5), and added fats (column 6). Kappa statistics between participants' and staffs' record of whether meat or other protein, beverages, vegetables, dessert, bread, salad, fruits were served ranged from 0.79 (vegetables) to 1.0 (meat or other protein), while the kappa value for serving other starches was 0.52. Average kappa values for each major food category ranged from 0.74 (fruits) to 0.87 (meat or other protein). Average kappa values for method of preparation ranged from 0.53 (vegetables) to 0.77 (fruits) and values for added fats ranged from 0.59 (other starches) to 0.81 (vegetables). Comparisons between staff and participant scores for Five Food Group and Healthfulness scale scores resulted in correlations of 0.75 (p < .001) and 0.85 (p < .001), respectively.
This study describes the development and validation of an instrument to assess the types of foods served at home for the evening meal. The screener was developed to include a full range of foods that may be served at meals, particularly the evening meal, and a variety of healthful and unhealthful preparation methods. Study findings indicate the screening instrument has substantial criterion validity, and the checklist-type format was easily completed by participants in their homes.
The new screening instrument demonstrated criterion validity with moderate to high kappa values between participants' and staffs' reports of foods served at meals in the home and significant correlations between their scale scores regarding foods from the five major food groups and the healthfulness of foods. These findings and the fact that participants easily completed the screener suggests this tool can be used to effectively assess the types of foods served at meals. Costs and time associated with data collection in research studies could be reduced since participants are able to complete the screener in their own homes without research staff.
The Five Food Group and Healthfulness scales and most of the food categories showed substantial criterion validity; however, two comparisons resulted in kappas of less than 0.60. The general question of whether or not other starches were served had only moderate criterion validity. A detailed examination of these data indicates that staff were more likely to code "other starch" as present compared to participants. Perhaps the term "starch" is less commonly known among the general public even though pasta, noodles, potatoes, rice, and pizza dough were listed as examples. More research is needed in this area to assess how best to describe starchy carbohydrates on surveys. The suboptimal agreement between staff and participants regarding preparation method for vegetables resulted from the greater likelihood of staff reports of frying vegetables compared to participant reports. It may be that participants only recognize frying in deep fat as "frying." Future versions of the screener may separate out frying from sautéing to help increase validity.
The high average validity indices for added fats for vegetables and bread suggest that the screening instrument may be useful for studies interested in reducing butter and sauces as a form of weight control or to reduce cholesterol. In addition, the ease of completion with regard to time (participants completed the form as they prepared the meal) and convenience and the low cost of the data collection are great assets of this tool for population-based studies, particularly those promoting healthful foods such as salads, fresh vegetables, fruit for dessert, and milk consumption. Furthermore, although the screener was developed to assess the evening meal, further testing should be completed to evaluate its use for breakfast or lunch meals made at home.
To interpret the findings of this study, several issues warrant discussion. Study participants were self-selected volunteers and may not represent the general population in terms of motivation to complete the instrument and the types of meals prepared. In fact, some adults participated in several validation studies conducted by the research team, perhaps indicating a highly motivated group that may have been more conscientious in completing the screener, although none of our data or anecdotal evidence support this bias. Although the authors carefully considered many food varieties and those from different cultures, the screener may not capture all foods served at home meals and all methods of preparation (e.g., microwave cooking of protein) used by some families. Mixed dishes that contained many ingredients (e.g., soups) were more difficult to code on the instrument; however, problems were lessened when specific instructions were added during screener development. The instrument also includes additional "other" spaces for coding that could be used for foods common to a particular population. In addition, the screener does not assess the quantity of foods served at meals since participants either check "yes" or "no." However, our measure of a wide variety of different types of foods served at meals is similar to the variety score of the Healthy Eating Index  and may be linked to better diet quality. Our aim was to create a brief screener and keep response burden to a minimum. Attempting to collect data on more foods, quantities of foods, or more specifics about foods such as brand names would have compromised our aim. Lastly, the screener does not measure what was eaten at other eating occasions or at meals, only what was served at mealtime. In addition, the screener was designed to assess foods that are prepared in the home, limiting its utility for meals that are purchased elsewhere (i.e., takeout) but eaten in the home. Future research is needed to address the present study's limitations.
To our knowledge, this meal screener is the first tool in the literature to assess the types of foods served at home meals and it proved to be a valid and participant-friendly tool that may be useful for research studies aiming to understand the home food environment, particularly those that are community-based where data collection is expensive and time-consuming. The screener adds a new and important meal component to the limited number of validated instruments that assess the home food environment. Furthermore, identifying the types and quality of foods served at home meals can help inform appropriate intervention strategies for individual households or might identify targets for public health messages. Future research should include more specific indices of healthfulness and assess the instrument's construct validity and test-retest reliability.
Guthrie JF, Lin BH, Frazao E: Role of food prepared away from home in the American diet, 1977-78 versus 1994-96: changes and consequences. J Nutr Educ Behav. 2002, 34: 140-150. 10.1016/S1499-4046(06)60083-3.
Lin B, Guthrie J, Frazao E: Quality of children's diets at and away from home: 1994-96. Food Rev. 1999, 22: 2-10.
Ayala GX, Rogers M, Arredondo EM, Campbell NR, Baquero B, Duerksen SC, Elder JP: Away-from-home food intake and risk for obesity: examining the influence of context. Obesity (Silver Spring). 2008, 16: 1002-1008. 10.1038/oby.2008.34.
Thompson OM, Ballew C, Resnicow K, Must A, Bandini LG, Cyr H, Dietz WH: Food purchased away from home as a predictor of change in BMI z-score among girls. Int J Obes Relat Metab Disord. 2004, 28: 282-289.
Downs SM, Arnold A, Marshall D, McCargar LJ, Raine KD, Willows ND: Associations among the food environment, diet quality and weight status in Cree children in Quebec. Public Health Nutr. 2009, 12: 1504-1511. 10.1017/S1368980008004515.
Kant AK, Graubard BI: Eating out in America, 1987-2000: trends and nutritional correlates. Prev Med. 2004, 38: 243-249. 10.1016/j.ypmed.2003.10.004.
U.S. Department of Health and Human Services: Strategic plan for NIH obesity research: a report of the NIH Obesity Research Task Force. 2004, Bethesda, MD: U.S. Department of Health and Human Services, National Institutes of Health, NIH Publication No. 04-5493
Bryant M, Stevens J: Measurement of food availability in the home. Nutr Rev. 2006, 64: 67-76. 10.1111/j.1753-4887.2006.tb00189.x.
Fulkerson JA, Nelson MC, Lytle L, Moe S, Heitzler C, Pasch KE: The validation of a home food inventory. Int J Behav Nutr Phys Act. 2008, 5: 55-10.1186/1479-5868-5-55.
Gable S, Chang Y, Krull JL: Television watching and frequency of family meals are predictive of overweight onset and persistence in a national sample of school-aged children. J Am Diet Assoc. 2007, 107: 53-61. 10.1016/j.jada.2006.10.010.
Boutelle KN, Fulkerson JA, Neumark-Sztainer D, Story M, French SA: Fast food for family meals: relationships with parent and adolescent food intake, home food availability and weight status. Public Health Nutr. 2007, 10: 16-23.
Larson NI, Neumark-Sztainer D, Hannan PJ, Story M: Family meals during adolescence are associated with higher diet quality and healthful meal patterns during young adulthood. J Am Diet Assoc. 2007, 107: 1502-1510. 10.1016/j.jada.2007.06.012.
Boutelle KN, Birnbaum AS, Lytle LA, Murray DM, Story M: Associations between perceived family meal environment and parent intake of fruit, vegetables, and fat. J Nutr Educ Behav. 2003, 35: 24-29. 10.1016/S1499-4046(06)60323-0.
Videon TM, Manning CK: Influences on adolescent eating patterns: the importance of family meals. J Adolesc Health. 2003, 32: 365-373. 10.1016/S1054-139X(02)00711-5.
Taveras EM, Rifas-Shiman SL, Berkey CS, Rockett HR, Field AE, Frazier AL, Colditz GA, Gillman MW: Family dinner and adolescent overweight. Obes Res. 2005, 13: 900-906. 10.1038/oby.2005.104.
Gillman MW, Rifas-Shiman SL, Frazier AL, Rockett HR, Camargo CA, Field AE, Berkey CS, Colditz GA: Family dinner and diet quality among older children and adolescents. Arch Fam Med. 2000, 9: 235-240. 10.1001/archfami.9.3.235.
Utter J, Scragg R, Schaaf D, Mhurchu CN: Relationships between frequency of family meals. BMI and nutritional aspects of the home food environment among New Zealand adolescents. Int J Behav Nutr Phys Act. 2008, 5: 50-10.1186/1479-5868-5-50.
Fulkerson JA, Neumark-Sztainer D, Hannan PJ, Story M: Family Meal Frequency and Weight Status Among Adolescents: Cross-sectional and 5-year Longitudinal Associations. Obesity (Silver Spring). 2008, 16: 2529-2934. 10.1038/oby.2008.388.
Sen B: Frequency of family dinner and adolescent body weight status: evidence from the national longitudinal survey of youth, 1997. Obesity (Silver Spring). 2006, 14: 2266-2276. 10.1038/oby.2006.266.
Briefel RR, Wilson A, Gleason PM: Consumption of low-nutrient, energy-dense foods and beverages at school, home, and other locations among school lunch participants and nonparticipants. J Am Diet Assoc. 2009, 109: S79-90. 10.1016/j.jada.2008.10.064.
Sirard JR, Nelson MC, Pereira MA, Lytle LA: Validity and reliability of a home environment inventory for physical activity and media equipment. Int J Behav Nutr Phys Act. 2008, 5: 24-10.1186/1479-5868-5-24.
Shaw A, Fulton L, Davis C, Hogbin M: Using the food guide pyramid: a resource for nutrition educators.
Cronbach LJ: Test validation. Educational Measurement. Edited by: Thorndike RL. 1971, Washington, DC: American Council on Education, 2
Basiotis PP, Carlson A, Gerrior SA, Juan WY, Lino M: The healthy eating index: 1999-2000. 2002, U.S. Department of Agriculture, Center for Nutrition Policy and Promotion, Publication No. CNPP-12
This study was supported by the University of Minnesota Graduate School's Grant-in-Aid program (PI: Jayne A. Fulkerson) and as part of the IDEA study (PI: Leslie Lytle) funded by NCI's Transdisciplinary Research in Energetics and Cancer Initiative (NCI Grant 1 U54 CA116849-01, Examining the Obesity Epidemic Through Youth, Family, and Young Adults, PI: Robert Jeffery).
The authors would like to thank Lisa Harnack, Dianne Neumark-Sztainer, Marla Reicks, and Simone French for their expert advice on the layout, content and initial development of the meal screening instrument.
The authors declare that they have no competing interests.
JF conceptualized the study design, drafted the original screening tool, field tested the tool, requested input from experts in the field, trained staff for data collection, conducted the data analysis, and drafted the manuscript. LL and MS assisted with conceptualizing the study design and developing the screening tool as well as revising the manuscript for critical intellectual content. SM coordinated all data collection, data cleaning and data entry, contributed to protocol/instrument revisions and revised the manuscript for critical intellectual content. AS collected data and contributed to protocol/instrument revisions. AW contributed to instrument revisions and concept scoring. All authors have given final approval of the final version of the manuscript.
About this article
Cite this article
Fulkerson, J.A., Lytle, L., Story, M. et al. Development and validation of a screening instrument to assess the types and quality of foods served at home meals. Int J Behav Nutr Phys Act 9, 10 (2012). https://doi.org/10.1186/1479-5868-9-10