- Open Access
Measurement of availability and accessibility of food among youth: a systematic review of methodological studies
International Journal of Behavioral Nutrition and Physical Activityvolume 14, Article number: 22 (2017)
Comprehensive and psychometrically tested measures of availability and accessibility of food are needed in order to explore availability and accessibility as determinants and predictors of dietary behaviors. The main aim of this systematic review was to update the evidence regarding the psychometric properties of measures of food availability and accessibility among youth. A secondary objective was to assess how availability and accessibility were conceptualized in the included studies.
A systematic literature search was conducted using Medline, Embase, PsycINFO and Web of Science. Methodological studies published between January 2010 and March 2016 and reporting on at least one psychometric property of a measure of availability and/or accessibility of food among youth were included. Two reviewers independently extracted data and assessed study quality. Existing criteria were used to interpret reliability and validity parameters.
A total of 20 studies were included. While 16 studies included measures of food availability, three included measures of both availability and accessibility; one study included a measure of accessibility only. Different conceptualizations of availability and accessibility were used across the studies. The measures aimed at assessing availability and/or accessibility in the home environment (n = 11), the school (n = 4), stores (n = 3), childcare/early care and education services (n = 2) and restaurants (n = 1). Most studies followed systematic steps in the development of the measures. The most common psychometrics tested for these measures were test-retest reliability and criterion validity. The majority of the measures had satisfactory evidence of reliability and/or validity. None of the included studies assessed the responsiveness of the measures.
The review identified several measures of food availability or accessibility among youth with satisfactory evidence of reliability and/or validity. Findings indicate a need for more studies including measures of accessibility and addressing its conceptualization. More testing of some of the identified measures in different population groups is also warranted, as is the development of more measures of food availability and accessibility in the broader environment such as the neighborhood food environment.
The promotion of healthy dietary behaviors among youth is pivotal for the prevention of overweight/obesity as well as non-communicable diseases [1, 2]; dietary behaviors learned in childhood are also found to track into adulthood . To develop effective interventions targeting different dietary behaviors, it is imperative to understand the important correlates of these behaviors. Examples of such correlates include the availability and accessibility of food, as well as other factors such as self-efficacy, food preferences, parental modeling and parental rules. Availability and accessibility of foods as potential determinants of food choice and dietary intake are recognized in most up-to-date theories aiming to predict and/or explain health behaviors including dietary behaviors. For example, social–ecological theories of health behavior  posit that the physical and social environment we live in importantly influences our health behaviors. The food environment children and adolescents live in –especially the home and school environments- define what foods are available and accessible to them. A further detailing and specification of social cognitive theory for energy balance-related behaviors including dietary behavior, was proposed by Kremers et al. . They argue that the influence of such environmental factors –including availability and accessibility- may be mediated and moderated by individual level, social and demographic determinants such as intentions, preferences, self-efficacy, and social environmental factors such as socioeconomic position, parenting, and modeling. Most major theoretical models aiming to explain food choice and dietary behaviors nowadays directly or indirectly recognize the importance of and interplay between physical environmental factors -such as availability and accessibility of foods-, social environmental factors and personal factors as important drivers of food choice and dietary behavior, which is why further insight in and overview of the measurement qualities of measures to assess these issues, is of importance. However, existing evidence suggests that there is a high variation in the conceptualization of correlates and determinants of dietary behaviors, as well as a common use of measurement instruments whose psychometric properties are not tested [6, 7]. These issues are problematic for several reasons. The first is the difficulty to identify important determinants of dietary behaviors due to the presence of significant measurement errors. These errors might be particularly pronounced in studies involving children due to varying cognitive development that might affect comprehension and recall of the construct in question. The second is the inability to compare findings across different populations and settings when different measures are used to explore the same correlate.
Availability and accessibility of foods are among the correlates most consistently associated with dietary behaviors among youth [8–11]. In addition, their importance in explaining socioeconomic differences in dietary behaviors has been evidenced by several studies using formal tests of mediation [12–14]. However, the conceptualization of these constructs has not always been uniform, in particular in relation to the concept of accessibility of foods. Availability is related to the physical presence of food; this can include foods offered/served in different settings. In a recent Delphi study aimed at clarifying food parenting practices related to snacking, different descriptions were given by experts in relation to availability including having food at home, offering food, serving food and making sure foods are prepared . Accessibility on the other hand has been defined as reflecting whether foods are available in a form and location that facilitate their consumption . The need for the food to be retrievable and ready to eat has also been highlighted . In the aforementioned Delphi study, the following descriptions were put forward by experts as being related to the accessibility of snacks: “storing snacks in a location the child cannot access on his or her own”, “not giving the child money for snacks at school”, “avoiding going to shops where snacks are available”, “putting snacks on the table all day” etc. . These conceptualizations show the different dimensions of these constructs and the need to consider these while looking at instruments measuring these concepts and while summarizing evidence related to the role of these correlates in influencing dietary behaviors.
Previous reviews have looked at measurement properties of correlates of dietary behaviors among youth including availability and/or accessibility of food [18–20]. Findings indicate that several measures of availability and accessibility of food, in particular related to the home environment, do exist. While evidence of reliability exists for several of these instruments, a lack of validity assessment was documented across reviews. The present review includes studies published from 2010 onwards not included in previous reviews of studies exploring the psychometric properties of measures of the availability and/or accessibility of food among youth. Unlike the previous reviews, the focus is only on methodological studies, and, in addition to summarizing the psychometric properties of the instruments, the review will also describe differences in the conceptualization of these correlates across studies. Providing such an overview of existing measures and their psychometric properties will help to avoid unnecessary replication of existing measures and help identify gaps in the measurement of the constructs of interest.
The systematic steps outlined in the PRISMA guidelines were used in this review . The studies of interest were those reporting on the psychometric properties of measures assessing the availability and/or accessibility of foods/drinks among youth. The location could be at home, at school and in the neighborhood (e.g. stores). Therefore, the search was conducted by combining, using the “AND” Boolean operator, five main groups of keywords: keywords for dietary behaviors (e.g. food habits, dietary habits, dietary behavior), keywords for the correlates (e.g. availability, accessibility), keywords for psychometric properties (e.g. validity, reliability), keywords for methods used (e.g. survey, questionnaire) and keywords for the population of interest (e.g. children, adolescents, youth). Within each of these categories, keywords were combined using the “OR” Boolean operator. The search strategy is available from the corresponding author upon request. The following databases were searched for relevant articles using keywords and Medical Subject Headings: Medline, Embase, PsycINFO and Web of Science. In addition, reference lists of relevant publications were manually searched.
The following inclusion criteria were used in this review: i) methodological studies where the aim/one of the aims of the study is to evaluate at least one measurement property of an instrument measuring accessibility and/or availability of food, ii) the measurement instrument relates to the availability and accessibility of food in one or more of different food environments of youth (0–18 years), iii) studies published in English in peer-reviewed journals, iv) studies published between January 2010 and March 2016.
Identification of relevant studies and data extraction
Titles and abstracts of retrieved studies were screened to assess whether inclusion criteria were met. When the abstract was considered insufficient to make conclusions about inclusion, the full text was screened. A standardized form for extraction of detailed data from each included study was developed. The data extracted included study and sample description (including year of study publication, country, age of participants, gender composition, sample size, socioeconomic background (when available)). Information about the measures used was also extracted and included the type of construct assessed (availability and/or accessibility), the name (if any) of instrument, the type of instrument (e.g. self-report questionnaire, inventory, observation form), the number of items included and the methods for item development.
Information on the conceptualization of availability and accessibility was extracted, when explicitly presented in the studies. Information regarding internal consistency, test-retest and inter-rater reliability, as well as content (including face), construct and criterion validity was also extracted when and where available. Responsiveness, which refers to the sensitivity of the measure for the assessment of change , was also of interest. Results of test-retest and inter-rater reliability, often expressed as correlation coefficients, were interpreted using Landis & Koch’s criteria: slight (r = 0.00–0.19); fair (r = 0.20–0.39); moderate (r = 0.40–0.59); substantial (r = 0.60–0.79); and almost perfect (r = 0.80–1.0) reliability. Kappa values were similarly interpreted .
Internal consistency reliability was defined as adequate when Cronbach’s alpha coefficient above 0.6 was reported . It was also considered adequate if exploratory factor analysis was conducted .
Face and content validity: face validity is an aspect of content validity and involves a subjective assessment with no specific standards as to how it should be assessed and cannot be quantified . When the study sample was clearly described, and a clear conceptualization of the measure was provided or a previously validated instrument was used or the item development and refinement is clearly presented, the instrument was described as having face validity. Use of independent experts is an aspect of the assessment of content validity ; instruments in studies where experts were used in the development or refinement phase of development were therefore considered to have content validity.
Criterion validity and construct validity can be quantified using different parameters such as correlation coefficients or percentage of agreement values. For these constructs, a correlation of 0.3 or above was considered acceptable [26, 27]; a correlation of above ≥ 0.7 was considered very good . When percentage agreement values were used, agreement levels were categorized as follows: “good to excellent” (>75%), “moderate” (60–74%), or “poor” (< 60%) .
Assessment of study quality
In addition to the quality criteria for the assessment of reliability and validity described above, assessment of the quality of the methods of item development and refinement was done.
The assessment was based on how systematic the process of item development was, including the methods that were used in the process of item development (e.g. use of items from existing instruments, use of expert opinion, use of theory, use of existing literature, use of qualitative methods etc.). It also included an assessment of whether any method was used for item refinement (e.g. pilot testing, cognitive interviews or use of experts). The following scores were given: 4 = fully systematic process of item development and use of at least one method of item refinement; 3 = fully systematic process used for item development but no method reported for item refinement OR process not fully systematic but item refinement was done; 2 = process of item development was not fully systematic and no method reported for item refinement; 1 = no systematic process was reported for the development or refinement of items. This grading was modified (to fit the type of studies included in the present review (i.e. methodological studies only) and the constructs assessed) from the grading developed by Vaughn et al. .
Two researchers (MKG, CV) independently extracted data and assessed study quality; discrepancies were resolved through discussion.
The literature search yielded a total of 1268 potentially relevant papers after removal of duplicates. After a review of titles, abstracts and full-texts, 20 studies that met the inclusion criteria were found [30–49]. No additional studies were found through manual reference searching (Fig. 1).
Characteristics of included studies
Table 1 (columns 1–3) describes the characteristics of the included studies. Most of the studies were conducted in North America (n = 13); the rest were conducted in Australia (n = 3), Europe (n = 2), China (n = 1) and Brazil (n = 1). The target population ranged from pre-school children to adolescents. The sample size varied between 13  and 730 . Participants and settings from different socioeconomic backgrounds were included in most of the included studies. In four of the studies where information was provided by parents, the sample was predominantly made up of mothers [33, 34, 37, 48]. In the studies where children or adolescents provided information, both male and female participants were included. In the studies where ethnic composition was reported [30, 31, 33, 35, 37, 43, 44, 46–48], participants with different ethnic backgrounds were included although there was a variation in the proportion of participants from different ethnic groups; one study included ethnic minorities only . The food environment in which these instruments aimed to assess availability or accessibility included the home environment (11 studies) [30–35, 37, 38, 44, 45, 48], the school (4 studies) [39, 40, 43, 47], stores (3 studies) [36, 42, 49], childcare/early care and education services (2 studies) [41, 46] and restaurants (1 study) . While 15 [30, 31, 34, 36, 39–49] studies included measures of food availability only, three included measures of both availability and accessibility [35, 37, 38] and one included a measure of accessibility only . Two studies included two different measurement instruments [37, 43]. One of the instruments used by Nepper et al.  was adapted from the instrument developed by Boles et al. . Different types of foods and beverages were included in the studies. However fruits and vegetables were the most commonly included foods.
Characteristics of measures/instruments assessing availability and accessibility
Table 1 (columns 4–6) shows the characteristics of measures/instruments included. Different types of instruments were used. Over half of the studies included self-report questionnaires; other types of instruments included were: observational tools [36, 38, 40, 43], checklists [35, 42], inventories [30, 37] and a telephone interview . The number of items included in the final instruments varied significantly between studies. Some studies used broader categories of foods and/or drinks with subcategories although reliability and validity were in some cases reported at the food category level only. For example, availability of different types of fruits was assessed by Hearst et al.; reliability was however reported at the category level (i.e. fruit) . In many of the included studies, included instruments also measured other correlates of dietary behaviors; some also included measurements of the physical activity environment.
Conceptualization of availability and accessibility
With regards to availability, measured in 18 studies, participants were either asked to report whether a certain type of food/drink was present at the time of data collection by selecting options such as yes or no, or by reporting the usual presence of foods. In some studies, the participants were asked whether the food item of interest was served/offered or sold in specified places, e.g. canteens, vending machines etc. In three studies, operational definitions of availability were provided. In the study by Izumi et al., fruits and vegetables were considered to be available if a single portion of the item was present in the store in a ready-to-eat form; for some items, if at least one variety met the criteria, the item was considered available . Nepper et al. defined availability as the existence of food in different locations regardless of whether it is readily visible or accessible to the child . Boles et al. defined availability as whether food is physically located within the home . In the study by Petty et al., the scale assessing availability of fruits and vegetables at home using parental report included items regarding parental consumption .
Accessibility was also defined in different manners in the four studies with measures of accessibility. Hearst et al. measured accessibility by exploring whether the food items were present on the kitchen counter or visible when opening the refrigerator door . Nepper et al. used the following definition for accessibility: “a food that is retrievable, ready to eat, or in a location where it is easy for a child to reach it” . In the study by Boles et al. accessibility was defined as whether the child could reach the food . Accessibility was measured in terms of beliefs about family’s affordance of food items; ability to eat everything in reasonable amount and ease of access to a variety of food items in the study by Bennaroch et al. .
Item development and refinement including quality assessment
Table 1 (column 7) provides details of the item development and refinement for each included study. Many of the included studies provided a clear description of how the items were chosen or developed and followed a systematic step in item development and refinement. Twelve of the included studies received the maximum quality score of 4 for item development and refinement [30–33, 36, 38, 39, 41–43, 46, 48], 6 studies received a score of 3 [35, 40, 44, 45, 47, 49] and two studies received a score of 2 [34, 37]. Methods used in the development or refinement of items included using or building on available instruments [30, 34, 36–38, 41, 45, 46, 49], literature review [31, 32, 39, 41, 42, 47], expert opinion [30–33, 36, 38, 39, 46, 48] and use of qualitative methods . Several studies combined two or more of these methods.
Assessment of reliability and validity
Table 2 presents the results of reliability analysis in the included studies. Reliability assessment was conducted in 14 studies. Seven studies assessed test-retest reliability [31, 33, 34, 37, 44–46]. The gap between the test and retest was 2 weeks in three studies [31, 33, 34], 1 week in two studies [37, 45] and 2–4 weeks in one study . Test-retest reliability was almost perfect in three studies [31, 33, 34]; it was moderate to substantial for all [44, 45] or most  items in the other studies. Test-retest reliability was slight to substantial in the study by Ward et al. , with most items having intra-class correlation (ICC) < 0.40 for 1-day ICC; 4-day ICC showed moderate to almost perfect reliability except for one item.
Six studies assessed internal consistency reliability [31–34, 37, 44]; an adequate internal consistency was reported in all studies where it was assessed except for 1 item in the study by Ding Ding et al. . Six studies assessed inter-rater reliability [30, 36, 38, 42, 43, 49]. Inter-rater reliability as measured by kappa revealed substantial agreement for all  or most [36, 42] of the items included. Percentage agreement was moderate to good-to-excellent for most items in the studies where it was computed [43, 49]. Items with inadequate kappa values (< 0.60) were removed in the study by Boles et al. .
All of the studies either provided a clear description of the sample and provided a clear conceptualization of the measure, or provided a clear description of the item development and/or refinement, or used a previously validated measure. Therefore all of the measures were considered as addressing face validity. In addition, nine studies used experts in the development and/or refinement of survey items [30–33, 36, 38, 39, 46, 48]; the measures were therefore considered to have content validity.
Construct validity was assessed in six studies (Table 2). Correlations of the measures with dietary behaviors were assessed in two studies [32, 44] and associations were mostly weak (r <0.30). Petty et al. reported significant associations between the availability measure and dietary behaviors (reported as regression coefficients); convergent validity (comparing response with that of the other parent) was acceptable . Acceptable construct validity was reported by Singh et al. (based on ICC and percentage agreement values) . Dewar et al. explored factorial validity using confirmatory factor analysis and found fit indices that were a good or exact fit of the hypothesized model . Boles et al. assessed the discriminant validity of their measure and found differences between obese and non-obese children for the availability and accessibility of vegetables but not for other included foods .
Criterion validity was assessed in ten studies (Table 2). The criterion measure was either direct observation by trained research staff [30, 39–41, 46] or comparison with responses reported by research staff trained to use the instrument [35, 37, 48]. In one study, digital photography was used in one sample and direct observation in the second sample . Acceptable validity was achieved for all final items in some studies [30, 40, 41, 48]. In other studies most items achieved adequate criterion validity [35, 37, 39, 46, 47].
None of the included studies included an assessment of the responsiveness of the instrument.
The review aimed to summarize the results of methodological studies exploring the psychometric properties of measures of the availability and/or accessibility of food among youth, and to describe differences in the conceptualization of these correlates across studies. A total of 20 studies were identified and only four assessed accessibility. There were differences in the conceptualization of the correlates between studies, in particular accessibility of food. Different assessments of reliability and accessibility were conducted in the included studies, and most measures were found to have adequate evidence of reliability and/or validity. None of the studies assessed responsiveness.
Determination of sample size for studies of validity and reliability assessment has long been a matter of discussion and no strong consensus exists [50, 51]. However, the sample size of some of the included studies [35, 37] appears small even by the most liberal estimates . Testing these instruments among a larger sample would therefore appear important. It is also important to report information about missing data and participation rate, which was not always the case in the included studies, as these might affect the interpretation of results. Many of the studies included participants or settings with different socioeconomic backgrounds although several studies had fairly homogeneous samples. Two studies focused on low income participants [35, 40], another included participants with a predominantly low SEP . Availability and accessibility of food are known to differ by socioeconomic position  and groups with low socioeconomic position often bear a disproportionate burden of overweight and obesity. More testing of instruments in specific socioeconomic subgroups or settings, and in particular in low socioeconomic groups and ethnic minorities, is thus needed. Studies, if powered to do so, could also look at similarities or differences between different socioeconomic subgroups within the same study.
Conceptualization of availability and accessibility
There were some variations in how availability was conceptualized in different studies, partly dependent on the setting explored. Availability and accessibility of food can be assessed in all the different environments that youth get exposed to (i.e. home, school or early care settings, stores or restaurants). Availability, which refers to the physical presence of food, should be overall conceptualized in the same manner across these settings. For the home environment, this implies that the food is present somewhere in the home; for schools, stores or restaurants, a food is available if sold or offered in these settings. However, further refinements should be made as appropriate to increase the feasibility of use of the measurement instrument as the type and volume of foods in these different settings vary significantly. In this regard, one of the issues that might arise with the assessment of availability is whether one should count all possible varieties of certain foods or whether there is some acceptable minimum number of varieties . This is particularly relevant when environments such as food stores are assessed and when food types with a large number of categories are assessed. A clear definition of availability should be provided in such cases. There were also variations in the conceptualization of accessibility across studies. Accessibility can cover different aspects  including location (e.g. fruits and vegetables put on the table vs. the refrigerator), form (e.g. whole vs. sliced fruits) and cost. There is a need to uniformly define what is meant by accessibility of food in order to compare studies and make conclusions about the most important aspects of accessibility that influence dietary behaviors. For example, visibility has been used as a dimension of accessibility ; it has also been defined as a construct by itself, separate from accessibility . Food could indeed be visible but not reachable. Even though visibility can increase a child’s attention to food, its effect might be different to accessibility which included retrievable and reachable food  so this separation of constructs appears justified. Applying a theory or framework to identify relevant items to be included in the measurement instruments and conducting thorough analyses (e.g. factor analyses) to refine items when multiple items are used appears important. Another way to develop a thorough conceptualization of these concepts is the use of expert opinion, which was used in several studies, as well as the use of qualitative methods, which can also help generate theory. Due to the few studies that assessed accessibility of food, this review cannot provide further clarity to the conceptualization of accessibility.
Reliability and validity
In most of the included studies, there was a satisfactory evidence of internal consistency reliability which could among other things reflect the thorough process of development of items via the use of literature, expert opinion, theory and previously validated instruments. Evidence of test-retest reliability was also largely satisfactory although some variation between items was observed. Although there are specific cut points for the identification of reliability values that are acceptable, the item and the type of data collected should also be taken into consideration. Parameters of reliability such as the ICC are affected by inter-individual variation, being low in homogeneous samples . This reflects the importance of assessing the ICC of an instrument in the same or comparable population to the one where it will be used . The low reliability values for the measures of the availability of some foods might also indicate factors such as the day-to-day variability in the availability of those foods and not necessarily errors in reporting from the side of participants . In the present review, the time gap between the two administrations for establishing test-retest reliability varied between studies, with a time gap of up to 4 weeks used. Although there is no single recommended time gap for the administration of instruments while assessing test-retest reliability, this time gap can have an effect on reliability estimates.
Previous reviews of measurement instruments of correlates of energy balance-related behaviors among youth have concluded that there was a limited assessment of criterion validity of measures, partly due to a lack of a gold standard [18, 23, 54, 55]. The assessment of reliability and validity is influenced by different factors including the purpose for which the instrument is used. There are two pathways through which the food environment can affect behaviors: through perceptions of the environment or through actual physical characteristics of the environment . The choice of measurement instrument and the type of validity assessed depends on which of these two aspects is explored. Perceptions are commonly measured using self-report instruments (e.g. surveys, interviews) . The objective environment is best assessed via methods such as direct observation or documentation ; or via self-report instruments validated using methods such as direct observation (i.e. criterion methods). Several of the studies included in this review which developed measurement instruments of the availability of food assessed criterion validity. The criterion measures were direct observation by trained research staff, instrument filled in by trained staff and digital photography.. This assessment of validity is very valuable as it reflects the ability of these measures to provide a good assessment of the actual presence (i.e. availability) of foods, and measures with such evidence of validity [30, 35, 37, 39–41, 46–48] should be recommended for use in future studies, or for further testing in other samples. However, criterion validity would not be useful when the interest is to explore perceptions. Unlike availability, which reflects the actual presence of foods, accessibility can involve the perception of whether what is available is actually easily accessible. For example, the assessment of the ease with which food can be consumed as well as the cost related to food, which might be components of food accessibility, are prone to differences in perceptions, making it difficult to use any criterion measure. In these cases, other measures of validity such as construct validity are more relevant, in particular when thorough empirical or theoretical information is used to define hypothesized associations. Construct validity was assessed in some studies included in this review with associations that varied from weak to strong. The weak or absent associations might reflect a genuine lack of association of the measures with the chosen outcome, in particular if the hypothesized associations were not based on thorough evidence or theory; they might also reflect lack of validity of the measures, of the hypothesized determinant (availability or accessibility) or of the outcome.
Although the present review is limited to methodological studies, none of the included studies measured responsiveness. The lack of assessment of responsiveness is of concern, as evidence about sensitivity to change of such instruments is important, in particular for intervention studies. However, assessment of responsiveness requires time and resources as follow-up of participants is required.
Direct comparison of the psychometric properties of measures of food availability and accessibility within and across reviews is complicated due to the differences such as the type of measures, number of items, food types included and the age group targeted. Previous reviews have documented the presence of measures of food availability and accessibility among youth with one or more satisfactory psychometric properties tested in specific samples [18–20]. The present review similarly identified several systematically developed measures with adequate psychometric properties including several measures with criterion validity. Some of the survey instruments/measures were culturally adapted and new for the specific context they were used in. These include the instrument by Hua et al. used to assess the Chinese food environment  and the instrument by Petty et al. which represented a translation of the parental mealtime action scale into Portuguese and used in a Brazilian sample . Hearst et al. similarly refined and validated an existing home food inventory for use in specific cultural groups (Spanish- and Somali- speaking low income families) .
Fluctuations in availability that might occur because of factors such as seasonal variations and shopping routines when actual availability is assessed (e.g. inventories) are important to consider. Surveys conducted directly after food purchase will give estimates that are different from surveys conducted at a later time point. This might be more problematic in low income settings where availability might be even more variable . Different methods can be used to address this problem. One is to measure usual availability or availability over a given period. This was done by Nepper et al. who developed both a one-time assessment tool and a 30-day home environmental survey instrument . The second option is to conduct inventories immediately after shopping episodes. Recording items on repeated occasions and adjusting data for the number of days since shopping was last done have also been suggested .
Some of the measures included, as evidence by the number of items included (Table 1), are lengthy and might require considerable time for participants to complete; their feasibility might thus be limited for some studies.
Strengths and limitations of review
This review was limited to methodological studies, as the main aim was to include instruments where the process of development as well as validity and reliability evidence were described in detail, and to focus mainly on newly developed instruments. It is however possible that there are measures with at least some evidence of test-retest reliability and/or construct validity that were missed by excluding non-methodological studies. This includes studies that might have used the instruments included in this review. The search strategy may not have captured all relevant articles. The strengths include the systematic process used in the identification of studies, the assessment of quality of processes for instrument development and evaluation, as well as the use of two independent researchers for the extraction of data and quality assessment.
Strengths and weaknesses of available instruments and recommendations for further research Several of the instruments in the included studies represented improvements from previous instruments; they were developed to increase feasibility of use and to improve use in different population groups as well as different settings (including diverse school types). While self-report questionnaires were predominant, as was also the case with older instruments assessing availability and accessibility of food among youth [18, 19], some observational tools were also developed and tested in schools, afterschool programs, stores and at home. While observational tools using trained researchers might provide the most objective assessment of the food environment, they might be costly and hence using instruments that can be filled in by parents or available personnel at school or daycare is important . There is a strong focus on the home environment in relation to the dietary behaviors of youth . In line with that, methodological studies including measures of home availability and accessibility of food appeared predominant. As the obesogenic environment is being increasingly recognized as a driver of the obesity epidemic, including among youth, more studies addressing availability and accessibility outside the home are called for, although some good measures do already exist. This is particularly true for the neighborhood food environment such as stores that might be important sources of unhealthy food, in particular among adolescents. Few studies have focused on accessibility therefore more methodological studies looking at measures of food accessibility are needed, with a focus on operationalization of the construct in addition to testing psychometric properties. Studies in countries other than the US and in particular in non-Western settings and studies looking at particular population subgroups are also needed.
This review identified 20 methodological studies exploring the psychometric properties of measures of availability and/or accessibility of food related to youth. The studies included several food items, and most studies followed systematic steps in the development of the measures. More than half of the measures focused on the home environment, and only four studies included measures of accessibility. The majority of the measures had satisfactory evidence of reliability and/or validity. However, there were variations in the conceptualization of the correlates, in particular accessibility. More studies including measures of accessibility and addressing its conceptualization are needed. More testing of some of these measures in different population groups is also warranted, as is the development of measures of food availability and accessibility in the broader environment such as the neighborhood food environment.
Preferred Reporting Items for Systematic reviews and Meta-Analyses
Swinburn BA, Sacks G, Hall KD, McPherson K, Finegood DT, Moodie ML, et al. The global obesity pandemic: shaped by global drivers and local environments. Lancet. 2011;378:804–14.
World Health Organization. Global strategy on diet, physical activity and health. Geneva: World Health Organization; 2004.
Lien N, Lytle LA, Klepp KI. Stability in consumption of fruit, vegetables, and sugary foods in a cohort from age 14 to age 21. Prev Med. 2001;33:217–26.
Sallis JF, Owen N, Fisher EB. Ecological models of health behaviour. In: Glanz Z, Rimer BK, Viswanath K, editors. Health behaviour and health education. Theory, research and practice. 4th ed. San Francisco: Jossey-Bass; 2008.
Kremers SP, de Bruijn GJ, Visscher TL, Van MW, de Vries NK, Brug J. Environmental influences on energy balance-related behaviors: a dual-process view. Int J Behav Nutr Phys Act. 2006;3:9.
McKinnon RA, Reedy J, Handy SL, Rodgers AB. Measuring the food and physical activity environments: shaping the research agenda. Am J Prev Med. 2009;36(4 Suppl):S81–5.
McKinnon RA, Reedy J, Morrissette MA, Lytle LA, Yaroch AL. Measures of the food environment: a compilation of the literature, 1990-2007. Am J Prev Med. 2009;36(4 Suppl):S124–33.
Pearson N, Biddle SJH, Gorely T. Family correlates of fruit and vegetable consumption in children and adolescents: A systematic review. Public Health Nutr. 2009;12:267–83.
Van der Horst K, Oenema A, Ferreira I, Wendel-Vos W, Giskes K, Van Lenthe F, et al. A systematic review of environmental correlates of obesity-related dietary behaviors in youth. Health Educ Res. 2007;22:203–26.
Rasmussen M, Krølner R, Klepp K-I, Lytle L, Brug J, Bere E, et al. Determinants of fruit and vegetable consumption among children and adolescents: a review of the literature. Part I: Quantitative studies. Int J Behav Nutr Phys Act. 2006;3:22.
Verloigne M, Van Lippevelde W, Maes L, Brug J, de Bourdeaudhuij I. Family and school-based correlates of energy balance-related behaviours in 10-12-year-old children: a systematic review within the ENERGY (EuropeaN Energy balance Research to prevent excessive weight Gain among Youth) project. Public Health Nutr. 2012;15:1380–95.
De Coen V, Vansteelandt S, Maes L, Huybrechts I, De Bourdeaudhuij I, Vereecken C. Parental socioeconomic status and soft drink consumption of the child. The mediating proportion of parenting practices. Appetite. 2012;59:76–80.
Hilsen M, van Stralen MM, Klepp KI, Bere E. Changes in 10-12 year old’s fruit and vegetable intake in Norway from 2001 to 2008 in relation to gender and socioeconomic status - a comparison of two cross-sectional groups. Int J Behav Nutr Phys Act. 2011;8:108.
Totland TH, Lien N, Bergh IH, Bjelland M, Gebremariam MK, Klepp KI, et al. The relationship between parental education and adolescents’ soft drink intake from the age of 11-13 years, and possible mediating effects of availability and accessibility. Br J Nutr. 2013;110:926–33.
Gevers DW, Kremers SP, de Vries NK, van Assema P. Clarifying concepts of food parenting practices. A Delphi study with an application to snacking behavior. Appetite. 2014;79:51–7.
Story M, Kaphingst KM, Robinson-O’Brien R, Glanz K. Creating healthy food and eating environments: policy and environmental approaches. Annu Rev Public Health. 2008;29:253–72.
Cullen KW, Baranowski T, Owens E, Marsh T, Rittenberry L, de Moor C. Availability, accessibility, and preferences for fruit, 100% fruit juice, and vegetables influence children’s dietary behavior. Health Educ Behav. 2003;30:615–26.
Pinard CA, Yaroch AL, Hart MH, Serrano EL, McFerren MM, Estabrooks PA. Measures of the home environment related to childhood obesity: a systematic review. Public Health Nutr. 2012;15:97–109.
Bryant M, Stevens J. Measurement of food availability in the home. Nutr Rev. 2006;64:67–76.
Ohri-Vachaspati P, Leviton LC. Measuring food environments: a guide to available instruments. Am J Health Promot. 2010;24:410–26.
Moher D, Liberati A, Tetzlaff J, Altman DG, PRISMA Group. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. Int J Surg. 2010;8:336–41.
de Vet HCW, Terwee CB, Mokkink LB, Knol DJ. Measurement in medicine. A practical guide. Cambridge: Cambridge University Press; 2011.
Landis JR, Koch GG. The measurement of observer agreement for categorical data. Biometrics. 1977;33:159–74.
Sim J, Wright C. Research in health care: concepts, designs and methods. Cheltenham: Stanley Thornes Ltd.; 2000.
Terwee CB, Bot SD, de Boer MR, van der Windt DA, Knol DL, Dekker J, Bouter LM, de Vet HC. Quality criteria were proposed for measurement properties of health status questionnaires. J Clin Epidemiol. 2007;60:34–42.
Cohen J. Statistical power analysis for the behavioral sciences. 2nd ed. Hillsdale: L. Erlbaum Associates; 1988.
Serra-Majem L, Frost Andersen L, Henríque-Sánchez P, Doreste-Alonso J, Sánchez-Villegas A, Ortiz-Andrelluchi A, Negri E, La Vecchia C. Evaluating the quality of dietary intake validation studies. Br J Nutr. 2009;102 Suppl 1:S3–9.
Saelens BE, Frank LD, Auffrey C, Whitaker RC, Burdette HL, Colabianchi N. Measuring physical environments of parks and playgrounds: EAPRS instrument development and inter-rater reliability. J Phys Act Health. 2006;3(1S):S190–207.
Vaughn AE, Tabak RG, Bryant MJ, Ward DS. Measuring parent food practices: a systematic review of existing measures and examination of instruments. Int J Behav Nutr Phys Act. 2013;10:61.
Boles RE, Burdell A, Johnson SL, Gavin WJ, Davies PL, Bellows LL. Home food and activity assessment. Development and validation of an instrument for diverse families of young children. Appetite. 2014;80:23–7.
Dewar DL, Lubans DR, Plotnikoff RC, Morgan PJ. Development and evaluation of social cognitive measures related to adolescent dietary behaviors. Int J Behav Nutr Phys Act. 2012;9:36.
Benarroch A, Perez S, Perales J. Factors influencing adolescent eating behavior: application and validation of a diagnostic instrument. Electron J Res Educ Psychol. 2011;9:1219–44.
Vyduna JL, Boushey CJ, Bruhn CM, Reicks M, Auld GW, Cluskey M, Edlefsen M, Misner S, Olson B, Schram J, Zaghloul S. Field testing a questionnaire assessing parental psychosocial factors related to consumption of calcium-rich foods by Hispanic, Asian, and Non-Hispanic white young adolescent children. Ecol Food Nutr. 2016;55:1–15.
Petty ML, Escrivão MA, Souza AA. Preliminary validation of the Parent Mealtime Action Scale and its association with food intake in children from São Paulo. Brazil Appetite. 2013;62:166–72.
Hearst MO, Fulkerson JA, Parke M, Martin L. Validation of a home food inventory among low-income Spanish- and Somali-speaking families. Public Health Nutr. 2013;16:1151–8.
Rimkus L, Powell LM, Zenk SN, Han E, Ohri-Vachaspati P, Pugach O, Barker DC, Resnick EA, Quinn CM, Myllyluoma J, Chaloupka FJ. Development and reliability testing of a food store observation form. J Nutr Educ Behav. 2013;45:540–8.
Nepper MJ, Ludemann M, Chai W. Validation of instruments to assess home food environment of pre-adolescents: a pilot study. J Nutrition Health Food Sci. 2014;2:1–9.
Boles RE, Scharf C, Filigno SS, Saelens BE, Stark LJ. Differences in home food and activity environments between obese and healthy weight families of preschool children. J Nutr Educ Behav. 2013;45:222–31.
Nathan N, Wolfenden L, Morgan PJ, Bell AC, Barker D, Wiggers J. Validity of a self-report survey tool measuring the nutrition and physical activity environment of primary schools. Int J Behav Nutr Phys Act. 2013;10:75.
Lee RM, Emmons KM, Okechukwu CA, Barrett JL, Kenney EL, Cradock AL, Giles CM, deBlois ME, Gortmaker SL. Validity of a practitioner-administered observational tool to measure physical activity, nutrition, and screen time in school-age programs. Int J Behav Nutr Phys Act. 2014;11:145.
Dodds P, Wyse R, Jones J, Wolfenden L, Lecathelinais C, Williams A, Yoong SL, Finch M, Nathan N, Gillham K, Wiggers J. Validity of a measure to assess healthy eating and physical activity policies and practices in Australian childcare services. BMC Public Health. 2014;14:572.
Izumi BT, Findholt NE, Pickus HA, Nguyen T, Cuneo MK. Inter-rater reliability of a food store checklist to assess availability of healthier alternatives to the energy-dense snacks and beverages commonly consumed by children. Child Obes. 2014;10:266–71.
Krukowski RA, Philyaw Perez AG, Bursac Z, Goodell M, Raczynski JM, Smith West D, Phillips MM. Development and evaluation of the school cafeteria nutrition assessment measures. J Sch Health. 2011;81:431–6.
Ding D, Sallis JF, Norman GJ, Saelens BE, Harris SK, Kerr J, Rosenberg D, Durant N, Glanz K. Community food environment, home food environment, and fruit and vegetable intake of children and adolescents. J Nutr Educ Behav. 2012;44:634–8.
Singh AS, Vik FN, Chinapaw MJ, Uijtdewilligen L, Verloigne M, Fernández-Alvira JM, Stomfai S, Manios Y, Martens M, Brug J. Test-retest reliability and construct validity of the ENERGY-child questionnaire on energy balance-related behaviours and their potential determinants: the ENERGY-project. Int J Behav Nutr Phys Act. 2011;8:136.
Ward DS, Mazzucca S, McWilliams C, Hales D. Use of the Environment and Policy Evaluation and Observation as a Self-Report Instrument (EPAO-SR) to measure nutrition and physical activity environments in child care settings: validity and reliability evidence. Int J Behav Nutr Phys Act. 2015;12:124.
Anzman-Frasca S, Boulos R, Hofer T, Folta SC, Koomas A, Nelson ME, Sacheck JM, Economos CD. Validation of the out-of-school-time snacks, beverages, and physical activity questionnaire. Child Obes. 2015;11:439–48.
Fulkerson JA, Lytle L, Story M, Moe S, Samuelson A, Weymiller A. Development and validation of a screening instrument to assess the types and quality of foods served at home meals. Int J Behav Nutr Phys Act. 2012;9:10.
Hua J, Seto E, Li Y, Wang MC. Development and evaluation of a food environment survey in three urban environments of Kunming. China BMC Public Health. 2014;14:235.
Cicchetti DV. The precision of reliability and validity estimates re-visited: distinguishing between clinical and statistical significance of sample size requirements. J Clin Exp Neuropsychol. 2001;23:695–700.
Javali SB, Gudaganavar NV, Raj SM. Effect of varying sample size in estimation of reliability coefficients of internal consistency. WebmedCentral Biostatistics. 2011;2:WMC001572.
Zarnowiecki DM, Dollman J, Parletta N. Associations between predictors of children’s dietary intake and socioeconomic position: a systematic review of the literature. Obes Rev. 2014;15:375–91.
Gittelsohn J, Sharma S. Physical, consumer, and social aspects of measuring the food environment among diverse low-income populations. Am J Prev Med. 2009;36:S161–5.
Brown H, Hume C, ChinAPaw M. Validity and reliability of instruments to assess potential mediators of children’s physical activity: a systematic review. J Sci Med Sport. 2009;12:539–48.
Reimers AK, Mess F, Bucksch J, Jekauc D, Woll A. Systematic review on measurement properties of questionnaires assessing the neighbourhood environment in the context of youth physical activity behaviour. BMC Public Health. 2013;13:461.
The preparation of this paper was supported by the DEterminants of DIet and Physical ACtivity (DEDIPAC) knowledge hub. This work is supported by the Joint Programming Initiative ‘Healthy Diet for a Healthy Life’. The funding agency supporting this work in Norway is the Research Council of Norway, Division for Society and Health.
The study was funded by the Norwegian Research Council. The funder had no role in the design of the study and collection, analysis, and interpretation of data.
Availability of data and materials
MKG and NL conceived the study and developed the study proposal. MKG developed the search strategy and conducted the literature search. MKG and CV extracted data and assessed study quality. MKG wrote the first draft of the manuscript. All authors have provided feedbacks during the different phases of the study, and critically read the manuscript. All authors have read and approved the final version of the manuscript.
The authors declare they have no competing interests.
Consent for publication
Ethics approval and consent to participate