# Table 1 Criterion measures used to validate the Out-of-School Nutrition and Physical Activity Observational Practice Assessment Tool (OSNAP-OPAT)

Measure Weekly mean (SD) Psychometric properties Phase Days Corresponding OSNAP-OPAT items
Minutes of moderate and vigorous physical activity per day via Actigraph accelerometer from all valid daysa 15.30 (8.37) High reliability (ICC = 0.80) over 4 days for children’s overall physical activity [23] 1 & 2 5 How many minutes do you think the typical child at your program was physically active today?
Evidence for validity of children’s physical activity counts compared to doubly labeled water and VO2 max [17],[24],[25] What is the least amount of physical activity time that was offered to any group of children today?
Minutes of vigorous physical activity per day via Actigraph accelerometer from all valid daysa 1.97 (1.27) High reliability (ICC = 0.80) over 4 days for children’s overall physical activity [23] 1 & 2 5 How many minutes do you think the typical child at your program was engaged in vigorous physical activity (i.e. activity more than a walk) today?
Evidence for validity of children’s physical activity counts compared to doubly labeled water and VO2 max [17],[24],[25] What is the least amount of vigorous physical activity time that was offered to any group of children today?
Percent of children engaged in moderate or vigorous physical activity during physical activity time via SOPLAY observations 68.60 (11.02) High interrater reliability r = 0.76-0.98 [26] 1 2 How many children do you think were active when they attended physical activity time?
Moderately valid compared to accelerometer estimates for boys and girls combined r = 0.40-0.58 [27]
Direct observation of proportion of days items served at snack, including brand and size linked with nutrient database FV: 0.56 (0.23) Direct observation is a commonly used criterion measure for nutrition studies of school meals [28] 1 5 Was a fruit or vegetable offered at snack?
Grain: 0.86 (0.24) Were grains served at snack?
Whole grain: 0.29 (0.24) If grains were served at snack, were whole grains served?
Water: 0.51 (0.43) Was water served (with a pitcher or from a cooler) at snack?
Juice: 0.36 (0.30) Was 100% juice served at snack?
Juice >4oz: 0.29 (0.33) If 100% juice was served at snack, was it served in a container greater than 4oz?
Proportion of snack component(s) consumed according to direct observation and photography (Coded None 0, some 1, most 2, all 3) Water: 0.14 (0.23) High interrater reliability ICC = 0.78-0.92 [29] 1 & 2 2 For the children who were served water, how much do you think they drank?
Valid in comparison to weighed plate waste protocol
Food items ICC = 0.86-0.94
Self-served water ICC = 0.47-0.52 [29]
Direct observation of proportion of days screen time offered during the afterschool program TV: 0.03 (0.08) High interrater reliability of young children’s time watching television r = 0.96 [30] 1 5 Did your program offer any recreational (i.e. internet, entertainment) computer time today?
Computer: 0.43 (0.40) Did your program show any broadcast or cable TV or movies today?
Direct observation of number of children per day consuming foods and beverages brought in from outside the program snack Sugary drinks: 2.11 (2.09) High interrater agreement (87%) for item identification in elementary students’ home-packed lunches [31] 1 5 How many kids consumed sugary drinks from outside the snack program (e.g. vending, home, etc.) during the afterschool day?
Food: 9.86 (12.20) How many kids consumed food from outside the snack program during the afterschool day?
1. aMinutes of physical activity accumulated overall (i.e., counting every minute over the activity level threshold), computed according to methods used in analysis of national surveillance data, using Freedson cut points and algorithms adapted from Troiano and colleagues [4].