Table 1 Criterion measures used to validate the Out-of-School Nutrition and Physical Activity Observational Practice Assessment Tool (OSNAP-OPAT)

Minutes of moderate and vigorous physical activity per day via Actigraph accelerometer from all valid days^a

15.30 (8.37)

High reliability (ICC = 0.80) over 4 days for children’s overall physical activity [23]

1 & 2

5

How many minutes do you think the typical child at your program was physically active today?

Evidence for validity of children’s physical activity counts compared to doubly labeled water and VO₂ max [17],[24],[25]

What is the least amount of physical activity time that was offered to any group of children today?

Minutes of vigorous physical activity per day via Actigraph accelerometer from all valid days^a

1.97 (1.27)

High reliability (ICC = 0.80) over 4 days for children’s overall physical activity [23]

1 & 2

5

How many minutes do you think the typical child at your program was engaged in vigorous physical activity (i.e. activity more than a walk) today?

Evidence for validity of children’s physical activity counts compared to doubly labeled water and VO₂ max [17],[24],[25]

What is the least amount of vigorous physical activity time that was offered to any group of children today?

Percent of children engaged in moderate or vigorous physical activity during physical activity time via SOPLAY observations

68.60 (11.02)

High interrater reliability r = 0.76-0.98 [26]

1

2

How many children do you think were active when they attended physical activity time?

Moderately valid compared to accelerometer estimates for boys and girls combined r = 0.40-0.58 [27]

Direct observation of proportion of days items served at snack, including brand and size linked with nutrient database

FV: 0.56 (0.23)

Direct observation is a commonly used criterion measure for nutrition studies of school meals [28]

1

5

Was a fruit or vegetable offered at snack?

Grain: 0.86 (0.24)

Were grains served at snack?

Whole grain: 0.29 (0.24)

If grains were served at snack, were whole grains served?

Water: 0.51 (0.43)

Was water served (with a pitcher or from a cooler) at snack?

Juice: 0.36 (0.30)

Was 100% juice served at snack?

Juice >4oz: 0.29 (0.33)

If 100% juice was served at snack, was it served in a container greater than 4oz?

Proportion of snack component(s) consumed according to direct observation and photography (Coded None 0, some 1, most 2, all 3)

Water: 0.14 (0.23)

High interrater reliability ICC = 0.78-0.92 [29]

1 & 2

2

For the children who were served water, how much do you think they drank?

Valid in comparison to weighed plate waste protocol

Food items ICC = 0.86-0.94

Self-served water ICC = 0.47-0.52 [29]

Direct observation of proportion of days screen time offered during the afterschool program

TV: 0.03 (0.08)

High interrater reliability of young children’s time watching television r = 0.96 [30]

1

5

Did your program offer any recreational (i.e. internet, entertainment) computer time today?

Computer: 0.43 (0.40)

Did your program show any broadcast or cable TV or movies today?

Direct observation of number of children per day consuming foods and beverages brought in from outside the program snack

Sugary drinks: 2.11 (2.09)

High interrater agreement (87%) for item identification in elementary students’ home-packed lunches [31]

1

5

How many kids consumed sugary drinks from outside the snack program (e.g. vending, home, etc.) during the afterschool day?

Food: 9.86 (12.20)

How many kids consumed food from outside the snack program during the afterschool day?