Skip to main content

Table 2 Validity Measures Using Weighted Kappa Test Statistics and Percent Agreement

From: Reliability and validity of a nutrition and physical activity environmental self-assessment for child care

Self-Assessment Question

Validity

   
 

Validation Method

Kappa

95% CI

Percent Agreement

Nutrition

    

N1A. Fruit (not juice)

Document Review

0.31

0.15–0.47

43.8

N1B. Fresh, frozen, or canned in juice fruit

--

---

---

---

N1C. 100% fruit juice

Document Review

0.23

0.06–0.41

42.2

N1D. Vegetables (not including fried potatoes)

Document Review

0.06

-0.10–0.02

47.6

N1E. Dark green, red, orange, or yellow vegetables

Document Review

0.08

-0.08–0.24

12.9

N1F. Vegetables and added fat

---

---

---

---

N2A. Fried or pre-fried meats

Document Review

0.19

-0.03–0.40

59.4

N2B. Fried or pre-fried potatoes

Document Review

0.22

0.04–0.40

53.8

N2C. High fat meats

Document Review

0.06

-0.03–0.15

26.2

N2D. Lean meats

Document Review

0.13

-0.04–0.30

41.5

N3A. Outdoor drinking water

Observation

0.17

-0.01–0.35

33.3

N3B. Indoor drinking water

Observation

0.40

0.23–0.58

60.0

N3C. Sugar-sweetened beverages

Document Review

0.26

-0.12–0.64

93.7

N3D. Type of milk for children ages 2 and older

Observation

0.73

0.59–0.88

82.1

N3E. Soft-drink vending machines

Observation

0.78

0.67–0.90

83.1

N4A. Cycle menu length

Document Review

0.06

-0.17–0.29

41.8

N4B. Whole grain, high fiber

Document Review

0.03

0.00–0.05

26.6

N4C. Introduction of new foods

Observation

---

---

---

N4D. Foods from other cultures

Document Review

0.25

0.10–0.41

56.1

N5A. Satiety

Observation

0.18

0.02–0.34

36.1

N5B. Hunger

Observation

-0.01

-0.12–0.10

27.5

N5C. Encouraging children to eat

Observation

0.08

0.02–0.14

30.2

N5D. Sweets, high fat, high salt

Document Review

0.03

0.00–0.06

17.2

N5E. Food as reward

Observation

0.33

-0.08–0.73

92.5

N5F. Food used to control behavior

Observation

0.00

0.00–0.00

87.9

N6A. Parent guidelines for holidays or celebrations

Document Review

0.35

0.19–0.50

47.5

N6B. Holidays and celebrations

Document Review

---

---

---

N6C. Fundraising

Document Review

0.23

-0.09–0.55

33.3

N7A. Children and staff sit together for meals

Observation

0.22

0.10–0.35

32.8

N7B. Meals served family style

Observation

0.55

0.30–0.80

82.1

N7C. Staff consume the same foods and drinks as children

Observation

0.32

0.17–0.47

47.5

N7D. Staff consume less healthy foods in front of children

Observation

0.11

-0.11–0.34

55.9

N7E. Staff talk with children about healthy foods

Observation

0.04

-0.07–0.14

22.5

N8A. Training opportunities on nutrition for staff

---

---

---

---

N8B. Nutrition training provided by qualified professional

---

---

---

---

N8C. Staff provide nutrition education for children

---

---

---

---

N8D. Nutrition education offered to parents

---

---

---

---

N9A. Written policy on nutrition and food service

Document Review

0.76

0.60–0.92

88.1

Physical Activity

    

PA1A. Active (free) play time

Observation

0.12

-0.05–0.30

44.6

PA1B. Structured physical activity

Observation

0.34

0.10–0.59

59.7

PA1C. Outdoor active play

Observation

0.16

0.02–0.31

52.2

PA1D. PA as punishment

Observation

0.07

-0.04–0.17

36.4

PA1E. Sedentary time

Observation

0.00

0.00–0.00

0.0

PA2A. Presence of television

Observation

0.48

0.30–0.65

67.2

PA2B. TV, videos, video games

Observation

0.60

0.42–0.77

75.4

PA3A. Fixed play equipment

Observation

0.77

0.63–0.90

83.6

PA3B. Equipment safety checks

Observation

0.14

-0.14–0.24

65.9

PA3C. Portable play equipment

Observation

0.45

0.29–0.60

59.7

PA3D. Indoor play space

Observation

0.18

0.03–0.32

40.3

PA4A. Staff join in active play

Observation

0.59

0.43–0.75

69.7

PA4B. Support for PA

Observation

0.28

0.15–0.42

35.4

PA5A. Training opportunities on PA for staff

---

---

---

---

PA5B. PA training by qualified professional

---

---

---

---

PA5C. Staff provide PA education for children

---

---

---

---

PA5D. PA education offered to parents

---

---

---

---

PA6A. Written policy on PA

Document Review

0.79

0.63–0.95

90.6

  1. PA = Physical activity