Skip to main content

Table 3 Reliability Measures Using Weighted Kappa Test Statistics and Percent Agreement

From: Reliability and validity of a nutrition and physical activity environmental self-assessment for child care

Self-Assessment Question

Test-Retest Reliability

Inter-Rater Reliability

 

Kappa

95% CI

Percent Agreement

Kappa

95% CI

Percent Agreement

Nutrition

      

N1A. Fruit (not juice)

0.35

0.20–0.51

57.0

0.54

0.30–0.79

68.4

N1B. Fresh, frozen, or canned in juice fruit

0.30

0.08–0.51

73.4

0.40

0.06–0.73

76.3

N1C. 100% fruit juice

0.44

0.30–0.58

60.2

0.65

0.44–0.86

75.7

N1D. Vegetables (not including fried potatoes)

0.39

0.23–0.55

65.1

0.30

0.02–0.58

61.1

N1E. Dark green, red, orange, or yellow vegetables

0.09

-0.05–0.24

50.0

0.35

0.11–0.59

58.3

N1F. Vegetables and added fat

0.38

0.23–0.52

55.3

0.20

-0.06–0.47

54.3

N2A. Fried or pre-fried meats

0.27

0.11–0.42

62.1

0.28

0.05–0.51

62.2

N2B. Fried or pre-fried potatoes

0.42

0.27–0.58

69.8

0.59

0.34–0.83

78.4

N2C. High fat meats

0.31

0.16–0.46

62.6

0.37

0.09–0.62

67.5

N2D. Lean meats

0.28

0.14–0.43

53.4

0.39

0.15–0.63

55.6

N3A. Outdoor drinking water

0.57

0.45–0.68

60.8

0.63

0.42–0.83

69.4

N3B. Indoor drinking water

0.41

0.26–0.57

66.4

0.67

0.47–0.87

73.7

N3C. Sugar-sweetened beverages

0.48

0.10–0.87

96.2

0.85

0.54–1.00

97.3

N3D. Type of milk for children ages 2 and older

0.75

0.64–0.87

83.3

0.86

0.74–0.98

86.9

N3E. Soft-drink vending machines

0.86

0.79–0.94

89.8

0.90

0.79–1.00

92.1

N4A. Cycle menu length

0.59

0.44–0.73

71.8

0.60

0.36–0.84

78.9

N4B. Whole grain, high fiber

0.39

0.25–0.53

53.3

0.39

0.16–0.62

52.6

N4C. Introduction of new foods

0.22

0.08–0.37

50.5

0.48

0.26–0.70

60.5

N4D. Foods from other cultures

0.24

0.08–0.40

53.3

0.49

0.29–0.70

60.5

N5A. Satiety

0.33

0.17–0.49

54.6

0.56

0.36–0.75

60.5

N5B. Hunger

0.14

0.00–0.28

34.3

0.61

0.42–0.80

63.2

N5C. Encouraging children to eat

0.26

0.10–0.41

59.6

0.45

0.18–0.72

68.4

N5D. Sweets, high fat, high salt

0.29

0.13–0.44

65.1

0.59

0.35–0.83

79.0

N5E. Food as reward

0.19

-0.09–0.46

89.0

0.32

0.06–0.58

94.7

N5F. Food used to control behavior

1.00

1.00–1.00

100.0

1.00

1.00–1.00

100.0

N6A. Parent guidelines for holidays or celebrations

0.41

0.27–0.55

54.5

0.48

0.23–0.72

61.1

N6B. Holidays and celebrations

0.31

0.16–0.46

48.6

0.54

0.34–0.74

60.5

N6C. Fundraising

0.23

0.09–0.36

42.0

0.42

0.16–0.68

61.8

N7A. Children and staff sit together for meals

0.60

0.49–0.71

62.4

0.68

0.51–0.85

68.4

N7B. Meals served family style

0.77

0.67–0.88

81.5

0.85

0.73–0.97

86.8

N7C. Staff consume the same foods and drinks as children

0.51

0.40–0.62

54.1

0.40

0.18–0.62

60.5

N7D. Staff consume less healthy foods in front of children

0.36

0.18–0.53

73.8

0.45

0.17–0.73

757

N7E. Staff talk with children about healthy foods

0.23

0.08–0.37

46.3

0.58

0.39–0.77

68.4

N8A. Training opportunities on nutrition for staff

0.30

0.14–0.45

51.4

0.50

0.28–0.71

56.8

N8B. Nutrition training provided by qualified professional

0.33

0.19–0.47

44.0

0.50

0.29–0.72

60.5

N8C. Staff provide nutrition education for children

0.22

0.08–0.36

41.5

0.56

0.35–0.77

60.5

N8D. Nutrition education offered to parents

0.07

-0.11–0.24

54.9

0.29

0.01–0.57

67.6

N9A. Written policy on nutrition and food service

0.44

0.28–0.61

65.6

0.53

0.29–0.78

67.7

Physical Activity

      

PA1A. Active (free) play time

0.41

0.27–0.56

66.1

0.55

0.32–0.78

71.1

PA1B. Structured physical activity

0.24

0.09–0.39

57.8

0.64

0.48–0.80

76.3

PA1C. Outdoor active play

0.39

0.22–0.56

75.2

0.67

0.40–0.94

89.5

PA1D. PA as punishment

0.19

0.04–0.34

48.2

0.47

0.21–0.74

72.2

PA1E. Sedentary time

0.38

0.18–0.57

77.1

0.44

0.09–0.79

78.9

PA2A. Presence of television

0.70

0.54–0.86

87.4

0.50

0.29–0.72

73.0

PA2B. TV, videos, video games

0.63

0.50–0.76

77.0

0.72

0.49–0.94

83.8

PA3A. Fixed play equipment

0.46

0.30–0.63

63.3

0.56

0.30–0.81

65.8

PA3B. Equipment safety checks

0.37

0.20–0.54

69.8

0.56

0.29–0.83

79.0

PA3C. Portable play equipment

0.34

0.20–0.48

52.3

0.60

0.42–0.78

65.8

PA3D. Indoor play space

0.31

0.16–0.47

61.5

0.85

0.68–1.00

92.1

PA4A. Staff join in active play

0.32

0.18–0.46

50.9

0.46

0.25–0.67

57.9

PA4B. Support for PA

0.17

0.04–0.31

37.1

0.62

0.43–0.81

64.9

PA5A. Training opportunities on PA for staff

0.33

0.19–0.47

44.8

0.63

0.45–0.81

60.5

PA5B. PA training by qualified professional

0.32

0.17–0.48

50.0

0.66

0.51–0.82

62.2

PA5C. Staff provide PA education for children

0.45

0.31–0.58

52.3

0.45

0.23–0.67

52.6

PA5D. PA education offered to parents

0.25

0.08–0.43

73.1

0.55

0.30–0.79

81.1

PA6A. Written policy on PA

0.37

0.19–0.54

62.4

0.71

0.50–0.93

82.4

  1. PA = Physical activity