Skip to main content

Table 4 Inter-rater Reliability for MAPS-Global Single Item Indicators, Subscales and Overall Summary Scores

From: Development and reliability of a streetscape observation instrument for international use: MAPS-global

 

# items (range of scores)

Sample items and overall subscale description

ICC/Kappa, Confidence Interval

Destinations & Land Use (DLU)

Positive Destinations & Land Use

Residential Mix

4 (0–3)

Single family, multi-family, mixed, apartment over retail

.83 (.79, .85)

Shops

8 (0–28)

Grocery, convenience store, bakery, drugstore, other retail, shopping mall, strip mall, open air market

.97 (.96, .97)

Restaurant-Entertainment

4 (0–20)

Fast food, sit-down, café, entertainment

.90 (.88, .92)

Institutional-Service

3 (0–15)

Bank, health-related professional, other service

.94 (.92, .95)

Worship

1 (0–5)

Place of worship

.91 (.89, .92)

School

1 (0–5)

School land use

.98 (.97, .98)

Public Recreation

4 (0–20)

Public indoor, public outdoor facility, park, trail

.83 (.80, .86)

Private Recreation

2 (0–10)

Private indoor, private outdoor facility

.84 (.81, .87)

Pedestrian Streeta

1 (0–5)

Pedestrian street/zone

.89 (.87, .91)

Negative Destinations & Land Use

Age-restricted bar or nightclub

1 (0–5)

Age-restricted bar/nightclub

.93 (.91, .94)

Liquor or alcohol store

1 (0–5)

Liquor or alcohol store

.54 (.47, .61)

Positive DLU

27 (0–111)

Sum of the positive DLU subscales

.96 (.95, .97)

Negative DLU

2 (0–10)

Sum of the negative DLU subscales

.92 (.90, .93)

Overall DLU

29b

Positive DLU - Negative DLU

.96 (.96, .97)

Streetscape Characteristics

Transit

9 (0–13)

Number of stops, transit type and amenities (bench, shelter, and timetable)

.90 (.89, .92)

Traffic calming

1 (0–5)

Signs, circles, speed tables, speed humps, curb extension

.90 (.88, .91)

Roll-over curba

1 (0–1)

Roll-over curbs

.84 (.81, .87)

Trash bins

1 (0–1)

Public trash bins

.89 (.87, .91)

Benches

1 (0–1)

Benches or other places to sit

.81 (.78, .84)

Bicycle racks

1 (0–1)

Bicycle racks

.83 (.80, .86)

Bicyle lockers

1 (0–1)

Secure bicycle access lockers or compounds

Too rare to calculate Kappa

Bicycle sharing

1 (0–1)

Bicycle docking station for bike sharing

.97 (.96, .98)

Kiosks

1 (0–1)

Kiosks or information booths

.97 (.96, .98)

Hawkers

1 (0–1)

Hawkers/shops/carts

.97 (.96, .97)

Positive Streetscape

17c (0–25)

Sum of positive streetscape

.93 (.91, .94)

Aesthetics & Social Characteristics

Presence of anyone walkinga

1 (0–1)

Presence of anyone walking

.59 (.53, .65)

Positive Aesthetics/Social

4 (0–4)

Hardscape, water, softscape, landscaping

.78 (.74, .82)

Negative Aesthetics/Social

6 (0–6)

Buildings not maintained, graffiti, litter, dog fouling, physical disorder, highway near

.80 (.76, .83)

Overall Aesthetics/Social

10d

Positive Aesthetics/Social - Negative Aesthetics/Social

.81 (.77, .84)

Crossings/Intersections

Positive Crossing Subscales

Crosswalk Amenities

7 (0–7)

Crossing aids, marked crosswalk, high visibility striping, different material, curb extension, raised crosswalk, refuge islands

.99 (.99, .99)

Curb Quality & Presence

3 (0–6)

Curb presence, curb ramps lined up, tactile paving

.95 (.94, .95)

Intersection Control & Signage

7 (0–7)

Yield signs, stop signs, traffic signal, traffic circle, pedestrian walk signals, push buttons, countdown signal

.97 (.96, .97)

Bicycle Features

3 (0–3)

Waiting area, bike lane crossing the crossing, bike signal

.94 (.93, .95)

Overpass

1 (0–1)

Crossing on pedestrian overpass, bridge

.80 (.77, .82)

Mid-segment crossinga

1 (0–1)

Unanticipated mid-segment crossing

Too rare to calculate Kappa

Negative Crossing Subscales

Road Width

1 (0–2)

Distance of crossing leg

.99 (.98, .99)

Positive Crossing

21 (0–24)

Sum of the positive crossing subscales

.98 (.98, .98)

Negative Crossing

1 (0–2)

Sum of the negative crossing subscales

.99 (.98, .98)

Overall Crossing

22e

Positive Crossing - Negative Crossing

.98 (.97, .98)

Street Segments

Positive Segment Subscales

Building Height-Setback

4 (0–10)

Building height, smallest and largest setback

.97 (.97, .97)

Segment typea

1 (0–1)

Segment type: residential or commercial

.96 (.96, .97)

Building Height-Road Width Ratio

5 (0–3)

Building height, setback and road width

.80 (.78, .82)

Buffer

2 (0–5)

Parking along street, buffer

.92 (.91, .92)

Bike Infrastructure

3 (0–5)

Bike lane presence, quality, signage

.95 (.94, .96)

Shade

3 (0–6)

Number of trees, sidewalk coverage, shade

.93 (.93, .94)

Sidewalk

2 (0–6)

Sidewalk presence and width

.93 (.92, .94)

Pedestrian infrastructure

5 (0–5)

Mid-segment crossing, pedestrian bridge, covered place to walk, street lights

.93 (.92, .93)

Building Aesthetics and Design

1 (0–2)

Street windows

.84 (.82, .85)

Informal Path or Shortcut

1 (0–1)

Informal path connecting to something else

.86 (.84, .87)

Hawkers/Shops

1 (0–2)

Hawkers/shops on sidewalk/ped zone

.73 (.71, .76)

Negative Segment Subscales

Sidewalk

7 (0–13)

Non-continuous sidewalk, trip hazards, obstructions, cars blocking walkway, slope, gates, driveways

.96 (.95, .96)

Positive Segment

27 (0–45)

Sum of the positive segment subscales

.97 (.97, .98)

Negative Segment

7 (0–13)

Sum of the negative segment subscales

.96 (.95, .96)

Overall Segment

34f

Positive Segment - Negative Segment

.98 (.98, .98)

Overall Summary and Grand Scores

Overall Positive

102 (0–210)

Positive DLU, positive streetscape, positive aesthetics/social, positive segment (mean of all segments), positive crossing (mean of all segments).

.96 (.95, .97)

Overall Negative

16 (0–22)

Negative DLU, negative aesthetics/social, negative segment (mean of all segments), negative crossing (mean of all crossings).

.92 (.90, .93)

Overall Grand Score

118

Overall Positive - Overall Negative

.99 (.99, .99)

Cross-Domain Subscales

Pedestrian Infrastructure

13 (0–27)

Trail, pedestrian zone, sidewalk presence/width, buffer, shortcut, mid-segment crossing, pedestrian bridge, air conditioned place to walk, low lights, overpass, crosswalk, refuge island

.96 (.95–.97)

Pedestrian Design

13 (0–21)

Open-air market, trash cans, benches, kiosks, hawkers and shops, setback, visibility, pedestrian walk signals, push buttons, countdown signals, ramps, crossing aids

.98 (.97–.98)

Bicycle Facilities

9 (0–11)

Bike racks, docking stations, lockers, bike lane, bike lane quality, signs, bike signal, bike box, bike lane crossing the crossing

.97 (.96–.98)

Cul-de-sacs/Dead-ends

Overall Cul-de-sacg

6 (0–6)

Closeness to participant’s home, total amenities, visibility

.94 (.88, .97)

  1. anot included in subscale
  2. b31 items in section, bicycle shops added to tool later, pedestrian zone not included in subscales
  3. c22 items in this section, 4 new informal transit items added roll over curbs not included in subscales
  4. d11 items in this section, presence of people walking not included in subscales
  5. e23 items in this section, mid- segment crossing not included in subscales
  6. f30 unique items used in subscales, but 5 items (setback × 2, building height × 2, and sidewalk) were scored in more than one way for different subscales, segment type not included in subscales
  7. gscore reported is based on 2 items as 4 items were too rare to calculate Kappa