- Open Access
Citizen science applied to building healthier community environments: advancing the field through shared construct and measurement development
© The Author(s). 2017
- Received: 15 May 2017
- Accepted: 13 September 2017
- Published: 29 September 2017
Physical inactivity across the lifespan remains a public health issue for many developed countries. Inactivity has contributed considerably to the pervasiveness of lifestyle diseases. Government, national and local agencies and organizations have been unable to systematically, and in a coordinated way, translate behavioral research into practice that makes a difference at a population level. One approach for mobilizing multi-level efforts to improve the environment for physical activity is to engage in a process of citizen science. Citizen Science here is defined as a participatory research approach involving members of the public working closely with research investigators to initiate and advance scientific research projects. However, there are no common measures or protocols to guide citizen science research at the local community setting.
We describe overarching categories of constructs that can be considered when designing citizen science projects expected to yield multi-level interventions, and provide an example of the citizen science approach to promoting PA. We also recommend potential measures across different levels of impact.
Encouraging some consistency in measurement across studies will potentially accelerate the efficiency with which citizen science participatory research provides new insights into and solutions to the behaviorally-based public health issues that drive most of morbidity and mortality. The measures described in this paper abide by four fundamental principles specifically selected for inclusion in citizen science projects: feasibility, accuracy, propriety, and utility. The choice of measures will take into account the potential resources available for outcome and process evaluation. Our intent is to emphasize the importance for all citizen science participatory projects to follow an evidence-based approach and ensure that they incorporate an appropriate assessment protocol.
We provided the rationale for and a list of contextual factors along with specific examples of measures to encourage consistency among studies that plan to use a citizen science participatory approach. The potential of this approach to promote health and wellbeing in communities is high and we hope that we have provided the tools needed to optimally promote synergistic gains in knowledge across a range of Citizen Science participatory projects.
- Our voice
- Stanford healthy neighborhood discovery tool
Physical inactivity across the lifespan remains a public health issue for many developed countries . Physical inactivity has contributed to the pervasiveness of lifestyle diseases and conditions (e.g., cardiovascular disease, diabetes, obesity) . There is a significant body of evidence that supports behavioral strategies to increase physical activity . However, government, national and local agencies and organizations have been unable to systematically, and in a coordinated way, translate behavioral research into practice to increase physical activity at a population level.
The built environments where people live, work, receive education, socialise, engage in recreation, and access destinations (services, retail, nature) can affect physical activity levels [4–9]. One effective approach for increasing a community’s physical activity levels is to link multiple sectors (i.e., the individual, the community, local and regional government) in efforts to create health-promoting local environments and policies. Clinical and population scientists know the many short- and long-term benefits of physical activity across the population . A critical next step is to target structural changes to local environments to support individuals’ regular physical activity irrespective of age, socioeconomic status, culture, or ethnicity .
Citizen science, a concept utilised originally by the disciplines of ecology and environmental sciences, is one promising approach for bringing together multiple sectors to address the physical activity environment. “Citizen Science” is typically defined as an approach involving members of the public working closely with research investigators to initiate and advance scientific research projects . It capitalises on people’s innate sense of curiosity as well as desire to learn, question, contribute, and interact with others around issues and areas that impact a community’s health and/or well-being. Note that while the term “citizen science” is the most commonly used descriptor in this field, we use this term to broadly denote community resident participation irrespective of formal citizenship status.
Community-Based Participatory Research (CBPR), is an approach in which involved participants are directly involved in and affected by the research questions being addressed [13, 14]. In a comprehensive CBPR process, it is typically recommended that community members be included in the following four ways: (1) they participate as partners rather than study subjects; (2) they contribute their knowledge to understanding and addressing health problems; (3) they often contribute to the research process through participation in the conception and design of the project, data collection, or/and participation in data analysis; and (4) they typically receive immediate benefits from the research results in their community .
The Our Voice citizen science model seeks to build on and combine both of these perspectives in the following manner: 1) it brings a systematic methodology (via use of the Discovery Tool app) to resident-based “real-world” data collection that is a hallmark of scientifically-oriented citizen science methods but often lacking in many CBPR processes; and 2) it systematically involves residents in data insight generation, consensus building, and data-based local community applications that are typically missing from the citizen science field.
Taken together, the Our Voice citizen science participatory approach empowers residents not only to systematically collect signficant and meaningful local information about their community environments, but also to participate by prioritising their concerns and their own interpretations of the data in order to engage meaningfully in cross-sector conversations to generate practical solutions that can have direct impact on their own community. A citizen science participatory approach has the potential to enable the following outcomes: i) multi-sector and intergenerational approaches for sustainable local change; ii) greater equality, where disadvantaged groups can become key stakeholders in the local discovery and change process; and iii) realistic and contextualized solution(s), as opposed to a “one size fits all” approach to local change. This approach also employs an economy of resources by tapping into existing human resources, knowledge, and networks “in situ”. Additionally, this approach enables direct translation and application of findings to those who will benefit the most directly. As well as being a useful method of data collection, citizen science can enhance public understanding of science, and strengthen links between professional scientists and community members .
As citizen science participatory research gains momentum, scientific synergies can be realized by identifying common constructs (i.e., theoretical concepts) that should be measured to document and evaluate the process. In this paper, we describe overarching categories of constructs that should be considered when designing citizen science participatory projects expected to yield multi-level interventions for physical activity. We also provide an example of a citizen science participatory approach to promoting physical activity. Where possible, this paper also suggests available tools to assess some of the core constructs that are described. Owing to the complexity of a number of the concepts, however, and the relevance of cultural contexts, these suggested measures will not be universally suited to all studies. While sharing commonalities, each project is expected to address unique behaviors and/or environmental features, the variety of which typically cannot be anticipated a priori.
In offering a list of relevant constructs together with a set of candidate measurement tools, we seek to stimulate researchers utilizing the citizen science participatory approach to engage in a thoughtful process of identifying relevant, useful, and feasible measures that may be incorporated into a particular study and compared across multiple studies. It is incumbent on the researcher to select the measures that fit best within the population, setting, and theoretical foundations of a given citizen science project. New measures, formulated for use in specific populations, are being developed continuously, so we do not purport to present a comprehensive or authoritative list. It is assumed that researchers will be familiar with the basic principles of evaluation research design. The goal of this paper is to outline a set of constructs that cut across many settings and theoretical models, and recommend that the architects of each citizen science project identify which constructs and associated measures can and should be assessed within each study.
Based on the above considerations, the purpose of this paper is to recommend common constructs and potential measures across different levels of impact (i.e., individual, social, built environment, community, policy) for citizen science participatory research targeting physical activity. By encouraging consistency in measurement constructs across multiple studies, we intend to accelerate the pace at which individual scientific gains will build on one another to yield high-quality evidence to inform intervention guidelines. We believe that such coordination will magnify the impact of each individual project and lead to greater forward strides in promoting community-based health and well-being than might be accomplished by a multitude of isolated, uncoordinated studies. It should be noted that while this is not an exhaustive list, it provides examples of the types of constructs across different levels of impact that have been found to be relevant in prior citizen science participatory research in the physical activity area .
The multiple levels of constructs that may be affected by or may influence a citizen science participatory process for improving physical activity include individual, interpersonal, environmental and policy . In addition, the content of the intervention should be documented using a process evaluation. The following section describes constructs recommended for consideration in selecting measures to be included in a citizen science physical activity intervention study. Specific examples of measures to assess these constructs are presented subsequently.
At the individual level, social and population health scientists typically collect, at a minimum, information about the age and sex of research participants. In relation to health behaviors, there is ample evidence that both age and sex correlate with physical activity . Another individual-level characteristic that has been shown to have consistent associations with physical activity is socioeconomic status (SES) which typically includes level of education and/or household income [19–22]. It is recommended that some indicator of SES also be included. Other frequently measured demographic characteristics include marital status and number of people in the household-variables which reflect potentially social factors that can impact intervention effectiveness . Health status, whether it is self-rated health or reported as number of morbidities, is another important demographic especially for older adults .
Advocacy means taking action on behalf of oneself or others. In a citizen science project, advocacy skills are critical to ensure that concerns within the community are raised effectively to local councils or boards. While there are many types and levels of advocacy (e.g., self, peer, group, systems and legal), [25–27], here we are referring to the minimum level of personal skills typically needed to engage in group advocacy.
Empowerment is the process of becoming more confident to take action for the improvement of one’s life or the local context in which one lives. The literature in this area often has focused on empowerment as seen in patient engagement in self-management [28–30], in a variety of professions (e.g., nursing, teaching) [31, 32] and among consumers of services [33, 34].
Civic engagement is the meaningful participation of residents in building and maintaining a community  or actively participating in the life of their community through activities such as voting, joining community groups, and volunteering . It has been argued that civic engagement is not simply the act of volunteerism but also includes other activities associated with civic life, including active involvement in the community, staying informed about current affairs, and making informal connections with other residents, as well as community organizations, around issues that impact multiple residents .
A wealth of research supports the role of self-efficacy (a person’s level of confidence in his or her ability to engage in a specific behavior in a given context) as a determinant of behavior . Moreover, self-efficacy can be nurtured through a variety of strategies, including modeling, shaping, and mastery experiences . In the context of citizen science interventions to promote community health and well-being, program success may be shaped by and may result in changes in residents’ self-efficacy related to a variety of behaviors.
The primary focus of this paper is on resident-engaged interventions to promote community health and well-being through increasing physical activity. As part of specific interventions that target physical activity, the type of physical activity that is expected to change should be carefully considered. Possibilities include recreational activity, structured forms of exercise, active transport, and decreased sedentary time.
Social norms are important determinants of health behaviors , and have been incorporated into a number of health behavior theories. Assessment of social norms may assist in the interpretation of findings, especially within cultures that may discourage physical activity among certain subgroups of the population .
When residents characterize a neighborhood as having strong social bonds and mutual trust in the absence of social conflict, that neighborhood may be described as having high cohesion . A growing number of studies support the assertion that neighborhood cohesion influences residents’ health behaviors .
Although there are numerous definitions, urban areas tend to be characterized based on population density, degree of urbanization and/or proximity to a metropolitan area . Urban environments have been found to offer a different set of opportunities and hindrances for healthy behaviors as compared to suburban or rural environments [44–46].
In addition to the impact of individual-level socioeconomic status on health behavior, there appears to be an additional influence of community-level poverty on such behaviors . Community-level indicators of poverty may indicate reduced access to retail outlets selling fresh produce, limited recreational facilities, and elevated crime rates, all features of an obesogenic environment .
Although it seems intuitive that neighborhood safety will influence the likelihood of engaging in regular physical activity, a recent review of the literature  did not find support for this direct association. The authors pointed out several study limitations and suggested that a number of moderators need to be taken into account in future studies (e.g., age, sex, motivation to be physically active) in future studies. They call for additional studies that examine the longitudinal association between residents’ safety and their participation in physical activity as well as studies that use valid measures and incorporate multi-level models.
Weather, air quality and excessive noise
Outdoor temperature and air quality are atmospheric environmental factors that may impact the safety or acceptability of outdoor physical activity . Extremes of low or high temperatures or conditions that compromise outdoor safety (e.g., sidewalks covered in snow and ice)  may prevent physical activity participation throughout some seasons. Winter conditions often create barriers for community mobility particularly in older adults . Likewise, public health officials recommend that individuals avoid outdoor activities when thresholds are exceeded for various air pollutants. This is particularly true for those with breathing or heart conditions, because of the potential to trigger adverse health events (e.g., asthma attacks; ). However, recent research shows that the benefits of physical activity usually outweigh the costs of pollution . While less rigorously studied in the physical activity field, there are growing concerns about the potential impacts of excessive environmental noise levels on outdoor physical activity participation levels among certain population subgroups, including aging adults .
Walkability refers to the extent to which an area or neighborhood is friendly to walking. It has been suggested that neighborhoods with greater mixed land use, street connectivity, and residential density  are more “walkable” for many different groups of residents. Recent research has identified four environmental attributes that were positively and linearly related to physical activity in 14 cities worldwide, which include the following factors: net residential density, intersection density, public transport density, and number of parks . It was also reported that the difference in physical activity between participants living in the most and least walkable neighborhoods ranged from 68 to 89 min/week, representing up to 60% of the recommended physical activity guidelines . With respect to children’s physical activity, density and accessibility have been positively associated with walking to school  while distance to school has been negatively associated with sedentary behavior .
Much of the literature regarding access to public transport is derived from city planning , and statistical modelling , or exploration and analysis related to specific locales or settings (e.g., station terminals) . A review of 27 studies examining the link between use of public transport and physical activity found that the median walking time associated with use of public transport was 15 min from a public transport stop . Moreover, living in a community in the highest 5% of public transportation density was associated with a mean weekly accumulation of moderate-to-vigorous activity (MVPA) roughly 30 min higher as compared to living in a community in the lowest 5% of public transportation density .
Policies relevant to community-based health promotion efforts may include courses of action adopted by local housing associations or neighborhood groups, as well as civic government at all levels. Common policies that may impact residents’ likelihood of engaging in physical activity can include allocation of resources (e.g., a municipality directing resources to enhance outdoor recreation areas) and changes in zoning regulations (e.g., designation of areas for mixed use of both residential and retail). Moreover, residents’ willingness to engage in the citizen-science process may be facilitated by policies that encourage the exchange of information with local government, such as the establishment of neighborhood councils with direct representation to the city or area council.
Replication of any intervention study requires thorough documentation of the key elements of the intervention, often described as process evaluation. A comprehensive process evaluation ensures that the program’s operations, implementation, and service delivery are thoroughly documented. Process data may also be used to help interpret study findings and identify program elements that were more or less effective . In this process, it is important to collect data to show whether the program was implemented as desired . Some examples include the following: identification of strategies used to recruit community partners and citizen scientists, response rates and reasons for non-response (if available), neighbourhood selection criteria, type and amount of citizen scientist training delivered, process by which themes were identified and prioritized by the citizen scientists, process followed regarding the identification and listing of the solutions generated by the citizen scientists, number of meetings with local and public stakeholders, documenting meeting agendas and lists of attendees from meetings with stakeholders, noting participants’ views in addition to likes and dislikes as part of the community meetings, reporting the number of people reached during project implementation (e.g., count of attendance in meetings, which stakeholders joined the meetings, etc.), and time and type of researchers, citizen scientists, and other community organizations or facilitators who were involved. These data may be collected by researchers with the assistance of citizen scientists, and/or by participating organizations serving as partners with researchers. The data are usually collected during and immediately after project implementation. A variety of methods can be used including counts or other types of observational assessments, and focus group and/or interview-derived transcription. Clear documentation of individual citizen science interventions will facilitate comparisons among studies and synergistic gains in knowledge.
Feasibility (ease of data collection). Feasibility standards ensure that the evaluation is viable and pragmatic, and emphasize that the evaluation should employ practical, non-disruptive procedures; that the differing political interests of those involved should be anticipated and acknowledged; and that the use of resources in conducting the evaluation should be prudent and produce valuable findings.
Accuracy (focusing on sensitivity to change). The use of an established instrument with appropriate validity and reliability is preferred. For areas in which an instrument needs to be developed (e.g., in relation to specific populations or subgroups, or to measure constructs that are reasonably new to the field), evaluation of test-retest reliability and other psychometric properties is encouraged. For example, test-retest reliability can often be ascertained through use of a control or comparison group that is not receiving the intervention. Moreover, the tool must be able to reliably detect and capture the small changes that one might realistically expect from a community-based citizen science intervention.
Propriety (conformity to conventionally accepted standards of behavior). Propriety standards ensure that the evaluation is ethical (i.e., conducted with regard for the rights and interests of those involved and effected), and address such items as developing protocols and other agreements for guiding the evaluation; protecting the welfare of human participants; weighing and disclosing findings in a complete and balanced fashion; and addressing any conflicts of interest in an open and fair manner.
Utility (usefulness, of benefit). Data collected from the assessment instrument should be easy to interpret, avoiding complicated data cleaning or preliminary analysis to produce a result.
Examples of measures for assessing constructs
Age/Date of Birtha
Socioeconomic Status: Educational attainmenta
Number of people in householda
Social Issues Advocacy Scale (SIAS)  a
Personal Empowerment Scale a
Volunteer experience a
Civic engagement scale (adolescents) a
The Older Adults’ Computer Technology Attitudes Scale a
Computer Use Self Efficacy Scale a, d
Self-efficacy for Exercise Scale a
Community Healthy Activities Model Program for Seniors (CHAMPS) questionnaire for midlife and older adults a
International Physical Activity Questionnaire version for ages 15–65 years (IPAQ; 54) a
Accelerometry & related device-based assessment tools a
Injunctive Norms a
Neighborhood cohesion a
Social Network Analysis b
e.g., U.S. Centers for Disease Control and Prevention classification of counties (https://www.cdc.gov/nchs/data_access/urban_rural.htm)b
e.g., English Indices of Deprivation (https://www.gov.uk/government/statistics/english-indices-of-deprivation-2015)b
Perceived neighborhood safety ()a
Neighborhood Incivilities From the Neighborhood Inventory of Environmental Typology (NlfETy) b
Ambient fine particulate matterb
Historical weather data2 (e.g., Environment Canada: http://climate.weather.gc.ca/index_e.html) b
Abbreviated Neighborhood Environment Walkability Scale; ANEWS a
e.g., Walking distance to a transit stop/station from residential address is less than 400 m for bus stop or train or less than 800 m to train/rail station access 
Allocation of Resources
New funds allocated to environmental resources to support PAc
Number of changes to zoning ordinances designed to promote environmental support for PAc
Community Engagement in Government
Proportion of residents actively participating in local government meetingsc
Office-holders’ perceived level of impact that residents have on local government decisionsc
Fidelity of interventionc
Acceptability of intervention components
Satisfaction with the interventiona,c
Awareness of the interventiona,c
To provide an example of how the constructs and measures outlined above can be implemented to improve physical activity, the Our Voice citizen science example of King and colleagues  will be described. While physical activity and increased walkability have been a focus of a number of Our Voice studies to date, the Our Voice framework is being applied to a number of other health areas as well, including healthy food access, reduction of environmental stressors, and violence prevention. The Our Voice Citizen Science Engagement and Advocacy Framework (i.e., the Our Voice Framework) describes a process in which community residents are trained as “citizen scientists” who not only collect relevant data about their local contexts and environments, but also become agents of positive health-enabling changes in their communities through community assessment, engagement, advocacy, and action . Our Voice citizen scientists collect information about their local community environment, work together to set priorities for action and create actionable solutions to improve their environment.
The Our Voice framework builds on the tenets of CBPR, and adds additional dimensions involving the following activities: community members collect information facilitated by Our Voice-specific mobile technology (i.e., a mobile app, described below), and then residents receive guidance and training to enable them to build neighborhood consensus, prioritize their results, frame recommended solutions to the issues that they identify, and engage directly with decision-makers to make changes in their local environments aimed at promoting positive health behaviors (e.g., improving side walk quality to promote more walking, developing back yard gardens to promote healthier eating).
In an Our Voice project in Cuernavaca, Mexico called Nuestra Voz, adolescent and adult residents living in low-income neighbourhoods were able to successfully use the Our Voice Discovery Tool to identify those local aspects that hindered residents’ ability to walk safely in their neighbourhoods. Because access to local decision makers and policy makers in their area was limited, the residents were able to agree on social environmental solutions, including creation of a neighbourhood residents committee aimed at better control of dogs in the neighbourhood (i.e., more frequent leashing and clean-up after dogs), a neighbourhood watch program to combat local crime, and strategies to enhance neighbourhood social cohesion .
A third example of a successful Our Voice project was aimed at improving access to healthy food choices in ethnically diverse older adults (including those of Latino, Chinese, and European descent) living in low-income neighbourhoods in northern San Mateo County, CA. The residents used the Discovery Tool to identify aspects of their local environments that helped or hindered healthy eating, and learned how to advocate for changes in partnerships with local decision and policy makers . Participants learned about the food assistance and transportation services in their area about which most were previously unaware (e.g., regular food distribution programs, the US Department of Agriculture’s Supplemental Nutrition Assistance Program eligibility, congregate meal programs, existing and planned bus routes and shuttle services, financial assistance). At three months post-intervention, 84% of participants had contacted a local decision maker and/or shared information and resources with family, neighbours, or friends . At 6 months post-intervention, older adult participants living in an affordable senior housing site in the targeted locale formed a Senior Advocacy Team (SAT), which met regularly to discuss and address issues of relevance to the older adults living at the housing site. Among the successful outcomes generated by the SAT was the hosting of an open forum at the housing site in which local city and county policy and decision makers discussed local environmental concerns and brainstormed solutions. Environmental changes that came out of this forum included modifications to street signage and curb designations which made it easier for the older adults to observe traffic and cross the street safely . Post-intervention 12- and 24-month evaluations indicated that SAT members had attended a senior advocacy event twice in the California state capital, where they spoke with their state legislators concerning increased funding for affordable and safe senior housing . They also partnered with an elementary school adjacent to the housing site to improve local traffic safety concerns, which resulted in an assessment of local traffic density and speed by the local transportation and housing departments. The results from this assessment led to subsequent environmental modifications by local government to enhance the nearby crosswalk and install pedestrian signal lights .
The Our Voice mobile technology, called the Stanford Healthy Neighborhood Discovery Tool (Discovery Tool), is an easy-to-use mobile device-based application that was developed by a team of research and community practice personnel from the Stanford Prevention Research Center and the broader Stanford community to assist residents in identifying neighborhood features that affect active and healthy living. The Discovery Tool has subsequently undergone extensive refinement based on input from scientists and community users in the U.S. and globally. The Discovery Tool records GPS-tracked walking routes, and allows residents to capture geo-coded photographs and audio narratives which identify barriers to and enablers of healthy living in their neighborhoods (e.g., healthy food access, features that affect neighborhood walkability; health food access) . The Discovery Tool was originally developed using a CBPR approach and enables users to capture, in a standardized way, relevant contextual data about their local environments in real time, which facilitates later data analysis and community decision-making. The Discovery Tool has been used thus far in a growing number of studies across three continents. These studies have provided evidence for its ease of use and acceptability among a range of users . For example, low-income, technology-naïve Latino adolescents and older adults used it in a pilot study conducted in the North Fair Oaks neighborhood of Redwood City, CA to assess neighborhood built environment features that helped or hindered their physical activity . In addition to the U.S., the Discovery Tool has been used by residents living in Mexico, Colombia, Chile, and Israel . The tool was shown to be an easy-to-use technology-driven tool that has facilitated citizen science research and collaborations .
In the five years since the first publication describing the Discovery Tool and the Our Voice framework, additional projects have been planned or initiated in several regions of the United States, Canada, the United Kingdom, Australia, Brazil, Germany, New Zealand and South Africa . The Our Voice Global Network (http://med.stanford.edu/ourvoice/the-global-network-right.html) was formed to create a learning community around the Our Voice model and coordinate approaches across geographically disparate projects.
The purpose of this paper is to provide recommendations to researchers utilizing Citizen Science participatory approach for measures that should be considered for inclusion in future citizen science participatory projects addressing physical activity, and to offer some examples of specific instruments available to conduct these assessments. Encouraging consistency across studies can accelerate the efficiency with which citizen science participatory research provides new insights and solutions to behaviorally-based public health issues that drive morbidity and mortality around the world .
We have elaborated on one specific example of the citizen-engaged process, referred to as the Our Voice framework. Since its inception in 2012, the Our Voice framework has been implemented in several countries. This momentum has created an opportunity for the development and adoption of shared research approaches to allow comparison between the Our Voice approach and similar citizen science activities in a wide range of settings. The adoption of recommendations reported in this paper would create the potential for synergies among future Our Voice projects and similar projects.
The measures described in this paper abide by four principles selected for inclusion in citizen science participatory projects, as follows: feasibility, utility, propriety, and accuracy. The choice of measures will take into account the resources available for outcome and process evaluation. We stress the importance for all such projects to follow an evidence-based approach and ensure that they incorporate an appropriate assessment protocols. Not only will such an approach magnify the impact of individual projects, but it will also highlight the shared strengths and opportunities for further development of these projects leading to the creation of a critical mass of well-coordinated studies. This is an exceptional opportunity to further the community-based health promotion agenda which in the past has suffered from a lack of coordination, shared vision and comparable research measures.
The strengths of this paper include the following: i) the constructs and measures align with citizen science participatory projects and the Our Voice framework; ii) it provides a guide for researchers embarking on community-engaged research; iii) it focuses on variables that are often ignored (e.g., civic engagement; sense of empowerment); and iv) it includes both quantitative and qualitative measures. A limitation to the information provided is the omission of specific and authoritative recommendations as to which measures should be employed for which studies, and the absence of a thorough review of all available tools for assessing each construct. This level of detail is both beyond the scope of this paper and impractical, given the many and varied factors that may influence the choice of measures. These factors may include available resources, characteristics of the community residents, expertise within the study team and the community, and the specific target of the program or intervention. Moreover, this paper focuses primarily on constructs relevant to promoting physical activity, whereas citizen science participatory projects can be used to address many issues, including nutrition (e.g., access to healthful food options), recycling (e.g., ease of neighborhood recycling), and access to health care. Many of the constructs identified in this paper may be relevant to these other arenas, but each of these target areas will require attention to additional constructs that may not have been mentioned here. This area is in a relatively early stage of research and a growing body of evidence would be required for recommendations to be presented. This paper highlights important areas to consider in order to ensure collection of high quality evidence which will move this field forward.
Among the challenges of citizen science participatory research is capturing longer-term changes (i.e., those occurring well beyond the initial citizen scientist engagement process). Researchers are not usually funded for more than two to three years, or even shorter time periods. The impact on the built and social environments may only come to fruition in the longer term. Thus, it becomes important to assess the shorter-term individual and environmental changes that may serve as markers or facilitators of longer-term environmental or policy impacts in a locale. Such markers include the natural diffusion of citizen scientist activities to other local topic areas of concern or to other groups of residents, as has been observed in the few longer-term Our Voice projects to date [66, 68]. Identifying funding opportunities that support the longer-term follow-up of such community-based citizen science projects is also essential in helping to bridge the gap between evidence and practice in this field. Another challenge is capturing changes at multiple levels of impact, from the individual through community levels. One way of resolving this challenge may be by aggregating individual responses to the neighborhood level and analyzing this information as an ecologic rather than an individual characteristic .
virtual or augmented reality to show policy makers, community partners, and residents alike how proposed changes would actually look and “feel”. The display of such information could enable more confident decision making and more thorough consideration of all possible alternatives, thereby enhancing the decision making process .
the use of existing closed-circuit television (CCTV) cameras (Archive of Many Outdoor Spaces. http://amos.cse.wustl.edu/), where a collection of long-term time-lapse imagery from publicly accessible outdoor webcams around the world are used.
linking Our Voice data to other types of aggregated health data for a particular locale, such as health insurance or public health data records.
incorporating geographic information systems (GIS) data, local census data, and wearable activity monitors and other biometric sensors (e.g., FitBit, Apple Watch, stress sensors, etc.) with Discovery Tool and similar resident-generated data.
Including measures that are used in health impact assessments.
The use of online tools (e.g. Smartsheet) to track, manage and automate collaborative projects.
The citizen science participatory approach to research embodied in the Our Voice framework represents a paradigm shift in the basic conceptualization of population health science as currently practiced. This paradigm departs from the traditional approach in which trained scientists, often residing outside of the communities or populations which they are studying, are the drivers of community question generation, data collection, and data interpretation. The citizen science model facilitates scientific partnerships with engaged residents through helping them systematically apply a replicable set of tools and processes to improve the health of the local communities in which they live. The role of researchers is to complement the deep knowledge that citizen scientists have about the issues facing their communities with knowledge about the scientific process. Providing citizen scientists with training (for example, how to gather, review and analyze data), and resources, (such as workbooks, manuals, and templates), can facilitate the development of systematized, replicable processes. Building and sustaining mutual trust is key to overcoming the challenges of conducting citizen science research . These challenges include ensuring cultural appropriateness, recruiting and retaining citizen scientists as participants, building academic-community partnerships, resolving conflicts, ensuring momentum and productivity, and promoting long-term sustainability .
In maintaining and enhancing Citizen Science engagement, we highly recommend that the guiding principles of community based participatory research are followed, which include the following activities: recognizing the community as a unit of identity; building on strengths and resources within the community; facilitating collaborative partnerships through open, transparent, and respectful interchanges and discussion throughout the project; integrating knowledge and action for the mutual benefit of all partners; promoting a co-learning and empowering process that attends to social inequalities; using a cyclical and iterative process to ensure that interventions are optimized for the target population or community; addressing health from both positive and ecological (contextual) perspectives; and disseminating the findings and knowledge gained to all partners in ways that are readily understood . We believe that the potential of these approaches and suggestions in fostering contextually meaningful physical activity-enabling solutions is high and worthy of further exploration and development.
The Global Citizen Science Research Network (in alphabetical order): Bonnie Broderick, Mathew Buman, Sebastien Chastin, Daniela Lopes Dos Santos, Nicolas Aguilar-Farias, Randi Garber, Paul Gamble, Peter Gelius, Erica Hinckson, Abby King, Diane King, Estelle Lambert, Der Ming Liou, Michelle Porter, Alfred Rütten, Deborah Salvo, Olga Samiento, Margaret Schneider, Rebecca Seguin, Afroditi Stathi, Emily Stone, Anthony Tuckett, Sandra Winter, Andrea Wolff.
This work is supported in part by the Robert Wood Johnson Foundation Grant ID#73344 (PI: King), US Public Health Service Grant #1U54EB020405 supporting The National Center for Mobility Data Integration and Insight (PI: S. Delp), and the Nutrilite Health Institute Wellness Fund provided by Amway to the Stanford Prevention Research Center, Stanford University School of Medicine.
Availability of data and materials
EH has designed, and provided the outline, and contributed to all sections of the manuscript along with MS, and is the co-leader of the writing group with MS; PG provided to the information relating to reporting section and designed “Rover”; AK, SW and ES provided extensive feedback, all coauthors and the wider team of the Global Citizen Science Research Network provided specific guidance related to the conceptualization of this paper as well as input on the drafts and final manuscript. All authors read and approved the final manuscript.
Ethics approval and consent to participate
Consent for publication
All authors have consented to publication of this manuscript.
The authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Open AccessThis article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.
- Hallal PC, Andersen LB, Bull FC, Guthold R, Haskell W, Ekelund U. Global physical activity levels: surveillance progress, pitfalls, and prospects. Lancet. 2012;380:247–57.View ArticlePubMedGoogle Scholar
- Ding D, Lawson KD, Kolbe-Alexander TL, Finkelstein EA, Katzmarzyk PT, van Mechelen W, Pratt M, Committee LPASE. The economic burden of physical inactivity: a global analysis of major non-communicable diseases. Lancet. 2016;388:1311–24.Google Scholar
- Heath GW, Parra DC, Sarmiento OL, Andersen LB, Owen N, Goenka S, Montes F, Brownson RC, Group LPASW. Evidence-based intervention in physical activity: lessons from around the world. Lancet. 2012;380:272–81.View ArticlePubMedPubMed CentralGoogle Scholar
- Witten K, Blakely T, Bagheri N, Badland H, Ivory V, Pearce J, Mavoa S, Hinckson E, Schofield G. Neighborhood built environment and transport and leisure physical activity: findings using objective exposure and outcome measures in New Zealand. Environ Health Perspect. 2012;120:971–7.View ArticlePubMedPubMed CentralGoogle Scholar
- Field A, Arcus K, Tunks M, Aust J, Dale-Gandar L. Manukau built form and spatial structure plan health impact assessment: Te Kaunihera o Manukau City council. Ministry of Health-Manatu Hauora: Te Ora O Manukau-Manukau the Healthy City; 2009.Google Scholar
- Hinckson EA, Garrett N, Duncan JS: Active commuting to school in New Zealand Children (2004-2008): A quantitative analysis. Prev Med 2011, 52: 332–336.Google Scholar
- McGrath LJ, Hopkins WG, Hinckson EA. Associations of objectively measured built-environment attributes with youth moderate–vigorous physical activity: a systematic review and meta-analysis. Sports Med. 2016;46(7):1003–17.Google Scholar
- Hinckson EA, McGrath L, Hopkins W, Oliver M, Badland H, Mavoa S, Witten K, Kearns R. Distance to school is associated with sedentary time in children: findings from the URBAN study. Child Health Hum D. 2014;2:151. doi:10.3389/fpubh.2014.00151.Google Scholar
- Hinckson E, Duncan S, Oliver M, Mavoa S, Cerin E, Badland H, Steward T, Ivory V, McPhee J, Schofield S. Built environment and physical activity in New Zealand adolescents: a protocol for a cross-sectional study. BMJ Open. 2014;4:e004475. doi:10.1136/bmjopen-2013-004475.View ArticlePubMedPubMed CentralGoogle Scholar
- Reiner M, Niermann C, Jekauc D, Woll A. Long-term health benefits of physical activity–a systematic review of longitudinal studies. BMC Public Health. 2013;13:1.View ArticleGoogle Scholar
- Sallis JF, Cerin E, Conway TL, Adams MA, Frank LD, Pratt M, Salvo D, Schipperijn J, Smith G, Cain KL. Physical activity in relation to urban environments in 14 cities worldwide: a cross-sectional study. Lancet. 2016;387:2207–17.View ArticlePubMedGoogle Scholar
- King AC, Winter SJ, Sheats JL, Rosas LG, Buman MP, Salvo D, Rodriguez NM, Seguin RA, Moran M, Garber R. Leveraging citizen science and information Technology for Population Physical Activity Promotion. Transl J Am Coll Sports Med. 2016;1:30–44.PubMedPubMed CentralGoogle Scholar
- Viswanathan M, Ammerman A, Eng E, Garlehner G, Lohr KN, Griffith D, Rhodes S, Samuel-Hodge C, Maty S, Lux L: Community-based participatory research: assessing the evidence: summary. 2004.Google Scholar
- Angrist M. Eyes wide open: the personal genome project, citizen science and veracity in informed consent. Personal med. 2009;6:691–9.View ArticleGoogle Scholar
- Agency for Healthcare Research and Quality. The Role of Community-Based Participatory Research: Creating Partnerships, Improving Health. Rockville, MD. https://archive.ahrq.gov/research/cbprrole.htm: Agency for Healthcare Research and Quality; June 2003.
- Peters M. An inventory of citizen science initiatives, resources and learning opportunities in New Zealand. A report prepared for the NZ Landcare trust. NZ Landcare Trust: Hamilton, New Zealand; 2016.Google Scholar
- King AC. Theory’s role in shaping behavioral health research for population health. Int J Behav Nutr Phys Act. 2015;12:146.View ArticlePubMedPubMed CentralGoogle Scholar
- Khan LK, Sobush K, Keener D, Goodman K, Lowry A, Kakietek J, Zaro S. Control CfD, prevention: recommended community strategies and measurements to prevent obesity in the United States. MMWR Recomm Rep. 2009;58:1–26.PubMedGoogle Scholar
- Gordon-Larsen P, Nelson MC, Page P, Popkin BM. Inequality in the built environment underlies key health disparities in physical activity and obesity. Pediatrics. 2006;117:417–24.View ArticlePubMedGoogle Scholar
- Stalsberg R, Pedersen AV. Effects of socioeconomic status on the physical activity in adolescents: a systematic review of the evidence. Scand J Med Sci Sports. 2010;20:368–83.View ArticlePubMedGoogle Scholar
- Giles-Corti B, Donovan RJ. Socioeconomic status differences in recreational physical activity levels and real and perceived access to a supportive physical environment. Prev Med. 2002;35:601–11.View ArticlePubMedGoogle Scholar
- Grzywacz JG, Marks NF. Social inequalities and exercise during adulthood: toward an ecological perspective. J Health Soc Behav. 2001:202–20.Google Scholar
- Pettee K, Brach J, Kriska A, Boudreau R, Richardson C, Colbert L, Satterfield S, Visser M, Harris T, Ayonayon H. Influence of marital status on physical activity levels among older adults. Med Sci Sports Exerc. 2006;38:541–6.View ArticlePubMedGoogle Scholar
- McAuley E, Konopack JF, Motl RW, Morris KS, Doerksen SE, Rosengren KR. Physical activity and quality of life in older adults: influence of health status and self-efficacy. Ann Behav Med. 2006;31:99–103.View ArticlePubMedGoogle Scholar
- Balcazar FE, Seekins T, Fawcett SB, Hopkins BL. Empowering people with physical disabilities through advocacy skills training. Am J Community Psychol. 1990;18:281–96.View ArticlePubMedGoogle Scholar
- Chen-Hayes SF. Social justice advocacy readiness questionnaire. J Gay Lesbian Soc Serv. 2001;13:191–203.View ArticleGoogle Scholar
- Blair H. Assessing civil society impact for democracy programmes: using an advocacy scale in Indonesia and the Philippines. Democratization. 2004;11:77–103.View ArticleGoogle Scholar
- Schouten LM, Niessen LW, van de Pas JW, Grol RP, Hulscher ME. Cost-effectiveness of a quality improvement collaborative focusing on patients with diabetes. Med Care. 2010;48:884–91.View ArticlePubMedGoogle Scholar
- Organization WH. Exploring patient participation in reducing health-care-related safety risks. Copenhagen: World Health Organization; 2013.Google Scholar
- Barr PJ, Scholl I, Bravo P, Faber MJ, Elwyn G, McAllister M. Assessment of patient empowerment-a systematic review of measures. PLoS One. 2015;10:e0126553.View ArticlePubMedPubMed CentralGoogle Scholar
- Kuokkanen L, Leino-Kilpi H, Katajisto J, Heponiemi T, Sinervo T, Elovainio M. Does organizational justice predict empowerment? Nurses assess their work environment. J Nurs Scholarsh. 2014;46:349–56.View ArticlePubMedGoogle Scholar
- Avidov-Ungar O, Friedman I, Olshtain E. Empowerment amongst teachers holding leadership positions. Teachers Teach. 2014;20:704–20.View ArticleGoogle Scholar
- Rogers E, Chamberlin J, Ellison M. A consumer-constructed scale to measure empowerment among users of mental health services. Year Book of Psychiatry and Applied Mental Health. 1999;1999:192–3.Google Scholar
- Dickerson FB. Strategies that foster empowerment. Cogn Behav Pract. 1999;5:255–75.View ArticleGoogle Scholar
- Benson PL, Leffert N, Scales PC, Blyth DA. Beyond the “village” rhetoric: creating healthy communities for children and adolescents. Appl Dev Sci. 2012;16:3–23.View ArticleGoogle Scholar
- Gerteis M, Winston J, Stanton F, Moses S, Grodner Mendoza T, Roberts M. Reinventing aging: baby boomers and civic engagement. Cambridge, Mass: Harvard School of Public Health-MetLife Foundation Initiative on Retirement and Civic Engagement; 2004.Google Scholar
- Martinson M, Minkler M. Civic engagement and older adults: a critical perspective. Gerontologist. 2006;46:318–24.View ArticlePubMedGoogle Scholar
- Bandura A. Self-efficacy: toward a unifying theory of behavioral change. Psychol Rev. 1977;84:191.View ArticlePubMedGoogle Scholar
- Manning M. The effects of subjective norms on behaviour in the theory of planned behaviour: a meta-analysis. Br J Soc Psychol. 2009;48:649–705.View ArticlePubMedGoogle Scholar
- Lawton J, Ahmad N, Hanna L, Douglas M, Hallowell N: 'I can't do any serious exercise': barriers to physical activity amongst people of Pakistani and Indian origin with Type 2 diabetes Health Educ Res. 2006, 21: 43–54.Google Scholar
- Martinez SM, Arredondo EM, Roesch S. Physical activity promotion among churchgoing Latinas in San Diego, California: does neighborhood cohesion matter? J Health Psyc. 2013;18:1319–29.View ArticleGoogle Scholar
- Ory MG, Towne SD, Won J, Forjuoh SN, Lee C. Social and environmental predictors of walking among older adults. BMC Geriatr. 2016;16:155.View ArticlePubMedPubMed CentralGoogle Scholar
- McCormack LA, Meendering J. Diet and physical activity in rural vs urban children and adolescents in the United States: a narrative review. J Acad Nutr Diet. 2016;116:467–80.View ArticlePubMedGoogle Scholar
- Calancie L: Nutrition-related policy and environmental strategies to prevent obesity in rural communities: a systematic review of the literature, 2002-2013. Prev Chronic Dis 2015, 12.Google Scholar
- Moore JB, Beets MW, Morris SF, Kolbe MB. Comparison of objectively measured physical activity levels of rural, suburban, and urban youth. Am J Prev Med. 2014;46:289–92.View ArticlePubMedGoogle Scholar
- Sandercock G, Angus C, Barton J. Physical activity levels of children living in different built environments. Prev Med. 2010;50:193–8.View ArticlePubMedGoogle Scholar
- Piontak JR, Schulman MD. School context matters: the impacts of concentrated poverty and racial segregation on childhood obesity. J Sch Health. 2016;86:864–72.View ArticlePubMedGoogle Scholar
- Carroll-Scott A, Gilstad-Hayden K, Rosenthal L, Peters SM, McCaslin C, Joyce R, Ickovics JR. Disentangling neighborhood contextual associations with child body mass index, diet, and physical activity: the role of built, socioeconomic, and social environments. Soc Sci Med. 2013;95:106–14.View ArticlePubMedPubMed CentralGoogle Scholar
- da Silva IC, Payne VL, Hino AA, Varela AR, Reis RS, Ekelund U, Hallal PC. Physical activity and safety from crime among adults: a systematic review. J Phys Act Health. 2016;13:663–70.View ArticlePubMedGoogle Scholar
- Tucker P, Gilliland J. The effect of season and weather on physical activity: a systematic review. Public Health. 2007;121:909–22.View ArticlePubMedGoogle Scholar
- Li Y, Hsu JA, Fernie G. Aging and the use of pedestrian facilities in winter—the need for improved design and better technology. J Urban Health. 2013;90:602–17.View ArticlePubMedGoogle Scholar
- Clarke PJ, Yan T, Keusch F, Gallagher NA. The impact of weather on mobility and participation in older US adults. Am J Public Health. 2015;105:1489–94.View ArticlePubMedPubMed CentralGoogle Scholar
- Campbell ME, Li Q, Gingrich SE, Macfarlane RG, Cheng S. Should people be physically active outdoors on smog alert days? Canadian Journal of Public Health/Revue Canadienne de Sante'e Publique. 2005:24–8.Google Scholar
- Tainio M, de Nazelle AJ, Götschi T, Kahlmeier S, Rojas-Rueda D, Nieuwenhuijsen MJ, de Sá TH, Kelly P, Woodcock J. Can air pollution negate the health benefits of cycling and walking? Prev Med. 2016;87:233–6.View ArticlePubMedPubMed CentralGoogle Scholar
- Cunningham GO, Michael YL. Concepts guiding the study of the impact of the built environment on physical activity for older adults: a review of the literature. Am J Health Promot. 2004;18:435–43.View ArticlePubMedPubMed CentralGoogle Scholar
- Frank LD, Sallis JF, Saelens BE, Leary L, Cain K, Conway TL, Hess PM. The development of a walkability index: application to the neighborhood quality of life study. Br J Sports Med. 2010;44:924–33.View ArticlePubMedGoogle Scholar
- D’Haese S, Vanwolleghem G, Hinckson E, De Bourdeaudhuij I, Deforche B, Van Dyck D, Cardon G. Cross-continental comparison of the association between the physical environment and active transportation in children: a systematic review. Int J Behav Nutr Phys Act. 2015;12:145.View ArticlePubMedPubMed CentralGoogle Scholar
- Currie G. Quantifying spatial gaps in public transport supply based on social needs. J Transp Geogr. 2010;18:31–41.View ArticleGoogle Scholar
- Wibowo SS, Olszewski P. Modeling walking accessibility to public transport terminals: case study of Singapore mass rapid transit. J East Asia Soc Transp Stud. 2005;6:147–56.Google Scholar
- Murray AT, Davis R, Stimson RJ, Ferreira L. Public transportation access. Transp Res Part D: Transp Environ. 1998;3:319–28.View ArticleGoogle Scholar
- Rissel C, Curac N, Greenaway M, Bauman A. Physical activity associated with public transport use—a review and modelling of potential benefits. Int J Env Res Public Health. 2012;9:2454–78.View ArticleGoogle Scholar
- Linnan L, Steckler A: Process evaluation for public health interventions and research: Jossey-bass San Francisco; 2002.Google Scholar
- US Department of Health and Human Services. Physical Activity Evaluation Handbook. Atlanta, GA: US Department of Health and Human Services, Centers for Disease Control and Prevention; 2002.Google Scholar
- Joint Committee on Standards for Educational Evaluation. Program evaluation standards: how to assess evaluations of educational programs. Thousand Oaks, CA: Sage Publications; 1994.Google Scholar
- Buman MP, Winter SJ, Baker C, Hekler EB, Otten JJ, King AC. Neighborhood eating and activity advocacy teams (NEAAT): engaging older adults in policy activities to improve food and physical environments. Transl Behav Med. 2012;2:249–53.View ArticlePubMedGoogle Scholar
- Winter SJ, Buman MP, Sheats JL, Hekler EB, Otten JJ, Baker C, Cohen D, Butler BA, King AC. Harnessing the potential of older adults to measure and modify their environments: long-term successes of the neighborhood eating and activity advocacy team (NEAAT) study. Transl Behav Med. 2014;4:226.View ArticlePubMedPubMed CentralGoogle Scholar
- Rosas LG, Salvo D, Winter SJ, Cortes D, Rivera J, Rodriguez NM, King AC. Harnessing technology and citizen science to support neighborhoods that promote active living in Mexico. J Urban Health. 2016;93:953–73.View ArticlePubMedGoogle Scholar
- Sheats JL, Winter SJ, Romero PP, King AC. FEAST: empowering community residents to use technology to assess and advocate for healthy food environments. J Urban Health. 2017;94:180–9.View ArticlePubMedGoogle Scholar
- Buman MP, Winter SJ, Sheats JL, Hekler EB, Otten JJ, Grieco LA, King AC. The Stanford healthy neighborhood discovery tool: a computerized tool to assess active living environments. Am J Prev Med. 2013;44:e41–7.View ArticlePubMedPubMed CentralGoogle Scholar
- Winter SJ, Rosas LG, Romero PP, Sheats JL, Buman MP, Baker C, King AC. Using citizen scientists to gather, analyze, and disseminate information about neighborhood features that affect active living. J Immigr Minor Health. 2016;18:1126–38.View ArticlePubMedGoogle Scholar
- Sampson RJ, Raudenbush SW, Earls F. Neighborhoods and violent crime: a multilevel study of collective efficacy. Science. 1997;277:918–24.View ArticlePubMedGoogle Scholar
- Al-Kodmany K. Visualization tools and methods in community planning: from freehand sketches to virtual reality. CPL bibliography. 2002;17:189–211.Google Scholar
- Jagosh J, Bush PL, Salsberg J, Macaulay AC, Greenhalgh T, Wong G, Cargo M, Green LW, Herbert CP, Pluye P. A realist evaluation of community-based participatory research: partnership synergy, trust building and related ripple effects. BMC Public Health. 2015;15:725.View ArticlePubMedPubMed CentralGoogle Scholar
- Israel BA, Schulz AJ, Parker EA, Becker AB. Review of community-based research: assessing partnership approaches to improve public health. Annu Rev Public Health. 1998;19:173–202.View ArticlePubMedGoogle Scholar
- Nilsson JE, Marszalek JM, Linnemeyer RM, Bahner AD, Misialek LH. Development and assessment of the social issues advocacy scale. Educ Psychol Meas. 2011;71:258–75.View ArticleGoogle Scholar
- Rosenfield S. Factors contributing to the subjective quality of life of the chronic mentally ill. J Health Soc Behav. 1992:299–315.Google Scholar
- Morrow-Howell N, Hinterlong J, Rozario PA, Tang F. Effects of volunteering on the well-being of older adults. J Gerontol B Psychol Sci Soc Sci. 2003;58:S137–45.View ArticlePubMedGoogle Scholar
- Albanesi C, Cicognani E, Zani B. Sense of community, civic engagement and social well-being in Italian adolescents. J Community Appl Soc Psychol. 2007;17:387–406.View ArticleGoogle Scholar
- Sallis JF, Pinski RB, Grossman RM, Patterson TL, Nader PR. The development of self-efficacy scales for healthrelated diet and exercise behaviors. Health Educ Res. 1988;3:283–92.View ArticleGoogle Scholar
- Stewart AL, Mills KM, King AC, Haskell WL, Gillis D, Ritter PL. CHAMPS physical activity questionnaire for older adults: outcomes for interventions. Med Sci Sports Exerc. 2001;33:1126–41.View ArticlePubMedGoogle Scholar
- Hagströmer M, Bergman P, De Bourdeaudhuij I, Ortega FB, Ruiz JR, Manios Y, Rey-Lopez J, Phillipp K, Von Berlepsch J, Sjöström M. Concurrent validity of a modified version of the international physical activity questionnaire (IPAQ-A) in European adolescents: the HELENA study. Int J Obes. 2008;32:S42–8.View ArticleGoogle Scholar
- Migueles JH, Cadenas-Sanchez C, Ekelund U, Nyström CD, Mora-Gonzalez J, Löf M, Labayen I, Ruiz JR, Ortega FB. Accelerometer data collection and processing criteria to assess physical activity and other outcomes: a systematic review and practical considerations. Sports Med. 2017:1–25.Google Scholar
- Courneya KS, Conner M, Rhodes RE. Effects of different measurement scales on the variability and predictive validity of the “two-component” model of the theory of planned behavior in the exercise domain. Psychol Health. 2006;21:557–70.View ArticleGoogle Scholar
- Santos SM, Griep RH, Cardoso LO, MGdM A, MdJMd F, Giatti L, Chor D. Cross-cultural adaptation and reliability of measurements on self-reported neighborhood characteristics in ELSA-Brasil. Rev Saude Publica. 2013;47:122–30.View ArticlePubMedGoogle Scholar
- Bennett GG, McNeill LH, Wolin KY, Duncan DT, Puleo E, Emmons KM. Safe to walk? Neighborhood safety and physical activity among public housing residents. PLoS Med. 2007;4:e306.View ArticlePubMed CentralGoogle Scholar
- Furr-Holden C, Smart M, Pokorni J, Ialongo N, Leaf PJ, Holder HD, Anthony JC. The NIfETy method for environmental assessment of neighborhood-level indicators of violence, alcohol, and other drug exposure. Prev Sci. 2008;9:245–55.View ArticlePubMedPubMed CentralGoogle Scholar
- Bonney R, Shirk JL, Phillips TB, Wiggins A, Ballard HL, Miller-Rushing AJ, Parrish JK. Next steps for citizen science. Science. 2014;343:1436–7.View ArticlePubMedGoogle Scholar