Skip to main content

The development of the Comprehensive Analysis of Policy on Physical Activity (CAPPA) framework

Abstract

Background

Policy analysis is considered essential for achieving successful reforms in health promotion and public health. The only framework for physical activity (PA) policy analysis was developed at a time when the field of PA policy research was in its early stages. PA policy research has since grown, and our understanding of what elements need to be included in a comprehensive analysis of PA policy is now more refined. This study developed a new conceptual framework for PA policy analysis – the Comprehensive Analysis of Policy on Physical Activity (CAPPA) framework.

Methods

The development of the CAPPA framework was based on: (i) an extensive review of literature; (ii) an open discussion between the authors; (iii) three rounds of a Delphi process; and (iv) two-rounds of consultations with PA policy stakeholders.

Results

The CAPPA framework specifies 38 elements of a comprehensive analysis of PA policies in the following six categories, which comprise the building blocks of the framework: (i) purpose of analysis (including auditing and assessment of policies); (ii) policy level (including: international; national; subnational; local; and institutional policies); (iii) policy sector (including: health; sport; recreation and leisure; education; transport; environment; urban/rural planning and design; tourism; work and employment; public finance; and research sectors); (iv) type of policy (including: formal written policies; unwritten formal statements; written standards and guidelines; formal procedures; and informal policies); (v) stage of policy cycle (including: agenda setting; formulation; endorsement/legitimisation; implementation; evaluation; maintenance; termination; and succession); and (vi) scope of analysis (including availability; context; processes; actors; political will; content; and effects). Based on the CAPPA framework, we also proposed broad and inclusive definitions of PA policy and PA policy analysis.

Conclusion

The CAPPA framework may be used to guide future studies related to PA policy and to provide a context for the analysis of its specific components. The framework could be used in the same way for sedentary behaviour policy research. Future research should examine the extent to which PA policy analysis has covered each of the elements specified in the CAPPA framework and analyse the elements for which evidence is lacking. Future studies should also determine whether the existing tools allow for auditing and assessment of all the CAPPA elements and develop new tools if needed to allow for a more comprehensive PA policy analysis.

Background

Insufficient physical activity (PA) is among the key risk factors for non-communicable diseases (NCDs), such as type II diabetes, some types of cancer, and cardiovascular disease [1, 2]. NCDs cause the deaths of nearly 40 million people per year world-wide, which is around 70% of overall global mortality [3]. Accordingly, insufficient PA is considered one of the main risk factors for premature mortality worldwide [4]. For example, in 2008, approximately 9% of all deaths globally were attributed to insufficient PA [5]. Insufficient PA is also associated with a range of poor mental health outcomes, such as increased risk of depression [1]. Current inadequate PA levels also generate a significant economic burden for national healthcare systems. Conservatively estimated, physical inactivity costs healthcare systems worldwide around 53.8 billion international dollars, of which 68% is paid by the public sector [6]. Given these large health and economic impacts, investing in PA promotion is widely considered a “best buy” [2, 7]. The significant public health and economic burdens of insufficient PA also emphasise the need for good public health policy related to PA.

In the last two decades, several important events have contributed to PA planning and policy development [8]. One of the initial global-level policy developments in PA promotion occurred in 2004 when the World Health Organization (WHO) issued the Global Strategy on Diet, Physical Activity and Health [9]. Subsequently, in 2013, the WHO published the Global Action Plan for the Prevention and Control of NCDs [10]. In this document, national governments, as key players in the prevention and control of NCDs, are urged to: establish national NCD targets; develop national NCD plans; and measure their progress in tackling NCDs [10]. The plan provides a menu of policy options for governments and other stakeholders to take action in NCD control and prevention and includes a global target to reduce the prevalence of insufficient PA by 10% by 2025 [10]. In 2018, the WHO launched a Global Action Plan on Physical Activity which recommends 20 policy actions [11] and is currently preparing a monitoring framework that will provide member states with methods to appraise progress related to PA policy development. One of the key recommended actions to support the creation of active systems is strengthening of policy frameworks, governance, and leadership systems at both subnational and national levels, to encourage implementation of actions to increase PA [11].

Increasing PA in a population requires culturally adapted, large-scale actions across whole systems, including multiple contexts, such as the health, transport, sport, urban planning, and education sectors [11, 12]. As such, one of the essential determinants of active living is the policy environment [13]. The development and implementation of policies may facilitate the creation of supportive environments for people to engage in physically active lifestyles [14, 15]. Therefore, a vital platform for developing, managing, and providing such actions is a national-level policy [12]. By developing and implementing PA policies, national governments design political and legal frameworks that are necessary for local governments and municipalities to create opportunities and environments for PA and active living [16].

It has been suggested that further research is needed to better inform future PA policy development [8, 17, 18]. Understanding the policy process and impact is essential for facilitating successful reforms [19]. A valuable tool enabling evidence-based development and improvement of policies is policy analysis, a “craft” that has been evolving since the 1950s [20, 21]. Policy analysis is perceived as crucial to achieving successful reforms in health promotion [19]. In relation to PA promotion, an analysis of PA-related policies can: raise awareness of current policy gaps and opportunities; demonstrate policy related actions being taken across the system; encourage important debates; contribute to meeting health objectives [22]; provide a catalyst for cooperation and communications across different sectors and levels [12]; and assist decision makers in making better informed choices in a specific problem situation [23].

In a recent systematic review, Klepac Pogrmilovic et al. [24] found more than 150 studies on national-level PA policies, which suggests that this research field is relatively well developed. However, the review also found that very few studies relied on explicit and rigorous conceptual or theoretical frameworks, which may have led to vague and/or varied definitions and conceptualisations of PA policy. The review also found that researchers in this area have not reached consensus on the definitions of PA policy and PA policy analysis [24]. Taking this into account, Klepac Pogrmilovic et al. [24] suggested that more coordinated efforts on a standardised approach to PA policy analysis would contribute to further advancement of this research area [24].

In 2002, a major consultation on PA policy development took place between the WHO and the United States Centers for Disease Control and Prevention (CDC) [25], from which a PA policy framework was recommended. The framework addressed the necessary elements that PA policy needs to encompass [25]. The first and only framework designed specifically for PA policy research was developed by Schmid and colleagues in 2006, to improve categorisation, visualisation, and understanding of PA policy research [17]. The Schmid et al.’s framework is presented as a figure with three ‘axes’: policy, sector, and scale [17]. The most important axis is the vertical one which presents different ways in which policy may be studied: identifying policies (i.e. description), determinants of policy, developing and implementing policy, and the impacts of policies [17]. The remaining two axes are: the sector axis (including: health; transportation; parks/public spaces; worksite; and school sectors) and the levels axis (including: local; regional; state; national; and international policies) [17]. It furthermore conceptualises public policy at three levels as: formal written codes; written standards; and unwritten social norms. The framework was developed through four stages: a literature review; a review of other policy research frameworks; collaborative discussions; and three workshops.

Schmid et al.’s framework was developed at a time when the field of PA policy research was in its early stages, and it provided a useful foundation for several studies undertaken in the field [14, 26,27,28,29,30,31,32]. However, PA policy research has since grown as a research area [24, 33], and our understanding of what elements need to be included in a comprehensive analysis of PA policy is now more refined. For example, the scope of Schmid et al.’s framework [17] does not cover formal processes and unwritten formal statements. Also, it is focused primarily on public policies, with less emphasis on non-governmental policies (e.g. private sector policies) related to PA. Furthermore, the framework does not: aim to provide a platform to facilitate a specific policy analysis; take into account all stages of the policy cycle at which policies may need to be studied; or acknowledge that PA policy analysis may be focused on various aspects, such as the content of a policy, the context surrounding a policy, or the actors involved in the development of a policy. Therefore, a more comprehensive framework is needed to reflect this evolving and diversifying field and to better guide contemporary and future PA policy research.

Applying a comprehensive approach to PA policy, with a focus on analysis, may strengthen the evidence base on PA policy development and content, improve comparability between studies, and provide insight into why some countries, institutions, and agencies are more successful in developing enabling contexts within which PA promotion is more likely to happen and achieve real impact. The aim of this paper was to develop a new conceptual framework for PA policy analysis – the Comprehensive Analysis of Policy on Physical Activity (CAPPA) framework.

Methods

The development of the CAPPA framework was based on: (i) an extensive review of literature; (ii) an open discussion between the authors; (iii) three rounds of a Delphi process; and (iv) two rounds of consultations with ten PA policy stakeholders. The development of the framework is depicted in Fig. 1. We conducted a systematic literature review to identify studies that analysed national PA and/or SB policies [24]. By reviewing the content of 203 publications included in the review, we found 25 studies that relied on a theoretical or conceptual framework. For the current study, we reviewed the frameworks cited in these studies. Additionally, we conducted an extensive search of the literature on theoretical and conceptual frameworks used for the analysis of other PA policies (not national) and other public health policies. The search was conducted through reference lists of all identified articles in the systematic literature review, authors’ own archives, and the Google Scholar database. The initial draft of the CAPPA framework was developed by two authors (BKP and ZP) through a discussion based on the theoretical models and concepts presented in the existing literature related to policy analysis in general [20, 21, 34,35,36,37,38,39,40] and policy analysis within the health and PA research field [12, 17, 31, 32, 41,42,43,44,45,46].

Fig. 1
figure 1

Summary of the Comprehensive Analysis of Policy on Physical Activity (CAPPA) framework development

The first draft of the framework was revised on the basis of written comments provided by three authors (GOS, KM, and SJHB) and an open discussion between five of the authors (BKP, GOS, KM, SJHB, and ZP). These five authors were selected purposefully, as each one of them had specific academic expertise important for the development of the framework, including political science (BKP), psychology and qualitative methods (GOS), PA policy analysis (KM), epidemiology of PA and SB (SJHB), and methods and measurement in public health (ZP). The second draft of the framework was further considered by these authors, through a three-staged Delphi decisional process. The purpose of the Delphi process was to: (i) get independent suggestions from the panel members about how to improve the second draft of the framework; and (ii) achieve consensus about the draft framework. The Delphi method was employed to ensure anonymity in the process of reaching consensus on the structure and wording of the draft framework.

The Delphi method is a systematic approach to reaching consensus through interactive communication among experts [47]. The Delphi methodology is often used in PA policy research [48,49,50], as well as within the field of PA research in general [51]. Various tools may be employed to administer a Delphi process [52, 53]. For the current study, the panel members provided information by completing online surveys. An independent researcher outside the author team and the Delphi panel acted as the moderator for the Delphi process. Before starting each round, the moderator distributed to the panel members an email invitation containing the survey web link and a supplementary file with a detailed explanation of the draft structure of the framework and the definitions of the building blocks of the framework and their elements. After each round, the moderator collected the responses and provided feedback to the panel members. The feedback included summary comments related to each section of the survey as well as anonymised individual responses provided by all panel members.

The first round of the Delphi process covered three key areas: (i) name of the framework; (ii) overall structure of the framework; and (iii) the names and the definitions of all proposed building blocks of the framework and their respective elements. A combination of closed and open-ended questions was used in the survey for each specific section of the framework. For example, in the section of the survey related to the category “purpose of analysis”, these questions were posed: (i) “Do you agree with the inclusion, proposed names, and proposed definitions of the following elements of the framework in the ‘Purpose of analysis’ category?” (closed “yes/no” response); (ii) “If you disagree with the inclusion, name, and/or definition of any of the proposed elements, what would you suggest to change and why?” (open-ended response); (iii) “Do you think any other elements should be added to this category of the framework?” (closed “yes/no” response); and (iv) “If you do, please propose the names and definitions of the additional elements and briefly explain why you think they should be added” (open-ended response).

The third draft of the framework, developed in the Delphi process, was then revised through two-rounds of consultations with ten PA stakeholders, authors of the paper (AB, ARV, CW, HR, MK, MP, NC, NM, SK, and WB), who were asked to provide their written comments on the building blocks and elements of the framework and their definitions. The members of the consultation panel were selected purposefully, where the criteria for their inclusion in the panel were: (i) they have participated in the development of PA policy; and/or (ii) they are experts in PA policy research. Expertise of the consultation panel members relevant to the development of the framework included: development, implementation, and evaluation of PA policies and programmes; PA surveillance and monitoring; development of PA guidelines; PA interventions; public policy; and building international and global public health capacity. The consultation panel members were selected from various contexts, such as public policy, academia, national and international organisations for PA promotion, and public health consultancy. The comments on the third and pre-final draft of the framework made by the members of the consultation panel were discussed among all fifteen authors, which led to the development of the final version of the framework.

In this paper we relied on the broad and common definition of the term “policy analysis” that is “Policy analysis is any form of policy-relevant research” [54]. Based on the literature review and the CAPPA framework, herein we proposed definitions of PA policy and PA policy analysis that are aligned with a comprehensive approach to analysing PA policies.

Results

The first draft of the framework, developed through the literature review and collaborative discussions of two authors, contained five categories (i.e. building blocks of the framework): purpose; level; sectors; type of policy; and aspect of policy and their 24 elements. The framework was modified after an open discussion and extensive comments from the remaining authors. The second draft of the framework contained six building blocks of the framework (purpose of analysis; policy level; policy sector; type of policy; stage of policy cycle; and scope of analysis) and their 31 elements. The second draft of the framework was then refined through the Delphi process. During the three rounds, panel members reached consensus on more than 40 discussion points, while the final decision on two discussion points was made by a four-fifths supermajority vote. The Delphi panel agreed on the inclusion and definitions of six building blocks of the framework and their 35 individual elements. The final version of the framework was developed through two rounds of consultations with ten PA policy stakeholders. The consultation panel members made a total of 43 suggestions. Based on the suggestions and following a discussion between all authors of the paper, 32 final changes were made to the framework. This included: (i) changing the names of four elements of the framework; (ii) modification of fifteen definitions; (iii) adding two additional elements to the framework; (iv) dividing one element into two elements; and (v) refining the examples provided for ten elements.

The final CAPPA framework (Fig. 2) specifies 38 elements of a comprehensive analysis of PA policies in the following six categories (i.e. building blocks of the framework): purpose of analysis (including: auditing and assessment of policies); policy level (including: international; national; subnational; local; and institutional policies); policy sector (including: health; sport; recreation and leisure; education; transport; environment; urban/rural planning and design; tourism; work and employment; public finance; and research sectors); type of policy (including: formal written policies; unwritten formal statements; written standards and guidelines; formal procedures; and informal policies); stage of policy cycle (including: agenda setting; formulation; endorsement/legitimisation; implementation; evaluation; maintenance; termination; and succession); and scope of analysis (including: availability; context; processes; actors; political will; content; and effects). In Table 1, we provide the definitions of the building blocks and elements of the framework, together with examples that may facilitate their understanding.

Fig. 2
figure 2

Structure of the Comprehensive Analysis of Policy on Physical Activity (CAPPA) framework

Table 1 Definitions of the building blocks and elements of Comprehensive Analysis of Policy on Physical Activity (CAPPA) framework

Definitions of PA policy and PA policy analysis

According to the CAPPA framework, PA policy is indicated by the totality of formal written policies, unwritten formal statements, written standards and guidelines, formal procedures, and informal policies (or lack thereof) that may directly or indirectly affect community- or population-level PA. Accordingly, we defined PA policy analysis as any kind of policy-relevant research that audits or assesses one or more aspects of PA policy.

Discussion

In this study, we developed the CAPPA framework as a conceptual inventory of components necessary for a comprehensive analysis of PA policy, including definitions of two different purposes of analysis, five policy levels, eleven policy sectors, five types of policy, eight stages of policy cycle, and seven elements that reflect the scope of policy analysis. The framework was developed to improve the comprehensiveness and contribute to the standardisation of PA policy analysis research. This comprehensive conceptual framework may serve as a “road map” for researchers and academics interested in PA policy analysis as well as to policymakers and health policy practitioners interested in the development, monitoring, implementation, and analysis of PA policies. The framework can also be used for categorising PA policies or as a classification system for PA policy research. To further facilitate the standardisation of PA policy research, we also proposed definitions of PA policy and PA policy analysis that are aligned with the CAPPA framework.

Purpose of analysis

Studies can be conducted with the purpose of auditing and/or assessment of PA policies. Policy auditing is a prerequisite for policy assessment, as we first need to know which aspects of policy exist (or existed), before we can assess them. An assessment of the aspects of policy identified in the audit process will then determine how good they are against certain standards. For a comprehensive analysis of PA policies, it is important to both audit and assess relevant policies. For example, a country may have a range of national PA policies in place, including a PA strategy and a PA action plan, but it is possible that none of them are evidence based, none of them specify clear targets, none of them define feasible ways to improve population-levels of PA, and none are funded or implemented. Policy assessment may need to be done to elucidate some of the important questions about PA policies. It should be noted, however, that policy auditing and policy assessment may be extremely time-consuming, and it is, therefore, often not practical to conduct both within a single study.

Policy level

PA policies can be developed at various levels. The simplest classification found in the literature makes a distinction between PA policies that occur at the national and international levels [68]. PA policies at the national level are usually developed by the Government or a governmental body, but they may also be developed by non-governmental or advisory bodies, and later endorsed by the Government. The ways to classify policies below the national level may vary depending on the country in question and its political system. Policies can be developed and implemented on subnational levels such as state, federal, municipal, regional, and provincial. The CAPPA framework was developed with the intention of being as applicable as possible to various political systems. Therefore, we did not distinguish between a range of different levels that are below the national level and above the local level. Instead, we encompassed all such levels with the broad term “subnational”. PA policy researchers should, however, clearly distinguish between different subnational levels in the context of the political system they are investigating and endeavour to analyse policies separately at each of the levels. Schmid et al.’s conceptualisation of scale (i.e. equivalent to policy level in the CAPPA framework) does not include the “institutional” level, because their framework focused mainly on public policies [17], that is, the policies related to government actions [34]. In the CAPPA framework we included the “institutional” level, because policies at this level often have a key role in the development and implementation of PA interventions. Furthermore, it can be assumed that policies at one level may influence the adoption and shaping of policies at other levels. For a complete understanding of PA policy, it is therefore important to analyse policies at all levels, as well as to consider their possible interactions.

Policy sector

Policies in a range of sectors may directly or indirectly affect PA levels in the population [41, 69]. This is also acknowledged in the Schmid et al.’s framework [17], which includes five sectors: health; transportation; parks/public spaces; worksite; and school. In the CAPPA framework we built on Schmid et al.’s sectors and added other sectors that were previously identified as relevant to this research field such as: public finance; research; sport; recreation and leisure; and tourism [11, 17, 41, 69].

It should be noted, however, that policy sectors may be termed differently and overlap more or less, depending on the specific context of a given country. Therefore, the CAPPA sectors should be interpreted in the context of a specific country. Furthermore, we acknowledge that PA policies can, and in many cases should, be cross-sectoral, that is, developed and/or implemented across multiple sectors. When classifying a policy according to the CAPPA framework, one should, therefore, not necessarily try to fit it within a single sector. This may present a methodological challenge in some classifications, but it is inevitable due to the complex nature of PA policies. Future users of the CAPPA framework may choose to report on all sectors to which a policy applies or to prioritise the sector that initiated or is responsible for the policy. For example, in the case of a Walk to school policy issued by the Ministry of Education, the priority could be given to the education sector, but a policy analyst could choose to report that this policy also belongs to the transport sector. When making such classifications, it is, therefore, important to clearly describe the criteria that were applied.

We also aimed to clearly differentiate between “sectors” and “settings”, because one sector usually includes multiple settings and one setting can belong to multiple sectors. For example, the education sector includes settings such as childcare centres, primary schools, secondary schools, and universities. At the same time, each of these settings is also a part of the work and employment sector, because they employ their staff. There is a vast number of settings that might include PA-related policies, and any attempt to list them all is unlikely to result in an exhaustive inventory. For this reason, in the CAPPA framework we did not provide a list of settings that are potentially relevant from the perspective of a comprehensive PA policy analysis. PA policy researchers should consider analysing PA policies in all the sectors included in the CAPPA framework and in as many relevant settings as possible.

Type of policy

There are different types of policies, and they are not necessarily always in the written form. This has already been acknowledged by Schmid et al. [17]. They conceptualised policy at three levels: (i) formal written regulations, codes, or decisions bearing legal authority; (ii) written standards that guide choices; and (iii) unwritten social norms [17]. Formal written policies in the CAPPA framework correspond to Schmid et al.’s first level. Written standards and guidelines and informal policies in the CAPPA framework correspond to the second level and the third level in the Schmid et al.’s framework [17], respectively. As suggested by Schmid et al., informal policies are “considered to be part of culture rather than explicit policy and not a primary focus of initial physical activity policy research” [17]. However, analysing informal policies could bring additional valuable insights into overall PA policy directions that may subsequently inform policy decision-making. Policy may be conceptualised in a broader sense to also include formal procedures [44] and unwritten formal statements [35], which has been acknowledged in the CAPPA framework. Such statements may play an important role in shaping the general policy context within which the dominant beliefs may subsequently get converted into formal written policies. Formal procedures, such as PA surveillance, may be indicators of the body’s position or commitment regarding PA. Formal procedures are usually (but not necessarily) supported by a formal written or unwritten policy. Furthermore, the analysis of unwritten formal statements may also provide valuable insights about the intentions of a given body regarding PA. The definition of unwritten formal statements in the CAPPA framework is in line with the definition of public policy as an “authoritative statement by a government about its intentions” [35]. Unwritten formal statements related to PA have previously been studied mainly using discourse analysis as a research method [70, 71].

Investigating understudied types of policies may help better elucidate policy-related correlates of PA. For example, a conclusion that a certain country has an underdeveloped PA policy simply based on an analysis that showed it lacks formal written policies, may be misleading. The country might have informal policies in place that promote PA, and unwritten formal statements created through announcements or verbal declarations by its decision makers may indicate the government has well-conceived plans and mechanisms for PA promotion. In a different example, a country might have a well-developed formal written policy, but certain informal policies and unwritten formal statements (or lack thereof) may indicate a lack of political will to support PA promotion. It is important to note, however, that analysing unwritten formal statements and informal policies could be challenging, as they may be more difficult to identify and evaluate than formal written statements, written standards and guidelines, and formal procedures.

Stage of policy cycle

The list and definitions of stages of policy cycle in the CAPPA framework, were mainly informed by the health policy and political science literature. The concept of policy cycles was originally “employed prescriptively as a way to organize policymaking”, but it further evolved as a framework common for analysing policies [38]. The WHO specified the following stages of the policy cycle: problem identification and agenda setting; policy formation; adoption; policy implementation; and policy evaluation [42]. Informed by Cairney’s conceptualisation of the policy cycle [38], for the purpose of the CAPPA framework we adapted the WHO’s five-stage policy cycle to include an additional three elements ─ maintenance, termination, and succession. The CAPPA framework contains eight stages which is an important advance from the four-stage structure of Schmid et al.’s earlier framework [17].

It should be noted that a policy will not necessarily go through all the stages of the policy cycle. For example, a policy may be enacted by Parliament, but that does not necessarily mean it will ever be implemented in practice. Furthermore, stages in the cycle of a given policy may not necessarily be in the order presented in the CAPPA framework. For example, some policies may be formulated without going through the agenda setting stage. Some policies may be formulated, maintained, and terminated without ever being implemented or ever being evaluated. Furthermore, a policy may pass multiple times through the same stage (e.g. a policy can be evaluated on several occasions). For a thorough understanding of a PA policy, it is important to analyse all the stages that it went through.

Scope of analysis

Most previous research on national PA policies has focused on analysing availability of policies (i.e. whether specific policies exist) and their content (i.e. what information they include) [24]. Analysis of availability of policies should not be confused with auditing as a purpose of PA policy analysis, because theoretically the availability of policies can be both audited (e.g. using the open-ended questionnaire item: “Please list the PA policies that are available in your country!”) and assessed (e.g. using the question: “How would you rate the range of PA policies available in your state compared to the national level?”, with the response scale: “Less available policies” / “Similar number of available policies” / “More available policies”). The analysis of policy content should not be confused with assessment as a purpose of PA policy analysis, because the content of a policy can also be both audited (e.g. using the question “Does the national PA strategy include specific targets for different population groups?”, with the “yes/no” response scale) and assessed (e.g. with the question: “On a scale from 0 to 10, please rate the overall quality of the national PA strategy”). For some types of PA policy, the analysis of content can be performed by using qualitative methods for content analysis, that is, by coding and interpreting text of written documents, transcribed oral communications, and graphics.

Furthermore, Walt’s simple health policy analysis framework distinguishes between four elements: context, content, process, and actors [45]. Context, content, processes, and actors often play pivotal roles in different stages of the policy cycle. In the CAPPA framework, we therefore acknowledge the importance of analysing all these elements in addition to the availability, political will, and the effects of policies. Political will represents a bridge between public health action and knowledge [72] and is considered to be essential for making changes in public health policy [73]. Political support and commitment to a PA policy are recognised as highly relevant factors for the success of the policy and are, therefore, important parts of a comprehensive PA policy analysis [69, 74,75,76]. Researchers may be deterred from analysing the effects of PA policies, because these may be difficult to measure. It has therefore been suggested, as one of the key priorities for the progress of the PA policy research field, to develop better tools for analysing the effects of policies [17]. This was recognised by the Physical Activity Policy Research Network (PAPRN) in the USA, which conducted a ten-year study of the effectiveness of policies to increase levels of PA [77]. In 2017, they concluded there is a lack of studies on the outcomes of PA policies [78].

When it comes to an overall policy-making process, political power is often a vital force. In the political arena, various groups exercise their political power to reach their goals, either by advocating for a change or blocking it [79]. In health policy analysis, power is usually considered in relation to two elements of the CAPPA framework; namely, processes and actors [22]. However, power can also be studied within other elements of the scope of analysis category such as political will or context. Political will, necessary to introduce any policy change, may be highly influenced by power relations and values within and outside of the government. For example, members of the government can have a strong political will to increase resources necessary for the implementation of a nutrition and PA strategy that aims to reduce children’s obesity rates. However, powerful food industry lobbies may block the strategy implementation, if the proposed measures are not in their best interests.

Definitions of PA policy and PA policy analysis

Within the field of political science, there is no consensus on what constitutes “a policy” or a policy analysis [24]. Similarly, within the PA research field, “PA policy” was defined and conceptualised differently across studies, whilst a large majority of the studies on national PA polices did not explicitly state how they defined PA policy [24]. The majority of studies that provided their operational definition of PA policy conceptualised policy within Schmid et al.’s first level [24], that is, as the formal written regulation, code, or decision bearing legal authority [17] which corresponds to formal written policies in the CAPPA framework. For example, several PA policy studies relied on the definition of a policy that conceptualises ‘policy’ as a ‘policy document’, that is, “a written document that contains strategies and priorities, defines goals and objectives, and is issued by a part of the administration” [31, 32, 69]. Restricting the conceptualisation of PA policy only to “written documents” may be practical for researchers, because these types of policies are usually the easiest to identify. However, this approach may exclude other possible aspects of policy such as “unwritten statements”. Some health and PA policy researchers based their studies on a broader definition of policy, which besides formal statements also includes informal institutional procedures, arrangements, and justifications for action [44]. We acknowledge that various studies have different purposes and may therefore employ the most suitable definition for the scope of the study. We also acknowledge that it may be impossible to analyse all aspects of PA policy in a single study and that sometimes it may be necessary to reduce the analysis to only one or two aspects of PA policy. However, we believe a comprehensive standardised definition of PA policy may contribute to further development of the PA policy research field. Therefore, based on the CAPPA framework and various understandings of PA policies that were detected in our recent systematic scoping review [24], we defined PA policy broadly, to be as inclusive as possible. We used a similar comprehensive and inclusive approach in defining PA policy analysis, whilst relying on the CAPPA framework and a broad definition of policy analysis from the field of political science [54].

Possible applications of the CAPPA framework in PA policy research

The CAPPA framework can be used for a variety of purposes. These include (but are not limited to): (i) to help PA policy researchers conceptualise their study questions, that is, as a source of ideas what can and should be analysed; (ii) as a benchmark for evaluating what has been done in terms of PA policy research overall, in its specific areas, and in specific contexts (e.g. in specific countries); (iii) as a guide for policymakers, who want to influence population-level PA, on which types of policies and which policy sectors they can focus on in their endeavours; (iv) to help PA policy researchers improve between-study comparability, particularly by using the definitions provided within the framework; (v) to help assess the comprehensiveness and content validity of the available tools for PA policy analysis; and (vi) to guide the development of new PA policy analysis tools, particularly regarding the facets of PA policy they are intended to measure.

A practical example of a possible application of the CAPPA framework can be found in our recent systematic review of instruments for PA policy analysis [80]. For every instrument included in the review we determined whether it was designed for auditing or assessment of PA policies, which policy sectors, types of policy, and stages of policy cycle it covers, and what is encompassed in its scope of analysis. The list of elements of the CAPPA framework served as a benchmark for the assessment of comprehensiveness of the included instruments. An extract (for four sample instruments) from the data extraction table can be found in Table 2. The definitions provided in the CAPPA framework enabled us to conduct the assessments consistently across all instruments and between two authors who took part in the data extraction process. In the same review, we used the CAPPA framework also to guide the synthesis of findings. It enabled us to easily identify which elements needed for a comprehensive analysis of PA policy cannot be analysed using the available instruments.

Table 2 An example of a possible application of the Comprehensive Analysis of Policy on Physical Activity (CAPPA) framework: an extract from a review of instruments for the analysis of physical activity and/or sedentary behaviour policies

Applicability of the CAPPA framework to the analysis of sedentary behaviour policy

Research suggests that uninterrupted prolonged periods of sedentary behaviour (SB) (i.e. waking activities in a sitting, reclining, or lying posture with very low energy expenditure) are associated with increased risk of cardiovascular disease, type II diabetes, and some types of cancer [86]. It was estimated that high SB is responsible for nearly 4% of deaths from all causes internationally [5]. It is therefore of public health importance to reduce SB in the population. PA and SB are often considered within the same study, as these behaviours are co-dependent [87]. A recent review found that all but one study that analysed national SB policies also analysed PA policies [24]. Given that PA and SB policy research fields largely overlap and that contexts of PA and SB policies are very similar, the CAPPA framework and definitions analogous to the ones provided for PA policy and PA policy analysis may also be used to guide research on SB policies.

Strengths and limitations of the study

The key strength of this study is a rigorous method used to develop the framework, which included an extensive literature review, three rounds of Delphi process, and two rounds of consultations with stakeholders. The CAPPA framework provides a categorisation of a complex area into measurable component parts. Each of these components is defined, and can be audited and assessed in combination to provide a comprehensive understanding of PA policy. The main strengths of the CAPPA framework are its: (i) comprehensiveness; (ii) generalisability to different political contexts; (iii) supporting definitions that underpin each building block of the framework and its elements; and (iv) visual simplicity.

The CAPPA framework is also subject to some limitations. The authors aimed to make the building blocks of the framework and their elements as generalisable as possible, but given a variety of policy contexts internationally, some elements may not be applicable to all countries. Also, due to the complexities in the political context, an overlap between the various elements of the framework was inevitable. Future users of the framework should acknowledge the possible overlap and specify the way they choose to deal with it. Whilst the first draft of the framework was developed based on a comprehensive literature review, due to the wealth of literature in the fields of political science, health policy research, and PA policy research, the authors acknowledge there might be aspects of PA policy analysis that are not encompassed by the CAPPA framework.

Conclusion

The CAPPA framework may be used to guide future studies related to PA policy, provide a context for the description, understanding, and analysis of its specific components and serve as a classification system for research on PA policies. It may also serve as a benchmark for the evaluation of comprehensiveness of existing tools for the analysis of PA policy and guide the development of new tools. The framework can be used in the same way for SB policy research. Operational definitions of different aspects of policy varied significantly across previous studies in this area [24]. The definitions of specific types of policy, aspects of policy, and purposes of policy analysis provided in the CAPPA framework might help in achieving standardisation of terminology in this area and in improving the comparability of findings across different studies. Future research should examine the extent to which PA policy analysis has covered each of the elements specified in the CAPPA framework. Future studies should also evaluate whether the existing tools for PA policy analysis allow for auditing and assessment of all the elements of the CAPPA framework and develop new tools where needed.

Availability of data and materials

Not applicable.

Abbreviations

CAPPA:

Comprehensive Analysis of Policy on Physical Activity

CDC:

Centers for Disease Control and Prevention

NCD:

Noncommunicable disease

PA:

Physical activity

SB:

Sedentary behaviour

WHO:

World Health Organization

References

  1. Lee I-M, et al. Effect of physical inactivity on major non-communicable diseases worldwide: an analysis of burden of disease and life expectancy. Lancet. 2012;380(9838):219–29.

    Article  Google Scholar 

  2. Physical Activity Guidelines Advisory Committee. 2018 Physical Activity Guidelines Advisory Committee scientific report. Washington, DC: U.S. Department of Health and Human Services; 2018.

  3. World Health Organization. Noncommunicable diseases. 2 February 2018; Available from: http://www.who.int/mediacentre/factsheets/fs355/en/. Accessed 2 Feb 2018.

  4. World Health Organization. Physical activity fact sheet. 2 February 2018; Available from: http://www.who.int/mediacentre/factsheets/fs385/en/. Accessed 2 Feb 2018.

  5. de Rezende LFM, et al. All-cause mortality attributable to sitting time: analysis of 54 countries worldwide. Am J Prev Med. 2016;51(2):253–63.

    Article  Google Scholar 

  6. Ding D, et al. The economic burden of physical inactivity: a global analysis of major non-communicable diseases. Lancet. 2016;388(10051):1311–24.

    Article  Google Scholar 

  7. MacAuley D, Bauman A, Frémont P. Exercise: not a miracle cure, just good medicine. Br J Sports Med. 2016;50(18):1107–8.

    Article  Google Scholar 

  8. Kohl HW 3rd, et al. The pandemic of physical inactivity: global action for public health. Lancet. 2012;380(9838):294–305.

    Article  Google Scholar 

  9. World Health Organization. WHO global strategy on diet, physical activity and health. Food Nutr Bull. 2004;25(3):292–302.

    Article  Google Scholar 

  10. World Health Organization. Global action plan for the prevention and control of NCDs 2013–2020. Geneva: World Health Organization; 2013.

    Google Scholar 

  11. World Health Organization. Global action plan on physical activity 2018–2030: more active people for a healthier world. Geneva: World Health Organization; 2018.

    Google Scholar 

  12. Bull F, Milton K, Kahlmeier S. National policy on physical activity: the development of a policy audit tool. J Phys Act Health. 2014;11(2):233–40.

    Article  Google Scholar 

  13. Sallis J, et al. An ecological approach to creating active living communities. Annu Rev Public Health. 2006;27:297–322.

    Article  Google Scholar 

  14. Bellew B, et al. Public policy actions needed to promote physical activity. Curr Cardiovasc Risk Rep. 2011;5(4):340–9.

    Article  Google Scholar 

  15. World Health Organization, Physical activity for health, more active people for a healthier world: draft global action plan on physical activity 2018–2030. World Health Organization; 2017.

  16. World Health Organization. Physical Activity/Policy. 2018; Available from: http://www.euro.who.int/en/health-topics/disease-prevention/physical-activity/policy. Accessed 18 March 2018.

  17. Schmid TL, Pratt M, Witmer L. A framework for physical activity policy research. J Phys Act Health. 2006;3(Suppl 1):S20–9.

    Article  Google Scholar 

  18. Rütten A, et al. Three types of scientific evidence to inform physical activity policy: results from a comparative scoping review. Int J Public Health. 2016;61(5):553–63.

    Article  Google Scholar 

  19. Walt G, Gilson L. Reforming the health sector in developing countries: the central role of policy analysis. Health Policy Plan. 1994;9(4):353–70.

    Article  CAS  Google Scholar 

  20. Lasswell HD, Lerner D, Fisher HH. The policy sciences: recent developments in scope and method. Palo Alto: Stanford University Press; 1951.

  21. Bardach E, Patashnik EM. A practical guide for policy analysis: the eightfold path to more effective problem solving. Washington: CQ press, SAGE Publications; 2015.

  22. Buse K, et al. How can the analysis of power and process in policy-making improve health outcomes? World Hosp Health Serv. 2009;45(1):4–8.

    PubMed  Google Scholar 

  23. Quade ES, Carter GM. Analysis for public decisions. Cambridge: MIT Press; 1989.

    Google Scholar 

  24. Klepac Pogrmilovic B, et al. A global systematic scoping review of studies analysing indicators, development, and content of national-level physical activity and sedentary behaviour policies. Int J Behav Nutr Phys Act. 2018;15:123.

  25. Shephard RJ, et al. Physical activity policy development: a synopsis of the WHO/CDC Consultation, September 29 through October 2, 2002, Atlanta, Georgia. Public Health Rep. 2004;119(3):346–51

    Article  Google Scholar 

  26. Eyler A. Promoting physical activity through policy. Research Digest of the President’s Council on Fitness, Sports & Nutrition. 2011;12(3):1–9.

    Google Scholar 

  27. Pratt M, et al. An international perspective on the Nexus of physical activity research and policy. Environ Behav. 2016;48(1):37–54.

    Article  Google Scholar 

  28. Rütten A, et al. Supportive environments for physical activity, community action, and policy in 8 European Union member states: comparative analysis and specificities of context. J Phys Act Health. 2013;11(5):873–83.

    Article  Google Scholar 

  29. Woods CB, Mutrie N. Putting physical activity on the policy agenda. Quest. 2012;64(2):92–104.

    Article  Google Scholar 

  30. Wu BR. Understanding network governance: a case study exploration of Active Canada 20/20. St. Catharines, Ontario: Brock University; 2015.

  31. Christiansen N, Kahlmeier S, Racioppi F. Sport promotion policies in the European Union: results of a contents analysis. Scand J Med Sci Sports. 2014;24(2):428–38.

    Article  CAS  Google Scholar 

  32. Daugbjerg SB, et al. Promotion of physical activity in the European region: content analysis of 27 national policy documents. J Phys Act Health. 2009;6(6):805–17.

    Article  Google Scholar 

  33. Varela AR, et al. Mapping the historical development of physical activity and health research: a structured literature review and citation network analys. Prev Med. 2018;111:466–72.

    Article  Google Scholar 

  34. Dye TR. Understanding public policy: Pearson new international edition. Upper Saddle River: Pearson Higher Ed; 2013.

  35. Althaus C, Bridgman P, Davis G. The Australian policy handbook. Melbourne: Allen & Unwin; 2013.

    Google Scholar 

  36. Colebatch HK. Policy analysis, policy practice and political science. Aust J Public Adm. 2005;64(3):14–23.

    Article  Google Scholar 

  37. Dunn WN. Public policy analysis: Upper Saddle River: Pearson Education; 2004.

  38. Cairney P. Understanding public policy: theories and issues. Hampshire: Palgrave MacMillan; 2012.

    Chapter  Google Scholar 

  39. Kustec-Lipicer S. Vrednovanje javnih politika. Zagreb: Disput; 2012.

    Google Scholar 

  40. Fischer F, Miller GJ, Sidney MS. Handbook of public policy analysis: theory, politics, and methods. Boca Raton: CRC Press, Taylor and Francis Group; 2007.

    Google Scholar 

  41. World Health Organization. Factsheets on health-enhanching physical activity in the 28 European Union member states of the WHO European region. Copenhagen: World Health Organization, Regional Office for Europe; 2015.

  42. World health Organization. Health Service Planing and Policy Making: A toolkit for nurses and midwifes. Manila: World Health Organization. Regional Office for the Western Pacific; 2005.

    Google Scholar 

  43. Milton K, Bauman A. A critical analysis of the cycles of physical activity policy in England. Int J Behav Nutr Phys Act. 2015;12:8.

  44. Rütten A, et al. Policy assessment and policy development for physical activity promotion: Results of an exploratory intervention study in 15 European Nations. Health Res Policy Syst. 2012;10:14.

  45. Walt G. In: Janovsky K, editor. Policy analysis: an approach, in health policy and systems development: an agenda for research. Geneva: World Health Organization; 1996. p. 225–42.

  46. Centers for Disease Control and Prevention, US Department of Health and Human Services. CDC’s Policy Analytical Framework. Atlanta: Centers for Disease Control and Prevention; 2013.

  47. Dalkey N, Helmer O. An experimental application of the DELPHI method to the use of experts. Manag Sci. 1963;9(3):1–17.

    Article  Google Scholar 

  48. Aro AR, et al. Integrating research evidence and physical activity policy making-REPOPA project. Health Promot Int. 2016;31(2):430–9.

    Article  Google Scholar 

  49. Aarts M, et al. Feasibility of multi-sector policy measures that create activity-friendly environments for children: results of a Delphi study. Implement Sci. 2011;6:128.

    Article  Google Scholar 

  50. Valente A, et al. Models and visions of science- policy interaction: remarks from a delphi study in Italy. Sci Public Policy. 2015;42(2):228–41.

    Article  Google Scholar 

  51. Gillis L, et al. Research priorities for child and adolescent physical activity and sedentary behaviours: an international perspective using a twin-panel Delphi procedure. Int J Behav Nutr Phys Act. 2013;10:112.

    Article  Google Scholar 

  52. Stevenson V. Some initial methodological considerations in the development and design of Delphi Surveys: Cardiff: Low Carbon Research Institute; 2010.

  53. Gill FJ, et al. Using a web-based survey tool to undertake a Delphi study: Application for nurse education research. Nurs Educ Today. 2013;33:1322–8.

    Article  Google Scholar 

  54. Hird J. In: Friedman LS, editor. How effective is policy analysis?, in: Does policy analysis matter?: Exploring its effectiveness in theory and practice. Oakland, California: University of California Press; 2017. p. 44–84.

  55. U.S. Department of Health and Human Services. Physical activity and health: a report of the Surgeon General. Atlanta: U.S. Department of Health and Human Services, Public Health Service, CDC, National Center for Chronic Disease Prevention and Health Promotion; 1996.

  56. The Scottish Government. Scotland’s sport strategy for children and young people – giving children and young people a sporting chance. Edinburgh: Scottish Government; 2014.

  57. City of Darebin. Leisure strategy and action plan 2015-2020. Preston, Melbourne: City of Darebin; 2015.

  58. State Government of Victoria Education and Training. Physical and sport education policy. Victoria: State Government of Victoria; 2017.

  59. Department of Transport Tourism and Sport. Smart travel, a sustainable transport future: a new transport policy for Ireland 2009-2020. Dublin 2: Department of Transport, Tourism and Sport; 2009.

  60. Kahlmeier S, et al. Swiss national environment and health action plan (NEHAP): baseline assessment calls for action. Epidemiology. 2000;11(4):S130.

  61. Bull F, et al. National policy approaches to promoting physical activity: seven case studies from europe. Final technical report 2: full country case studies. Perth: The School of Population Health, The University of Western Australia; 2014.

  62. Government of Alberta. Best practices for the assessment and control of physical hazards: best practices guidelines for occupational health and safety in the healthcare industry. Alberta: Work Safe Alberta; 2011.

    Google Scholar 

  63. Government of Victoria. 2018-2019 state budget. Melbourne: Government of Victoria, Treasury and Finance; 2018.

  64. Government of Canada. Physical activity and sport act S.C. 2003, c. 2. Ottawa, Canada: Government of Canada; 2003.

  65. Victorian Government. Active Victoria, a strategic framework for sport and recreation in Victoria 2017 - 2021. Melbourne: State of Victoria, Department of Health and Human Services; 2017.

  66. Australian Government. Australia's physical activity and sedentary behaviour guidelines. Canberra: Australian Government, Department of Health; 2014.

  67. Australian Bureau of Statistics. Australian health survey: physical activity, 2011-12. Canberra: Australian Government, Australian Bureau of Statistics; 2011.

  68. Lankenau B, Solari A, Pratt M. International physical activity policy development: a commentary. Public Health Rep. 2004;119(3):352–5.

    Article  Google Scholar 

  69. Bull F, Milton K, Kahlmeier S. Health-Enhancing Physical Activity (HEPA) Policy Audit Tool (PAT) - Version 2. Copenhagen: World Health Organization, Regional Office for Europe; 2015.

  70. Lagos RAS. Sedentary lifestyle, sports and biopolitical pressure for healthy living: discourse analysis on the “choose to live healthy” system in Chile. Movimento. 2016;22(2):391–402.

    Article  Google Scholar 

  71. Gillon P. A human rights-based approach to the discourses governing active recreation in New Zealand. Auckland: Auckland University of Technology; 2010.

    Google Scholar 

  72. Lezine D, Reed G. Political will: a bridge between public health knowledge and action. Am J Public Health. 2007;97(11):2010–3.

    Article  Google Scholar 

  73. Cullerton K, et al. Playing the policy game: a review of the barriers to and enablers of nutrition policy change. Public Health Nutr. 2016;19(14):2643–53.

    Article  Google Scholar 

  74. Yancey AK, Cole BL, McCarthy WJ. A graphical, computer-based decision-support tool to help decision makers evaluate policy options relating to physical activity. Am J Prev Med. 2010;39(3):273–9.

    Article  Google Scholar 

  75. Tremblay M, et al. Physical activity of children: a global matrix of grades comparing 15 countries. J Phys Act Health. 2014;11(Suppl 1):S113–25.

    Article  Google Scholar 

  76. Bellew B, et al. The rise and fall of Australian physical activity policy 1996–2006: a national review framed in an international context. Aust New Zealand Health Policy. 2008;5:18.

  77. Prevention Research Center in St. Louis. Physical Activity Policy Research Network (PAPRN). 2018 21.05.2019]; Available from: https://prcstl.wustl.edu/items/physical-activity-policy-research-network-paprn-2/. Accessed 21 May 2019.

  78. Manteiga A, et al. The Impact of the Physical Activity Policy Research Network. Am J Prev Med. 2017;52(3(Suppl 3):S224–7.

    Article  Google Scholar 

  79. Birkland TA. An introduction to the policy process: theories, concepts and models of public policy making. New York and London: Routledge; 2014.

    Book  Google Scholar 

  80. Klepac Pogrmilovic B, et al. A systematic review of instruments for the analysis of national-level physical activity and sedentary behaviour policies. Health Res Policy Syst. In press.

  81. Bull F, et al. National policy approaches to promoting physical activity: seven case studies from europe. Final technical report. Perth: The School of Population Health, The University of Western Australia; 2014.

  82. Bull F, et al. Turning the tide: national policy approaches to increasing physical activity in seven European countries. Br J Sports Med. 2014;49(11):749–56.

    Article  Google Scholar 

  83. Ramirez, Varela A, et al. 1st Physical Activity Almanac: The Global Observatory for Physical Activity - GoPA. The Global Observatory for Physical Activity; 2016.

  84. Ramirez Varela A, et al. Worldwide surveillance, policy and research on physical activity and health: The Global Observatory for Physical Activity. J Phys Act Health. 2017;14(9):701–9.

    Article  Google Scholar 

  85. Rütten A, Gelius P, Abu-Omar K. Policy development and implementation in health promotion—from theory to practice: the ADEPT model. Health Promot Int. 2010;26(3):322–9.

    Article  Google Scholar 

  86. de Rezende LFM, et al. Sedentary behavior and health outcomes: an overview of systematic reviews. PLoS One. 2014;9(8):e105620.

    Article  Google Scholar 

  87. Pedišić Ž, Dumuid D, Olds T. Integrating sleep, sedentary behaviour, and physical activity research in the emerging field of time-use epidemiology: definitions, concepts, statistical methods, theoretical framework, and future directions. Kinesiology. 2017;49(2):135–45.

    Article  Google Scholar 

Download references

Acknowledgments

This article is a part of the PhD project of the first author, BKP, supervised by KM, SJHB, and ZP (principal supervisor). The authors wish to thank Jozo Grgic (JG) for his generous help as the moderator in the Delphi decisional process.

Funding

Not applicable.

Author information

Authors and Affiliations

Authors

Contributions

BKP and ZP conceived the idea for the study. BKP, GOS, and ZP reviewed the literature. BKP and ZP developed the initial version of the framework. BKP and ZP designed the questionnaire and supplementary materials used in the Delphi process. BKP, GOS, KM, SJHB, and ZP, participated in the open discussion and three rounds of the Delphi process about the framework. AB, ARV, CW, HR, MK, MP, NC, NM, SK, and WB participated in the consultation process. All authors participated in the discussion about the final version of the framework. BKP drafted the initial manuscript. ZP, KM, GOS, SJHB, AB, ARV, CW, HR, MK, MP, NC, NM, SK, and WB contributed to writing the manuscript. All authors read and approved the final manuscript.

Corresponding author

Correspondence to Zeljko Pedisic.

Ethics declarations

Ethics approval and consent to participate

Not applicable.

Consent for publication

Not applicable.

Competing interests

The authors declare that they have no competing interests.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Klepac Pogrmilovic, B., O’Sullivan, G., Milton, K. et al. The development of the Comprehensive Analysis of Policy on Physical Activity (CAPPA) framework. Int J Behav Nutr Phys Act 16, 60 (2019). https://doi.org/10.1186/s12966-019-0822-5

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12966-019-0822-5

Keywords