Skip to main content
Download PDF
Download ePub

The effect of temperature on physical activity: an aggregated timeseries analysis of smartphone users in five major Chinese cities

International Journal of Behavioral Nutrition and Physical Activity volume 19, Article number: 68 (2022) Cite this article

Abstract

Background

Physical activity is an important factor in premature mortality reduction, non-communicable disease prevention, and well-being protection. Climate change will alter temperatures globally, with impacts already found on mortality and morbidity. While uncomfortable temperature is often perceived as a barrier to physical activity, the actual impact of temperature on physical activity has been less well studied, particularly in China. This study examined the associations between temperature and objectively measured physical activity among adult populations in five major Chinese cities.

Methods

Aggregated anonymized step count data was obtained between December 2017-2018 for five major Chinese cities: Beijing, Shanghai, Chongqing, Shenzhen, and Hong Kong. The associations of temperature with daily aggregated mean step count were assessed using Generalized Additive Models (GAMs), adjusted for meteorological, air pollution, and time-related variables.

Results

Significant decreases in step counts during periods of high temperatures were found for cold or temperate climate cities (Beijing, Shanghai, and Chongqing), with maximum physical activity occurring between 16 and 19.3 °C. High temperatures were associated with decreases of 800-1500 daily steps compared to optimal temperatures. For cities in subtropical climates (Shenzhen and Hong Kong), non-significant declines were found with high temperatures. Overall, females and the elderly demonstrated lower optimal temperatures for physical activity and larger decreases of step count in warmer temperatures.

Conclusions

As minor reductions in physical activity could consequentially affect health, an increased awareness of temperature’s impact on physical activity is necessary. City-wide adaptations and physical activity interventions should seek ways to sustain physical activity levels in the face of shifting temperatures from climate change.

Background

The public health burden of hot and cold temperatures has been documented by studies showing impacts on excess mortality [1,2,3,4,5], hospital admissions [3, 6,7,8]. However, much less has been discussed about the impact of temperatures at the level of daily human activity. Physical activity is an important factor for premature mortality reduction, as insufficient physical activity is attributed to be responsible for an estimated 9% of premature deaths worldwide [10]. Furthermore, physical activity plays an essential role in preventing non-communicable disease and enhancing well-being [11,12,13]. Poor weather has often been described as a ‘barrier to physical activity’ in qualitative studies [14, 15], and research has shown that objectively-measured physical activity can be affected by temperatures [14, 16,17,18,19]. However, few studies have been conducted in the Asia, particularly in China, although this relationship may vary across different climates and regional contexts.

With a population of 1.4 billion people as of 2019 [20], China currently has the largest population worldwide. Over the recent decades, the physical activity levels of the population have decreased, particularly in more urbanized areas [21]. A study found that work- and household- physical activity decreased by nearly half between 1991 and 2011, while active leisure and transport physical activity did not see a meaningful change in the same period [22]. According to World Health Organization (WHO) data, estimates of physical inactivity prevalence in 2016 among adults in China was 14.11% (10.1-19.37) [23]. The prevalence was found higher among Chinese people aged 45 and older in a nationwide survey, with physical inactivity prevalence at 19.31% (95% CI: 18.28–20.38%) in 2015 [24]. The Tsinghua-Lancet Commission on healthy cities in China calls for integration of health into all policies, including the increased facilitation of physical activity [21].

With climate change, temperatures in China are predicted to increase by 2.3 °C to 3.3 °C from 2000 to 2050 [25], increasing the occurrence of extremely hot temperatures in the coming decades. Yet there is a lack of understanding about the relationship between temperature and physical activity in China. Previous studies had only assessed small samples of the population [26, 27], or observed physical activity ecologically in specific locations such as public parks [28]. Ma et al. 2018 found a negative correlation between mean temperature and walking distance among 210 Pokemon GO players in Hong Kong [26]. Wang et al. 2017 reported no significant impact of temperature among 40 Beijing adults when monitored with an accelerometer every 2 months for an entire year [27]. Zhao et al. 2018 observed Harbin park users in the spring and found a positive correlation of ambient temperature with increased people conducting activities and increased intensity (METs) [28]. A more comprehensive understanding of temperature’s effect on physical activity is needed at the population level. This knowledge would support the development of policies to address these potential impacts and to promote physical activity in the cities, as called for in the Tsinghua-Lancet Commission.

Step counts are an important indicator of physical activity at the population level, as walking is a largely accessible, inexpensive, and a regularly conducted physical activity in everyday life [29]. The objective measurement of step counts has enabled studies to assess day-to-day variations of physical activity and its association with temperature [16, 19, 30,31,32,33,34]. However, studies have found different associations between temperature and step counts in various cities. Higher temperatures were associated with increased daily step count among COPD patients in London, United Kingdom [30] and residents in Prince Edward Island, Canada [32], whilst reduced steps were reported among adults in Qatar [16]. No associations were found between temperature and step counts among elderly in Cologne, Germany [33] and adults in Perth, Australia [31]. In Japan, curvilinear associations between temperature and step count were found among elderly in Nakanojo, with step counts peaking at 17 °C [19]. However, in Hokkaido, another Japanese study found elderly step counts were negatively associated with temperature during the snowfall season, but positively associated during non-snowfall season [34]. Multi-location comparisons could be useful to understand the varying associations between cities.

With the advancement of technology, step counts have been increasingly assessed using smartphone accelerometer applications, which have been highlighted for their convenience in population studies and validated for their accuracy [35, 36]. A systematic review found that the accuracy of smartphone physical activity measurements ranged from 73 to 100% regardless of phone placement (n = 10 studies), although lower accuracy was found for stair climbing (52-79% accuracy) [37]. Using smartphones enables utilization of the same objective physical activity measurement and study methodology across locations, facilitating multi-location comparisons [38,39,40].

This study examines the associations between mean temperature and daily step counts across five major Chinese cities.

Methods

Study setting and design

This is a prospective aggregated timeseries study. Five major Chinese cities were assessed including Beijing (located in the North), Shanghai (East), Chongqing (Southwest), Shenzhen (South), and Hong Kong SAR (South, Special Administrative Region). These are major cities in China, in terms of the population size, and economic and political significance (see Table 1). The cities are also located in four divergent areas of the country, with varying climates and topographies.

Table 1 Summary characteristics among five major Chinese cities (as of 2018)
Full size table

Physical activity data

Anonymous aggregated secondary data on physical activity was obtained from the mobile application WeChat‘s in-app function WeRun (微信运动) for the duration of the study period. WeChat is an all-encompassing multi-function social media and messaging platform in China, with over 1.04 billion active monthly users as of 2018 [49]. The in-app function WeRun is a voluntary addition that enables users to compare fitness levels with their community and reads from the step count data of the phone’s health applications (iPhone or Android) or other data sources such as smartwatches, as allowed by the user. Both the iPhone and Android phones have been validated against regularly accepted pedometers and accelerometers in field-based research [35, 50]. These studies have found comparable estimates in both laboratory and free-living environments, although the mobile phone-proxy estimates may be liable to underestimation due to inconstant phone carrying [35, 50].

The secondary physical activity data was obtained from users who had specifically enabled the fitness tracking function of WeRun, authorizing the collection of their daily step counts. All data was anonymized prior to retrieval and only obtained in aggregate form to protect personal privacy. Aggregated mean daily step counts were obtained for each city from anonymized users of the in-app function who were located in the city at night (10 pm). Aggregated mean daily step counts were also obtained stratified by gender and age group (18-64, 65+) along with the number of anonymized users included in each aggregate value.

Weather and pollutant data

Meteorological data were obtained from the China Meteorological Administration for the following stations for the mainland Chinese cities: Beijing (ID: 54511), Shanghai (ID: 58362), Chongqing (ID: 57516), and Shenzhen (ID: 59493). Data from Hong Kong was obtained from the Hong Kong Observatory. Daily mean temperature was used as the main exposure for this analysis, and also adapted into apparent temperature and percentile temperature of the study period. Apparent temperature was calculated from temperature and relative humidity using the following formulas [51, 52]:

$$H=\left(\log 10(RH)-2\right)/0.4343+\left(17.62\ast {T}_{air}\right)/\left(243.12+{T}_{air}\right)$$
$${T}_{dewpt}=243.12\ast H/\left(17.62-H\right)$$
$${T}_{apparent}=-2.653+0.994\left({T}_{air}\right)+0.0153{\left({T}_{dewpt}\right)}^2$$

where RH = relative humidity, Tair = air temperature, Tdewpt = dew point temperature, and Tapparent = apparent temperature. Other daily meteorological covariates obtained from the meteorological stations included: mean relative humidity, total rainfall, mean wind speed, mean atmospheric pressure, and total sunshine hours. A square root transformation was done for rainfall and windspeed, in order to reduce the effect of outliers. Extreme weather event information on typhoon days were incorporated as binary indicators from a WMO report on China and the Hong Kong Observatory [53,54,55]. The occurrence of super typhoon Mangkhut was included separately due to the severity of the storm, which made landfall in Shenzhen and Hong Kong on Sept 16, 2018.

Air pollution data was obtained from China National Environmental Monitoring Center network (CNEMC) and Hong Kong Environmental Protection Department. An air quality index was used instead of individual air pollutant variables, to reduce possible collinearity. In China, the Air Quality Index (AQI) is based on the concentration levels of six pollutants (SO2, NO2, PM2.5, PM10, CO, O3) and reported using a scale of 1-300+ [56]. All hourly AQI values were aggregated to the daily level and further log-transformed to adjust for the right skew. Missing variables were imputed using a simple moving average for consecutively missing data of twelve hours or less. Longer consecutive missing data were left as missing. The imputation was completed with the R package ‘imputeTS’. In Hong Kong, the Air Quality Health Index (AQHI) was used, based on the concentration levels of four pollutants (SO2,NO2, O3, and particulate matter) and reported using a scale of 1-10+ [57]. Hourly AQHI values were available for twelve general stations located throughout the city, which were averaged together to indicate the daily value for the entire city. For values ‘10+’, a value of 12 was used in the daily aggregation. The Tap Mun monitoring station was not included, as its rural location is not reflective of the residence of the general population.

Time-related variables, such as month, day of week (DOW), and public holiday, were included to control the analysis. Mainland China had extra workdays to compensate for extended holiday periods, which were adjusted for in the analysis as well [58]. A city-wide marathon was included as a special event in Hong Kong during the study period and adjusted for in the analysis [59]. The authors were unable to identify the occurrence of city-wide events in the other Chinese cities during the study period.

Statistical analysis

The associations of temperature were assessed on aggregated mean daily step count, adjusted by other meteorological conditions, air pollution index, and time-related variables. A stepdown analysis was conducted separately for each city using Generalized Additive Models (GAMs). Meteorological covariates with the highest p-value were removed in each model, until no variables with p-value over 0.1 remained. The Akaike information criterion (AIC) was also compared between models to ensure the model quality did not decrease. Air pollution index and time-related variables were kept in the model as control variables. The full model had a formula as follows:

$$\begin{aligned}E\left( Daily\ mean\ step\ count\right)&= s(Mean\ temperature,k=4)+ s(Relative\ humidity,k=4)+ s(Precipitation,k=4)\\&+ s(Windspeed,k=4)+ s(Pressure,k=4)+ s(Sunshine,k=4)+s(AQI\ or\ AQHI,k=4)\\&+ factor(DOW)+ factor(Holiday)+ factor(Month)+ factor(Extra\ workdays)\\&+ factor(Typhoon)+ factor(Super\ typhoon)+ factor(Marathon)\end{aligned}$$

where s() indicates the smoothing function of continuous independent variables in R package “mgcv”. k indicates the basis dimension for the smooth, such that k-1 is the maximum degrees of freedom considered for the variable. factor() indicates the categorical independent variables. AQI or AQHI indicates the Air Quality Index (used in China) or Air Quality Health Index (used in Hong Kong). DOW indicates the day of week. Meteorological variables were excluded if irrelevant to the city.

The analysis was further stratified by gender and age group. Sensitivity analyses assessed the 1) effect of apparent temperature, 2) effect of percentile temperature, 3) removal of air pollution index, and 4) removal of outlier data caused by Typhoon Mangkhut in Shenzhen and Hong Kong. Statistical significance level was set at p ≤ 0.05. All analyses were conducted using R version 3.5.2 [60], using the package “mgcv” (Mixed GAM Computation Vehicle with Automatic Smoothness Estimation) [61].

Ethics approval

Ethics approval was obtained from the Survey and Behavioural Research Ethics Committee of The Chinese University of Hong Kong (Date: August 13, 2018).

Results

Descriptive statistics

The study period was from Dec 6, 2017 to Dec 31, 2018. During the study period, daily temperatures averaged from 12.7 °C (±SD 12.1) in Beijing, to 23.5 °C (±SD 5.3) in Hong Kong. The average amount of anonymized users included in the aggregated data during the study period were 11.1 million for Beijing, 9.6 mil for Shanghai, 2.8 mil for Chongqing, 4.9 mil for Shenzhen and 0.4 mil for Hong Kong. Compared to census data, the study samples in all five cities had a comparable gender distribution with their respective general populations (see Table 2). However, the sample populations tended to be significantly younger than the general populations.

Table 2 Demographic comparison between sample population and city population of five Chinese cities (Unit 10,000 persons)
Full size table

The aggregated average step counts for each of the cities during the study period averaged 6846 steps for Beijing, 6703 for Shanghai, 7540 for Chongqing, 7209 for Shenzhen and 9040 for Hong Kong (see Table 3). The average step count was significantly higher among males than females (T-test, p < 0.001). Figure 1 demonstrates the trend of average daily step count during the study period for each city. The trends of average daily step count by gender and by age can be found in Supplemental materials, Figs. S1 and S2.

Table 3 Summary findings of five Chinese cities
Full size table
Fig. 1
figure 1

Trend of average daily step count in each city. Note: BJ = Beijing, SH = Shanghai, CQ = Chongqing, SZ = Shenzhen, HK = Hong Kong

Full size image

Main models

The final models for Beijing, Chongqing, and Hong Kong underwent a stepdown process, in which atmospheric pressure and relative humidity were removed (see Table 4). For Shanghai and Shenzhen, no changes were required from the full models.

Table 4 Stepdown models of five Chinese cities
Full size table

Overall, three of five cities (Beijing, Shanghai, and Chongqing) had significant inverse U-shaped associations between temperature and daily step count in high temperatures (see Table 5 and Fig. 2). During periods of high temperature, populations in Beijing, Shanghai, and Chongqing had significantly lower physical activity compared to optimal temperatures, while no significant associations were found in Shenzhen and Hong Kong. In periods of low temperatures, while populations in Beijing, Shanghai, and Shenzhen also found significantly lower step counts compared to optimal temperatures, the amount of decrease was less than in hot temperatures. The optimal temperature of peak step counts varied slightly between cities. In Beijing, the estimate of optimal temperature was at 19.3 °C, with a change in − 386.0 steps (95% CI: − 626.6, − 145.5) for a 10 °C increase from optimal temperature. In Shanghai, the optimal temperature was 17.9 °C, with a change in − 432.7 steps (95% CI: − 636.2, − 229.1) and in Chongqing, the optimal temperature was 16.1 °C, with a − 321.7 decrease (95% CI: − 526.6, − 116.8) in average step count for 10 °C increase from optimal temperature. On days with extremely hot temperatures, step counts decreased by − 820 steps at 32.6 °C in Shanghai and − 1494 steps at 36.5 °C in Chongqing, when compared to their respective optimal temperatures.

Table 5 Mean temperature associations on daily average step count, by city
Full size table
Fig. 2
figure 2

Relationships between temperature and daily step count in five Chinese cities. Note: The model for each city was adjusted for relative humidity#, precipitation, windspeed, pressure#, sunshine, AQI/AQHI, month, day of week, public holiday, extra workdays, typhoon, super typhoon, and marathon (#some cities had these variables removed in the stepdown process). Black markings along the x-axis indicate the actual existing temperature data of each city; Vertical red dotted lines indicate the identified optimal temperature; Grey shading indicates the 95% confidence interval

Full size image

In Shenzhen, a curvilinear association was found albeit non-significant at higher temperatures. At the highest temperature in the dataset (30.8 °C), there was a non-significant decrease of − 204.8 step counts (95% CI: − 514.5, 104.8) compared to the optimal temperature (24.2 °C). On the other hand, a weak non-significant negative linear temperature association was found for Hong Kong (Change in steps at 10 °C from pre-set temperature 20 °C: -105.4; 95% CI -268.5, 57.6).

For other meteorological variables, higher relative humidity was negatively associated with step counts in Shanghai, Chongqing, and Shenzhen in a non-linear manner (see Supplemental materials, Fig. S3). High relative humidity in Beijing had a non-significant association with average step count. Rainfall and windspeeds were negatively associated with daily step count in all five cities, while daily sunshine hours were positively associated with step count, with a particularly strong association observed in inland Chongqing. Where atmospheric pressure remained in the model, it was found to be positively associated with step counts in Shenzhen and Shanghai. The air pollution index was significantly associated with physical activity levels in all cities except Beijing. Overall, the final model of these cities explained 73 to 88% of the variance in daily mean step counts (see Table 5 for model information).

Stratified analyses

When stratified by gender, a lower optimal temperature was found among females than males in all four cities with curvilinear associations (Beijing, Shanghai, Chongqing, and Shenzhen) (see Table 6 and Supplemental materials Fig. S4). A slightly larger decline in step counts was found in Beijing among females at 10 °C above the optimal temperature (28.7 °C, change in steps: -405.4; 95% CI: − 641.1, − 169.6). Alternately, in Shenzhen a slightly larger effect was found among females at 10 °C colder temperatures from optimal (13.5 °C, change in steps: -338.1; 95% CI: − 629.9, − 46.4). In Hong Kong, the associations among both males and females remained non-significant.

Table 6 Stratification results of the temperature-physical activity associations in five Chinese cities
Full size table

When stratified by age group, a lower optimal temperature was also found for the elderly over 65 in all cities with curvilinear associations (Beijing, Shanghai, Shenzhen, Hong Kong) (see Table 6 and Supplemental materials Fig. S4). In Chongqing, the association among the elderly was no longer inverse U-shaped, but had a steep significant negative slope. Additionally, in warmer temperatures, the elderly were associated with a markedly larger decrease in step counts compared with the adult age group (aged 18-64), with an approximate additional reduction of ~ 70 steps in Beijing and Shanghai and ~ 1200 steps in Chongqing. Furthermore, in Shenzhen and Hong Kong, the association of decreased step counts in warm temperatures was found significant among the elderly, while still remaining non-significant among the adults. In cold temperatures, there was no clear difference between the elderly and adults in most cities, except in Shenzhen, where the elderly were associated with a larger decrease in step counts with an approximate additional 130 ~ steps.

Sensitivity analyses

Several sensitivity analyses were conducted including 1) examining the effect of apparent temperature and 2) examining the effect of percentile temperature, 3) removal of air pollution index, and 4) removal of outlier data caused by Typhoon Mangkhut in Shenzhen and Hong Kong on Sept 16, 2018. The results were largely consistent with the primary findings (see Table 7).

Table 7 Sensitivity analyses of the temperature-physical activity associations in five Chinese cities
Full size table

For apparent temperature models, the AIC was higher than for the original models in all cities aside from Hong Kong. A slightly higher optimal apparent temperature was found in Beijing, Shanghai, and Shenzhen. A slightly lower optimal apparent temperature was found in Chongqing, although the effect at + 10 °C was no longer significant. In Hong Kong, the effect at + 10 °C from 20 °C was to significantly decrease step counts by − 83.7 (95% CI: − 150.4, − 17.1).

Optimal percentile temperature was found at the 48th percentile in Chongqing, 54th percentile in Shanghai, 58th percentile in Shenzhen, and 68th percentile in Beijing. Similar to the main model, no optimal percentile temperature was found for Hong Kong. The model AIC improved when using percentile temperature for all cities except Chongqing.

Without the pollution index, the results remained consistent in Beijing, Shanghai, and Shenzhen, although the model AIC had a substantial increase from each city’s original model. In Chongqing, the optimal temperature increased from 16 °C to 19.3 °C. Additionally, a curvilinear association was found in Hong Kong, with optimal temperatures at 21.9 °C and a marginally significant decrease of − 348.0 (95% CI: − 697.8, 1.8) for a 10 °C increase from optimal temperature.

The results remained consistent when removing the typhoon outlier for Shenzhen and Hong Kong, while the model AIC improved from the original. When the two cities were hit by Typhoon Mangkhut on Sept 16, 2018, the aggregated daily step counts on that date dropped significantly to 3992 and 4682, respectively compared to average step counts.

Discussion

Inverse U-shaped associations of temperature on city-wide aggregated step counts in four of five Chinese cities (Beijing, Shanghai, Chongqing, and Shenzhen) were found, with significant decreases in high temperatures for three cities (Beijing, Shanghai, and Chongqing). Step counts peaked at optimal temperatures ranging from 16.0 °C in Chongqing, 17.9 °C in Shanghai, 19.3 °C in Beijing, to 24.2 °C in Shenzhen. In warm temperatures, average decreases of 322 to 433 steps were found for those cities at 10 °C increase from optimal temperature, while temperatures in Shenzhen did not extend high enough to find a significant association. On days with extremely hot temperatures, the mean step counts of the city population decreased as far as 800 to 1500 steps compared to the optimal temperature. The impact of temperature seemed to be greater in climates with wider temperature ranges, whereas cities in subtropical climates did not have significant declines in step counts on days with high temperatures. In Hong Kong, a non-significant association was found between temperature and step count, however, a marginally significant curvilinear association was found with optimal temperatures at 21.9 °C when the city-specific air pollution index (AQHI) was taken out of the model, and a significant negative association was found in high apparent temperatures. Optimal percentile temperatures ranged between 48th percentile in Chongqing to 68th percentile in Beijing. Other results remained largely consistent in the sensitivity analyses.

Only a few temperature-physical activity studies have previously been conducted in China or in the Asian region. Two studies located in Japan had similarly found curvilinear associations between temperature and step counts, with step counts peaking between 17 °C and 20.7 °C [19, 63]. A study from Harbin, China, a city in the far north with a very cold climate, found a positive association during the spring months between temperature and the intensity of activity and number of active persons in the public park [28]. A previous study in Beijing found no seasonal variation and hourly association between temperature and average physical activity among 40 Chinese participants of an accelerometer study [27]. However, the study seemed to only consider the possibility of a linear association using general linear models. In Hong Kong, a study on Pokémon Go users found a significant negative association between temperature and daily distance travelled in the summer [26], while the negative association in our study was non-significant.

In other published multi-location studies, a trail study across the USA found increasing optimal temperatures with warmer American-centric climate regions [18]. In this study, locations with similar climates had similar associations, however warmer locations did not necessarily have the greater effects in high temperatures. Chongqing and Shanghai (both climate Cfa under the Köppen-Geiger classification [47]) had similar optimal temperature peaks and clear decreased physical activity associations in warm temperatures. Warmer Shenzhen and Hong Kong (both climate Cwa) found similar optimal temperature peaks ranging in the early 20s °C, particularly in the Hong Kong model without air pollution. However, non-significant decreases in step counts were found with higher temperatures, as both cities had lower extreme temperatures (maximum temp: 30.8 °C and 31.2 °C, respectively) compared to the other cities. Surprisingly, Beijing (climate Dwa) had a relatively high optimal temperature (19.3 °C) and the highest percentile optimal temperature at 68th percentile, despite having an overall colder climate.

This study found that optimal temperatures for physical activity ranged between 48th to 68th percentile, with the highest percentile found in Beijing. As indicated by Beijing’s climate classification Dwa, the ‘a’ demonstrates hot summer temperatures in an overall cold snow climate zone ‘D’. This produces a wider temperature range than other cities, as seen in Table 3. With half of days having mean temperatures below 12 °C in Beijing, the population may seek to take advantage of the warmer temperatures and other connected weather conditions (increased daylight hours, absence of icy surfaces etc.) to conduct more active leisure activities [64], leading to the findings of a greater increase of physical activity in warmer temperatures and higher optimal temperature than other cities. Additionally, the inter-city variations in physical activity patterns seem to demonstrate population adaptation to local climates [65] and may have also been influenced by variations in infrastructural or spatial patterns of the urban environment, such as the city density and urban sprawl [66]. As mentioned in a Beijing study on travel behaviour, the built environment can significantly affect people’s allocation of time and pursuit of activities [67]. Other potential confounding factors such as socio-economic status, education, and employment may have also affected the analysis and the comparison across cities.

In the stratified analyses, lower optimal temperatures were found among females in all cities with curvilinear relationships. This is a new finding, as previous studies that stratified by gender did not assess for a difference in optimal temperature between genders [63, 64, 68, 69]. Only one study stratifying by gender found overall lower step counts among females compared to males [63], while other studies did not find clear differences in temperature-related physical activity between males and females [64, 68, 69]. Our study also found that elderly over 65 had lower optimal temperatures and larger decreases of step count in warmer temperatures compared with the adult age group. These findings are consistent with several previous studies that stratified by age and found stronger temperature effects among those over 65, particularly over 80 [63, 70, 71]. These are also aligned with the physiological understanding of a lower heat tolerance among older adults due to a decreased capacity to thermoregulate [72, 73].

Strengths and limitations

This was the first multi-location comparative study on temperature and physical activity located in China and in Asia. This study demonstrated a decrease of daily physical activity in high temperatures using aggregated objectively measured step counts from a large, anonymized sample size. The data collection method ensured that anonymized users were located in the respective cities in order to be included in the analysis. A non-linear statistical analysis allowed for flexible associations between temperature and physical activity, as well as all other meteorological variables. The analysis comprised over a year’s duration, covered all seasons, and controlled for time-related variables and holidays and special events (typhoons and marathons) where feasible.

However, this study’s data collection was limited to only those who voluntarily downloaded the mobile application, and may have skewed towards the health-conscious, able-bodied (no mobility problems), younger, and more active subset of the population. This can be seen by the relatively high average daily step count of each city and the skewed age distribution compared to the general population, and suggests that this study may underestimate the temperature effect, particularly among more vulnerable populations. The accelerometer could only collect information on ambulatory activities when the phone was located with the person and was unable to account for any cycling or aquatic activities. As this study could not control for whether the anonymized users kept their phones on them, the aggregation from a large data sample could be an underestimation of actual physical activity levels. The aggregated data could not control at the individual participant level and would have included any visitors or temporary stay individuals who used the in-app function and were located in the city during any evenings of the study period. No uncertainty boundaries were provided around the step count estimates. Other potential confounding factors may not have been addressed in this study, such as socio-demographic characteristics, accessibility of transportation options, or indoor/outdoor activity. The effect of weather alerts and warnings on physical activity levels could not be adjusted in this analysis.

Future research directions

Future studies should assess the temperature-physical activity relationship in more climate and geographically diverse locations of China and other regions. An increased understanding is needed on the role of urban planning and spatial patterns in affecting the relationship between temperature and physical activity. Extreme temperature events could be assessed in warmer subtropical climate locations like Shenzhen and Hong Kong, to elucidate the effect of extreme temperatures. Furthermore, the singular effect of the super typhoon in these two cities also hints at the large impact that extreme weather events can have on population physical activity patterns. With climate change and an increased frequency of heat waves, typhoons, storms, and other climate-related hazards, there may be increased days where population activity is lowered by such extreme events. Studies could further examine and project the impact of physical activity in extreme weather events.

Conclusions

Temperatures and physical activity demonstrated inverse-U shaped associations among several major cities in China, with physical activity peaking between 16 °C to 19.3 °C in temperate climate cities. Coupled with rising temperatures due to climate change, these reductions in physical activity could subsequently lead to consequential health effects, as the temperatures shift upward to levels higher than the optimal temperature for physical activity. Adaptations to temperature should be addressed in China’s physical activity promotion guidelines, with healthcare providers empowered to provide appropriate physical activity recommendations and heat health prevention measures. Recommended city-wide interventions include increased access to indoor recreational facilities and urban design measures to alleviate the heat and to support sustainable physical activity levels in the face of climate change.

Availability of data and materials

The data that support the findings of this study are available from WeChat WeRun (https://www.wechat.com/) but restrictions apply to the availability of these data, which were used under agreement for the current study, and so are not publicly available.

References

  1. Barnett AG, Hajat S, Gasparrini A, Rocklov J. Cold and heat waves in the United States. Environ Res. 2012;112:218–24.

    Article  CAS  PubMed  Google Scholar 

  2. Gasparrini A, Guo Y, Hashizume M, Lavigne E, Zanobetti A, Schwartz J, et al. Mortality risk attributable to high and low ambient temperature: a multicountry observational study. Lancet. 2015;386(9991):369–75.

    Article  PubMed  PubMed Central  Google Scholar 

  3. Kovats RS, Hajat S. Heat stress and public health: a critical review. Annu Rev Public Health. 2008;29:41–55.

    Article  PubMed  Google Scholar 

  4. Chan EYY, Goggins WB, Kim JJ, Griffiths SM. A study of intracity variation of temperature-related mortality and socioeconomic status among the Chinese population in Hong Kong. J Epidemiol Community Health. 2012;66(4):322–7.

    Article  PubMed  Google Scholar 

  5. Goggins WB, Chan EY, Yang C, Chong M. Associations between mortality and meteorological and pollutant variables during the cool season in two Asian cities. Environ Health. 2013;12(59):1–10.

  6. Chan EYY, Goggins WB, Yue JS, Lee P. Hospital admissions as a function of temperature, other weather phenomena and pollution levels in an urban setting in China. Bull World Health Organ. 2013;91(8):576–84.

    Article  PubMed  PubMed Central  Google Scholar 

  7. Chan EYY, Lam HCY, So SHW, Goggins WB, Ho JY, Liu S, et al. Association between ambient temperatures and mental disorder hospitalizations in a Subtropical City: a time-series study of Hong Kong special administrative region. Int J Environ Res Public Health. 2018;15(4):754.

    Article  PubMed Central  CAS  Google Scholar 

  8. Ye X, Wolff R, Yu W, Vaneckova P, Pan X, Tong S. Ambient temperature and morbidity: a review of epidemiological evidence. Environ Health Perspect. 2012;120(1):19–28.

    Article  PubMed  Google Scholar 

  9. Chan EYY, Goggins WB, Kim JJ, Griffiths S, Ma TK. Help-seeking behavior during elevated temperature in Chinese population. J Urban Health. 2011;88(4):637–50.

    Article  PubMed  PubMed Central  Google Scholar 

  10. Lee IM, Shiroma EJ, Lobelo F, Puska P, Blair SN, Katzmarzyk PT. Effect of physical inactivity on major non-communicable diseases worldwide: an analysis of burden of disease and life expectancy. Lancet. 2012;380(9838):219–29.

    Article  PubMed  PubMed Central  Google Scholar 

  11. Bull FC, Bauman AE. Physical inactivity: the "Cinderella" risk factor for noncommunicable disease prevention. J Health Commun. 2011;16(Suppl 2):13–26.

    Article  PubMed  Google Scholar 

  12. Durstine JL, Gordon B, Wang Z, Luo X. Chronic disease and the link to physical activity. J Sport Health Sci. 2013;2(1):3–11.

    Article  Google Scholar 

  13. Physical Activity Guidelines Advisory Committee. 2018 Physical activity guidelines advisory Committee scientific report. Washington, DC: US Department of Health and Human Services; 2018.

    Google Scholar 

  14. Chan CB, Ryan DA. Assessing the effects of weather conditions on physical activity participation using objective measures. Int J Environ Res Public Health. 2009;6(10):2639–54.

    Article  PubMed  PubMed Central  Google Scholar 

  15. Tucker P, Gilliland J. The effect of season and weather on physical activity: a systematic review. Public Health. 2007;121(12):909–22.

    Article  CAS  PubMed  Google Scholar 

  16. Al-Mohannadi AS, Farooq A, Burnett A, Van Der Walt M, Al-Kuwari MG. Impact of climatic conditions on physical activity: a 2-year cohort study in the Arabian gulf region. J Phys Act Health. 2016;13(9):929–37.

    Article  PubMed  Google Scholar 

  17. de Montigny L, Ling R, Zacharias J. The effects of weather on walking rates in nine cities. Environ Behav. 2011;44(6):821–40.

    Article  Google Scholar 

  18. Ermagun A, Lindsey G, Loh TH. Urban trails and demand response to weather variations. Transp Res Part D: Transp Environ. 2018;63:404–20.

    Article  Google Scholar 

  19. Togo F, Watanabe E, Park H, Shephard RJ, Aoyagi Y. Meteorology and the physical activity of the elderly: the Nakanojo study. Int J Biometeorol. 2005;50(2):83–9.

    Article  PubMed  Google Scholar 

  20. National Bureau of Statistics of China. Total population (year-end). Beijing: National Bureau of Statistics of China; 2019. Available from: https://data.stats.gov.cn/english/easyquery.htm?cn=C01

    Google Scholar 

  21. Yang J, Siri JG, Remais JV, Cheng Q, Zhang H, Chan KKY, et al. The Tsinghua–lancet commission on healthy Cities in China: unlocking the power of cities for a healthy China. Lancet. 2018;391(10135):2140–84.

    Article  PubMed  PubMed Central  Google Scholar 

  22. Zang J, Ng SW. Age, period and cohort effects on adult physical activity levels from 1991 to 2011 in China. Int J Behav Nutr Phys Act. 2016;13:40.

    Article  PubMed  PubMed Central  Google Scholar 

  23. World Health Organization. Prevalence of insufficient physical activity among adults aged 18+ years (age-standardized estimate) (%). Geneva: World Health Organization; 2022. Available from: https://www.who.int/data/gho/data/indicators/indicator-details/GHO/prevalence-of-insufficient-physical-activity-among-adults-aged-18-years-(age-standardized-estimate)-(-).

    Google Scholar 

  24. Li X, Zhang W, Zhang W, Tao K, Ni W, Wang K, et al. Level of physical activity among middle-aged and older Chinese people: evidence from the China health and retirement longitudinal study. BMC Public Health. 2020;20(1):1682.

    Article  PubMed  PubMed Central  Google Scholar 

  25. National Development and Reform Commission P. China’s national climate change programme China: national development and reform commission; 2007.

    Google Scholar 

  26. Ma BD, Ng SL, Schwanen T, Zacharias J, Zhou M, Kawachi I, et al. Pokemon GO and physical activity in Asia: multilevel study. J Med Internet Res. 2018;20(6):e217.

    Article  PubMed  PubMed Central  Google Scholar 

  27. Wang G, Li B, Zhang X, Niu C, Li J, Li L, et al. No seasonal variation in physical activity of Han Chinese living in Beijing. Int J Behav Nutr Phys Act. 2017;14(1):48.

    Article  PubMed  PubMed Central  Google Scholar 

  28. Zhao X, Bian Q, Zhao D, Zhang B. 寒地城市公园春季休闲体力活动强度与植被群落微气候调节效应适应性研究 Research on the Adaptability between the leisure physical Activity Intensity and Micro-climate Regulation of Vegetation Community of Cold Region Parks in Spring (Chinese). 中国园林. 2018(2):42-8.

  29. Hallal PC, Andersen LB, Bull FC, Guthold R, Haskell W, Ekelund U. Global physical activity levels: surveillance progress, pitfalls, and prospects. Lancet. 2012;380(9838):247–57.

    Article  PubMed  Google Scholar 

  30. Alahmari AD, Mackay AJ, Patel AR, Kowlessar BS, Singh R, Brill SE, et al. Influence of weather and atmospheric pollution on physical activity in patients with COPD. Respir Res. 2015;16:71.

    Article  PubMed  PubMed Central  CAS  Google Scholar 

  31. Badland HM, Christian H, Giles-Corti B, Knuiman M. Seasonality in physical activity: should this be a concern in all settings? Health Place. 2011;17(5):1084–9.

    Article  PubMed  Google Scholar 

  32. Chan CB, Ryan DA, Tudor-Locke C. Relationship between objective measures of physical activity and weather: a longitudinal study. Int J Behav Nutr Phys Act. 2006;3:21.

    Article  PubMed  PubMed Central  Google Scholar 

  33. Giannouli E, Fillekes MP, Mellone S, Weibel R, Bock O, Zijlstra W. Predictors of real-life mobility in community-dwelling older adults: an exploration based on a comprehensive framework for analyzing mobility. Eur Rev Aging Phys Act. 2019;16:19.

    Article  PubMed  PubMed Central  Google Scholar 

  34. Ogawa S, Seko T, Ito T, Mori M. Differences in physical activity between seasons with and without snowfall among elderly individuals residing in areas that receive snowfall. J Phys Ther Sci. 2019;31:12–6.

  35. Hekler EB, Buman MP, Grieco L, Rosenberger M, Winter SJ, Haskell W, et al. Validation of physical activity tracking via android smartphones compared to ActiGraph accelerometer: laboratory-based and free-living validation studies. JMIR Mhealth Uhealth. 2015;3(2):e36.

    Article  PubMed  PubMed Central  Google Scholar 

  36. Presset B, Laurenczy B, Malatesta D, Barral J. Accuracy of a smartphone pedometer application according to different speeds and mobile phone locations in a laboratory context. J Exerc Sci Fit. 2018;16(2):43–8.

    Article  PubMed  PubMed Central  Google Scholar 

  37. Bort-Roig J, Gilson ND, Puig-Ribera A, Contreras RS, Trost SG. Measuring and influencing physical activity with smartphone technology: a systematic review. Sports Med. 2014;44(5):671–86.

    Article  PubMed  Google Scholar 

  38. Aral S, Nicolaides C. Exercise contagion in a global social network. Nat Commun. 2017;8:14753.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  39. Vanky AP, Verma SK, Courtney TK, Santi P, Ratti C. Effect of weather on pedestrian trip count and duration: City-scale evaluations using mobile phone application data. Prev Med Rep. 2017;8:30–7.

    Article  PubMed  PubMed Central  Google Scholar 

  40. Ho JY, Zijlema WL, Triguero-Mas M, Donaire-Gonzalez D, Valentin A, Ballester J, et al. Does surrounding greenness moderate the relationship between apparent temperature and physical activity? Findings from the PHENOTYPE project. Environ Res. 2021;197:110992.

    Article  CAS  PubMed  Google Scholar 

  41. National Bureau of Statistics of China. 中国统计年鉴 China Statistical yearbook 2019. Beijing: China Statistics Press; 2019. Available from: http://www.stats.gov.cn/tjsj/ndsj/2019/indexeh.htm.

  42. Beijing Municipal Bureau of Statistics, Survey Office of the National Bureau of Statistics in Beijing. 北京统计年鉴 Beijing Statistical Yearbook 2019. Beijing: China Statistics Press; 2019. Available from: http://nj.tjj.beijing.gov.cn/nj/main/2019-tjnj/zk/indexeh.htm.

  43. Shanghai Municipal Statistical Bureau, Survey Office of the National Bureau of Statistics in Shanghai. 上海统计年鉴 Shanghai Statistical Yearbook 2019. Shanghai: China Statistics Press; 2019. Available from: http://tjj.sh.gov.cn/tjnj/zgsh/tjnj2019en.html.

  44. Chongqing Municipal Statistical Bureau, Survey Office of the National Bureau of Statistics in Chongqing. 重庆统计年鉴 Chongqing Statistical Yearbook 2019. Chongqing: China Statistics Press; 2019. Available from: http://tjj.cq.gov.cn/zwgk_233/tjnj/2019/zk/indexch.htm.

  45. Statistics Bureau of Shenzhen Municipality, Survey Office of the National Bureau of Statistics in Shenzhen. 深圳统计年鉴 Shenzhen Statistical Yearbook 2019 总第29期. Shenzhen: China Statistics Press 2019.

  46. Census and Statistics Department. Hong Kong Statistics: Population Estimates. Hong Kong SAR: Census and Statistics Department, The Government of Hong Kong Special Administrative Region; 2019. [updated 15 March, 2021]. Available from: https://www.censtatd.gov.hk/en/page_8000.html.

  47. Kottek M, Grieser J, Beck C, Rudolf B, Rubel F. World map of the Köppen-Geiger climate classification updated. Meteorol Z. 2006;15(3):259–63.

    Article  Google Scholar 

  48. Exchange Rates UK. Hong Kong dollar to Chinese Yuan spot exchange rates for 2018: Exchange Rates UK; 2018. Available from: https://www.exchangerates.org.uk/HKD-CNY-spot-exchange-rates-history-2018.html

  49. Statista. Number of monthly active WeChat users from 2nd quarter 2011 to 3rd quarter 2021(in millions). Hamburg; 2021. Available from: https://www.statista.com/statistics/255778/number-of-active-wechat-messenger-accounts/. [updated Feb 8, 2022].

  50. Amagasa S, Kamada M, Sasai H, Fukushima N, Kikuchi H, Lee IM, et al. How well iPhones measure steps in free-living conditions: cross-sectional validation study. JMIR Mhealth Uhealth. 2019;7(1):e10418.

    Article  PubMed  PubMed Central  Google Scholar 

  51. Ballester J, Robine JM, Herrmann FR, Rodo X. Long-term projections and acclimatization scenarios of temperature-related mortality in Europe. Nat Commun. 2011;2:358.

    Article  PubMed  CAS  Google Scholar 

  52. Sensirion. Application Note Dew-point calculation. In: Sensirion. Switzerland: 2006. p. 1-3.

  53. China Meteorological Administration. Member Report of China. Chiang Mai: ESCAP/WMO Typhoon Committee, 13th Integrated Workshop; 2018.

    Google Scholar 

  54. Hong Kong Observatory. Tropical cyclone warning signals. Hong Kong: Hong Kong Observatory; 2018. Available from: https://www.hko.gov.hk/en/wxinfo/climat/warndb/warndb1.shtml

    Google Scholar 

  55. Meteorological Bureau of Shenzhen Municipality. 预警服务: 历史预警查询. Shenzhen: Meteorological Bureau of Shenzhen Municipality; 2018. Available from: http://weather.sz.gov.cn/qixiangfuwu/yujingfuwu/lishiyujingchaxun/.

  56. Ministry of Ecology and Environment of the PRC. 如何读懂空气质量预报. Ministry of Ecology and Environment of the PRC. Available from: http://www.mee.gov.cn/.

  57. Environmental Protection Department. About AQHI. Hong Kong SAR: Environmental Protection Department HKSAR. Available from: https://www.aqhi.gov.hk/en/what-is-aqhi/about-aqhi.html.

  58. The State Council PRC. 国务院办公厅关于2019年部分节假日安排的通知. 国务院办公厅; 2018. Available from: http://www.gov.cn/zhengce/content/2018-12/06/content_5346276.htm.

  59. Major Sports Events Committee. "M" mark events calendar. Hong Kong: Major Sports Events Committee (MSEC), The Government of the Hong Kong Special Administrative Region; 2018. Available from: http://www.mevents.org.hk/en/calendar_2018.php

  60. R Core Team. R. A language and environment for statistical computing. Vienna: R Foundation for Statistical Computing; 2018.

    Google Scholar 

  61. Wood S. Generalized additive models: an introduction with R. 2nd ed: Chapman and Hall/CRC; 2017.

  62. Shenzhen Municipal Statistics Bureau. 2018年深圳市社会性别统计报告. In: 市统计局, editor. Shenzhen: 深圳市统计局; 2019.

  63. Hino K, Lee JS, Asami Y. Associations between seasonal meteorological conditions and the daily step count of adults in Yokohama, Japan: results of year-round pedometer measurements in a large population. Prev Med Rep. 2017;8:15–7.

    Article  PubMed  PubMed Central  Google Scholar 

  64. Aspvik NP, Viken H, Ingebrigtsen JE, Zisko N, Mehus I, Wisloff U, et al. Do weather changes influence physical activity level among older adults? - the generation 100 study. PLoS One. 2018;13(7):e0199463.

    Article  PubMed  PubMed Central  CAS  Google Scholar 

  65. Ma W, Wang L, Lin H, Liu T, Zhang Y, Rutherford S, et al. The temperature-mortality relationship in China: an analysis from 66 Chinese communities. Environ Res. 2015;137:72–7.

    Article  CAS  PubMed  Google Scholar 

  66. LV J, Yang BD, Yang YJ, Zhang ZH, Chen F, Liu GJ. Spatial patterns of China's major cities and their evolution mechanisms during the past decades of reform and opening up. Procedia Eng. 2017;198:915–25.

    Article  Google Scholar 

  67. Wang D, Chai Y, Li F. Built environment diversities and activity–travel behaviour variations in Beijing, China. J Transp Geogr. 2011;19(6):1173–86.

    Article  Google Scholar 

  68. Bosdriesz JR, Witvliet MI, Visscher TL, Kunst AE. The influence of the macro-environment on physical activity: a multilevel analysis of 38 countries worldwide. Int J Behav Nutr Phys Act. 2012;9(110):1–13.

  69. Klenk J, Buchele G, Rapp K, Franke S, Peter R, Acti FESG. Walking on sunshine: effect of weather conditions on physical activity in older people. J Epidemiol Community Health. 2012;66(5):474–6.

    Article  PubMed  Google Scholar 

  70. Obradovich N, Fowler JH. Climate change may alter human physical activity patterns. Nat Hum Behav. 2017;1(5):1–7.

  71. Witham MD, Donnan PT, Vadiveloo T, Sniehotta FF, Crombie IK, Feng Z, et al. Association of day length and weather conditions with physical activity levels in older community dwelling people. PLoS One. 2014;9(1):e85331.

    Article  PubMed  PubMed Central  CAS  Google Scholar 

  72. Balmain BN, Sabapathy S, Louis M, Morris NR. Aging and thermoregulatory control: the clinical implications of exercising under heat stress in older individuals. Biomed Res Int. 2018;2018:8306154.

    Article  PubMed  PubMed Central  Google Scholar 

  73. Kenny GP, Yardley J, Brown C, Sigal RJ, Jay O. Heat stress in older individuals and patients with common chronic diseases. CMAJ. 2010;182(10):1053–60.

    Article  PubMed  PubMed Central  Google Scholar 

Download references

Acknowledgements

The authors wish to thank the Tencent team for their data and technical support, with special thanks to Dr. Wujie Zheng and Ms. Diane Liu. The anonymized aggregated data was shared for research purposes only while the first author was an intern at Tencent. The authors would also like to thank Professor Ming Luo for his data support.

Funding

JYH conducted the research while an intern at Tencent and was funded by the Hong Kong PhD Fellowship Scheme from the Hong Kong Research Grants Council (PF15-18545) during the same period. JYH is partially supported by the Research Impact Fund (Ref-No: R4046-18) of the Hong Kong Research Grants Council. The sponsors had no role in the design, data collection, analysis, interpretation, or writing of the study.

Author information

Authors and Affiliations

  1. The Jockey Club School of Public Health and Primary Care, The Chinese University of Hong Kong, Hong Kong, China

    Janice Y. Ho, William B. Goggins, Phoenix K. H. Mo & Emily Y. Y. Chan

  2. Nuffield Department of Medicine, University of Oxford, Oxford, UK

    Emily Y. Y. Chan

Authors
  1. Janice Y. Ho
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. William B. Goggins
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Phoenix K. H. Mo
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Emily Y. Y. Chan
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

JYH, WBG, PKHM and EYYC contributed to the conceptualization, design, interpretation, and writing. JYH acquired and analysed the data. All authors read and approved the final manuscript.

Corresponding author

Correspondence to Emily Y. Y. Chan.

Ethics declarations

Ethics approval and consent to participate

Ethics approval on the secondary data was obtained from the Survey and Behavioural Research Ethics Committee of The Chinese University of Hong Kong (Date: August 13, 2018).

The anonymized aggregated secondary data was obtained from WeChat users who had consented to participate in the fitness tracking channel WeRun (微信运动) within WeChat and have authorized the collection of their number of steps.

Consent for publication

Not applicable.

Competing interests

The authors declare that they have no competing interests.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visithttp://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Ho, J.Y., Goggins, W.B., Mo, P.K.H. et al. The effect of temperature on physical activity: an aggregated timeseries analysis of smartphone users in five major Chinese cities. Int J Behav Nutr Phys Act 19, 68 (2022). https://doi.org/10.1186/s12966-022-01285-1

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12966-022-01285-1

Keywords

International Journal of Behavioral Nutrition and Physical Activity

ISSN: 1479-5868

Contact us