Skip to main content

Advertisement

We’d like to understand how you use our websites in order to improve them. Register your interest.
Download PDF

Measuring physical activity among pregnant women using a structured one-week recall questionnaire: evidence for validity and reliability

International Journal of Behavioral Nutrition and Physical Activity volume 7, Article number: 21 (2010) Cite this article

Abstract

Background

Accurate measurement of the components of physical activity during pregnancy can aid in our understanding of the dose response relationships between physical activity and corresponding perinatal outcomes. The aim of this study was to develop and evaluate a one-week recall questionnaire to assess moderate to vigorous physical activity during pregnancy.

Methods

To assess concurrent-related validity, 177 pregnant women (median 18 weeks' gestation, interquartile range (IQR) 15 -23) kept a structured diary and wore an accelerometer (Actigraph) for one week. At the conclusion of the week, they completed the Pregnancy Infection and Nutrition 3 (PIN3) physical activity questionnaire over the telephone. To assess evidence for test-retest reliability, 109 pregnant women (median 19 weeks' gestation, IQR 18-27) completed the questionnaire twice over the telephone, within 48 hours apart, recalling the same two time periods. Spearman correlation coefficients (SCC) and intraclass correlation coefficients (ICC) were used to assess evidence for validity and reliability, respectively.

Results

Comparison of the questionnaire to the structured diary was moderate to substantial (SCC 0.47 to 0.69) for several measures of moderate or vigorous physical activity using either perceived or absolute intensity. Comparison of moderate to vigorous physical activity from the questionnaire (absolute intensity using MET-hours/week) to the accelerometer ranged from 0.12 to 0.23 using SCC for absolute intensity (MET-hours/week) and 0.28 to 0.34 using relative intensity (hours/week) (n = 177). Test-retest reliability was moderate to almost perfect for moderate to vigorous physical activity, with the ICC ranging from 0.56 to 0.82 for both perceived and absolute intensities.

Conclusions

The PIN3 one-week recall questionnaire assessed moderate to vigorous physical activity in the past week with evidence for reliability and validity.

Background

Several decades of research supports the benefits of physical activity during pregnancy [1, 2]. In acknowledgment of this, several physician organizations endorse physical activity during pregnancy with position statements, such as in Canada [3], the United Kingdom [4], and the United States (US) [5]. In addition, the US government included a section on pregnancy recommendations in its national "2008 Physical Activity Guidelines for Americans" [1].

To evaluate and provide more specific evidence towards guidelines, accurate assessment of physical activity during pregnancy is needed. Self-reported questionnaires are useful in this regard, as they are often more economical and provide information on types and perceived intensity of activity not available from objective measurement methods. In epidemiologic studies of pregnant women, one goal for the questionnaire is to properly rank women within a narrow range of physical activity [6].

To date three physical activity questionnaires were evaluated for evidence of both validity and reliability among pregnant women: the Pregnancy Physical Activity Questionnaire [7, 8], the modified Kaiser Physical Activity Survey [9], and the modified International Physical Activity Questionnaire [10]. The first two questionnaires [7–9] provide information on the mode, frequency, and duration of physical activity in the current trimester of pregnancy; neither questionnaire collects perceived intensity, but activities can be assigned an absolute intensity through the use of metabolic equivalent (MET) values corresponding to specific modes of activity [11, 12]. The third questionnaire is an adaption of the International Physical Activity Questionnaire; it is shorter and provides information on leisure and household activities in the past two weeks [10]. It had low evidence of validity and reliability among a sample of pregnant women. An additional questionnaire that focused only on recreational activity (including active transport) recalled since becoming pregnant was evaluated for evidence of validity; the authors concluded that it may be useful in ranking women according to recreational activity [13]. Three of these questionnaires are self-administered [7, 10, 13] and one is interviewer-administered [9].

Physical activity during pregnancy may not be stable within a trimester, due to rapid changes in the mother's body. In addition, the compendium of physical activities used to assign MET values to activities is based on adults and does not account for pregnancy. Thus, it may be valuable to collect perceived intensity during the physical activity recall. We developed a one-week recall questionnaire to assess moderate to vigorous physical activity during pregnancy for use in the third Pregnancy Infection and Nutrition (PIN3) Study. It was designed such that dose response could be explored, accounting for variation in physical activity over a shorter time period, and comparisons could be made between perceived (relative) and absolute intensity. The aim of this study was to evaluate evidence for test-retest reliability and concurrent related validity for the PIN3 structured one-week recall physical activity questionnaire among pregnant women.

Methods

All data collection described herein was approved by the University of North Carolina - Chapel Hill Institutional Review Board and each participant provided written informed consent prior to participation in the study. We evaluated evidence for test-retest reliability and concurrent validity from two independent samples of pregnant women.

PIN3 Physical Activity Questionnaire

A one-week recall questionnaire was developed to evaluate physical activity among pregnant women enrolled in the PIN3 Study. The questionnaire was interviewer administered and designed to capture moderate and vigorous physical activity. It is available as additional file 1. The questionnaire can be contrasted with an interviewer-administered 7-day recall [14], but instead of recalling day-by-day the participant recalls mode-by-mode. The PIN3 physical activity questionnaire assessed frequency and duration of all moderate and vigorous physical activities the woman participated in, including activity done for recreation, at work, for transportation, childcare, adult care, and both indoor and outdoor household activities. Using recreational activity as an example, the question asked: "In the past week, did you participate in any non-work, recreational activity or exercise, such as walking for exercise, swimming, or dancing, that caused at least some increase in breathing and heart rate?" If the participant responded 'Yes', then the interviewer asked her to list all types of activities, one by one, with the following question: "What type of recreational activities did you do during the past week?" For each activity, the participant reported the number of sessions per week, duration of each session, and the perceived intensity level using the following options: 'fairly light,' 'somewhat hard,' and 'hard or very hard'. These intensity categories corresponded to the Borg scale of perceived exertion [15]. These questions were repeated for work, transportation, child and adult care giving, indoor household, and outdoor household activity.

The scoring of the questionnaire included assessment of intensity of activity in two ways. First, perceived (or relative) intensity using the modified Borg scale [15] to capture the participant's perception of intensity and to derive number of hours in the past week spent in moderate to vigorous physical activity, We classified activities reported as "somewhat hard" as moderate and activities reported as "hard or very hard" as vigorous. Second, absolute intensity classifying activities using published metabolic (MET) tables [11, 12] to determine the number of MET-hours per week spent in physical activity. A number of activities reported by women were not listed in the compendium. Thus, two raters determined the MET intensity based on other activities in the compendium; when the two raters disagreed they met and resolved by consensus. The final compendium of activities used for scoring is available elsewhere http://www.cpc.unc.edu/projects/pin/design_pin3/docs_3/PIN-MET-Table-080207.pdf. To determine moderate activity using absolute intensity, we defined moderate intensity as both 3 to 6 METS, a definition often used for adults [16], and 4.8 to 7.1 METS, the estimated values for moderate activity specific to adults 20 to 39 years of age [17].

The questionnaire took on average 10-20 minutes to administer. Intra- and inter-interviewer quality control measures, such as expert review of taped interviews, were established to ensure that interviewers were asking questions reliably and systematically.

Concurrent-Related Validity Assessment

For this portion of the study, pregnant women from central North Carolina were recruited by placing flyers in local clinics and screened over the telephone. Women were not enrolled if they were non-English speaking, under the age of 18 years, carrying multiple gestations, did not have a telephone from which they could complete the phone interviews, or more than 28 weeks' gestation during the screening call. The women wore an accelerometer for one week, kept a daily structured diary, and following this completed a questionnaire that included the one-week recall of the PIN3 physical activity questionnaire. Participants were paid $50 at the completion of the study; later in the study an electromagnetic field monitor was added to the protocol [18] and participants were paid $75.

PIN3 Diary Card

The structured diary card was developed as a way of assessing the evidence for concurrent related validity of the PIN3 physical activity questionnaire. The card and the instructions can be found in additional file 2. The goal of the card was to collect all moderate to vigorous physical activities the women performed in the past week. Women were requested to fill out the two-page card on a daily basis and to mail it back to us at the end of the one week period. The activities listed were the ones most commonly reported among the initial PIN3 participants and space was provided to list other types of activities. For each day, participants filled in time spent and perceived exertion (based on the same intensity descriptions used in the questionnaire) for each activity. On the diary card, if a woman performed an activity at two different intensities, such as gardening, one intensity level and time could be recorded in one row and the activity along with the different intensity and time could be recorded as an "other activity". In practice, this did not happen and so we assume women recorded the intensity level that best represented that activity.

The scoring of the diary card was similar as possible to the scoring of the PIN3 questionnaire. Hours per week in physical activity was calculated by adding up the time reported for each specific activity by intensity level. All activities were assigned a MET value from the compendium [11, 12], in order to determine MET-hours of activity.

Accelerometer

For the accelerometer, we used the Manufacturing Technology Inc. (MTI) Actigraph accelerometer model #7164 (Fort Walton Beach, FL). It is a small, light-weight uniaxial accelerometer that measures accelerations in the range of 0.05 to 2 G's with a band limited frequency of 0.25-2.5 Hertz [19]. Validity [20–22] and reliability [23–26] of the monitor as an indicator for physical activity have been demonstrated among adults.

Women were fitted with the accelerometer to be worn during waking hours for 7 days on a belt or clip-on pouch over their right hip at the iliac crest. They were asked to remove the monitor for sleeping, bathing, or swimming. Written and verbal instructions, as well as a phone number to call with questions, were provided. Participants mailed the monitor back to the study offices at the conclusion of the 7 days.

Accelerometer data were collected with 1-minute epochs, and the monitors were regularly calibrated throughout the study. Spurious counts were flagged, assessed, and set to missing if determined to be invalid. We defined non-wear time as a period of 20 minutes or more of zeros. We defined a standard measurement day as the length of time in which > = 70% of the sample was wearing the accelerometer, separately for weekdays and weekends similar to others [27]. We classified participants as having complete accelerometry data if they had nonmissing counts over at least 70% of a standard measurement day for all 7 days.

Ignoring missing values in the accelerometer file can cause a biased estimate of the true level of physical activity [27]. Therefore, missing data were filled by using multiple imputation inference strategy (using SAS proc MI) through expectation-maximization algorithm and a Markov Chain Monte Carlo method [27]. Considering the wearing time of our participants, non-missing accelerometer data falling into the daily time window of 5 am to midnight was selected as reference data for the imputation. Indicators on ten blocks of the time period (5 am to midnight) and week day versus weekend were used for the imputation procedure. In order to represent a random sample of the missing values, ten multiple imputed data sets were created by the multiple imputation procedure and each imputation contained minute-by-minute daily activity count data from 5 am to midnight.

From the accelerometer, we used the data several ways. First, using total counts per week we evaluated the raw data provided by the accelerometer without imposing cutpoint decisions. Second, activity was calculated as hours per week (using count thresholds) and counts per week spent in differing intensities (e.g., light, moderate, vigorous). A number of calibration studies of adults provide count thresholds (e.g., cutpoints) for moderate and vigorous activity. We calculated cutpoints using three of these studies: Freedson et al [20], Swartz et al [28], and summary cutpoints from National Heath and Nutrition Examination Survey (NHANES) data [29], calculated originally by taking the weighted average of cutpoints from Freedson et al [20], Yngve et al [30], Leenders et al [31], and Brage et al [22].

Test-Retest Reliability Assessment

For this portion of the study, we relied on a sample of PIN3 participants. The PIN3 Study recruited pregnant women less than 20 weeks' gestation seeking prenatal care at clinics associated with the University of North Carolina Hospitals. Trained staff identified women through review of all medical charts of new prenatal patients. Women were not enrolled if they were non-English speaking, under the age of 16 years, carrying multiple gestations, not planning to continue care or deliver at the study hospital, or did not have a telephone from which they could complete the phone interviews. Selected women were asked to participate in two telephone interviews, at 17-22 and 27-30 weeks' gestation. The study website http://www.cpc.unc.edu/pin provides greater detail on the protocols and measures.

We evaluated the physical activity questionnaire test-retest reliability among pregnant women within 48 hours of their telephone interview completion as part of the PIN3 Study. We enrolled women purposefully, with approximately equal numbers in six strata: (i) completing the first (17-22 weeks) or second (27-30 weeks) telephone interview and (ii) self-report of either being currently employed in a strenuous job, active at leisure, or inactive at either work or leisure. During the second interview, women were asked to recall the same week that the first interview was conducted, so that recall periods matched. Women were paid $5 for participation in each interview.

Other Measures

During the first interview for both the validity and reliability samples, women were asked to report their education, current work status, race, general health, and parity (live plus still births). For the reliability sample only, age was reported at the interview and the medical record was abstracted and included self-reported weight and measured height for the determination of pre-pregnancy body mass index (BMI). BMI values were grouped using the Institute of Medicine recommendations for pregnant women, in effect during that time period, into low (<19.8 kg/m2) or normal weight (19.8-<26.0 kg/m2), overweight (26.0-<30.0 kg/m2), and obese (> = 30.0 kg/m2) [32]. For the validity samples, age was obtained during recruitment and calculated based on her date of birth as her age on the interview date.

Statistical Analysis

All analyses were conducted using SAS version 9.1 (Cary, NC). Evidence for validity was assessed using Spearman correlation coefficients (SCC) with 95% confidence intervals (CI) comparing either the diary or accelerometer results to the questionnaire. We conducted analyses comparing the accelerometer to the questionnaire using the full sample, the imputed sample, and the smaller sample defined by complete accelerometry data. Bland-Altman plots [33] were used to assess agreement between physical activity measurements from the questionnaire with either the accelerometer or the diary among the full sample. On the plots, the x-axis is the average of two measurements, while the y-axis is the difference between the two measurements. Horizontal lines represent the upper and lower limits of agreement and the mean difference of the two measurements. In addition, Pitman's test of differences in the variances was calculated for each comparison [34].

Test-retest reliability was assessed using intraclass correlations coefficients (ICC) with corresponding 95% CI. ICC were calculated using a two-way analysis of variance model and conceptualized as the proportion of the total variance explained by between-participant variance. Bland-Altman plots [33] were used to compare questionnaire results at the two time periods. Stratified analyses were performed to determine if differences in reliability differed by gestational age at interview date, race, education, age, parity, or pre-pregnancy BMI. As a rough guide, we followed the ratings suggested by Landis and Koch [35] for agreement level: 0-0.20 slight, 0.21-0.40 fair, 0.41-<0.60 moderate, 0.61-<0.80 substantial, and 0.81-<1.00 almost perfect. Each physical activity entry was screened and outliers were pairwise deleted from the analysis.

Results

Description of Participants

In total, 177 pregnant women participated in the validity study and 109 pregnant women participated in the reliability study. For the validity study, a standard measurement day in which 70% of the women were wearing the accelerometer was defined from 9:00 to 21:00 on weekdays and 10:30 to 21:00 on weekends (see Figure in additional file 3). Thus, the minimum number of hours of nonmissing data allowed to be considered as having complete accelerometry data was 8.4 hours on weekdays (12 hours * 70%) and 7.4 hours on weekends (10.5 hours * 70%). Among our sample, 120 women (68%) met this criteria and were defined as the "complete Actigraph sample".

A description of participants in the validity (separately for the full sample and a subset of those determined to have worn the accelerometer for the minimum defined time over 7 days) and reliability studies are reported in Table 1. The median gestational week that the validity sample participated was 18 weeks (n = 177, interquartile range 15 to 23 weeks) and the reliability sample participated at 19 weeks (n = 109, interquartile range 18 to 27 weeks). The validity sample (n = 177) included a lower proportion of Black women, those with less than or equal to a high school education, younger age groups (<20 years), and lower general health (combining good, fair, and poor categories) compared to the reliability sample. The work status between the groups was similar. The validity sample reported more moderate, vigorous, and moderate to vigorous physical activity than the reliability sample (see Table in additional file 4).

Table 1 Descriptive information on the participants in the validity and reliability studies#
Full size table

Concurrent-Related Validity Assessment Using a Diary

To assess evidence for validity of the questionnaire, we compared summary values from the structured PIN3 diary to the physical activity questionnaire, with the average values from the diary reported in additional file 4. Agreement using SCC was moderate to substantial (0.47 to 0.69) for moderate, vigorous, moderate to vigorous, and total physical activity assessed using either perceived or absolute intensity (Table 2). Results from the Bland-Altman plots (not shown) indicated that the results from the diary were more often higher than the results from the questionnaire for total hours/week (85.9% of women from the full sample), total MET-hours/week (82.5%), moderate to vigorous hours/week (67.8%), and moderate to vigorous MET-hours/week using 3-6 METS to define moderate activity (80.2%). Of these four measures, only moderate to vigorous physical activity included exact matches (7.3% of the sample). For moderate to vigorous MET-hours/week using 4.8-7.1 METS to define moderate activity, the diary consistently provided similar measures as the questionnaire (47.5% having the same measure) and a similar distribution of over and under reporting as compared to the questionnaire (24.3%, 28.2%, respectively). The Pitman's test of differences in the variances supported these observations, with only the absolute measure of moderate to vigorous MET-hours/week (using 4.8-7.1 METS to define moderate activity) showing no significant differences in variances.

Table 2 Comparison of the PIN3 physical activity questionnaire to the diary card using Spearman correlation coefficients (SCC) with 95% confidence intervals (CI)
Full size table

Concurrent-Related Validity Assessment Using an Accelerometer

Evidence for validity was also assessed by comparing accelerometer measures collected during the same week as the recall period for the physical activity questionnaire, with the average values from the accelerometer reported in additional file 4. Table 3 reports findings using absolute intensity measures from the questionnaire. The results were generally similar whether we used the full sample (n = 177), the sample that included imputation (n = 177), or the sample with complete Actigraph data over 7 days (n = 120). SCC were fair, ranging from 0.20 to 0.31 when comparing total Actigraph counts/week to the questionnaire in MET-hours/week. Results were generally similar whether we defined moderate intensity as 3 to 6 METS or 4.8 to 7.1 METS. Considering the lower count cutpoints using the Swartz et al calibration study results, moderate activity agreement ranged from 0.04 to 0.24, while vigorous activity ranged from 0.29 to 0.44, and total moderate to vigorous activity ranged from 0.10 to 0.32. Considering the higher count cutpoints using the Freedson et al and Troiano et al cutpoints for either moderate activity definition, agreement ranged from 0.01 to 0.07, while vigorous activity ranged from 0.28 to 0.40, and total moderate to vigorous activity agreement ranged from 0.12 to 0.20.

Table 3 Comparison of the PIN3 physical activity questionnaire to the accelerometer using Spearman correlation coefficients (SCC) with 95% confidence intervals (CI), using absolute intensity overall and separately using 3-6 METS and 4.8-7.1 METS to define moderate activity
Full size table

Similar results were found when scoring the questionnaire using perceived intensity in hours/week (Table 4). Agreement results were generally similar using any of the three cutpoints, and either the full sample (n = 177) or the sample with complete Actigraph data over 7 days (n = 120). Agreement between moderate activity on the accelerometer and the questionnaire ranged from 0.16 to 0.33, vigorous activity agreement ranged from 0.26 to 0.33, and moderate to vigorous activity agreement ranged from 0.22 to 0.34. Results from the Bland-Altman plots (not shown) indicated that moderate to vigorous physical activities reported on the questionnaire (hours/week) were higher when compared to those derived from the accelerometer using the Freedson or Troiano cutpoints. However, using the Swartz et al cutpoints, higher hours/week of moderate to vigorous physical activity from the accelerometer was observed in 94.4% of the sample compared to the questionnaire. Pitman's test of difference in variance supported the trends from Bland-Altman plots (not shown) and indicated that there were significant differences between the activity measures from accelerometer and reported on the questionnaire.

Table 4 Comparison of the PIN3 physical activity questionnaire to the accelerometer using Spearman correlation coefficients (SCC) with 95% confidence intervals (CI), using perceived intensity
Full size table

Test-Retest Reliability Assessment

Test-retest was moderate to almost perfect for total and moderate to vigorous physical activity, with the ICC ranging from 0.56 to 0.84 for both perceived and absolute intensities (Table 5). When considering moderate to vigorous activity, reliability for perceived hours/week in "somewhat hard" activity was lower (0.56, 95% CI 0.42, 0.68) than for absolute MET-hours/week for either the lower definition of 3-6 METS (0.82, 95% CI 0.75, 0.87) or the higher definition of 4.8-7.1 METS (0.74, 95% CI 0.64, 0.82). Results from the Bland-Altman plots (not shown) indicated an even distribution of values above and below the difference line of zero, with more discrepant findings occurring only at the highest reported mean values of physical activity, using either perceived or absolute total activity or moderate to vigorous physical activity.

Table 5 Test-retest reliability of PIN3 physical activity questionnaire using intraclass correlation coefficients (ICC) with 95% confidence intervals (CI) (n = 109)
Full size table

Test-retest reliability remained moderate to almost perfect, using either perceived or absolute intensity, when exploring by modality for work, recreation, outdoor household, child and adult care, and transportation activity (Table 5). The exception to this was moderate to vigorous indoor household activity, where the ICC was 0.39 for perceived intensity and 0.36 for absolute intensity using a 3 MET lower bound.

Next we explored whether test-retest reliability differed by several factors, according to the ICC, for total moderate to vigorous physical activity using both perceived and absolute intensity definitions (Table 6). The factors included interview date (17-22 or 27-30 weeks' gestation), race (White or Other), education (high school or less, some college or more), age (18 to 29 years, 30 or more years), parity (zero or 1+), and prepregnancy body mass index (<25 or > = 25 kg/m2). Only a few meaningful differences were identified, defined as a difference that would classify women into a different category as described by Landis and Koch [35]. For total moderate to vigorous hours/week, White women and younger women had moderate reliability while women of other races and older women had substantial reliability. Furthermore, women with lower education had fair reliability on this measure, while those with higher education had substantial reliability. The only difference identified for total moderate to vigorous MET-hours/week defined at > = 3 METS was for race; White women had almost perfect reliability while women of other races had substantial reliability. For total moderate to vigorous MET-hours/week defined at > = 4.8 METS, those with lower education had moderate reliability while those with higher education had substantial reliability and those who were younger had fair reliability while those that were older had almost perfect reliability.

Table 6 Stratified test-retest reliability of PIN3 physical activity questionnaire using intraclass correlation coefficients (ICC) with 95% confidence intervals (CI) (n = 109*)
Full size table

Discussion

In epidemiologic studies, physical activity questionnaires should rank individuals from sedentary to most active; the challenge may be greater among pregnant women who may not be as active [36] (and thus the distribution of their activity is less) as their non-pregnant counterparts [6]. We developed a one-week recall instrument, to obtain more frequent fluxuations in physical activity that may occur during pregnancy, and evaluated the psychometric properties of the questionnaire. These results indicate that the questionnaire generally displayed evidence for fair to substantial concurrent validity and moderate to substantial test-retest reliability.

Evidence for Validity Comparing to the Diary

With the lack of a single comparison standard measure for physical activity, we used both a self-reported (diary) and objective (accelerometer) measure to compare to the physical activity questionnaire. The PIN3 structured diary provided estimates of moderate to vigorous physical activity over the same week that the questionnaire recall occurred. SCC were moderate to substantial regardless of whether perceived or absolute intensity from the questionnaire was used. While there is some concern that keeping the structured diary may heighten participant's awareness and report of their recalled physical activities on the questionnaire for the validation portion of the study, thus biasing results to appear more favorable than they are, others have shown that this does not affect overall estimates of validity in other populations [37].

Evidence for Validity Comparing to the Accelerometer

A concern when comparing two self-reported measures against one another is that the errors inherent with each method may be correlated, resulting in inflated estimates of validity [9]. To account for this, we also compared the PIN3 physical activity questionnaire to an objective measure of physical activity. We found that agreement was higher when comparing the questionnaire to the diary (i.e., both self-reported measures) in comparison to the accelerometer.

For accelerometry, the challenge is that the cutpoints used to convert counts to moderate and vigorous intensity activity vary across studies, due in part to different calibration methods, different activities included in the calibration study, and differing populations. For adults, there seems to be more variability with moderate activity cutpoints as compared to vigorous activity cutpoints and no calibration studies have been conducted on pregnant women. We explored the sensitivity of the objective validity results by exploring three different accelerometry cutpoints for moderate and vigorous physical activity. The cutpoints from Freedson et al [20] and Swartz et al [28] were used in other pregnancy studies collecting accelerometry data [7, 9]. In addition, we used summary cutpoints from NHANES data by Troiano et al [29]. Similar to Chasan-Taber et al [7], we found that the correlation between the accelerometer and the questionnaire were lower for the Freedson et al [20] equation in which the count threshold was much higher, than for equations using lower thresholds from Swartz et al [28]. Others have also found that the higher count cutpoints for moderate activity may be set too high to capture a broad range of moderate activities [38]. Therefore, in addition to reporting comparisons using these cutpoints, we reported correlations with Actigraph counts, an indicator of overall physical activity that does not rely on thresholds.

We also explored our validation results using cutpoints for moderate to vigorous physical activity from a calibration study of Hendelman et al [21], which assigned moderate activity at 191 counts/minute and vigorous activity at 7525 counts/minute. This cutpoint for moderate activity was explored in other studies of pregnancy [7, 9, 39] and is much lower than the other values that we explored, while the vigorous cutpoint is higher than any we used. While the correlational results using Hendelman cutpoints generally produced similar results to our findings, the Bland-Altman plots indicated a strong bias with almost all women having higher values from the accelerometer as compared to the questionnaire. Thus, we chose not to report these results.

While the accelerometer is an acceptable measure to compare a physical activity measure against due to its objectivity and removal of recall and response bias, it is not without limitations. The accelerometer we used (Actigraph) is uniaxial; thus activities that involved upper body movement, lifting, or cycling are underestimated. Moreover, swimming activities were not counted, since we asked women to remove the accelerometer when in the water.

A recent comprehensive review summarized the results of studies comparing physical activity questionnaire data to objective measures [40]. When considering comparison to accelerometry, the average percent mean difference (calculated as (self-reported mean minus accelerometer mean)/accelerometer mean) across 60 studies of women was 138%. Most often, women's report of physical activity was higher than the accelerometer readings. In our study, this depended on the validity measure used. On the full sample, the percent mean difference ((mean from self-report - mean from accelerometer)/mean from accelerometer) for moderate to vigorous physical activity was 85% using the Freedson et al cutpoint and 96% using the Troiano et al cutpoint, indicating higher reporting from the questionnaire. In contrast, the percent mean difference for moderate to vigorous physical activity using the Swartz et al cutpoint was -69%, indicating higher reporting from the accelerometer. Using total counts from the accelerometer compared to total physical activity from the questionnaire, the percent mean difference was -88%.

Using the Troiano et al cutpoint, the US national data from 2003 to 2004 indicate that women 20 to 29 years of age average 24 minutes/day of moderate to vigorous physical activity, whereas women 30 to 39 years of age averaged 21 minutes/day [29]. Interestingly, when using the same accelerometer cutpoint we obtained a slightly lower average of 19 minutes/day of moderate to vigorous physical activity among our sample of 177 pregnant women. In contrast, the PIN3 questionnaire averaged 37 minutes/day for these same 177 pregnant women, a two-fold higher report.

Evidence for Reliability

Test-retest reliability agreement for the PIN3 questionnaire was moderate to almost perfect for moderate to vigorous physical activity. This is similar to reliability assessed from two other physical activity questionnaires, indicating agreement in measuring total physical activity with an ICC of 0.78 [7] and 0.84 [9]. Because we over sampled women who were active, our results may be an underestimate, since test-retest reliability is generally higher among sedentary adults. The period of recall was 24 to 48 hours, in order for women to recall the same time period and not introduce bias in reporting of different days. This short time period between interviews may have influenced their recall of activities, thus leading to higher estimates of reliability.

Limitations

Several limitations of this study should be noted. First, the distribution of characteristics of women in the validity and reliability samples showed were somewhat different due to the differing methods of recruitment. This would become important if the findings differed by important confounding variables. Second, it is not known how representative our sample is to the source population or how generalizable our results will be to other populations. Comparing to the US national data from NHANES described earlier, among women 20 to 39 years of age, the minutes of moderate to vigorous physical activity was slightly lower among our sample, which seemed reasonable since the women were pregnant. Third, we assigned MET values to all reported activities based on the compendium of physical activities for adults [11, 12]. It is not known how well these MET values correspond to similar activities performed while pregnant, but others indicate that they can differ from 0.2 to 2.0 METS [7]. The correlation between physical activity from self-report compared to accelerometry may decline over the course of pregnancy [39]. Studies assessing the metabolic intensity of activities among pregnant women at various gestational ages are needed to help quantify this error. Fourth, we have tested many associations but did not adjust for multiple testing. Therefore, significance should be interpreted with caution, and replication of results would be useful. Lastly, women were asked to recall moderate and vigorous activities that caused at least some increase in their breathing and heart rate. The activities that we classified as less than moderate, with a perceived intensity of "fairly light", may be under ascertained by some women since they were instructed to recall moderate to vigorous activities.

Conclusion

The PIN3 physical activity questionnaire was designed to provide the frequency, intensity, duration, and mode of physical activities in the past week. The questionnaire is interviewer-administered and asks women to recall moderate to vigorous physical activities mode by mode. Using both direct and indirect methods for evaluation, this study provides validity and reliability evidence for use of the PIN3 questionnaire to assess moderate to vigorous physical activity in the past week among pregnant women.

References

  1. 1.

    U.S. Department of Health and Human Services: 2008 Physical Activity Guidelines for Americans. 2008, Washington, D.C., 1-61. Accessed November 1, 2008 at, [http://www.health.gov/paguidelines]

    Google Scholar 

  2. 2.

    Pivarnik JM, Chambliss H, Clapp J, Dugan S, Hatch M, Lovelady C, Mottola MF, Williams M: Impact of physical activity during pregnancy and postpartum on chronic disease risk. Med Sci Sports Exerc. 2006, 38 (5): 989-1006. 10.1249/01.mss.0000218147.51025.8a.

    Article  Google Scholar 

  3. 3.

    Davies G, Wolfe L, Mottola M, MacKinnon C: Joint SOGC/CSEP clinical practice guideline: Exercise in pregnancy and the postpartum period. Can J Appl Physiol. 2003, 28 (3): 330-341.

    Article  Google Scholar 

  4. 4.

    Exercise in pregnancy. RCOG Statement No. 4 - January 2006. Accessed September 1, 2009 at, [http://www.rcog.org.uk/files/rcog-corp/uploaded-files/RCOGStatement4ExercisePregnancy2006.pdf]

  5. 5.

    ACOG: Exercise during pregnancy and the postpartum period. ACOG Committee Opinion No. 267. Obstet Gynecol. 2002, 99 (1): 171-173. 10.1016/S0029-7844(01)01749-5.

    Article  Google Scholar 

  6. 6.

    Chasan-Taber L, Evenson KR, Sternfeld B, Kengeri S: Assessment of recreational physical activity during pregnancy in epidemiologic studies of birthweight and length of gestation: methodologic aspects. Women Health. 2007, 45 (4): 85-107. 10.1300/J013v45n04_05.

    Article  Google Scholar 

  7. 7.

    Chasan-Taber L, Schmidt M, Roberts D, Hosmer D, Markenson G, Freedson P: Development and validation of a pregnancy physical activity questionnaire. Med Sci Sports Exerc. 2004, 36 (10): 1750-1760. 10.1249/01.MSS.0000142303.49306.0D.

    Article  Google Scholar 

  8. 8.

    Ota E, Haruna M, Yanai H, Suzuki M, Anh DD, Matsuzaki M, Tho le H, Ariyoshi K, Yeo SA, Murashima S: Reliability and validity of the Vietnamese version of the Pregnancy Physical Activity Questionnaire (PPAQ). Southeast Asian J Trop Med Public Health. 2008, 39 (3): 562-570.

    Google Scholar 

  9. 9.

    Schmidt MD, Freedson PS, Pekow P, Roberts D, Sternfeld B, Chasan-Taber L: Validation of the Kaiser Physical Activity Survey in pregnant women. Med Sci Sports Exerc. 2006, 38 (1): 42-50. 10.1249/01.mss.0000181301.07516.d6.

    Article  Google Scholar 

  10. 10.

    Aittasalo M, Pasanen M, Fogelholm M, Ojala K: Validity and repeatability of a short pregnancy leisure time physical activity questionnaire. J Physical Activity Health. 2010, 7: 109-118.

    Google Scholar 

  11. 11.

    Ainsworth B, Haskell W, Leon A, Jacobs D, Montoye H, Sallis J, Paffenbarger R: Compendium of physical activities: Classification of energy costs of human physical activities. Med Sci Sports Exerc. 1993, 25: 71-80. 10.1249/00005768-199301000-00011.

    CAS  Article  Google Scholar 

  12. 12.

    Ainsworth B, Haskell W, Whitt M, Irwin M, Swartz A, Strath S, O'Brien W, Bassett D, Schmitz K, Emplaincourt P, Jacobs D, Leon A: Compendium of physical activities: an update of activity codes and MET intensities. Med Sci Sport Exer. 2000, 32 (9 supplement): S498-S516.

    CAS  Article  Google Scholar 

  13. 13.

    Brantsaeter AL, Owe KM, Haugen M, Alexander J, Meltzer HM, Longnecker MP: Validation of self-reported recreational exercise in pregnant women in the Norwegian Mother and Child Cohort Study. Scand J Med Sci Sports. 2009

    Google Scholar 

  14. 14.

    Sallis J: Seven-day physical activity recall. Med Sci Sports Exerc. 1997, 29: S89-S103.

    Google Scholar 

  15. 15.

    Borg G, Linderholm H: Perceived exertion and pulse rate during graded exercise in various age groups. Acta Med Scand. 1974, 472: 194-206.

    Google Scholar 

  16. 16.

    Pate R, Pratt M, Blair S, Haskell W, Macera C, Bouchard C, Buchner D, Ettinger W, Heath G, King A, Kriska A, Leon A, Marcus B, Morris J, Paffenbarger R, Patrick K, Pollock M, Rippe J, Sallis J, Wilmore J: Physical activity and public health. A recommendation from the Centers for Disease Control and Prevention and the American College of Sports Medicine. JAMA. 1995, 273 (5): 402-407. 10.1001/jama.273.5.402.

    CAS  Article  Google Scholar 

  17. 17.

    Pollock M, Gaesser G, Butcher J, Despres J, Dishman R, Franklin B, Ewing Garber C: American College of Sports Medicine Position Stand: The recommended quantity and quality of exercise for developing and maintaining cardiorespiratory and muscular fitness, and flexibility in healthy adults. Med Sci Sport Exer. 1998, 30 (6): 975-991. 10.1097/00005768-199806000-00032.

    Article  Google Scholar 

  18. 18.

    Savitz D, Herring A, Mezei G, Evenson K, Terry J, Kavet R: Physical activity and magnetic field exposure in pregnancy. Epidemiol. 2006, 17 (2): 222-225. 10.1097/01.ede.0000197294.05564.08.

    Article  Google Scholar 

  19. 19.

    Trost S, McIver K, Pate R: Conducting accelerometer-based activity assessments in field-based research. Med Sci Sports Exerc. 2005, 37 (11 Suppl): S531-S543. 10.1249/01.mss.0000185657.86065.98.

    Article  Google Scholar 

  20. 20.

    Freedson P, Melanson E, Sirard J: Calibration of the Computer Science and Applications, Inc. accelerometer. Med Sci Sports Exerc. 1998, 30: 777-781. 10.1097/00005768-199805000-00021.

    CAS  Article  Google Scholar 

  21. 21.

    Hendelman D, Miller K, Baggett C, Debold E, Freedson P: Validity of accelerometry for the assessment of moderate intensity physical activity in the field. Med Sci Sports Exerc. 2000, 32: S442-449. 10.1097/00005768-200009001-00002.

    CAS  Article  Google Scholar 

  22. 22.

    Brage S, Wedderkopp N, Franks P, Andersen L, Froberg K: Reexamination of validity and reliability of the CSA monitor in walking and running. Med Sci Sports Exerc. 2003, 35: 1447-1454. 10.1249/01.MSS.0000079078.62035.EC.

    Article  Google Scholar 

  23. 23.

    Nichols J, Morgan C, Chabot L, Sallis J, Calfas K: Assessment of physical activity with the Computer Science and Applications, Inc. accelerometer: Laboratory versus field validation. Res Q Exerc Sport. 2000, 71: 36-43.

    CAS  Article  Google Scholar 

  24. 24.

    Metcalf B, Curnow J, Evans C, Voss L, Wilkin T: Technical reliability of the CSA activity monitor: The EarlyBird Study. Med Sci Sports Exerc. 2002, 34 (9): 1533-1537. 10.1097/00005768-200209000-00022.

    Article  Google Scholar 

  25. 25.

    Welk G, Schaben J, Morrow J: Reliability of accelerometry-based activity monitors: A generalizability study. Med Sci Sports Exerc. 2004, 36: 1637-1645.

    Google Scholar 

  26. 26.

    Esliger D, Tremblay M: Technical reliability assessment of three accelerometer models in a mechanical setup. Med Sci Sports Exerc. 2006, 38 (12): 2173-2181. 10.1249/01.mss.0000239394.55461.08.

    Article  Google Scholar 

  27. 27.

    Catellier DJ, Hannan PJ, Murray DM, Addy CL, Conway TL, Yang S, Rice JC: Imputation of missing data when measuring physical activity by accelerometry. Med Sci Sports Exerc. 2005, 37 (11 Suppl): S555-562. 10.1249/01.mss.0000185651.59486.4e.

    Article  Google Scholar 

  28. 28.

    Swartz A, Strath S, Bassett D, O'Brien W, King G, Ainsworth B: Estimation of energy expenditure using CSA accelerometers at hip and wrist sites. Med Sci Sports Exerc. 2000, 32: S450-456. 10.1097/00005768-200009001-00003.

    CAS  Article  Google Scholar 

  29. 29.

    Troiano R, Berrigan D, Dodd K, Masse L, Tilert T, McDowell M: Physical activity in the United States measured by accelerometer. Med Sci Sports Exerc. 2008, 40 (1): 181-188.

    Article  Google Scholar 

  30. 30.

    Yngve A, Nilsson A, Sjostrom M, Ekelund U: Effect of monitor placement and of activity setting on the MTI accelerometer output. Med Sci Sports Exerc. 2003, 35: 320-326. 10.1249/01.MSS.0000048829.75758.A0.

    Article  Google Scholar 

  31. 31.

    Leenders N, Nelson T, Sherman W: Ability of different physical activity monitors to detect movement during treadmill walking. Intl J Sport Med. 2003, 24: 43-50. 10.1055/s-2003-37196.

    CAS  Article  Google Scholar 

  32. 32.

    Institute of Medicine: Nutrition during pregnancy: Part I, Weight gain; Part II Nutrient supplements. 1990, Washington D.C.: Committee on Nutritional Status During Pregnancy and Lactation, Food and Nutrition Board, National Academy Press

    Google Scholar 

  33. 33.

    Bland J, Altman D: Statistical methods for assessing agreement between two methods of clinical measurement. Lancet. 1986, 1 (8476): 307-310.

    CAS  Article  Google Scholar 

  34. 34.

    Pitman E: A note on normal correlation. Biometrika. 1939, 31: 9-12.

    Article  Google Scholar 

  35. 35.

    Landis J, Koch G: The measurement of observer agreement for categorical data. Biometrics. 1977, 33: 159-174. 10.2307/2529310.

    CAS  Article  Google Scholar 

  36. 36.

    Evenson K, Wen F: National trends in self-reported physical activity and sedentary behaviors among pregnant women: NHANES 1999-2006. Prev Med. 2010, 50: 123-128. 10.1016/j.ypmed.2009.12.015.

    Article  Google Scholar 

  37. 37.

    Timperio A, Salmon J, Rosenberg M, Bull F: Do logbooks influence recall of physical activity in validation studies?. Med Sci Sports Exerc. 2004, 36 (7): 1181-1186. 10.1249/01.MSS.0000132268.74992.D8.

    Article  Google Scholar 

  38. 38.

    Ainsworth B, Bassett D, Strath S, Swartz A, O'Brien W, Thompson R, Jones D, Macera C, Kimsey C: Comparison on three methods of measuring time spent in physical activity. Med Sci Sports Exerc. 2000, 32 (9 suppl): S457-464.

    CAS  Article  Google Scholar 

  39. 39.

    Rousham E, Clarke P, Gross H: Significant changes in physical activity among pregnant women in the UK as assessed by accelerometry and self-reported activity. Eur J Clin Nutr. 2005, 60 (3): 393-400. 10.1038/sj.ejcn.1602329.

    Article  Google Scholar 

  40. 40.

    Prince SA, Adamo KB, Hamel ME, Hardt J, Gorber SC, Tremblay M: A comparison of direct versus self-report measures for assessing physical activity in adults: a systematic review. Intl J Behavioral Nutrition Physical Activity. 2008, 5: 56-10.1186/1479-5868-5-56.

    Article  Google Scholar 

Download references

Acknowledgements

Funding for this study was provided by the National Institutes of Health (NIH)/National Cancer Institute (#CA109804-01). Data collection was supported by NIH/National Institute of Child Health and Human Development (#HD37584) and the Electric Power Research Institute (contract #CP P12618/C6280). The content is solely the responsibility of the authors and does not necessarily represent the official views of the NIH. The Pregnancy, Infection, and Nutrition Study is a joint effort of many investigators and staff members whose work is gratefully acknowledged. We especially thank Aimee Benson, Chyrise Bradley, Sarah Causey, Amy Herring, David Savitz, and James Terry, as well as the anonymous reviewers.

Author information

Affiliations

  1. Department of Epidemiology, Gillings School of Global Public Health, University of North Carolina, Chapel Hill, North Carolina, USA
    • Kelly R Evenson
    •  & Fang Wen
Authors
  1. Kelly R Evenson
    View author publications
    You can also search for this author in
  2. Fang Wen
    View author publications
    You can also search for this author in

Corresponding author

Correspondence to Kelly R Evenson.

Additional information

Competing interests

The authors declare that they have no competing interests.

Authors' contributions

KRE conceptualized the project, designed the questionnaires, provided input on data collection, and drafted the manuscript. FW conducted most of the statistical analyses and provided feedback on several earlier drafts of the manuscript. Both authors read and approved the final manuscript.

Electronic supplementary material

Additional file 1: PIN3 physical activity questionnaire, using a structured one-week recall of moderate to vigorous physical activity for pregnant women. This file provides a summary of the PIN3 physical activity questionnaire that is being evaluated in this study. (PDF 27 KB)

Additional file 2: PIN3 physical activity diary card. This file provides the diary card used for the validation component in this study, along with a scoring table. (PDF 115 KB)

Additional file 3: Cumulative proportion of the validity participants (n = 177) wearing the accelerometer by time of day, separately for weekdays and weekends. This file provides a summary of the accelerometer wearing time among the pregnant women who participated in the validity study. (PDF 49 KB)

Additional file 4: Physical activity for the validity and reliability study participants. This file provides a summary of the physical activity among pregnant women who participated in the validity or reliability study. (PDF 34 KB)

Authors’ original submitted files for images

Below are the links to the authors’ original submitted files for images.

Authors’ original file for figure 1

Rights and permissions

This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Reprints and Permissions

About this article

Cite this article

Evenson, K.R., Wen, F. Measuring physical activity among pregnant women using a structured one-week recall questionnaire: evidence for validity and reliability. Int J Behav Nutr Phys Act 7, 21 (2010). https://doi.org/10.1186/1479-5868-7-21

Download citation

Keywords

  • Physical Activity
  • Pregnant Woman
  • Vigorous Physical Activity
  • Intraclass Correlation Coefficient
  • Absolute Intensity

International Journal of Behavioral Nutrition and Physical Activity

ISSN: 1479-5868

Contact us