- Open Access
A meta-analysis of the reproducibility of food frequency questionnaires in nutritional epidemiological studies
International Journal of Behavioral Nutrition and Physical Activity volume 18, Article number: 12 (2021)
Reproducibility of FFQs measures the consistency of the same subject at different time points. We performed a meta-analysis to explore the reproducibility of FFQs and factors related to reproducibility of FFQs.
Methods and findings
A systematic literature review was performed before July 2020 using PubMed and Web of Science databases. Pooled intraclass and Spearman correlation coefficients (95% confidence interval) were calculated to assess the reproducibility of FFQs. Subgroup analyses based on characteristics of study populations, FFQs, or study design were performed to investigate factors related to the reproducibility of FFQs. A total of 123 studies comprising 20,542 participants were eligible for the meta-analysis. The pooled crude intraclass correlation coefficients ranged from 0.499 to 0.803 and 0.499 to 0.723 for macronutrients and micronutrients, respectively. Energy-adjusted intraclass correlation coefficients ranged from 0.420 to 0.803 and 0.507 to 0.712 for macronutrients and micronutrients, respectively. The pooled crude and energy-adjusted Spearman correlation coefficients ranged from 0.548 to 0.851 and 0.441 to 0.793, respectively, for macronutrients; and from 0.573 to 0.828 and 0.510 to 0.744, respectively, for micronutrients. FFQs with more food items, 12 months as dietary recall interval (compared to less than 12 months), and a shorter time period between repeated FFQs resulted in superior FFQ reproducibility.
In conclusion, FFQs with correlation coefficients greater than 0.5 for most nutrients may be considered a reliable tool to measure dietary intake. To develop FFQs with higher reproducibility, the number of food items and dietary recall interval should be taken into consideration.
The FFQ is the most commonly used tool to assess individual usual dietary intake in nutritional epidemiological studies, especially for investigating the relationship between dietary and health outcomes [1, 2]. FFQs allow researchers to rank subjects according to their dietary and nutritional intake. Obtaining an accurate estimate of long-term habitual food intake is crucial , which is very important to better understand diet and associated diseases. However, assessment of nutritional habits is complex , and they are affected by real changes in regular dietary intake and random changes in FFQ [5, 6]. FFQs allow covering a wider range of foods, including those consumed rarely, and can be administered once whereas to describe usual dietary habits with a reasonable reproducibility . If the reproducibility is not maintained high enough, the dietary intakes of subjects measured at baseline would substantially misclassify their true exposure during the study period . To enhance the interpretation of estimated diet–disease associations and to improve the translation of such associations into dietary recommendations, reproducibility analysis is required before applying FFQ to analyze dietary intake .
Reproducibility reflects reliability and refers to the similarity of the same method at different timepoints . Reproducibility is generally assessed by administering the same FFQ twice to the same group of subjects and analyzing the association between the two responses . Previous studies reported that the intervals between two FFQs varied from 1 week  to 2 years . And true change in regular dietary intakes and random variation in response to the FFQ have been considered factors affecting the repeatability of FFQs , which result in reduced reproducibility of FFQs with long interval [2, 15]. However, the two FFQs administered closely, respondents may remember and repeat their previous responses and result in high reproducibility .
Numerous studies have been devoted to assess the reproducibility of FFQs before applying FFQ to different populations. The Spearman and intraclass correlation coefficients (ICCs) to assess the reproducibility of 134-item FFQs with approximately 6 months apart ranged from 0.46 to 0.79 and from 0.34 to 0.71, respectively, for 25 nutrients in the Shanghai Diet and Health Study . The reproducibility of another FFQ of 157 items with 3-month interval used in the Food4Me study (a randomized controlled trial across seven European countries) has been reported to range from 0.62 to 0.89 . Then, a repeatability study of an interview administered FFQ of 135 items in the Mexican Women’s Bone Health Cohort Study found that the reproducibility coefficients range from 0.186 to 0.810 for energy-unadjusted data and 0.174 to 0.597 for energy-adjusted data . However, the correlation coefficients of different nutrients evaluated in different studies are different, and a widely accepted reference value for the reproducibility of FFQs is currently lacking.
Furthermore, the characteristics of FFQs may affect their reproducibility. A previous study reported that the ICCs of an FFQ comprising 255 items ranged from 0.69 (fat) to 0.84 (vitamin A) in Moroccan adults . A shorter FFQ assessing the average consumption of 57 food items was reported to have a reliability coefficient ranging from 0.56 to 0.70 . Therefore, FFQ items may induce differences in reproducibility. A previous study suggested that the median (range) energy-adjusted Spearman correlation coefficients (SCCs) for 30 nutrients between two FFQ measurements was 0.24 (0.04–0.69) for men and 0.50 (0.27–0.60) for women , suggesting that the reliability of FFQs differ between men and women. Moreover, differences in FFQ reproducibility may be caused by other factors , such as real changes in diet over time, individual differences in diet, and study design differences [22, 23]. However, there has been a paucity of studies comprehensively exploring the effects of these factors on the reproducibility of FFQs.
Although the reproducibility of FFQs has been evaluated in various studies, there has yet to be a comprehensive meta-analysis of the reproducibility studies and definition of reference ranges for reproducibility coefficients. Moreover, no study has systematically explored the factors related to the reproducibility of FFQs. Therefore, we conducted a meta-analysis to systematically assess the reproducibility of FFQs and to explore the factors related to the reproducibility of FFQs.
A systematic review was conducted according to the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guideline; the relevant checklist is provided in PRISMA Checklist.
We conducted a comprehensive literature search for published studies from PubMed and Web of Science databases before July 2020. The literature search was conducted by two independent researchers. The search strategy used employed the terms “FFQ OR food frequency questionnaire” AND “reproducibility OR repeatability OR reliability”.
Study identification and selection
The potentially relevant articles were evaluated by two independent reviewers based on the inclusion. The original studies were obtained from the database. After removing duplicates, we screened the studies according to title and abstract. After reading the full texts, the eligible articles were obtained by exclusion criteria.
Articles were included if they met the following criteria: (1) FFQs were used to measure nutrient intake; (2) the age range of target healthy populations was between 8 and 86 years; (3) the study assessed the reproducibility of FFQs; (4) the study was published in English; and (5) the reproducibility of FFQs was measured with the intraclass correlation coefficient (ICC) and Pearson correlation coefficient or SCC.
The exclusion criteria were: (1) food intake was assessed using FFQs; (2) FFQs were used to assess a specific nutrient; (3) the target population was unhealthy people or specific populations, such as individuals who were overweight or malnourished; (4) the participants were less than 8 years old; (5) the article investigated diet-disease relationships; and (6) the full text was unavailable through web searches.
Data were extracted from each study by independent reviewers. The extracted contents included the following, excluding authors and published years: (1) characteristics of participants including sample size, age, gender distribution, and region; (2) characteristics of FFQs including food items and dietary recall interval; (3) characteristics of study design including administration method and interval between two FFQs; and (4) statistics employed to assess reproducibility between repeated FFQs including ICC and Pearson correlation coefficient or SCC in relation to energy, macronutrients, and micronutrients (minerals and vitamins). Macronutrients included protein, fat, plant fat, animal fat, MUFA, PUFA, n-3 PUFA, n-6 PUFA, SFA, linoleic acid, linolenic acid, EPA, DHA, trans-fat, cholesterol, lipid, carbohydrate, sucrose, sugar, starch, fiber, soluble fiber, insoluble fiber, and alcohol. Minerals included selenium (Se), magnesium (Mg), calcium (Ca), iron (Fe), iodine (I); zinc (Zn), copper (Cu), potassium (K), phosphorus (P), sodium (Na), and manganese (Mn). Vitamins included vitamin A, retinol, carotene, β-carotene, vitamin C, vitamin D, vitamin E, vitamin K, thiamin, riboflavin, niacin, vitamin B6, folate and vitamin B12.
The pooled correlation coefficients were calculated based on the ICC and SCC values obtained from each article. We converted Pearson correlation coefficients into SCCs if the latter were lacking. Fisher’s transformation was used to convert each correlation coefficient to an approximately normally distributed z-value. The standard error of z was calculated. After appropriate conversion, random effects meta-analyses were used to combine data. The heterogeneity of the z-values among studies was determined by calculating the inconsistency index (I2). I2 greater than 50% indicated the presence of heterogeneity. z-values were converted using inverse Fisher’s transformation to obtain correlation coefficients and 95% CIs to account for results. Sensitivity analysis was performed to explore the when to further explore the source of heterogeneity.
Studies were stratified according to the following characteristics: (1) population characteristics including age (< 18 years, 18–50 years, and > 50 years), gender, and region; (2) characteristics of the reproducibility studies including sample size (≤ 112 and > 112 , the cutoff point was the median of sample size) and time interval between repeated FFQs (≤6 months and > 6 months, the cutoff point was the median of time interval); and (3) characteristics of FFQ design including FFQ items (≤ 120 and > 120, the cutoff point was the median of item), dietary recall interval (≥12 months and < 12 months), administration mode (interviewer-administered or self-administered). All statistical analyses were performed using Stata Software (Version 11.0 Stata, College Station, TX, USA). A P-value less than 0.05 was considered statistically significant.
Literature search and study selection
The flow chart of the study selection is shown in Fig. 1. We identified 2706 original studies from the database. After removing 1256 duplicates, 159 articles met the inclusion criteria according to title and abstract screening. After reading the full texts, 35 articles were excluded according to exclusion criteria. In total, we obtained 123 articles based on the procedure described above.
An overview of the retrieved studies assessing the reproducibility of FFQs is presented in Table 1 (detail information shown in Supplemental Table 1). Of the 123 articles included [4, 10,11,12,13, 15,16,17,18, 20, 21, 23,24,25,26,27,28,29,30,31,32,33,34,35,36,37,38,39,40,41,42,43,44,45,46,47,48,49,50,51,52,53,54,55,56,57,58,59,60,61,62,63,64,65,66,67,68,69,70,71,72,73,74,75,76,77,78,79,80,81,82,83,84,85,86,87,88,89,90,91,92,93,94,95,96,97,98,99,100,101,102,103,104,105,106,107,108,109,110,111,112,113,114,115,116,117,118,119,120,121,122,123,124,125,126,127,128,129,130,131,132,133,134], two articles analyzed differences in different age groups [50, 113], and five articles assessed the differences in reproducibility according to time intervals between repeated FFQs [39, 91, 96, 113, 134]. The extracted information on characteristics of the included studies is summarized in Table 1 (detail information shown in Supplemental Table 1). The median sample size per study was 112 (range: 14–1981), with a total of 20,542 participants. The age range of participants was between 8 and 86 years. The studies were divided into three groups according to age: adult (18–50 years), elderly (> 50 years) and adolescent (< 18 years); these comprised 77, 33, and 15 studies, respectively. For studies with a wide participant age range covering cutoff point, the mean age reported in articles was used as the grouping criterion first. In addition, the median age was used to group population if the mean age was not available. For FFQ characteristics, the median number of FFQ items was 120. The number of studies that required participants to recall food intake for more or less than 12 months was 80 and 33, respectively. Of these studies, 44 were interview-administered, 63 were self-administered, and 16 were not available. Time intervals between FFQs varied considerably (from 1 week to 2.7 years), and studies were classified as less than 6 months (n = 63) or more than 6 months (n = 55).
Correlation coefficients for energy and macronutrients
As shown in Table 2, crude ICCs for reproducibility ranged from 0.499 for starch to 0.803 for alcohol (median: 0.667). All values for energy and macronutrients exceeded 0.5. After adjusting for energy, the range of ICC was between 0.420 (n-3 PUFA) and 0.803 (alcohol) with a median value of 0.630. Energy-adjusted ICCs of most nutrients exceeded 0.5 except those for n-3 PUFA, trans-fat, and soluble fiber. For SCCs, all pooled crude values ranged from 0.548 (plant fat) to 0.851 (alcohol) with a median value of 0.637, and energy-adjusted values ranged from 0.441 (n-6 PUFA) to 0.793 (alcohol) with a median value of 0.580. Most values were decreased after adjusting for energy, except those for lipid and plant fat. All pooled crude SCCs exceeded 0.5; energy-adjusted values exceeded 0.5 except those for n-3 PUFA and n-6 PUFA. Heterogeneity was high for energy and most nutrients in crude and energy-adjusted ICCs and SCCs (I2 > 50%).
Correlation coefficients for micronutrients
Table 3 depicts the reproducibility of the FFQ measurements in terms of pooled ICCs and SCCs for micronutrients. For vitamins, the pooled crude and energy-adjusted ICCs varied from 0.589 (retinol) to 0.723 (vitamin B6) and from 0.512 (carotene) to 0.712 (vitamin B6), respectively; values generally exceeded 0.5. The median crude SCC was 0.613 with a range from 0.573 (retinol) to 0.643 (niacin). The median energy-adjusted SCC was 0.38 with a range from 0.510 (carotene) to 0.658 (vitamin K). For mineral intake, the crude and energy-adjusted ICCs ranged from 0.499 to 0.674 (median: 0.640) and from 0.507 to 0.690 (median: 0.626), respectively; the crude and energy-adjusted SCCs ranged from 0.613 to 0.828 (median: 0.637) and from 0.552 to 0.744 (median: 0.597), respectively. The heterogeneity of correlation coefficients for most micronutrients was high (I2 > 75%).
Subgroup analysis according to age and sex
To assess the impact of age on the degree of reproducibility of two FFQ measures, we performed subgroup analysis according to age (Fig. 2). As shown in Supplemental Table 2, compared with those for adults aged between 18 and 50 years (median: 0.671, range: 0.510–0.793), the ICCs of reproducibility were lower in adolescents (< 18 years) except those for retinol and vitamin D (median: 0.524, range: 0.290–0.730). The median (range) of ICCs for the elderly (> 50 years) was 0.659 (0.482–0.866), which were lower than those for adults for 22 of 40 nutrients. For pooled SCCs (Supplemental Table 3), the median (range) values between repeated measures was 0.646 (0.516–0.837), 0.608 (0.339–0.873), and 0.469 (0.480–0.724) for adults, the elderly, and adolescents, respectively. SCCs were lower in adolescents than in adults for most nutrients except K, Na, and lipid. Values were higher in adults than in the elderly for 34 of 45 nutrients.
Based on subgroup analysis according to sex (Fig. 3), pooled ICCs for estimation of 13 of 28 and pooled SCCs for estimation of 17 of 46 nutrient intake between two measures were higher in men than in women. The median pooled crude ICC was 0.668 (range: 0.489–0.839) and 0.666 (range: 0.410–0.819) for men and women (Supplemental Table 4). Range of SCCs was between 0.374 and 0.872 for men, and between 0.502 and 0.838 for women (Supplemental Table 5).
Subgroup analysis according to region
Subgroup analysis according to region revealed that the ICCs of reproducibility ranged from 0.369 (retinol) to 0.829 (thiamin), 0.560 (Zn) to 0.830 (alcohol), 0.400 (vitamin K) to 0.839 (β-carotene), 0.310 (starch) to 0.859 (lipid), and 0.563 (vitamin D) to 0.861 (alcohol) in the regions of Africa, Oceania, Asia, Europe, and America, respectively (Supplemental Table 6 and Table 7). As shown in Supplemental Table 8 and Table 9, pooled crude SCCs ranged from 0.283 (vitamin B6) to 0.723 (Na) for Africa, 0.514 (vitamin A) to 0.907 (alcohol) for Oceania, 0.537 (lipid) to 0.809 (linolenic acid) for Asia, 0.487 (plant fat) to 0.857 (alcohol) for Europe, and 0.413 (vitamin K) to 0.872 (alcohol) for America.
Factors influencing reproducibility according to study design
The results of pooled ICCs and SCCs for reproducibility stratified according to sample size are presented in Fig. 4. The results of pooled ICCs stratified according to sample size are presented in Supplemental Table 10. The median (range) of ICCs in small (≤112) and large sample sizes (> 112) were 0.678 (0.529–0.818) and 0.636 (0.310–0.764), respectively. The ICCs of reproducibility for small sample sizes were higher than those for large sample size for 30 of 39 nutrients. When SCCs were used to assess the reproducibility of FFQs, the values ranged from 0.482 to 0.855 for large sample sizes. The values for small sample sizes varied from 0.516 to 0.841, which were higher than those of large sample sizes for most nutrients (28/46) (Supplemental Table 11).
The results of analysis of subgroups by interval time between two measures of FFQs is present in Fig. 5. And we found that a median (range) of pooled ICCs of 0.643 (0.518–0.822) for short-term reproducibility and 0.652 (0.485–0.788) for long-term reproducibility (Supplemental Table 12). SCCs ranged from 0.532 to 0.860 and 0.339 to 0.840 for short-term and long-term reproducibility, respectively (Supplemental Table 13). For participants with a shorter period (≤6 months) between completing FFQs, pooled ICCs of energy and most nutrient (24/40) intake were higher than those for longer periods (> 6 months). Higher SCCs were identified for most nutrients (42/48) for assessment of the short-term reliability of FFQs when compared with those for long-term reliability.
In order to assess the influence of seasons on the reproducibility of FFQs, we conducted a subgroup analysis with 12-month interval as cut-point. For the long-term and short-term reproducibility of FFQ, the pooled ICC was from 0.501 to 0.859 (median = 0.676) and from 0.485 to 0.788 (median = 0.643), respectively (Supplemental Table 14). Compared with the reproducibility of FFQs at long time intervals (≥ 12 months), the ICCs of FFQs reproducibility at short intervals were higher (28/40). As shown in Supplemental Table 15, the SCCs of reproducibility of FFQ at long intervals (≥ 12 months) were from 0.339 to 0.848 (median = 0.602) and SCCs of reproducibility of FFQ at short intervals (< 12 months) were from 0.248 to 0.845 (median = 0.632). The SCCs for short-term reproducibility of FFQs were higher for energy and most nutrients (34/49) than long-term reproducibility of FFQs.
Factors influencing reproducibility according to FFQ design
The results of subgroup analyses according to items of FFQ are presented in Fig. 6. For FFQ items, the pooled ICCs between two measures of FFQs with many items (> 120) varied from 0.512 to 0.825, whereas values of FFQs with small items (≤120) ranged from 0.310 to 0.764 (Supplemental Table 16). The pooled SCCs of long FFQs varied from 0.555 to 0.85, while the values of short FFQs ranged from 0.469 to 0.851 (Supplemental Table 17). Compared with those of short FFQs, pooled ICCs and SCCs of long FFQs were higher for 38 of 39 nutrients and 43 of 49 nutrients, respectively.
ICCs and SCCs for reproducibility stratified according to dietary recall interval are presented in Fig. 7. The median ICC values were 0.659 (range: 0.557–0.836) for long-term FFQs (≥12 months) and 0.622 (range: 0.310–0.854) for short-term FFQs (< 12 months). SCCs ranged from 0.522 to 0.847 and 0.494 to 0.838 for long-term and short-term FFQs, respectively. The combined ICCs of 24/38 nutrients and SCCs of 20/42 nutrients between repeated long-term FFQs were higher than those for short-term FFQs (Supplemental Table 18 and Table 19).
Figure 8 present the difference of correlations between self-administered and interviewer-administered FFQs. Pooled ICCs ranged from 0.530 to 0.811 and 0.502 to 0.826 for the reproducibility of self-administered FFQs and interviewer-administered FFQs, respectively (Supplemental Table 20). In total, values for 17/39 nutrients were higher for self-administered FFQs than for interviewer-administered FFQs. SCCs for the reproducibility of self-administered FFQs (range: 0.553–0.874) were higher than those for interviewer-administered FFQs (range: 0.482–0.761) for 37 of 43 nutrients (Supplemental Table 21).
In the present study, we conducted a meta-analysis to systematically assess the reproducibility of FFQs and to explore the factors related to the reproducibility of FFQs. And the pooled ICCs and SCCs were found exceeded 0.5 for energy and most nutrients in general heathy populations. For the elderly and adolescents, pooled ICCs and SCCs for most nutrients were lower than those in adults (18–50 years old). In terms of energy and 24 macronutrients, all ICC and SCC values exceeded 0.5, except for I, soluble fiber, trans-fat, n-3 PUFA, and n-6 PUFA. Moreover, we identified that FFQs with more food items, 12 months as dietary recall interval, and shorter time periods between repeated FFQs resulted in superior FFQ reproducibility.
To evaluate the ability of FFQs to accurately evaluate long-term dietary intake in different age groups, we conducted subgroup analysis according to age which revealed that the correlations of the reproducibility of FFQs exceeded 0.5 for most nutrients in the elderly, adolescents, and adults, indicating that the reliability of FFQs was relatively consistent across age groups. However, the reproducibility of FFQs for adults was higher than that for the elderly and adolescents for most nutrients. A potential reason for the lower correlation in adolescents was that older individuals may have more established dietary habits than younger individuals . Further, in adolescents, it is more challenging to assess dietary intake levels, particularly for cooking-related ingredients such as spices , and to understand abstract concepts of average intake, particularly for seasonal food such as fruits , although the ability to self-report food intake in adolescents improves rapidly from 8 years of age . Compared with that in adults, the reproducibility of FFQs in the elderly tended to be poor. Although the elderly have a relatively stable dietary intake, a decline in memory or cognitive function may have contributed to the tendency for poor reproducibility in the elderly .
Gender differences in the reproducibility of FFQs were observed in this study. The degree of reproducibility was generally higher in women than in men for most nutrients, suggesting that women have more stable long-term dietary intake than that of men . Generally, women pay more attention to food intake and cook more often , which may contribute to the higher reproducibility of FFQs in women.
In addition, we observed that the reproducibility of FFQ was low when the sample size was large. This low correlation was not the true reproducibility coefficients between FFQs, but might be caused by irrelevant factors in the operation process. As the large sample sizes may facilitate the management of more participants; consume time, resources, and effort; induce loss to follow-up and put a burden on researchers. However, a small sample size may limit representativeness, which induces large differences in within-person nutrient intakes, leading to less reliable correlation coefficients and ICCs . Therefore, when conducting FFQ reproducibility research, a sample size with sufficient statistical power is recommended to ensure reproducibility of FFQs, rather than increasing sample size blindly.
FFQs with more items presented better reproducibility for most nutrients, indicating that long FFQs collated more reliable information  and enabled better estimations of dietary and nutrient consumption . However, participants require more time to accurately complete the questionnaire and may lose patience, leading to potential biases and, ultimately, data of lower quality . Therefore, to balance reporting errors and reproducibility of FFQs, pilot studies should be performed to explore the appropriate number of FFQ items based on the demographic characteristics of participants.
FFQs were used to assess regular dietary habits over extended periods. The correlation coefficients of the study assessing the reproducibility of FFQs over more than a 1-year period were higher than those over short periods for most nutrients. Relatively high correlations for 1 year indicated that FFQs can provide an accurate estimation of long-term dietary habits. The reasons for lower correlations of FFQs over less than 1 year may be related to the seasonal availability of food . In addition, it is useful for researchers to assess the complete dietary intake of participants with 1 year as the reference time for FFQs .
The combined correlation coefficients were higher when FFQs were administered over a short period (≤6 months) compared with those over a long time interval (> 6 months), suggesting that shorter intervals between repeated FFQ administrations were a key factor contributing to high reproducibility of FFQs, in accordance with a previous review . A possible explanation for the higher correlations for short-term reproducibility is that it is easier for respondents to remember and replicate their previous FFQ responses accurately when two FFQs are administered closely in time . The difference between the two subgroups may also be because of changes in diet over time . The lower correlation of long-term reproducibility suggested that the participants’ usual intake of food may have changed during the study period . Because food intake also exhibits yearly trends [138, 139], longer intervals between repeated FFQs were selected to avoid the effects of seasonal or yearly variations in diet . Therefore, before selecting intervals between repeated FFQs, memory bias and seasonal changes in diet should be taken into consideration.
The main strength of this study is that it is the first meta-analysis to comprehensively analyze FFQ reproducibility. Current research is based on a large number of different populations with a wide age range which revealed good reproducibility of nutrient intake, making FFQs suitable for analyzing dietary intake among different subgroups of age, sample size, gender, and region. We comprehensively evaluated the reproducibility of FFQs by analyzing the intake of 50 nutrients, which strengthened the conclusions of this study.
This study has some limitations. First, our screening criteria excluded articles that assessed the effectiveness of specific nutrients, which may have affected our results in different ways. Second, learning ability and lifestyles, such as education level and body mass index, may have influenced FFQ reliability. However, the relevant data were not available in the included articles. Third, we did not evaluate the quality of included studies because there are currently no tools to assess the quality of reproducibility studies for FFQs. Further studies are needed to establish such tools to evaluate the quality of reproducibility studies for FFQ.
In conclusion, FFQs with correlation coefficients greater than 0.5 for most nutrients may be considered a reliable tool to measure dietary intake. In addition, factors related to FFQ design may be associated with the reproducibility of FFQs, such as FFQ items and dietary recall intervals. To increase the reproducibility of FFQs, the following points should be considered before developing FFQs. First, pilot studies are warranted to explore the appropriate number of FFQ items based on the characteristics of the study population. Second, 12 months is suggested as the dietary recall interval. Third, when performing reproducibility studies for FFQs, a sample size with sufficient statistical power, but no larger, is recommended.
Availability of data and materials
- I2 :
Spearman correlation coefficients
Shim JS, Oh K, Kim HC. Dietary assessment methods in epidemiologic studies. Epidemiol Health. 2014;36:e2014009.
Cade J, Thompson R, Burley V, Warm D. Development, validation and utilisation of food-frequency questionnaires - a review. Public Health Nutr. 2002;5:567–87.
Kaaks R, Slimani N, Riboli E. Pilot phase studies on the accuracy of dietary intake measurements in the EPIC project: overall evaluation of results. European Prospective Investigation into Cancer and Nutrition. Int J Epidemiol. 1997;26(Suppl 1):S26–36.
Franceschi S, Barbone F, Negri E, Decarli A, Ferraroni M, Filiberti R, Giacosa A, Gnagnarella P, Nanni O, Salvini S, et al. Reproducibility of an Italian food frequency questionnaire for cancer studies. Results for specific nutrients. Ann Epidemiol. 1995;5:69–75.
Kaaks R, Slimani N, Riboli E. Temporal change in the reproducibility of a self-administered food frequency questionnaire. Int J Epidemiol. 1997;26(Suppl 1):S26–36.
Nagata C, Ohwaki A, Kurisu Y, Shimizu H. Food diversity and validity of semiquantitative food frequency questionnaire. J Epidemiol. 1998;8:297–301.
Cade JE, Burley VJ, Warm DL, Thompson RL, Margetts BM. Food-frequency questionnaires: a review of their design, validation and utilisation. Nutr Res Rev. 2004;17:5–22.
Tsubono Y, Nishino Y, Fukao A, Hisamichi S, Tsugane S. Temporal change in the reproducibility of a self-administered food frequency questionnaire. Am J Epidemiol. 1995;142:1231–5.
Shrestha A, Koju RP, Beresford SAA, Chan KCG, Connell FA, Karmacharya BM, Shrestha P, Fitzpatrick AL. Reproducibility and relative validity of food group intake in a food frequency questionnaire developed for Nepalese diet. Int J Food Sci Nutr. 2017;68:605–12.
Turconi G, Bazzano R, Roggi C, Cena H. Reliability and relative validity of a quantitative food-frequency questionnaire for use among adults in Italian population. Int J Food Sci Nutr. 2010;61:846–62.
Li K, Takezaki T, Lv LW, Yu P, Song FY, Tajima K. Reproducibility of a semi-quantitative food frequency questionnaire in Chaoshan area, China. Asian Pac J Cancer Prev. 2005;6:521–6.
Hebden L, Kostan E, O'Leary F, Hodge A, Allman-Farinelli M. Validity and reproducibility of a food frequency questionnaire as a measure of recent dietary intake in young adults. PLoS One. 2013;8:e75156.
Takachi R, Ishihara J, Iwasaki M, Hosoi S, Ishii Y, Sasazuki S, Sawada N, Yamaji T, Shimazu T, Inoue M, Tsugane S. Validity of a self-administered food frequency questionnaire for middle-aged urban cancer screenees: comparison with 4-day weighed dietary records. J Epidemiol. 2011;21:447–58.
Silva NF, Sichieri R, Pereira RA, Silva RM, Ferreira MG. Reproducibility, relative validity and calibration of a food frequency questionnaire for adults. Cadernos de saude publica. 2013;29:1783–94.
Zhuang M, Yuan Z, Lin L, Hu B, Wang X, Yang Y, Chen X, Jin L, Lu M, Ye W. Reproducibility and relative validity of a food frequency questionnaire developed for adults in Taizhou, China. PloS one. 2012;7:e48341.
Zang J, Luo B, Chang S, Jin S, Shan C, Ma L, Zhu Z, Guo C, Zou S, Jia X, Wu F. Validity and reliability of a food frequency questionnaire for assessing dietary intake among Shanghai residents. Nutr J. 2019;18:30.
Marshall SJ, Livingstone KM, Celis-Morales C, Forster H, Fallaize R, O'Donovan CB, Woolhead C, Marsaux CF, Macready AL, Navas-Carretero S, et al. Reproducibility of the online Food4Me food-frequency questionnaire for estimating dietary intakes across Europe. J Nutr. 2016;146:1068–75.
Tijerina A, Tur JA. Development and validation of a Semiquantitative food frequency questionnaire to assess dietary intake in 40-65-year-old Mexican women. Ann Nutr Metabol. 2020;76:73–82.
El Kinany K, Garcia-Larsen V, Khalis M, Deoula MMS, Benslimane A, Ibrahim A, Benjelloun MC, El Rhazi K. Adaptation and validation of a food frequency questionnaire (FFQ) to assess dietary intake in Moroccan adults. Nutr J. 2018;17:61.
Sam CHY, Skidmore P, Skeaff S, Wall C, Bradbury KE, Parackal S. Relative validity and reproducibility of a short FoodFrequency questionnaire to assess nutrient Intakesof New Zealand adults. Nutrients. 2020;12:619.
Tsubono Y, Kobayashi M, Sasaki S, Tsugane S, JPHC. Validity and reproducibility of a self-administered food frequency questionnaire used in the baseline survey of the JPHC study cohort I. J Epidemiol. 2003;13:S125–33.
Xing X, Burr JA, Brasure JR, Neugut AI, Marshall JR. Reproducibility of nutrient intake in a food frequency questionnaire used in a general population. Nutr Cancer. 1996;25:259–68.
Jackson MD, Motswagole BS, Kwape LD, Kobue-Lekalake RI, Rakgantswana TB, Mongwaketse T, Mokotedi M, Jackson-Malete J. Validation and reproducibility of an FFQ for use among adults in Botswana. Public Health Nutr. 2013;16:1995–2004.
Ahn Y, Kwon E, Shim JE, Park MK, Joo Y, Kimm K, Park C, Kim DH. Validation and reproducibility of food frequency questionnaire for Korean genome epidemiologic study. Eur J Clin Nutr. 2007;61:1435–41.
Hong TK, Dibley MJ, Sibbritt D. Validity and reliability of an FFQ for use with adolescents in Ho Chi Minh City, Vietnam. Public Health Nutr. 2010;13:368–75.
Bae YJ, Choi HY, Sung MK, Kim MK, Choi MK. Validity and reproducibility of a food frequency questionnaire to assess dietary nutrients for prevention and management of metabolic syndrome in Korea. Nutr Res Pract. 2010;4:121–7.
Barrat E, Aubineau N, Maillot M, Derbord E, Barthes P, Lescuyer JF, Boisseau N, Peltier SL. Repeatability and relative validity of a quantitative food-frequency questionnaire among French adults. Food Nutr Res. 2012;56:18472.
Bjerregaard AA, Tetens I, Olsen SF, Halldorsson TI. Reproducibility of a web-based FFQ for 13- to 15-year-old Danish adolescents. J Nutrit Sci. 2016;5:e5.
Bohlscheid-Thomas S, Hoting I, Boeing H, Wahrendorf J. Reproducibility and relative validity of energy and macronutrient intake of a food frequency questionnaire developed for the German part of the EPIC project. European Prospective Investigation into Cancer and Nutrition. Int J Epidemiol. 1997;26(Suppl 1):S71–81.
Boucher B, Cotterchio M, Kreiger N, Nadalin V, Block T, Block G. Validity and reliability of the Block98 food-frequency questionnaire in a sample of Canadian women. Public Health Nutr. 2006;9:84–93.
Zhang CX, Ho SC. Validity and reproducibility of a food frequency questionnaire among Chinese women in Guangdong province. Asia Pac J Clin Nutr. 2009;18:240–50.
Cantin J, Latour E, Ferland-Verry R, Morales Salgado S, Lambert J, Faraj M, Nigam A. Validity and reproducibility of a food frequency questionnaire focused on the Mediterranean diet for the Quebec population. Nutr Metab Cardiovasc Dis. 2016;26:154–61.
Cardoso MA. Reproducibility and validity of a food frequency questionnaire among women of Japanese ancestry living in Brazil; 2001.
Collins CE, Boggess MM, Watson JF, Guest M, Duncanson K, Pezdirc K, Rollo M, Hutchesson MJ, Burrows TL. Reproducibility and comparative validity of a food frequency questionnaire for Australian adults. Clin Nutr. 2014;33:906–14.
Dehghan M, del Cerro S, Zhang X, Cuneo JM, Linetzky B, Diaz R, Merchant AT. Validation of a semi-quantitative food frequency questionnaire for Argentinean adults. PLoS One. 2012;7:e37958.
Dehghan M, Ilow R, Zatonska K, Szuba A, Zhang X, Mente A, Regulska-Ilow B. Development, reproducibility and validity of the food frequency questionnaire in the Poland arm of the prospective urban and rural epidemiological (PURE) study. J Hum Nutr Diet. 2012;25:225–32.
Deschamps V, de Lauzon-Guillain B, Lafay L, Borys JM, Charles MA, Romon M. Reproducibility and relative validity of a food-frequency questionnaire among French adults and adolescents. Eur J Clin Nutr. 2009;63:282–91.
Doustmohammadian A, Amini M. Validity and reliability of a dish-based semi-quantitative food frequency questionnaire for assessment of energy and nutrient intake among Iranian adults, vol. 13; 2020. p. 95.
Dumartheray EW, Krieg MA, Cornuz J, Whittamore DR, Lovell DP, Burckhardt P, Lanham-New SA. Validation and reproducibility of a semi-quantitative food frequency questionnaire for use in elderly Swiss women. J Hum Nutr Diet. 2006;19:321–30.
Egami I, Wakai K, Kato K, Lin Y, Kawamura T, Tamakoshi A, Aoki R, Kojima M, Nakayama T, Wada M, Ohno Y. A simple food frequency questionnaire for Japanese diet--part II. Reproducibility and validity for nutrient intakes. J Epidemiol. 1999;9:227–34.
El Kinany K, Garcia-Larsen V. Adaptation and validation of a food frequency questionnaire (FFQ) to assess dietary intake in Moroccan adults, vol. 17; 2018. p. 61.
Elorriaga N, Irazola VE, Defagó MD, Britz M, Martínez-Oakley SP, Witriw AM, Rubinstein AL. Validation of a self-administered FFQ in adults in Argentina, Chile and Uruguay. Public Health Nutr. 2015;18:59–67.
Engle A, Lynn LL, Koury K, Boyar AP. Reproducibility and comparability of a computerized, self-administered food frequency questionnaire. Nutr J. 1990;13:281–92.
Fallaize R, Forster H. Online dietary intake estimation: reproducibility and validity of the Food4Me food frequency questionnaire against a 4-day weighed food record. J Med Internet Res. 2014;16:e190.
Fernández-Ballart JD, Piñol JL, Zazpe I, Corella D, Carrasco P, Toledo E, Perez-Bauer M, Martínez-González MA, Salas-Salvadó J, Martín-Moreno JM. Relative validity of a semi-quantitative food-frequency questionnaire in an elderly Mediterranean population of Spain. Br J Nutr. 2010;103:1808–16.
Field AE, Peterson KE, Gortmaker SL, Cheung L, Rockett H, Fox MK, Colditz GA. Reproducibility and validity of a food frequency questionnaire among fourth to seventh grade inner-city school children: implications of age and day-to-day variation in dietary intake. Public Health Nutr. 1999;2:293–300.
Filippi AR, Amodio E, Napoli G, Breda J, Bianco A, Jemni M, Censi L, Mammina C, Tabacchi G. The web-based ASSO-food frequency questionnaire for adolescents: relative and absolute reproducibility assessment. Clin Nutr Res. 2014;13:119.
Flagg EW, Coates RJ, Calle EE, Potischman N, Thun MJ. Validation of the American Cancer Society Cancer Prevention Study II Nutrition Survey Cohort Food Frequency Questionnaire. Epidemiology. 2000;11:462–8.
Friis S, Kruger Kjaer S, Stripp C, Overvad K. Reproducibility and relative validity of a self-administered semiquantitative food frequency questionnaire applied to younger women. J Clin Epidemiol. 1997;50:303–11.
Gilsing A, Mayhew AJ, Payette H, Shatenstein B, Kirkpatrick SI, Amog K, Wolfson C, Kirkland S, Griffith LE, Raina P. Validity and reliability of a short diet questionnaire to estimate dietary intake in older adults in a subsample of the Canadian longitudinal study on aging. Nutrients. 2018;10:1522.
Gnardellis C, Trichopoulou A, Katsouyanni K, Polychronopoulos E, Rimm EB, Trichopoulos D. Reproducibility and validity of an extensive semiquantitative food frequency questionnaire among Greek school teachers. Epidemiology. 1995;6:74–7.
Goulet J, Nadeau G, Lapointe A, Lamarche B, Lemieux S. Validity and reproducibility of an interviewer-administered food frequency questionnaire for healthy French-Canadian men and women. Nutr J. 2004;3:13.
Hernández-Avila M, Romieu I, Parra S, Hernández-Avila J, Madrigal H, Willett W. Validity and reproducibility of a food frequency questionnaire to assess dietary intake of women living in Mexico City. Salud publica de Mexico. 1998;40:133–40.
Ibiebele TI, Parekh S, Mallitt KA, Hughes MC, O’Rourke PK, Webb PM. Australian ovarian Cancer study G, the Australian Cancer S: reproducibility of food and nutrient intake estimates using a semi-quantitative FFQ in Australian adults. Public Health Nutr. 2009;12:2359–65.
Imaeda N, Goto C, Tokudome Y, Hirose K, Tajima K, Tokudome S. Reproducibility of a short food frequency questionnaire for Japanese general population. J Epidemiol. 2007;17:100–7.
Iqbal R, Ajayan K, Bharathi AV, Zhang X, Islam S, Soman CR, Merchant AT. Refinement and validation of an FFQ developed to estimate macro- and micronutrient intakes in a south Indian population. Public Health Nutr. 2009;12:12–8.
Ishihara J, Sobue T, Yamamoto S, Yoshimi I, Sasaki S, Kobayashi M, Takahashi T, Iitoi Y, Akabane M, Tsugane S. Validity and reproducibility of a self-administered food frequency questionnaire in the JPHC study cohort II: study design, participant profile and results in comparison with cohort I. J Epidemiol. 2003;13:S134–47.
Ishihara J, Iwasaki M, Kunieda CM, Hamada GS, Tsugane S. Food frequency questionnaire is a valid tool in the nutritional assessment of Brazilian women of diverse ethnicity. Asia Pac J Clin Nutr. 2009;18:76–80.
Jackson M, Walker S, Cade J, Forrester T, Cruickshank JK, Wilks R. Reproducibility and validity of a quantitative food-frequency questionnaire among Jamaicans of African origin. Public Health Nutr. 2001;4:971–80.
Jackson MD, Walker SP, Younger NM, Bennett FI. Use of a food frequency questionnaire to assess diets of Jamaican adults: validation and correlation with biomarkers. Nutr J. 2011;10:28.
Esmaillzadeh A, Omidvar N, Abtahi M, Dadkhah-Piraghaj M, Nikooyeh B, Neyestani TR, Jain MG, Rohan TE, Soskolne CL, Kreiger N. Calibration of the dietary questionnaire for the Canadian study of diet, lifestyle and health cohort. BMC Res Notes. 2003;6:79–86.
Johansson I, Hallmans G, Wikman A, Biessy C, Riboli E, Kaaks R. Validation and calibration of food-frequency questionnaire measurements in the northern Sweden health and disease cohort. Public Health Nutr. 2002;5:487–96.
Johansson L, Solvoll K, Opdahl S, Bjørneboe GE, Drevon CA. Response rates with different distribution methods and reward, and reproducibility of a quantitative food frequency questionnaire. Eur J Clin Nutr. 1997;51:346–53.
Teixeira JA, Baggio ML, Giuliano AR, Fisberg RM, Marchioni DM. Performance of the quantitative food frequency questionnaire used in the Brazilian center of the prospective study natural history of human papillomavirus infection in men: the HIM study. J Am Diet Assoc. 2011;111:1045–51.
Katsouyanni K, Rimm EB, Gnardellis C, Trichopoulos D, Polychronopoulos E, Trichopoulou A. Reproducibility and relative validity of an extensive semi-quantitative food frequency questionnaire using dietary records and biochemical markers among Greek schoolteachers. Int J Epidemiol. 1997;26(Suppl 1):S118–27.
Kesse-Guyot E, Castetbon K, Touvier M, Hercberg S, Galan P. Relative validity and reproducibility of a food frequency questionnaire designed for French adults. Ann Nutr Metabol. 2010;57:153–62.
Kim DW, Song S, Lee JE, Oh K, Shim J, Kweon S, Paik HY, Joung H. Reproducibility and validity of an FFQ developed for the Korea National Health and nutrition examination survey (KNHANES). Public Health Nutr. 2015;18:1369–77.
Kristal AR, Kolar AS, Fisher JL, Plascak JJ, Stumbo PJ, Weiss R, Paskett ED. Evaluation of web-based, self-administered, graphical food frequency questionnaire. J Acad Nutr Diet. 2014;114:613–21.
Labonté M, Cyr A, Baril-Gravel L, Royer MM, Lamarche B. Validity and reproducibility of a web-based, self-administered food frequency questionnaire. Eur J Clin Nutr. 2012;66:166–73.
Lazarus R, Wilson A, Gliksman M, Aiken J. Repeatability of nutrient intakes estimated by a semiquantitative food frequency questionnaire in elderly subjects. Ann Epedimiol. 1995;5:65–8.
Lee Y, Park K. Reproducibility and validity of a semi-quantitative FFQ for trace elements. Br J Nutr. 2016;116:864–73.
Lee MS, Pan WH, Liu KL, Yu MS. Reproducibility and validity of a Chinese food frequency questionnaire used in Taiwan. Asia Pac J Clin Nutr. 2006;15:161–9.
Leon Guerrero RT, Chong M, Novotny R, Wilkens LR, Badowski G, Blas-Laguana M, Murphy S. Relative validity and reliability of a quantitative food frequency questionnaire for adults in Guam. Food Nutr Res. 2015;59:26276.
Longnecker MP, Lissner L, Holden JM, Flack VF, Taylor PR, Stampfer MJ, Willett WC. The reproducibility and validity of a self-administered semiquantitative food frequency questionnaire in subjects from South Dakota and Wyoming. Epidemiology. 1993;4:356–65.
Lyu LC, Lin CF, Chang FH, Chen HF, Lo CC, Ho HF. Meal distribution, relative validity and reproducibility of a meal-based food frequency questionnaire in Taiwan. Asia Pac J Clin Nutr. 2007;16:766–76.
Macedo-Ojeda G, Vizmanos-Lamotte B, Márquez-Sandoval YF, Rodríguez-Rocha NP, López-Uriarte PJ, Fernández-Ballart JD. Validation of a semi-quantitative food frequency questionnaire to assess food groups and nutrient intake. Nutricion Hospitalaria. 2013;28:2212–20.
MacIntyre UE, Venter CS, Vorster HH. A culture-sensitive quantitative food frequency questionnaire used in an African population: 1. Development and reproducibility. Public Health Nutr. 2001;4:53–62.
Malekshah AF, Kimiagar M, Saadatian-Elahi M, Pourshams A, Nouraie M, Goglani G, Hoshiarrad A, Sadatsafavi M, Golestan B, Yoonesi A, et al. Validity and reliability of a new food frequency questionnaire compared to 24 h recalls and biochemical measurements: pilot phase of Golestan cohort study of esophageal cancer. Eur J Clin Nutr. 2006;60:971–7.
Männistö S, Virtanen M, Mikkonen T, Pietinen P. Reproducibility and validity of a food frequency questionnaire in a case-control study on breast cancer. J Clin Epidemiol. 1996;49:401–9.
Overby NC, Johannesen E, Jensen G, Skjaevesland AK, Haugen M. Test-retest reliability and validity of a web-based food-frequency questionnaire for adolescents aged 13-14 to be used in the Norwegian mother and child cohort study (MoBa). Food Nutr Res. 2014;58:23956.
Marchioni DM, Voci SM, Lima FE, Fisberg RM, Slater B. Reproducibility of a food frequency questionnaire for adolescents. Cadernos de saude publica. 2007;23:2187–96.
Marques-Vidal P, Ross A, Wynn E, Rezzi S, Paccaud F, Decarli B. Reproducibility and relative validity of a food-frequency questionnaire for French-speaking Swiss adults. Food Nutr Res. 2011;55:5905.
Martinez MF, Philippi ST, Estima C, Leal G. Validity and reproducibility of a food frequency questionnaire to assess food group intake in adolescents. Cadernos de saude publica. 2013;29:1795–804.
Martin-Moreno JM, Boyle P, Gorgojo L, Maisonneuve P, Fernandez-Rodriguez JC, Salvini S, Willett WC. Development and validation of a food frequency questionnaire in Spain. Int J Epidemiol. 1993;22:512–9.
Maruyama K, Kokubo Y, Yamanaka T, Watanabe M, Iso H, Okamura T, Miyamoto Y. The reasonable reliability of a self-administered food frequency questionnaire for an urban, Japanese, middle-aged population: the Suita study. Nutr Res. 2015;35:14–22.
Marventano S, Mistretta A, Platania A, Galvano F, Grosso G. Reliability and relative validity of a food frequency questionnaire for Italian adults living in Sicily, southern Italy. Int J Food Sci Nutr. 2016;67:857–64.
McPherson RS, Kohl HW 3rd, Garcia G, Nichaman MZ, Hanis CL. Food-frequency questionnaire validation among Mexican-Americans: Starr County, Texas. Ann Epedimiol. 1995;5:378–85.
Messerer M, Johansson SE, Wolk A. The validity of questionnaire-based micronutrient intake estimates is increased by including dietary supplement use in Swedish men. J Nutr. 2004;134:1800–5.
Mirmiran P, Esfahani FH, Mehrabi Y, Hedayati M, Azizi F. Reliability and relative validity of an FFQ for nutrients in the Tehran lipid and glucose study. Public Health Nutr. 2010;13:654–62.
Morris MC, Tangney CC, Bienias JL, Evans DA, Wilson RS. Validity and reproducibility of a food frequency questionnaire by cognition in an older biracial sample. Am J Epidemiol. 2003;158:1213–7.
Ocké MC, Bueno-de-Mesquita HB, Pols MA, Smit HA, van Staveren WA, Kromhout D. The Dutch EPIC food frequency questionnaire. II. Relative validity and reproducibility for nutrients. Int J Epidemiol. 1997;26(Suppl 1):S49–58.
Ogawa K, Tsubono Y, Nishino Y, Watanabe Y, Ohkubo T, Watanabe T, Nakatsuka H, Takahashi N, Kawamura M, Tsuji I, Hisamichi S. Validation of a food-frequency questionnaire for cohort studies in rural Japan. Public Health Nutr. 2003;6:147–57.
Palacios C, Trak MA, Betancourt J, Joshipura K, Tucker KL. Validation and reproducibility of a semi-quantitative FFQ as a measure of dietary intake in adults from Puerto Rico. Public Health Nutr. 2015;18:2550–8.
Park MK, Noh HY, Song NY, Paik HY, Park S, Joung H, Song WO, Kim J. Validity and reliability of a dish-based, semi-quantitative food frequency questionnaire for Korean diet and cancer research. Asian Pac J Cancer Prev. 2012;13:545–52.
Preston AM, Palacios C, Rodríguez CA, Vélez-Rodríguez RM. Validation and reproducibility of a semi-quantitative food frequency questionnaire for use in Puerto Rican children. P R Health Sci J. 2011;30:58–64.
Riboli E, Toniolo P, Kaaks R, Shore RE, Casagrande C, Pasternack BS. Reproducibility of a food frequency questionnaire used in the New York University Women's health study: effect of self-selection by study subjects. Eur J Clin Nutr. 1997;51:437–42.
Rifas-Shiman SL, Willett WC, Lobb R, Kotch J, Dart C, Gillman MW. PrimeScreen, a brief dietary screening tool: reproducibility and comparability with both a longer food frequency questionnaire and biomarkers. Public Health Nutr. 2001;4:249–54.
Rimm EB, Giovannucci EL, Stampfer MJ, Colditz GA, Litin LB, Willett WC. Reproducibility and validity of an expanded self-administered semiquantitative food frequency questionnaire among male health professionals. Am J Epidemiol. 1992;135:1114–26 discussion 1127-1136.
Rockett HR, Wolf AM, Colditz GA. Development and reproducibility of a food frequency questionnaire to assess diets of older children and adolescents. J Am Diet Assoc. 1995;95:336–40.
Rodriguez CA, Smith ER, Villamor E, Zavaleta N, Respicio-Torres G, Contreras C, Perea S, Jimenez J, Tintaya K, Lecca L, et al. Development and validation of a food frequency questionnaire to estimate intake among children and adolescents in urban Peru. Nutrients. 2017;9:1121.
Salvesen L, Hillesund ER, Vik FN, Brantsæter AL. Reproducibility and relative validity of a newly developed web-based food-frequency questionnaire for assessment of preconception diet. BMC Nutr. 2019;5:47.
Sam CH, Skeaff S, Skidmore PM. A comprehensive FFQ developed for use in New Zealand adults: reliability and validity for nutrient intakes. Public Health Nutr. 2014;17:287–96.
Sasaki S, Ishihara J, Tsugane S. Reproducibility of a self-administered food frequency questionnaire used in the 5-year follow-up survey of the JPHC study cohort I to assess food and nutrient intake. J Epidemiol. 2003;13:S115–24.
Sanjeevi N, Freeland-Graves J, George GC. Relative validity and reliability of a 1-week, semiquantitative food frequency questionnaire for women participating in the supplemental nutrition assistance program. J Acad Nutr Diet. 2017;117:1972–1982.e1972.
Schröder H, Covas MI, Marrugat J, Vila J, Pena A, Alcántara M, Masiá R. Use of a three-day estimated food record, a 72-hour recall and a food-frequency questionnaire for dietary assessment in a Mediterranean Spanish population. Clin Nutr. 2001;20:429–37.
Selem SS, Carvalho AM, Verly-Junior E, Carlos JV, Teixeira JA, Marchioni DM, Fisberg RM. Validity and reproducibility of a food frequency questionnaire for adults of São Paulo, Brazil. Rev Braz Epidemiol. 2014;17:852–9.
Shimizu H, Ohwaki A, Kurisu Y, Takatsuka N, Ido M, Kawakami N, Nagata C, Inaba S. Validity and reproducibility of a quantitative food frequency questionnaire for a cohort study in Japan. Jpn J Clin Oncol. 1999;29:38–44.
Shu XO, Yang G, Jin F, Liu D, Kushi L, Wen W, Gao YT, Zheng W. Validity and reproducibility of the food frequency questionnaire used in the Shanghai Women's health study. Eur J Clin Nutr. 2004;58:17–23.
Silva-Jaramillo KM, Neutzling MB, Drehmer M. FFQ for the adult population of the capital of Ecuador (FFQ-Quito): development, reliability and validity. Public Health Nutr. 2015;18:2540–9.
Sudha V, Radhika G, Sathya RM, Ganesan A, Mohan V. Reproducibility and validity of an interviewer-administered semi-quantitative food frequency questionnaire to assess dietary intake of urban adults in southern India. Int J Food Sci Nutr. 2006;57:481–93.
Tang Y, Liu Y, Xu L, Jia Y, Shan D, Li W, Pan X, Kang D, Huang C, Li X, et al. Validity and reproducibility of a revised semi-quantitative food frequency questionnaire (SQFFQ) for women of age-group 12-44 years in Chengdu. J Health Popul Nutr. 2015;33:50–9.
Tollosa DN, Van Camp J, Huybrechts I, Huybregts L, Van Loco J, De Smet S, Sterck E, Rabâi C, Van Hecke T, Vanhaecke L, et al. Validity and reproducibility of a food frequency questionnaire for dietary factors related to colorectal Cancer. Int J Environ Res Public Health. 2017;9:1257.
Tavani A, Negri E, Ferraroni M, D’Avanzo B, Decarli A, Giacosa A, La Vecchia C, Nanni O, Parpinel MT, Salvini S, et al. Influence of some covariates on the reproducibility of an Italian semi-quantitative food frequency questionnaire. Eur J Cancer Prev. 1995;4:319–27.
Villegas R, Yang G, Liu D, Xiang YB, Cai H, Zheng W, Shu XO. Validity and reproducibility of the food-frequency questionnaire used in the Shanghai men's health study. Br J Nutr. 2007;97:993–1000.
Watanabe M, Yamaoka K, Yokotsuka M, Adachi M, Tango T. Validity and reproducibility of the FFQ (FFQW82) for dietary assessment in female adolescents. Public Health Nutr. 2011;14:297–305.
Watson JF, Collins CE, Sibbritt DW, Dibley MJ, Garg ML. Reproducibility and comparative validity of a food frequency questionnaire for Australian children and adolescents. Int J Behav Nutr Phys Act. 2009;6:62.
Whitton C, Ho JCY, Tay Z, Rebello SA, Lu Y, Ong CN, van Dam RM. Relative validity and reproducibility of a food frequency questionnaire for assessing dietary intakes in a multi-ethnic Asian population using 24-h dietary recalls and biomarkers. Nutrients. 2017;9:1059.
Willett WC, Sampson L, Stampfer MJ, Rosner B, Bain C, Witschi J, Hennekens CH, Speizer FE. Reproducibility and validity of a semiquantitative food frequency questionnaire. Am J Epidemiol. 1985;122:51–65.
Vereecken CA, De Bourdeaudhuij I, Maes L. The HELENA online food frequency questionnaire: reproducibility and comparison with four 24-h recalls in Belgian-Flemish adolescents. Eur J Clin Nutr. 2010;64:541–8.
Xia W, Sun C, Zhang L, Zhang X, Wang J, Wang H, Wu L. Reproducibility and relative validity of a food frequency questionnaire developed for female adolescents in Suihua, North Carolina. J Nutr Gerontol Geriatr. 2011;6:e19656.
Zaragoza-Martí A, Ferrer-Cascales R, Hurtado-Sánchez JA, Laguna-Pérez A, Cabañero-Martínez MJ. Cross-cultural adaptation, validity, and reproducibility of the Mediterranean Islands study food frequency questionnaire in the elderly population living in the Spanish Mediterranean. Nutrients. 2018;10:1206.
Xu L, Dibley MJ, D’Este C. Reliability and validity of a food-frequency questionnaire for Chinese postmenopausal women. Public Health Nutr. 2004;7:91–8.
Yum J, Lee S. Development and evaluation of a dish-based semiquantitative food frequency questionnaire for Korean adolescents. Nutr Res Pract. 2016;10:433–41.
Zhang M, Binns CW, Lee AH. A quantitative food frequency questionnaire for women in Southeast China: development and reproducibility. Nutr Dietet. 2005;17:29–35.
Ye Q, Hong X, Wang Z, Yang H, Chen X, Zhou H, Wang C, Lai Y, Sun L, Xu F. Reproducibility and validity of an FFQ developed for adults in Nanjing, China. Br J Nutr. 2016;115:887–94.
Yuan C, Spiegelman D, Rimm EB, Rosner BA, Stampfer MJ, Barnett JB, Chavarro JE, Subar AF, Sampson LK, Willett WC. Validity of a dietary questionnaire assessed by comparison with multiple weighed dietary records or 24-hour recalls. Am J Epidemiol. 2017;185:570–84.
Tsubono Y, Ogawa K, Watanabe Y, Nishino Y, Tsuji I, Watanabe T, Nakatsuka H, Takahashi N, Kawamura M, Hisamichi S. Food frequency questionnaire and a screening test. Nutr Cancer. 2001;39:78–84.
Shai I, Rosner BA, Shahar DR, Vardi H, Azrad AB, Kanfi A, Schwarzfuchs D, Fraser D, Study D. Dietary evaluation and attenuation of relative risk: multiple comparisons between blood and urinary biomarkers, food frequency, and 24-hour recall questionnaires: the DEARR study. J Nutr. 2005;135:573–9.
Fornés NS, Stringhini ML, Elias BM. Reproducibility and validity of a food-frequency questionnaire for use among low-income Brazilian workers. Public Health Nutr. 2003;6:821–7.
Nouri M, Ghazizahedi S, Mohajeri SA. Relative validity and reproducibility of a semi-quantitative food frequency questionnaire among urban Iranians. Int J Health Life Sci. 2017;3(1):60–70.
McKeown NM, Day NE, Welch AA, Runswick SA, Luben RN, Mulligan AA, McTaggart A, Bingham SA. Use of biological markers to validate self-reported dietary intake in a random sample of the European prospective investigation into Cancer United Kingdom Norfolk cohort. Am J Clin Nutr. 2001;74:188–96.
Munger RG, Folsom AR, Kushi LH, Kaye SA, Sellers TA. Dietary assessment of older Iowa women with a food frequency questionnaire: nutrient intake, reproducibility, and comparison with 24-hour dietary recall interviews. Am J Epidemiol. 1992;136:192–200.
Zapataa ME, Buffarinib R, Lingiardia N, Gonçalves-Soaresb AL. Reproducibility and relative validity of a semi-quantitative food-frequency questionnaire in an adult population of Rosario, Argentina; 2015.
Smith W, Mitchell P, Reay EM, Webb K, Harvey PW. Validity and reproducibility of a self-administered food frequency questionnaire in older people. Aust N Z J Public Health. 1998;22:456–63.
WalterWillett. Nutritional epidemiology. New York: Oxford University Press; 1998.
Mahajan R, Malik M, Bharathi AV, Lakshmi PV, Patro BK, Rana SK, Kumar R. Reproducibility and validity of a quantitative food frequency questionnaire in an urban and rural area of northern India. Nat Med JIndia. 2013;26:266–72.
Fallaize R, Forster H, Macready AL, Walsh MC, Mathers JC, Brennan L, Gibney ER, Gibney MJ, Lovegrove JA. Online dietary intake estimation: reproducibility and validity of the Food4Me food frequency questionnaire against a 4-day weighed food record. J Med Internet Res. 2014;16:e190.
Chen Q, Marques-Vidal P. Trends in food availability in Portugal in 1966-2003: comparison with other Mediterranean countries. Eur J Nutr. 2007;46:418–27.
Bobak M, Skodova Z, Pisa Z, Poledne R, Marmot M. Political changes and trends in cardiovascular risk factors in the Czech Republic, 1985-92. J Epidemiol Community Health. 1997;51:272–7.
We are grateful to all the participants of the study.
This work was supported by the National Key R&D Program of China under Grant 2017YFC0907402 to Yuhong Zhao; the National Natural Science Foundation of China under Grant 81903302 to Yang Xia; the China Postdoctoral Science Foundation under Grant 2018M641753 to Yang Xia; and the 345 Talent Project of Shengjing Hospital of China Medical University under Grant M0294 to Yang Xia. The funding body had no role in the study design; collection, analysis, and interpretation of data; or writing of the manuscript.
Ethics approval and consent to participate
Consent for publication
The authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
The overview of the retrieved studies assessing the reproducibility of FFQs.
Pooled intraclass correlation coefficients for energy and nutrients stratified by age.
Pooled spearman correlation coefficients for energy and nutrients stratified by age.
Pooled intraclass correlation coefficients for energy and nutrients stratified by sex.
Pooled spearman correlation coefficients for energy and nutrients stratified by sex.
Pooled crude intraclass correlation coefficients for energy and nutrients stratified by regions.
Pooled energy-adjusted intraclass correlation coefficients for energy and nutrients stratified by regions.
Pooled crude spearman correlation coefficients for energy and nutrients stratified by regions.
Pooled energy-adjusted spearman correlation coefficients for energy and nutrients stratified by regions.
Pooled intraclass correlation coefficients for energy and nutrients stratified by sample size.
Pooled spearman correlation coefficients for energy and nutrients stratified by sample size.
Pooled intraclass correlation coefficient for energy and nutrients stratified by time interval (6 months as cut-point).
Pooled spearman correlation coefficient for energy and nutrients stratified by time interval (6 months as cut-point).
Pooled intraclass correlation coefficient for energy and nutrients stratified by time interval (12 months as cut-point).
Pooled spearman correlation coefficient for energy and nutrients stratified by time interval (12 months as cut-point).
Pooled intraclass correlation coefficient for energy and nutrients stratified by items of FFQ.
Pooled spearman correlation coefficient for energy and nutrients stratified by items of FFQ.
Pooled intraclass correlation coefficient for energy and nutrients stratified by dietary recall interval.
Pooled spearman correlation coefficient for energy and nutrients stratified by dietary recall interval.
Pooled intraclass correlation coefficient for energy and nutrients stratified by administration mode.
Pooled spearman correlation coefficient for energy and nutrients stratified by administration mode.
About this article
Cite this article
Cui, Q., Xia, Y., Wu, Q. et al. A meta-analysis of the reproducibility of food frequency questionnaires in nutritional epidemiological studies. Int J Behav Nutr Phys Act 18, 12 (2021). https://doi.org/10.1186/s12966-020-01078-4
- Food frequency questionnaire
- Macronutrients, micronutrients