ABSTRACT

BACKGROUND/AIMS:

This study aimed to identify the level of agreement between self-reported and objectively measured data among healthy Turkish adults in order to assess the validity of self-reported data.

MATERIALS AND METHODS:

Self-reported data along with independent measurements were obtained from 958 men and 502 women, aged between 18-53 years. The subjects were classified according to their body mass index (BMI) scores and margins of error in self-reported anthropometric data were calculated. The misclassification status according to BMI deriving from self-reported data was determined. Intraclass correlation coefficients were calculated at 95% confidence interval. Independent sample t-test and One-Way ANOVA were used for comparisons. Bland-Altman graph, specificity and sensitivity, Cohen’s kappa and receiver operating characteristic curve inspections were carried out.

RESULTS:

The results indicate that both men and women underestimated their weight and overestimated their height. The margin of error in estimating height for the men was found to be significantly larger than for women. In contrast, women tended to underestimate their weight more than men. The subjects’ self-reported and measured anthropometric data were significantly different (p<0.01) in both sexes. Specificity scores were found to be high but sensitivity scores were low.

CONCLUSION:

These results indicate that the subjects’ margins of error were large and that BMI assessment through self-reported data can lead to erroneous estimates when used to assess obesity in Turkish adults and BMI should not be relied on unless the scores are obtained by objective anthropometric measurements.

INTRODUCTION

Body mass index [(BMI); kg/m²)], calculated as mass (kg) divided by the height squared (m²), is a well-known and widely used measure to assess body composition and obesity prevalence.¹ The anthropometrical variables used to calculate BMI are commonly self-reported data in epidemiological studies.² Although it has limited predictive power on personal body composition assessment³ and the accuracy of such data is widely questioned, it is still the most commonly used measure to assess obesity in broad groups all over the world, not only because it only requires basic anthropometric data, namely, height and weight⁴ but also because the assessment is non-invasive, inexpensive and easy-to-use.⁵ Self-reported data is a useful tool to calculate BMI in large groups, especially when it is impractical to take independent measurements.⁶

Many studies use self-reported data, either raw or calculated, as a data collection method as it is easier, faster, and more economical than direct measurements.⁷ Social scientists, in general, use self-report to collect data because of the high cost of collecting data by measurement.⁸ It is widely recognized that self-reports of body weight and height are often inaccurate^1,9 and studies suggest that self-reported height and weight tend to be inaccurate and biased when compared to objectively measured data.¹⁰ Such inaccuracies may prevent researchers from determining the obesity levels of a population.^7,11 Although some previous studies suggested that BMI scores obtained using self‑reported height and weight were highly correlated with objectively measured BMI scores,^12,13 overweight, and elderly people along with women tend to underestimate their weight while overestimating their height.^5,7

Obesity has been known to be a major public health issue since the late 1980s¹⁴ and in today’s world, monitoring the obesity level of a large group is important to identify obesity‑related health problems, premature death rates,^11,15 and occupational health status.¹⁶ Some studies^5,17 have attempted to suggest a correction factor for self‑reported data in BMI classification, but no successful solution has been provided to date because the mechanism underlying the inaccuracy in self-reported BMI is unknown.⁴ Other ways to correct self-reported BMI, such as using the Stunkard Figure Rating Scale, were found to be impractical because they relied on the body image perceptions of individuals.⁵

In today’s world, governments look for solutions to prevent obesity at the individual level and to slow down or reduce obesity levels in the population.^4,18 High BMI levels are related to certain types of cancer,^19,20 ischemic heart disease,²¹ cardiorespiratory fitness,²² and low quality of life levels.²³ Obesity is known to contribute to cancers at a rate of about 6% in the U.S. population²⁴ and it is also associated with cardiorespiratory fitness.²⁵

Many countries have set some public policies and public health goals to prevent obesity at the individual level and to slow down obesity rates at the population level⁴ and BMI is widely used in determining these public health policies.³

Numerous studies have been conducted in several countries and regions, including the U.S.A., France, South America, Great Britain, Scandinavian countries, Australia, New Zealand, and Eastern countries to assess the association between self-reported and measured anthropometric data but only limited research on Turkish adults has been carried out. This study aimed to assess the association between self-reported and measured BMI categorizations in Turkish adults and to test the validity of self-reported anthropometric data.

MATERIALS AND METHODS

Participants

The participants who volunteered to take part in this study were aged 18 and over. This cross‑sectional study was carried out between September, 2018 and June, 2019. Data were collected in the Çorum province of Turkey. The participants were comprised of university students, urban and rural people, attendees and spectators of public meetings such as academic year opening ceremonies, art exhibitions and other events such as sporting games. Over 2,000 people were invited to take part and, of these, a total of 1,460 individuals agreed to take part in this study.

Data Collection

The subjects were informed about the aim of this study and their written consent was obtained. The subjects were asked to fill out a questionnaire including their anthropometric data. A Seca (model 703) professional weighing-scale was used to measure weight to 1/100 of a kilogram and a Seca (model 220) stadiometer was used to measure height to 1/10 of a centimetre accuracy. Measurement errors were minimized by applying standard operating procedures strictly and calibrating the measurement devices regularly.

Ethics Approval

The study protocol was approved by the Non-Interventional Researches Ethics Committee of Hitit University (approval number: 2018-07).

Statistical Analysis

Descriptive statistics are presented as mean ± standard deviation and quartiles of the anthropometric data are also given. The normality of the data was tested and found to be normally distributed. Intraclass correlation coefficients (ICCs) were calculated at 95% confidence interval (CI). The Independent sample t-test was used to analyse differences between dichotomous groups; One-Way ANOVA was used for analysis between three or more groups. Bland-Altman graphs were created to inspect the level of agreement between the self-reported and measured anthropometric data. Specificity and sensitivity scores were calculated to assess the levels of conformity of the self‑reported BMI values. Cohen’s Kappa was also calculated to assess the strength of agreement between the self-reported and objectively measured BMI categorization. SPSS (IBM Corp. 2013, Release 22.0.0.0, 64-bit edition; Licensed to Hitit University) was used for statistical analyses.

RESULTS

A total of 1,460 participants, aged 18 to 52 (31.91±8.18 years) participated in this study and the number of men (n=958) was nearly twice the number of women (n=502). The subjects’ measured and self-reported height, weight, and BMI values were included in the data analyses. The subjects’ gender, marital status, level of education, level of income, and smoking status were also used for statistical calculations.

Margins of error were calculated as the difference between the self-reported and measured values (self-reported minus measured). Those scores below zero reflect underestimation and those scores over zero reflect overestimation.

ICCs were 0.944 (95% CI: 0.939-0.960) for height, 0.971 (95% CI: 0.968-0.974) for weight and 0.878 (95% CI: 0.866-0.890) for BMI between the self-reported and measured values for the variables. All measurements for the variables revealed very high concordance but BMI had the lowest ICC value.

A summary of the statistics regarding the anthropometric measurements by gender is shown in Table 1. Men over-reported their heights by 1.99±1.86 cm while women over‑reported by 2.82±1.71 cm. The self-reported weight margin of error for men was ‑0.77±2.33 kg and it was -1.08±2.39 for women. Both men and women underestimated their weight but overestimated their height. Women were prone to underestimate their weight and overestimate their height more than men. Analysis of BMI values yielded similar results and the difference between the reported and measured BMI data for men was ‑0.78±0.98 kg/m² and ‑1.18±1.07 kg/m² for women. The differences between the reported and measured weight, height, and BMI data for men and women were statistically examined using the independent sample t-test and all found to be significant (p<0.001 and p<0.05). The subjects in the overweight/obese category significantly overestimated their heights and underestimated their weights and BMI scores when compared to normal category subjects (p<0.001).

Table 1

The mean differences between the measured and self-reported height, weight, and BMI values were not significantly different in any of the categories as shown in Table 2. Gender was found to cause statistically significant differences in reporting bias. Women overestimated their height (p<0.001) and underestimated their weight (p<0.05) and consequently the BMI scores of women were much lower when compared to men (p<0.001). The level of education, marital status, monthly income, and smoking status resulted in no significant differences between the measured and self‑reported data (p>0.05). All groups tended to overestimate heights and underestimate weights. As a result of this general tendency, the self-reported BMI in each category was lower than the measured BMI.

Table 2

The differences between the self-reported and measured data by age groups are summarized in Table 3. ANOVA results (Table 4) yielded no significant differences between the age categories (p>0.05).

Table 3

Table 4

The Bland-Altman plot of weight estimation errors demonstrated a slightly skewed distribution. The subjects tended to underestimate their weight by up to 9.4 kg and overestimate by up to 6.1 kg. The plot of height estimation error revealed that most of the subjects overestimated their heights, by up to 8.5 cm, but underestimated by only up to 2.9 cm.

The Bland-Altman plot of BMI errors revealed that the self-reported and measured data did not have a good level of agreement. A very large portion of the subjects’ BMI data was underestimated by up to 4.77 kg/m² but overestimated by only 1.81 kg/m². The plots support that the belief that the subjects have a strong tendency to overestimate their height and underestimate their weight (Figure 1).

Figure 1

The map of estimation errors presented a clear picture of the bias of the subjects. Most of the errors are pooled in the lower-right quadrant which represents both an overestimation of height and an underestimation of weight. Subjects who overestimated their weight and underestimated their height are in the upper-left quadrant and the number of these subjects was fairly small (Figure 2).

Figure 2

Figure 3 (graph on top) shows that all of the obese class II subjects underestimated their BMI scores and the rate of underestimation of BMI scores decreased as the level of obesity decreased. Over 90% of the obese class I subjects and more than half of the overweight subjects underestimated their BMI scores. The subjects in the normal and underweight categories did a fairly good estimation and both categories accurately estimated their BMI scores at about 80%. Only about 10% of all subjects overestimated their BMI scores but no overestimation was observed in the overweight, obese class I, or obese class II subjects. As stated previously, agreement on BMI estimation was set at ±1.40 kg/m² between the self-reported and measured data.

Figure 3

The rates of estimation consistency between the self-reported and measured BMI scores are given in Figure 3 (graph on bottom). Less than 10% of the subjects correctly reported their BMI scores. All of the obese subjects (both class I and II) and more than 95% of the overweight subjects underestimated their BMI scores. About 45% of the underweight and 20% of the normal subjects overestimated their BMIs. Except for a limited number of overweight subjects, no subjects above the normal range overestimated their BMI scores.

Figure 3

The receiver operating characteristic (ROC) graphs indicate the accuracy of the self-reported BMI for men and women. The area under the curve for men was 0.71 (95% CI: 0.667-0.751) and 0.76 (95% CI: 0.718-0.803) for women (Figure 4). The statistics for ROC curves of the BMI accuracy levels are summarized in Table 5.

Figure 4

Table 5

The specificity of the self-report was almost perfect (≥99.7%) but its sensitivity was only 69.5% for men, about 59.4% for women, and 65.9% overall (Table 6). Cohen’s kappa was also calculated to assess the strength between the self-reported and measured BMI categories and Kappa was found to be 0.678 (SE: 0.020, p<0.001).

Table 6

DISCUSSION

Reporting weight and height accurately is an essential part of obesity assessment via self-reported anthropometric data.¹ Although the strength of association between self-reported and measured BMI categories show substantial agreement in this study,²⁶ the accuracy of self-reported data has always been questioned and many authors have raised concerns,^27-30 while some others have championed its effectiveness.^14,31 There are many factors which affect the accuracy of self-reported data and it has been previously reported that the accuracy of self-reported anthropometric data is affected by certain variables.³² The main variable which affects the accuracy of self-reported BMI is reported to be gender.³³ In a study conducted to assess the accuracy of self-reported anthropometric data in Scottish adults,¹¹ both sexes tended to misestimate their height and weight. In their study, Bolton-Smith et al.¹¹ found that self-reported anthropometric data differed from the measured data by gender. Men tended to overestimate their height but underestimate their weight in a similar way to women but the margin of error was larger in women. Women tended to inaccurately estimate their height and weight in favour of a lower BMI to a greater extent than men.¹¹ Many other studies have shown that women, when compared to men, misestimated their anthropometric data in such a way that it would lead to a lower BMI result.^{4,6,8,11,14,32,34,35} Of the papers reviewed, only one study reported that women participants reported their BMI more accurately than men,³⁶ one study reported that men over-reported their BMI ¹⁷ and one study reported that men estimated their weight without significant bias.³⁷ The results of the current study are in line with previously published studies and revealed that weight was significantly underestimated and height was overestimated. As a result of this, BMI was significantly underestimated. In addition to this, our results were also similar to studies which found that women were more likely to underestimate their weight.

Engstrom et al.³⁸ reviewed the accuracy of self-report in women and it was found that overestimation was up to 7.6 cm in height and underestimation was up to 19 kg in weight. Engstrom et al.³⁸ reported that in all the studies reviewed, weight was underestimated while height was overestimated. These results are in line with the results of the current study.

It was previously reported that the reason for the tendency to underestimate weight might be that people weigh themselves with lighter clothes or without clothes in their private rooms compared with measurements taken when regularly dressed in public places such as a hospital or a clinic.^1,11 In addition to this, weighing with different scales might yield inconsistent results because of calibration inaccuracies. However, although this reason may contribute to an underestimation of weight, there is no strong evidence regarding it.¹ As the gap between the self-reported and measured weight is up to 20 kg, there might be another reason for this other than the calibration of the scales. In Turkish adults, it was revealed that there was a tendency to underestimate weight in both men and women. The main reason for this was thought to be the desire to be fit and thin, which is remarkably usual among women as has been reported.²

According to the results of a study carried out in Ireland, BMI misestimation was largely due to the underestimation of weight combined with the overestimation of height. It was also implied that as the level of BMI increased, both the prevalence and magnitude of self-reported BMI misestimation increased. It is believed that people misreport anthropometric data to depict a more socially desirable weight and height.²⁹ Some studies showed that the tendency to exhibit socially desired anthropometric ranges contributed to the misestimation of anthropometric data.^7,9

Although “full-figured” women were desirable before the 1920s, this concept is clearly out of fashion in today’s modern era and people have a desire to look more fit and thin. The reason for this transformation is not only due to societal concepts of how a person should look but also due to the goal to be thin which is promulgated by the fashion industry and reinforced by commercials.³ It has been previously postulated that cultural pressures to be thin and tall cause people to misreport their anthropometric data towards more socially normative (i.e., desirable) values.³⁹ The bias revealed in this study for both genders may be due to the desire to look thinner and taller in order to comply with social norms. It has also been reported that there are results which support the view that heavier individuals desired to conform to social norms and attempted to appear thinner by underreporting their weight⁴⁰ more than their slimmer counterparts.⁴¹

Although the impact of age on the accuracy of self-reported BMI has been reported in some previous studies^17,31,42,43 and some studies revealed that aging affected the bias in self-report by leading to a tendency to over-report height and under-report weight,³⁶ no statistically significant differences between the age groups were found in the current study. The reason for this was thought to be that all the age groups overestimated their height and underestimated their weight.

The sociodemographic variables investigated in this study (level of education, marital status, and monthly income) and smoking habits were found to have no statistical influence on the accuracy of the self-reported anthropometric data although previous studies yielded different results regarding this.

In one study conducted on the American population, an association was reported between educational level and the degree of misreporting anthropometric data. The association between education and misreporting was explained by the fact that the concerns about excess weight were greater for those at higher socioeconomic and cultural levels.⁴² Some other more recent studies revealed that sociodemographic variables including education had no association with misreporting height and weight.^2,15 In another study, no clear effect of the level of education on self-reported BMI accuracy was shown.⁴ Craig and Adams³² found that under-reporting was more likely to be among the well-educated but no supporting results were obtained in the current study. In a study conducted on Scottish adults,¹¹ no significant difference was found between the reported and measured data (including BMI) in terms of smoking habit or education level groups.

In the present study, no association between sociodemographic variables and self-reported anthropometric data was observed. This might be due to the fact that the desire to look thinner and taller in today’s world is more common than ever before because of the wide utilization of web-based social networks and technology. Cultural and social pressures are postulated to have an effect on misreporting height and weight because social norms push people to look beyond how they actually look.^8,30,39 By being integrated into social networks and the internet, people see tall and fit people more frequently and the desire to look like them might contribute to bias in self-reported anthropometry.

Similar to the results of the studies conducted by Dekkers et al.¹⁵ and Craig and Adams³², the levels of agreement between BMI categorizations (self-reported and measured) were found to be substantial.

Bolton-Smith et al.¹¹ found the rate of specificity and sensitivity for estimates of obesity prevalence to be 83% and 96% (respectively, for men) and 89% and 97% (respectively, for women). In the current study, specificity for men was found to be 99.9% and 99.7% for women while sensitivity was 69.5% for men and 59.4% for women. Kappa values were 0.719 for men, 0.605 for women, and 0.678 in general. Similar to the findings of this study, Brener et al.⁴⁴ reported 99.2% specificity, 54.9% sensitivity, and a Kappa value of 0.77 for BMI classification.

It was reported in one study that the mean difference in the self-reported and measured height decreased as the measured height increased. Short (<173 cm for men, <160 cm for women) subjects reported their height at a sensitivity rate of 69% while the tall (>182 cm for men, >168 cm for women) subjects’ rate was 94%. In contrast, weight was reported more accurately as the measured weight decreased in both men and women.⁴²

The correlation between reported and measured BMI levels should be cautiously relied on. Despite the high correlation (r>0.9) between measured and self-reported BMI, misclassification of BMI level by self-report was shown to be about 30-40%.⁴⁵ In a study conducted in Australia, only 52% or the participants accurately reported their height while the rate of accurately reported weight was as low as 34%.⁶ In a study conducted in Iran, the Kappa value for weight perception and measured weight was as low as 0.38 for women and 0.23 for men.¹⁰

In their work, Shiely et al.²⁹ reported that the Surveys of Lifestyle Attitudes and Nutrition 1998, 2002 and 2007 measurements revealed underreporting of BMI had statistically significantly increased over time across the three surveys (14%, 21%, 24% respectively). Specificity levels across the surveys did not change but sensitivity decreased in both the overweight and obese categories (75%, 68%, 66% for overweight and 80%, 64%, 53% for obese, respectively).

Although the severity of obesity is obvious, the size of the epidemic has usually been assessed by relying on self-reported anthropometric data.⁸ It has been reported that self-reported height and weight could not be relied upon as an alternative to independent measurements in obesity assessments.³⁶ As obesity rates are threatening human health globally, accurate estimations of obesity prevalence are essential for setting effective health policies in order to prevent the obesity epidemic.⁴⁶

CONCLUSION

The results of the current study suggest that the use of self-reported anthropometry in the Turkish population is questionable and measured data should be preferred to assess BMI. The subjects, both men and women, tended to overestimate their height and underestimate their weight, which led to biased BMIs. Such biases may lead to erroneous results with which to evaluate the obesity trend in Turkish adults. Women were more likely to deviate from their measured data in favour of their BMI categories than men. This general tendency to misclassification of BMI categories may prevent the government from setting appropriate policies to control obesity in Turkish adults. It should be kept in mind that self-reporting is a useful, easy, and cheap tool but it should not be relied on entirely to detect obesity prevalence. If a survey based on self-reported data is to be conducted, it would be good practice to measure a random subsample to investigate the magnitude and trajectory of any bias.

MAIN POINTS

-    Turkish women were more prone to underestimate their weight and overestimate their height than Turkish men.

-    Overestimation of height was found to reach up to 8.5 cm while underestimation in weight was about 9.4 kg.

-    Self-reported anthropometry should be cautiously used in both personal and public obesity assessments and/or prevalence studies.

ETHICS

Ethics Committee Approval: The study protocol was approved by the Non-Interventional Researches Ethics Committee of Hitit University (approval number: 2018-07).

Informed Consent: The subjects were informed about the aim of this study and their written consent was obtained.

Peer-review: Externally peer-reviewed.

DISCLOSURES

Financial Disclosure: The author declared that this study had received no financial support.