Elsevier

Health Policy

Volume 84, Issues 2–3, December 2007, Pages 262-268
Health Policy

Failure to validate the Health Survey for England physical activity module in a cardiac population

https://doi.org/10.1016/j.healthpol.2007.03.004Get rights and content

Abstract

Objectives

The Health Survey for England physical activity module interview, although not validated, is used as a performance indicator to see if people are achieving current physical activity targets and is the primary source of information for physical activity related policy making. The aim of this study was to assess the validity of the Health Survey for England physical activity module as a measure of physical activity in older adults with coronary heart disease.

Methods

Seventy-two older adults who had experienced a cardiac event completed the Health Survey for England physical activity interview and wore an accelerometer for seven consecutive days. Physical activity classification levels were derived from accelerometry and from the Health Survey for England physical activity interview, together with the number of episodes in which participants were moderately active for 30 min or more.

Results

The Health Survey for England physical activity interview exhibited high sensitivity (1.0) and specificity (0.76) for people engaged in high levels of physical activity, moderate sensitivity (0.40) and specificity (0.56) for people engaged in medium levels of physical activity and low sensitivity (0.35) and high specificity (0.92) for people engaged in low levels of physical activity. Compared with the accelerometer, the survey misclassified 63% of participants.

Conclusions

The Health Survey for England physical activity interview misclassified true activity levels in older adults with heart disease by overestimating actual activity in the less active participants. Similar biases on self-report physical activity measures have been demonstrated in the general population, suggesting that the Health Survey for England physical activity module interview may be providing inaccurate information on national activity levels.

Introduction

The Health Survey for England (HSE) is an annual, cross-sectional population interview-based survey which provides information on various aspects of the nation's health and health indicators including physical activity [1]. The HSE is a major source of data for assessing the prevalence of physical activity in England as important health policy documents and strategic targets are based on estimates from recent surveys [2], [3]. The questions used in the HSE physical activity module are derived from those originally used in the Allied Dunbar National Fitness Survey (1992) [4]. Surprisingly, neither survey has been validated. Amongst other information the HSE reports the percentage of the adult population achieving the current national recommendations of a minimum of 30 min of moderate intensity activity on at least 5 days per week [1]. The latest figures available reported that 37% of men and 24% of women met this criterion, but that this declined with age with 8% of men aged >75 years and 3% of women aged >75 years meeting the target activity guidelines [5].

Accurate measurement of physical activity by self-report is difficult and limited as factors such as social desirability, age, complexity of questionnaire, seasonal variation and length of period surveyed can influence responses to questions [6]. Direct measurement of physical activity by accelerometry may assist in reducing the limitations of self-report questionnaires. Free-living physical activity can be assessed on a minute-by-minute basis using accelerometry. Accelerometry provides a portable, simple, affordable (for small scale studies), objective and socially acceptable method of measuring physical activity [7].

As part of a study to validate an activity questionnaire for people with cardiac illness we administered both the Health Survey for England physical activity interview and accelerometry to participants who had a previous history of an acute cardiac event. This provided data that afforded the first evaluation of the validity of the Health Survey for England physical activity module, albeit in an older population with a chronic illness. To date, no studies have investigated the validity of the HSE for assessing physical activity levels in an elderly and chronic disease population, such as coronary heart disease (CHD). The aim of this study was to assess the agreement between physical activity classifications of ‘high’, ‘medium’, or ‘low’ as measured on the HSE compared with physical activity classification derived from accelerometry data in older adults with CHD.

Section snippets

Materials and methods

Three of the researchers (AO, PD, and RL) attended an evening meeting of the York Coronary Support group and gave a short presentation on the purpose of the research. A stall was set up in the hall to distribute written information and an application form for return by post. Entry criterion for the study was the participant's report of having experienced an acute cardiac event at any time in the past. The exclusion criterion was the self-report of any changes in the frequency, duration or

Results

Overall 82 people expressed an interest in participating in the study. Of these, 77 (94%) returned their form, gave consent and began the study. Two male participants withdrew from the study before the week's monitoring was completed: one due to illness, the other due to an unplanned holiday. A further three male participants were excluded: two due to the accidental immersion of the accelerometer in water and one due to participant failure to wear the accelerometer for seven consecutive days.

Discussion

This is the first attempt to examine the validity of the HSE physical activity module interview. Compared with an objective measure of activity (accelerometer), the HSE physical activity interview misclassified around 63% of participants, primarily by overestimating their true activity level. It might be suggested that this is because we administered the interview to an atypical population. Our sample population mainly consisted of older, retired adults, who are more likely to have a chronic

Conclusion

In summary, our research suggests that a problem may exist with the HSE as it misclassifies older CHD participants. Further studies are needed to clarify if this problem exists in the general population.

Acknowledgement

This study was funded by the British Heart Foundation, Grant No. BHF PG/04/102 (to AO).

References (26)

  • R.W. Motl et al.

    Is social desirability associated with self-reported physical activity?

    Preventive Medicine

    (2005)
  • G.E. Duncan et al.

    Can sedentary adults accurately recall the intensity of their physical activity?

    Preventive Medicine

    (2001)
  • Department of Health

    Health Survey for England 2003, vol. 2: methodology and documentation

    (2004)
  • The Chief medical Officer

    At least five a week: evidence on the impact of physical activity and its relationship to health

    (2004)
  • Activity and health research, Allied Dunbar National Fitness Survey: a report on activity patterns and fitness levels: main findings

    (1992)
  • Department of Health

    Health Survey for England 2003, vol. 1: findings

    (2004)
  • R.J. Shepherd

    Limits to the measurement of habitual physical activity by questionnaires

    British Journal of Sports Medicine

    (2003)
  • M.J. Mathie et al.

    Accelerometry: providing an integrated, practical method for long-term, ambulatory monitoring of human movement

    Physiological Measurement

    (2004)
  • S.G. Trost et al.

    Conducting accelerometer-based activity assessments in field-based research

    Medicine and Science in Sports and Exercise

    (2005)
  • C.E. Matthews et al.

    Sources of variance in daily physical activity levels as measured by an accelerometer

    Medicine and Science in Sports and Exercise

    (2002)
  • B.E. Ainswoth et al.

    Compendium of physical activities: an update of activity codes and MET intensities

    Medicine and Science in Sports and Exercise

    (2000)
  • S.M. Powell et al.

    Intermonitor variability of the RT3 accelerometer during typical physical activities

    Medicine and Science in Sports and Exercise

    (2003)
  • Cited by (0)

    View full text