What is an adequate sample size? Operationalising data saturation for theory-based interview studies

Jill J. Francis, Marie Johnston, Clare Robertson, Liz Glidewell, Vikki Entwistle, Martin P. Eccles, Jeremy M. Grimshaw

    Research output: Contribution to journalArticle

    536 Citations (Scopus)

    Abstract

    In interview studies, sample size is often justified by interviewing participants until reaching 'data saturation'. However, there is no agreed method of establishing this. We propose principles for deciding saturation in theory-based interview studies (where conceptual categories are pre-established by existing theory). First, specify a minimum sample size for initial analysis (initial analysis sample). Second, specify how many more interviews will be conducted without new ideas emerging (stopping criterion). We demonstrate these principles in two studies, based on the theory of planned behaviour, designed to identify three belief categories (Behavioural, Normative and Control), using an initial analysis sample of 10 and stopping criterion of 3. Study 1 (retrospective analysis of existing data) identified 84 shared beliefs of 14 general medical practitioners about managing patients with sore throat without prescribing antibiotics. The criterion for saturation was achieved for Normative beliefs but not for other beliefs or studywise saturation. In Study 2 (prospective analysis), 17 relatives of people with Paget's disease of the bone reported 44 shared beliefs about taking genetic testing. Studywise data saturation was achieved at interview 17. We propose specification of these principles for reporting data saturation in theory-based interview studies. The principles may be adaptable for other types of studies.

    Original languageEnglish
    Pages (from-to)1229-1245
    Number of pages17
    JournalPsychology and Health
    Volume25
    Issue number10
    DOIs
    Publication statusPublished - 2010

    Keywords

    • data saturation
    • sample size
    • interviews as topic
    • models
    • psychological
    • theory-based content analysis
    • PLANNED BEHAVIOR
    • HEALTH
    • PROFESSIONALS
    • CONSULTATIONS
    • COMMUNITY
    • RESOURCE
    • PEOPLE
    • ACCESS
    • CARE

    Cite this

    Francis, J. J., Johnston, M., Robertson, C., Glidewell, L., Entwistle, V., Eccles, M. P., & Grimshaw, J. M. (2010). What is an adequate sample size? Operationalising data saturation for theory-based interview studies. Psychology and Health, 25(10), 1229-1245. https://doi.org/10.1080/08870440903194015
    Francis, Jill J. ; Johnston, Marie ; Robertson, Clare ; Glidewell, Liz ; Entwistle, Vikki ; Eccles, Martin P. ; Grimshaw, Jeremy M. / What is an adequate sample size? Operationalising data saturation for theory-based interview studies. In: Psychology and Health. 2010 ; Vol. 25, No. 10. pp. 1229-1245.
    @article{8c26ad2169374640a018e7318047d539,
    title = "What is an adequate sample size? Operationalising data saturation for theory-based interview studies",
    abstract = "In interview studies, sample size is often justified by interviewing participants until reaching 'data saturation'. However, there is no agreed method of establishing this. We propose principles for deciding saturation in theory-based interview studies (where conceptual categories are pre-established by existing theory). First, specify a minimum sample size for initial analysis (initial analysis sample). Second, specify how many more interviews will be conducted without new ideas emerging (stopping criterion). We demonstrate these principles in two studies, based on the theory of planned behaviour, designed to identify three belief categories (Behavioural, Normative and Control), using an initial analysis sample of 10 and stopping criterion of 3. Study 1 (retrospective analysis of existing data) identified 84 shared beliefs of 14 general medical practitioners about managing patients with sore throat without prescribing antibiotics. The criterion for saturation was achieved for Normative beliefs but not for other beliefs or studywise saturation. In Study 2 (prospective analysis), 17 relatives of people with Paget's disease of the bone reported 44 shared beliefs about taking genetic testing. Studywise data saturation was achieved at interview 17. We propose specification of these principles for reporting data saturation in theory-based interview studies. The principles may be adaptable for other types of studies.",
    keywords = "data saturation, sample size, interviews as topic, models, psychological, theory-based content analysis, PLANNED BEHAVIOR, HEALTH, PROFESSIONALS, CONSULTATIONS, COMMUNITY, RESOURCE, PEOPLE, ACCESS, CARE",
    author = "Francis, {Jill J.} and Marie Johnston and Clare Robertson and Liz Glidewell and Vikki Entwistle and Eccles, {Martin P.} and Grimshaw, {Jeremy M.}",
    note = "MEDLINE{\circledR} is the source for the MeSH terms of this document.",
    year = "2010",
    doi = "10.1080/08870440903194015",
    language = "English",
    volume = "25",
    pages = "1229--1245",
    journal = "Psychology and Health",
    issn = "0887-0446",
    publisher = "Taylor & Francis",
    number = "10",

    }

    Francis, JJ, Johnston, M, Robertson, C, Glidewell, L, Entwistle, V, Eccles, MP & Grimshaw, JM 2010, 'What is an adequate sample size? Operationalising data saturation for theory-based interview studies', Psychology and Health, vol. 25, no. 10, pp. 1229-1245. https://doi.org/10.1080/08870440903194015

    What is an adequate sample size? Operationalising data saturation for theory-based interview studies. / Francis, Jill J.; Johnston, Marie; Robertson, Clare; Glidewell, Liz; Entwistle, Vikki; Eccles, Martin P.; Grimshaw, Jeremy M.

    In: Psychology and Health, Vol. 25, No. 10, 2010, p. 1229-1245.

    Research output: Contribution to journalArticle

    TY - JOUR

    T1 - What is an adequate sample size? Operationalising data saturation for theory-based interview studies

    AU - Francis, Jill J.

    AU - Johnston, Marie

    AU - Robertson, Clare

    AU - Glidewell, Liz

    AU - Entwistle, Vikki

    AU - Eccles, Martin P.

    AU - Grimshaw, Jeremy M.

    N1 - MEDLINE® is the source for the MeSH terms of this document.

    PY - 2010

    Y1 - 2010

    N2 - In interview studies, sample size is often justified by interviewing participants until reaching 'data saturation'. However, there is no agreed method of establishing this. We propose principles for deciding saturation in theory-based interview studies (where conceptual categories are pre-established by existing theory). First, specify a minimum sample size for initial analysis (initial analysis sample). Second, specify how many more interviews will be conducted without new ideas emerging (stopping criterion). We demonstrate these principles in two studies, based on the theory of planned behaviour, designed to identify three belief categories (Behavioural, Normative and Control), using an initial analysis sample of 10 and stopping criterion of 3. Study 1 (retrospective analysis of existing data) identified 84 shared beliefs of 14 general medical practitioners about managing patients with sore throat without prescribing antibiotics. The criterion for saturation was achieved for Normative beliefs but not for other beliefs or studywise saturation. In Study 2 (prospective analysis), 17 relatives of people with Paget's disease of the bone reported 44 shared beliefs about taking genetic testing. Studywise data saturation was achieved at interview 17. We propose specification of these principles for reporting data saturation in theory-based interview studies. The principles may be adaptable for other types of studies.

    AB - In interview studies, sample size is often justified by interviewing participants until reaching 'data saturation'. However, there is no agreed method of establishing this. We propose principles for deciding saturation in theory-based interview studies (where conceptual categories are pre-established by existing theory). First, specify a minimum sample size for initial analysis (initial analysis sample). Second, specify how many more interviews will be conducted without new ideas emerging (stopping criterion). We demonstrate these principles in two studies, based on the theory of planned behaviour, designed to identify three belief categories (Behavioural, Normative and Control), using an initial analysis sample of 10 and stopping criterion of 3. Study 1 (retrospective analysis of existing data) identified 84 shared beliefs of 14 general medical practitioners about managing patients with sore throat without prescribing antibiotics. The criterion for saturation was achieved for Normative beliefs but not for other beliefs or studywise saturation. In Study 2 (prospective analysis), 17 relatives of people with Paget's disease of the bone reported 44 shared beliefs about taking genetic testing. Studywise data saturation was achieved at interview 17. We propose specification of these principles for reporting data saturation in theory-based interview studies. The principles may be adaptable for other types of studies.

    KW - data saturation

    KW - sample size

    KW - interviews as topic

    KW - models

    KW - psychological

    KW - theory-based content analysis

    KW - PLANNED BEHAVIOR

    KW - HEALTH

    KW - PROFESSIONALS

    KW - CONSULTATIONS

    KW - COMMUNITY

    KW - RESOURCE

    KW - PEOPLE

    KW - ACCESS

    KW - CARE

    UR - http://www.scopus.com/inward/record.url?scp=78649552441&partnerID=8YFLogxK

    U2 - 10.1080/08870440903194015

    DO - 10.1080/08870440903194015

    M3 - Article

    VL - 25

    SP - 1229

    EP - 1245

    JO - Psychology and Health

    JF - Psychology and Health

    SN - 0887-0446

    IS - 10

    ER -