Doing what it says on the tin? A psychometric evaluation of the Assessment Experience Questionnaire

John Batten, Tansy Jessop, Phil Birch

    Research output: Contribution to journalArticle

    Abstract

    The Assessment Experience Questionnaire has been widely used to measure conditions of learning from assessment. It is one of three methods used in the ‘Transforming the Experience of Students through Assessment’ research process, originally funded by the Higher Education Academy to explore programme assessment patterns, and now used extensively in universities in the United Kingdom. Given the growth of assessment and feedback research over the last decade, the Assessment Experience Questionnaire is ripe for revision. Critics have queried its theoretical and statistical robustness. This study investigated the psychometric properties of the Assessment Experience Questionnaire, as the first step in the process of strengthening the instrument. Specifically, we examined the validity of the questionnaire with a sample of final year undergraduate students from eight UK universities (n = 633). Results were mixed, confirming that the questionnaire has some value, but indicating that not all sub-scales possess adequate psychometric properties to underpin confident conclusions. As a result, we have embarked on a process of making conceptual modifications to the Assessment Experience Questionnaire, both to update the theoretical constructs, and to ensure stronger overall validity. This article indicates the direction of these modifications, which will be outlined in a second article.
    Original languageEnglish
    JournalAssessment and Evaluation in Higher Education
    Publication statusE-pub ahead of print - 4 Nov 2018

    Fingerprint

    psychometrics
    questionnaire
    evaluation
    experience
    university
    research process
    academy
    critic
    student
    learning
    Values
    education

    Cite this

    @article{45ed70e1f22841d5bd527fe8cde79756,
    title = "Doing what it says on the tin? A psychometric evaluation of the Assessment Experience Questionnaire",
    abstract = "The Assessment Experience Questionnaire has been widely used to measure conditions of learning from assessment. It is one of three methods used in the ‘Transforming the Experience of Students through Assessment’ research process, originally funded by the Higher Education Academy to explore programme assessment patterns, and now used extensively in universities in the United Kingdom. Given the growth of assessment and feedback research over the last decade, the Assessment Experience Questionnaire is ripe for revision. Critics have queried its theoretical and statistical robustness. This study investigated the psychometric properties of the Assessment Experience Questionnaire, as the first step in the process of strengthening the instrument. Specifically, we examined the validity of the questionnaire with a sample of final year undergraduate students from eight UK universities (n = 633). Results were mixed, confirming that the questionnaire has some value, but indicating that not all sub-scales possess adequate psychometric properties to underpin confident conclusions. As a result, we have embarked on a process of making conceptual modifications to the Assessment Experience Questionnaire, both to update the theoretical constructs, and to ensure stronger overall validity. This article indicates the direction of these modifications, which will be outlined in a second article.",
    author = "John Batten and Tansy Jessop and Phil Birch",
    year = "2018",
    month = "11",
    day = "4",
    language = "English",
    journal = "Assessment and Evaluation in Higher Education",
    issn = "0260-2938",
    publisher = "Taylor and Francis Ltd.",

    }

    Doing what it says on the tin? A psychometric evaluation of the Assessment Experience Questionnaire. / Batten, John; Jessop, Tansy; Birch, Phil.

    In: Assessment and Evaluation in Higher Education, 04.11.2018.

    Research output: Contribution to journalArticle

    TY - JOUR

    T1 - Doing what it says on the tin? A psychometric evaluation of the Assessment Experience Questionnaire

    AU - Batten, John

    AU - Jessop, Tansy

    AU - Birch, Phil

    PY - 2018/11/4

    Y1 - 2018/11/4

    N2 - The Assessment Experience Questionnaire has been widely used to measure conditions of learning from assessment. It is one of three methods used in the ‘Transforming the Experience of Students through Assessment’ research process, originally funded by the Higher Education Academy to explore programme assessment patterns, and now used extensively in universities in the United Kingdom. Given the growth of assessment and feedback research over the last decade, the Assessment Experience Questionnaire is ripe for revision. Critics have queried its theoretical and statistical robustness. This study investigated the psychometric properties of the Assessment Experience Questionnaire, as the first step in the process of strengthening the instrument. Specifically, we examined the validity of the questionnaire with a sample of final year undergraduate students from eight UK universities (n = 633). Results were mixed, confirming that the questionnaire has some value, but indicating that not all sub-scales possess adequate psychometric properties to underpin confident conclusions. As a result, we have embarked on a process of making conceptual modifications to the Assessment Experience Questionnaire, both to update the theoretical constructs, and to ensure stronger overall validity. This article indicates the direction of these modifications, which will be outlined in a second article.

    AB - The Assessment Experience Questionnaire has been widely used to measure conditions of learning from assessment. It is one of three methods used in the ‘Transforming the Experience of Students through Assessment’ research process, originally funded by the Higher Education Academy to explore programme assessment patterns, and now used extensively in universities in the United Kingdom. Given the growth of assessment and feedback research over the last decade, the Assessment Experience Questionnaire is ripe for revision. Critics have queried its theoretical and statistical robustness. This study investigated the psychometric properties of the Assessment Experience Questionnaire, as the first step in the process of strengthening the instrument. Specifically, we examined the validity of the questionnaire with a sample of final year undergraduate students from eight UK universities (n = 633). Results were mixed, confirming that the questionnaire has some value, but indicating that not all sub-scales possess adequate psychometric properties to underpin confident conclusions. As a result, we have embarked on a process of making conceptual modifications to the Assessment Experience Questionnaire, both to update the theoretical constructs, and to ensure stronger overall validity. This article indicates the direction of these modifications, which will be outlined in a second article.

    M3 - Article

    JO - Assessment and Evaluation in Higher Education

    JF - Assessment and Evaluation in Higher Education

    SN - 0260-2938

    ER -