Validity evidence for STEM problem solving multiple choice questions: Developing an engineering admissions test

We describe the development of an admissions assessment supporting applications to engineering degree programmes at universities in the UK, Europe and South East Asia. The role of an admissions assessment and construct validity considerations for test development are discussed, drawing on a review of the skills needed for engineering degree programmes.

I. Assessment in Science, Technology, Engineering and Mathematics (STEM)

There is increasing concern within universities over ways to recruit and retain suitable students [1], particularly in engineering degree programmes [2]–[4]. A well-targeted admissions assessment can offer an objective summary of a student's suitability for a bachelor degree, and support recruitment by providing a transparent overview of the skills needed to succeed on the degree programme. For applicants, an appropriate admissions processes will help to advise prospective students of their suitability to undertake an academically demanding degree. To construct an effective engineering admissions assessment, we require students to apply and use physics and mathematics knowledge to demonstrate understanding of physical concepts, in addition to fluency in algorithmic processing.