Document
Establishing reliability and validity of an online placement test in an Omani higher education institution.
Contributors
Srivastava, Reema., Author
Al-Damen, Tareq., Author
Al-Aufiyah, Asma., Author
Al-Amriyah, Amal., Author
Al-Adawi, Suleiman., Author
Publisher
MDPI.
Gregorian
2023-02
Language
English
English abstract
Although placing students in the appropriate proficiency levels of post-secondary English
programs is crucial for optimal learning, the evaluation of placement tests (PTs) in terms of estab lishing their reliability and validity is relatively under-researched. This study assesses the validity,
reliability, and effectiveness of an in-house online PT. The content validity was established through
the internal and external moderation of the question papers and answer keys while criterion-related
concurrent validity was established via IELTS benchmarking. New Student Survey was used to
investigate the face validity. The internal consistency and reliability of the reading test items were
measured using Cronbach's alpha while descriptive statistics were calculated for the listening test.
Paired sample t-test (dependent t-test) was used to assess the inter-rater reliability of the speaking
and writing tests which were double-marked. The data analysis revealed that the PT was effective
in placing students at different levels of the foundation program (FP) and the statistical analyses
conducted to test the reliability and validity showed positive results for most of the test versions.
The study offers useful insights to test developers and policymakers regarding the authentication of
in-house tests and the creation of guidelines for PT design and evaluation.
Member of
Category
Journal articles