CAA International EALTS research

The validity and reliability of the CAAi EALTS are supported by an extensive programme of test development, observation, evaluation, review and research, all elements of which serve to reinforce the quality of the testing system.

Based on clear theoretical construct of spoken language communicative competence, the purpose and context of use of the CAAi EALT are transparent and appropriate to both the test-takers and other test-users alike.

Applying quality management systems of the Association of Language Testers in Europe, the CAAi EALTS test specifications and test materials have been developed by language training specialists, language assessment specialists and subject matter experts under the supervision of the EALTS Test Partners. This development has taken into account the expert judgement of external stakeholder groups and internal expert groups and the extensive feedback from test-takers involved in the trialing of the test.

Throughout the test preparation process strict guidelines have been followed in order to ensure that the materials conform to the test specifications, with procedures in place to determine and ensure the various components of test validity. Routine procedures are used to review and revise test items and test tasks to ensure the relevance and appropriateness of test content and that the topics or contexts of language use included will not introduce a bias against any particular group of candidates.

Data collection, analysis and research of test items and test tasks and of the CAAi EALTS examiners and assessors continue to ensure the on-going integrity, validity and reliability of the Testing System and its component parts. 1

1 ICAO Cir 318-AN/180 Ch.2 Test Validity and Reliability 2.2 A description of the development process accessible to test stake-holders is available in the CAA International EALTS Test Specification 2009.