AMBIENTUM BIOETHICA BIOLOGIA CHEMIA DIGITALIA DRAMATICA EDUCATIO ARTIS GYMNAST. ENGINEERING EPHEMERIDES EUROPAEA GEOGRAPHIA GEOLOGIA HISTORIA HISTORIA ARTIUM INFORMATICA IURISPRUDENTIA MATHEMATICA MUSICA NEGOTIA OECONOMICA PHILOLOGIA PHILOSOPHIA PHYSICA POLITICA PSYCHOLOGIA-PAEDAGOGIA SOCIOLOGIA THEOLOGIA CATHOLICA THEOLOGIA CATHOLICA LATIN THEOLOGIA GR.-CATH. VARAD THEOLOGIA ORTHODOXA THEOLOGIA REF. TRANSYLVAN
The STUDIA UNIVERSITATIS BABEŞ-BOLYAI issue article summary
The summary of the selected article appears at the bottom of the page. In order to get back to the contents of the issue this article belongs to you have to access the link from the title. In order to see all the articles of the archive which have as author/co-author one of the authors mentioned below, you have to access the link from the author's name.
Authors: DINA VÎLCU.
DOI: https://doi.org/10.24193/subbphilo.2017.2.08
Published Online: 2017-06-25
Published Print: 2017-06-30
FULL PDF
The Calculation of Cut off Score in Romanian as a Foreign Language Pretest and Examinations. While our educational and professional lives have been deeply influenced by our language abilities, companies and institutions rely more and more on formal evidence of these. Thus, organisations issuing language certificates have a great responsibility, related to the quality of the tests that they apply and the validity and reliability of the examinations. An essential element in this whole process is the cut off score, which needs to be set in relation with the purpose of the examination, the structure and the input of the test and the characteristics of the test taking population. The calculation of the cut off score in relation with these factors became central to the examination process for Romanian as a foreign language at Babeș-Bolyai University. The way in which this is set was decided in preparation for the auditing process with ALTE (the Association of Language Testers in Europe), an audit which our suit of examinations passed successfully. We apply the method of contrastive groups, based on the expertise of the test takers’ teachers and on the students’ results for every component of the examination and of pretest. Thus, the limit of passing/failing an examination is not set beforehand and just applied to each examination, all relevant factors being, instead, considered. The procedure we implemented for the calculation resulted in a higher reliability of the test takers’ results and also of the tests in the long term.
Keywords: language examinations, pretest, test component, cut off score, contrasting groups, test takers, bio data, data processing.
Bibliography
Bachman, Lyle F., Palmer, Adrian S., Language Testing in Practice. Designing and Developing Useful Language Tests, Oxford, Oxford University Press, 1996.
Cizek, Gregory (Ed.), 2001, Setting performance standards: Theory and applications, Routledge.
Cizek, Gregory, 1993, “Reconsidering Standards and Criteria”, in Journal of Educational Measurement, Vol. 30, Issue 2, p. 93-106.
Council of Europe, 2001, Common European Framework of Reference for Languages: Learning, Teaching, Assessment, Cambridge University Press, Cambridge. http://www.coe.int/t/dg4/linguistic/Source/Framework_EN.pdf
Horn et al., Cut scores: results may vary, 2000, NBETPP, Monographs, vol I, No. 1, 2000, p. 1-31.
Kane, Michael, Crooks, Terence, Cohen, Allan, “Validating Measures of Performance”, in Educational Measurement. Issues and Practice, Vol. 18, Issue 2, 1999, p. 5-17.
Kaftandjieva, Felianka, Methods for Setting Cut Scores in Criterion-referenced Achievement Tests. A Comparative analysis of six recent methods with an application to tests of reading in EFL, CITO, Arnhem, 2010.
Livingston, Samuel A, Zieky, Michael J, 1982, Passing scores: A Manual for Setting Standards on Performance on Educational and Occupational Tests, Educational Testing Service.
Principles of Good Practice for ALTE Examinations. Revised draft October 2001. (http://www.alte.org/attachments/files/good_practice.pdf)
Relating Language Examinations to the Common European Framework of Reference for Languages: Learning, teaching, assessment. A Manual, accompanied by Further Material on Maintaining Standards across Languages, Contexts and Administrations by exploiting Teacher Judgment and IRT Scaling, Strasbourg, Council of Europe, Language Policy Division, 2009. http://www.coe.int/t/dg4/linguistic/manuel1_en.asp
Spolski, Bernard, “Introduction. Language Testing at 25: Maturity and responsibility?” in Language Testing, 2008, 25 (3), p. 297-305.
