《英语教学中的测试与评价方法ppt课件.ppt》由会员分享，可在线阅读，更多相关《英语教学中的测试与评价方法ppt课件.ppt（83页珍藏版）》请在三一办公上搜索。
1、Testing & Assessment in ELT英语教学中的测试与评价方法,Outline,1. A sketchy history2. Types of language tests 3. Testing techniques 4. Criteria for good language tests 5. Constructing multiple-choice questions 6. Critical discussion,1. History of Langauge Testing and Assessment,A Sketchy History,1.1 Pre-scientifi
2、c Stage前科学阶段1.2 Psychometric-Structuralist Testing Stage心理测量学-结构主义测试阶段1.3 Integrative-Sociolinguistic Testing Stage 综合-社会语言学测试阶段1.4 Pragmatic and Communicative Testing Stage语用交际测试阶段,1.1 Pre-scientific Stage,Before the 1940sGrammar-translation method 语法翻译法Traditional testing approach,Traditional Test
3、ing Approach,What: grammatical rules, word formation, word usageHow: written test, no oral testQuestion type: subjective, like translation, composition, written questions,1.2 Psychometric-Structuralist Testing心理测量-结构主义测试,Since the 1950sTheoretical guidance FeaturesAudiolingual method 听说法 Discrete-po
4、int testing approach(分项测验/分立式测验),理论基础：语言学中的结构主义语言观：语言=语音+词汇+句式+语法，语言能力可以分解为具体的部分来考查。心理学中的行为主义教育论：刺激反应式学习方式，反复练习。心理测量学：依据一定的心理学理论，运用一定的操作程序，把人的知识、能力、性格、态度等心理特性和行为进行量化。,Emphasizing reliability （信度）and validity （效度）Emphasizing objective and accurate assessment, Objective questions dominate, particularl
5、y multiple choices.Analyzing testing results statistically Enjoying a high reliability 信度高,Discrete-point Testing,A question only assesses one language pointTesting: conducted at different levels of language structure 语言层面Language proficiency：being assessed from the aspects of listening, speaking, r
6、eading and writing 技能层面,1.3 Integrative-Sociolinguistic Testing 综合-社会语言学测试,Since the mid-1970s （动态语言观）Integrative skill tests 综合技能测试Assess a learners ability to use many bits at the same time. Question types：cloze/composition/oral interview, etc.,1.4 Pragmatic & Communicative Testing Stage语用交际测试阶段,F
7、rom the 1980s (功能语言观)Communicative approachFrom language usage to language usePragmatic approach,Integrity of language/whole languageAssessing with tasksAccuracy, fluency and appropriatenessCommunicative competence,2. Types of Language Tests,Types of Language Tests,Formative 标准参照性和常模参照性Tests Classif
8、ied According to Testing PurposesDiscrete-point & Integrative Tests 分立式和综合测试High stakes & Low-stakes Tests 高风险和低风险,2.1 Formative & Summative,Formative Assessment:Being carried out throughtout the course; Diagnostic purpose; Assessment for learning; Teacher or learner-initiated,Summative Assessment:B
9、eing carried out at the end of a course; Grading purpose, assign a course grade; Assessment of learning; Teacher-initiated,2.2 Criterion-referenced & Norm-referenced,Criterion-referenced Assessment: A way of measuring candidates against defined (and objective) criteria; Relatively consistentBeing us
10、ed to establish a persons competence; Examples: Driving tests, IELTS, TEM, etc.,Norm-referenced Assessment: A way of comparing candidates to identify whether the test taker performed better or worse than other test takers; Varying from year to year; Being used for selection; Examples: CEE (gaokao),
11、TOEFL,2.3 Objective & Subjective,Objective Assessment: A single correct answer; Objective scoring, no judgment on the part of the scorer. Examples: true/false, multiple choice, matching questions.,Subjective Assessment: More than one way of expressing the correct answer; Subective scoring, calling f
12、or judgment on the part of the scorer. Examples: extended-response questions and essays.,2.4 Tests Classified According to Testing Purposes,Proficiency Test 水平测试、能力测试Achievement Test 成绩测试、学业测试Placement Test 分级测试、分班测试Aptitude Test 能力倾向测试、学能测试Diagnostic Test 诊断测试,Proficiency Test,Measuring language pr
13、oficiencyThe content 考试内容: Not based on the content of a language course which people taking the test may have followed. It is based on a specification of what candidates have to be able to do in the language in order to be considered proficient.Examples: SAT, ACT, CEE, IELTS, PSC, PETS, BEC,Achieve
14、ment Test,Examining how successful a student, a teacher, or a syllabus, or a method is.Being closely linked to the course material used in class. Final achievement tests are those administered at the end of a course of study. Progress achievement tests are intended to measure the progress that stude
15、nts are making.,Placement Test,To identify the appropriate stage of language course according to students ability.To assign students to the appropriate level of classes they should take.,Aptitude Test,Measuring the extent to which an individual possesses specific language learning abilityBeing usual
16、ly used for selection and diagnosis and for prediction of language learning success. Components of language aptitude:phonetic coding ability (sound discrimination and memory), grammatical sensitivity (recognizing the grammatical function of words), rote learning ability for new sound and meaning ind
17、uctive learning ability for language patterns,Diagnostic Test,To show students strengths and weaknesses.,2.5 Discrete-point & Integrative,Discrete-point Test: multiple-choice questionsIntegrative Test: Dictation, translation, composition, etc.When he saw his mother, the little boy stopped _. A. cryi
18、ng B. cry C. to cry D. cried One day, the wife of a Chinese king sat watching a worm as it ate some mulberry leaves. Soon it stopped _. Then, as it slowly turned its head from side _ side, a very fine thread came out of its _. It wrapped the thread around and around itself until it was shut _ a litt
19、le cocoon.,2.6 High- & Low-stakes Tests,A relative conceptHigh-stakes: a test with important consequences for the test taker. Examples:CEE, TEMLow-stakes: End-term Exam,测试种类总结,分类标准 测试类别学习阶段不同 形成性测试，终结性测试评分方式 客观性测试，主观性测试分数解释参照标准不同 标准参照测试，常模参照测试测试目的 水平测试/成绩测试/学能测试/分班测试/诊断测试测试语言技能的分合 分立式测试，综合式测试测试对用户影响
20、的大小 低风险测试，高风险测试,3. Testing Techniques,Testing Techniques,Multiple-choice 多项选择题（单选或复选）Gap-filling 填充题 Matching 配对题Transformation 句型转换题Cloze 完形填空题（填充或选择题）True/False 是非题，判断正误题 Error Correction 改错题Dictation 听写Open Questions 开放式问题Short Answer Qs简答题Essay Writing写作Translation翻译,3.1 Multiple-choice Question
21、s,An example: Noise made by a snake is called _. A mew B bark C hiss D quackStem + Choices/Alternatives (the correct choice and distractors),Advantages:Efficiency NeutralityUniversalityResponse clarityDisadvantages:AmbiguityNo partial creditguessingTime-consuming for item consrtuction,3.2 Gap-fillin
22、g,An example:Eating too much fast food is not _. A hint：a root word (health), the first letter of the word (h_).,Advantages:Testing grammar or vocabularyEssy to gradeRelatively easy to construct. Disadvantages:Ambiguity: more than one possible correct answers.Parents owe their children a set of soli
23、d values _ which to build their lives. (around/on),3.3 Matching,Match the word on the left to the word with the opposite meaning.fat old young tallactive thinshort quietThis could be individual words, words and definitions, pictures to words etc.,Advantages:Testing vocabularyEasy to construct and gr
24、adeDisadvantages:Students may get the right answers without knowing all the words.,3.4 Transformation,This is an interesting book. (转为感叹句)What an interesting book this is!I went to bed after I finished my homework. I didnt go to bed until I finished my homework.It was not until I finished my homewor
25、k that I went to bed. Not until I finished my homework did I go to bed.A student has to rewrite a sentence based on an instruction or a key word given.,Advantages:Testing grammar and understanding of formFairly easy to gradeDisadvantages:A student may rewrite sentences to a formula.,3.5 Cloze 完形填空,C
26、omplete the text by adding a word to each gap. One day, the wife of a Chinese king sat watching a worm as it ate some mulberry leaves. Soon it stopped _. Then, as it slowly turned its head from side _ side, a very fine thread came out of its _. It wrapped the thread around and around itself until it
27、 was shut _ a little cocoon.,Advantages:Much more integrative; Effective for testing grammar, vocabulary and intensive reading;A good indicator of overall language proficiency.Disadvantages:There may have multiple correct answers.,3.6 True/False,Decide if the statement is true or false.England won t
28、he world cup in 1966. T/FThe candidate must decide if a statement is true or false.,Advantages:Test listening & reading comprehensionEasy to grade Disadvantages: Guessing can result in many correct answers.,3.7 Error Correction,Find the mistake in the sentence and correct them. He dont know why Tom
29、refused to speak to him.Errors must be found and corrected in a sentence or passage. It could be an extra word, words missed, mistakes with verb forms, etc.,Advantages:Useful for testing grammar and vocabulary as well as reading and listening comprehension.Disadvantages:Some errors can be corrected
30、in more than one way.,The Internet is playing a important part in 56 our daily life. On the net, we can learn about 57 news both home and abroad and some other 58 informations as well. We can also make phone calls, 59 send messages by e-mails, go to net schools, and 60 learn foreign languages by our
31、selves. Beside, we 61 can enjoy music, watch sports matches, and play the 62 chess or cards. The net even help us do shopping, 63 make a chat with others and make friends with them. 64 In a word, the Internet has made our life more easier. 65 ,3.8 Dictation,One of the oldest techniques known for the
32、 teaching and testing of foreign languages;Being closely related to grammar translation method;Testing spelling, listening and recognition.,Standard dictation 标准听写Partial dictation 部分听写Dictation with competing noise 干扰听写 Dictation-composition 听写作文Elicited imitation 复述听写,3.9 Open Questions,Answer the
33、 questions.Why did John steal the money?Here the candidate must answer simple questions after reading or listening or as part of an oral interview.,Advantages:Useful for testing any of the four skills, but less useful for testing grammar or vocabulary.Disadvantages:More difficult and time consuming
34、to gradeAn element of subjectivity involved in judging how complete the answer is.,3.10 Short Answer Questions,Requiring the learner to write a word, phrase, number or symbol;often based on a passage;Sometines with a limit of words in one answer (3-5 words),3.11 Essay Writing,Being widely usedOften
35、being criticized for their lack of objectivity.Requirements for writing:,用词正确语句通顺结构合理内容符合要求文体得当 (措辞和行文 正式-非正式)The two new senators have proved themselves exceptionally able (guys/men).Writing a letter to a close friend or writing a job application letter,Types of Essay Writing,单句写作He doesnt like dog
36、s as much as his wife does.His wife likes dogs better than him.组句成章（）They are students. （）Mr and Mrs White have two sons. （）Now Ben and Jerry are playing football with their father. （）Alice is only three. （）The boys have a sister, Alice. （）Their names are Ben And Jerry. （）Alice is sitting on the gra
37、ss with her mother.,Advantages:InegrativeDisadvantages:Difficult to score reliably and time-consuming to grade Often affected by handwriting, presence or spelling errors, grammar used the subjective judgments of the grader. Training of graders: time-consuming and needs to be repeated at frequent int
38、ervals throughout the grading.,3.12 Translation,Used method of testing in both classroom assessment and formal test.Criteria of good translation vary,4. General Criteria of Language Testing,4.1 Practicality,Factors to consider:Financial limitations; Time constraints; Ease of administration; Scoring.
39、,A test that is prohibitively expensive is impractical.A test that takes a students ten hours to complete is impractical.A test that requires individual one-to-one proctoring is impractical.A test that takes a few minutes for a student to take and several hours for an examiner to evaluate is impract
40、ical.A test that can be scored only by computer is impractical if the test takes place a thousand miles away from the nearest computer.,3.2 Reliability 信度,A consistent measure of performance. 可靠性/稳定性Sources of unreliability: the test itself or the scoring of the test, that is, test reliability and r
41、ater reliability.Test reliability: the consistency of results if giving the same test to the same subject on two different occasions. Scoring or rater reliability: the consistency of scoring by two or more scorers or by the same scorer on different occasions.,3.3 Validity 效度,The degree to which the
42、test actually measures what is intended to measure; Test what is important to test, not what is easy to test;The most complex and important criterion of a good test.,Types of Validity,Content validity 内容效度Construct validity 构念效度Face validity 表面效度Not what a test actually measures, but what it superfi
43、cially appears to measureCriterion validity 标准效度The extent to which the tests are related to concrete criteria in the real world,The extent to which a test is relevant and representative of what it is used to measure. 内容与测试目标是否有关测试内容是否具有代表性测试内容是否适合测试对象,The degree to which a test measures what it cla
44、ims to be measuring based on a theoretical guidance试题是否以有效的语言观为依据；“结构或构念”指整个考试的理论基础。,How to improve validity of a test:Specification of what is to be measured based on course syllubus; Construction of the test items;Review by experienced teachers and experts,4.4 Backwash 反拨作用,Backwash: the effect of
45、 testing on teaching and learning.Backwash can be harmful (teaching to the test）or beneficial (diagnostic and promoting improvement).,4.5 Difficulty and Discrimination,Index of difficulty 难度系数Discrimination 区分度 (区分考生能力的程度),5. Developing Multiple-Choice Questions,What to measure,To measure knowledge
46、recall as well as higher order thinking. Four types of content (facts, concepts, principles, and procedures) and five types of cognitive behaviors (recalling, understanding, predicting, evaluating, and problem solving).,Factual information,True FalseThe capital of Kentucky is Louisville.Multiple Cho
47、iceWhich city is the capital of Kentucky?A. FrankfortB. LexingtonC. LouisvilleD. Paducah,Higher order thinking,What is likely to happen to mortgage interest rates when interest rates on savings go up?A. IncreaseB. DecreaseC. No changeD. Unpredictable,True/False & Multiple Choice Questions,More time-
48、consuming for the teacher to construct good multiple-choice items than true/ false or completion items. The difficulty of finding suitable distractors, which are plausible. Plausible: the distractor must have the potential for being selected as the correct answer. Two distractors are as effective as
49、 three if one of the three is not plausible.,Reading level and reading speed of the students must be considered when constructing the items. To insure that one question or its distractors do not provide clues to the answer of another question.,Best answer items (measuring understanding, or interpret
50、ation) are usually more difficult than correct answer items. Which one of the following was the most important consideration in locating cities during frontier times in America?A. good farmlandB. access to waterways C. moderate temperature.D. easy to defend against attack by IndiansMay test the abil
