Calibrating Standards-based Assessment Tasks for English as a First Foreign Language. Standard-setting Procedures in Germany

von: Claudia Harsch, Hans Anand Pant, Olaf Köller (Hrsg.)

Waxmann Verlag GmbH, 2010

ISBN: 9783830972990 , 167 Seiten

Format: PDF, OL

Kopierschutz: frei

Windows PC,Mac OSX für alle DRM-fähigen eReader Apple iPad, Android Tablet PC's Online-Lesen für: Windows PC,Mac OSX,Linux

Preis: 19,90 EUR

Mehr zum Inhalt

Calibrating Standards-based Assessment Tasks for English as a First Foreign Language. Standard-setting Procedures in Germany


 

Table of Contents

6

Preamble

8

Chapter 1: Setting Standards in Line with the Common European Framework of Reference

10

1.1 Educational Standards and Standards-based Assessment

12

1.2 Relating IQB Tests to CEF-levels

19

1.3 Rationale for Selecting the Item Pool

27

1.4 Description of Panelists

29

1.5 Standard-setting Procedure at IQB

31

1.6 Research into Validity of the Standard-setting Procedure ( DFG Research Grant)

35

Chapter 2: Standard- setting Item Pool

36

2.1 Overview of Pilot Study Design

38

2.2 Methodology

41

2.3 Analyses for Reading and Listening Comprehension Scales

42

2.4 Analyses for Written Expression Scale

46

2.5 Descriptive Summary Statistics

48

2.6 Results from Multi-faceted Rasch Analyses

51

Chapter 3: The Bookmark Standard- setting Method

56

3.1 Background

58

3.2 Bookmark Standard-setting Method

59

3.3 Standard-setting Workshop Results

65

Chapter 4: The Standard- setting Criterion Mapping Method

68

4.1 Background

70

4.2 Preparation

73

Chapter 5: Procedural Standard- setting Issues

80

5.1 Criterion Mapping

82

5.2 Bookmark

92

5.3 Summary and Conclusions

105

Chapter 6: Comparison and Synthesis of Multiple Standard- setting Methods and Panels

106

6.1 Setting Educational Standards

108

6.2 The Standard-setting Study

108

6.3 General Conclusions

111

6.4 Synthesizing and Reporting Results

111

Appendices

120

Appendix A

122

Appendix B

125

Appendix C

130

Appendix D

147

Appendix E

149

Appendix F

152

Appendix G

155

Appendix H

157

Appendix I

159