Reading List

EDMS 738, Spring 2004: Theory-Based Task Design

Prof. Robert J. Mislevy

Textbook

Irvine, S.H., & Kyllonen, P.C. (Eds.), Item generation for test development. Hillsdale, NJ: Erlbaum. ISBN 0-8058-0593-1

Papers available in hardcopy

Baxter, G. P., Elder, A. D., & Glaser, R., (1996). Knowledge-based cognition and performance assessment in the science classroom. Educational Psychologist, 31 (2), 133-140.

Hively, W., Patterson, H.L., & Page, S.H. (1968). A "universe-defined" system of arithmetic achievement tests. Journal of Educational Measurement, 5, 275-290.

Katz, I. R. (1994). Coping with the complexity of design: Avoiding conflicts and prioritizing constraints. In A. Ram, N. Nersessian, & M. Recker (Eds.), Proceedings of the Sixteeth Annual Meeting of the Cognitive Science Society. Hillsdale, NJ: Erlbaum.

Papers available on the Web

Almond, R.G., Steinberg, L.S., & Mislevy, R.J. (2002). Enhancing the design and delivery of assessment systems: A four-process architecture. Journal of Technology, Learning, and Assessment, 1(5) [online journal]. http://www.bc.edu/research/intasc/jtla/journal/v1n5.shtml

Mislevy et al., (2003, January). Design Patterns for Assessing Science Inquiry. PADI Technical Report 1. SRI International, Menlo Park, CA. http://padi.sri.com/downloads/PADI_DesignPatterns.pdf

Mislevy, R.J. (in press). Substance and structure in assessment arguments. Law, Probability, and Risk. Available as CSE Technical Report 605. Los Angeles, CA: Los Angeles: The National Center for Research on Evaluation, Standards, Student Testing (CRESST), Center for Studies in Education, UCLA. http://www.cse.ucla.edu/reports/R605.pdf

Mislevy, R.J., Almond, R.G., & Lukas, J.F. (2003). A brief introduction to evidence-centered design. CSE Technical Report / ETS Research Report RR-03-16. Los Angeles, CA: Los Angeles: The National Center for Research on Evaluation, Standards, Student Testing (CRESST), Center for Studies in Education, UCLA. http://www.education.umd.edu/EDMS/mislevy/papers/BriefIntroECD.pdf

Mislevy, R.J., Steinberg, L.S., & Almond, R.A. (2002). Design and analysis in task-based language assessment. Language Assessment, 19, 477-496. Available as CSE Technical Report 579. Los Angeles, CA: Los Angeles: The National Center for Research on Evaluation, Standards, Student Testing (CRESST), Center for Studies in Education, UCLA. http://www.cse.ucla.edu/reports/TR579.pdf

Mislevy, R.J., Steinberg, L.S., & Almond, R.A. (2003). On the structure of educational assessments. Measurement: Interdisciplinary Research and Perspectives, 1, 3-66. Available as CSE Technical Report 597. Los Angeles, CA: Los Angeles: The National Center for Research on Evaluation, Standards, Student Testing (CRESST), Center for Studies in Education, UCLA. http://www.education.umd.edu/EDMS/mislevy/papers/structure.pdf

Mislevy, R.J., Steinberg, L.S., Breyer, F.J., Almond, R.G., & Johnson, L. (1999). A cognitive task analysis, with implications for designing a simulation-based assessment system. Computers and Human Behavior, 15, 335-374. Available as CSE Technical Report 487. Los Angeles, CA: Los Angeles: The National Center for Research on Evaluation, Standards, Student Testing (CRESST), Center for Studies in Education, UCLA. http://www.cse.ucla.edu/Reports/TECH487.PDF

Mislevy, R.J., Steinberg, L.S., Breyer, F.J., Almond, R.G., & Johnson, L. (2002). Making sense of data from complex assessments. Applied Measurement in Education, 15, 363-378. Available as CSE Technical Report 538. Los Angeles, CA: Los Angeles: The National Center for Research on Evaluation, Standards, Student Testing (CRESST), Center for Studies in Education, UCLA. http://www.education.umd.edu/EDMS/mislevy/papers/MakingSense.pdf

Web sites

WebLAS http://www.weblas.ucla.edu/

This is the central works-in-progress site for the Web-based Language Assessment System (WebLAS) project at UCLA. The material here represent collaboration efforts of the Principal Investigator, Dr. Lyle Bachman, the Language Subject-Matter Experts, and the WebLAS Software Development Team in a joint conjunction between Applied Linguistics and the Center for Digital Humanities.

GLOBE http://globeassessment.sri.com/

The GLOBE Classroom Assessment site, designed and developed by the Center for Technology in Learning (CTL) at SRI International, provides sample student assessment tools and frameworks to provide teachers and students with evidence about progress on GLOBE program goals.