Maryland Assessment Research Center (MARC)

Technical Reports

  • Jiao, H., Yadav, C., & Sharh, N. (2023). Automated scoring of the NAEP math constructed-response items (Technical Report). Submitted to the 2023 NAEP Math Item Automated Scoring Competition.

  • Xu*, S., Fisk*, C., Jiao, H., & Lissitz, R. W. (2023). Comparison of pre-smoothing and post-smoothing using Equate (R package) and LEGS (MARC Research Report). College Park, MD: University of Maryland.

  • Li*, G., Jiao, H., & Lissitz, R. W. (2023). Comparing propensity matching and weighting in producing equivalent groups for linking (MARC Research Report). College Park, MD: University of Maryland.

  • Jiao, H., Xu*, S., Fisk*, C., & Lissitz, R. W. (2023). Investigating Maryland students’ high school academic performance indictors as college and career readiness measures (MARC Research Report). College Park, MD: University of Maryland.

  • Ren*, J., Jiao, H., Han*, Y., & Lissitz, R. W. (2022). Further exploration of the relationship between Maryland students’ high school academic performance and their post-secondary academic achievements (MARC Research Report). College Park, MD: University of Maryland.

  • Tian*, C, Xu*, S., Jiao, H., Han*, Y., Yang*, H., & Lissitz, R. W. (2022). Exploring the relationship between Maryland students’ high school academic performance and their post- secondary academic achievements (MARC Research Report). College Park, MD: University of Maryland

  • Tian*, C, Jiao, H., Han*, Y., & Lissitz, R. W. (2022). Exploring the relationship between Advanced Placement (AP) exam performance and the post-secondary academic achievements (MARC Research Report). College Park, MD: University of Maryland.

  • Xu*, S., Tian*, C, Jiao, H., Han*, Y., Yang*, H., & Lissitz, R. W. (2021). Combining instructionally embedded test scores to obtain scores equivalent to year-end test scores (MARC Research Report). College Park, MD: University of Maryland.

  • Xu*, S., Tian*, C, Xin*, Q., Jiao, H., & Lissitz, R. W. (2021). Alignment of the SAT mathematics items and the PARCC Algebra I items to the Maryland Algebra I College and Career Ready Standards (MARC Research Report). College Park, MD: University of Maryland.

  • Qiao*, X., Jiao, H., & Lissitz, R. W. (2021). Student engagement in remote testing (MARC Research Report). College Park, MD: University of Maryland.

  • Xu*, S., Jiao, H., & Lissitz, R. W. (2021). Virtual standard setting: Issues and practices (MARC Research Report). College Park, MD: University of Maryland.

  • Tian*, C., Jiao, H., & Lissitz, R. W. (2021). Detection of cheating in remote testing (MARC Research Report). College Park, MD: University of Maryland.

  • Silbert, N., Campbell, S. G., Jiao, H., Lissitz, R., Piety, P., Tausczik, Y., Carter, B., Hughes, M., Jerome, B., Register, B., Sheehan, P., Hwang, B., Siegel, A., & Pandza, N. B. (2020). United States Air Force Computer Language Proficiency Test (CLPT): proposed test content (ARL-1917 Obj. 10 Technical Report). College Park: University of Maryland Applied Research Lab for Intelligence & Security.

  • Silbert, N., Campbell, S. G., Jiao, H., Lissitz, R., Piety, P., Tausczik, Y., Carter, B., Hughes, M., Jerome, B., Register, B., Sheehan, P., Hwang, B., Siegel, A., & Pandza, N. B. (2020). United States Air Force Computer Language Proficiency Test (CLPT): proposed test format (ARL-1917 Obj. 8 Technical Report). College Park: University of Maryland Applied Research Lab for Intelligence & Security.

  • Silbert, N., Campbell, S. G., Jiao, H., Lissitz, R., Piety, P., Tausczik, Y., Carter, B., Hughes, M., Jerome, B., Register, B., Sheehan, P., Hwang, B., Siegel, A., & Pandza, N. B. (2020). United States Air Force Computer Language Proficiency Test (CLPT): proposed scoring levels & outcomes (ARL-1917 Obj. 9 Technical Report). College Park: University of Maryland Applied Research Lab for Intelligence & Security.

  • Qiao*, X., Liao*, M., Jiao, H., & Lissitz, R. W. (2020). Transition weights in value tables for growth measure (MARC Research Report). College Park, MD: University of Maryland.

  • Liao*, M., Qiao*, X., Jiao, H., & Lissitz, R. W. (2019). Investigating the relationship between SAT scores and post-secondary outcomes (MARC Research Report). College Park, MD: University of Maryland.

  • Qiao*, X., Jiao, H., & Lissitz, R.W. (2019). Investigating the Concordance Relationship Between the HSA Cut Scores and the PARCC Cut Scores Using the 2018 PARCC Test Data. (MARC research Report). College Park, MD: University of Maryland.

  • Liao*, M., Qiao*, X., Jiao, H., & Lissitz, R. W. (2019). Investigating the relationship between the PARCC test scores and post-secondary outcomes (MARC Research Report). College Park, MD: University of Maryland.

  • Liao*, M., Lee*, J., Jiao, H., & Lissitz, R. W. (2019). Maryland state student growth percentile on Multi-State Alternate Assessment (MARC Research Report). College Park, MD: University of Maryland.

  • Qiao*, X., Jiao, H., & Lissitz, R.W. (2017). Combined Score Options for High School Graduation Assessment. (MARC research Report). College Park, MD: University of Maryland.

  • Liao*, D., Liao*, M., Qiao*, X., Jiao, H., & Lissitz, R.W. (2017). Investigating the Concordance Relationship Between the HSA Cut Scores and the PARCC Cut Scores Using the 2017 PARCC Test Data. (MARC research Report). College Park, MD: University of Maryland.

  • Liao*, M., Liao*, D., Jiao, H., & Lissitz, R. W. (2017). The relationship between the PARCC test scores and the college admission tests: SAT/ACT/PSAT (MARC Research Report). College Park, MD: University of Maryland.

  • Zou*, J., Liao*, D., Liao*, M., Jiao, H., & Lissitz, R. W. (2017). Investigating invariance of the concordance relationship between the HSA cut scores and PARCC cut scores using the 2017 test data (MARC Research Report). College Park, MD: University of Maryland.

  • Liao*, M., Liao*, D., Jiao, H., & Lissitz, R. W. (2017). Investigating invariance of the relationship between the PARCC test scores and the college admission tests: SAT/ACT/PSAT across years (MARC Research Report). College Park, MD: University of Maryland.

  • Chen*, L., Jiao, H., & Lissitz, R. W. (2017). Investigating invariance of the concordance relationship between the MSA cut scores and PARCC cut scores across years (MARC Research Report). College Park, MD: University of Maryland.

  • Chen*, L., Liao*, M., Liao*, D., Zou*, J., Jiao, H., & Lissitz, R. W. (2016). Maryland State student subgroup performance on 2016 PARCC tests (MARC Research Report). College Park, MD: University of Maryland.

  • Zou*, J., Liao*, M., Jiao, H., & Lissitz, R. W. (2016). Maryland State student performance on 2016 PARCC tests (MARC Research Report). College Park, MD: University of Maryland.

  • Chen*, L., Zou*, J. Jiao, H., & Lissitz, R. W. (2016). Investigating the concordance relationship between the MSA cut scores and PARCC cut scores (MARC Research Report). College Park, MD: University of Maryland.

  • Jiao, H., Zou*, J., Liao*, D., Li*, C., & Lissitz, R. W. (2016). Investigating the concordance relationship between the HSA cut scores and PARCC cut scores (MARC Research Report). College Park, MD: University of Maryland.

  • Bryant*, R., Jiao, H., & Lissitz, R. W. (2016). An investigation of NYC students’ performance and experience with the 2015 PARCC pilot tests (Research report submitted to PARCC Inc.). College Park, MD: University of Maryland.

  • Liao*, D., Li*, C., Jiao, H., & Lissitz, R. W. (2015). Investigating the relationship between the PARCC test scores and the college admission tests: SAT/ACT/PSAT (MARC Research Report). College Park, MD: University of Maryland.

  • Liao*, D., Jiao, H., & Lissitz, R. W. (2015). Comparison of different approaches to dealing with directional local item dependence in multipart items (MARC Research Report). College Park, MD: University of Maryland.

  • Li*, M., Jiao, H., & Lissitz, R. W. (2015). The impact of ignoring multiple-group structure in testlet-based tests on ability estimation (MARC Research Report). College Park, MD: University of Maryland.

  • Kang*, Y., Jiao, H., & Lissitz, R. W. (2015). The impact of ignoring the multiple-group structure of item response data (MARC Research Report). College Park, MD: University of Maryland.

  • Lee*, D., Jiao, H., & Lissitz, R. W. (2015). Comparison of latent trait and latent class-based models for cognitive diagnosis (MARC Research Report). College Park, MD: University of Maryland.

  • Jiao, H. (2014). Differential item functioning analysis for testlet-based assessments. (Research Report submitted to the Governing Board for the AERA Grants Program). College Park, MD: University of Maryland.

  • Jiao, H., Haynie, K., & Liu*, J. (2011). A partial credit modeling study of the NCLEX innovative items. (Research Report submitted to the Joint Research Committee, NCSBN). College Park, MD: University of Maryland.

  • Jiao, H., Lissitz, R., & Hou*, X. (2010). Computer-based testing in the K-12 state assessments. (MARCES Technical Report). College Park, MD: University of Maryland.

  • Lissitz, R., Li*, Y., & Jiao, H. (2009). Investigation of Factorial Structure of the 2009 HSA Biology Test across Accommodated and non-accommodated Students. (MARCES Technical Report). College Park, MD: University of Maryland.

  • Jiao, H., Wang, S., Johnson, M., & Jiang, J. (2007). Investigation of 2006 FCAT Reading Grade 3 Test. (Research Report). San Antonio, TX: Harcourt Assessment.

  • Jiao, H. (2007). The calibration, equating, and scaling specification for the spring 2007 test administration for the Mississippi Subject Area Testing Program. (Technical Report). San Antonio, TX: Harcourt Assessment.

  • Technical Report for the Michigan Educational Assessment Program 2006-2007 Cycle. (2007). Harcourt Assessment Inc. San Antonio, TX.

  • Technical Report for the Michigan Merit Exit Program 2006-2007 Cycle. (2007). Harcourt Assessment Inc. San Antonio, TX.

  • Jiao, H. (2007). The calibration, equating, and scaling specification for the fall 2006 test administration for the Mississippi Subject Area Testing Program. (Technical Report). San Antonio, TX: Harcourt Assessment.

  • Jiao, H. (2006). Sampling Design for the Michigan Educational Assessment Program. (Technical Report). San Antonio, TX: Harcourt Assessment.

  • Vukmirovic, Z., & Jiao, H. (2006). Calibration and equating options for FCAT writing + assessment. (White Paper). San Antonio, TX: Harcourt Assessment.

  • Jiao, H. (2006). Test Construction Specification for the Michigan Educational Assessment Program. (Technical Report). San Antonio, TX: Harcourt Assessment.

  • Jiao, H., Wang, S., He, W., & Vukmirovic, Z. (2006). The comparability of the spring 2006 online pilot test and the paper-and-pencil tests for the Mississippi Subject Area Testing Program. (Research Report). San Antonio, TX: Harcourt Assessment.

  • Jiao, H. (2006). The test construction specification for the fall 2006 and spring 2007 test administrations for the Mississippi Subject Area Testing Program. (Technical Report). San Antonio, TX: Harcourt Assessment.

  • Jiao, H. (2006). The calibration, equating, and scaling specification for the spring 2006 test administration for the Mississippi Subject Area Testing Program. (Technical Report). San Antonio, TX: Harcourt Assessment.

  • Jiao, H., & Vukmirovic, Z. (2006). The calibration, equating, and scaling specification for the Fall 2005 test administration for the Mississippi Subject Area Testing Program. (Technical Report). San Antonio, TX: Harcourt Assessment.

  • Vukmirovic, Z., Jiang, J., & Jiao, H. (2005). Comparison of different scoring methods of FCAT writing + assessments. (Research Report). San Antonio, TX: Harcourt Assessment.

  • Jiao, H., & Vukmirovic, Z. (2005). The comparability of the spring 2005 online pilot test and the paper-and-pencil tests for Mississippi Subject Area Testing Program. (Research Report). San Antonio, TX: Harcourt Assessment.

  • Jiao, H. (2005). The test construction specification for the fall 2005 and spring 2006 test administrations for the Mississippi Subject Area Testing Program. (Technical Report). San Antonio, TX: Harcourt Assessment.

  • Jiao, H., & Vukmirovic, Z. (2005). The calibration, equating, and scaling specification for the spring 2005 test administration for the Mississippi Subject Area Testing Program. (Technical Report). San Antonio, TX: Harcourt Assessment.

  • Jiao, H., Ayres, G, & Vukmirovic, Z. (2005). Pre-equating vs. post-equating for Mississippi Subject Area Testing Program. (Research Report). San Antonio, TX: Harcourt Assessment.

  • Jiao, H., Ayres, G., & Vukmirovic, Z. (2005). Impact of removing open-ended items from live administration for Mississippi Subject Area Testing Program. (Research Report). San Antonio, TX: Harcourt Assessment.

  • Jiao, H., Chu, K., & Vukmirovic, Z. (2005). Comparison of writing prompts in field-test and live administration for Mississippi Subject Area Testing Program. (Research Report). San Antonio, TX: Harcourt Assessment.

  • Wang, S, Jiao, H., Young, M. J., Brooks, T., & Olson, J. (2005). The effect of computerized test vs. paper-and-pencil test on K-12 student reading achievement: A meta-analysis. (Research Report). San Antonio, TX: Harcourt Assessment.

  • Jiao, H., Wang, S., Vukmirovic, Z., & Young, M. (2004). A Study to Establishing the Vertical Scale for MCA-II Using the Stanford Achievement Test 10. (Research Report). San Antonio, TX: Harcourt Assessment.

  • Jiao, H., Wang, S. & Vukmirovic, Z. (2004). Dimensionality Assessment for MCAS Grade 4, 7, and 10 ELA 2003 Test Administration. (Research Report). San Antonio, TX: Harcourt Assessment.

  • Jiao, H., & Vukmirovic, Z. (2004). Test construction specifications for Minnesota Academic Assessments-II 2005 pilot test administration. (Technical report). Harcourt Assessment, Inc. San Antonio, TX.

  • Wang, S., Jiao, H., Young, M. J., Brooks, T., & Olson, J. (2004). The effect of computerized test vs. paper-and-pencil test on K-12 student mathematics achievement: A meta-analysis. (Research Report). San Antonio, TX: Harcourt Assessment.

  • Wang, S., Jiao, H., Brooks, T., & Young, M. J. (2004). Construct equivalence of Stanford Diagnostic Reading Test (Fourth Edition) between two administration modes. (Research Report). San Antonio, TX: Harcourt Assessment.

  • Wang, S., Jiao, H., Young, M. J., & Brooks, T. (2004). Construct equivalence between customized and original Stanford Achievement Reading Comprehension Tests (Tenth Edition). (Research Report). San Antonio, TX: Harcourt Assessment.

  • Davis, J., Jiao, H., Vukmirovic, A., & Young, M. J. (2004). Comparison between pre-equating and post-equating for large-scale state assessment program. (Research report), Harcourt Assessment Inc. San Antonio, TX.

  • Stephenson, A., Jiao, H., & Wall, N. (2004). A performance comparison of native and Non- native speakers of English on an English Language Proficiency Test. (Research report). Harcourt Assessment, Inc. San Antonio, TX.

  • Nevada Technical Report for the CRT and HSPE Assessments 2002-2003 Cycle. (2004). Harcourt Assessment Inc. San Antonio, TX.

  • Jiao, H., & Paek, I. (2002). Examining the relationship between the full and the abbreviated versions of the Stanford Diagnostic Tests for Reading and Mathematics. Harcourt Educational Measurement. San Antonio, TX.

  • Cerrillo, T., Young, M. J., Skorupski, W., Jiao, H., Paek, I., Shin, S., & Turner, J. (2002). Performance Assessment research program: Analyses of bias and Differential Item Functioning on the New Standards Reference Examinations (Form E). Harcourt Educational Measurement, San Antonio, TX.******

  • Jiao, H. (2018, June). Development and modeling of technology-enhanced innovative assessment. Presented at East China Normal University, Shanghai, China.

  • Jiao, H. (2018, June). Modeling of technology-enhanced innovative assessment data. Presented at Beijing Normal University, Beijing, China.

  • Jiao, H. (2018, June). Joint modeling for product data and process data for cognitive diagnosis. Presented at Jianxi Normal University, Nanchang, Jiangxi Province, China.

  • Jiao, H& Zhan, P. (2018, July). Technology-enhanced innovative science assessment. Presented at the National Conference on STEM Education in China, Shenzhen, China.

  • Liao, D., Liao, M., Qiao, X., Jiao, H., & Lissitz, R.W. (2017). Investigating the concordance relationship between the HSA cut scores and the PARCC cut scores using the 2017 PARCC test data. (MARC research Report). College Park, MD: University of Maryland.
  • Liao, M., Liao, D., Jiao, H., & Lissitz, R.W. (2017). The relationship between the PARCC test scores and the college admission tests using the 2017 PARCC: SAT/ACT/PSAT. (MARC research Report). College Park, MD: University of Maryland.
  • Liao, M., Liao, D., Jiao, H., & Lissitz, R.W. (2017). Validating the relationship between the PARCC test scores and the college admission tests. (MARC research Report). College Park, MD: University of Maryland.
  • Qiao, X., Jiao, H., & Lissitz, R.W. (2017). Combined Score Options for High School Graduation Assessment. (MARC research Report). College Park, MD: University of Maryland.
  • Jiao, H., Zhan, P., Liao, M., & Man, K. (2017, November). A joint multigroup testlet model for responses and response time accounting for differential item and speed functioning. Presented at the fifth conference on the statistical methods in psychometrics. Columbia University, New York.
  • Chen, L., Liao, M., Liao, D., Zou, J., Jiao, H., & Lissitz, R. W. (2016). Maryland State student subgroup performance on 2016 PARCC tests (MARC Research Report). College Park, MD: University of Maryland.
  • Zou, J., Liao, M., Jiao, H., & Lissitz, R. W. (2016). Maryland State student performance on 2016 PARCC tests (MARC Research Report). College Park, MD: University of Maryland.
  • Jiao, H., Zou, J., Liao, D., Li, C., & Lissitz, R. W. (2016). Investigating the concordance relationship between the HSA cut scores and PARCC cut scores (MARC Research Report). College Park, MD: University of Maryland.
  • Liao, D., Li, C., Jiao, H., & Lissitz, R. W. (2015). Investigating the relationship between the PARCC test scores and the college admission tests: SAT/ACT/PSAT (MARC Technical Report). College Park, MD: University of Maryland.
  • Liao, D., Jiao, H., & Lissitz, R. W. (2015). Comparison of different approaches to dealing with directional local item dependence in multipart items (MARC Technical Report). College Park, MD: University of Maryland.
  • Jiao, H. (2014). Differential item functioning analysis for testlet-based assessments. (Research Report submitted to the Governing Board for the AERA Grants Program). College Park, MD: University of Maryland.
  • Jiao, H., Lissitz, R., & Hou, X. (2010). Computer-based testing in the K-12 state assessments. (MARCES Technical Report). College Park, MD: University of Maryland.
  • Lissitz, R., Li, Y., & Jiao, H. (2009). Investigation of Factorial Structure of the 2009 HSA Biology Test across Accommodated and non-accommodated Students. (MARCES Technical Report). College Park, MD: University of Maryland.
  • Jiao, H., & Lissitz, R. (2014, October). Exploring psychometric models for calibrating innovative items embedded in situations. Presented at the Fourteenth Annual Maryland Assessment Conference: Technology enhanced innovative assessment: Development, modeling, and scoring from an interdisciplinary perspective. University of Maryland, College Park.
  • Jiao, H., Kamata, A., & Xie, C. (2014, November). Multilevel cross-classified testlet model for complex item and person clustering in item response modeling. To be presented at the conference on Advances in multilevel modeling for educational research: Addressing practical issues found in real-world applications. University of Maryland, College Park.
  • Jiao, H., & Yang, X. (2014, May). A multicomponent testlet model. Presented at the Third Workshop on Statistical Methods in Cognitive Assessments. Fudan University, Shanghai, China.
  • Jiao, H. (2014, February). Polytomous multilevel testlet models for testlet-based assessments with complex sampling designs. Presented at the Joint Program in Survey Methodology, University of Maryland, College Park.