{"id":140,"date":"2025-11-07T09:14:44","date_gmt":"2025-11-07T17:14:44","guid":{"rendered":"https:\/\/labs.wsu.edu\/caire\/?page_id=140"},"modified":"2026-08-18T11:51:03","modified_gmt":"2026-08-18T18:51:03","slug":"blog","status":"publish","type":"page","link":"https:\/\/labs.wsu.edu\/caire\/blog\/","title":{"rendered":"Featured Work"},"content":{"rendered":"\n

CAIRE’s Academic Highlights<\/h2>\n\n\n\n

Bridging the gap between artificial intelligence and real-world classrooms. Our research provides evidence-based insights and solutions that empower educators to enhance instructional quality.<\/p>\n\n\n\n

\n
\n

Track 1: AI-Assisted Instruction & Teacher Support<\/h2>\n\n
\n
\n
AIED<\/div>\n \"SciEval\n <\/div>\n \n
\n

SciEval: A Benchmark for Automatic Evaluation of K\u201312 Science Instructional Materials<\/h3>\n

Zhaohui Li, Peng He, Honglu Liu, Zeyuan Wang, Zhiyuan Chen, Tingting Li, Jinjun Xiong<\/p>\n

Accepted as FULL Paper at AIED 2026 (March 2026)<\/i><\/p>\n

\n Manual evaluation of AI-generated science materials is difficult to scale. We introduce SciEval<\/strong>, a benchmark dataset of 273 materials evaluated across 13 criteria. Our results show that domain-aligned fine-tuning of LLMs yields significant gains in automated pedagogical evaluation.\n <\/p>\n

\n AIED<\/a>\n <\/div>\n <\/div>\n <\/div>\n\n
\n
\n
AIED<\/div>\n \"DrawSim-PD\n <\/div>\n \n
\n

DrawSim-PD: Simulating Student Science Drawings to Support NGSS-Aligned Teacher Diagnostic Reasoning<\/h3>\n

Arijit Chakma, Peng He, Honglu Liu, Zeyuan Wang, Tingting Li, Tiffany D. Do, Feng Liu<\/p>\n

Accepted as FULL Paper at AIED 2026 (March 2026)<\/i><\/p>\n

\n To address privacy restrictions on sharing student work, we present DrawSim-PD<\/strong>, a generative framework that simulates NGSS-aligned student science drawings with controllable imperfections. We release a corpus of 10,000 artifacts to overcome data scarcity in visual assessment research.\n <\/p>\n

\n AIED<\/a>\n <\/div>\n <\/div>\n <\/div>\n\n
\n
\n
JSET<\/div>\n \"Human-AI\n <\/div>\n \n
\n

The Transformative Collaboration of Human Intelligence and Artificial Intelligence in Designing Knowledge-in-Use Science Assessment for Learning<\/h3>\n \n

Tingting Li, Joseph S. Krajcik, Rand Spiro <\/p> \n \n

Published in Journal of Science Education and Technology (November 2025)<\/i><\/p>\n

\n This study investigates the collaboration between human experts and GPT-4 to design NGSS-aligned, 3D science assessments. Using a design-based research approach, we demonstrate that principled human scaffolding\u2014through structured prompts and iterative expert evaluation\u2014enables AI to co-produce high-quality, equitable tasks. This work offers a transferable refinement framework, positioning generative AI as a collaborative design partner rather than a mere automated tool.\n <\/p>\n

\n Article<\/a>\n <\/div>\n <\/div>\n <\/div>\n\n
\n
\n
AIED<\/div>\n \"SciIBI\n <\/div>\n \n
\n

Can Multimodal LLMs See Science Instruction? Benchmarking Pedagogical Reasoning in K-12 Classroom Videos<\/h3>\n

Yixuan Shen, Peng He, Honglu Liu, Jinxuan Fan, Yuyang Ji, Tingting Li, Tianlong Chen, Kaidi Xu, Feng Liu<\/p>\n

Accepted as Short Paper at AIED 2026 (March 2026)<\/i><\/p>\n

\n Existing benchmarks for classroom discourse overlook visual artifacts and model-based reasoning. We address this gap with SciIBI<\/strong>, the first video benchmark for analyzing science classroom discourse, featuring 113 NGSS-aligned clips. Our evaluation reveals current multimodal LLMs struggle to distinguish pedagogically similar practices, suggesting models should accelerate human expert review rather than replace it.\n <\/p>\n

\n arXiv<\/a>\n <\/div>\n <\/div>\n <\/div>\n\n
\n
\n
EDM<\/div>\n \"RAG\n <\/div>\n \n
\n

Enhancing LLM-Based Short Answer Grading with Retrieval-Augmented Generation<\/h3>\n

Yucheng Chu, Peng He, Hang Li, Haoyu Han, Kaiqi Yang, Yu Xue, Tingting Li, Joseph Krajcik, Jiliang Tang<\/p>\n

Accepted as Short Paper at EDM 2025<\/i><\/p>\n

\n Large language models show promise in automated grading but often lack specific domain knowledge. We propose an adaptive Retrieval-Augmented Generation (RAG)<\/strong> framework that dynamically retrieves and incorporates curated educational sources to evaluate complex science understanding. Our system significantly improves grading accuracy compared to baseline LLM approaches.\n <\/p>\n

\n arXiv<\/a>\n <\/div>\n <\/div>\n <\/div>\n\n
\n
\n
JSET<\/div>\n \"Deep\n <\/div>\n \n
\n

Utilizing Deep Learning AI to Analyze Scientific Models: Overcoming Challenges<\/h3>\n

Tingting Li, Kevin Haudek, Joseph Krajcik<\/p>\n

Published in Journal of Science Education and Technology (April 2025)<\/i><\/p>\n

\n Assessing complex student scientific models with AI is challenging due to data imbalances. This study employs deep learning and SMOTE<\/strong> (Synthetic Minority Over-sampling Technique) to enhance the fairness and accuracy of automated scoring. Our results demonstrate significant improvements in mirroring human judgment, while highlighting areas where AI must evolve to better interpret creative student expressions.\n <\/p>\n

\n Article<\/a>\n <\/div>\n <\/div>\n <\/div>\n\n
\n
\n
IJCAI<\/div>\n \"LLM-driven\n <\/div>\n \n
\n

Enhancing Automated Grading in Science Education through LLM-Driven Causal Reasoning and Multimodal Analysis<\/h3>\n

Haohao Zhu, Tingting Li, Peng He, Jiayu Zhou<\/p>\n

Published at International Joint Conferences on Artificial Intelligence 2025 (November 2025)<\/i><\/p>\n

\n Assessing multimodal student work in science education is challenging and often biased by traditional text-only methods. We propose a novel LLM-augmented multimodal evaluation framework<\/strong> that leverages LLMs to generate causal knowledge graphs, capturing essential conceptual relationships in student responses. Experimental results show this approach significantly improves grading accuracy and consistency by mitigating biases like handwriting neatness and answer length.\n <\/p>\n

\n PDF<\/a>\n <\/div>\n <\/div>\n <\/div>\n\n
\n