Evaluating a Data-Driven Redesign Process for Intelligent Tutoring Systems
arXiv:2603.29094v1 Announce Type: new Abstract: Past research has defined a general process for the data-driven redesign of educational technologies and has shown that in carefully-selected instances, this process can help make systems more effective. In the current work, we test the generality of the approach by applying it to four units of a middle-school mathematics intelligent tutoring system that were selected not based on suitability for redesign, as in previous work, but on topic. We tested whether the redesigned system was more effective than the original in a classroom study with 123 students. Although the learning gains did not differ between the conditions, students who used the Redesigned Tutor had more productive time-on-task, a larger number of skills practiced, and greater t
View PDF HTML (experimental)
Abstract:Past research has defined a general process for the data-driven redesign of educational technologies and has shown that in carefully-selected instances, this process can help make systems more effective. In the current work, we test the generality of the approach by applying it to four units of a middle-school mathematics intelligent tutoring system that were selected not based on suitability for redesign, as in previous work, but on topic. We tested whether the redesigned system was more effective than the original in a classroom study with 123 students. Although the learning gains did not differ between the conditions, students who used the Redesigned Tutor had more productive time-on-task, a larger number of skills practiced, and greater total knowledge mastery. The findings highlight the promise of data-driven redesign even when applied to instructional units not selected as likely to yield improvement, as evidence of the generality and wide applicability of the method.
Comments: Accepted as short paper to the 27th International Conference on Artificial Intelligence in Education (AIED 2026)
Subjects:
Human-Computer Interaction (cs.HC); Artificial Intelligence (cs.AI)
Cite as: arXiv:2603.29094 [cs.HC]
(or arXiv:2603.29094v1 [cs.HC] for this version)
https://doi.org/10.48550/arXiv.2603.29094
arXiv-issued DOI via DataCite (pending registration)
Submission history
From: Conrad Borchers [view email] [v1] Tue, 31 Mar 2026 00:28:34 UTC (1,296 KB)
Sign in to highlight and annotate this article
Conversation starters
Daily AI Digest
Get the top 5 AI stories delivered to your inbox every morning.
More about
announceproductstudy
University of Oklahoma researcher awarded NIH grant to advance tribally defined approaches to genomic research - ou.edu
<a href="https://news.google.com/rss/articles/CBMimAFBVV95cUxNVUU5ZEhYM0dQbE1CYnpPUE04QVVTdmlqUC00dzZQSmpKaWJoSnpINXJ2N1NIN0g4Z0hHSEh2N3RLTVJvNjc3RHV3ZWxYdkgxb0J1TlVtNDNRc1VpZmJjRDdhOFMxQUs2NkRnV3dndkpscmJ1bFJ3V3RLVVdZSnJ2SlRmYWNtZVNwYXBVdzZwTHBtTUZlZ25hYQ?oc=5" target="_blank">University of Oklahoma researcher awarded NIH grant to advance tribally defined approaches to genomic research</a> <font color="#6f6f6f">ou.edu</font>
Episode 2: I Was a Junior Developer and I Must Be Stopped
<p>Welcome back.</p> <p>Last episode, we reviewed a Laravel function that used three loops to reconstruct an array it already had, fired two database queries per item instead of one, and named a variable <code>$r_arr</code> with the confidence of a man who has never once been held accountable for anything.</p> <p>It was a good one, some of us liked it.</p> <p>So today, we are reviewing my hotel invoice generator. It is a PHP class called <code>ExcelController</code>. It imports guest data from an uploaded Excel file and exports a personalised invoice for each guest, packed into a zip file for download.</p> <p>It was never merged.</p> <p>The room numbers are completely random.</p> <p>My senior opened the PR. He read through it. He left seven comments. He never raised his voice. He never sen
Knowledge Map
Connected Articles — Knowledge Graph
This article is connected to other articles through shared AI topics and tags.
More in Research Papers
Jamie Dimon, office-work champion, vows his anti-remote culture ‘would crush you.’ The economy’s top talent begs to differ
JPMorgan’s CEO thinks in-person work makes companies more competitive. Most of the research says another thing about “the entitled non-complier.”
오라클, 전 세계 최대 3만 명 감원…기업 지원·제품 로드맵 차질 우려
오라클이 대규모 감원에 착수했다. 이번 구조조정은 오라클 역사상 최대 규모의 인력 감축이 될 가능성이 있다. 미국, 인도, 캐나다, 멕시코, 우루과이의 직원들은 현지 시간 기준 31일 오전 6시경 ‘오라클 리더십(Oracle Leadership)’ 명의의 해고 통보 이메일을 받았으며, 인사부나 직속 상사로부터 사전 안내는 없었다. 슬랙, 줌, VPN, 출입 배지 등 기업 시스템 접근 권한도 거의 동시에 차단됐다. 오라클은 영향을 받은 직원들에게 조직 개편과 운영 효율화를 위한 조치라고 설명했다. 컨설팅 기업 그레이하운드 리서치(Greyhound Research)의 수석 애널리스트 산치트 비르 고지아는 오라클 ERP, 오라클 클라우드 인프라(OCI), 넷스위트(NetSuite)를 운영하는 CIO들에게 가장 시급한 우려로 운영 안정성 저하를 지목했다. 그는 “조용히 누적되는 불균형, 지연되는 에스컬레이션 대응, 축소된 백엔드 전문성, 증가하는 팀 간 인수인계, 표준 운영 절차를 벗어난 사고 발생 시 신뢰 저하가 나타날 수 있다”고 분석했다. 이어 “기업 고객은 단순히 코드 개발 속도만을 구매하는 것이 아니라 지원의 연속성, 릴리스 규율, 품질 보증, 통합 안정성, 문제 발생 시 책임성을 함께 고려한다”고 설명했다. 또한 CIO들에게 오라클 계정 팀을 상대로 전담 지원 인력의 지속적인 제공 여부, 최근 60~90일 동안 변경된 제품 조직에 대한 명확성, 향후 두 분기 동안의 릴리스 이행 여부를 확인할 것을 권고했다. 그는 “답변이 모호하다면 그 자체가 하나의 신호”라고 언급했다. 감원 규모와 대상 조직 온라인 직장
UVA researchers use AI to speed up drug development - WVIR
<a href="https://news.google.com/rss/articles/CBMiiwFBVV95cUxOaHF0M0pSdUx0OUp4UHd4a0VnVllZVWtFZ0F6U0I2azlPejJLLTduTmdtZWFCYWhLRWRQSjRXTkxaWlJiV1ozc1JERnFqemtLczJmOEh3d0luZTlNdFNNcDlRdjdobU50RDd0Tk5NRkdqSU5HbGo0RVEzSTdoVThFeWxhRHFzUWpaX3FF0gGfAUFVX3lxTE1jbWpYOWZEWGtJd25vRGg0Nll3VFRzNGdoT01YYmt4YVZ1RHV5dVB3TVN0UVdGVDNHbDFKZnBlODlyQkZSWFFjZ2NDRWVvS05kXzJPOVNpT0xtZ3g5UjM2MF8wWmhPdGkwU1hGYTJzOTlreTJjNzVlaFdHVm9mNUxjOXdQVmR3cVE1ZlhrRmpMbWZpU1FFUEx0UVZXVlBBTQ?oc=5" target="_blank">UVA researchers use AI to speed up drug development</a> <font color="#6f6f6f">WVIR</font>
Illinois Tech computer science researcher honored by IEEE Chicago Section - EurekAlert!
<a href="https://news.google.com/rss/articles/CBMiXEFVX3lxTE13OVpWMEk1Z3hlMkR2bHNBQ2dkazFwb3VqN3hCa29GWGJvSVlPa00zd2xUakRmYXFqQmc5OWU0eGl4a21FMDAwWUN2Q3p0M3FrbXBkNV8zN0cxaG1s?oc=5" target="_blank">Illinois Tech computer science researcher honored by IEEE Chicago Section</a> <font color="#6f6f6f">EurekAlert!</font>
Discussion
Sign in to join the discussion
No comments yet — be the first to share your thoughts!