We are excited to share that the paper, “Dynamic Testing of GUI Exercises in Headless Environments,” has been accepted to the ACM Student Research Competition (SRC) at the 40th IEEE/ACM International Conference on Automated Software Engineering (ASE ‘25) in Seoul, Republic of Korea.
The work addresses a recurring challenge in large-scale programming courses: reliable testing of GUI-based exercises inside auto-graders that run without a graphical subsystem. Our headless testing approach simulates user interactions and verifies application state, enabling dynamic checks beyond static analysis.
With a reference implementation called Eos, the approach was integrated into Artemis and evaluated on 1,020 student submissions. The results demonstrate reproducible, scalable, and pedagogically meaningful feedback for both template-based and open-ended tasks.
The Student Research Competition offers students a venue to present their research, receive feedback, and exchange ideas.
We look forward to presenting this work at ASE 2025 and will share the published paper and full citation once available.
- Dynamic Testing of GUI Exercises in Headless Environments by Benjamin Schmitz
