FATED is a 1-day workshop colocated with the EDM 2020 conference.
Educational Data Mining is no longer a research idea. It is common practice. Schools and service providers now routinely amass rich datasets reflecting learning behaviors and educational outcomes at the student, class, school and even district/institutional level. This data is used to support personalized instruction, guide pedagogical practice, allocate institutional resources, and support system development. This automation represents both the opportunity to benefit huge populations at low cost, and the risk to lose control over the intended outcomes, particularly as educators themselves become increasingly dependent on often opaque models.
All models are imperfect and as recent experiences have shown, educational applications of AI are not immune to the risks observed in other domains. Teachers, students, and parents have protested the use of educational systems in classrooms across the US, driven in part by a lack of clear guidance on how the systems are managed, and a lack of clear criteria on how they can be judged (NEP 2018, Bowles 2019, Herold 2019). In complex educational environments problems such as bias can go undetected in real time and may, over the long term and large scale, far outweigh the potential benefits (Buckingham & Shum 2018).
This rapidly-growing environment raises a number of crucial ethical, research, and policy issues (Holmes et al. 2018, Lynch 2017). Among these, how do we identify and ameliorate bias in our algorithms? How do we address the problem identified by Barocas & Hardt in their NeurIPS 2017 tutorial: “Different models with the same reported accuracy can have a very different distribution of error across population”? How do we design systems that are accountable to social and policy concerns (Kroll et al. 2017)? How do we ensure student privacy (e.g. Aggrawal and Yu 2008, Dwork 2006)? How do we ensure fairness in educational systems (Holstein & Doroudi 2019, Holstein et al. 2019)? How do we address the inevitable ethical challenges (Holmes et al. 2018, Ben-Porath & Ben Shahar 2017)? And who really owns the data (Lynch 2017)?
The goal of this workshop is to develop a focus on Fairness, Accountability, & Transparency in Educational Data (FATED). This will include discussion of open issues in EDM, and prior research on fairness accountability and transparency in machine learning systems. It will also include the presentation of novel peer-reviewed research by the EDM community, and a practical tutorial on some methods for assessing bias in trained models. Finally we will work to develop near and long-term goals for the community.
Presentation Slides for Accepted Papers
- Wang, Lang, Paepcke, & Stevens. A Natural-Language Approach to Early Forecasting of Undergraduate Majors: An Investigation of Efficacy and Bias
- Lee & Kizilcec. Evaluation of Fairness Trade-offs in Predicting Student Success
- Romaric, Ouedraogo, & Capus. How WhatsApp makes Educational Data Mining difficult in West African universities
- Kitto, Gulson, Thompson, & Payne. Technical Democracy in Educational Decision Making
- Hertwick, Castillo, & Mathioudakis. Towards Data-Driven Affirmative Action Policies under Uncertainty
|10:00 AM||1:00 PM||6:00 PM||7:00 PM||2:00 AM||Opening|
|10:30 AM||1:30 PM||6:30 PM||7:30 PM||2:30 AM||Evaluation of Fairness Trade-offs In Predicting Student Success
Hansol Lee and Rene Kizilcec
|10:50 AM||1:50 PM||6:50 PM||7:50 PM||2:50 AM||A Natural Language Approach to Early Forecasting of Undergraduates’ Degrees
Alexander Wang, David Lang, Andreas Paepcke and Mitchell Stevens
|10 min break|
|11:20 AM||2:20 PM||7:20 PM||8:20 PM||3:20 AM||How WhatsApp makes Educational Data Mining difficult in West African universities
Romaric Bassole, Frédéric T. Ouedraogo and Laurence Capus
|11:40 AM||2:40 PM||7:40 PM||8:40 PM||3:40 AM||Towards Data-Driven Affirmative Action Policies under Uncertainty
Corinna Hertweck, Carlos Castillo and Michael Mathioudakis
|12:00 PM||3:00 PM||8:00 PM||9:00 PM||4:00 AM||Technical Democracy in Educational Decision Making
Kirsty Kitto, Kalervo Gulson, Greg Thompson and Leonie Payne
|10 min break|
|12:30 PM||3:30 PM||8:30 PM||9:30 PM||4:30 AM||Open Discussion|
|1:00 PM||4:00 PM||9:00 PM||10:00 PM||5:00 AM||End|
You can register at the bottom of this page by selecting Conference Attendee.
The FATED workshop will be held virtually in conjunction with EDM (details to be determined).
- June 15 – AoE
Submission of original research & position papers – Extended deadline
- June 22
Notification for acceptance
- June 29
Camera-ready version due
- July 10
Call for Papers
- Short position papers
Between 2 and 3 pages
- Full papers
Between 3 and 5 pages including references
Submissions will be made through EasyChair, using the EDM paper Word or LaTeX template.
Nigel Bosch (University of Illinois at Urbana-Champaign)
Christopher Brooks (University of Michigan)
Shayan Doroudi (University of California Irvine)
Josh Gardner (University of Washington)
Kenneth Holstein (Carnegie Mellon University)
Andrew Lan (University of Massachusetts at Amherst)
Collin Lynch (North Carolina State University)
Beverly Park Woolf (University of Massachusetts at Amherst)
Mykola Pechenizkiy (Eindhoven University of Technology, The Netherlands)
Steven Ritter (Carnegie Learning)
Jill-Jênn Vie (Inria Lille, France)
Renzhe Yu (University of California, Irvine)