Ethics and Data Use
Evaluating ethics, privacy, and data use is essential to protect users’ data and ensure the AI solution upholds ethical standards.
What recognized guidelines and standards does the tool adhere to ensure safeguarding user’s data? Who needs to be involved in the review of these protocols and who will be responsible for transparently communicating them in plain language to users?
No technology is perfect but by asking the right questions about a technology and carefully considering our capacity to effectively leverage it, we can maximize impact.
Ask
Data Protection:
How does your tool safeguard data protection and privacy, and can a user customize its settings to meet specific needs?
Data Ownership:
How are users informed and given control over their data, especially concerning opt-out options?
Data Handling:
In cases where the tool leverages user input for training, how do you ensure data anonymity and restrict access to sensitive information?
Compliance:
How does your tool adhere to key privacy regulations (e.g., GDPR, FERPA, COPPA)?
Transparency:
What information is shared with users and how frequently, particularly in AI-driven decisions impacting learning pathways and outcomes?
Ethical Practices:
What ethical frameworks inform your development?
Consider
Data and AI Literacy:
How will you communicate the importance of data privacy and ethical AI use to your students?
Protection and Transparency:
What measures will you take to ensure that students’ data privacy rights are protected when using AI tools?
Awareness and Autonomy:
How will you ensure that students and staff are informed about and have control over their data when using the AI tool?
Scenario
A family literacy program utilizes an digital application that scans childrens’ books and uses AI to generate custom discussion questions and activities for adult learners and their children. The vendors offer extensive documentation of the standards and procedures they follow to ensure the application securely processes learners’ personal data. Program administrators, IT staff and instructors work together to ensure compliance with privacy regulations and develop a plan to communicate data usage policies to participants. Trust is maintained with clear communication about data use, families develop awareness around data privacy, and the app enables programs to track and offer credit for out-of-class parent and child together time.
The AI Integration Framework was adapted, with permission, from the "Top 6 Questions for GenAI EdTech Providers" resource developed by AI for Education.
This is one dimension of the AI Integration Framework.