The Agent Institutions and Norms tutorial focuses on the role of norms in engineering safe and trusted AI. Specifically, we address the value-alignment problem: the problem of ensuring that AI systems are aligned with human values. While the tutorial provides a brief introduction to agent institutions and normative systems, its main focus is on presenting the theoretical foundations for understanding values and the role of norms in engineering values, along with some formal approaches for value alignment that build on these foundations. The theoretical foundations are rooted in philosophy and they help define a normative-based formal model for value engineering in autonomous agents. With these foundations, we then present a number of approaches for addressing value alignment in socio-technical systems, along with the implications of these approaches from promoting self-organisation to human control. A discussion of the open ethical questions forms an integral part of this tutorial.
AI, Norms and Institutions
13 July 2021
9:30 am - 12:45 pm
This event is part of the Safe and Trusted AI Summer School 2021. The Summer School is core for STAI CDT PhD students, and open to a limited number of other students, by invitation.
About the speaker
Dr Nardine Osman is a Tenured Scientist at CSIC’s Artificial Intelligence Research Institute (IIIA-CSIC). She has obtained her PhD (2008) and MSc (2003) in Informatics from the University of Edinburgh, UK, and her Bachelor of Engineering (2001) in Computer and Communications Engineering from the American University of Beirut, Lebanon. Nardine has participated in a number of European and national projects, and has lately led two national projects on the topics of “responsible technologies” and is currently the PI of a European project on a related topic. During her career, Nardine has published around 60 peer-reviewed articles in major international journals and conferences, with over 500 citations. Her research work has resulted in three copyrights, and one of her copyrighted algorithms is currently being used in the industry. Nardine has lately served as the deputy chair and a member of the board of directors of EURAMAS. She is currently a member of the editorial boards of JAIR and IJHCS, has chaired a few workshops and conferences (AT 2016, AAMAS 2016 workshops, and AInF@IJCAI 2015), and has served as a program committee member to many other conferences and workshops.