AI students win best paper award
Infomedia master students presented report on the limitations of the state-of-the-art in bias mitigation. Their project report was awarded the best paper award at Norwegian Informatics Conference.
Main content
Does your machine learning solution work the same for different types of people? You may think, why not. A machine learning algorithm uses data to build a model that identifies a phenomenon by its features. Say you want to go through a stack of CV’s and identify the most promising candidates. You can “train” a machine learning model to do that, just as Amazon did. But if you can accidentally end up with a model that gives preferential treatment to one group of people. How do we mitigate bias and how much does bias mitigation cost in therms of the accuracy of our models.
This is the question that Knut T. Hufthammer, Tor H. Aasheim, Sølve Ånneland and Håvard Brynjulfsen decided to investigate as part of their student project in the AI Ethics course in the spring this year. They turned to an open source toolkit for bias mitigation, AI Fairness 360 curated by IBM. Using the toolkit they built a try example of a hiring system using US census data and showed that bias mitigation has an impact on accuracy is mild. More importantly they learned the limitations of the state-of-the-art in bias mitigation today. The report of the project of Knut T. Hufthammer, Tor H. Aasheim, Sølve Ånneland and Håvard Brynjulfsen was published as a paper at the Norwegian Informatics Conference and was awarded the best paper award. While waiting for the proceedings you can read the paper here.
In the same venue you can also read a second project from the spring course: an investigation of how much can the The Norwegian National Strategy for Artificial Intelligence principles be satisfied in an automated Kindergarten place allocation system for the Bergen commune.
If you are curious about AI ethics and want to try your hand at it, the department of Information Science and Media Studies will offer the INFO383 Research Topics in AI Ethics course next semester. If you are interested in AI in general, the same department, in cooperation with the Department of Informatics will offer a Bachelor in AI starting in the autumn of 2021.