Skip to main content ITU
Logo
  • Programmes
    • BSc Programmes
    • BSc in Global Business Informatics
    • BSc in Digital Design and Interactive Technologies
    • BSc in Software Development
    • BSc in Data Science
    • Applying for a BSc programme
    • MSc Programmes
    • MSc in Digital Innovation & Management
    • MSc in Digital Design and Interactive Technologies
    • MSc in Software Design
    • MSc in Data Science
    • MSc in Computer Science
    • MSc in Games
    • Applying for an MSc programme
    • Student Life
    • Practical information for international students
    • Ask a student
    • Women in tech
    • Student organisations at ITU
    • Study start
    • Labs for students
    • Special Educational Support (SPS)
    • Study and Career Guidance
    • Exchange student
    • Become an exchange student
    • Guest Students
    • Who can be a guest student?
    • ITU Summer University
    • Open House
    • Open House - BSc programmes
    • Open House - MSc programmes
  • Professional Education
    • Master in IT Management
    • Master in IT Management
    • Admission and entry requirements
    • Contact
    • Single Subjects
    • About single subjects
    • Admission and entry requirements
    • Contact
    • Short courses | ITU Professional Courses
    • See all short courses
    • Contact
    • Contact
    • Contact us here
  • Research
    • Sections
    • Data Science
    • Data, Systems, and Robotics
    • Digital Business Innovation
    • Digitalization Democracy and Governance
    • Human-Computer Interaction and Design
    • Play Culture and AI
    • Software Engineering
    • Technologies in Practice
    • Theoretical Computer Science
    • Research Centres
    • Centre for Digital Play
    • Center for Climate IT
    • Center for Computing Education Research
    • Centre for Digital Welfare
    • Centre for Information Security and Trust
    • Research Centre for Government IT
    • Danish Institute for IT Program Management
    • Research entities
    • Research centers
    • Sections
    • Research groups
    • Labs
    • ITU Research Portal
    • Find Researcher
    • Find Research
    • Research Ethics and Integrity
    • Good Scientific Practice
    • Technical Reports
    • Technical Reports
    • PhD Programme
    • About the PhD Programme
    • PhD Courses
    • PhD Defences
    • PhD Positions
    • Types of Enrolment
    • PhD Admission Requirements
    • PhD Handbook
    • PhD Support
  • Collaboration
    • Collaboration with students
    • Project collaboration
    • Project Market
    • Student worker
    • Project postings
    • Job and Project bank
    • Employer Branding
    • IT Match Making
    • Hiring an ITU student or graduate
    • Make a post in the job bank
    • Research collaboration
    • Read more about research collaboration at ITU
    • Industrial PhD
    • Hire an Industrial PhD
    • Maritime Hub
    • Innovation and entrepreneurship
    • ITU Business Development
    • ITU NextGen
  • About ITU
    • About ITU
    • Press
    • Vacancies
    • Contact
  • DK
Research suggests that predictive modelling is not a good replacement for caseworkers’ assessment at job centres
ITU  /  Press  /  News from ITU  /  Research suggests that predictive modelling is not a good replacement for caseworkers’ assessment at job centres

Research suggests that predictive modelling is not a good replacement for caseworkers’ assessment at job centres

Using artificial intelligence to predict long term unemployment among welfare seekers can be problematic in practice. That is the conclusion drawn in a new research article entitled “We Would Never Write That Down”: Classifications of Unemployed and Data Challenges for AI published in the proceedings of the ACM on HCI (PACM HCI), as part of the leading international conference on computer supported cooperative work (CSCW 2021).

Business IT DepartmentResearchdigitizatione-governmentartificial intelligence

Written 22 April, 2021 08:51 by Jari Kickbusch

Artificial Intelligence—or AI as it is popularly known—is integrated in all aspects of our everyday lives, from predicting our shopping habits to our taste in film and music. Basically, the predictions made by AI technology is informed by analysing vast amounts of data, and in a day and age where electronic data is stored and preserved on an unprecedented scale, AI can provide us with insights that were unthinkable only a few decades ago. For instance, AI technologies are used to predict how the Covid-19 virus will spread and what demographic is particularly at risk.

Even though AI is one of the most hyped technologies of our day, it is, of course, not the answer to all the world’s challenges. The recently published article “We Would Never Write That Down”: Classifications of Unemployed and Data Challenges for AI, in which researchers have focused on the process of assessing welfare seekers at Danish job centres, is a case in point.

- At the job centres, caseworkers organise welfare seekers according to certain categories, also known as ‘match groups’. This process is tremendously important because the categories determine what type of benefits a welfare seeker is entitled to and their rights in the system. There has been a great push to use historical data from welfare seekers to predict, for instance, the likelihood of long-term employment. That is what our research has focused on, says Anette C.M. Petersen, who is a PhD student at the IT University and authored the article alongside Lars Rune Christensen (ITU) Richard Harper (Lancaster University), and Thomas Hildebrandt (University of Copenhagen).

Binary perceptions
The article is based on fieldwork conducted by Anette C. M. Petersen in Gladsaxe Municipality. Here, she studied cases concerning welfare seekers processed by caseworkers with the intention of finding out whether artificial intelligence can streamline and improve decision-making. In the municipality, welfare seekers are divided into two match groups; 2.2, consisting of the “ready to work” applicants, and 2.3, consisting of applicants who are not ready to accept employment but are, however, “ready for activation measures” (these match groups have subsequently been renamed 6.2 and 6.3). However, the reality is far more complex than what is implied by the two match groups, says Anette C. M. Petersen:

- A caseworker told me that a welfare seeker basically has to be ‘almost dead’ to qualify for 2.3. It is incredibly difficult for the caseworkers to document and prove that citizens are challenged in their lives to the point of qualifying for that match group. At the same time, there is mounting political pressure to place more welfare seekers in the ‘ready to work’ match group to expedite their way to employment and out of the system … What we see is that, in practice, most welfare seekers do not actually belong in either of the two match groups. Instead, they occupy a grey area. They are neither well enough to take on employment nor able to sufficiently document their illness to prevent them from working. So, caseworkers handle these cases by using their own terminology: For example, a welfare seeker may be further classified as either a “light,” “heavy,” or “hard” 2.2.

The person behind the label
According to Anette C.M. Petersen, the caseworkers’ own system of definitions helps them provide welfare seekers with the proper service and support (which is not restricted to job hunting), and the article concludes that caseworkers’ assessment cannot simply be replaced by AI.

- In terms of implementing AI at job centres, there is too much important information on what it means to be a citizen in this system, that AI systems are not privy to and thus cannot employ in predicting, for instance, long-term unemployment … Naturally, our results have raised questions about whether we can find patterns in the data that correspond to the caseworkers’ classifications and identify, for instance, ‘light’ or ‘heavy’ 2.2s. These are valid questions, but the caseworker has physical contact with the welfare seeker. For example, the caseworkers can smell the alcohol on someone’s breath or conclude if a welfare seeker is upset by asking questions about their health. There are many physical clues that technology cannot pick up, says Anette C.M. Petersen.

- According to the caseworkers, their terminology is not compatible with a bureaucratic system - regardless of whether AI is introduced or not. Caseworkers do not write everything down, because they are working with humans, and humans are complicated and changeable beings. When you start employing historical data to predict the future, you run the risk of further entrenching these people in their circumstances or possibly making them permanent. Caseworkers are very aware of that concern.

How then can we use artificial intelligence?
While the article’s conclusion takes a critical stance on employing artificial technology in assessing risk of long-term unemployment among welfare seekers, it remains optimistic in terms of using AI as a tool for caseworkers to use in their work. That is why Anette C.M. Petersen hopes to engender a discussion about the possibilities and limitations of AI by publishing the article in PACM HCI.

- Even though our research is conducted in a Danish context, it is very relevant abroad, too – and in different contexts. Our research highlights important challenges that may occur when working with AI which may also be relevant, for instance, in connection with predicting crime. With this article, we hope to gain the attention of those developing the systems, open up opportunities for constructive dialogues and enhance collaboration across disciplines. In that respect, PACM HCI is an excellent venue for our article.

Ecoknow
The research article is part of a major research project, Ecoknow, which aims to examine how digital casework processes can become more intelligent, flexible, and transparent. Head of the research project, professor at the University of Copenhagen, Thomas Hildebrandt (one of the co-authors of the article), is delighted that the researchers were get the article published in PACM HCI. But that is not all he is happy about. The article will appear alongside another Ecoknow-article, Street-Level Algorithms and AI in Bureaucratic Decision-Making: A Caseworker Perspective, focusing on caseworkers’ view on AI-supported work.

- I am thrilled that our work with Ecoknow is getting a lot of exposure, and that there is so much interest in AI research that does not simply start out with a technical solution to a problem, but instead takes a step back to observe the caseworkers at work and interview them about their relationship to the technology, so we can collaborate to identify problems and challenges that can be solved by AI, says Thomas Hildebrandt.


Find more information about Ecoknow, which is financed by Innovation Fund Denmark, at the research project’s website.

Read the research article on ACM's webpage

Further information

Jari Kickbusch, phone 7218 5304, email jark@itu.dk

News

"The aim is our trust"

"The aim is our trust"

6 May, 2025

As part of the Danish Science Festival, the IT University and the newspaper Dagbladet Information gathered a number of experts to discuss cyber warfare in Denmark and how prepared we are for it. The Minister of Resilience and Preparedness, Thorsten Schack Pedersen, also participated in the talk.

Professor portrait: Nutan Limaye is pushing the boundaries of complexity theory

Professor portrait: Nutan Limaye is pushing the boundaries of complexity theory

1 May, 2025

On 22 May 2025 at 14:30, Professor Nutan Limaye from the section Theoretical Computer Science will present her inaugural lecture in Auditorium 0 at the IT University of Copenhagen. The lecture is entitled “My reflections on the last two decades and Complexity Theory”.

Professor portrait Anna Vallgårda challenges the design of care technology

Professor portrait Anna Vallgårda challenges the design of care technology

24 April, 2025

On 9 May 2025 at 14:30, Professor Anna Vallgårda will give her inaugural lecture in Auditorium 0 at the IT University of Copenhagen. The lecture is entitled: ”Radical Redesign of Care Technologies”.

Is Denmark prepared for cyberwarfare?

Is Denmark prepared for cyberwarfare?

8 April, 2025

A group of researchers from the IT University of Copenhagen is investigating what Denmark can learn from Ukraine in terms of preparing for cyberwarfare. Cyberwarfare does not just affect governments and companies, but also civilians, and the researchers ask what should be done if we come under attack.

Researchers aim to teach math students critical thinking with data science

Researchers aim to teach math students critical thinking with data science

31 March, 2025

In a new research project at the IT University of Copenhagen and the University of Copenhagen, a group of researchers will investigate how data science can become part of high school mathematics education to provide students with a better foundation for critical thinking and the ability to illuminate and nuance claims they encounter in their daily lives.

ITU researcher secures grant to improve safety of AI systems

ITU researcher secures grant to improve safety of AI systems

19 March, 2025

At Advanced Institute of Science and Technology in Japan, Associate Professor Alessandro Bruni from ITU is currently conducting research on the mathematical foundation for developing verifiably correct machine learning frameworks. The project is supported by the Carlsberg Foundation.

Professor portrait: Vasilis Galis found his way in research on the Athens metro

Professor portrait: Vasilis Galis found his way in research on the Athens metro

13 March, 2025

On 28 March 2025 at 14:30, Professor Vasilis Galis from the section Technologies in Practice will present his inaugural lecture in Auditorium 0 at the IT University of Copenhagen. The lecture is entitled “Research against dead time”.

ITU researcher investigates elections in Greenland

ITU researcher investigates elections in Greenland

11 March, 2025

On 11 March 2025, the election for Inatsisartut (Greenland's parliament) will take place. For several years, researchers from ITU, led by Professor Carsten Schürmann and Center for Information Security and Trust, have been investigating election and the possibility of internet elections in Greenland, and the election today is no exception.

IRFD funded ITU project to develop theoretical foundation for probabilistic session types

IRFD funded ITU project to develop theoretical foundation for probabilistic session types

6 March, 2025

The increasing technological complexity makes probabilistic understanding and management of critical computing systems a necessity. A new research project, led by Associate Professor Marco Carbone, aims to develop the foundation for probabilistic session types to that end.

Urban highways are barriers to social connections

Urban highways are barriers to social connections

5 March, 2025

Researchers from IT University of Copenhagen have proved that urban highways limit social connections in the 50 largest cities in the US. It is the first ever quantitative evaluation of the barrier effect of urban highways in reducing social connections across neighborhoods.

New research to find efficient strategies for prevention of epidemics

New research to find efficient strategies for prevention of epidemics

26 February, 2025

Assistant Professor at ITU, Jonas Juul, receives a Novo Nordisk Foundation Data Science Investigator grant of DKK 6.5 million for a project that aims to improve statistical methods for predicting outbreaks of infections.

Within Limits – an exhibition on computation and constraint

Within Limits – an exhibition on computation and constraint

24 February, 2025

On 7 March, join Artist Jacob Remin, Associate Professor James Maguire and Postdoc Frauke Mennes from the Center for Climate IT at ITU for the launch of Within Limits – an art installation that questions and reimagines the scalar logics inherent in computational worlds.

ITU students and alumni win awards at Copenhagen Gaming Week

ITU students and alumni win awards at Copenhagen Gaming Week

21 February, 2025

ITU was represented with games developed by both students and alumni from the university at Copenhagen Gaming Week and ‘Spilprisen’ that took place last week. Students from the MSc Games won the award for ’Best Student Game’, while alumni from the same study programme won for ‘Best Debut’.

New research project to find a more inclusive way to develop algorithms

New research project to find a more inclusive way to develop algorithms

10 February, 2025

Associate Professor Veronika Cheplygina has received a Novo Nordisk Data Science Investigator Grant of almost DKK 11 million. The grant will fund research on how more inclusive teaching and research environments may lead to better algorithms for medical imaging.

Thesis on digital divide in prisons wins award

Thesis on digital divide in prisons wins award

31 January, 2025

Three students from ITU have won the Danish Institute for Human Rights' Thesis Award for their thesis "The Digital Divide in Prisons". The thesis examines how the digital divide between inmates in Danish prisons and the surrounding society can be bridged.

New ITU research analyses attacks on Large Language Models

New ITU research analyses attacks on Large Language Models

16 January, 2025

What are the intentions and profile of someone trying to use LLMs for malicious purposes? And how do they do it? In a new study, researchers from ITU define so-called “red teaming” of LLMs to enable better security in the future.

Jakob Grue Simonsen named new prorector at IT University in Copenhagen

Jakob Grue Simonsen named new prorector at IT University in Copenhagen

22 November, 2024

Jakob Grue Simonsen, who comes from a position as head of department at the Department of Computer Science, University of Copenhagen, will focus on well-being and collaboration when he takes over as prorector at ITU on 1 January 2025.

IT University of Copenhagen reveals two new members of management

IT University of Copenhagen reveals two new members of management

18 November, 2024

At IT University of Copenhagen, future head of education, Luís Cruz-Filipe (L), and future head of research, Morten Hjelholt (R), will become part of the university management when both take up their positions on 1 February and 1 January 2025 respectively.

Video: Is artificial intelligence the key to human consciousness?

Video: Is artificial intelligence the key to human consciousness?

12 November, 2024

"Our future is going to look like science fiction." Associate professor at IT University of Copenhagen, Paolo Burelli, uses artificial intelligence to approach a better understanding of the human brain and consciousness.

ITU researcher awarded Villum Synergy grant for qualitative data project

ITU researcher awarded Villum Synergy grant for qualitative data project

15 October, 2024

Associate Professor at IT University of Copenhagen, Anna Rogers, and Associate Professor Hjalmar Carlsen at University of Copenhagen have received a Villum Synergy grant from Villum Fonden to develop a new tool for conducting large-scale, high-quality qualitative interviews.

Contact us

Phone
+45 7218 5000
E-mail
itu@itu.dk

All contact information

Web Accessibility Statement

Find us

IT University of Copenhagen
Rued Langgaards Vej 7
DK-2300 Copenhagen S
Denmark
How to get here

Follow us

ITU Student /
Privacy /
EAN-nr. 5798000417878/
CVR-nr. 29 05 77 53 /
P-nummer 1005162959

This page is printed from https://www.itu.dk/404