Skip to main content ITU
Logo
  • Programmes
    • BSc Programmes
    • BSc in Global Business Informatics
    • BSc in Digital Design and Interactive Technologies
    • BSc in Software Development
    • BSc in Data Science
    • Applying for a BSc programme
    • MSc Programmes
    • MSc in Digital Innovation & Management
    • MSc in Digital Design and Interactive Technologies
    • MSc in Software Design
    • MSc in Computer Science
    • MSc in Data Science
    • MSc in Games
    • Applying for an MSc programme
    • Student Life
    • Women in tech
    • Student organisations at ITU
    • Labs for students
    • Practical Information for International Students
    • Ask a student
    • Study Start
    • Study and Career Guidance
    • Guest Students
    • Who can be a Guest Student
    • ITU Summer University
    • Exchange Student
    • Become an exchange student at ITU
    • Open House
    • Open House - MSc programmes
    • Open House - BSc programmes
  • Professional Education
    • Master in IT
    • Master in IT Management
    • Single Subjects
    • About single subjects
    • Contact
    • Contact us here
  • Research
    • Departments
    • Business IT Department
    • Computer Science Department
    • Digital Design Department
    • Research Groups and Labs
    • Research Groups
    • Labs
    • Research Centres
    • Centre for Digital Play
    • Center for Climate IT
    • Center for Computing Education Research
    • Centre for Digital Welfare
    • Centre for Information Security and Trust
    • European Blockchain Centre
    • Danish Institute for IT Program Management
    • ITU Research Portal
    • Find Researcher
    • Find Research
    • Research Ethics and Integrity
    • Good Scientific Practice
    • Technical Reports
    • Technical Reports
    • PhD Programme
    • About the PhD Programme
    • PhD Courses
    • PhD Defences
    • PhD Positions
    • Types of Enrolment
    • PhD Handbook
    • PhD Support
  • Collaboration
    • Collaboration with students
    • Project collaboration
    • Project Market
    • Student worker
    • Project postings
    • Job and Project bank
    • Employer Branding
    • IT Match Making
    • Hiring an ITU student or graduate
    • Make a post in the job bank
    • Research collaboration
    • Licensing Opportunities
    • Open Entrepreneurship
    • Research collaboration
    • Industrial PhD
    • Hire an Industrial PhD
    • Innovation and entrepreneurship
    • ITU Business Development
    • ITU Startup programme
  • About ITU
    • About ITU
    • Press
    • Vacancies
    • Contact
  • DK
Researchers are training a deep learning algorithm to beat humans at StarCraft
ITU  /  Press  /  News from ITU  /  Researchers are training a deep learning algorithm to beat humans at StarCraft

Researchers are training a deep learning algorithm to beat humans at StarCraft

Computers have already crushed humans at chess, Go and poker. Now, researchers at the IT University of Copenhagen are training an algorithm to beat the best human players in the sci-fi computer game StarCraft. If the project succeeds, it will be another quantum leap forward for artificial intelligence (AI).

Computer Science DepartmentResearchalgorithmscomputer gamesartificial intelligence

Written October 4, 2017 6:49 AM by Vibeke Arildsen

The more complex a game is, the more it resembles reality with all its unpredictability and unknowns. This is why AI researchers are now taking on computer games like StarCraft, which is estimated to have 101685 possible configurations in each match.

Niels Justesen is a year into his PhD project at the IT University of Copenhagen, and is working towards developing a self-learning AI algorithm that can beat even professional StarCraft players.

VIDEO: Watch the researchers’ algorithm (blue) beat StarCraft’s built-in training bot (purple).

www.youtube.com/embed/Ps_5P8Xx3_s

"Until now, research on computer games and deep learning algorithms has focused on trying to learn the games end-to-end, but that approach would be very difficult in a game like StarCraft because it is so complex. In StarCraft, you have uncertainty about how the opponent is going to act, just as in the real world. At the same time, the player must control an entire army and delegate tasks to different units of troops. Learning an algorithm to make the right decisions in such a complex system is a very general challenge for AI that, if resolved, can affect many other areas," he says.

AI trained on 2,000 games

So far, Niels Justesen and supervisor Sebastian Risi have trained the algorithm on 2,000 games involving some of the world's best StarCraft players. Based on this data set, the algorithm has gradually learned how human players have reacted in nearly 800,000 different game situations. To a certain extent, the algorithm can generalize this knowledge and use it make decisions in situations it has not experienced before. At this point, the algorithm plays at the same level as intermediate human StarCraft players.

StarCraft

StarCraft is a sci-fi strategy game where the player must build an army and destroy the opponent’s base. The game is particularly popular in South Korea, where professional StarCraft players are big stars.

The next step will be to get the algorithm to make better strategic decisions than even the professional StarCraft players using a method called deep reinforcement learning.

"A deep reinforcement learning algorithm learns to develop good strategies by experimenting in an environment. It tries different things, and thereby learns to do more of what it gets rewards from, and less of what it is punished for. Much the same way as a child learns to navigate in the world by trying things out,” Niels Justesen explains.

A milestone for AI

The ITU researcher is not the only one who works to develop a StarCraft algorithm. Facebook and the Google-owned company DeepMind are among those who are working with other aspects of the StarCraft problem. Finding an algorithm that can beat the best humans at the game will probably be the result of a collaboration between researchers and companies, says Niels Justesen.

"Our approach is to split the game into smaller parts and solve the problems one at a time instead of trying to solve the big complex problem at once. In this way, we are gradually trying to solve the overall strategy of the game, while Facebook, for example, is working on getting the algorithm to control a lot of troops at the same time," he says.

Ultimately, the aim is not to humiliate man in yet another game, but to drive AI research a major step forward. A number of the world's leading AI researchers recently estimated that the StarCraft game will be resolved within the next five years. This will be a major step forward that can will have implications far outside the world of gaming," says Niels Justesen.

»

A deep reinforcement learning algorithm learns to develop good strategies by experimenting in an environment. It tries different things, and thereby learns to do more of what it gets rewards from, and less of what it is punished for.

Niels Justesen, PhD student

«
"Google has already used algorithms originally designed to play games to reduce power consumption by 40 percent in their huge data centers. Researchers are also working on using deep learning algorithms to optimize the management of the large power networks known as smart grids. In the medical world, progress in deep learning could help doctors determine diagnoses based on data about the history of thousands of patients," he says and adds:

"Solving StarCraft would be a milestone a bit like the moon landing. You may not get that much out of being on the moon, but the technology you have developed in the process can be used in many other arenas."

If you want to challenge the algorithm at StarCraft, you can do it on Culture Night at ITU on Friday, October 13, 2017.

Further information

Vibeke Arildsen, Press Officer, phone 2555 0447, email viar@itu.dk

News

How Big Things Get Done by Bent Flyvbjerg receives impressive media coverage all over the world

How Big Things Get Done by Bent Flyvbjerg receives impressive media coverage all over the world

March 24, 2023

Bent Flyvbjerg, Professor at IT-University of Copenhagen and University of Oxford, has recently had his book How Big Things Get Done published. The book has received a spectacular welcome and a massive press coverage worldwide.

Do deepfake videos challenge the integrity of online information?

Do deepfake videos challenge the integrity of online information?

March 7, 2023

Deepfakes – highly realistic synthetic audio-video content depicting actual individuals – may potentially increase the dissemination of disinformation online, but research on the phenomenon and how users are affected is sparse. A new research project spearheaded by the IT University’s Human-Centered Data Science research group tackles the issue.

Professor portrait: Teaching and teaching teaching is Claus Brabrand’s hallmark

Professor portrait: Teaching and teaching teaching is Claus Brabrand’s hallmark

March 6, 2023

On March 23, Claus Brabrand, Head of the Center for Computing Education Research (CCER) and member of the Computer Science Department at the IT University of Copenhagen, will present his inaugural lecture as professor. He has spent the past twenty years working in educational research and is today considered a thought leader in the field. The lecture will take place at 14:00 in Auditorium 0 (zero).

ITU web server targeted by attackers, system integrity remains intact

ITU web server targeted by attackers, system integrity remains intact

February 28, 2023

On Thursday, February 23, ITU’s web server was targeted by cyberattackers. The server went offline briefly but the system integrity remains intact.

ITU project to monitor illegal hate speech on social media platforms

ITU project to monitor illegal hate speech on social media platforms

February 27, 2023

Social media platforms are required by law to remove illegal content – such as hate speech – but in Denmark, monitoring of the platforms ceased in 2018. A new ITU lead project aims to monitor platforms for instances of hate speech in Danish and report to the EU.

Ambitious EU funded robot research project to ensure sustainable food handling

Ambitious EU funded robot research project to ensure sustainable food handling

February 20, 2023

The EU MOZART project investigates the latest robotic technologies and system solutions to drive the food industry towards economic, social, and environmental sustainability. The project is coordinated by Professor Kasper Støy of the IT University of Copenhagen.

New research and industry collaboration to improve usability of cyber security tools

New research and industry collaboration to improve usability of cyber security tools

February 6, 2023

Cyberattacks are multi-dimensional, but cybersecurity software lacks the ability to represent threats. A new research and industry collaboration headed up on the ITU side by Associate Professor of Digital Design at the IT University, Daniel Cermak-Sassenrath, sets out to make cybersecurity tools more accessible and usable.

New face at ITU to help build the “Danish embassy of AI”

New face at ITU to help build the “Danish embassy of AI”

February 6, 2023

Associate Professor of Computer Science, Toine Bogers, is a new face at the IT University of Copenhagen. Alongside his work at ITU, he is also the new Chief Scientific Officer of the Pioneer Centre for AI – a collaborative effort between five Danish universities to conduct and facilitate fundamental research in AI.

Radu-Cristian Curticapean secures funding from Villum Fonden for research in resource requirements

Radu-Cristian Curticapean secures funding from Villum Fonden for research in resource requirements

January 24, 2023

This year, 22 research talents from the technical and natural sciences will receive a combined total of DKK 126 million through Villum Fonden Young Investigator Programme. One of this year’s recipients is Associate Professor of Computer Science from the IT University of Copenhagen, Radu-Cristian Curticapean who has been awarded 3 million DKK for research in the field of theoretical computer science.

Regarding incident at last year's exam

Regarding incident at last year's exam

January 13, 2023

Students taking the Security 1 exam on December 22, 2022, were presented with an exam set identical to last year’s. The university administration is still in the process of investigating the incident.

ITU researcher receives grant to develop quantum-inspired algorithms

ITU researcher receives grant to develop quantum-inspired algorithms

December 19, 2022

Associate Professor at the IT University of Copenhagen, Michael Kastoryano, has secured 5 million kroner from the Carlsberg Foundation to develop quantum-inspired algorithms.

ITU researcher receives grant to enable powerful machine learning in smaller hardware environments

ITU researcher receives grant to enable powerful machine learning in smaller hardware environments

December 16, 2022

Associate Professor of Computer Science at the IT University of Copenhagen, Pınar Tözün, has secured 2.7 million kroner from the Novo Nordisk Foundation to develop novel mechanisms to get more value out of data using the computing power of small devices.

ITU researcher secures ERC Consolidator grant to develop rapid learning abilities in AI

ITU researcher secures ERC Consolidator grant to develop rapid learning abilities in AI

December 13, 2022

Professor Sebastian Risi from the IT University’s Digital Design department has received 1.9 million Euros from the European Research Council to develop AI that is capable of adapting to and learning from unforeseen events in a bid to unleash more of the enormous potential of autonomous machines.

Research spinout LAIKA helps creative writers overcome the dreaded writer’s block

Research spinout LAIKA helps creative writers overcome the dreaded writer’s block

December 5, 2022

Associate Professor at the IT University of Copenhagen, Martin Pichlmair, has spearheaded the development of LAIKA – new artificial intelligence that acts as a helping hand for creative writers struggling to find inspiration. Today, LAIKA is officially launched as a spinout company in collaboration with the ITU Business Unit.

Cooperative enterprise is in our cultural DNA – so why aren’t we better at it today?

Cooperative enterprise is in our cultural DNA – so why aren’t we better at it today?

November 29, 2022

Cooperative enterprise may help tackle some of society’s greatest problems, chief among them a constantly changing labour market. Traditionally, cooperative enterprise has played an important role in Denmark, but the business form is marginalized today. The IT University research group Reflection and Action (Reflact) is working on changing that.

Routledge to publish long awaited handbook of collective intelligence

Routledge to publish long awaited handbook of collective intelligence

November 23, 2022

The handbook, which is co-edited by Assistant Professor of the IT University, Carina Antonia Hallin, will provide a much-needed foundation for working in the field of collective intelligence combining human minds and technology for democracy and governance. The book is available for pre-order now.

ITU researcher secures prestigious EU funding for research in theoretical computer science

ITU researcher secures prestigious EU funding for research in theoretical computer science

November 22, 2022

Associate Professor Radu-Cristian Curticapean at the IT University of Copenhagen’s Computer Science department has received a 1.5 million Euro grant from the European Research Council to conduct research in the field of theoretical computer science.

IRFD funds ITU research in voter coercion and graph modification problems

IRFD funds ITU research in voter coercion and graph modification problems

November 15, 2022

IT University of Copenhagen researchers Oksana Kulyk and Paloma Thomé De Lima have been awarded 2.8 million kroner for their respective projects from the Independent Research Fund Denmark.

New research center focuses on IT aspects of the green transition

New research center focuses on IT aspects of the green transition

November 11, 2022

On December 7, the IT University of Copenhagen is launching the new Center for Climate IT which will examine the complex relationship between digitalization and climate change. Join us for an opening reception and panel debate.

Gaming AI engine developers modl.ai close 8.5-million-euro funding deal

Gaming AI engine developers modl.ai close 8.5-million-euro funding deal

November 9, 2022

The company, co-founded by Professor at the IT University, Sebastian Risi, tackles complex game development problems with automation and an army of bots.

Contact us

Phone
+45 7218 5000
E-mail
itu@itu.dk

All contact information

Web Accessibility Statement

Find us

IT University of Copenhagen
Rued Langgaards Vej 7
DK-2300 Copenhagen S
Denmark
How to get here

Follow us

ITU Student /
Privacy /
EAN-nr. 5798000417878/
CVR-nr. 29 05 77 53

This page is printed from https://itu.dk/layouts/itu_responsive/General%20Browser.aspx