Skip to main content ITU
Logo
  • Programmes
    • BSc Programmes
    • BSc in Global Business Informatics
    • BSc in Digital Design and Interactive Technologies
    • BSc in Software Development
    • BSc in Data Science
    • Applying for a BSc Programme
    • MSc Programmes
    • MSc in Digital Innovation & Management
    • MSc in Digital Design and Interactive Technologies
    • MSc in Software Design
    • MSc in Computer Science
    • MSc in Data Science
    • MSc in Games
    • Applying for an MSc Programme
    • Student Life
    • Women in tech
    • Student Organisations at ITU
    • Labs for students
    • Practical Information for International Students
    • Study Start
    • Study and Career Guidance
    • Guest Students
    • Who can be a Guest Student
    • ITU Summer University
    • Exchange Student
    • Become an exchange student at ITU
    • Open House
    • Open House - MSc Programmes
    • Open House - BSc programmes
  • Professional Education
    • Master in IT
    • Master in IT Management
    • Single Subjects
    • About single subjects
    • Contact
    • Contact us here
  • Research
    • Departments
    • Business IT Department
    • Computer Science Department
    • Digital Design Department
    • Research Groups and Labs
    • Research Groups
    • Labs
    • Research Centres
    • Centre for Digital Play
    • Center for Computing Education Research
    • Centre for Digital Welfare
    • Centre for Information Security and Trust
    • European Blockchain Centre
    • Danish Institute for IT Program Management
    • Find a Researcher
    • Faculty Search
    • Research Ethics and Integrity
    • Good Scientific Practice
    • Technical Reports
    • Technical Reports
    • PhD Programme
    • About the PhD Programme
    • PhD Courses
    • PhD Defences
  • Collaboration
    • Collaboration with students
    • Project collaboration
    • Project Market
    • Student worker
    • Project postings
    • Job and Project bank
    • Portraits of ITU graduates
    • Employer Branding
    • IT Match Making
    • Hiring an ITU student or graduate
    • Make a post in the job bank
    • Research collaboration
    • Licensing Opportunities
    • Open Entrepreneurship
    • Research collaboration
    • Industrial PhD
    • Hire an Industrial PhD
    • Innovation and entrepreneurship
    • ITU Business Development
    • ITU Startup programme
    • Startup stories
  • About ITU
    • Vacancies
    • Press
    • ITU Alumni
    • News
    • Calendar
    • Contact
    • About ITU
  • DK
Researchers are training a deep learning algorithm to beat humans at StarCraft
ITU  /  Press  /  News from ITU  /  Researchers are training a deep learning algorithm to beat humans at StarCraft

Researchers are training a deep learning algorithm to beat humans at StarCraft

Computers have already crushed humans at chess, Go and poker. Now, researchers at the IT University of Copenhagen are training an algorithm to beat the best human players in the sci-fi computer game StarCraft. If the project succeeds, it will be another quantum leap forward for artificial intelligence (AI).

Computer Science DepartmentResearchalgorithmscomputer gamesartificial intelligence

Written October 4, 2017 6:49 AM by Vibeke Arildsen

The more complex a game is, the more it resembles reality with all its unpredictability and unknowns. This is why AI researchers are now taking on computer games like StarCraft, which is estimated to have 101685 possible configurations in each match.

Niels Justesen is a year into his PhD project at the IT University of Copenhagen, and is working towards developing a self-learning AI algorithm that can beat even professional StarCraft players.

VIDEO: Watch the researchers’ algorithm (blue) beat StarCraft’s built-in training bot (purple).

www.youtube.com/embed/Ps_5P8Xx3_s

"Until now, research on computer games and deep learning algorithms has focused on trying to learn the games end-to-end, but that approach would be very difficult in a game like StarCraft because it is so complex. In StarCraft, you have uncertainty about how the opponent is going to act, just as in the real world. At the same time, the player must control an entire army and delegate tasks to different units of troops. Learning an algorithm to make the right decisions in such a complex system is a very general challenge for AI that, if resolved, can affect many other areas," he says.

AI trained on 2,000 games

So far, Niels Justesen and supervisor Sebastian Risi have trained the algorithm on 2,000 games involving some of the world's best StarCraft players. Based on this data set, the algorithm has gradually learned how human players have reacted in nearly 800,000 different game situations. To a certain extent, the algorithm can generalize this knowledge and use it make decisions in situations it has not experienced before. At this point, the algorithm plays at the same level as intermediate human StarCraft players.

StarCraft

StarCraft is a sci-fi strategy game where the player must build an army and destroy the opponent’s base. The game is particularly popular in South Korea, where professional StarCraft players are big stars.

The next step will be to get the algorithm to make better strategic decisions than even the professional StarCraft players using a method called deep reinforcement learning.

"A deep reinforcement learning algorithm learns to develop good strategies by experimenting in an environment. It tries different things, and thereby learns to do more of what it gets rewards from, and less of what it is punished for. Much the same way as a child learns to navigate in the world by trying things out,” Niels Justesen explains.

A milestone for AI

The ITU researcher is not the only one who works to develop a StarCraft algorithm. Facebook and the Google-owned company DeepMind are among those who are working with other aspects of the StarCraft problem. Finding an algorithm that can beat the best humans at the game will probably be the result of a collaboration between researchers and companies, says Niels Justesen.

"Our approach is to split the game into smaller parts and solve the problems one at a time instead of trying to solve the big complex problem at once. In this way, we are gradually trying to solve the overall strategy of the game, while Facebook, for example, is working on getting the algorithm to control a lot of troops at the same time," he says.

Ultimately, the aim is not to humiliate man in yet another game, but to drive AI research a major step forward. A number of the world's leading AI researchers recently estimated that the StarCraft game will be resolved within the next five years. This will be a major step forward that can will have implications far outside the world of gaming," says Niels Justesen.

»

A deep reinforcement learning algorithm learns to develop good strategies by experimenting in an environment. It tries different things, and thereby learns to do more of what it gets rewards from, and less of what it is punished for.

Niels Justesen, PhD student

«
"Google has already used algorithms originally designed to play games to reduce power consumption by 40 percent in their huge data centers. Researchers are also working on using deep learning algorithms to optimize the management of the large power networks known as smart grids. In the medical world, progress in deep learning could help doctors determine diagnoses based on data about the history of thousands of patients," he says and adds:

"Solving StarCraft would be a milestone a bit like the moon landing. You may not get that much out of being on the moon, but the technology you have developed in the process can be used in many other arenas."

If you want to challenge the algorithm at StarCraft, you can do it on Culture Night at ITU on Friday, October 13, 2017.

Further information

Vibeke Arildsen, Press Officer, phone 2555 0447, email viar@itu.dk

News

Recommendations to boost cooperative enterprise based on ITU research

Recommendations to boost cooperative enterprise based on ITU research

June 24, 2022

Danish startups and entrepreneurs lack knowledge of the potential in cooperative enterprise. The Ministry of Industry, Business and Financial Affairs’ taskforce on cooperative enterprise has published a new set of recommendations for legislators to address the problem. A team of ITU researchers has been instrumental in devising the recommendations by analyzing democratic entrepreneurship in Denmark.

Per Bruun Brockhoff appointed new Vice-Chancellor of the IT University of Copenhagen

Per Bruun Brockhoff appointed new Vice-Chancellor of the IT University of Copenhagen

June 20, 2022

Department Head at DTU Compute, Per Bruun Brockhoff, will take office as Vice-Chancellor of the IT University on September 1, 2022.

Innovation projects apply knowledge in practice – and presents new perspectives on research

Innovation projects apply knowledge in practice – and presents new perspectives on research

June 16, 2022

Researchers at the IT University of Copenhagen, Cancan Wang and Bernardo David, have secured funding from Copenhagen Fintech to realize their respective innovation projects in a private sector context. Innovation projects allow researchers to apply their knowledge in practice and gain new research insights.

NERDS research group wins best research environment award

NERDS research group wins best research environment award

June 2, 2022

The IT University’s Networks, Data, and Society (NERDS) research group is the winner of Danish Young Academy’s award for best research environment.

Funding: ITU researchers examine cultural dynamics in the age of digitalisation

Funding: ITU researchers examine cultural dynamics in the age of digitalisation

June 1, 2022

Associate Professor at Digital Design, Luca Rossi, and Postdoc at Business IT, Vasilieos-Spyridon Vlassis, have secured 4.6 million kroner from the European CHANSE programme for their respective research projects in digital innovation and social and cultural dynamics.

Space missions: SpaceX is faster and more cost-efficient than NASA

Space missions: SpaceX is faster and more cost-efficient than NASA

May 30, 2022

A new study from the internationally renowned project management expert and Villum Kann Rasmussen Professor at the IT University of Copenhagen, Bent Flyvbjerg, concludes that in using a scalable platform strategy, SpaceX is more efficient than NASA when it comes to launching missions into space.

Rasmus Ejlers Møgelberg and Jonas Fritsch receive grants from IRFD

Rasmus Ejlers Møgelberg and Jonas Fritsch receive grants from IRFD

May 10, 2022

The two researchers – from Computer Science and Digital Design at the IT University respectively – have each secured a grant of approximately 2.8 million kroner for their research projects.

European Blockchain Center announces new partnership

European Blockchain Center announces new partnership

April 28, 2022

The European Blockchain Center at the IT University of Copenhagen is partnering with SupraOracles to explore future collaborative efforts to provide value to the blockchain industry on a global scale.

Can robots help prevent anxiety attacks in children?

Can robots help prevent anxiety attacks in children?

April 26, 2022

Morten Roed Frederiksen from Computer Science at ITU has received 1.6 million kroner from Independent Research Fund Denmark for at research project that aims to make robots better at understanding human emotion. The goal is to create technology that may help children with anxiety.

Professor Sebastian Risi receives grant to develop policy learning with neural networks

Professor Sebastian Risi receives grant to develop policy learning with neural networks

April 20, 2022

Professor in the Digital Design Department at the IT University of Copenhagen, Sebastian Risi, has received a grant of approximately 550,000 Danish kroner for his work on neural cellular automata to grow neural network policies capable of adapting to novel complex reinforcement learning tasks.

New research may help improve Copenhagen’s bicycle infrastructure

New research may help improve Copenhagen’s bicycle infrastructure

March 28, 2022

A newly released research paper shows how network analysis can serve as a cost-efficient support tool for bicycle infrastructure planning. The research has been conducted by analyzing the street network in Copenhagen based on data from OpenStreetMap.

ITU professor takes critical approach to green tech, secures prestigious grant

ITU professor takes critical approach to green tech, secures prestigious grant

March 17, 2022

Professor at the IT University of Copenhagen’s Business IT department Steffen Dalsgaard has won the prestigious ERC Consolidator Grant. The almost two million Euro grant will enable him and his colleagues to critically examine IT and sustainability across the globe.

We need to talk about marine renewable energy

We need to talk about marine renewable energy

March 3, 2022

Denmark lacks neither ocean waves nor pioneering scientists and innovators who are dreaming about harnessing energy from them. Professor at IT University of Copenhagen Brit Ross Winthereik, who headed research into initiatives in wave energy innovation around the Atlantic, explains why we are still waiting to see a booming wave energy industry.

IT University to suspend all cooperation with Russia and Belarus

IT University to suspend all cooperation with Russia and Belarus

March 2, 2022

Along with Denmark’s other universities, ITU will be suspending all bilateral institutional cooperation with the states of Russia and Belarus going forward. Current exchange programme participants will not be affected by the measure.

New blockchain governance standard to generate trust and accountability in the market

New blockchain governance standard to generate trust and accountability in the market

February 28, 2022

The new standard, developed by Professor Roman Beck at the IT-University and Danish Standard, will ensure greater transparency, interoperability, and accountability in the use of blockchain and DLT systems. Professor Roman Beck has recently received AIS’s Impact Award for his work in the field.

Using Minecraft to explore climate change topics with school children

Using Minecraft to explore climate change topics with school children

February 8, 2022

Few of the world’s most popular games deal directly with climate issues. However, games can still be used to make gamers think about real world problems, says Associate Professor, Hans-Joachim Backe, who is developing tools for teachers to discuss climate issues based on for example Minecraft.

Digitizing the Amazon: How to use the rainforest without ruining it

Digitizing the Amazon: How to use the rainforest without ruining it

February 8, 2022

There is a lot of hope that the digital, material, and biological innovations of the Fourth Industrial Revolution will help us save the Amazon rainforest. However, the real impact of the new bio economy is yet to be revealed. Researchers from the IT University will study the outcome of Amazônia 4.0.

How do we secure critical technologies from tampering? The answer may be sending them into orbit

How do we secure critical technologies from tampering? The answer may be sending them into orbit

January 20, 2022

At the IT University of Copenhagen, Associate Professor Bernardo David, is working on a joint research project that aims to send satellites that power cryptographic and blockchain applications into orbit in order to secure them from tampering and to enable time-based primitives based on communication delays.

ITU PhD fellow named Game Changer by gaming industry mainstay

ITU PhD fellow named Game Changer by gaming industry mainstay

January 5, 2022

PhD fellow at the Center for Computer Games Research at the IT University of Copenhagen, Leon Y. Xiao, is new to ITU, but his research into the legal and ethical aspects of the gaming industry has already made an impact. Gaming industry mainstay, GamesIndustry.biz, recently named him one of 2021’s Game Changers.

Martin Tvede Zachariasen steps down as Vice-Chancellor

Martin Tvede Zachariasen steps down as Vice-Chancellor

December 20, 2021

Martin Tvede Zachariasen steps down as Vice-Chancellor of the IT University after three years in office. Martin Tvede Zachariasen’s resignation takes effect December 31, 2021.

Contact us

Phone
+45 7218 5000
E-mail
itu@itu.dk

All contact information

Web Accessibility Statement

Find us

IT University of Copenhagen
Rued Langgaards Vej 7
DK-2300 Copenhagen S
Denmark
How to get here

Follow us

ITU Student /
Privacy /
EAN-nr. 5798000417878/
CVR-nr. 29 05 77 53

This page is printed from https://en.itu.dk/News?tag=%7B9EAE610E-FB0F-4642-AD63-CE297525C30B%7D