XTREME: Reimagining music and art through mixed reality
After three years of research, experimentation and collaboration with some of Europe’s leading cultural institutions, the EU-funded XTREME project is showing how mixed reality could transform the way people experience music, opera and art.
Researchdigital artinnovation
Written 16 November, 2026 11:23 by Jari Kickbusch
Imagine stepping into an opera where the performers are standing right beside you. Or listening to an orchestra from the very centre of the ensemble, surrounded by musicians and immersed in three-dimensional sound. These are the kinds of experiences explored in XTREME, an EU funded, Horizon Europe project led by Professor Sami Brandt from the IT University of Copenhagen (ITU). Bringing together XR artists, musicians and technology partners from across Europe, the researchers have investigated how emerging mixed reality technologies can create entirely new forms of cultural experiences.
Rather than reproducing existing performances in digital form, the researchers sought to understand how virtual and physical worlds can be combined to create experiences that would not be possible in a traditional concert hall, museum or opera house.
“We are not trying to replicate the exact live experience,” says Sami Brandt. “The target has been to create a new kind of experience that you can share with your friends, either in the same room or with friends somewhere else.”
Knausgård novel as mixed reality opera
One of XTREME’s most ambitious projects was the digital production of the Finnish National Opera and Ballet’s adaptation of Karl Ove Knausgård’s novel The Morning Star.
Rather than presenting opera as a conventional stage performance, the team reimagined it as an immersive mixed-reality experience that placed audiences at the heart of the story. Wearing headsets, audience members move through the performance alongside the performers as digital elements materialize around them and the environment continuously transforms in response to the unfolding narrative.
For Sami Brandt, the production captured the project's core ambition of creating experiences that go beyond simply digitising existing art forms.
“The characters come to you. They are around you and you experience them in different surroundings and different worlds,” says Sami Brandt.
Testing new technology
According to Sami Brandt's colleague, ITU postdoctoral researcher and XTREME project manager, Justyna Starostka, the XTREME project was also an opportunity to test mixed reality technology in some of the most demanding cultural settings imaginable.
"This is very new technology, and we are really working at the frontier," she says. "The whole project was about taking that piece of technology and stress-testing it in the real world. We did it in an extreme way because we worked with very ambitious artistic institutions, high-tech researchers and production companies."
The collaboration required researchers and artists to learn from one another. Each production involved different partners, different creative processes and different expectations, creating both opportunities and challenges.
"There are different expectations between researchers, artistic teams and production teams," says Justyna Starostka. "Bringing together these different perspectives has been a challenging but valuable part of developing the experiences."
What comes next?
As XTREME approaches the end of its formal project period, attention is turning to how its results can be taken forward beyond the project's lifetime.
“XTREME has opened several new technological pathways and revealed a range of interesting challenges”, says Sami Brandt. “Beyond the technologies and experiences we have developed, the project has helped us identify promising directions for future research. We are already exploring opportunities for new research projects, and some of the results have also generated concrete business opportunities that are currently being investigated.”
"I think XTREME will live in many different ways after the project ends," says Justyna Starostka. "It has inspired a lot of new research, it has influenced cultural institutions, and it has given us valuable knowledge about how to create these kinds of experiences."
Sami Brandt expects mixed reality cultural experiences to become increasingly common during the coming decade.
"There are already companies developing commercial VR opera experiences," he says. "What we wanted to do was investigate what mixed reality opera could become. Within ten years, I would expect commercial solutions that can demonstrate many of the aspects we explored in this project."
For now, the team is preparing to showcase the project’s results to colleagues, partners and the wider immersive technology community. But the broader ambition remains unchanged: to explore how emerging technologies can create richer, more engaging and more accessible cultural experiences.
XTREME project overview
XTREME is a project financed by the EU Horizon Europe program running from January 2024 to December 2026,
During the project period four different mixed reality productions have been made in collaboration with four cultural institutions:
• MUNCH Museum in Oslo: https://xtremeitu.dk/use-case/munch
• The Finnish National Opera and Ballet in Helsinki: https://xtremeitu.dk/use-case/fnob
• The Irish Chamber Orchestra and the Irish World Academy of Music and Dance: https://xtremeitu.dk/use-case/ico
• Irish World Academy of Music and Dance: https://xtremeitu.dk/use-case/iwamd
XTREME Project Partners:
• IT University of Copenhagen (Denmark)
• University of Limerick (Ireland)
• University of Twente (Netherlands)
• Italian Institute of Technology (Italy)
• MUNCH (Norway)
• Leibniz University Hannover (Germany)
• KHORA (Denmark)
• 4DSOUND (Netherlands)
• AALTO University (Finland)
• Bolt Virtual (Greece)
• Immersive Stories (Denmark)
• University of Nottingham (United Kingdom)
• Finnish National Opera and Ballet (Finland)
Learn more about the XTREME project: https://xtremeitu.dk/
You can also join presentations by project partners, and experience the productions yourself using mixed reality headsets on XTREME Open Day. The event will be held on Friday 27 November, 14:30–17:00, Room 2F13 at EHK (DR Building).
Learn more the Open Day event: https://xtremeitu.dk/2026/11/11/xtreme-open-day-at-it-university-of-copenhagen-three-years-of-art-culture-and-mixed-reality