Skip to main content ITU
Logo
  • Programmes
    • BSc Programmes
    • BSc in Global Business Informatics
    • BSc in Digital Design and Interactive Technologies
    • BSc in Software Development
    • BSc in Data Science
    • Applying for a BSc Programme
    • MSc Programmes
    • MSc in Digital Innovation & Management
    • MSc in Digital Design and Interactive Technologies
    • MSc in Software Design
    • MSc in Computer Science
    • MSc in Data Science
    • MSc in Games
    • Applying for an MSc Programme
    • Student Life
    • Women in tech
    • Student Organisations at ITU
    • Labs for students
    • Practical Information for International Students
    • Study Start
    • Study and Career Guidance
    • Guest Students
    • Who can be a Guest Student
    • ITU Summer University
    • Exchange Student
    • Become an exchange student at ITU
    • Open House
    • Open House - MSc Programmes
    • Open House - BSc programmes
  • Professional Education
    • Master in IT
    • Master in IT Management
    • Single Subjects
    • About single subjects
    • Contact
    • Contact us here
  • Research
    • Departments
    • Business IT Department
    • Computer Science Department
    • Digital Design Department
    • Research Groups and Labs
    • Research Groups
    • Labs
    • Research Centres
    • Centre for Computer Games Research
    • Center for Computing Education Research
    • Centre for Digital Welfare
    • Centre for Information Security and Trust
    • European Blockchain Centre
    • Research Centre for Government IT
    • Research Institutes
    • Danish Institute for IT Program Management
    • Selected Research Themes
    • Artificial intelligence
    • Big Data
    • Climate IT
    • Computer games
    • Blockchain
    • Digitalization
    • IT security
    • Find a Researcher
    • Faculty Search
    • PhD Programme
    • About the PhD Programme
    • Available PhD Positions
    • PhD Courses
    • Research Ethics and Integrity
    • Good Scientific Practice
    • PhD Defences
    • Technical Reports
    • Technical Reports
  • Collaboration
    • Collaboration with students
    • Project collaboration
    • Project Market
    • Student worker
    • Project postings
    • Job and Project bank
    • Portraits of ITU graduates
    • Employer Branding
    • IT Match Making
    • Hiring an ITU student or graduate
    • Make a post in the job bank
    • Research collaboration
    • Licensing Opportunities
    • Open Entrepreneurship
    • Research collaboration
    • Industrial PhD
    • Hire an Industrial PhD
    • Innovation and entrepreneurship
    • ITU Business Development
    • ITU Startup programme
    • Startup stories
  • About ITU
    • Vacancies
    • Press
    • ITU Alumni
    • News
    • Calendar
    • Contact
    • About ITU
  • DK
PhD Courses
ITU  /  Research  /  PhD Programme  /  PhD Courses  /  PhD courses 2022  /  PhD Course - Deep Learning - A Computational Efficiency Perspective
  • Research
    • Research Departments
    • Research Ethics and Integrity
    • Good Scientific Practice
    • Research Groups and Centers
    • Labs
    • Technical Reports
    • PhD Programme
      • Industrial PhD
      • Marie Curie European Industrial PhD
      • Project PhD
      • Institute PhD
      • Independent PhD - Tuition Fee Free
      • PhD Positions
      • PhD Courses
        • PhD courses 2022
          • PhD Course - International Blockchain School - Winter Edition
          • Literature management module 1 - Academic information seeking and reference management
          • Literature management module 2 - Literature reviews: planning and searching for evidence
          • Literature management module 3 Researcher’s rights to scientific works and Anti-plagiarism screening
          • PhD Course - An Introduction to Data Visualization and Data Visualization Technology
          • PhD Course - Critical Participatory Research and Design
          • PhD Course - Deep Learning - A Computational Efficiency Perspective
            • PhD Course - Eludamos Symposium Doctoral Consortium
            • PhD Course - Experimenting with ethnography
            • PhD Course - Polynomials and algebraic complexity theory
            • PhD Course - Program Verification
            • PhD Course - Research Code of Conduct
            • PhD Reading Group - Introductory Formal Methods
            • PhD Study Group - Deep Generative Models
            • PhD Symposium - Into the academic Werkstatt - the craft of writing and preparing for publication
          • PhD courses 2021
          • PhD courses 2020
          • PhD Courses 2019
          • PhD Courses 2018
          • PhD courses 2017
          • PhD courses 2016
          • PhD courses 2015
          • PhD courses 2014
          • PhD courses 2013
          • PhD courses 2012
          • PhD courses 2011
          • PhD courses 2010
        • PhD Defences
        • PhD Handbook
        • PhD Support
      • Center for Digital Welfare

    PhD Course - Deep Learning - A Computational Efficiency Perspective

    Organizer(s):

    • Pınar Tözün (Associate Prof., main organizer)
    • Ties Robroek (PhD student, helper)
    • Ehsan Yousefzadeh-Asl-Miandoab (PhD student, helper)

    Course advertisement:

    • We have a link at Computer Science Wiki: Link

    Lecturer(s):

    • Pınar Tözün

    Date(s) of the course:

    • In total 9 lectures occurring every Monday from January 31, 2022 to April 4, 2022. There will be a break week because of instructor attending a Dagstuhl seminar on March 14.

    Time:

    • 13:00 – 15:00

    Room:

    • The course will be given in hybrid format with in-person presence at 4A05 and online presence on ITU’s Teams.

    Course description:

    Data scientists achieve more accurate predictions than ever, even in real-time, for the benefit of our society. Their productivity is fuelled by the exponential evolution of hardware and the surge of deep learning tools, which hide the complexities of hardware. However, there is a widening performance gap between the software tools and modern hardware. Modern tools are not able to utilize modern hardware fully. There is a pressing need for more hardware-conscious deep learning. In this course, our goal is to learn about methods to perform deep learning efficiently on modern hardware. 

    Intended learning outcomes are the following:
    (1)    Reflect on the evolution of modern hardware, especially in the context of deep learning applications
    (2)    Analyze performance metrics relevant for deep learning applications
    (3)    Reflect on the methods for computationally-efficient deep learning across different hardware platforms

    Reading list:

    Mandatory reading:

    We will be reading one or more chapters from the book below each week. We may complement some of the weeks with a research paper if desired by the participants.

    • Efficient Processing of Deep Neural Networks

    Optional reading for preparation for the class:

    The book below is a short and higher-level introduction to some of the topics we will dig deeper into in this class. It is written to help computer architects to get familiar with deep learning topics. If the participants wish to get a high-level familiarity with some of the terminology earlier on, we recommend them to read this book before the class starts. However, this isn’t mandatory reading for the lectures themselves.

    • Deep Learning for Computer Architects

    Programme:

    • The program can be found here

    Prerequisites:

    • Some familiarity with machine learning and computer architecture would be useful. However, we want to leave the course open to anyone who are interested in computational efficiency of machine learning workloads. If we realize that a big majority of the people in the course need background material on a certain topic, then we will re-arrange some reading material to include background on that topic.

    Exam:

    • Oral Exam with Pass/Fail result

    Credits:

    • 2 ECTS

    Amount of hours the student is expected to use on the course:

    • Participation: 2 hours – Weekly lectures will be 2 hours of presentation & discussion weekly on that week’s topic
    • Preparation: Approx. 4 hours

     

    Contact us

    Phone
    +45 7218 5000
    E-mail
    itu@itu.dk

    All contact information

    Web Accessibility Statement

    Find us

    IT University of Copenhagen
    Rued Langgaards Vej 7
    DK-2300 Copenhagen S
    Denmark
    How to get here

    Follow us

    ITU Student /
    Privacy /
    EAN-nr. 5798000417878/
    CVR-nr. 29 05 77 53

    This page is printed from https://en.itu.dk/research/portalplaceholder?layoutfraction=top&langRef=https://pure.itu.dk/portal/da/organisations/digital-design(d065e6c2-4fae-4d68-ad04-70aec25d2d5e)/clippings.html?page=29