Team
Prof. Dr.-Ing. Christof Weiß
Professor
Computational Humanities
Julius-Maximilians-Universität Würzburg
ZPD building
Hubland Nord
ZPD building
Hubland Nord
97074
Würzburg
Germany
Building:
ZPD
Room:
02.006
Phone:
+49 931 31 80528
Recent Positions
| 11/2022 – present | Professor for Computational Humanities, CAIDAS / Institute of Computer Science, Julius-Maximilians-Universität Würzburg (JMU), Germany |
| 01/2021 – 12/2021 | Visiting Researcher (DFG Research Fellowship), Audio Data Analysis and Signal Processing group at University Télécom Paris, France. Cooperating partner: Prof. Geoffroy Peeters |
| 04/2020 – 07/2020, 04/2021 – 07/2021 | Visiting Lecturer, Karlsruhe University of Music, Germany |
| 09/2015 – 10/2022 | Research Assistant, Semantic Audio Processing, International Audio Laboratories Erlangen, Friedrich-Alexander-Universität Erlangen-Nürnberg (FAU), Germany |
| 10/2012 – 07/2015 | Research Assistant, Fraunhofer Institute for Digital Media Technology (IDMT) Ilmenau, Germany |
Education
| 2017 | PhD (Media Technology), University of Technology Ilmenau, Supervisor: Prof. Karlheinz Brandenburg, Computational Methods for Tonality-Based Style Analysis of Classical Music Audio Recordings |
| 2012 | Concert Diploma (Composition), Würzburg University of Music (Tobias P. M. Schneid) |
| 2012 | Physics Diploma, University of Würzburg |
| 2011 | Music Diploma (Composition), Würzburg University of Music (Prof. Heinz Winbeck) |
| 2006 | Abitur, Max-Reger-Gymnasium Amberg |
Scholarships
| 10/2012 – 08/2015 | Fellow of the Foundation of German Business (sdw) PhD program |
| 05/2007 – 03/2012 | Fellow of the Foundation of German Business (sdw) study program |
Prizes and Awards
| 10/2018 | KlarText award for science communication of the Klaus Tschira Foundation. The award-winning article "Das ist Haydn. Ganz sicher!" was distributed as a supplement to German newspaper DIE ZEIT. |
| 04/2013 | Composition competition Festival Pablo Casals, Prades (France), 2nd prize for the piece "shading a changeable timeframe" for violin, french horn, clarinet, cello, and piano |
| 10/2011 | Youth Cultural Advancement Award (Kulturförderpreis) of the city of Amberg, Germany |
Research Stays
| 01/2021 – 12/2021 | Research stay at Audio Data Analysis and Signal Processing group, University Télécom ParisTech, France, with Prof. Geoffroy Peeters |
| 11/2014 | Research stay at Centre for Digital Music, Queen Mary University of London, UK, with Dr. Matthias Mauch and Dr. Simon Dixon |
| 01/2014 – 02/2014 | Research stay at Centre for Digital Music, Queen Mary University of London, UK, with Dr. Matthias Mauch and Dr. Simon Dixon |
| 05/2011 – 08/2011 | Research stay at Instituto di Fisica Corpuscular (IFIC) Valencia, Spain, with Dr. Martin Hirsch |
2023[ to top ]
-
Soft Dynamic Time Warping For Multi Pitch Estimation And Beyond in Proceedings of the IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP) (2023).
2022[ to top ]
-
JSD: A Dataset for Structure Analysis in Jazz Music in Transactions of the International Society for Music Information Retrieval (TISMIR) (2022). 5(1) 156–172.
-
Comparing Deep Models and Evaluation Strategies for Multi-Pitch Estimation in Music Recordings in IEEE/ACM Transactions on Audio, Speech & Language Processing (2022). 30 2814–2827.
-
Mid-level Harmonic Audio Features for Musical Style Classification in Proceedings of the International Society for Music Information Retrieval Conference (ISMIR) (2022).
2021[ to top ]
-
Computergestützte Visualisierung von Tonalitätsverläufen in Musikaufnahmen. Möglichkeiten für die Korpusanalyse in Instrumentalmusik neben Haydn und Mozart. Analyse, Aufführungspraxis und Edition, S. Klauk (ed.) (2021). 107–130.
-
What if the ’When’ Implies the ’What’?: Human Harmonic Analysis Datasets Clarify the Relative Role of Separate Steps in Automatic Tonal Analysis in Proceedings of the International Society for Music Information Retrieval Conference (ISMIR) (2021). 229–236.
-
Learning Multi-Pitch Estimation From Weakly Aligned Score-Audio Pairs Using a Multi-Label CTC Loss in Proceedings of the IEEE Workshop on Applications of Signal Processing to Audio and Acoustics (WASPAA) (2021). 121–125.
-
Training Deep Pitch-Class Representations With a Multi-Label CTC Loss in Proceedings of the International Society for Music Information Retrieval Conference (ISMIR) (2021). 754–761.
-
Singing Voice Detection in Opera Recordings: A Case Study on Robustness and Generalization in Electronics (2021). 10(10) 1214:1–14.
-
Learning Pitch-Class Representations from Score-Audio Pairs of Classical Music in Proceedings of the International Society for Music Information Retrieval Conference (ISMIR) (2021). 746–753.
-
Schubert Winterreise Dataset: A Multimodal Scenario for Music Analysis in ACM Journal on Computing and Cultural Heritage (JOCCH) (2021). 14(2) 25:1–18.
-
’Seitensatz’ versus ’Mittelsatz’: Expositionen in Beethovens frühen Klaviersonaten zwischen zeitgenössischer Theorie und computergestützter Analyse in Jahrbuch 2017 des Staatlichen Instituts für Musikforschung (SIM) -- Preußischer Kulturbesitz, S. Hohmaier (ed.) (2021).
-
Towards Leitmotif Activity Detection in Opera Recordings in Transactions of the International Society for Music Information Retrieval (TISMIR) (2021). 4(1) 127–140.
-
Towards Deep Learning Strategies for Transcribing Electroacoustic Music in Perception, Representations, Image, Sound, Music, R. Kronland-Martinet, S. Ystad, M. Aramaki (eds.) (2021). 48–59.
2020[ to top ]
-
Local Key Estimation in Music Recordings: A Case Study Across Songs, Versions, and Annotators in IEEE/ACM Transactions on Audio, Speech & Language Processing (2020). 28 2919–2932.
-
Local Key Estimation in Classical Music Recordings: A Cross-Version Study on Schubert’s Winterreise in Proceedings of the IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP) (2020). 501–505.
-
Classifying Leitmotifs in Recordings of Operas by Richard Wagner in Proceedings of the International Society for Music Information Retrieval Conference (ISMIR) (2020). 473–480.
-
Discourse Not Dualism: An Interdisciplinary Dialogue On Sonata Form in Beethoven’s Early Piano Sonatas in Proceedings of the International Society for Music Information Retrieval Conference (ISMIR) (2020). 199–206.
-
Dagstuhl ChoirSet: A Multitrack Dataset for MIR Research on Choral Singing in Transactions of the International Society for Music Information Retrieval (TISMIR) (2020). 3(1) 98–110.
2019[ to top ]
-
Towards Deep Learning Strategies for Transcribing Electroacoustic Music in Proceedings of the 14th International Symposium on Computer Music Multidisciplinary Research (CMMR) (2019). 450–461.
-
Cross-Version Singing Voice Detection in Opera Recordings: Challenges for Supervised Learning in Machine Learning and Knowledge Discovery in Databases - Proceedings of the International Workshops of ECML PKDD 2019, Part II, Communications in Computer and Information Science (2019). (Vol. 1168) 429–436.
-
Mid-Level Chord Transition Features for Musical Style Analysis in Proceedings of the IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP) (2019). 341–345.
-
Investigating CNN-based Instrument Family Recognition for Western Classical Music Recordings in Proceedings of the 20th International Society for Music Information Retrieval Conference (ISMIR) (2019). 612–619.
-
Towards Measuring Intonation Quality of Choir Recordings: A Case Study on Bruckner’s Locus Iste in Proceedings of the 20th International Society for Music Information Retrieval Conference (ISMIR) (2019). 276–283.
-
Investigating Style Evolution of Western Classical Music: A Computational Approach in Musicae Scientiae (2019). 23(4) 486–507.
2018[ to top ]
-
Computational Corpus Analysis: A Case Study on Jazz Solos in Proceedings of the 19th International Society for Music Information Retrieval Conference (ISMIR) (2018). 416–423.
2017[ to top ]
-
Exploring Tonal-Dramatic Relationships in Richard Wagner’s Ring Cycle in Proceedings of the 18th International Society for Music Information Retrieval Conference (ISMIR) (2017). 642–648.
-
Versionsübergreifende Visualisierung harmonischer Verläufe: Eine Fallstudie zu Wagners Ring-Zyklus in Proceedings of the Jahrestagung der Gesellschaft für Informatik (GI) (2017). 205–217.
-
A Multi-Version Approach for Transferring Measure Annotations Between Music Recordings in Proceedings of the AES International Conference on Semantic Audio (2017). 148–155.
-
Computational Methods for Tonality-Based Style Analysis of Classical Music Audio Recordings PhD thesis, Ilmenau University of Technology, Ilmenau, Germany. (2017).
2016[ to top ]
-
Möglichkeiten der computergestützten Erkennung und Visualisierung harmonischer Strukturen -- eine Fallstudie zu Richard Wagners "Die Walküre" in Bericht zur Jahrestagung der Gesellschaft für Musikforschung (GfM) 2015 in Halle/Saale, W. Auhagen, W. Hirschmann (eds.) (2016).
-
Analyzing Measure Annotations for Western Classical Music Recordings in Proceedings of the 17th International Society for Music Information Retrieval Conference (ISMIR) (2016). 517–523.
2015[ to top ]
-
On the Impact of Key Detection Performance for Identifying Classical Music Styles in Proceedings of the 16th International Society for Music Information Retrieval Conference (ISMIR) (2015). 45–51.
-
Zum Scherzo aus Hans Rotts 1. Sinfonie in Mythos Handwerk?, A. Jeßulat (ed.) (2015). 187–212.
-
Tonal Complexity Features for Style Classification of Classical Music in Proceedings of the IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP) (2015). 688–692.
2014[ to top ]
-
A Mid-Level Approach to Local Tonality Analysis: Extracting Key Signatures from Audio in Proceedings of the 53rd AES International Conference on Semantic Audio (2014).
-
Chroma-Based Scale Matching for Audio Tonality Analysis in Proceedings of the 9th Conference on Interdisciplinary Musicology (CIM) (2014). 168–173.
-
Quantifying and Visualizing Tonal Complexity in Proceedings of the 9th Conference on Interdisciplinary Musicology (CIM) (2014). 184–187.
-
Timbre-Invariant Audio Features for Style Analysis of Classical Music in Proceedings of the Joint Conference 40th ICMC and 11th SMC (2014). 1461–1468.
-
Automatic Style Classification of Jazz Records with Respect to Rhythm, Tempo, and Tonality in Proceedings of the 9th Conference on Interdisciplinary Musicology (CIM) (2014). 162–167.
2013[ to top ]
-
Global Key Extraction from Classical Music Audio Recordings Based on the Final Chord in Proceedings of the 10th Sound and Music Computing Conference (SMC) (2013). 742–747.
-
Supersymmetric Type-III Seesaw Mechanism: Lepton Flavor Violation and LHC Phenomenology in Physical Review D (2013). 87(1) 013010.
- Computergestützte Musikanalyse: Szenarien, Methoden und Evaluationsprobleme, Workshop: Datenanalyse für die Digital Humanities: Projekte, Methoden, Einsichten, Center for Artificial Intelligence and Data Science (CAIDAS), JMU Würzburg, February 8th, 2023
- Computational Analysis of Music Audio Recordings: Exploiting Raw Data for the Humanities, AI talks, Center for Artificial Intelligence and Data Science (CAIDAS), JMU Würzburg, January 24th, 2023
- Computergestützte Analyse von Musikaufnahmen: Korpora, Konzepte und Algorithmen, Arbeitskreis Philologie und Digitalität, Zentrum für Philologie und Digitalität (ZPD), JMU Würzburg, December 15th, 2022
- Neue Wege für die Musikforschung mittels Digitaler Signalverarbeitung (with Rainer Kleinertz and Meinard Müller), Ringvorlesung Geisteswissenschaften und Informatik im Dialog – Aktuelle Perspektiven der Digital Humanitities, Musikwissenschaft Univ. d. Saarlandes / Trier Center for Digital Humanities, January 10th, 2022
- Musikwissenschaft und Informatik im Dialog: Möglichkeiten der computergestützten harmonischen Analyse (with Rainer Kleinertz), Vortragsreihe Praxis der Digital Humanities, Trier Center for Digital Humanities, Universität Trier, January 7th, 2021
- Neue Wege für die Musikforschung mittels Digitaler Signalverarbeitung (with Meinard Müller), Ringvorlesung Tech Talk, Interdisziplinäres Zentrum für Digitale Geistes- und Sozialwissenschaften, FAU Erlangen-Nürnberg, December 10th, 2019 Handouts (Part 1), Handouts (Part 2), Flyer
- Exploiting Audio Data for Musicological Research, 2nd Heidelberg Computational Humanities Summer School (HCH19), Heidelberg University, July 2019
- Das ist Haydn, ganz sicher! – Über die automatische Erkennung von Musikstilen, Wissenschaft im Schloss, FAU Erlangen-Nürnberg, June 17th, 2019. Video of the talk
- Wie gut können Computer hören? Die Analyse von Musikaufnahmen als interdisziplinäres Forschungsfeld, Collegium Alexandrinum, FAU Erlangen-Nürnberg, May 9th, 2019. Video of the talk
- Das ist Haydn, ganz sicher!, Max-Reger-Gymnasium Amberg (Germany), February 2019
- Wie gut können Computer hören? – Über die Anwendung musiktheoretischer Konzepte auf Audiodaten, Hochschule für Musik Würzburg, December 2018
- Computergestützte Analyse von Musikaufnahmen am Beispiel von Richard Wagners Ring-Zyklus, Institutskolloquium des Instituts für Musikforschung, JMU Würzburg, July 2017
- Computergestützte Analyse von Musikaufnahmen – Neue Möglichkeiten für die Musikwissenschaften, Hochschule für Musik Karlsruhe, November 2016
Organization of Scientific Events
- Chair, 4. Workshop der GI-Fachgruppe "Informatik und Digital Humanities", INFORMATIK Festival 2023, Berlin, September 2023
- Music Chair (with Martin Gasser), International Society for Music Information Conference (ISMIR), Delft (The Netherlands), November 2019
- Organizer, Seminar Musiktechnologie im 21. Jahrhundert – Vom mp3-Player zum virtuellen Musikwissenschaftler for fellows of the Stiftung der Deutschen Wirtschaft (sdw), Ilmenau (Germany), July 2015
Editorial Activities and Society Activities
- Member of the Board of Directors of the International Society for Music Information Retrieval (ISMIR), 2022–2023
- Member of the Editorial board, ACM Journal on Computing and Cultural Heritage, since 2022
Reviewing
- Proceedings of the International Society for Music Information Retrieval Conference (Meta-Reviewer)
- Transactions of the International Society for Music Information Retrieval
- Music & Science
- IEEE Signal Processing Magazine
- Musicae Scientiae
- Neural Computing and Applications
- Scientometrics
- IEEE/ACM Transactions on Audio, Speech, and Language Processing
- ACM Journal on Computing and Cultural Heritage
- Applied Sciences
Participations
- Dagstuhl Seminar: Deep Learning and Knowledge Integration for Music Audio Analysis, Schloss Dagstuhl, Leibniz-Zentrum für Informatik, Wadern (Germany), January 2019
- Dagstuhl Seminar: Computational Methods for Melody and Voice Processing in Music Recordings, Schloss Dagstuhl, Leibniz-Zentrum für Informatik, Wadern (Germany), January 2019
- Lorentz Workshop: Computational Ethnomusicology: Methodologies for a New Field, Lorentz International Center for Scientific Workshops, Leiden (The Netherlands), March 2017
- Dagstuhl Seminar: Computational Music Structure Analysis, Schloss Dagstuhl, Leibniz-Zentrum für Informatik, Wadern (Germany), March 2016
- Summer School: Computational Music Analysis at the Joint Conference 40th ICMC and 11th SMC, University of Athens (Greece), September 2014
Current Courses
- Lecture: Music Information Retrieval for MSc Computer Science, MSc xtAI, MA Digital Humanities, JMU Würzburg Summer Term 2023
Previous Courses
- Lecture: Advanced Audio-Based Music Processing, University of Music Karlsruhe, Summer Term 2021
- Lecture: Digitale Musikanalyse: Wie gut können Computer hören? for students of B.A. Digitale Geistes- und Sozialwissenschaften (DGSW) and B.Sc. Elektrotechnik-Elektronik-Informationstechnik (EEI), Summer Term 2020
- Lecture: Advanced Audio-Based Music Processing, University of Music Karlsruhe, Summer Term 2020
- Lecture: Harmony Analysis (part of course Music Processing Analysis, Prof. Meinard Müller), Winter Term 2019/20
- Seminar: Music Processing (part of Audio Processing Seminar), Winter Term 2019/20
- Lab: Short-Time Fourier Transform and Chroma Features (part of Audio Processing Laboratory), Summer Term 2019
- Lecture: Harmony Analysis (part of course Music Processing Analysis, Prof. Meinard Müller), Winter Term 2018/19
- Seminar: Audio Decomposition and Structure Analysis (part of Audio Processing Seminar), Winter Term 2018/19
- Seminar: Chord Recognition and Audio Decomposition (part of Audio Processing Seminar), Winter Term 2017/18
- Lecture: Harmony Analysis (part of course Music Processing Analysis, Prof. Meinard Müller), Winter Term 2017/18
- Seminar: Automatic Chord Recognition from Audio Recordings (part of Audio Processing Seminar), Summer Term 2017
- Seminar: Reproducible Audio Research (part of Audio Processing Seminar), Winter Term 2016/17
- Lab: Short-Time Fourier Transform and Chroma Features (part of Audio Processing Laboratory), Summer Term 2016
- Lab: Short-Time Fourier Transform and Chroma Features (part of Audio Processing Laboratory), Winter Term 2015/16
- Lecture: Music Information Retrieval III – Tonality and Structure Analysis (part of course Audio Systems Technology), Ilmenau University of Technology, Winter Term 2014/15
- Exercises: Theoretische Mechanik und Quantenmechanik für Lehramtsstudierende der Physik, University of Würzburg, Summer Term 2012
Tutorials and Workshops
- Workshop: Music Information Retrieval (with Frank Zalkow), University of Music Karlsruhe, June 11–14, 2019
- Workshop: "Computergestützte Analyse von Musikaufnahmen – ein Beispiel für interdisziplinäre Forschung", Woche der Forschung 2019, University of Bamberg, February 26, 2019
- Seminar: "Wie gut können Computer hören? – Über die Anwendung musiktheoretischer Konzepte auf Audiodaten", University of Music Würzburg, December 12, 2018
- Workshop: Music Information Retrieval (with Frank Zalkow), University of Music Karlsruhe, July 10–13, 2018
- Tutorial: A Basic Introduction to Audio-Related Music Information Retrieval (with Meinard Müller), 18th International Society for Music Information Retrieval Conference (ISMIR), Suzhou (China), October 23, 2017
- Tutorial: Automatisierte Methoden der Musikverarbeitung (with Stefan Balke, Meinard Müller), 47. Jahrestagung der Gesellschaft für Informatik e.V. (GI), Chemnitz (Germany), September 25, 2017
- Meisterklasse Music Information Retrieval (with Prof. Meinard Müller), University of Music Karlsruhe, April 5–7, 2017
- Seminar: Musiktechnologie im 21. Jahrhundert – Vom mp3-Player zum virtuellen Musikwissenschaftler for fellows of the Foundation of German Business (sdw), Fraunhofer IDMT Ilmenau (Germany), July 3–4, 2015
Co-Supervised Student Theses
-
Sebastian Strahl, Learning Multi-Instrument Pitch Representations from Score–Audio Pairs, ASC Major Research Project, FAU Erlangen-Nürnberg, 2022.
- Hans-Ulrich Berendes, Evaluating Deep Pitch Class Features for Chord Recognition, ASC Minor Research Project, FAU Erlangen-Nürnberg, 2022.
- Benjamin Brunner, Evaluating Tuning Estimation Algorithms for Music Processing Applications, Master Thesis, FAU Erlangen-Nürnberg, 2021.
- Florian Schuberth, A Cross-Version Study on Computational Harmony Analysis of Music Recordings, Master Thesis, FAU Erlangen-Nürnberg, 2021.
- Johannes Zeitler, Extracting Tonal Features for Music Analysis Using Deep Learning, ASC Major Research Project, FAU Erlangen-Nürnberg, 2020.
- Tim Zunner, Deep Learning Techniques for Tonal Analysis of Music Recordings, ASC Major Research Project, FAU Erlangen-Nürnberg, 2020.
- Leo Brütting, Hierarchical Tonal Analysis of Music Signals, Bachelor Thesis, FAU Erlangen-Nürnberg, 2019.
- Fabian Brand, Chord Transition Features for Style Classification of Music Recordings, Master Thesis, FAU Erlangen-Nürnberg, 2018.
- Sebastian Preuße, Entwicklung eines Algorithmus zur segmentweisen Klassifikation von Instrumentenfamilien, Bachelor Thesis, Ilmenau University of Technology, 2016. Bibtex
- Andreas Männchen, Entwicklung und Implementierung eines Verfahrens zur automatischen und echtzeitfähigen Erkennung von Akkorden sowie wiederholten Harmoniefolgen in Gitarrensignalen, Master Thesis, TU Ilmenau, 2015.
- Robert Gräfe, Automatische Analyse und Klassifizierung von Audiodaten anhand von Tonartverläufen, Bachelor Thesis, TU Ilmenau, 2015.
- Maximilian Schaab, Automatische Klassifikation klassischer Musikstile anhand relativer Tonhöhenklassen, Bachelor Thesis, TU Ilmenau, 2015.
