avatar

Yixiao Zhang

Ph.D. Student
C4DM, Queen Mary University of London
yixiao.zhang (at) qmul.ac.uk


About Me

I am currently a 4th-year PhD student at Centre for Digital Music (C4DM), Queen Mary University of London. I am honored to be advised by Prof. Simon Dixon and Dr. Mark Levy. Before that, I was a Research Assistant at the Music X Lab, NYU Shanghai. from 2019 to 2020, supervised by Dr. Gus Xia. I received the Bachelor of Engineering degree (2015-2019) in Computer Science and Technology from University of Electronic Science and Technology of China (UESTC).

My research interests include controllable music generations with diffusions and LLMs, and Multimodal representation learning for music editing.

I am looking for full-time oppotunities from Nov 2024 on Generative Music AI!

News

  • [Apr. 2024] We have 2 papers accepted to IJCAI 2024!
  • [Feb. 2024] I will join Harmonai group at Stability.ai as an intern during May - Oct 2024.
  • [Jan. 2024] Our new paper, "MusicMagus: Zero-Shot Text-to-Music Editing via Diffusion Models", is now at arxiv.
  • [Oct. 2023] I will join Music Foundation Team at Sony Research as an intern during Oct 2023 - Apr 2024.
  • [Jun. 2023] I will join Yamaha Corporation as an intern during Jun - Sep 2023.

Education

Selected Publications

    Please see Google Scholar for full publication list.

    First-author papers

  1. IJCAI 2024
    MusicMagus: Zero-Shot Text-to-Music Editing via Diffusion Models
    Yixiao Zhang, Yukara Ikemiya, Gus Xia, Naoki Murata, Marco Martínez, Wei-Hsiang Liao, Yuki Mitsufuji, Simon Dixon
    The 33rd International Joint Conference on Artificial Intelligence (IJCAI 2024) - AI, Arts & Creativity Track
    PDF Project Page BibTex The paper was reported in the tech press MarkTechPost on Feb 25, 2024.

  2. arxiv 2023
    Loop Copilot: Conducting AI Ensembles for Music Generation and Iterative Editing
    Yixiao Zhang, Akira Maezawa, Gus Xia, Kazuhiko Yamamoto, Simon Dixon
    Preprint.
    PDF Code Project Page BibTex

  3. ISMIR 2022
    Interpreting Song Lyrics with an Audio-Informed Pre-trained Language Model
    Yixiao Zhang, Junyan Jiang, Gus Xia and Simon Dixon
    The 23rd International Society for Music Information Retrieval Conference (ISMIR 2022)
    PDF Code Best Paper Award nomination

    4. Other papers

  4. IJCAI 2024
    Arrange, Inpaint, and Refine: Steerable Long-term Music Audio Generation and Editing via Content-based Controls
    Liwei Lin, Gus Xia, Yixiao Zhang, Junyan Jiang
    The 33rd International Joint Conference on Artificial Intelligence (IJCAI 2024) - AI, Arts & Creativity Track
    PDF Code Project Page BibTex

  5. arxiv 2023
    Content-based Controls For Music Large Language Modeling
    Liwei Lin, Gus Xia, Junyan Jiang, Yixiao Zhang
    Preprint
    PDF Code Project Page BibTex

  6. NeurIPS 2023 Workshop
    The Song Describer Dataset: a Corpus of Audio Captions for Music-and-Language Evaluation
    Ilaria Manco, Benno Weck, Seungheon Doh, Yixiao Zhang, Dmitry Bogdanov, Yusong Wu, Ke Chen, Philip Tovstogan, Emmanouil Benetos, Elio Quinton, George Fazekas, Juhan Nam, Minz Won
    NeurIPS 2023 Workshop on Machine Learning for Audio
    PDF Code Project Page

    Internships

  1. Stability.ai
    Topics: Research on music large language models
    Advisors: Dr. Jordi Pons
    May 2024 (exp.) - Oct 2024 (exp.)

  2. Sony Research
    Topics: Text-based music editing with diffusion models
    Advisors: Yukara Ikemiya
    Oct 2023 - Apr 2024 (exp.)

  3. Yamaha Corporation
    Topics: Conversational interface for interative music creation
    Advisors: Dr. Akira Maezawa
    Jun 2023 - Sep 2023

  4. Microsoft Research Asia
    Topics: Theoretical research of reinforcement learning
    Advisors: Dr. Weiqing Liu and Dr. Xiao Yang
    Oct 2018 - Jun 2019

Services

Conference Reviewers

Journal Reviewers

Committee Members

Teaching

Teaching Assistant


Powered by Jekyll and Minimal Light theme.