ICASSP2017 Paper on Singing Transcription (Yamaha Internship Work)

During Oct-Dec 2015, I was a research intern at Yamaha Corporation Japan supervised by Dr. Akira Maezawa for a sung melody transcription project. We employed the novel observation probability distribution of combination of angular and gamma distributions to the HMM-based framework. The work is accepted as a proceeding of the 42nd IEEE International Conference on…

Scientific American (Chinese Edition) Interviews 环球科学采访

The Chinese edition of Scientific American,《环球科学》(“科学美国人”中文版) interviews Dr. Luwei Yang (杨璐威博士) on “Investigating the Mysteries of Music Using Quantum Physics Methods” (《用量子力学中的方法探索音乐的奥秘》)! The interview text is reproduced below.  Source: mp.weixin.qq.com/s/1qPJ01ILlX3OhsXqoVdcvA   专访 | 用量子力学中的方法探索音乐的奥秘? Original 2017-04-11 紫苏 科研圈 杨璐威博士将原本用于量子物理的谐波(harmonics)分析的方法用于自动检测音乐中的颤音。 撰文 紫苏 可能平常人看来,音乐不过是将一堆乐谱中音符转换为音频信号。但是实际上,音乐有它自己的结构和形式。对于这些音乐的特征,人们不仅可以通过定性分析(如音乐评论等),也可以利用数学方法来进行定量分析。 音乐数学建模是通向计算音乐和大规模自动化分析音乐的第一步:它不仅能让我们理解乐曲中的不同模式,也让我们理解音乐中的总体趋势。 来自的伦敦玛丽女王大学数字音乐中心的杨璐威博士将原本用于量子物理里的谐波(harmonics)分析的方法——过滤对角方法(FDM),来自动检测音乐中的颤音。单论检测准确度来说,在帧水平上,提高了30%以上;在音符水平上,提高了一倍以上。论文发表于(论文信息见文末)。 杨璐威在演奏二胡 《环球科学》的记者就这篇论文采访了杨璐威博士: 您的这篇论文的主旨是克服音乐的颤音问题是么?那么什么是颤音呢? 璐威:颤音是指音高在一定频率范围内的周期变化。它是音乐演奏中常用的技法之一,常见于弦乐、声乐、管乐中等(弦乐中的颤音也叫揉弦)。颤音一般不在乐谱中标记,因此,音乐家更能自由地让颤音出现在乐曲中的任何位置和控制颤音的快慢和大小。它能反映不同音乐文化、音乐时期、甚至是不同演奏家的音乐风格。 我们先听一段包含较多颤音的音乐片段 二泉映月, 二胡, 片段-黄江琴 (00:52) 颤音的频率一般是在4-8Hz之间。前人一般使用的方法是对基频时序信号运用短时傅里叶变换(STFT),在频谱中4-8Hz频段里找寻是否有极值的方法来判断颤音的存在。考虑到傅立叶变换的不确定性原理(uncertainty principle),如果要想在如此小的频段上寻找极值,最完美的方法就是得到一个频域分辨率很高的频谱图。并且一般情况下,需要增加窗的长度。如果窗的长度增加了,时域上的分辨率就会下降。 为什么您在研究中选择了二胡和小提琴,在二胡的颤音更为多见么?…

Phys.org: Quantum physics offers insight into music expressivity

Phys.org publishes press release on our paper, “The filter diagonalisation method for music signal analysis: frame-wise vibrato detection and estimation”, just out in the Journal of Mathematics and Music. Yang, Luwei, Khalid Z. Rajab & Elaine Chew (2017). The filter diagonalisation method for music signal analysis: frame-wise vibrato detection and estimation. Journal of Mathematics and Music, pp.1-19.  Doi: 10.1080/17459737.2016.1263897…

Joined Huawei

In the February of 2017, I joined Huawei Technologies Co. Ltd. at Shenzhen China . I am doing research on machine learning. Currently, I am involved in a chatbot project with interests in intent recognition, sentiment analysis and speech emotion recognition.

Luwei Yang will attend and present the AVA at ISMIR2016

Luwei Yang will attend and present a paper about the AVA at the 17th International Society for Music Information Retrieval Conference (ISMIR2016), organised by the New York university and Columbia University. The conference will take place at the New York City 7-11 August 2016. AVA: An Interactive System for Visual and Quantitative Analyses of Vibrato and Portamento…

AVA Matlab toolbox is available

AVA is an automatic vibrato and portamento detection and analysis tool. It accepts raw audio and automatically tracks the vibrato and portamento to display their expressive parameters for inspection and further statistical analysis. Download and more information please go to here.

2016 Chinese New Year Concert

The 2016 Chinese New Year Concert will take place 7:30pm on Monday, 1 February 2016, in the Octagon and features award winning Chinese instrumentalists, and C4DM members (Katerina Kosta, Beici Liang, and Elaine Chew) and music technologies embodied in Andrew McPherson’s Magnetic Resonator Piano, and Mathieu Barthet and Gyorgy Fazekas’ Mood Conductor/Rater. Tickets will open on…

Presentation in FMA2015

From 10th to 12th June 2015, I presented a poster titled in Vibrato Characteristics and Frequency Histogram Envelopes in Beijing Opera Singing in the 5th International Workshop on Folk Music Analysis. The extended abstract is here.

Presentation in MCM2015

The Fifth Biennial International Conference on Mathematics and Computation in Music(MCM2015) will be held on 22-25 June-2015  at Queen Mary University of London in the United Kingdom. In this conference, I will give an oral presentation on Logistic Modeling of Note Transitions. In this paper, I employed the Logistic model to represent the note transitions especially…

Luwei Yang gives Tsinghua talk on AVA, A System for Automatic Vibrato Analysis

Luwei Yang giving talk on automatic vibrato detection in the Automation Department at Tsinghua University Luwei Yang pictured with host, Professor Li Cao of the Automation Department at Tsinghua University Luwei Yang gave a talk on AVA, an automatic vibrato detection system, at Tsinghua University’s Department of Automation in Beijing, China, at 3pm on Thursday,…

2015年公派博士招生 音乐中的数学和计算方向@伦敦大学玛丽女王学院

本人导师Prof. Elaine Chew(http://www.eecs.qmul.ac.uk/~eniale/), 现招2015年国家公派(CSC)博士一名,专业为电子工程(Electronic Engineering),大方向为音乐中的数学和计算(music and computation),具体介绍可参见http://mupae.blogspot.co.uk/p/about.html。此方向只是一个大类方向而已,具体的小方向可以跟老板商量。包括音乐结构分析(Music structure),音乐认知(Music cognition),音乐交互(Music interaction),音乐韵律(Music prosody),音乐信息检索(Music Information Retrieval),音源分离(Source separation)和音频合成(Synthesis)等。 本人导师目前是伦敦大学玛丽女王学院电子工程和计算机学院的数字媒体教授和数字音乐研究中心(Centre for Digital Music)音乐表现力研究小组主任。本科就读于斯坦福大学,获得数学和计算科学、音乐表演双学位。硕士和博士毕业于麻省理工学院运营研究中心。她的整个研究生阶段,致力于将音乐和工程学联系起来。博士毕业后曾在哈佛大学做访问学者。之后,她在美国南加州大学任副教授,建立了南加州大学音乐计算和认知实验室。 虽然老板没有具体给出申请人的要求。但是我根据这些年的体会,建议申请人具有以下背景: 理工科出生,毕业于电子工程、计算机科学、自动化、信号处理、数学、物理等专业。 本科毕业的申请人,GPA:85/100以上。 对音乐比较感兴趣。会乐器和懂音乐不是一个必须条件,但是会是一个加分选项。毕竟研究的东西会跟音乐有关。 是一个很自律和self-motivated的人,因为老板不太会管你。老板的风格是希望你自己提出问题和提出解决方法,然后跟老板讨论。 Elaine Chew邮箱:elaine.chew@qmul.ac.uk (建议先通过邮箱联系) 申请截止日期为2015 年1月31日 (因为老板也是前几天才通知我这个招生信息,所以时间有点仓促,如果有感兴趣的同学请尽快联系老板。) 招生流程如下: The process for CSC recruitment for Queen Mary University of London is as follows: Stage 1: Interested students should apply online using the standard QMUL…

Call for Contribution: MCM2015

The Fifth Biennial International Conference on Mathematics and Computation in Music (MCM2015) will be held 22-25 June 2015 at Queen Mary University of London in the United Kingdom. MCM is the flagship conference of the Society for Mathematics and Computation in Music, whose official publication is the Journal of Mathematics and Music. The aim of…