韵律特征在概率线性判别分析说话人确认中的应用
Modeling prosodic features with probabilistic linear discriminant analysis for speaker verification
-
摘要: 研究韵律特征在说话人确认中的应用。将整个韵律轨迹以固定段长和段移进行片段划分,并对其进行勒让德多项式拟合从而获取连续性的韵律特征,将特征映射到总变化因子空间,并用概率线性判别分析来补偿说话人和场景的差异。在美国国家标准技术研究院2010年说话人识别评测扩展核心测试集5的基础上加入噪声构造测试集,并分别对韵律特征和传统Mel频率倒谱系数进行测试。结果显示,随着信噪比的逐渐减小,Mel频率倒谱系数性能出现大幅度下降,而韵律特征性能相对比较稳定,两种特征融合后能使系统性能得到进一步提升,等错率和最小检测错误代价相对于Mel频率倒谱系数单系统最多能分别下降9%和11%。实验表明,韵律特征应用于说话人识别中具有较强的噪声鲁棒性,且与传统的Mel频率倒谱系数存在较强的互补性。Abstract: The use of continuous prosodic features is introduced into speaker verification. The whole prosodic contour is segmented over fixed-frame long with fixed-frame shift and the prosodic features are extracted using a basis consisting of Legendre polynomials. They are then modeled using the i-vector based approach followed by probabilistic linear diseriminant analysis (PLDA) to compensate for speaker and channel variability effects in the space of i-vectors. The experiments are carried out on the noisy conditions which are generated based on the extended condition 5 of the NIST 2010 Speaker Recognition Evaluation (SRE) dataset. The experimental results indicate that the prosodic features are noise-robust and the fusion of the prosodic features and the traditional Mel Frequency Cepstral Coefficients (MFCCs) can make significant performance improvement. Compared to the MFCCs system alone~ the fusion can provide up to 9% and 11% relative improvement respectively in equal error rate (EER) and minimum detection cost function (minDCF).