摘要目的:探讨一种基于超声图像的汉语音素三维舌运动可视化方法,并构建可视化数据库。方法:利用MRI数据建立精细化舌统计模型,并以6个独立且具生理意义的控制参数描述舌形态变化。通过超声技术采集语料库中各音素发音时的舌正中矢状面图像,手动标注舌轮廓;基于训练好的全连接神经网络建立超声舌轮廓与控制参数的映射关系,并结合人工调整优化参数以获得与轮廓匹配的三维舌模型。对模型匹配精度进行量化评估,并统计分析易混淆音素的舌形差异。结果:多数音素的三维舌模型在正中矢状面与超声舌轮廓的曲线相似度超过90%,平均均方根误差(RMSE)较传统舌模型降低约28%,能够揭示音素间的细微发音差异。结论:研究构建的汉语音素三维舌运动可视化库可为听障患者语言康复及第二语言学习者的语音可视化教学提供帮助,具有推广与应用潜力。
更多相关知识
abstractsObjective:To explore a 3D visualization method for tongue articulation based on ultrasound images and to construct a corresponding visualization database.Methods:A high-fidelity statistical tongue model was constructed from MRI data and parameterized with six independent, physiologically interpretable control parameters to capture tongue-shape variation. To provide speech-specific data for model fitting, mid-sagittal ultrasound images were collected for each phoneme in the corpus, and tongue contours were manually annotated. A fully connected neural network was then trained to map the ultrasound-derived tongue contours to the model's control parameters. The estimated parameters were further refined through manual adjustment to obtain 3D tongue shapes that accurately matched the observed contours. Finally, model-fitting accuracy was quantitatively evaluated, and statistical analyses were conducted to examine tongue-shape differences among easily confusable phonemes.Results:For the majority of phonemes, the similarity between the 3D model′s mid-sagittal contour and the ultrasound-derived tongue contour exceeded 90%, and the average root mean square error(RMSE) was reduced by approximately 28% compared with conventional tongue models, thereby enabling the detection of subtle articulatory distinctions among phonemes.Conclusion:The constructed 3D tongue articulation visualization database for Mandarin phonemes provides a valuable tool for speech rehabilitation in individuals with hearing impairment and for visualization-based instruction in second-language learning, demonstrating strong potential for dissemination and application.
More相关知识
- 浏览6
- 被引0
- 下载0

相似文献
- 中文期刊
- 外文期刊
- 学位论文
- 会议论文


换一批



