WinoST: Evaluating Gender Bias in Speech Translation

WinoST is a challenge set for evaluating gender bias in speech translation. WinoST is the speech version of WinoMT (Stanovsky et al., 2019) which is an MT challenge set and both follow an evaluation protocol to measure gender accuracy. WinoST consists of 3888 speech audios in English plus a text file with the the text of these audios. For further details, please refer to the publication entitled "Evaluating Gender Bias in Speech Translation" (Costa-jussà et al., 2020). Also cite this publication if using this corpus.

WinoST是一款用于评估语音翻译中性别偏见的挑战数据集。WinoST是WinoMT（Stanovsky等人，2019）的语音版本，而WinoMT作为一款机器翻译(Machine Translation)挑战数据集，二者均遵循用于衡量性别准确率的标准化评估协议。WinoST包含3888条英语语音音频，以及一份收录对应音频文本的文本文件。如需获取更多细节，请参阅题为"Evaluating Gender Bias in Speech Translation"（Costa-jussà等人，2020）的学术论文。若使用该语料库，请一并引用此出版物。