Synthetically Spoken Coco

Synthetically Spoken COCO

Version 1.0

This dataset contain synthetically generated spoken versions of MS COCO [1] captions. This<br>
dataset was created as part the research reported in [5].<br>
The speech was generated using gTTS [2]. The dataset consists of the following files:

- dataset.json: Captions associated with MS COCO images. This information comes from [3]. <br>
- sentid.txt: List of caption IDs. This file can be used to locate MFCC features of the MP3 files<br>
in the numpy array stored in dataset.mfcc.npy.<br>
- mp3.tgz: MP3 files with the audio. Each file name corresponds to caption ID in dataset.json<br>
and in sentid.txt.<br>
- dataset.mfcc.npy: Numpy array with the Mel Frequence Cepstral Coefficients extracted from <br>
the audio. Each row corresponds to a caption. The order or the captions corresponds to the<br>
ordering in the file sentid.txt. MFCCs were extracted using [4].

[1] http://mscoco.org/dataset/#overview<br>
[2] https://pypi.python.org/pypi/gTTS<br>
[3] https://github.com/karpathy/neuraltalk<br>
[4] https://github.com/jameslyons/python_speech_features<br>
[5] https://arxiv.org/abs/1702.01991