The Cleft Dataset
A dataset of ultrasound and audio recorded with children with cleft lip and palate
The cleft dataset is a collection of ultrasound tongue imaging and audio data, gathered from children with cleft lip and palate by a research speech and language therapist working in a hospital environment.
Speakers
We recorded data with 39 English-speaking children, but only 29 gave consent to share their data. These are 11 female speakers and 18 male, aged 7-11 years.
| SPEAKER-ID | GENDER | AGE-Y | AGE-M | AGE | CLEFT-TYPE | OTHER-MEDICAL |
|---|---|---|---|---|---|---|
| 01M | M | 10 | 5 | 10.42 | BCLP | no |
| 03F | F | 5 | 1 | 5.83 | UCLP | no |
| 05M | M | 10 | 3 | 10.75 | UCLP | no |
| 06M | M | 9 | 8 | 9.75 | UCLP | no |
| 07M | M | 9 | 2 | 9.75 | UCLP | no |
| 09M | M | 9 | 8 | 9.33 | UCLP | yes |
| 11M | M | 4 | 5 | 4.42 | CP | no |
| 12F | F | 5 | 1 | 5.42 | CP | yes |
| 14F | F | 5 | 0 | 5.33 | BCLP | no |
| 15F | F | 4 | 9 | 4.75 | UCLP | yes |
| 16M | M | 9 | 7 | 9.33 | UCLP | no |
| 17F | F | 4 | 4 | 4.42 | BCLP | no |
| 18F | F | 5 | 1 | 5.25 | UCLP | no |
| 19F | F | 3 | 9 | 3.58 | CP | yes |
| 20F | F | 7 | 5 | 7.75 | CP | no |
| 21M | M | 9 | 1 | 9.5 | CP | no |
| 24M | M | 6 | 5 | 6.33 | CP | yes |
| 25M | M | 4 | 1 | 4.33 | CP | no |
| 26M | M | 4 | 4 | 4.67 | BCLP | no |
| 28F | F | 8 | 9 | 8.58 | BCLP | no |
| 30F | F | 7 | 7 | 7.42 | CP | no |
| 31F | F | 5 | 4 | 5.42 | CP | no |
| 32M | M | 5 | 8 | 5.5 | UCLP | no |
| 33M | M | 6 | 4 | 6.42 | UCLP | yes |
| 34M | M | 5 | 3 | 5.25 | CP | yes |
| 35M | M | 3 | 7 | 3.42 | UCLP | no |
| 36M | M | 5 | 0 | 5.58 | BCLP | no |
| 37M | M | 7 | 0 | 7.58 | BCLP | no |
| 39M | M | 7 | 0 | 7 | CP | yes |
Cleft Types
| Data type | Description |
|---|---|
| CP | cleft palate only |
| UCLP | unilateral cleft lip and palate affecting one side of the lip and palate |
| BLP | bilateral cleft lip and palate affecting both sides |
Sessions
Each child recorded an "Assessment" session, and two children recorded a "Therapy" session.
Data Types
Core data types:
| Data type | Description |
|---|---|
| wav | speech waveform |
| ult | raw ultrasound data |
| param | ultrasound parameters |
| txt | prompt text with date/time of utterance recording |
Hardware synchronisation failed for this dataset. We release the parameter File as exported from the AAA software. In [1] we provide automatically predicted synchronisation offsets.
Additional data:
| Data type | Description |
|---|---|
| slt_labels | manual annotation from SLT, when available. See [2] for details |
| probe_direction_labels | a label for each utterance indicating whether the probe was in a coronal position (cor) or midsagittal right or let (sag_right, sag_left) |
SLT Labels are available in Praat's TextGrid format, and probe_direction_labels is a csv file.
File IDs
Individual recordings are indexed for each session according to their recording times. See the prompt text file for recording date/time.
Each file ID also includes a prompt type identifier. See Data for details.
References
[1] Eshky, A.,Cleland, J., Ribeiro, M. S., Renals, S. Automatic audiovisual synchronisation for ultrasound tongue imaging. (Under revision).
[2] Cleland, J., Lloyd, S., Campbell, L., Crampin, L., Palo, J.-P., Sugden,E., Wrench, A., & Zharkova, N. (2020). The impact of real-time ar-ticulatory information on phonetic transcription: ultrasound-aidedtranscription in cleft lip and palate speech. Folia Phoniatrica etLogopaedica, 72, 120–130.