GALE Phase 1 Arabic Broadcast News Parallel Text - Part 1

Name: GALE Phase 1 Arabic Broadcast News Parallel Text - Part 1
Creator: Linguistic Data Consortium
Published: 2020-11-30T15:49:22+08:00

DataCite Commons2021-07-01 更新2025-04-16 收录

机器翻译

阿拉伯语新闻

数据链接：

https://catalog.ldc.upenn.edu/LDC2007T24 数据链接链接失效反馈

官方服务：

资源简介：

<h3>Introduction</h3> This release is Part 1 of the three-part GALE Phase 1 Arabic Broadcast News Parallel Text, which, along with other corpora, was used as training data in year 1 (Phase 1) of the DARPA-funded GALE program. This corpus contains transcripts and English translations of 17 hours of Arabic broadcast news programming selected from a variety of sources. This corpus does not contain the audio files from which the transcripts and translations were generated. The audio files will be released by the LDC at a future date. LDC has released the following GALE Phase 1 & 2 Arabic Parallel Text data sets: <ul> <li>GALE Phase 1 Arabic Broadcast News Parallel Text - Part 1 (<a href="../../../LDC2007T24">LDC2007T24</a>)</li> <li>GALE Phase 1 Arabic Broadcast News Parallel Text - Part 2 (<a href="../../../LDC2008T09">LDC2008T09</a>)</li> <li>GALE Phase 1 Arabic Blog Parallel Text (<a href="../../../LDC2008T02">LDC2008T02</a>)</li> <li>GALE Phase 1 Arabic Newsgroup Parallel Text - Part 1 (<a href="../../../LDC2009T03">LDC2009T03</a>)</li> <li>GALE Phase 1 Arabic Newsgroup Parallel Text - Part 2 (<a href="../../../LDC2009T09">LDC2009T09</a>)</li> <li>GALE Phase 2 Arabic Broadcast Conversation Parallel Text Part 1 (<a href="../../../LDC2012T06">LDC2012T06</a>)</li> <li>GALE Phase 2 Arabic Broadcast Conversation Parallel Text Part 2 (<a href="../../../LDC2012T14">LDC2012T14</a>)</li> <li>GALE Phase 2 Arabic Newswire Parallel Text (<a href="../../../LDC2012T17">LDC2012T17</a>)</li> <li>GALE Phase 2 Arabic Broadcast News Parallel Text (<a href="../../../LDC2012T18">LDC2012T18</a>)</li> <li>GALE Phase 2 Arabic Web Parallel Text (<a href="../../../LDC2013T01">LDC2013T01</a>)</li> </ul> <h3>Source Data</h3> A total of 17 hours of Arabic broadcast news recordings was selected from six sources and seven different programs. A manual selection procedure was used to choose data appropriate for the GALE program, namely, news and conversation programs focusing on current events. Stories on topics such as sports, entertainment news, and stock market reports were excluded from the data set. The following table is a summary of the files included in this release. <table> <tbody> <tr> <td width="147">Source</td> <td width="125">Program</td> <td width="162">Epoch (YYYY.MM)</td> <td width="96">#hours</td> <td width="105">#words</td> </tr> <tr> <td rowspan="2" width="147">Al Hurra</td> <td width="125">News 10</td> <td width="162">2005.11</td> <td width="96">0.2</td> <td width="105">959</td> </tr> <tr> <td width="125">News 13</td> <td width="162">2005.04 - 2005.11</td> <td width="96">3.9</td> <td width="105">24,430</td> </tr> <tr> <td width="147">Dubai TV</td> <td width="125">Dubai News</td> <td width="162">2005.01 - 2005.02</td> <td width="96">1.9</td> <td width="105">10,842</td> </tr> <tr> <td width="147">Lebanese Broadcast</td> <td width="125">Naharkum Saiid</td> <td width="162">2005.01 - 2005.02</td> <td width="96">2.0</td> <td width="105">13,979</td> </tr> <tr> <td width="147">Nile TV</td> <td width="125">News</td> <td width="162">2000.10</td> <td width="96">0.6</td> <td width="105">3,671</td> </tr> <tr> <td width="147">Voice of America</td> <td width="125">News</td> <td width="162">2000.06 - 2000.11</td> <td width="96">5.7</td> <td width="105">36,925</td> </tr> </tbody> </table> <h3>Transcription</h3> The selected audio snippets were then carefully transcribed by LDC annotators and professional transcription agencies following LDC's Quick Rich Transcription. Manual sentence units/segments (SU) annotation was also performed as part of the transcription task. Three types of end of sentence SU are identified: - statement SU - question SU - incomplete SU <h3>Translation</h3> After transcription and SU annotation, the files were reformatted into a human-readable translation format and were then assigned to professional translators for careful translation. Translators followed LDC's GALE translation guidelines, which describe the makeup of the translation team, the source data format, the translation data format, best practices for translating certain linguistic features (such as names and speech disfluencies), and quality control procedures applied to completed translations. TDF Format All final data are in Tab Delimited Format (TDF). TDF is compatible with other transcription formats, such as the Transcriber format and AG format, and it is easy to process. Each line of a TDF file corresponds to a speech segment and contains 13 tab delimited fields (the 13th field "suType" might be empty): field data_type ----- --------- 1 file unicode 2 channel int 3 start float 4 end float 5 speaker unicode 6 speakerType unicode 7 speakerDialect unicode 8 transcript unicode 9 section int 10 turn int 11 segment int 12 sectionType unicode 13 suType unicode A source TDF file and its translation are the same except that the transcript in the source TDF is replaced by its English translation. Encoding All data are encoded in UTF8. <h3>Samples</h3> For examples of this data, please examine these screen captures of the <a href="desc/addenda/LDC2007T24_src.jpg" rel="nofollow">original text</a> and its <a href="desc/addenda/LDC2007T24_trans.jpg" rel="nofollow">translation</a>. <h3>Sponsorship</h3> This work was supported in part by the Defense Advanced Research Projects Agency, GALE Program Grant No. HR0011-06-1-0003. The content of this publication does not necessarily reflect the position or the policy of the Government, and no official endorsement should be inferred. Portions © 2005 Dubai TV, © 2000 Nile TV, © 2005 PAC, Ltd., © 2005-2007 Trustees of the University of Pennsylvania

提供机构：

Linguistic Data Consortium

创建时间：

2020-11-30

搜集汇总

数据集介绍