(279) previous ~ index ~ next

---

To: TDT Distrib <tdt-distrib@ldc.upenn.edu>
From: Jonathan Fiscus <jonathan.fiscus@nist.gov>
Subject: TDT3 Corpus Usage
Date: Wed, 23 Aug 2000 08:14:42 -0400

---

Folks,

There seems to be some residual confusion about the use of the TDT3
corpus for the fall evaluation. To clarify the issue, we added the
following excerpt to version 1.4 of the evaluation plan. As we agreed
at last February's meeting, the TDT3 corpus should not be used again
until this Fall's evaluation. The existing 60 TDT3 topics will be used
for the TDT2000 evaluation, so of course, they are also not to be looked
at until after the results have been submitted to NIST.


Regards,
Jon

----- excerpt from V1.4 of the TDT2000 evaluation plan -----

The TDT3 corpus will be augmented for TDT2000 to include 60 additional
topics. These topics, along with the original 60 TDT3 topics, will be
used for formal TDT2000 evaluation. Here are the rules for evaluation
participants regarding the use of these and other corpus resources:

· The LDC-supplied corpora may be supplemented by whatever other
resources participants may choose to use.

· All training and development resources, however, must predate 1
October, 1998.

· Since the formal evaluation will reuse the TDT3 corpus and the
original 60 topics, this corpus must not be used in any way prior to the
evaluation. Precluded use includes training, testing, profiling, or any
manual or automatic means of inspecting or otherwise gleaning
information from the data.

---

(279) previous ~ index ~ next

Last updated Tue Sep 19 14:30:58 2000