(292) previous ~ index ~ next
To: TDT Distrib <tdt-distrib@ldc.upenn.edu>
From: Jonathan Fiscus <jonathan.fiscus@nist.gov>
Subject: Release of Pre-Adjudicated TDT Results
Date: Fri, 13 Oct 2000 15:06:54 -0400
Folks,
Sorry to take so long turning these results around. You can download or
browse results at the following URLs:
ftp://jaguar.ncsl.nist.gov/tdt/tdt2000/TDT2000_official_results_20001013.tgz
ftp://jaguar.ncsl.nist.gov/tdt/tdt2000/TDT2000_official_results_20001013/index.htm
The results are based on the LDC's pre-adjudicated annotations. I did
not include the annotations in this release since there are experiments
still being run. The LDC will be doing the adjudication over the next
two weeks. After they conclude their work, I'll produce rescore the
evaluation submissions and release the annotations.
There are a number of issues with the tracking results that I want to
alert you all to. I have not done the usual conditioned evaluations on
any of this data, (e.g. nwt vs broadcast news vs test language etc.),
nor have I conditioned the evaluation on by old versus new topics.
Since performance seems to be *very* different on the new topics, I'll
be anxious to do the conditioned analysis when I return.
Jon
PS. I'll be out of the office until Oct. 30th. If problems arise,
please email me as I'll be reading email off and on during this time.
(292) previous ~ index ~ next
Last updated Mon Oct 16 12:05:13 2000