(200) previous ~ index ~ next
To: "tdt-distrib@unagi.cis.upenn.edu" <tdt-distrib@unagi.cis.upenn.edu>
From: Jonathan Fiscus <jonathan.fiscus@nist.gov>
Subject: Problems with TDT2eval V0.4
Date: Tue, 20 Oct 1998 13:16:19 -0400
Folks,
Tom Pierce and Scott McCarley have reported a problem with running
TDT2det.pl from the TDT2eval_v0.4 distribution. There is a bug in the
distribution causes an illegal division by zero that has been fixed in
TDT2eval0.5. The new release is at the URL
'ftp://jaguar.ncsl.nist.gov/tdt98/TDT2eval_v0.5.tar.Z'.
What follows is a description of the bug, and a possible work around...
Jon
Bug description:
----------------
The combined training and devtest TDT2 corpus release, tdt_deliv_981006,
required a modification to the detection evaluation software. In order
to handle the new topic relevance file that contains judgments for both
the training and dev-test topics, and additional option, '-T', was added
to TDTdet.pl that restricts the evaluated topics be a regular
expression. When the option wasn't used, the divide by zero occurred.
Adding the option to the execution of version 0.4 will avoid the error
condition.
Users should read the documentation for example expressions for the
training or dev-test topic sets.
--
Jon Fiscus
NIST
Email: jfiscus@nist.gov
Phone: (301) 975-3182
(200) previous ~ index ~ next
Last updated Wed Oct 28 14:44:11 1998