(069) previous ~ index ~ next
To: Hubert Jin <hjin@bbn.com>
From: Jonathan Fiscus <jonathan.fiscus@nist.gov>
Subject: Re: TDT-2 Evaluation Website
Date: Fri, 05 Jun 1998 07:56:19 -0400
Hubert,
You're specifying the index file and the system
output file incorrectly. Since a single evaluation involves many
system runs, (one per topic), the TDTtrk.pl script uses file lists
to identify index files and system output files.
In the "Errors" directory, there are two example file lists,
"tk_bn_indexes" which is a file list of indexes, and "tk_bn_outputs"
which is a file list of system outputs. If you instead run the
command:
TDT2trk.pl -R ../.. -I tk_bn_indexes tk_bn_outputs
It will work. In your example, you only wanted to score the output
for a single topic, creating file lists containing just single topic
will do the trick.
If this isn't clear, the online documentation explains this in more
detail.
Jon
Hubert Jin wrote:
>
> Hi Jon,
>
> Thanks for the dry-dry-run corpus. I took a look at the it,
> and tried to score for tracking result following the "Run_all"
> example. However, I failed to make it work:
>
> anne.bbn.com>cd /d4m/hjin/TDT98/tdt-dry-dry-run-980430/Examples/Errors/
> /d4m/hjin/TDT98/tdt-dry-dry-run-980430/Examples/Errors
> anne.bbn.com> TDT2trk.pl -R /d4m/hjin/TDT98/tdt-dry-dry-run-980430 -I
> /d4m/hjin/TDT98/tdt-dry-dry-run-980430/indexes/tk_bn_1.ndx tk_bn_1.trk
> Loading Topic Boundary tables:
> Loading Index File 19980105_2000_2030_CNN_HDL
> Index file '19980105_2000_2030_CNN_HDL' not found at
> /d4m/hjin/perl5/lib/TDT2.pm line 244.
>
> Note: the TDT2trk.pl and TDT2.pm used above are from the recent
> distribution [i.e. TDT2eval_v0.1, May 20].
>
> Do you have any ideas how to make it work?
--
Jon Fiscus
NIST
Email: jfiscus@nist.gov
Phone: (301) 975-3182
(069) previous ~ index ~ next
Last updated Wed Sep 9 09:40:51 1998