(298) previous ~ index ~ next
To: Jon_Yamron@dragonsys.com
From: Mark Przybocki <mark.przybocki@nist.gov>
Subject: Re: 2nd unofficial release.
Date: Fri, 20 Oct 2000 16:12:31 -0400
There was a problem with how the evaluation software used the new
LDC reference tables.
Because there was not an exhaustive judgment for each story/topic
this year, the new topic/story combinations that were judged to be
off topic were identified as level=NO.
The detection software treated certain stories (ones that were
identified as level=NO for one topic and level=YES for another
topic) as a story with TWO topics.
In detection, stories about more then one topic are not considered
for scoring.
-mark
> Could you be more specific about the problem? Is there something wrong
> with the evaluation software?
>
> - Jon
>
> Mark Przybocki <mark.przybocki@nist.gov>@email.nist.gov on 10/20/2000
> 01:14:26 PM
>
> Sent by: mark@email.nist.gov
>
> To: TDT Distrib <tdt-distrib@ldc.upenn.edu>
> cc:
> Subject: 2nd unofficial release.
>
> Folks,
>
> One more time. This second release fixes a problem we found with
> the detection results. Many thanks to Dave Graff and James Allan
> for helping me work through this. The scoring code was originally
> not using all stories it should have used. (My first unofficial
> release made this problem even worse!)
>
> ftp://jaguar.ncsl.nist.gov/tdt/tdt2000/TDT2000_unofficial_results_20001020/index.htm
>
> ftp://jaguar.ncsl.nist.gov/tdt/tdt2000/TDT2000_unofficial_results_20001020.tar.gz
>
> If you notice any problems, please let me know.
>
> -mark
>
> P.S. You may ignore the DATE/TIME Stamp in the report files. I just
> noticed that some of the machines I use for scoring TDT have the
> wrong date set.
>
> --
> # // Mark Przybocki
> # // Room B239 Bldg 225 E-mail: mark.przybocki@nist.gov
> # // NIST Phone: 301/975-3347
> # // Gaithersburg, MD 20899 FAX: 301/670-0939
--
# // Mark Przybocki
# // Room B239 Bldg 225 E-mail: mark.przybocki@nist.gov
# // NIST Phone: 301/975-3347
# // Gaithersburg, MD 20899 FAX: 301/670-0939
(298) previous ~ index ~ next
Last updated Wed Oct 25 15:48:25 2000