(155) previous ~ index ~ next
To: jonathan.fiscus@nist.gov, wisegb@crd.ge.com
From: wisegb@markab.crd.ge.com (G. Bowden Wise)
Subject: Re: MISC Files in Tracking Output
Date: Sat, 5 Sep 1998 18:21:51 -0400
> Conditioning your output based on the doctype is not in the "style" of
> evaluation that the test is trying to duplicate. An operational system
> probably won't give you that information, so the evaluation doesn't give
> that as side information. We decided at previous meeting that while
> systems are expected to 'track' miscellaneous storys, the evaluation
> won't score them.
Well, we took the specs to literally so when it says
scoring will be done only on "news" stories, when boundaries
are given we don't retrieve the non-news stories at all.
Will the eval software fail to score a file if the MISC
stories are not output?
Are other sites retrieving all boundaries for a particular
file (even MISC and UNTRANSCRIBED?) or just retrieving
MISC?
Bowden
(155) previous ~ index ~ next
Last updated Wed Sep 9 09:40:57 1998