(118) previous ~ index ~ next
To: "tdt-distrib@unagi.cis.upenn.edu" <tdt-distrib@unagi.cis.upenn.edu>
From: Thomas C Pierce <tp26+@andrew.cmu.edu>
Subject: Re: New Eval Spec., Eval Software, Dev-test index files and examples
Date: Mon, 17 Aug 1998 17:20:49 -0400 (EDT)
hello everyone,
i have a few items remaining on my 'data-wishlist' after the
announcement of the new release of the eval software. [aside for Jon:
i'll give that a try, and let you know what happens.. ]
i think it would be a good idea, for consistency's sake, to re-release
the tarballs of the first two three-month data sets. it seems that
there have been enough judgement-revisions made, dtd file errors
discovered, and whatnot to warrant this.
also, instead of each site generating the index files separately, could
they just be included along with the data? this seems like a good idea,
since consistency is what we're after...
if the data is not re-released, i think that, at the very least, a
comprehensive list of modifications should be made available.
another issue, which i think should be discussed is precisely what
information our systems can be privvy to. the rule of thumb we've been
using is that the system may look at all the information supplied in the
release data except, of course, the judgements files. however, this
meant we could use the "MISC/NEWS" tags, which possibly should not be
allowed...
-tom
> There are new versions of the evaluation plan, evaluation software
> (version 0.3), dev-test index files (version 2), and example
> system-generated TDT2 output. You can download both the evaluation
> plan and software from the NIST TDT web site at the URL:
(118) previous ~ index ~ next
Last updated Wed Sep 9 09:40:54 1998