(297) previous ~ index ~ next
To: Jon_Yamron@dragonsys.com
From: James Allan <allan@cs.umass.edu>
Subject: Re: 2nd unofficial release.
Date: Fri, 20 Oct 2000 16:06:19 -0400
Jon,
The problem was that the evaluation software did not properly handle
NO judgments. Recall that prior to this year, all judgments were
either YES or BRIEF. Starting this year, there are NO judgments
because the annotations are not exhaustive.
Jon's software included a couple of places where it assumed that the
only possible values were YES and BRIEF. The result was that it was
treating NOs as either YES or BRIEF.
Mark fixed the problem. We also confirmed things by removing all of
the NO judgments and running Jon's original software. Both gave the
same result.
-- james
(297) previous ~ index ~ next
Last updated Wed Oct 25 15:48:22 2000