(186) previous ~ index ~ next
To: <jsmc@watson.ibm.com>, <tdt-distrib@unagi.cis.upenn.edu>
From: "George Doddington" <doddington@email.msn.com>
Subject: Re: TDT2 Evaluation Plan -- detection rule clarification
Date: Wed, 30 Sep 1998 18:33:25 -0700
>We need a clarification on exactly what information may be used
>in detection. Are the following legal?
>
>(1) confidence measures of the ASR output
>(2) filename (or information source and date)
Confidence measures are not part of the manual transcription, but they
are certainly a potential part of an automatic transcription. In fact, the
default evaluation condition (which uses the TDT2-supplied automatic
transcription) includes word-level recognition confidence as part of the
transcription. Therefore the use of this confidence measure is legal for
the default evaluation condition, too.
Knowledge of each story's source and time of the broadcast is allowable
information for the system to use. (This is stated in the evaluation plan,
version 3.7, at the bottom of page 3.)
--
George Doddington in Orinda, CA. doddington@nist.gov 925/631-6628
(186) previous ~ index ~ next
Last updated Fri Oct 2 19:04:21 1998