TDT3 Email Correspondence

(283) previous ~ index ~ next

To: TDT Distrib <tdt-distrib@ldc.upenn.edu>
From: Jonathan Fiscus <jonathan.fiscus@nist.gov>
Subject: TDT2000 Required Evaluation Conditions
Date: Tue, 12 Sep 2000 13:34:36 -0400

Folks,

At the dry run meeting, not all participants submitted results from
systems that were ran using the required evaluation conditions. Please
take a moment to review this note to make sure your planned submission
includes the required evaluation condition for each task.

Thanks
Jon

Segmentation
------------

	Source language				Both English and Mandarin
	Source data type			ASR transcription
	Maximum decision deferral period	10,000 words for English
						15,000 characters for Mandarin

Topic Tracking
--------------

There are two options: the Basic Required Condition and the Challenge
Conditions

			Basic Required Condition

	Topic training language			English
	Source language				English and Mandarin together
	On-topic training stories		1
	Off-topic training stories		0
	Source data type			text sources and manual
						transcription of audio sources
	Story boundaries			Reference boundaries

			Alternate ("Challenge") Conditions

	Topic training language			English
	Source language				English and Mandarin together
	On-topic training stories		4
	Off-topic training stories		2 and 0 
	Source data type			text sources and 
						ASR transcription of audio sources
	Story boundaries			Automatic boundaries

Topic Detection
---------------

	Source Language				English and Mandarin together
	Source data type			text sources and the TDT3 
						automatic transcription of
						audio sources
	Maximum decision deferral period	10 source files
	Story boundaries			Automatic boundaries

First Story Detection
---------------------

	Source Language				English only
	Source data type			text sources and the TDT3
						automatic transcription of
						audio sources
	Maximum decision deferral period	10 source files
	Story boundaries			Automatic boundaries

Link Detection
--------------

	Source Language				English and Mandarin together
	Source data type			text sources and the ASR
						transcription of audio sources
	Maximum decision deferral period	10 source files
	Story boundaries			Reference boundaries
(283) previous ~ index ~ next


Last updated Tue Sep 19 14:31:00 2000