(235) previous ~ index ~ next
To: TDT Distrib <tdt-distrib@ldc.upenn.edu>
From: Jonathan Fiscus <jonathan.fiscus@nist.gov>
Subject: Summer Update
Date: Fri, 26 May 2000 14:40:43 -0400
Folks,
Sorry for those missed deadlines. I'm finally in a position to work
on TDT. This note is to let you know what we're planning for the
summer. There are two action items that we would like responses to.
Please send them to me, jonathan.fiscus@nist.gov, by June 1st.
First, an updated evaluation plan for TDT2000 is available for
comment. The relevant URLs are:
ftp://jaguar.ncsl.nist.gov/tdt/tdt2000/evalplans/TDT00.Eval.Plan.v1.0.doc
ftp://jaguar.ncsl.nist.gov/tdt/tdt2000/evalplans/TDT00.Eval.Plan.v1.0.ps
The update reflects the minimal changes agreed to at the workshop. In
order to simplify the comparison of the updated eval plan to last
year's evaluation plan (version 2.7), I've built a comparison of the
two documents using MS-Word's document comparison feature. If people
like this type of presentation, I'll continue publishing these
"comparison" printouts. The URL of the comparison document is:
ftp://jaguar.ncsl.nist.gov/tdt/tdt2000/evalplans/TDT00.Eval.Plan.v1.0_comparedto_tdt3_evalplan_v2.7.ps
NIST will conduct a "Dry-Run" evaluation during July and the LDC will
host a one-day meeting on August 7th, (note the change of date from
August 4th), to discuss the outcome and any issues that arise. The
dry run will focus on the new aspects of the evaluation,
(e.g. tracking with negative topic examples, and tracking and
detection with automatic story boundaries) and to provide a forum to
discuss recent TDT related work.
In order for the LDC to prepare for the meeting, they have asked for an
estimate of how many people plan on attending the meeting. The first
action item is for each site to estimate how many people plan on
attending the meeting and to send me an email indicating the number.
The second action item is again request for information. We'd like to
know who is planning to participate in the Fall eval and on which of
the five tasks they'd like to evaluate their systems on. We are not
asking for commitments at this time, but rather a statements of intent
that can be modified at will. We're asking all previous and
prospective participants to respond even if the answer is "no, we
don't plan on participating".
I hope this summer will be productive for research since mostly all
the data is already available.
Jon
--
Jonathan Fiscus
National Inst. of Stds. and Tech.
100 Bureau Dr. Stop 8940
Gaithersburg, MD 20899-8940
Phone: (301) 975-3182
Email: jonathan.fiscus@nist.gov
(235) previous ~ index ~ next
Last updated Mon Jun 12 13:26:39 2000