(178) previous ~ index ~ next
To: tdt-distrib@ldc.upenn.edu
From: "Charles L. Wayne" <clwayne@afterlife.ncsc.mil>
Subject: TDT Dry Run Meeting Plans
Date: Thu, 10 Sep 1998 23:13:04 -0400 (EDT)
Greetings,
I was very pleased to hear from NIST about all the results that were
submitted today. From reading the e-mail, I know what a struggle this
has been. I am VERY impressed.
NIST has, of course, been working hard to get the evaluation software
right; and I hope you've seen the evidence of that over the past couple
weeks. If there are still problems in their code, please report that
to them so that they can make corrections; that would be a lot more
efficient than hacking workarounds.
Similarly, the LDC has been working very hard to improve the corpus.
You won't see the effects of that until after the dry run meeting, but
you have seen a note explaining their new bug reporting and tracking
system, and you will soon see a note explaining other things that they
have been doing.
In order to make sure that we have a good handle on any remaining
problems, we will devote some time at the beginning of the meeting to
cataloging those problems. Each site will be allotted 2 minutes to
provide a concise summary of problems that still exist with either the
evaluation software or the corpus.
During the body of the meeting, each research site will be allotted 15
minutes to talk about each of the major tasks (segmentation, detection,
or tracking) for which it has obtained results. Sites that do key
contrast experiments (e.g., detection or tracking without known
segmentation, or any task with manual transcriptions) may have an
additional 5 minutes.
As you saw today, Jon Fiscus has invited more submissions, and he will
accept them as late as noon Tuesday (though he would prefer Monday).
During the meeting, at the beginning of each appropriate session, NIST
will give a short summary of the results that they received.
Site presentations should (a) summarize the technical approaches used,
(b) analyze and interpret errors, and (c) outline any new research
directions to be pursued this fall. In addition, the allotted
presentation times are intended to include (d) a few clarifying
questions from the floor.
Please bring 40 sets of hardcopy handouts for all the slides that you
may present. The slides for each presentation should be separately
collated and stapled.
George and I will be finalizing the agenda over the weekend. One
change is that the Thursday session will begin 15 minutes earlier than
previously announced. Please arrive at the door between 7:30 and 8:00
a.m. Coffee, tea, and bagels will be available starting at 7:45. The
meeting itself will begin at 8:15.
Best wishes,
Charles
(178) previous ~ index ~ next
Last updated Fri Sep 11 13:52:54 1998