English document collection
NTCIR-12 Temporalia uses a web corpus, called "LivingKnowledge news and blogs annotated subcollection", constructed by the LivingKnowledge project and distributed by Internet Memory.
The collection is 20G uncompressed and over 5G zipped. It spans from May 2011 to March 2013 and contains around 3.8M documents collected from about 1500 different blogs and news sources. The data is split into 970 files, named after the date of that day and some information about its sources (there might be more than one file per day).
Each file contains a number of text documents. For each document the following information is available
<doc id=lk-20130223040102_592>
<meta-info>
<tag name="host">www.spiegel.de</tag>
<tag name="data">2013-02-22</tag>
<tag name="url">http://www.spiegel.de/international/business/eu-widens-libor-scandal-investigation-and-threatens-heavy-fines-a-884948.html#ref=rss</tag>
<tag name="sourcerss">http://www.spiegel.de/international/index.rss</tag>
<tag name="title">EU Widens LIBOR Scandal Investigation and Threatens Heavy Fines</tag>
</meta-info>
<text>
...
</text>The "doc id" refers to a unique document identifier in the collection. The "host" contains the hostname the text was pulled from, the "date" the publishing data of the document, the "url" text was pulled from, the "sourcerss" the rss that was accessed to retrieve the page, and finally, the "title" the title of the page.
Between the <text> tags, there’s the content of the page. This collection also provides three kinds of annotations: Sentence splitting, Named Entities, and Time annotations. Each sentence in the content of the page is surrounded by <SE> tags.
Each identified named entity is surrounded by the <E> tags. The type of the entity is included inside the tag, for instance <E type="E:ORGANIZATION:CORPORATION">YouWalkAway.com</E>.
Each time reference identified in the text is surrounded by the tag <T> <T val="2012">the end of 2012</T> which contains a "val" element referring to the estimated point in time the annotation is referring to.
An example of documents can be found below.
We will provide a script to remove these annotations and leave only the textual
part of each page, if the participants wish to only use that.
How to get a copy of the document collection
Please contact us email (tc4fia at googlegroups dot com) first with your name, affiliation, and registered group id. We will then let you know the contact address of Leïla Medjkoune, Head of Web Archiving, Internet Memory, who manages the distribution of the document collection.
How to remove tags and correct markup inconsistency
Please read HOWTO and FAQ.
Chinese document collection
For NTCIR-12 Temporalia-2, the Chinese document collections SogouCA (2012) and SogouT will be used for dry-run and formal run respectively.
For each document, the following informaton is available
<doc id=***>
<meta-info>
<tag name="host">***</tag>
<tag name="date">***</tag>
<tag name="url">***</tag>
<tag name="title">***</tag>
<tag name="source-encoding">***</tag>
</meta-info>
<text>***</text>
</doc>The "host" contains the hostname the document was pulled from, the "date" is the publish date of the document, the "url" identifies the document was pulled from, and finally, the "title" the title of the page.
Between the <text> tags, there's the content of the page. This collection also provides three kinds of annotations: Sentence splitting, Named Entities, and Time annotations. Each sentence in the content of the page is surrounded by <SE> tags.
Each identified named entity is surrounded by the <E> tags.
The type of the entity is included inside the tag.
An example of documents can be found below.
Specifically, for Named Entities, there are totally 5 types of tags. PERSON, LOCATION, ORGANIZATION, GPE (geo-political entity), MISC (by merging all but the four most dominant entity types into one general entity type called misc, i.e., miscellaneous).
For annotating temporal expressions, a variant of the standard format TIMEX3 used in TempEval task is applied.
For more datails on the annotation attributes, please refert to Joint Parsing and Named Entity Recognition (by J. R. Finkel and C. D. Manning) and Guidelines for Temporal Expression Annotation for English for TempEval 2010 (by TimeML Working Group).
For dry-run, using the SogouCA (2012) cllection as the input, the script for generating the untagged and tagged collections is TemporaliaChTagger. (Note: Please follow the steps in "Readme.txt". It takes time when generating the tagged collection, since it just assembles two off-the-shelf open-source tools).
For the formal run of the Chinese TDR subtask, a subset of the entire SogouT is used. Since the publication date of a webpage is essential in this subtask, some ad-hoc rules for getting the publication date of a webpage are used to generate this subset. The finally used subset includes a number of 10,907,101 webpages. In view of the fact that we can not redistribute the data, and to alleviate the efforts in processing SogouT, FileExtractor.zip is provided for participants to generate this subset based on SogouT by themselves. Please refer to the included Readme.txt (within FileExtractor.zip) on how to use it.