edu.illinois.cs.cogcomp.nlp.corpusreaders

Class TreebankChunkReader

java.lang.Object

edu.illinois.cs.cogcomp.nlp.corpusreaders.AnnotationReader<TextAnnotation>

edu.illinois.cs.cogcomp.nlp.corpusreaders.PennTreebankReader

edu.illinois.cs.cogcomp.nlp.corpusreaders.TreebankChunkReader

All Implemented Interfaces:

IResetableIterator<TextAnnotation>, Iterable<TextAnnotation>, Iterator<TextAnnotation>

public class TreebankChunkReader
extends PennTreebankReader

Read the WSJ chunk data reader, generated by the file chunlink.pl in the directory treebank-2 in the standard Penn Treebank distribution. This file reads the data generated by running the following command on each file in combined/wsj/$dir/$file:

 perl ./chunlink.pl  -s -ns ./combined/wsj/$dir/$file > ./chunkData/wsj/$dir/$file
 

We assume that this creates a directory structure in treebank-2 as follows

  \treebank-2
  - .. other standard stuff
  - \chunkData
    - \wsj
      - \00
        - wsj_0001.mrg
        - wsj_0002.mrg
        - ...
      - \01
        - wsj_0101.mrg
        - ...
      - and the other sections
 

 #arguments: IOB tag: Begin, word numbering: sent
 #columns: word_id iob_inner pos word function heads head_ids iob_chain trace-function trace-type trace-head_ids
 # Sentence 0001/01
 0 B-NP    NNP   Pierre          NOFUNC          Vinken            1 B-S/B-NP/B-NP
 1 I-NP    NNP   Vinken          NP-SBJ          join              8 I-S/I-NP/I-NP
 2 O       COMMA COMMA           NOFUNC          Vinken            1 I-S/I-NP
 3 B-NP    CD    61              NOFUNC          years             4 I-S/I-NP/B-ADJP/B-NP
 .
 .
 .
 

This class takes the standard penn treebank annotation and adds this annotation to it

Each file in this has the following information in it:

Author:

Vivek Srikumar

Field Summary

Fields

Modifier and Type	Field and Description
protected String	chunkHome
protected List<String>	chunkLines

Fields inherited from class edu.illinois.cs.cogcomp.nlp.corpusreaders.PennTreebankReader

combinedWSJHome, currentSectionId, PENN_TREEBANK_WSJ, sections

Fields inherited from class edu.illinois.cs.cogcomp.nlp.corpusreaders.AnnotationReader

corpusName, currentAnnotationId, resourceManager

Constructor Summary

Constructors

Constructor and Description
TreebankChunkReader(String treebankHome)
TreebankChunkReader(String treebankHome, String[] sections)

Method Summary

Modifier and Type	Method and Description
TextAnnotation	next() return the next annotation object.

Methods inherited from class edu.illinois.cs.cogcomp.nlp.corpusreaders.PennTreebankReader

generateReport, hasNext, initializeReader, remove

Methods inherited from class edu.illinois.cs.cogcomp.nlp.corpusreaders.AnnotationReader

iterator, reset

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface java.lang.Iterable

forEach, spliterator

Methods inherited from interface java.util.Iterator

forEachRemaining

Field Detail

chunkHome

protected String chunkHome

chunkLines

protected List<String> chunkLines

Constructor Detail

TreebankChunkReader

public TreebankChunkReader(String treebankHome)
                    throws Exception

Throws:

Exception

TreebankChunkReader

public TreebankChunkReader(String treebankHome,
                           String[] sections)
                    throws Exception

Throws:

Exception

Method Detail

next

public TextAnnotation next()

Description copied from class: PennTreebankReader

return the next annotation object. Don't forget to increment currentAnnotationId.

Specified by:

next in interface Iterator<TextAnnotation>

Overrides:

next in class PennTreebankReader

Returns:

an annotation object.