edu.illinois.cs.cogcomp.chunker.utils

Class CoNLL2000Parser

java.lang.Object

edu.illinois.cs.cogcomp.lbjava.parse.LineByLine

edu.illinois.cs.cogcomp.lbjava.nlp.ColumnFormat

edu.illinois.cs.cogcomp.chunker.utils.CoNLL2000Parser

All Implemented Interfaces:

edu.illinois.cs.cogcomp.lbjava.parse.Parser

public class CoNLL2000Parser
extends ColumnFormat

This parser is designed to extract an internal representation of the sentences and words that appear in the CoNLL 2000 shared task corpora. It produces LBJ2.parse.LinkedVectors populated by LBJ2.nlp.seg.Tokens representing words. Each LinkedVector represents a sentence from the input. More information about LinkedVector can be found in LBJ's online Javadoc.

A line of the input file parsed by this parser contains information about a single word of natural language text. The word itself appears first, followed by a part of speech tag and a BIO chunk tag, all separated by whitespace. If a part of speech tag is unknown, a single dash may appear instead. Words appear in the order they were found in the plain text, and sentences are separated by newlines.

Author:

Nick Rizzolo

Field Summary

Fields inherited from class edu.illinois.cs.cogcomp.lbjava.parse.LineByLine

fileName, in

Constructor Summary

Constructors

Constructor and Description
CoNLL2000Parser(String file) Constructs this parser to parse the given file.

Method Summary

Modifier and Type	Method and Description
Object	next() Produces the next object parsed from the input file; in this case, that object is guaranteed to be a LinkedVector populated by Tokens representing a sentence.

Methods inherited from class edu.illinois.cs.cogcomp.lbjava.parse.LineByLine

close, readLine, reset

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

CoNLL2000Parser

public CoNLL2000Parser(String file)

Constructs this parser to parse the given file.

Parameters:

file - The name of the file to parse.

Method Detail

next

public Object next()

Produces the next object parsed from the input file; in this case, that object is guaranteed to be a LinkedVector populated by Tokens representing a sentence.

Specified by:

next in interface edu.illinois.cs.cogcomp.lbjava.parse.Parser

Overrides:

next in class ColumnFormat