edu.illinois.cs.cogcomp.lbjava.nlp.seg

Class PlainToTokenParser

java.lang.Object

edu.illinois.cs.cogcomp.lbjava.nlp.seg.PlainToTokenParser

All Implemented Interfaces:

edu.illinois.cs.cogcomp.lbjava.parse.Parser

public class PlainToTokenParser
extends Object
implements edu.illinois.cs.cogcomp.lbjava.parse.Parser

This parser takes the Words in the representation created by another Parser and creates a new representation consisting of Tokens. The input parser is actually expected to return a LinkedVector populated by Words with each call to Parser.next(). The Tokens returned by calls to this class's next() method are also contained in LinkedVectors representing sentences which are accessible via the LinkedChild.parent field.

Author:

Nick Rizzolo

Field Summary

Fields

Modifier and Type	Field and Description
protected Token	next The next token to return.
protected edu.illinois.cs.cogcomp.lbjava.parse.Parser	parser A parser creating a representation consisting of Words.

Constructor Summary

Constructors

Constructor and Description
PlainToTokenParser(edu.illinois.cs.cogcomp.lbjava.parse.Parser p) The only constructor.

Method Summary

Modifier and Type	Method and Description
void	close() Frees any resources this parser may be holding.
Object	next() This method returns Tokens until the input is exhausted, at which point it returns null.
void	reset() Sets this parser back to the beginning of the raw data.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

parser

protected edu.illinois.cs.cogcomp.lbjava.parse.Parser parser

A parser creating a representation consisting of Words.

next

protected Token next

The next token to return.

Constructor Detail

PlainToTokenParser

public PlainToTokenParser(edu.illinois.cs.cogcomp.lbjava.parse.Parser p)

The only constructor.

Parameters:

p - A parser creating a representation consisting of Words.

Method Detail

next

public Object next()

This method returns Tokens until the input is exhausted, at which point it returns null.

Specified by:

next in interface edu.illinois.cs.cogcomp.lbjava.parse.Parser

reset

public void reset()

Sets this parser back to the beginning of the raw data.

Specified by:

reset in interface edu.illinois.cs.cogcomp.lbjava.parse.Parser

close

public void close()

Frees any resources this parser may be holding.

Specified by:

close in interface edu.illinois.cs.cogcomp.lbjava.parse.Parser