edu.illinois.cs.cogcomp.lbjava.nlp

Class WordSplitter

java.lang.Object

edu.illinois.cs.cogcomp.lbjava.nlp.WordSplitter

All Implemented Interfaces:

edu.illinois.cs.cogcomp.lbjava.parse.Parser

public class WordSplitter
extends Object
implements edu.illinois.cs.cogcomp.lbjava.parse.Parser

This parser takes the plain, unannotated Sentences returned by another parser (e.g., SentenceSplitter) and splits them into Word objects. Entire sentences now represented as LinkedVectors are then returned one at a time by calls to the next() method.

A main(String[]) method is also implemented which applies this class to plain text in a straight-forward way.

Author:

Nick Rizzolo

Field Summary

Fields

Modifier and Type	Field and Description
protected edu.illinois.cs.cogcomp.lbjava.parse.Parser	parser The Sentence returning parser.

Constructor Summary

Constructors

Constructor and Description
WordSplitter(edu.illinois.cs.cogcomp.lbjava.parse.Parser p) Initializing constructor.

Method Summary

Modifier and Type	Method and Description
void	close() Frees any resources this parser may be holding.
static void	main(String[] args) Run this program on a file containing plain text, and it will produce the same text on STDOUT rearranged so that each line contains exactly one sentence, and so that character sequences deemed to be "words" are delimited by whitespace.
Object	next() Returns LinkedVectors of Word objects one at a time.
void	reset() Sets this parser back to the beginning of the raw data.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

parser

protected edu.illinois.cs.cogcomp.lbjava.parse.Parser parser

The Sentence returning parser.

Constructor Detail

WordSplitter

public WordSplitter(edu.illinois.cs.cogcomp.lbjava.parse.Parser p)

Initializing constructor.

Parameters:

p - The Sentence returning parser.

Method Detail

main

public static void main(String[] args)

Run this program on a file containing plain text, and it will produce the same text on STDOUT rearranged so that each line contains exactly one sentence, and so that character sequences deemed to be "words" are delimited by whitespace.

Usage: java edu.illinois.cs.cogcomp.lbjava.edu.illinois.cs.cogcomp.lbjava.nlp.WordSplitter <file name>

Parameters:

args - The command line arguments.

next

public Object next()

Returns LinkedVectors of Word objects one at a time.

Specified by:

next in interface edu.illinois.cs.cogcomp.lbjava.parse.Parser

reset

public void reset()

Sets this parser back to the beginning of the raw data.

Specified by:

reset in interface edu.illinois.cs.cogcomp.lbjava.parse.Parser

close

public void close()

Frees any resources this parser may be holding.

Specified by:

close in interface edu.illinois.cs.cogcomp.lbjava.parse.Parser