edu.illinois.cs.cogcomp.lbjava.nlp.seg

Class Token

java.lang.Object

edu.illinois.cs.cogcomp.lbjava.parse.LinkedChild

edu.illinois.cs.cogcomp.lbjava.nlp.Word

edu.illinois.cs.cogcomp.lbjava.nlp.seg.Token

All Implemented Interfaces:

Serializable, Cloneable

public class Token
extends Word

Simple extension of the Word class from LBJava's NLP library. Two extra fields are provided to store the token's type. First, type is intended to store the type of the token as computed by some classifier. Second, label is intended for use only when the data is labeled.

Author:

Nick Rizzolo

See Also:

Serialized Form

Field Summary

Fields

Modifier and Type	Field and Description
String	label This field stores the type tag found in labeled data.
String	type This field is used to store a computed type tag.

Fields inherited from class edu.illinois.cs.cogcomp.lbjava.nlp.Word

capitalized, form, lemma, partOfSpeech, wordSense

Fields inherited from class edu.illinois.cs.cogcomp.lbjava.parse.LinkedChild

end, next, parent, previous, start

Constructor Summary

Constructors

Constructor and Description
Token(Word w, Token p, String type) A Token can be constructed from a Word object representing the same word, a Token representing the previous word in the sentence, and the type label found in the data.

Method Summary

Modifier and Type	Method and Description
String	toString() Produces a simple String representation of this word in which the label field appears followed by the word's part of speech and finally the form (i.e., spelling) of the word all surrounded by parentheses.

Methods inherited from class edu.illinois.cs.cogcomp.lbjava.parse.LinkedChild

clone

Methods inherited from class java.lang.Object

equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Field Detail

type

public String type

This field is used to store a computed type tag.

label

public String label

This field stores the type tag found in labeled data.

Constructor Detail

Token

public Token(Word w,
             Token p,
             String type)

A Token can be constructed from a Word object representing the same word, a Token representing the previous word in the sentence, and the type label found in the data.

Parameters:

w - Represents the same word as the Token being constructed.

p - The previous word in the sentence.

type - The type label for this word from the data.

Method Detail

toString

public String toString()

Produces a simple String representation of this word in which the label field appears followed by the word's part of speech and finally the form (i.e., spelling) of the word all surrounded by parentheses.

Overrides:

toString in class Word

Returns:

The POS bracket form of this word, or just the spelling of the word if the part of speech is not available.