Uses of Class
edu.illinois.cs.cogcomp.lbjava.nlp.seg.Token

Packages that use Token

Package	Description
edu.illinois.cs.cogcomp.lbjava.nlp.seg
edu.illinois.cs.cogcomp.pos

Uses of Token in edu.illinois.cs.cogcomp.lbjava.nlp.seg

Fields in edu.illinois.cs.cogcomp.lbjava.nlp.seg declared as Token

Modifier and Type	Field and Description
Token	POSBracketToToken.currentWord A pointer to the most recently returned word is kept for easy access to the next word.
protected Token	PlainToTokenParser.next The next token to return.

Constructors in edu.illinois.cs.cogcomp.lbjava.nlp.seg with parameters of type Token

Constructor and Description
Token(Word w, Token p, String type) A Token can be constructed from a Word object representing the same word, a Token representing the previous word in the sentence, and the type label found in the data.

Uses of Token in edu.illinois.cs.cogcomp.pos

Methods in edu.illinois.cs.cogcomp.pos that return types with arguments of type Token

Modifier and Type	Method and Description
static List<Token>	LBJavaUtils.recordToLBJTokens(TextAnnotation record) Converts a record into LBJ Tokens for use with LBJ classifiers.