| Interface | Description |
|---|---|
| StateProcessor | |
| Tokenizer |
Specifies behavior for Tokenizers integrated into Cognitive Computation Group NLP software
|
| Class | Description |
|---|---|
| Acronyms |
this class manages a list of acronyms (with the trailing period removed).
|
| Contractions |
List of known contractions compiled into a hash map for fast lookup.
|
| IllinoisTokenizer | Deprecated
use StatefulTokenizer instead.
|
| StatefulTokenizer |
This is the entry point to the tokenizer state machine.
|
| TextAnnotationTest |
test specific functionalities associated with TextAnnotation and tokenization Created by mssammon
on 3/31/16.
|
| Tokenizer.Tokenization | |
| TokenizerStateMachine |
This is the state machine used to parse text.
|
| UrlValidation |
This class is solely used to validate URIs.
|
| Enum | Description |
|---|---|
| TokenizerState | |
| TokenType |
These are the types of tokens we deal with.
|
Copyright © 2017. All rights reserved.