Uses of Interface
edu.udo.cs.wvtool.util.TokenEnumeration

Packages that use TokenEnumeration

edu.udo.cs.wvtool.generic.stemmer	Provides classes and interfaces for stemmers.
edu.udo.cs.wvtool.generic.tokenizer	Provides classes and interfaces for tokenization.
edu.udo.cs.wvtool.generic.wordfilter	Provides classes and interfaces for the filtering of words.

Uses of TokenEnumeration in edu.udo.cs.wvtool.generic.stemmer

Classes in edu.udo.cs.wvtool.generic.stemmer that implement TokenEnumeration

class	AbstractStemmer An abstract stemmer.
class	AbstractWordNetStemmer An abstract stemming class using the wordnet dicitionary.
class	DictionaryStemmer A stemmer that is based on an explicit dictionary containing pairs of terms and base forms.
class	DummyStemmer Does not do anything with the tokens.
class	LovinsStemmerWrapper Wrapper for the lovins stemmer.
class	PorterStemmerWrapper Wrapper for the Porter Stemmer provided with the system.
class	SnowballStemmerWrapper Wrapper for the snowball stemmer package.
class	ToLowerCaseConverter Converts the tokens to lower case.
class	WordNetHypernymStemmer Replaces a word by a hypernym.
class	WordNetSynonymStemmer Replaces a word by the first representant of its synset.

Fields in edu.udo.cs.wvtool.generic.stemmer declared as TokenEnumeration

private TokenEnumeration

AbstractStemmer.source

Methods in edu.udo.cs.wvtool.generic.stemmer that return TokenEnumeration

TokenEnumeration	SnowballStemmerWrapper.stem(TokenEnumeration source, WVTDocumentInfo d)
TokenEnumeration	WVTStemmer.stem(TokenEnumeration source, WVTDocumentInfo d) Convert a list of tokens to a list of stems.
TokenEnumeration	AbstractStemmer.stem(TokenEnumeration source, WVTDocumentInfo d)

Methods in edu.udo.cs.wvtool.generic.stemmer with parameters of type TokenEnumeration

TokenEnumeration	SnowballStemmerWrapper.stem(TokenEnumeration source, WVTDocumentInfo d)
TokenEnumeration	WVTStemmer.stem(TokenEnumeration source, WVTDocumentInfo d) Convert a list of tokens to a list of stems.
TokenEnumeration	AbstractStemmer.stem(TokenEnumeration source, WVTDocumentInfo d)

Uses of TokenEnumeration in edu.udo.cs.wvtool.generic.tokenizer

Classes in edu.udo.cs.wvtool.generic.tokenizer that implement TokenEnumeration

class	NGramTokenizer Creates tokens by creating ngrams of the tokens received from an inner tokenizer.
class	SimpleTokenizer This class implements a simple tokenizer.

Fields in edu.udo.cs.wvtool.generic.tokenizer declared as TokenEnumeration

private TokenEnumeration

NGramTokenizer.input

Methods in edu.udo.cs.wvtool.generic.tokenizer that return TokenEnumeration

TokenEnumeration	SimpleTokenizer.tokenize(java.io.Reader source, WVTDocumentInfo d)
TokenEnumeration	WVTTokenizer.tokenize(java.io.Reader source, WVTDocumentInfo d) Tokenize a character stream.
TokenEnumeration	NGramTokenizer.tokenize(java.io.Reader source, WVTDocumentInfo d)

Uses of TokenEnumeration in edu.udo.cs.wvtool.generic.wordfilter

Classes in edu.udo.cs.wvtool.generic.wordfilter that implement TokenEnumeration

class	AbstractStopWordFilter Abstract call implementing basic functionality for several word filters.
class	DummyWordFilter Dummy Wrapper for the stop word class (without performing any filtering).
class	SelectingWordFilter Class that dynamically selects the word filter according to the selected language.
class	StopWordFilterFile Filters all words specified in a file.
class	StopWordsWrapper Wrapper for the stop word class.
class	StopWordsWrapperGerman A wrapper for the german stopwordlist

Fields in edu.udo.cs.wvtool.generic.wordfilter declared as TokenEnumeration

private TokenEnumeration

AbstractStopWordFilter.input the token stream from which the characters are read

Methods in edu.udo.cs.wvtool.generic.wordfilter that return TokenEnumeration

TokenEnumeration	SelectingWordFilter.filter(TokenEnumeration source, WVTDocumentInfo d)
TokenEnumeration	WVTWordFilter.filter(TokenEnumeration source, WVTDocumentInfo d) Filter tokens from a token stream.
TokenEnumeration	AbstractStopWordFilter.filter(TokenEnumeration source, WVTDocumentInfo d)

Methods in edu.udo.cs.wvtool.generic.wordfilter with parameters of type TokenEnumeration

TokenEnumeration	SelectingWordFilter.filter(TokenEnumeration source, WVTDocumentInfo d)
TokenEnumeration	WVTWordFilter.filter(TokenEnumeration source, WVTDocumentInfo d) Filter tokens from a token stream.
TokenEnumeration	AbstractStopWordFilter.filter(TokenEnumeration source, WVTDocumentInfo d)