Uses of Interface
deepnetts.tokenizers.Tokenizer

Packages that use Tokenizer

Package	Description
deepnetts.net	Neural network architectures with their corresponding builders.
deepnetts.tokenizers
deepnetts.tokenizers.bpe

Uses of Tokenizer in deepnetts.net

Methods in deepnetts.net with parameters of type Tokenizer

Modifier and Type	Method	Description
FeedForwardNetworkLM.Builder	FeedForwardNetworkLM.Builder.addTokenizer(Tokenizer tokenizer)

Uses of Tokenizer in deepnetts.tokenizers

Classes in deepnetts.tokenizers that implement Tokenizer

Modifier and Type	Class	Description
class	WordTokenizer

Uses of Tokenizer in deepnetts.tokenizers.bpe

Classes in deepnetts.tokenizers.bpe that implement Tokenizer

Modifier and Type	Class	Description
class	BPETokenizer