simple-tokenizer vocabulary
Factor handbook ยป Vocabulary index


Summary
Simple string tokenizer

Metadata
Tags:text
Authors:Slava Pestov


Words

Ordinary words
WordStack effect
tokenize( input -- ast )


Files


Metadata files