Summary
Simple string tokenizer
Metadata
Words
Ordinary words
Files
Metadata files
Simple string tokenizer
Metadata
| Tags: | text |
| Authors: | Slava Pestov |
Words
Ordinary words
| Word | Stack effect |
 tokenize | ( input -- ast ) |
Files
resource:basis/simple-tokenizer/simple-tokenizer.factor
resource:basis/simple-tokenizer/simple-tokenizer-docs.factor
resource:basis/simple-tokenizer/simple-tokenizer-tests.factor
resource:basis/simple-tokenizer/simple-tokenizer-docs.factor
resource:basis/simple-tokenizer/simple-tokenizer-tests.factor
Metadata files