Summary
Simple string tokenizer
Metadata
Words
Ordinary words
Files
Metadata files
Children from resource:basis
Simple string tokenizer
Metadata
| Tags: | text |
| Authors: | Slava Pestov |
Words
Ordinary words
| Word | Stack effect |
 tokenize | ( input -- ast ) |
Files
resource:basis/simple-tokenizer/simple-tokenizer.factor
resource:basis/simple-tokenizer/simple-tokenizer-docs.factor
resource:basis/simple-tokenizer/simple-tokenizer-tests.factor
resource:basis/simple-tokenizer/simple-tokenizer-docs.factor
resource:basis/simple-tokenizer/simple-tokenizer-tests.factor
Metadata files
resource:basis/simple-tokenizer/authors.txt
resource:basis/simple-tokenizer/summary.txt
resource:basis/simple-tokenizer/tags.txt
resource:basis/simple-tokenizer/summary.txt
resource:basis/simple-tokenizer/tags.txt
Children from resource:basis
