Summary
Tokenizing lines of text with a syntax mode
Meta-data
Words
Union classes
Generic words
Ordinary words
Class predicate words
Files
Children from resource:basis
Tokenizing lines of text with a syntax mode
Meta-data
| Authors: | Slava Pestov |
Words
Union classes
 abstract-span-rule |
Generic words
| Word | Stack effect |
 handle-rule-end | ( match-count rule -- ) |
| handle-rule-start | ( match-count rule -- ) |
| match-position | ( rule -- n ) |
| text-matches? | ( string text -- match-count/f ) |
Ordinary words
| Word | Stack effect |
 (check-word-break) | ( -- ) |
| ?end-rule | ( -- ) |
| add-remaining-token | ( -- ) |
| can-match-here? | ( matcher rule -- ? ) |
| check-end-delegate | ( -- ? ) |
| check-escape-rule | ( rule -- ? ) |
| check-every-rule | ( -- ? ) |
| check-rule | ( -- ) |
| check-word-break | ( -- ? ) |
| current-char | ( -- char ) |
| current-keyword | ( -- string ) |
| do-escaped | ( -- ) |
| find-escape-rule | ( -- rule ) |
| get-always-rules | ( vector/f ruleset -- vector/f ) |
| get-char-rules | ( vector/f char ruleset -- vector/f ) |
| get-rules | ( char ruleset -- seq ) |
| handle-no-word-break | ( -- ) |
| keyword-number? | ( keyword -- ? ) |
| mark-keyword | ( keyword -- id ) |
| mark-number | ( keyword -- id ) |
| mark-remaining | ( -- ) |
| mark-token | ( -- ) |
| mark-token-loop | ( -- ) |
| rest-of-line | ( -- str ) |
| rule-end-matches? | ( rule -- match-count/f ) |
| rule-match-token* | ( rule -- id ) |
| rule-set-empty? | ( ruleset -- ? ) |
| rule-start-matches? | ( rule -- match-count/f ) |
| string-head? | ( str1 str2 ignore-case -- ? ) |
| string= | ( str1 str2 ignore-case -- ? ) |
| tokenize-line | ( line-context line rules -- line-context' seq ) |
| unwind-no-line-break | ( -- ) |
Class predicate words
| Word | Stack effect |
| abstract-span-rule? | ( object -- ? ) |
Files
Children from resource:basis
| Vocabulary | Summary |
 xmode.marker.context | xmode.marker.context vocabulary |
| xmode.marker.state | xmode.marker.state vocabulary |