Summary
Tokenizing lines of text with a syntax mode

Metadata

Parents:	xmode
Authors:	Slava Pestov

Words

Union classes

abstract-span-rule

Generic words

Word	Stack effect
handle-rule-end	( match-count rule -- )
handle-rule-start	( match-count rule -- )
match-position	( rule -- n )
text-matches?	( string text -- match-count/f )

Ordinary words

Word	Stack effect
(check-word-break)	( -- )
?end-rule	( -- )
add-remaining-token	( -- )
can-match-here?	( matcher rule -- ? )
check-end-delegate	( -- ? )
check-escape-rule	( rule -- ? )
check-every-rule	( -- ? )
check-rule	( -- )
check-word-break	( -- ? )
current-char	( -- char )
current-keyword	( -- string )
do-escaped	( -- )
find-escape-rule	( -- rule )
get-always-rules	( ruleset -- vector/f )
get-char-rules	( char ruleset -- vector/f )
get-rules	( char ruleset -- seq )
handle-no-word-break	( -- )
keyword-number?	( keyword -- ? )
mark-keyword	( keyword -- id )
mark-number	( keyword -- id )
mark-remaining	( -- )
mark-token	( -- )
mark-token-loop	( -- )
match-start	( string regexp -- slice/f )
rest-of-line	( -- str )
rule-end-matches?	( rule -- match-count/f )
rule-match-token*	( rule -- id )
rule-set-empty?	( ruleset -- ? )
rule-start-matches?	( rule -- match-count/f )
string-head?	( str1 str2 ignore-case -- ? )
string=	( str1 str2 ignore-case -- ? )
tokenize-line	( line-context line rules -- line-context' seq )
unwind-no-line-break	( -- )

Class predicate words

Word	Stack effect
abstract-span-rule?	( object -- ? )

Files


Metadata files


Children from resource:basis

Vocabulary	Summary
xmode.marker.context
xmode.marker.state