(take-token) ( sequence-parser -- string )

Vocabulary

c.lexer

Inputs

sequence-parser

an object

Outputs

string

an object

Definition

USING: combinators.short-circuit kernel sequences.parser unicode
;

IN: c.lexer

: (take-token) ( sequence-parser -- string )
    skip-whitespace
    [ current { [ blank? ] [ f = ] } 1|| ] take-until ;