tokenizer-parser ( -- parser )

Vocabulary

peg.ebnf.private

Inputs

None

Outputs

parser

an object

Definition

USING: make peg sequences ;

IN: peg.ebnf.private

: tokenizer-parser ( -- parser )
    [
        "tokenizer" syntax , "=" syntax , ">" token ensure-not ,
        [ "default" token sp , choice-parser , ] choice* ,
    ] seq* [ first <ebnf-tokenizer> ] action ;