ebnf-tokenizer

Vocabulary

peg.ebnf.private

Definition

IN: peg.ebnf.private

TUPLE: ebnf-tokenizer elements ;

Methods

USING: accessors kernel namespaces peg.ebnf.private peg.parsers
;

M: ebnf-tokenizer (transform)
    elements>> dup "default" =
    [ drop default-tokenizer \ tokenizer set-global any-char ]
    [ (transform) dup parser-tokenizer \ tokenizer set-global ]
    if ;