make-word-table ( -- )

Vocabulary

unicode.breaks.private

Inputs

None

Outputs

None

Definition

USING: sequences ;

IN: unicode.breaks.private

: make-word-table ( -- )
    { wCR } { wLF } connect
    { wNewline wCR wLF } unicode-words <iota> disconnect
    unicode-words <iota> { wNewline wCR wLF } disconnect
    { wZWJ } unicode-words <iota> check-Extended_Pictographic
    set-table { wWSegSpace } { wWSegSpace } connect
    unicode-words <iota> { wZWJ } connect
    { wALetter wHebrew_Letter } { wALetter wHebrew_Letter }
    connect
    { wALetter wHebrew_Letter }
    { wMidLetter wMidNumLet wSingle_Quote } check-AHletter-after
    set-table
    { wMidLetter wMidNumLet wSingle_Quote }
    { wALetter wHebrew_Letter } check-AHletter-before set-table
    { wHebrew_Letter } { wSingle_Quote } connect
    { wHebrew_Letter } { wDouble_Quote }
    check-Hebrew-letter-after set-table
    { wDouble_Quote } { wHebrew_Letter }
    check-Hebrew-letter-before set-table
    { wNumeric } { wNumeric } connect
    { wALetter wHebrew_Letter } { wNumeric } connect
    { wNumeric } { wALetter wHebrew_Letter } connect
    { wMidNum wMidNumLet wSingle_Quote } { wNumeric }
    check-number-before set-table
    { wNumeric } { wMidNum wMidNumLet wSingle_Quote }
    check-number-after set-table
    { wKatakana } { wKatakana } connect
    { wALetter wHebrew_Letter wNumeric wKatakana wExtendNumLet }
    { wExtendNumLet } connect
    { wExtendNumLet }
    { wALetter wHebrew_Letter wNumeric wKatakana } connect
    { wRegional_Indicator } { wRegional_Indicator }
    check-RI-pair set-table ;