gb18030
GB 18030

Vocabulary
io.encodings.gb18030

Class description
The encoding descriptor for GB 18030, a Chinese national standard for text encoding. GB 18030 consists of a unique encoding for each Unicode code point, and for this reason has been described as a UTF. It is backwards compatible with the earlier encodings GB 2312 and GBK.

See also
An introduction to encodings

Definition

IN: io.encodings.gb18030

SINGLETON: gb18030

Methods

USING: ascii assocs byte-arrays combinators io io.encodings
io.encodings.gb18030 io.encodings.gb18030.private kernel
namespaces ;

M: gb18030 decode-char
    drop dup stream-read1 {
        { [ dup not ] [ 2drop f ] }
        {
            [ dup ascii? ]
            [ nip 1byte-array mapping get-global value-at ]
        }
        { [ dup quad-1/3? ] [ two-byte ] }
        [ 2drop replacement-char ]
    } cond ;


USING: assocs io io.encodings io.encodings.gb18030
io.encodings.gb18030.private kernel namespaces ;

M: gb18030 encode-char
    drop
    [ [ mapping get-global at ] [ lookup-range ] ?unless ] dip
    stream-write ;