robot-rules-quot ( robots -- quot )

Vocabulary

robots.private

Inputs

robots

an object

Outputs

quot

an object

Definition

USING: accessors arrays globs kernel regexp regexp.combinators
sequences ;

IN: robots.private

: robot-rules-quot ( robots -- quot )
    [
        [ site>> ] [ rules>> allows>> ] bi derive-urls
        [ <glob> ] map <or>
    ] [
        [ site>> ] [ rules>> disallows>> ] bi derive-urls
        [ <glob> ] map <and> <not>
    ] bi 2array <or> [ matches? ] curry ;