add-spidered ( spider spider-result -- )

Vocabulary

spider.private

Inputs

spider	an object
spider-result	an object

Outputs

None

Definition

USING: accessors assocs kernel math ;

IN: spider.private

:: add-spidered ( spider spider-result -- )
    spider [ 1 + ] change-count drop
    spider-result dup url>> spider spidered>> set-at
    spider spider-result filter-base-links
    :> ( matching nonmatching ) spider-result depth>> 1 +
    :> depth nonmatching depth spider add-nonmatching
    matching spider apply-filters depth spider add-todo ;