spider vocabulary
Factor handbook ยป Vocabulary index


Documentation
Spider

Metadata
Authors:Doug Coleman


Words

Tuple classes
ClassSuperclassSlots
spider tuplebase count max-count sleep max-depth initial-links filters spidered todo nonmatching quiet? currently-spidering #threads semaphore follow-robots? robots
spider-result tupleurl depth headers fetched-in parsed-html links processed-in fetched-at


Ordinary words
WordStack effect
<spider-result>( url depth -- spider-result )
<spider>( base -- spider )
run-spider( spider -- spider )
run-spider-loop( spider -- )


Class predicate words
WordStack effect
spider-result?( object -- ? )
spider?( object -- ? )


Files


Metadata files


Children from resource:extra
VocabularySummary
spider.report
spider.unique-deque


Children
VocabularySummary
spider.private