spider.private vocabulary
Factor handbook ยป Vocabulary index


Summary

Metadata
Parents:spider


Words

Ordinary words
WordStack effect
add-nonmatching( links level spider -- )
add-spidered( spider spider-result -- )
add-todo( links level spider -- )
apply-filters( links spider -- links' )
fill-spidered-result( spider spider-result -- )
filter-base-links( spider spider-result -- base-links nonmatching-links )
normalize-hrefs( base links -- links' )
print-spidering( spider-result -- )
push-links( links level unique-deque -- )
queue-initial-links( spider -- spider )
setup-next-url( spider -- spider spider-result )
spider-next-page( spider -- )
spider-page( spider spider-result -- )
spider-page?( spider -- ? )
spider-sleep( spider -- )
url-html?( url -- ? )


Files