|
||||||||||
PREV PACKAGE NEXT PACKAGE | FRAMES NO FRAMES |
Interface Summary | |
---|---|
IDelayResolver | Resolves and creates "delays" between each document crawled. |
IHttpClientInitializer | Initializes an HTTP Connection. |
IHttpDocumentChecksummer | |
IHttpDocumentFetcher | Fetches the HTTP document and its metadata (HTTP Headers). |
IHttpDocumentProcessor | Custom processing (optional) performed on a document. |
IHttpHeadersChecksummer | |
IHttpHeadersFetcher | Fetches the HTTP Header, typically via a HEAD request. |
IRobotsMetaBuilder | |
IRobotsTxtProvider | Given a URL, extract any "robots.txt" rules. |
IURLExtractor | Responsible for extracting URLs out of a document. |
IURLNormalizer | Responsible for normalizing URLs. |
|
||||||||||
PREV PACKAGE NEXT PACKAGE | FRAMES NO FRAMES |