com.norconex.collector.http.pipeline.importer

Class HttpImporterPipelineContext

java.lang.Object

com.norconex.collector.core.pipeline.BasePipelineContext

com.norconex.collector.core.pipeline.DocumentPipelineContext

com.norconex.collector.core.pipeline.importer.ImporterPipelineContext

com.norconex.collector.http.pipeline.importer.HttpImporterPipelineContext

public class HttpImporterPipelineContext
extends ImporterPipelineContext

Author:

Pascal Essiembre

Constructor Summary

Constructors

Constructor and Description
HttpImporterPipelineContext(HttpCrawler crawler, ICrawlDataStore crawlDataStore, HttpCrawlData crawlData, HttpCrawlData cachedCrawlData, HttpDocument doc)
HttpImporterPipelineContext(ImporterPipelineContext copiable) Constructor creating a copy of supplied context.

Method Summary

Modifier and Type	Method and Description
HttpCrawlData	getCachedCrawlData()
HttpCrawlerConfig	getConfig()
HttpCrawlData	getCrawlData()
HttpCrawler	getCrawler()
HttpDocument	getDocument()
HttpClient	getHttpClient()
IHttpMetadataFetcher	getHttpHeadersFetcher()
Importer	getImporter()
HttpMetadata	getMetadata()
RobotsMeta	getRobotsMeta()
ISitemapResolver	getSitemapResolver()
boolean	isHttpHeadFetchEnabled()
boolean	isHttpHeadSuccessful() Gets whether http headers were already fetched successfully.
void	setHttpHeadSuccessful(boolean httpHeadSuccessful) Sets whether http headers were already fetched successfully.
void	setRobotsMeta(RobotsMeta robotsMeta)

Methods inherited from class com.norconex.collector.core.pipeline.importer.ImporterPipelineContext

getImporterResponse, isDelete, isOrphan, setDelete, setImporterResponse, setOrphan

Methods inherited from class com.norconex.collector.core.pipeline.DocumentPipelineContext

getContent, getContentReader, setCachedCrawlData, setDocument

Methods inherited from class com.norconex.collector.core.pipeline.BasePipelineContext

equals, fireCrawlerEvent, getCrawlDataStore, hashCode, setCrawlData, toString

Methods inherited from class java.lang.Object

clone, finalize, getClass, notify, notifyAll, wait, wait, wait

Constructor Detail

HttpImporterPipelineContext

public HttpImporterPipelineContext(ImporterPipelineContext copiable)

Constructor creating a copy of supplied context.

Parameters:

copiable - the item to be copied

Since:

2.8.0

HttpImporterPipelineContext

public HttpImporterPipelineContext(HttpCrawler crawler,
                                   ICrawlDataStore crawlDataStore,
                                   HttpCrawlData crawlData,
                                   HttpCrawlData cachedCrawlData,
                                   HttpDocument doc)

Method Detail

getCrawler

public HttpCrawler getCrawler()

Overrides:

getCrawler in class BasePipelineContext

getConfig

public HttpCrawlerConfig getConfig()

Overrides:

getConfig in class BasePipelineContext

getCrawlData

public HttpCrawlData getCrawlData()

Overrides:

getCrawlData in class BasePipelineContext

getCachedCrawlData

public HttpCrawlData getCachedCrawlData()

Overrides:

getCachedCrawlData in class DocumentPipelineContext

getHttpClient

public HttpClient getHttpClient()

getDocument

public HttpDocument getDocument()

Overrides:

getDocument in class DocumentPipelineContext

getHttpHeadersFetcher

public IHttpMetadataFetcher getHttpHeadersFetcher()

getSitemapResolver

public ISitemapResolver getSitemapResolver()

getMetadata

public HttpMetadata getMetadata()

getImporter

public Importer getImporter()

getRobotsMeta

public RobotsMeta getRobotsMeta()

setRobotsMeta

public void setRobotsMeta(RobotsMeta robotsMeta)

Parameters:

robotsMeta - the robotsMeta to set

isHttpHeadFetchEnabled

public boolean isHttpHeadFetchEnabled()

isHttpHeadSuccessful

public boolean isHttpHeadSuccessful()

Gets whether http headers were already fetched successfully.

Returns:

true if fetched successfully

Since:

2.9.1

setHttpHeadSuccessful

public void setHttpHeadSuccessful(boolean httpHeadSuccessful)

Sets whether http headers were already fetched successfully.

Parameters:

httpHeadSuccessful - true if fetched successfully

Since:

2.9.1