com.norconex.collector.http.robot

Interface IRobotsTxtFilter

All Superinterfaces:

IOnMatchFilter, IReferenceFilter

public interface IRobotsTxtFilter
extends IReferenceFilter, IOnMatchFilter

Holds a robots.txt rule. The IOnMatchFilter.getOnMatch() method indicate whether the rule is a "Disallow" or "Allow". A "Disallow" rule is represented by OnMatch.EXCLUDE whereas "Allow" is represented by OnMatch.INCLUDE.

Since:

2.4.0

Author:

Pascal Essiembre

Method Summary

Modifier and Type	Method and Description
String	getPath()

Methods inherited from interface com.norconex.collector.core.filter.IReferenceFilter

acceptReference

Methods inherited from interface com.norconex.importer.handler.filter.IOnMatchFilter

getOnMatch

Method Detail

getPath

String getPath()