com.norconex.collector.http.robot.impl
Classes
StandardRobotsMetaProvider
StandardRobotsTxtProvider