Uses of Package
org.apache.nutch.plugin

Packages that use org.apache.nutch.plugin

Package	Description
org.apache.nutch.analysis.lang	Text document language identifier.
org.apache.nutch.collection	Subcollection is a subset of an index.
org.apache.nutch.exchange	Control code for exchange component, which acts in indexing job and decides to which index writer a document should be routed, based on plugins behavior.
org.apache.nutch.exchange.jexl	Plugin of Exchange component based on JEXL expressions.
org.apache.nutch.indexer	Index content, configure and run indexing and cleaning jobs to add, update, and delete documents from an index.
org.apache.nutch.indexer.anchor	An indexing plugin for inbound anchor text.
org.apache.nutch.indexer.arbitrary	Indexing filter to add document arbitrary data to the index from the output of a user-specified class.
org.apache.nutch.indexer.basic	A basic indexing plugin, adds basic fields: url, host, title, content, etc.
org.apache.nutch.indexer.feed	Indexing filter to index meta data from RSS feeds.
org.apache.nutch.indexer.filter
org.apache.nutch.indexer.geoip	This plugin implements an indexing filter which takes advantage of the GeoIP2-java API.
org.apache.nutch.indexer.jexl	This plugin implements a dynamic indexing filter which uses JEXL expressions to allow filtering based on the page's metadata
org.apache.nutch.indexer.links
org.apache.nutch.indexer.metadata	Indexing filter to add document metadata to the index.
org.apache.nutch.indexer.more	A more indexing plugin, adds "more" index fields:last modified date, MIME type, content length.
org.apache.nutch.indexer.replace	Indexing filter to allow pattern replacements on metadata.
org.apache.nutch.indexer.staticfield	A simple plugin called at indexing that adds fields with static data.
org.apache.nutch.indexer.subcollection	Indexing filter to assign documents to subcollections.
org.apache.nutch.indexer.tld	Top Level Domain Indexing plugin.
org.apache.nutch.indexer.urlmeta	URL Meta Tag Indexing Plugin
org.apache.nutch.indexwriter.cloudsearch
org.apache.nutch.indexwriter.csv	Index writer plugin to write a plain CSV file.
org.apache.nutch.indexwriter.dummy	Index writer plugin for debugging, writes pairs of <action, url> to a text file, action is one of "add", "update", or "delete".
org.apache.nutch.indexwriter.elastic	Index writer plugin for Elasticsearch.
org.apache.nutch.indexwriter.kafka	Index writer plugin to produce JSON messages to Kafka.
org.apache.nutch.indexwriter.opensearch1x	Index writer plugin for OpenSearch.
org.apache.nutch.indexwriter.rabbit
org.apache.nutch.indexwriter.solr	Index writer plugin for Apache Solr.
org.apache.nutch.microformats.reltag	A microformats Rel-Tag Parser/Indexer/Querier plugin.
org.apache.nutch.net	Web-related interfaces: URL filters and normalizers.
org.apache.nutch.parse	The Parse interface and related classes.
org.apache.nutch.parse.ext	Parse wrapper to run external command to do the parsing.
org.apache.nutch.parse.feed	Parse RSS feeds.
org.apache.nutch.parse.headings	Parse filter to extract headings (h1, h2, etc.) from DOM parse tree.
org.apache.nutch.parse.html	An HTML document parsing plugin.
org.apache.nutch.parse.js	Parser and parse filter plugin to extract all (possible) links from JavaScript files and embedded JavaScript code snippets.
org.apache.nutch.parse.metatags	Parse filter to extract meta tags: keywords, description, etc.
org.apache.nutch.parse.tika	Parse various document formats with help of Apache Tika.
org.apache.nutch.parse.zip	Parse ZIP files: embedded files are recursively passed to appropriate parsers.
org.apache.nutch.parsefilter.debug	Adds serialized DOM to parse data, useful for debugging, to understand how the parser implementation interprets a document (not only HTML).
org.apache.nutch.parsefilter.naivebayes	Html Parse filter that classifies the outlinks from the parseresult as relevant or irrelevant based on the parseText's relevancy (using a training file where you can give positive and negative example texts see the description of parsefilter.naivebayes.trainfile) and if found irrelevent it gives the link a second chance if it contains any of the words from the list given in parsefilter.naivebayes.wordlist.
org.apache.nutch.parsefilter.regex	RegexParseFilter.
org.apache.nutch.plugin	The Nutch Plugin System.
org.apache.nutch.protocol	Classes related to the Protocol interface, see also org.apache.nutch.net.protocols.
org.apache.nutch.protocol.file	Protocol plugin which supports retrieving local file resources.
org.apache.nutch.protocol.ftp	Protocol plugin which supports retrieving documents via the ftp protocol.
org.apache.nutch.protocol.htmlunit	Protocol plugin which supports retrieving documents via HTTP/HTTPS using Selenium and the HtmlUnitDriver web driver for the for the HtmlUnit headless browser.
org.apache.nutch.protocol.http	Protocol plugin which supports retrieving documents via the http protocol.
org.apache.nutch.protocol.http.api	Common API used by HTTP plugins (http, httpclient, etc.)
org.apache.nutch.protocol.httpclient	Protocol plugin which supports retrieving documents via the HTTP andHTTPS protocols, optionally with Basic, Digest and NTLM authentication schemes for web server as well as proxy server.
org.apache.nutch.protocol.interactiveselenium	Protocol plugin which supports retrieving documents using and interacting with Selenium.
org.apache.nutch.protocol.okhttp	Protocol plugin for HTTP/HTTPS based on okhttp, supports HTTP 1.1 and/or http/2.
org.apache.nutch.protocol.selenium	Protocol plugin which supports retrieving documents via Selenium.
org.apache.nutch.publisher
org.apache.nutch.publisher.rabbitmq	Publisher package to implement queues
org.apache.nutch.scoring	The ScoringFilter interface.
org.apache.nutch.scoring.depth	Scoring filter to stop crawling at a configurable depth (number of "hops" from seed URLs).
org.apache.nutch.scoring.link	Scoring filter used in conjunction with WebGraph.
org.apache.nutch.scoring.metadata	Metadata Scoring Plugin
org.apache.nutch.scoring.opic	Scoring filter implementing a variant of the Online Page Importance Computation (OPIC) algorithm.
org.apache.nutch.scoring.orphan	Scoring filter to modify score or status of orphaned pages (no inlinks found for a configurable amount of time).
org.apache.nutch.scoring.similarity
org.apache.nutch.scoring.tld	Top Level Domain Scoring plugin.
org.apache.nutch.scoring.urlmeta	URL Meta Tag Scoring Plugin
org.apache.nutch.urlfilter.api	Generic URL filter library, abstracting away from regular expression implementations.
org.apache.nutch.urlfilter.automaton	URL filter plugin based on dk.brics.automaton Finite-State Automata for JavaTM.
org.apache.nutch.urlfilter.domain	URL filter plugin to include only URLs which match an element in a given list of domain suffixes, domain names, and/or host names.
org.apache.nutch.urlfilter.domaindenylist	URL filter plugin to exclude URLs by domain suffixes, domain names, and/or host names.
org.apache.nutch.urlfilter.fast	URL filter plugin that first does fast exact suffix matches on host/domain names before applying regular expressions to the path component of a URL.
org.apache.nutch.urlfilter.ignoreexempt	URL filter plugin which identifies exemptions to external urls when when external urls are set to ignore.
org.apache.nutch.urlfilter.prefix	URL filter plugin to include only URLs which match one of a given list of URL prefixes.
org.apache.nutch.urlfilter.regex	URL filter plugin to include and/or exclude URLs matching Java regular expressions.
org.apache.nutch.urlfilter.suffix	URL filter plugin to either exclude or include only URLs which match one of the given (path) suffixes.
org.apache.nutch.urlfilter.validator	URL filter plugin that validates given urls.
org.creativecommons.nutch	Sample plugins that parse and index Creative Commons metadata.

Classes in org.apache.nutch.plugin used by org.apache.nutch.analysis.lang

Class	Description
Pluggable	Defines the capability of a class to be plugged into Nutch.

Classes in org.apache.nutch.plugin used by org.apache.nutch.collection

Class	Description
Pluggable	Defines the capability of a class to be plugged into Nutch.

Classes in org.apache.nutch.plugin used by org.apache.nutch.exchange

Class	Description
Pluggable	Defines the capability of a class to be plugged into Nutch.

Classes in org.apache.nutch.plugin used by org.apache.nutch.exchange.jexl

Class	Description
Pluggable	Defines the capability of a class to be plugged into Nutch.

Classes in org.apache.nutch.plugin used by org.apache.nutch.indexer

Class	Description
Pluggable	Defines the capability of a class to be plugged into Nutch.

Classes in org.apache.nutch.plugin used by org.apache.nutch.indexer.anchor

Class	Description
Pluggable	Defines the capability of a class to be plugged into Nutch.

Classes in org.apache.nutch.plugin used by org.apache.nutch.indexer.arbitrary

Class	Description
Pluggable	Defines the capability of a class to be plugged into Nutch.

Classes in org.apache.nutch.plugin used by org.apache.nutch.indexer.basic

Class	Description
Pluggable	Defines the capability of a class to be plugged into Nutch.

Classes in org.apache.nutch.plugin used by org.apache.nutch.indexer.feed

Class	Description
Pluggable	Defines the capability of a class to be plugged into Nutch.

Classes in org.apache.nutch.plugin used by org.apache.nutch.indexer.filter

Class	Description
Pluggable	Defines the capability of a class to be plugged into Nutch.

Classes in org.apache.nutch.plugin used by org.apache.nutch.indexer.geoip

Class	Description
Pluggable	Defines the capability of a class to be plugged into Nutch.

Classes in org.apache.nutch.plugin used by org.apache.nutch.indexer.jexl

Class	Description
Pluggable	Defines the capability of a class to be plugged into Nutch.

Classes in org.apache.nutch.plugin used by org.apache.nutch.indexer.links

Class	Description
Pluggable	Defines the capability of a class to be plugged into Nutch.

Classes in org.apache.nutch.plugin used by org.apache.nutch.indexer.metadata

Class	Description
Pluggable	Defines the capability of a class to be plugged into Nutch.

Classes in org.apache.nutch.plugin used by org.apache.nutch.indexer.more

Class	Description
Pluggable	Defines the capability of a class to be plugged into Nutch.

Classes in org.apache.nutch.plugin used by org.apache.nutch.indexer.replace

Class	Description
Pluggable	Defines the capability of a class to be plugged into Nutch.

Classes in org.apache.nutch.plugin used by org.apache.nutch.indexer.staticfield

Class	Description
Pluggable	Defines the capability of a class to be plugged into Nutch.

Classes in org.apache.nutch.plugin used by org.apache.nutch.indexer.subcollection

Class	Description
Pluggable	Defines the capability of a class to be plugged into Nutch.

Classes in org.apache.nutch.plugin used by org.apache.nutch.indexer.tld

Class	Description
Pluggable	Defines the capability of a class to be plugged into Nutch.

Classes in org.apache.nutch.plugin used by org.apache.nutch.indexer.urlmeta

Class	Description
Pluggable	Defines the capability of a class to be plugged into Nutch.

Classes in org.apache.nutch.plugin used by org.apache.nutch.indexwriter.cloudsearch

Class	Description
Pluggable	Defines the capability of a class to be plugged into Nutch.

Classes in org.apache.nutch.plugin used by org.apache.nutch.indexwriter.csv

Class	Description
Pluggable	Defines the capability of a class to be plugged into Nutch.

Classes in org.apache.nutch.plugin used by org.apache.nutch.indexwriter.dummy

Class	Description
Pluggable	Defines the capability of a class to be plugged into Nutch.

Classes in org.apache.nutch.plugin used by org.apache.nutch.indexwriter.elastic

Class	Description
Pluggable	Defines the capability of a class to be plugged into Nutch.

Classes in org.apache.nutch.plugin used by org.apache.nutch.indexwriter.kafka

Class	Description
Pluggable	Defines the capability of a class to be plugged into Nutch.

Classes in org.apache.nutch.plugin used by org.apache.nutch.indexwriter.opensearch1x

Class	Description
Pluggable	Defines the capability of a class to be plugged into Nutch.

Classes in org.apache.nutch.plugin used by org.apache.nutch.indexwriter.rabbit

Class	Description
Pluggable	Defines the capability of a class to be plugged into Nutch.

Classes in org.apache.nutch.plugin used by org.apache.nutch.indexwriter.solr

Class	Description
Pluggable	Defines the capability of a class to be plugged into Nutch.

Classes in org.apache.nutch.plugin used by org.apache.nutch.microformats.reltag

Class	Description
Pluggable	Defines the capability of a class to be plugged into Nutch.

Classes in org.apache.nutch.plugin used by org.apache.nutch.net

Class	Description
Pluggable	Defines the capability of a class to be plugged into Nutch.

Classes in org.apache.nutch.plugin used by org.apache.nutch.parse

Class	Description
Extension	An Extension is a kind of listener descriptor that will be installed on a concrete ExtensionPoint that acts as kind of Publisher.
Pluggable	Defines the capability of a class to be plugged into Nutch.

Classes in org.apache.nutch.plugin used by org.apache.nutch.parse.ext

Class	Description
Pluggable	Defines the capability of a class to be plugged into Nutch.

Classes in org.apache.nutch.plugin used by org.apache.nutch.parse.feed

Class	Description
Pluggable	Defines the capability of a class to be plugged into Nutch.

Classes in org.apache.nutch.plugin used by org.apache.nutch.parse.headings

Class	Description
Pluggable	Defines the capability of a class to be plugged into Nutch.

Classes in org.apache.nutch.plugin used by org.apache.nutch.parse.html

Class	Description
Pluggable	Defines the capability of a class to be plugged into Nutch.

Classes in org.apache.nutch.plugin used by org.apache.nutch.parse.js

Class	Description
Pluggable	Defines the capability of a class to be plugged into Nutch.

Classes in org.apache.nutch.plugin used by org.apache.nutch.parse.metatags

Class	Description
Pluggable	Defines the capability of a class to be plugged into Nutch.

Classes in org.apache.nutch.plugin used by org.apache.nutch.parse.tika

Class	Description
Pluggable	Defines the capability of a class to be plugged into Nutch.

Classes in org.apache.nutch.plugin used by org.apache.nutch.parse.zip

Class	Description
Pluggable	Defines the capability of a class to be plugged into Nutch.

Classes in org.apache.nutch.plugin used by org.apache.nutch.parsefilter.debug

Class	Description
Pluggable	Defines the capability of a class to be plugged into Nutch.

Classes in org.apache.nutch.plugin used by org.apache.nutch.parsefilter.naivebayes

Class	Description
Pluggable	Defines the capability of a class to be plugged into Nutch.

Classes in org.apache.nutch.plugin used by org.apache.nutch.parsefilter.regex

Class	Description
Pluggable	Defines the capability of a class to be plugged into Nutch.

Classes in org.apache.nutch.plugin used by org.apache.nutch.plugin

Class	Description
Extension	An Extension is a kind of listener descriptor that will be installed on a concrete ExtensionPoint that acts as kind of Publisher.
ExtensionPoint	The ExtensionPoint provide meta information of a extension point.
Plugin	A nutch-plugin is an container for a set of custom logic that provide extensions to the nutch core functionality or another plugin that provides an API for extending.
PluginClassLoader	The PluginClassLoader is a child-first classloader that only contains classes of the runtime libraries setuped in the plugin manifest file and exported libraries of plugins that are required plugins.
PluginDescriptor	The PluginDescriptor provide access to all meta information of a nutch-plugin, as well to the internationalizable resources and the plugin own classloader.
PluginRepository	The plugin repository is a registry of all plugins.
PluginRuntimeException	PluginRuntimeException will be thrown until a exception in the plugin managemnt occurs.
URLStreamHandlerFactory	This URLStreamHandlerFactory knows about all the plugins in use and thus can create the correct URLStreamHandler even if it comes from a plugin classpath.

Classes in org.apache.nutch.plugin used by org.apache.nutch.protocol

Class	Description
Pluggable	Defines the capability of a class to be plugged into Nutch.
PluginRuntimeException	PluginRuntimeException will be thrown until a exception in the plugin managemnt occurs.

Classes in org.apache.nutch.plugin used by org.apache.nutch.protocol.file

Class	Description
Pluggable	Defines the capability of a class to be plugged into Nutch.

Classes in org.apache.nutch.plugin used by org.apache.nutch.protocol.ftp

Class	Description
Pluggable	Defines the capability of a class to be plugged into Nutch.

Classes in org.apache.nutch.plugin used by org.apache.nutch.protocol.htmlunit

Class	Description
Pluggable	Defines the capability of a class to be plugged into Nutch.

Classes in org.apache.nutch.plugin used by org.apache.nutch.protocol.http

Class	Description
Pluggable	Defines the capability of a class to be plugged into Nutch.

Classes in org.apache.nutch.plugin used by org.apache.nutch.protocol.http.api

Class	Description
Pluggable	Defines the capability of a class to be plugged into Nutch.

Classes in org.apache.nutch.plugin used by org.apache.nutch.protocol.httpclient

Class	Description
Pluggable	Defines the capability of a class to be plugged into Nutch.

Classes in org.apache.nutch.plugin used by org.apache.nutch.protocol.interactiveselenium

Class	Description
Pluggable	Defines the capability of a class to be plugged into Nutch.

Classes in org.apache.nutch.plugin used by org.apache.nutch.protocol.okhttp

Class	Description
Pluggable	Defines the capability of a class to be plugged into Nutch.

Classes in org.apache.nutch.plugin used by org.apache.nutch.protocol.selenium

Class	Description
Pluggable	Defines the capability of a class to be plugged into Nutch.

Classes in org.apache.nutch.plugin used by org.apache.nutch.publisher

Class	Description
Pluggable	Defines the capability of a class to be plugged into Nutch.

Classes in org.apache.nutch.plugin used by org.apache.nutch.publisher.rabbitmq

Class	Description
Pluggable	Defines the capability of a class to be plugged into Nutch.

Classes in org.apache.nutch.plugin used by org.apache.nutch.scoring

Class	Description
Pluggable	Defines the capability of a class to be plugged into Nutch.

Classes in org.apache.nutch.plugin used by org.apache.nutch.scoring.depth

Class	Description
Pluggable	Defines the capability of a class to be plugged into Nutch.

Classes in org.apache.nutch.plugin used by org.apache.nutch.scoring.link

Class	Description
Pluggable	Defines the capability of a class to be plugged into Nutch.

Classes in org.apache.nutch.plugin used by org.apache.nutch.scoring.metadata

Class	Description
Pluggable	Defines the capability of a class to be plugged into Nutch.

Classes in org.apache.nutch.plugin used by org.apache.nutch.scoring.opic

Class	Description
Pluggable	Defines the capability of a class to be plugged into Nutch.

Classes in org.apache.nutch.plugin used by org.apache.nutch.scoring.orphan

Class	Description
Pluggable	Defines the capability of a class to be plugged into Nutch.

Classes in org.apache.nutch.plugin used by org.apache.nutch.scoring.similarity

Class	Description
Pluggable	Defines the capability of a class to be plugged into Nutch.

Classes in org.apache.nutch.plugin used by org.apache.nutch.scoring.tld

Class	Description
Pluggable	Defines the capability of a class to be plugged into Nutch.

Classes in org.apache.nutch.plugin used by org.apache.nutch.scoring.urlmeta

Class	Description
Pluggable	Defines the capability of a class to be plugged into Nutch.

Classes in org.apache.nutch.plugin used by org.apache.nutch.urlfilter.api

Class	Description
Pluggable	Defines the capability of a class to be plugged into Nutch.

Classes in org.apache.nutch.plugin used by org.apache.nutch.urlfilter.automaton

Class	Description
Pluggable	Defines the capability of a class to be plugged into Nutch.

Classes in org.apache.nutch.plugin used by org.apache.nutch.urlfilter.domain

Class	Description
Pluggable	Defines the capability of a class to be plugged into Nutch.

Classes in org.apache.nutch.plugin used by org.apache.nutch.urlfilter.domaindenylist

Class	Description
Pluggable	Defines the capability of a class to be plugged into Nutch.

Classes in org.apache.nutch.plugin used by org.apache.nutch.urlfilter.fast

Class	Description
Pluggable	Defines the capability of a class to be plugged into Nutch.

Classes in org.apache.nutch.plugin used by org.apache.nutch.urlfilter.ignoreexempt

Class	Description
Pluggable	Defines the capability of a class to be plugged into Nutch.

Classes in org.apache.nutch.plugin used by org.apache.nutch.urlfilter.prefix

Class	Description
Pluggable	Defines the capability of a class to be plugged into Nutch.

Classes in org.apache.nutch.plugin used by org.apache.nutch.urlfilter.regex

Class	Description
Pluggable	Defines the capability of a class to be plugged into Nutch.

Classes in org.apache.nutch.plugin used by org.apache.nutch.urlfilter.suffix

Class	Description
Pluggable	Defines the capability of a class to be plugged into Nutch.

Classes in org.apache.nutch.plugin used by org.apache.nutch.urlfilter.validator

Class	Description
Pluggable	Defines the capability of a class to be plugged into Nutch.

Classes in org.apache.nutch.plugin used by org.creativecommons.nutch

Class	Description
Pluggable	Defines the capability of a class to be plugged into Nutch.