Package org.apache.nutch.any23

Class Any23IndexingFilter

java.lang.Object

org.apache.nutch.any23.Any23IndexingFilter

All Implemented Interfaces:

Configurable, IndexingFilter, Pluggable

public class Any23IndexingFilter
extends Object
implements IndexingFilter

This implementation of IndexingFilter adds a triple(s) field to the NutchDocument.

Triples are extracted via Apache Any23.

See Also:

Any23ParseFilter

Field Summary

Fields

Modifier and Type	Field	Description
static String	STRUCTURED_DATA

Fields inherited from interface org.apache.nutch.indexer.IndexingFilter

X_POINT_ID

Constructor Summary

Constructors

Constructor	Description
Any23IndexingFilter()

Method Summary

Modifier and Type	Method	Description
NutchDocument	filter(NutchDocument doc, Parse parse, Text url, CrawlDatum datum, Inlinks inlinks)	Adds fields or otherwise modifies the document that will be indexed for a parse.
Configuration	getConf()	Get the Configuration object
void	setConf(Configuration conf)	Set the Configuration object

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

STRUCTURED_DATA

public static final String STRUCTURED_DATA

See Also:

Constant Field Values

Constructor Detail

Any23IndexingFilter

public Any23IndexingFilter()

Method Detail

getConf

public Configuration getConf()

Get the Configuration object

Specified by:

getConf in interface Configurable

See Also:

Configurable.getConf()

setConf

public void setConf(Configuration conf)

Set the Configuration object

Specified by:

setConf in interface Configurable

See Also:

Configurable.setConf(org.apache.hadoop.conf.Configuration)

filter

public NutchDocument filter(NutchDocument doc,
                            Parse parse,
                            Text url,
                            CrawlDatum datum,
                            Inlinks inlinks)
                     throws IndexingException

Description copied from interface: IndexingFilter

Adds fields or otherwise modifies the document that will be indexed for a parse. Unwanted documents can be removed from indexing by returning a null value.

Specified by:

filter in interface IndexingFilter

Parameters:

doc - document instance for collecting fields

parse - parse data instance

url - page url

datum - crawl datum for the page (fetch datum from segment containing fetch status and fetch time)

inlinks - page inlinks

Returns:

filtered NutchDocument

Throws:

IndexingException - if there is a fatl error whilst indexing

See Also:

IndexingFilter.filter(NutchDocument, Parse, Text, CrawlDatum, Inlinks)