Package us.codecraft.webmagic.pipeline

Class JsonFilePipeline

java.lang.Object

us.codecraft.webmagic.utils.FilePersistentBase

us.codecraft.webmagic.pipeline.JsonFilePipeline

All Implemented Interfaces:

Pipeline

public class JsonFilePipeline
extends FilePersistentBase
implements Pipeline

Store results to files in JSON format.

Since:

0.2.0

Author:

code4crafter@gmail.com

Field Summary

Fields inherited from class us.codecraft.webmagic.utils.FilePersistentBase

path, PATH_SEPERATOR

Constructor Summary

Constructors

Constructor	Description
JsonFilePipeline()	new JsonFilePageModelPipeline with default path "/data/webmagic/"
JsonFilePipeline(String path)

Method Summary

Modifier and Type	Method	Description
void	process(ResultItems resultItems, Task task)	Process extracted results.

Methods inherited from class us.codecraft.webmagic.utils.FilePersistentBase

checkAndMakeParentDirecotry, getFile, getPath, setPath

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Details

JsonFilePipeline

public JsonFilePipeline()

new JsonFilePageModelPipeline with default path "/data/webmagic/"

JsonFilePipeline

public JsonFilePipeline(String path)

Method Details

process

public void process(ResultItems resultItems,
 Task task)

Description copied from interface: Pipeline

Process extracted results.

Specified by:

process in interface Pipeline

Parameters:

resultItems - resultItems

task - task