Package us.codecraft.webmagic.pipeline

Class FilePageModelPipeline

java.lang.Object

us.codecraft.webmagic.utils.FilePersistentBase

us.codecraft.webmagic.pipeline.FilePageModelPipeline

All Implemented Interfaces:

PageModelPipeline

public class FilePageModelPipeline
extends FilePersistentBase
implements PageModelPipeline

Store results objects (page models) to files in plain format.
Use model.getKey() as file name if the model implements HasKey.
Otherwise use SHA1 as file name.

Since:

0.3.0

Author:

code4crafter@gmail.com

Field Summary

Fields inherited from class us.codecraft.webmagic.utils.FilePersistentBase

path, PATH_SEPERATOR

Constructor Summary

Constructors

Constructor	Description
FilePageModelPipeline()	new JsonFilePageModelPipeline with default path "/data/webmagic/"
FilePageModelPipeline(String path)

Method Summary

Modifier and Type	Method	Description
void	process(Object o, Task task)

Methods inherited from class us.codecraft.webmagic.utils.FilePersistentBase

checkAndMakeParentDirecotry, getFile, getPath, setPath

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Details

FilePageModelPipeline

public FilePageModelPipeline()

new JsonFilePageModelPipeline with default path "/data/webmagic/"

FilePageModelPipeline

public FilePageModelPipeline(String path)

Method Details

process

public void process(Object o,
 Task task)

Specified by:

process in interface PageModelPipeline