Package us.codecraft.webmagic.pipeline
Class FilePageModelPipeline
- java.lang.Object
-
- us.codecraft.webmagic.utils.FilePersistentBase
-
- us.codecraft.webmagic.pipeline.FilePageModelPipeline
-
- All Implemented Interfaces:
PageModelPipeline
public class FilePageModelPipeline extends FilePersistentBase implements PageModelPipeline
Store results objects (page models) to files in plain format.
Use model.getKey() as file name if the model implements HasKey.
Otherwise use SHA1 as file name.- Since:
- 0.3.0
- Author:
- code4crafter@gmail.com
-
-
Field Summary
-
Fields inherited from class us.codecraft.webmagic.utils.FilePersistentBase
path, PATH_SEPERATOR
-
-
Constructor Summary
Constructors Constructor Description FilePageModelPipeline()
new JsonFilePageModelPipeline with default path "/data/webmagic/"FilePageModelPipeline(java.lang.String path)
-
Method Summary
All Methods Instance Methods Concrete Methods Modifier and Type Method Description void
process(java.lang.Object o, Task task)
-
Methods inherited from class us.codecraft.webmagic.utils.FilePersistentBase
checkAndMakeParentDirecotry, getFile, getPath, setPath
-
-
-
-
Method Detail
-
process
public void process(java.lang.Object o, Task task)
- Specified by:
process
in interfacePageModelPipeline
-
-