Uses of Interface
us.codecraft.webmagic.pipeline.PageModelPipeline
-
Packages that use PageModelPipeline Package Description us.codecraft.webmagic.model Page model and annotations used to customize a crawler.us.codecraft.webmagic.pipeline Pipeline is the persistent and offline process part of crawler. -
-
Uses of PageModelPipeline in us.codecraft.webmagic.model
Classes in us.codecraft.webmagic.model that implement PageModelPipeline Modifier and Type Class Description class
ConsolePageModelPipeline
Print page model in console.
Usually used in test.Methods in us.codecraft.webmagic.model with parameters of type PageModelPipeline Modifier and Type Method Description OOSpider
OOSpider. addPageModel(PageModelPipeline pageModelPipeline, java.lang.Class... pageModels)
static OOSpider
OOSpider. create(Site site, PageModelPipeline pageModelPipeline, java.lang.Class... pageModels)
Constructors in us.codecraft.webmagic.model with parameters of type PageModelPipeline Constructor Description OOSpider(Site site, PageModelPipeline pageModelPipeline, java.lang.Class... pageModels)
create a spider -
Uses of PageModelPipeline in us.codecraft.webmagic.pipeline
Classes in us.codecraft.webmagic.pipeline that implement PageModelPipeline Modifier and Type Class Description class
CollectorPageModelPipeline<T>
class
FilePageModelPipeline
Store results objects (page models) to files in plain format.
Use model.getKey() as file name if the model implements HasKey.
Otherwise use SHA1 as file name.class
JsonFilePageModelPipeline
Store results objects (page models) to files in JSON format.
Use model.getKey() as file name if the model implements HasKey.
Otherwise use SHA1 as file name.
-