Uses of Interface
us.codecraft.webmagic.pipeline.Pipeline
Packages that use Pipeline
Package
Description
Main class "Spider" and models.
Pipeline is the persistent and offline process part of crawler.
-
Uses of Pipeline in us.codecraft.webmagic
Fields in us.codecraft.webmagic with type parameters of type PipelineMethods in us.codecraft.webmagic with parameters of type PipelineModifier and TypeMethodDescriptionSpider.addPipeline
(Pipeline pipeline) add a pipeline for SpiderDeprecated.Method parameters in us.codecraft.webmagic with type arguments of type PipelineModifier and TypeMethodDescriptionSpider.setPipelines
(List<Pipeline> pipelines) set pipelines for Spider -
Uses of Pipeline in us.codecraft.webmagic.handler
Classes in us.codecraft.webmagic.handler that implement Pipeline -
Uses of Pipeline in us.codecraft.webmagic.pipeline
Subinterfaces of Pipeline in us.codecraft.webmagic.pipelineModifier and TypeInterfaceDescriptioninterface
Pipeline that can collect and store results.Classes in us.codecraft.webmagic.pipeline that implement PipelineModifier and TypeClassDescriptionclass
Write results in console.
Usually used in test.class
Store results in files.class
Store results to files in JSON format.class
A pipeline combines the result in more than one page together.
Used for news and articles containing more than one web page.class
-
Uses of Pipeline in us.codecraft.webmagic.samples.pipeline
Classes in us.codecraft.webmagic.samples.pipeline that implement Pipeline