Package us.codecraft.webmagic.pipeline

Class MultiPagePipeline

java.lang.Object
us.codecraft.webmagic.pipeline.MultiPagePipeline
All Implemented Interfaces:
us.codecraft.webmagic.pipeline.Pipeline
public class MultiPagePipeline extends Object implements us.codecraft.webmagic.pipeline.Pipeline
A pipeline combines the result in more than one page together.
Used for news and articles containing more than one web page.
MultiPagePipeline will store parts of object and output them when all parts are extracted.
Since:
0.2.0
Author:
code4crafter@gmail.com

  • Constructor Details

    • MultiPagePipeline

      public MultiPagePipeline()

  • Method Details

    • process

      public void process(us.codecraft.webmagic.ResultItems resultItems, us.codecraft.webmagic.Task task)
      Specified by:
      process in interface us.codecraft.webmagic.pipeline.Pipeline