Package us.codecraft.webmagic.recover

Class MmapQueueScheduler

  • All Implemented Interfaces:
    us.codecraft.webmagic.scheduler.Scheduler
    public class MmapQueueScheduler
extends us.codecraft.webmagic.scheduler.DuplicateRemovedScheduler
    Author:
    ：linweisen

    • Field Summary

      • Fields inherited from class us.codecraft.webmagic.scheduler.DuplicateRemovedScheduler

        logger

    • Constructor Summary

      Constructors 
      Constructor Description
      MmapQueueScheduler​(us.codecraft.webmagic.scheduler.component.DuplicateRemover duplicateRemover, java.lang.String path)  

    • Method Summary

      All Methods Instance Methods Concrete Methods 
      Modifier and Type Method Description
      <T> T fromJson​(java.lang.String jsonString, java.lang.Class<T> clazz)  
      us.codecraft.webmagic.Request poll​(us.codecraft.webmagic.Task task)  
      void pushWhenNoDuplicate​(us.codecraft.webmagic.Request request, us.codecraft.webmagic.Task task)  
      java.lang.String toJson​(java.lang.Object object)  

      • Methods inherited from class us.codecraft.webmagic.scheduler.DuplicateRemovedScheduler

        getDuplicateRemover, noNeedToRemoveDuplicate, push, setDuplicateRemover, shouldReserved

      • Methods inherited from class java.lang.Object

        clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

    • Constructor Detail

      • MmapQueueScheduler

        public MmapQueueScheduler​(us.codecraft.webmagic.scheduler.component.DuplicateRemover duplicateRemover,
                          java.lang.String path)

    • Method Detail

      • poll

        public us.codecraft.webmagic.Request poll​(us.codecraft.webmagic.Task task)

      • pushWhenNoDuplicate

        public void pushWhenNoDuplicate​(us.codecraft.webmagic.Request request,
                                us.codecraft.webmagic.Task task)
        Overrides:
        pushWhenNoDuplicate in class us.codecraft.webmagic.scheduler.DuplicateRemovedScheduler

      • toJson

        public java.lang.String toJson​(java.lang.Object object)

      • fromJson

        public <T> T fromJson​(java.lang.String jsonString,
                      java.lang.Class<T> clazz)