Uses of Interface
us.codecraft.webmagic.scheduler.Scheduler
-
Packages that use Scheduler Package Description us.codecraft.webmagic Main class "Spider" and models.us.codecraft.webmagic.recover us.codecraft.webmagic.samples.scheduler us.codecraft.webmagic.scheduler Scheduler is the part of url management. -
-
Uses of Scheduler in us.codecraft.webmagic
Methods in us.codecraft.webmagic that return Scheduler Modifier and Type Method Description Scheduler
Spider. getScheduler()
Scheduler
SpiderScheduler. getScheduler()
Methods in us.codecraft.webmagic with parameters of type Scheduler Modifier and Type Method Description Spider
Spider. scheduler(Scheduler scheduler)
Deprecated.Spider
Spider. setScheduler(Scheduler updateScheduler)
set scheduler for Spidervoid
SpiderScheduler. setScheduler(Scheduler scheduler)
Constructors in us.codecraft.webmagic with parameters of type Scheduler Constructor Description SpiderScheduler(Scheduler scheduler)
-
Uses of Scheduler in us.codecraft.webmagic.recover
Classes in us.codecraft.webmagic.recover that implement Scheduler Modifier and Type Class Description class
MmapQueueScheduler
-
Uses of Scheduler in us.codecraft.webmagic.samples.scheduler
Classes in us.codecraft.webmagic.samples.scheduler that implement Scheduler Modifier and Type Class Description class
DelayQueueScheduler
class
LevelLimitScheduler
-
Uses of Scheduler in us.codecraft.webmagic.scheduler
Subinterfaces of Scheduler in us.codecraft.webmagic.scheduler Modifier and Type Interface Description interface
MonitorableScheduler
The scheduler whose requests can be counted for monitor.Classes in us.codecraft.webmagic.scheduler that implement Scheduler Modifier and Type Class Description class
DuplicateRemovedScheduler
Remove duplicate urls and only push urls which are not duplicate.class
FileCacheQueueScheduler
Store urls and cursor in files so that a Spider can resume the status when shutdown.class
PriorityScheduler
Priority scheduler.class
QueueScheduler
Basic Scheduler implementation.
Store urls to fetch in LinkedBlockingQueue and remove duplicate urls by HashMap.class
RedisPriorityScheduler
the redis scheduler with priorityclass
RedisScheduler
Use Redis as url scheduler for distributed crawlers.
-