Package us.codecraft.webmagic.scheduler
Interface Scheduler
-
- All Known Subinterfaces:
MonitorableScheduler
- All Known Implementing Classes:
DelayQueueScheduler
,DuplicateRemovedScheduler
,FileCacheQueueScheduler
,LevelLimitScheduler
,MmapQueueScheduler
,PriorityScheduler
,QueueScheduler
,RedisPriorityScheduler
,RedisScheduler
public interface Scheduler
Scheduler is the part of url management.
You can implement interface Scheduler to do: manage urls to fetch remove duplicate urls- Since:
- 0.1.0
- Author:
- code4crafter@gmail.com
-
-
Method Summary
All Methods Instance Methods Abstract Methods Modifier and Type Method Description Request
poll(Task task)
get an url to crawlvoid
push(Request request, Task task)
add a url to fetch
-