Package us.codecraft.webmagic.scheduler
Class PriorityScheduler
- java.lang.Object
-
- us.codecraft.webmagic.scheduler.DuplicateRemovedScheduler
-
- us.codecraft.webmagic.scheduler.PriorityScheduler
-
- All Implemented Interfaces:
MonitorableScheduler
,Scheduler
- Direct Known Subclasses:
DelayQueueScheduler
,LevelLimitScheduler
public class PriorityScheduler extends DuplicateRemovedScheduler implements MonitorableScheduler
Priority scheduler. Request with higher priority will poll earlier.- Since:
- 0.2.1
- Author:
- code4crafter@gmail.com
-
-
Field Summary
Fields Modifier and Type Field Description static int
INITIAL_CAPACITY
-
Fields inherited from class us.codecraft.webmagic.scheduler.DuplicateRemovedScheduler
logger
-
-
Constructor Summary
Constructors Constructor Description PriorityScheduler()
-
Method Summary
All Methods Instance Methods Concrete Methods Modifier and Type Method Description int
getLeftRequestsCount(Task task)
int
getTotalRequestsCount(Task task)
Request
poll(Task task)
get an url to crawlvoid
pushWhenNoDuplicate(Request request, Task task)
-
Methods inherited from class us.codecraft.webmagic.scheduler.DuplicateRemovedScheduler
getDuplicateRemover, noNeedToRemoveDuplicate, push, setDuplicateRemover, shouldReserved
-
-
-
-
Field Detail
-
INITIAL_CAPACITY
public static final int INITIAL_CAPACITY
- See Also:
- Constant Field Values
-
-
Method Detail
-
pushWhenNoDuplicate
public void pushWhenNoDuplicate(Request request, Task task)
- Overrides:
pushWhenNoDuplicate
in classDuplicateRemovedScheduler
-
poll
public Request poll(Task task)
Description copied from interface:Scheduler
get an url to crawl
-
getLeftRequestsCount
public int getLeftRequestsCount(Task task)
- Specified by:
getLeftRequestsCount
in interfaceMonitorableScheduler
-
getTotalRequestsCount
public int getTotalRequestsCount(Task task)
- Specified by:
getTotalRequestsCount
in interfaceMonitorableScheduler
-
-