All Methods Instance Methods Concrete Methods
Modifier and Type	Method	Description
`DuplicateRemover`	`getDuplicateRemover()`
`protected boolean`	`noNeedToRemoveDuplicate(Request request)`
`void`	`push(Request request, Task task)`	add a url to fetch
`protected void`	`pushWhenNoDuplicate(Request request, Task task)`
`DuplicateRemovedScheduler`	`setDuplicateRemover(DuplicateRemover duplicatedRemover)`
`protected boolean`	`shouldReserved(Request request)`

Methods inherited from class java.lang.Object
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface us.codecraft.webmagic.scheduler.Scheduler
poll

Constructor Detail
- DuplicateRemovedScheduler
```
public DuplicateRemovedScheduler()
```

public DuplicateRemover getDuplicateRemover()

public DuplicateRemovedScheduler setDuplicateRemover(DuplicateRemover duplicatedRemover)

protected boolean shouldReserved(Request request)

protected boolean noNeedToRemoveDuplicate(Request request)

protected void pushWhenNoDuplicate(Request request,
                                   Task task)

Class DuplicateRemovedScheduler