Uses of Interface
us.codecraft.webmagic.scheduler.component.DuplicateRemover

Packages that use DuplicateRemover

Package	Description
us.codecraft.webmagic.recover
us.codecraft.webmagic.scheduler	Scheduler is the part of url management.
us.codecraft.webmagic.scheduler.component	Component of scheduler.

Uses of DuplicateRemover in us.codecraft.webmagic.recover

Classes in us.codecraft.webmagic.recover that implement DuplicateRemover

Modifier and Type	Class	Description
class	DuplicateStorageRemover

Constructors in us.codecraft.webmagic.recover with parameters of type DuplicateRemover

Constructor	Description
MmapQueueScheduler(DuplicateRemover duplicateRemover, java.lang.String path)

Uses of DuplicateRemover in us.codecraft.webmagic.scheduler

Classes in us.codecraft.webmagic.scheduler that implement DuplicateRemover

Modifier and Type	Class	Description
class	BloomFilterDuplicateRemover	BloomFilterDuplicateRemover for huge number of urls.
class	RedisPriorityScheduler	the redis scheduler with priority
class	RedisScheduler	Use Redis as url scheduler for distributed crawlers.

Methods in us.codecraft.webmagic.scheduler that return DuplicateRemover

Modifier and Type	Method	Description
DuplicateRemover	DuplicateRemovedScheduler.getDuplicateRemover()

Methods in us.codecraft.webmagic.scheduler with parameters of type DuplicateRemover

Modifier and Type	Method	Description
DuplicateRemovedScheduler	DuplicateRemovedScheduler.setDuplicateRemover(DuplicateRemover duplicatedRemover)

Uses of DuplicateRemover in us.codecraft.webmagic.scheduler.component

Classes in us.codecraft.webmagic.scheduler.component that implement DuplicateRemover

Modifier and Type	Class	Description
class	HashSetDuplicateRemover