Uses of Interface
us.codecraft.webmagic.downloader.Downloader
-
Packages that use Downloader Package Description us.codecraft.webmagic Main class "Spider" and models.us.codecraft.webmagic.downloader Downloader is the part that downloads web pages and store in Page object.us.codecraft.webmagic.downloader.selenium -
-
Uses of Downloader in us.codecraft.webmagic
Fields in us.codecraft.webmagic declared as Downloader Modifier and Type Field Description protected Downloader
Spider. downloader
Methods in us.codecraft.webmagic that return Downloader Modifier and Type Method Description Downloader
Request. getDownloader()
Methods in us.codecraft.webmagic with parameters of type Downloader Modifier and Type Method Description Spider
Spider. downloader(Downloader downloader)
Deprecated.void
Request. setDownloader(Downloader downloader)
Spider
Spider. setDownloader(Downloader downloader)
set the downloader of spider -
Uses of Downloader in us.codecraft.webmagic.downloader
Classes in us.codecraft.webmagic.downloader that implement Downloader Modifier and Type Class Description class
AbstractDownloader
Base class of downloader with some common methods.class
HttpClientDownloader
The http downloader based on HttpClient.class
PhantomJSDownloader
this downloader is used to download pages which need to render the javascript -
Uses of Downloader in us.codecraft.webmagic.downloader.selenium
Classes in us.codecraft.webmagic.downloader.selenium that implement Downloader Modifier and Type Class Description class
SeleniumDownloader
使用Selenium调用浏览器进行渲染。目前仅支持chrome。
需要下载Selenium driver支持。
-