Uses of Class
us.codecraft.webmagic.Page
-
Packages that use Page Package Description us.codecraft.webmagic Main class "Spider" and models.us.codecraft.webmagic.configurable us.codecraft.webmagic.downloader Downloader is the part that downloads web pages and store in Page object.us.codecraft.webmagic.downloader.selenium us.codecraft.webmagic.example us.codecraft.webmagic.handler us.codecraft.webmagic.model Page model and annotations used to customize a crawler.us.codecraft.webmagic.model.samples us.codecraft.webmagic.model.sources us.codecraft.webmagic.processor PageProcessor custom part of a crawler for specific site.us.codecraft.webmagic.processor.example us.codecraft.webmagic.proxy us.codecraft.webmagic.samples us.codecraft.webmagic.samples.scheduler us.codecraft.webmagic.scripts us.codecraft.webmagic.scripts.languages -
-
Uses of Page in us.codecraft.webmagic
Methods in us.codecraft.webmagic that return Page Modifier and Type Method Description static Page
Page. fail()
Deprecated.Usefail(Request)
instead.static Page
Page. fail(Request request)
Page
SimpleHttpClient. get(java.lang.String url)
Page
SimpleHttpClient. get(Request request)
Page
Page. setRawText(java.lang.String rawText)
Page
Page. setSkip(boolean skip)
Methods in us.codecraft.webmagic with parameters of type Page Modifier and Type Method Description protected void
Spider. extractAndAddRequests(Page page, boolean spawnUrl)
-
Uses of Page in us.codecraft.webmagic.configurable
Methods in us.codecraft.webmagic.configurable with parameters of type Page Modifier and Type Method Description void
ConfigurablePageProcessor. process(Page page)
-
Uses of Page in us.codecraft.webmagic.downloader
Methods in us.codecraft.webmagic.downloader that return Page Modifier and Type Method Description Page
Downloader. download(Request request, Task task)
Downloads web pages and store in Page object.Page
HttpClientDownloader. download(Request request, Task task)
Page
PhantomJSDownloader. download(Request request, Task task)
protected Page
HttpClientDownloader. handleResponse(Request request, java.lang.String charset, org.apache.http.HttpResponse httpResponse, Task task)
Methods in us.codecraft.webmagic.downloader with parameters of type Page Modifier and Type Method Description protected void
AbstractDownloader. onError(Page page, Task task, java.lang.Throwable e)
protected void
AbstractDownloader. onSuccess(Page page, Task task)
-
Uses of Page in us.codecraft.webmagic.downloader.selenium
Methods in us.codecraft.webmagic.downloader.selenium that return Page Modifier and Type Method Description Page
SeleniumDownloader. download(Request request, Task task)
-
Uses of Page in us.codecraft.webmagic.example
Methods in us.codecraft.webmagic.example with parameters of type Page Modifier and Type Method Description void
GithubRepoPageMapper. process(Page page)
-
Uses of Page in us.codecraft.webmagic.handler
Methods in us.codecraft.webmagic.handler with parameters of type Page Modifier and Type Method Description void
CompositePageProcessor. process(Page page)
RequestMatcher.MatchOther
SubPageProcessor. processPage(Page page)
process the page, extract urls to fetch, extract the data and store -
Uses of Page in us.codecraft.webmagic.model
Methods in us.codecraft.webmagic.model with parameters of type Page Modifier and Type Method Description void
AfterExtractor. afterProcess(Page page)
T
PageMapper. get(Page page)
java.util.List<T>
PageMapper. getAll(Page page)
-
Uses of Page in us.codecraft.webmagic.model.samples
Methods in us.codecraft.webmagic.model.samples with parameters of type Page Modifier and Type Method Description void
DianpingFtlDataScanner. afterProcess(Page page)
void
OschinaAnswer. afterProcess(Page page)
-
Uses of Page in us.codecraft.webmagic.model.sources
Methods in us.codecraft.webmagic.model.sources with parameters of type Page Modifier and Type Method Description java.lang.String
Source.DefaultSource. getText(Page page, java.lang.String html, boolean isRaw, FieldExtractor fieldExtractor)
java.lang.String
Source. getText(Page page, java.lang.String html, boolean isRaw, FieldExtractor fieldExtractor)
java.lang.String
Source.RawHtml. getText(Page page, java.lang.String html, boolean isRaw, FieldExtractor fieldExtractor)
java.lang.String
Source.RawText. getText(Page page, java.lang.String html, boolean isRaw, FieldExtractor fieldExtractor)
java.lang.String
Source.SelectedHtml. getText(Page page, java.lang.String html, boolean isRaw, FieldExtractor fieldExtractor)
java.lang.String
Source.Url. getText(Page page, java.lang.String html, boolean isRaw, FieldExtractor fieldExtractor)
static PageField
SourceTextExtractor. getText(Page page, java.lang.String html, boolean isRaw, FieldExtractor fieldExtractor)
java.util.List<java.lang.String>
Source.DefaultSource. getTextList(Page page, java.lang.String html, boolean isRaw, FieldExtractor fieldExtractor)
java.util.List<java.lang.String>
Source. getTextList(Page page, java.lang.String html, boolean isRaw, FieldExtractor fieldExtractor)
java.util.List<java.lang.String>
Source.RawHtml. getTextList(Page page, java.lang.String html, boolean isRaw, FieldExtractor fieldExtractor)
java.util.List<java.lang.String>
Source.RawText. getTextList(Page page, java.lang.String html, boolean isRaw, FieldExtractor fieldExtractor)
java.util.List<java.lang.String>
Source.SelectedHtml. getTextList(Page page, java.lang.String html, boolean isRaw, FieldExtractor fieldExtractor)
java.util.List<java.lang.String>
Source.Url. getTextList(Page page, java.lang.String html, boolean isRaw, FieldExtractor fieldExtractor)
-
Uses of Page in us.codecraft.webmagic.processor
Methods in us.codecraft.webmagic.processor with parameters of type Page Modifier and Type Method Description void
PageProcessor. process(Page page)
Processes the page, extract URLs to fetch, extract the data and store.void
SimplePageProcessor. process(Page page)
-
Uses of Page in us.codecraft.webmagic.processor.example
Methods in us.codecraft.webmagic.processor.example with parameters of type Page Modifier and Type Method Description void
BaiduBaikePageProcessor. process(Page page)
void
GithubRepoPageProcessor. process(Page page)
void
ZhihuPageProcessor. process(Page page)
-
Uses of Page in us.codecraft.webmagic.proxy
Methods in us.codecraft.webmagic.proxy with parameters of type Page Modifier and Type Method Description void
ProxyProvider. returnProxy(Proxy proxy, Page page, Task task)
Return proxy to Provider when complete a download.void
SimpleProxyProvider. returnProxy(Proxy proxy, Page page, Task task)
-
Uses of Page in us.codecraft.webmagic.samples
Methods in us.codecraft.webmagic.samples with parameters of type Page Modifier and Type Method Description void
AlexanderMcqueenGoodsProcessor. process(Page page)
void
AmanzonPageProcessor. process(Page page)
void
AngularJSProcessor. process(Page page)
void
DiandianBlogProcessor. process(Page page)
void
DiaoyuwengProcessor. process(Page page)
void
F58PageProcesser. process(Page page)
void
GithubRepoPageProcessor. process(Page page)
void
HuxiuProcessor. process(Page page)
void
InfoQMiniBookProcessor. process(Page page)
void
IteyeBlogProcessor. process(Page page)
void
KaichibaProcessor. process(Page page)
void
MamacnPageProcessor. process(Page page)
void
MeicanProcessor. process(Page page)
void
NjuBBSProcessor. process(Page page)
void
PhantomJSPageProcessor. process(Page page)
void
QzoneBlogProcessor. process(Page page)
void
SinaBlogProcessor. process(Page page)
void
TianyaPageProcesser. process(Page page)
void
ZhihuPageProcessor. process(Page page)
-
Uses of Page in us.codecraft.webmagic.samples.scheduler
Methods in us.codecraft.webmagic.samples.scheduler with parameters of type Page Modifier and Type Method Description void
ZipCodePageProcessor. process(Page page)
-
Uses of Page in us.codecraft.webmagic.scripts
Methods in us.codecraft.webmagic.scripts with parameters of type Page Modifier and Type Method Description void
ScriptProcessor. process(Page page)
-
Uses of Page in us.codecraft.webmagic.scripts.languages
Methods in us.codecraft.webmagic.scripts.languages with parameters of type Page Modifier and Type Method Description void
Javascript. process(javax.script.ScriptEngine engine, java.lang.String defines, java.lang.String script, Page page)
void
JRuby. process(javax.script.ScriptEngine engine, java.lang.String defines, java.lang.String script, Page page)
void
Jython. process(javax.script.ScriptEngine engine, java.lang.String defines, java.lang.String script, Page page)
abstract void
Language. process(javax.script.ScriptEngine engine, java.lang.String defines, java.lang.String script, Page page)
-