Uses of Class
us.codecraft.webmagic.Page

Packages that use Page

Package	Description
us.codecraft.webmagic	Main class "Spider" and models.
us.codecraft.webmagic.configurable
us.codecraft.webmagic.downloader	Downloader is the part that downloads web pages and store in Page object.
us.codecraft.webmagic.downloader.selenium
us.codecraft.webmagic.example
us.codecraft.webmagic.handler
us.codecraft.webmagic.model	Page model and annotations used to customize a crawler.
us.codecraft.webmagic.model.samples
us.codecraft.webmagic.model.sources
us.codecraft.webmagic.processor	PageProcessor custom part of a crawler for specific site.
us.codecraft.webmagic.processor.example
us.codecraft.webmagic.proxy
us.codecraft.webmagic.samples
us.codecraft.webmagic.samples.scheduler
us.codecraft.webmagic.scripts
us.codecraft.webmagic.scripts.languages

Uses of Page in us.codecraft.webmagic

Methods in us.codecraft.webmagic that return Page

Modifier and Type	Method	Description
static Page	Page.fail()	Deprecated. Use fail(Request) instead.
static Page	Page.fail(Request request)	Deprecated, for removal: This API element is subject to removal in a future version. Use ofFailure(Request) instead.
Page	SimpleHttpClient.get(String url)
Page	SimpleHttpClient.get(Request request)
static Page	Page.ofFailure(Request request)	Returns a Page with downloadSuccess is true, and request is specified.
static Page	Page.ofSuccess(Request request)	Returns a Page with downloadSuccess is true, and request is specified.
Page	Page.setRawText(String rawText)
Page	Page.setSkip(boolean skip)

Methods in us.codecraft.webmagic with parameters of type Page

Modifier and Type	Method	Description
protected void	Spider.extractAndAddRequests(Page page, boolean spawnUrl)

Uses of Page in us.codecraft.webmagic.configurable

Methods in us.codecraft.webmagic.configurable with parameters of type Page

Modifier and Type	Method	Description
void	ConfigurablePageProcessor.process(Page page)

Uses of Page in us.codecraft.webmagic.downloader

Methods in us.codecraft.webmagic.downloader that return Page

Modifier and Type	Method	Description
Page	Downloader.download(Request request, Task task)	Downloads web pages and store in Page object.
Page	HttpClientDownloader.download(Request request, Task task)
Page	PhantomJSDownloader.download(Request request, Task task)
protected Page	HttpClientDownloader.handleResponse(Request request, String charset, org.apache.http.HttpResponse httpResponse, Task task)

Methods in us.codecraft.webmagic.downloader with parameters of type Page

Modifier and Type	Method	Description
protected void	AbstractDownloader.onError(Page page, Task task, Throwable e)
protected void	AbstractDownloader.onSuccess(Page page, Task task)

Uses of Page in us.codecraft.webmagic.downloader.selenium

Methods in us.codecraft.webmagic.downloader.selenium that return Page

Modifier and Type	Method	Description
Page	SeleniumDownloader.download(Request request, Task task)

Uses of Page in us.codecraft.webmagic.example

Methods in us.codecraft.webmagic.example with parameters of type Page

Modifier and Type	Method	Description
void	GithubRepoPageMapper.process(Page page)

Uses of Page in us.codecraft.webmagic.handler

Methods in us.codecraft.webmagic.handler with parameters of type Page

Modifier and Type	Method	Description
void	CompositePageProcessor.process(Page page)
RequestMatcher.MatchOther	SubPageProcessor.processPage(Page page)	process the page, extract urls to fetch, extract the data and store

Uses of Page in us.codecraft.webmagic.model

Methods in us.codecraft.webmagic.model with parameters of type Page

Modifier and Type	Method	Description
void	AfterExtractor.afterProcess(Page page)
T	PageMapper.get(Page page)
List<T>	PageMapper.getAll(Page page)

Uses of Page in us.codecraft.webmagic.model.samples

Methods in us.codecraft.webmagic.model.samples with parameters of type Page

Modifier and Type	Method	Description
void	DianpingFtlDataScanner.afterProcess(Page page)
void	OschinaAnswer.afterProcess(Page page)

Uses of Page in us.codecraft.webmagic.model.sources

Methods in us.codecraft.webmagic.model.sources with parameters of type Page

Modifier and Type	Method	Description
String	Source.DefaultSource.getText(Page page, String html, boolean isRaw, FieldExtractor fieldExtractor)
String	Source.getText(Page page, String html, boolean isRaw, FieldExtractor fieldExtractor)
String	Source.RawHtml.getText(Page page, String html, boolean isRaw, FieldExtractor fieldExtractor)
String	Source.RawText.getText(Page page, String html, boolean isRaw, FieldExtractor fieldExtractor)
String	Source.SelectedHtml.getText(Page page, String html, boolean isRaw, FieldExtractor fieldExtractor)
String	Source.Url.getText(Page page, String html, boolean isRaw, FieldExtractor fieldExtractor)
static PageField	SourceTextExtractor.getText(Page page, String html, boolean isRaw, FieldExtractor fieldExtractor)
List<String>	Source.DefaultSource.getTextList(Page page, String html, boolean isRaw, FieldExtractor fieldExtractor)
List<String>	Source.getTextList(Page page, String html, boolean isRaw, FieldExtractor fieldExtractor)
List<String>	Source.RawHtml.getTextList(Page page, String html, boolean isRaw, FieldExtractor fieldExtractor)
List<String>	Source.RawText.getTextList(Page page, String html, boolean isRaw, FieldExtractor fieldExtractor)
List<String>	Source.SelectedHtml.getTextList(Page page, String html, boolean isRaw, FieldExtractor fieldExtractor)
List<String>	Source.Url.getTextList(Page page, String html, boolean isRaw, FieldExtractor fieldExtractor)

Uses of Page in us.codecraft.webmagic.processor

Methods in us.codecraft.webmagic.processor with parameters of type Page

Modifier and Type	Method	Description
void	PageProcessor.process(Page page)	Processes the page, extract URLs to fetch, extract the data and store.
void	SimplePageProcessor.process(Page page)

Uses of Page in us.codecraft.webmagic.processor.example

Methods in us.codecraft.webmagic.processor.example with parameters of type Page

Modifier and Type	Method	Description
void	BaiduBaikePageProcessor.process(Page page)
void	GithubRepoPageProcessor.process(Page page)
void	ZhihuPageProcessor.process(Page page)

Uses of Page in us.codecraft.webmagic.proxy

Methods in us.codecraft.webmagic.proxy with parameters of type Page

Modifier and Type	Method	Description
void	ProxyProvider.returnProxy(Proxy proxy, Page page, Task task)	Return proxy to Provider when complete a download.
void	SimpleProxyProvider.returnProxy(Proxy proxy, Page page, Task task)

Uses of Page in us.codecraft.webmagic.samples

Methods in us.codecraft.webmagic.samples with parameters of type Page

Modifier and Type	Method	Description
void	AlexanderMcqueenGoodsProcessor.process(Page page)
void	AmanzonPageProcessor.process(Page page)
void	AngularJSProcessor.process(Page page)
void	DiandianBlogProcessor.process(Page page)
void	DiaoyuwengProcessor.process(Page page)
void	F58PageProcesser.process(Page page)
void	GithubRepoPageProcessor.process(Page page)
void	HuxiuProcessor.process(Page page)
void	InfoQMiniBookProcessor.process(Page page)
void	IteyeBlogProcessor.process(Page page)
void	KaichibaProcessor.process(Page page)
void	MamacnPageProcessor.process(Page page)
void	MeicanProcessor.process(Page page)
void	NjuBBSProcessor.process(Page page)
void	PhantomJSPageProcessor.process(Page page)
void	QzoneBlogProcessor.process(Page page)
void	SinaBlogProcessor.process(Page page)
void	TianyaPageProcesser.process(Page page)
void	ZhihuPageProcessor.process(Page page)

Uses of Page in us.codecraft.webmagic.samples.scheduler

Methods in us.codecraft.webmagic.samples.scheduler with parameters of type Page

Modifier and Type	Method	Description
void	ZipCodePageProcessor.process(Page page)

Uses of Page in us.codecraft.webmagic.scripts

Methods in us.codecraft.webmagic.scripts with parameters of type Page

Modifier and Type	Method	Description
void	ScriptProcessor.process(Page page)

Uses of Page in us.codecraft.webmagic.scripts.languages

Methods in us.codecraft.webmagic.scripts.languages with parameters of type Page

Modifier and Type	Method	Description
void	Javascript.process(ScriptEngine engine, String defines, String script, Page page)
void	JRuby.process(ScriptEngine engine, String defines, String script, Page page)
void	Jython.process(ScriptEngine engine, String defines, String script, Page page)
abstract void	Language.process(ScriptEngine engine, String defines, String script, Page page)