Package us.codecraft.webmagic.downloader

Class AbstractDownloader

java.lang.Object

us.codecraft.webmagic.downloader.AbstractDownloader

All Implemented Interfaces:

Downloader

Direct Known Subclasses:

HttpClientDownloader

public abstract class AbstractDownloader
extends java.lang.Object
implements Downloader

Base class of downloader with some common methods.

Since:

0.5.0

Author:

code4crafter@gmail.com

Constructor Summary

Constructors

Constructor	Description
AbstractDownloader()

Method Summary

Modifier and Type	Method	Description
Html	download(java.lang.String url)	A simple method to download a url.
Html	download(java.lang.String url, java.lang.String charset)	A simple method to download a url.
protected void	onError(Page page, Task task, java.lang.Throwable e)
protected void	onError(Request request)	Deprecated. Use onError(Page, Task, Throwable) instead.
protected void	onError(Request request, Task task, java.lang.Throwable e)	Deprecated. Use onError(Page, Task, Throwable) instead.
protected void	onSuccess(Page page, Task task)
protected void	onSuccess(Request request)	Deprecated. Use onSuccess(Page, Task) instead.
protected void	onSuccess(Request request, Task task)	Deprecated. Use onSuccess(Page, Task) instead.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface us.codecraft.webmagic.downloader.Downloader

download, setThread

Constructor Detail

AbstractDownloader

public AbstractDownloader()

Method Detail

download

public Html download(java.lang.String url)

A simple method to download a url.

Parameters:

url - url

Returns:

html

download

public Html download(java.lang.String url,
                     java.lang.String charset)

A simple method to download a url.

Parameters:

url - url

charset - charset

Returns:

html

onSuccess

@Deprecated
protected void onSuccess(Request request)

Deprecated.

Use onSuccess(Page, Task) instead.

Parameters:

request - the Request.

onSuccess

@Deprecated
protected void onSuccess(Request request,
                         Task task)

Deprecated.

Use onSuccess(Page, Task) instead.

Parameters:

request - the Request.

task - the Task.

Since:

0.7.6

onSuccess

protected void onSuccess(Page page,
                         Task task)

Parameters:

page - the Page.

task - the Task.

Since:

0.10.0

onError

@Deprecated
protected void onError(Request request)

Deprecated.

Use onError(Page, Task, Throwable) instead.

Parameters:

request - the Request.

onError

@Deprecated
protected void onError(Request request,
                       Task task,
                       java.lang.Throwable e)

Deprecated.

Use onError(Page, Task, Throwable) instead.

Parameters:

request - the Request.

task - the Task.

e - the exception.

Since:

0.7.6

onError

protected void onError(Page page,
                       Task task,
                       java.lang.Throwable e)

Parameters:

page - the Page.

task - the Task.

e - the exception.

Since:

0.10.0