Interface Scheduler

    • Method Detail

      • push

        void push​(Request request,
                  Task task)
        add a url to fetch
        Parameters:
        request - request
        task - task
      • poll

        Request poll​(Task task)
        get an url to crawl
        Parameters:
        task - the task of spider
        Returns:
        the url to crawl