scrapy - ScrapyDeprecationWaring: Command's default `crawler` is deprecated and will be removed. Use `create_crawler` method to instantiate crawlers -


scrapy version 0.19

i using code @ page ( run multiple scrapy spiders @ once using scrapyd ). when run scrapy allcrawl, got

scrapydeprecationwaring: command's default `crawler` deprecated , removed. use `create_crawler` method instantiate crawlers

here code:

from scrapy.command import scrapycommand import urllib import urllib2 scrapy import log  class allcrawlcommand(scrapycommand):      requires_project = true     default_settings = {'log_enabled': false}      def short_desc(self):         return "schedule run available spiders"      def run(self, args, opts):         url = 'http://localhost:6800/schedule.json'         s in self.crawler.spiders.list(): #this line raise warning             values = {'project' : 'your_project_name', 'spider' : s}             data = urllib.urlencode(values)             req = urllib2.request(url, data)             response = urllib2.urlopen(req)             log.msg(response)

how fix deprecationwarning ?

thanks

use:

crawler = self.crawler_process.create_crawler()

Comments

Post a Comment

Popular posts from this blog

iphone - Three second countdown in cocos2d -

i trying have 3 second countdown display when level beat in game. did: -(void) gamesegmentbeat { [self pauseschedulerandactions]; // overlay game opaque background ccsprite *opaquebg = [ccsprite spritewithfile:@"background1.png"]; opaquebg.position = screencenter; [self addchild:opaquebg z:10000]; // these 3 labels 3 seconds cclabelttf *three = [cclabelttf labelwithstring:@"3" fontname:@"helvetica" fontsize:100]; three.position = ccp(screencenter.x, screencenter.y); cclabelttf *two = [cclabelttf labelwithstring:@"2" fontname:@"helvetica" fontsize:100]; two.position = ccp(screencenter.x, screencenter.y); cclabelttf *one = [cclabelttf labelwithstring:@"1" fontname:@"helvetica" fontsize:100]; one.position = ccp(screencenter.x, screencenter.y); // secondspast specified in update method secondspast = 0; if (secondspast == 1) { [self addchild:thr...
Read more

hyperlink - how to do url routing in php -

sorry, don't know should exact technical term problem statement title of thread might misleading/confusing. that's reason why not able search problem solution on google. okay, i'm developing simple social network users. want each user have own profile link. for example, if username of user 'xyz' profile link should ' http://example.com/user/xyz now how create "virtual" link? edit: okay, learned it's mod_rewrite , got similar question how dynamically rewrite url facebook routes php delicate matter. mod_rewrite can in beginning, after becoming mess , f*** rather help, when "big" software needs scalable. remembering "routes" not part of specific application, nomenclature "server" interprets request "client" , returns specific value "client" configuration of request. ie, "router" server. what recommend study http protocol, rest , on. this surely in many things, knowi...
Read more

c - Avoiding Extra Malloc in Linked List (node->next = NULL) -

in linked list, i'm trying avoid malloc ing node without adding bunch of if statements , such. have following: polynomial create() { polynomial head = null; polynomial temp = null; int numterms, coefficient, exponent; int counter = 0; printf("enter number of terms in polynomial: "); scanf ("%d", &numterms); printf("\n"); if (numterms == 0) { head = malloc(sizeof(term)); head->coef = 0; head->exp = 0; head->next = null; return head; } while (numterms != counter) { // ask input printf("enter coefficient , exponent of term %d: ", (counter + 1)); scanf("%d %d", &coefficient, &exponent); printf("\n"); // create term if (temp == null) temp = malloc(sizeof(term)); temp->coef = coefficient; temp->exp = exponent; temp->next = null; //if((numterms - 1) != counter) tem...
Read more