python - Possible to get alexa information or google page rankings over time? -


i trying access historical google page rankings or alexa rankings on time add weightings on search engine making fun. separate function call in python (ideally) , pass in paramaters of url , how long wanted average over, measured in days , use information weight results!

i think fun work on, feel may easy trick of apis guru might able show me , save me few sleepless weeks! can help?

thanks lot !

if @ alexa page stack overflow can see next global rank offers change of site's rank on past 3 months. may not down level of granularity like, scrape out information relatively , doubt gain additional information looking @ changes of different lengths of time. long term answer collect , store rankings have historical record going forward.

update: here sample code.

import mechanize import cookielib beautifulsoup import beautifulsoup   def changerankscrapper(site):     """     takes site url, scrapes site's alexa page,     , returns site's global alexa rank ,     change in rank on past 3 months.     """      #create alexa url     url = "http://www.alexa.com/siteinfo/" + site      #get html     cj = cookielib.cookiejar()     mech = mechanize.openerfactory().build_opener(mechanize.httpcookieprocessor(cj))     request = mechanize.request(url)     response = mech.open(request)     html = response.read()      #parse html beautifulsoup     soup = beautifulsoup(html)      globalrank = int(soup.find("strong", { "class" : "metricsurl font-big2 valign" }).text)     changerank = int(soup.find("span", { "class" : "change-wrapper change-up" }).text)       return globalrank, changerank  #example site = "http://stackoverflow.com/" globalrank, changerank = changerankscrapper(site) print(globalrank) print(changerank)

Comments

Post a Comment

Popular posts from this blog

java.util.scanner - How to read and add only numbers to array from a text file -

i'm learning java , have question regarding reading file want read numbers file contains strings well. here example of file: 66.56 "3 java 3-43 5-42 2.1 1 and here coding: public class test { public static void main (string [] args){ if (0 < args.length) { file x = new file(args[0]); try{ scanner in = new scanner( new fileinputstream(x)); arraylist<double> test = new arraylist<>(); while(in.hasnext()){ if(in.hasnextdouble()){ double f=in.nextdouble(); test.add(f);} else {in.next();} } catch(ioexception e) { system.err.println("exception during reading: " + e); } } my problem add 66.56,2.1 , 1 doesn't add 3 after "3 or ignores 3-43 , 5-42 can tell me how skip strings , add doubles here? thanks all said 3 ie; "3, 3-43 , 4-42 strings either u read string , split , check number @ " , - or put in space between characters , integers. jvm after compilation tre...
Read more

rewrite - Trouble with Wordpress multiple custom querystrings -

i'm working on adding multiple querystring , doesn't seem work. i've found codes seems work others might i'm missing something. i want like: http://mydomain.com/board/?getyear=2013&getsometext2=sometext to http://mydomain.com/board/2013/sometext/ i added code below functions.php file. doesn't seem work should though. this works. echoing querystring gets both variable without problem. http://mydomain.com/board/2013/sometext/ but doesn't. tested querystring vis isset() seems nothing being set/get http://mydomain.com/board/2013/ function add_query_vars($vars) { $vars[] = "getyear"; $vars[] = "getsometext2"; return $vars; } add_filter('query_vars', 'add_query_vars'); function add_rewrite_rules($arules) { $anewrules = array('board/([^/]+)/([^/]+)/?$' => 'index.php?pagename=board&getyear=$matches[1]&getsometext2=$matches[2]'); $arules = $a...
Read more