python - Trouble extracting XPath element from eBay - for Scrapy project -


edit: realised logged in ebay on pc displaying different layout server running scrapy.

i'm working on project using scrapy 0.18(python 2.6.6) scrape product listing information ebay.

i've been able extract elements fine except shipping price, i've tried many different xpath variants in scrapy shell , can't extract information , can't figure out why. used xpath chrome extension grab element's xpath sure , still can't information.

i'm trying extract postage cost displayed below buy button(displays free if it's set free shipping), i'll show example listing , xpath element below.

example listing: http://www.ebay.com.au/itm/apple-ipad-4-4th-generation-32gb-wi-fi-cellular-4g-black-ausluck-/151029092728?pt=au_tablets&hash=item232a091178&_uhb=1

xpath i'm using: //html/body/div[@id='body']/div[@id='centerpaneldf']/div[@id='centerpanel']/div[@id='centerpanelinternal']/div[@id='leftsummarypanel']/div[@class='is ']/form/div[@id='shippingsummary']/div[3]/div[@class='u-fll sh-col']/span[@id='shsummary']/span[@id='fshippingcost']/span

i'm missing obvious, i'm new python/xpath/scrapy. if can educate me on i'm doing wrong i'd appreciate it.

kind regards

i have no idea scrapy, having never used before. use selenium lot , 1 way find element : //span[@id = 'fshippingcost']. on firebug xpath checker found element alright.


Comments

Post a Comment

Popular posts from this blog

java.util.scanner - How to read and add only numbers to array from a text file -

i'm learning java , have question regarding reading file want read numbers file contains strings well. here example of file: 66.56 "3 java 3-43 5-42 2.1 1 and here coding: public class test { public static void main (string [] args){ if (0 < args.length) { file x = new file(args[0]); try{ scanner in = new scanner( new fileinputstream(x)); arraylist<double> test = new arraylist<>(); while(in.hasnext()){ if(in.hasnextdouble()){ double f=in.nextdouble(); test.add(f);} else {in.next();} } catch(ioexception e) { system.err.println("exception during reading: " + e); } } my problem add 66.56,2.1 , 1 doesn't add 3 after "3 or ignores 3-43 , 5-42 can tell me how skip strings , add doubles here? thanks all said 3 ie; "3, 3-43 , 4-42 strings either u read string , split , check number @ " , - or put in space between characters , integers. jvm after compilation tre...
Read more

rewrite - Trouble with Wordpress multiple custom querystrings -

i'm working on adding multiple querystring , doesn't seem work. i've found codes seems work others might i'm missing something. i want like: http://mydomain.com/board/?getyear=2013&getsometext2=sometext to http://mydomain.com/board/2013/sometext/ i added code below functions.php file. doesn't seem work should though. this works. echoing querystring gets both variable without problem. http://mydomain.com/board/2013/sometext/ but doesn't. tested querystring vis isset() seems nothing being set/get http://mydomain.com/board/2013/ function add_query_vars($vars) { $vars[] = "getyear"; $vars[] = "getsometext2"; return $vars; } add_filter('query_vars', 'add_query_vars'); function add_rewrite_rules($arules) { $anewrules = array('board/([^/]+)/([^/]+)/?$' => 'index.php?pagename=board&getyear=$matches[1]&getsometext2=$matches[2]'); $arules = $a...
Read more