{"id":18513,"date":"2022-11-01T03:06:09","date_gmt":"2022-10-31T21:36:09","guid":{"rendered":"https:\/\/jassweb.com\/solved\/solved-scraping-with-selenium-web-driver\/"},"modified":"2022-11-01T03:06:09","modified_gmt":"2022-10-31T21:36:09","slug":"solved-scraping-with-selenium-web-driver","status":"publish","type":"post","link":"https:\/\/jassweb.com\/solved\/solved-scraping-with-selenium-web-driver\/","title":{"rendered":"[Solved] scraping with selenium web driver"},"content":{"rendered":"<p> [ad_1]<br \/>\n<\/p>\n<div id=\"answer-63303861\" class=\"answer js-answer accepted-answer js-accepted-answer\" data-answerid=\"63303861\" data-parentid=\"63303040\" data-score=\"1\" data-position-on-page=\"1\" data-highest-scored=\"1\" data-question-has-accepted-highest-score=\"1\" itemprop=\"acceptedAnswer\" itemscope itemtype=\"https:\/\/schema.org\/Answer\">\n<div class=\"post-layout\">\n<div class=\"votecell post-layout--left\"><\/div>\n<div class=\"answercell post-layout--right\">\n<div class=\"s-prose js-post-body\" itemprop=\"text\">\n<p>You should fix your XPath expressions. Use <code>findElement<\/code> for the first 3. <code>findElements<\/code> for the last.<\/p>\n<p>To get the home odd :<\/p>\n<pre><code>\/\/td[a[.=\"bet365\"]]\/following-sibling::td[span][1]\/span\n<\/code><\/pre>\n<p>To get the draw odd :<\/p>\n<pre><code>\/\/td[a[.=\"bet365\"]]\/following-sibling::td[span][2]\/span\n<\/code><\/pre>\n<p>To get the away odd :<\/p>\n<pre><code>\/\/td[a[.=\"bet365\"]]\/following-sibling::td[span][3]\/span\n<\/code><\/pre>\n<p>To get them all :<\/p>\n<pre><code>\/\/td[a[.=\"bet365\"]]\/following-sibling::td[span]\/span\n<\/code><\/pre>\n<p>Getting them all is probably better since you call <code>driver.find_elements_by_xpath<\/code> 1 time. For each match, store each element of the result (a list) in your specific lists (append the first in the home odd list, the second in the draw odd list, the third in the away odd list).<\/p>\n<p><strong>EDIT<\/strong> : To get the opening odds, extract the value from the attribute <code>data-opening-odd<\/code>. XPath :<\/p>\n<pre><code>\/\/td[a[.=\"bet365\"]]\/following-sibling::td[span][1]\/@data-opening-odd\n\/\/td[a[.=\"bet365\"]]\/following-sibling::td[span][2]\/@data-opening-odd\n\/\/td[a[.=\"bet365\"]]\/following-sibling::td[span][3]\/@data-opening-odd\n\/\/td[a[.=\"bet365\"]]\/following-sibling::td[span]\/@data-opening-odd\n<\/code><\/pre>\n<p>Selenium syntax :<\/p>\n<pre><code>awayodd = WebDriverWait(driver, 20).until(EC.visibility_of_element_located((By.XPATH, '\/\/td[a[.=\"bet365\"]]\/following-sibling::td[span][3]'))).get_attribute(\"data-opening-odd\")\n<\/code><\/pre>\n<\/p><\/div>\n<div class=\"mt24\"><\/div>\n<\/div>\n<p>            <span class=\"d-none\" itemprop=\"commentCount\">1<\/span> <\/p><\/div>\n<\/div>\n<p>[ad_2]<\/p>\n<p>solved scraping with selenium web driver <\/p>\n","protected":false},"excerpt":{"rendered":"<p>[ad_1] You should fix your XPath expressions. Use findElement for the first 3. findElements for the last. To get the home odd : \/\/td[a[.=&#8221;bet365&#8243;]]\/following-sibling::td[span][1]\/span To get the draw odd : \/\/td[a[.=&#8221;bet365&#8243;]]\/following-sibling::td[span][2]\/span To get the away odd : \/\/td[a[.=&#8221;bet365&#8243;]]\/following-sibling::td[span][3]\/span To get them all : \/\/td[a[.=&#8221;bet365&#8243;]]\/following-sibling::td[span]\/span Getting them all is probably better since you call driver.find_elements_by_xpath 1 &#8230; <a title=\"[Solved] scraping with selenium web driver\" class=\"read-more\" href=\"https:\/\/jassweb.com\/solved\/solved-scraping-with-selenium-web-driver\/\" aria-label=\"More on [Solved] scraping with selenium web driver\">Read more<\/a><\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[320],"tags":[349,611,1138,760,916],"class_list":["post-18513","post","type-post","status-publish","format-standard","hentry","category-solved","tag-python","tag-selenium","tag-selenium-webdriver","tag-web-scraping","tag-xpath"],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v26.5 - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>[Solved] scraping with selenium web driver - JassWeb<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/jassweb.com\/solved\/solved-scraping-with-selenium-web-driver\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"[Solved] scraping with selenium web driver - JassWeb\" \/>\n<meta property=\"og:description\" content=\"[ad_1] You should fix your XPath expressions. Use findElement for the first 3. findElements for the last. To get the home odd : \/\/td[a[.=&quot;bet365&quot;]]\/following-sibling::td[span][1]\/span To get the draw odd : \/\/td[a[.=&quot;bet365&quot;]]\/following-sibling::td[span][2]\/span To get the away odd : \/\/td[a[.=&quot;bet365&quot;]]\/following-sibling::td[span][3]\/span To get them all : \/\/td[a[.=&quot;bet365&quot;]]\/following-sibling::td[span]\/span Getting them all is probably better since you call driver.find_elements_by_xpath 1 ... Read more\" \/>\n<meta property=\"og:url\" content=\"https:\/\/jassweb.com\/solved\/solved-scraping-with-selenium-web-driver\/\" \/>\n<meta property=\"og:site_name\" content=\"JassWeb\" \/>\n<meta property=\"article:published_time\" content=\"2022-10-31T21:36:09+00:00\" \/>\n<meta name=\"author\" content=\"Kirat\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Kirat\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"1 minute\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\/\/jassweb.com\/solved\/solved-scraping-with-selenium-web-driver\/#article\",\"isPartOf\":{\"@id\":\"https:\/\/jassweb.com\/solved\/solved-scraping-with-selenium-web-driver\/\"},\"author\":{\"name\":\"Kirat\",\"@id\":\"https:\/\/jassweb.com\/solved\/#\/schema\/person\/65c9c7b7958150c0dc8371fa35dd7c31\"},\"headline\":\"[Solved] scraping with selenium web driver\",\"datePublished\":\"2022-10-31T21:36:09+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\/\/jassweb.com\/solved\/solved-scraping-with-selenium-web-driver\/\"},\"wordCount\":108,\"publisher\":{\"@id\":\"https:\/\/jassweb.com\/solved\/#organization\"},\"keywords\":[\"python\",\"selenium\",\"selenium-webdriver\",\"web-scraping\",\"xpath\"],\"articleSection\":[\"Solved\"],\"inLanguage\":\"en-US\"},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/jassweb.com\/solved\/solved-scraping-with-selenium-web-driver\/\",\"url\":\"https:\/\/jassweb.com\/solved\/solved-scraping-with-selenium-web-driver\/\",\"name\":\"[Solved] scraping with selenium web driver - JassWeb\",\"isPartOf\":{\"@id\":\"https:\/\/jassweb.com\/solved\/#website\"},\"datePublished\":\"2022-10-31T21:36:09+00:00\",\"breadcrumb\":{\"@id\":\"https:\/\/jassweb.com\/solved\/solved-scraping-with-selenium-web-driver\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/jassweb.com\/solved\/solved-scraping-with-selenium-web-driver\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/jassweb.com\/solved\/solved-scraping-with-selenium-web-driver\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/jassweb.com\/solved\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"[Solved] scraping with selenium web driver\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/jassweb.com\/solved\/#website\",\"url\":\"https:\/\/jassweb.com\/solved\/\",\"name\":\"JassWeb\",\"description\":\"Build High-quality Websites\",\"publisher\":{\"@id\":\"https:\/\/jassweb.com\/solved\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/jassweb.com\/solved\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\/\/jassweb.com\/solved\/#organization\",\"name\":\"Jass Web\",\"url\":\"https:\/\/jassweb.com\/solved\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/jassweb.com\/solved\/#\/schema\/logo\/image\/\",\"url\":\"https:\/\/jassweb.com\/wp-content\/uploads\/2021\/02\/jass-website-logo-1.png\",\"contentUrl\":\"https:\/\/jassweb.com\/wp-content\/uploads\/2021\/02\/jass-website-logo-1.png\",\"width\":693,\"height\":132,\"caption\":\"Jass Web\"},\"image\":{\"@id\":\"https:\/\/jassweb.com\/solved\/#\/schema\/logo\/image\/\"}},{\"@type\":\"Person\",\"@id\":\"https:\/\/jassweb.com\/solved\/#\/schema\/person\/65c9c7b7958150c0dc8371fa35dd7c31\",\"name\":\"Kirat\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/jassweb.com\/solved\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/jassweb.com\/solved\/wp-content\/litespeed\/avatar\/1261af3c9451399fa1336d28b98ea3bb.jpg?ver=1775193939\",\"contentUrl\":\"https:\/\/jassweb.com\/solved\/wp-content\/litespeed\/avatar\/1261af3c9451399fa1336d28b98ea3bb.jpg?ver=1775193939\",\"caption\":\"Kirat\"},\"sameAs\":[\"http:\/\/jassweb.com\"],\"url\":\"https:\/\/jassweb.com\/solved\/author\/jaspritsinghghumangmail-com\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"[Solved] scraping with selenium web driver - JassWeb","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/jassweb.com\/solved\/solved-scraping-with-selenium-web-driver\/","og_locale":"en_US","og_type":"article","og_title":"[Solved] scraping with selenium web driver - JassWeb","og_description":"[ad_1] You should fix your XPath expressions. Use findElement for the first 3. findElements for the last. To get the home odd : \/\/td[a[.=\"bet365\"]]\/following-sibling::td[span][1]\/span To get the draw odd : \/\/td[a[.=\"bet365\"]]\/following-sibling::td[span][2]\/span To get the away odd : \/\/td[a[.=\"bet365\"]]\/following-sibling::td[span][3]\/span To get them all : \/\/td[a[.=\"bet365\"]]\/following-sibling::td[span]\/span Getting them all is probably better since you call driver.find_elements_by_xpath 1 ... Read more","og_url":"https:\/\/jassweb.com\/solved\/solved-scraping-with-selenium-web-driver\/","og_site_name":"JassWeb","article_published_time":"2022-10-31T21:36:09+00:00","author":"Kirat","twitter_card":"summary_large_image","twitter_misc":{"Written by":"Kirat","Est. reading time":"1 minute"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/jassweb.com\/solved\/solved-scraping-with-selenium-web-driver\/#article","isPartOf":{"@id":"https:\/\/jassweb.com\/solved\/solved-scraping-with-selenium-web-driver\/"},"author":{"name":"Kirat","@id":"https:\/\/jassweb.com\/solved\/#\/schema\/person\/65c9c7b7958150c0dc8371fa35dd7c31"},"headline":"[Solved] scraping with selenium web driver","datePublished":"2022-10-31T21:36:09+00:00","mainEntityOfPage":{"@id":"https:\/\/jassweb.com\/solved\/solved-scraping-with-selenium-web-driver\/"},"wordCount":108,"publisher":{"@id":"https:\/\/jassweb.com\/solved\/#organization"},"keywords":["python","selenium","selenium-webdriver","web-scraping","xpath"],"articleSection":["Solved"],"inLanguage":"en-US"},{"@type":"WebPage","@id":"https:\/\/jassweb.com\/solved\/solved-scraping-with-selenium-web-driver\/","url":"https:\/\/jassweb.com\/solved\/solved-scraping-with-selenium-web-driver\/","name":"[Solved] scraping with selenium web driver - JassWeb","isPartOf":{"@id":"https:\/\/jassweb.com\/solved\/#website"},"datePublished":"2022-10-31T21:36:09+00:00","breadcrumb":{"@id":"https:\/\/jassweb.com\/solved\/solved-scraping-with-selenium-web-driver\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/jassweb.com\/solved\/solved-scraping-with-selenium-web-driver\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/jassweb.com\/solved\/solved-scraping-with-selenium-web-driver\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/jassweb.com\/solved\/"},{"@type":"ListItem","position":2,"name":"[Solved] scraping with selenium web driver"}]},{"@type":"WebSite","@id":"https:\/\/jassweb.com\/solved\/#website","url":"https:\/\/jassweb.com\/solved\/","name":"JassWeb","description":"Build High-quality Websites","publisher":{"@id":"https:\/\/jassweb.com\/solved\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/jassweb.com\/solved\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/jassweb.com\/solved\/#organization","name":"Jass Web","url":"https:\/\/jassweb.com\/solved\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/jassweb.com\/solved\/#\/schema\/logo\/image\/","url":"https:\/\/jassweb.com\/wp-content\/uploads\/2021\/02\/jass-website-logo-1.png","contentUrl":"https:\/\/jassweb.com\/wp-content\/uploads\/2021\/02\/jass-website-logo-1.png","width":693,"height":132,"caption":"Jass Web"},"image":{"@id":"https:\/\/jassweb.com\/solved\/#\/schema\/logo\/image\/"}},{"@type":"Person","@id":"https:\/\/jassweb.com\/solved\/#\/schema\/person\/65c9c7b7958150c0dc8371fa35dd7c31","name":"Kirat","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/jassweb.com\/solved\/#\/schema\/person\/image\/","url":"https:\/\/jassweb.com\/solved\/wp-content\/litespeed\/avatar\/1261af3c9451399fa1336d28b98ea3bb.jpg?ver=1775193939","contentUrl":"https:\/\/jassweb.com\/solved\/wp-content\/litespeed\/avatar\/1261af3c9451399fa1336d28b98ea3bb.jpg?ver=1775193939","caption":"Kirat"},"sameAs":["http:\/\/jassweb.com"],"url":"https:\/\/jassweb.com\/solved\/author\/jaspritsinghghumangmail-com\/"}]}},"_links":{"self":[{"href":"https:\/\/jassweb.com\/solved\/wp-json\/wp\/v2\/posts\/18513","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/jassweb.com\/solved\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/jassweb.com\/solved\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/jassweb.com\/solved\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/jassweb.com\/solved\/wp-json\/wp\/v2\/comments?post=18513"}],"version-history":[{"count":0,"href":"https:\/\/jassweb.com\/solved\/wp-json\/wp\/v2\/posts\/18513\/revisions"}],"wp:attachment":[{"href":"https:\/\/jassweb.com\/solved\/wp-json\/wp\/v2\/media?parent=18513"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/jassweb.com\/solved\/wp-json\/wp\/v2\/categories?post=18513"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/jassweb.com\/solved\/wp-json\/wp\/v2\/tags?post=18513"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}