Selenium + Python Data Scraping not working. the product name of Shopee are not saving in the csv file

Active3 hr before
Viewed126 times

5 Answers


Let’s aim for collecting the following basic information on each company and outputting them as a CSV file:,Sending an HTTP request, ordinarily via Requests, to a webpage and then parsing the HTML (ordinarily using BeautifulSoup) which is returned to access the desired information, Typical Use Case: Standard web scraping problem, refer to the case study

Example_snippet/controller/utility/_selenium.js/ KEY. . .
load more v

Once the program finishes running, we will receive a file with the names of goods and their prices:,To get acquainted with the scraping process, we will use ebay,com and try to parse the prices of laptops

Example_snippet/controller/utility/_selenium.js/ pip install lxml pip install r. . .
pip install lxml
pip install requests
pip install beautifulsoup4
load more v

I was incredibly lucky to come across this on the web, Not all sites will have (or will share) their API to share with you

Example_snippet/controller/utility/_selenium.js/ WebDriverWait(browser, 20).unt. . .
WebDriverWait(browser, 20).until(EC.element_to_be_clickable((By.XPATH, “ //div[@class=’shopee-modal__container’]//button[text()=’English’]”))).click()
load more v

This will now export all scraped data in a file reddit,csv

Example_snippet/controller/utility/_product.js/ conda install -c conda-forge s. . .
conda install - c conda - forge scrapy
load more v

Meta Stack Overflow , Stack Overflow help chat ,Stack Overflow en español,Stack Overflow на русском

Example_snippet/controller/utility/_product.js/ items = driver.find_elements_b. . .
items = driver.find_elements_by_xpath('//div[@class="col-xs-2-4 shopee-search-item-result__item"]')
Name = item.find_element_by_xpath('.//div[@data-sqe="name"]').text
load more v