websitescraping Posted November 21, 2013 Share Posted November 21, 2013 What is the use of website scraping? Link to comment Share on other sites More sharing options...
Albert-chauffe-eau Posted November 21, 2013 Share Posted November 21, 2013 Steal the content of a website. This content can be use on another website. Link to comment Share on other sites More sharing options...
Ciseur Posted November 21, 2013 Share Posted November 21, 2013 Steal the content of a website. This content can be use on another website. Not only. If you work on a website and you want to get all datas page by page scrapping URL by URL is a good way to create a spreadsheet with all data you need. Link to comment Share on other sites More sharing options...
Nikolai Posted June 11, 2015 Share Posted June 11, 2015 One another case : sometimes supplier does not have data feed, so you have to create a scraper to extract data into your csv file or for importing it into you webshop database. 1 Link to comment Share on other sites More sharing options...
Mugatu Posted June 12, 2015 Share Posted June 12, 2015 Also things like price comparison automation, such as check your pricing is inline with your competitors etc. A big use is things like online gaming odds, airline tickets prices etc this can basically become a DoS on your site if it happens too frequently. Some hosts provide Web Application Firewall solutions which include anti scraping technology. Like above noted some suppliers don't have their data and images available and say just take them from our site. Easiest way is to scrape them and have in a .csv output so you can import to Presta as an example. Link to comment Share on other sites More sharing options...
Recommended Posts
Create an account or sign in to comment
You need to be a member in order to leave a comment
Create an account
Sign up for a new account in our community. It's easy!
Register a new accountSign in
Already have an account? Sign in here.
Sign In Now