1

I did a small script aiming to check for price change in some products as I sell on ebay and want to keep track on amazon as well. The idea is really simple using lxml to get the prices and compare it to what has been stored and then send email if there is change. I thought I got it working when testing it was doing what i wanted, then I wanted it to run all day with 15min intervals so I set up a bash script to take care of that but what I've noticed is that quickly after maybe the 10-15th it started getting NULL values and then it went to captcha.. Do you know if there is any amazon protection against scraping and if so is there any legal way to do it?

Yes I came across the question referred above but I saw it was quite old and the guy used urllib which I don't I use lxml, http and the following headers:

{'User-Agent': 'Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/42.0.2311.90 Safari/537.36'}

I just wanted to know if there has been a way to do it since the question you referred to.

Nick
  • 608
  • 1
  • 11
  • 23
  • 1
    Possible duplicate of [Is there a way to scrape Amazon Product Listing page using Python?](http://stackoverflow.com/questions/14844032/is-there-a-way-to-scrape-amazon-product-listing-page-using-python) – RCA Jun 29 '16 at 14:47
  • @RebeccaAckerman Yes I came across this one but I saw it was quite old and the guy used urllib which I don't I use lxml, http and the following headers: `{'User-Agent': 'Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/42.0.2311.90 Safari/537.36'}` I just wanted to know if there has been a way to do it since the question you referred to.. – Nick Jun 29 '16 at 15:00
  • Another way is to get an aws account and use Amazon Simple Product API https://github.com/yoavaviram/python-amazon-simple-product-api – Darren Haynes Jun 29 '16 at 15:16
  • @DarrenHaynes thanks, I will have a look at that, my main concern when I googled it was the fact that it was said on couple of places it is available only for merchants and third party devs.. – Nick Jun 29 '16 at 15:19
  • Thanks to @DarrenHaynes, I got some more information about the matter. So basically you can even use Amazon Simple Notification Service. But I want to make it with a python myself so that I can learn something ;). I guess someone can either close the question, not really sure how it works! – Nick Jun 30 '16 at 09:58

0 Answers0