0

i am trying to scrape a site (https://www.bstn.com/eu_nl) but when i use requests to go to the page an accept cookies popup pops up, i tried accepting it with the answer of this question and this question but they both don't work for me. I also tried it with this code

        cookie = {
            'cookiefirst-id': '0c446d9d-7078-4ba3-a6b8-d02af551b831'
        }

        item = 'https://www.bstn.com/eu_nl'
        p = requests.get(item, cookies=cookie, headers=headers)
        soup = BeautifulSoup(p.text, 'lxml')
        names = soup.find_all('div')
        print(names)

but the output is an empty list. I got the cookie from the network tab (see picture). network-tab-cookie

Any help/answers appreciated!

maurijn.vd
  • 57
  • 1
  • 6

0 Answers0