Python Beautiful Soup web scraping CNN election results

Question

Please bear with me I am brand new to web scraping! I want to scrape all of the exit poll data off this CNN webpage http://www.cnn.com/election/results/exit-polls for this question I will just ask to scrape the first exit poll, the gender one. the code below doesnt print anything. what I am doing wrong? not looping through all the tags?

import urllib2
from bs4 import BeautifulSoup
html = urllib2.urlopen('http://www.cnn.com/election/results/exit-polls').read()
soup = BeautifulSoup(html)
table = soup.find("div",{"class":"exit-poll__question"})
print table

BeautifulSoup can't get that information since the information is loaded using Javascript. — Jake Conway, Nov 16 '16 at 04:01
Take a look at something like [dryscrape](https://github.com/niklasb/dryscrape). There's a good example of usage [here](http://stackoverflow.com/a/26440563/7090605). — Jake Conway, Nov 16 '16 at 04:05

score 1 · Accepted Answer · answered Nov 16 '16 at 07:53

1

you can find the data in this link

you can find the link in chrome's dev-tools>>Network

so what you need to do is to request the url

i hope this will help.

answered Nov 16 '16 at 07:53

宏杰李

11,204
2
24
33

Python Beautiful Soup web scraping CNN election results

1 Answers1