How to load only html from web pages in selenium?
I need only html of requested page without css and javascript.
Asked
Active
Viewed 4,233 times
5
-
Could I ask why? Are the CSS and JavaScript files so large that loading them is significantly slowing down the selenium tests? – Brian Hoover Jan 04 '15 at 15:26
-
I want to use `selenium` for web scrapping – micgeronimo Jan 04 '15 at 15:35
-
as @BrianHoover suggests, OP, you will very likely need JS to scrape a lot of sites properly -- since elements are loaded or altered using JS. – Bee Smears Jan 04 '15 at 19:45
1 Answers
3
If you need selenium for web-scraping, strictly speaking, you would still need need javascript and css files since they can take a significant part in the page load and rendering. For example, several parts of a page can be loaded with additional ajax calls, or inserted via a custom javascript logic.
Also, if you want only HTML part of a page, why do you need to involve a real browser?
If you still want to prevent js and css files from loading, you can configure certain permissions in Firefox through tweaking FirefoxProfile preferences, see:
