0

Edited - data was confidential and crashing the website.

datacookies
  • 13
  • 8
  • Possible duplicate of [Max retries exceeded with URL in requests](https://stackoverflow.com/questions/23013220/max-retries-exceeded-with-url-in-requests) – AMC Nov 21 '19 at 06:18
  • Your question seems overly broad, it might be better to focus on fixing that error first. – AMC Nov 21 '19 at 06:19
  • Why are you using selenium, requests and beautifulsoup when all does same task? And also you have never initiated webdriver. And for the error you need to go through a proxy if you are in one or you can use time.sleep for waiting. you can also use verify=False as parameter in requests.get . – Harish Vutukuri Nov 21 '19 at 07:24
  • @datacookies, you edited the question stating that data is confidential. Please note that question versions are kept, so the original text is still available for anyone. If it is really necessary to remove that data from the site, you have two options: [check this post](https://meta.stackexchange.com/questions/25088/how-can-i-delete-my-question-on-stack-overflow) to remove the question yourself. The site might refuse to do so. If that's the case, you can try to flag your question for moderator intervention, and explain your request. – caxcaxcoatl Nov 22 '19 at 00:42

1 Answers1

2

This is the code to open the chrome using selenium and downloading the file by clicking on the button.

import time
from selenium import webdriver
from selenium.webdriver.chrome.options import Options

# Options for Chrome WebDriver
op = Options()
op.add_argument('--disable-notifications')
op.add_experimental_option("prefs",{
    "download.prompt_for_download": False,
    "download.directory_upgrade": True,
    "safebrowsing.enabled": True 
})

# Download Path
download_dir = 'D:\\'

# Initializing the Chrome webdriver with the options
driver = webdriver.Chrome(options=op)

# Setting Chrome to trust downloads
driver.command_executor._commands["send_command"] = ("POST", '/session/$sessionId/chromium/send_command')
params = {'cmd': 'Page.setDownloadBehavior', 'params': {'behavior': 'allow', 'downloadPath': download_dir}}
command_result = driver.execute("send_command", params)

driver.implicitly_wait(5)

# Opening the page
driver.get("https://apa.nexregreporting.com/home/portfoliocompression")

# Click on the button and wait for 10 seconds
driver.find_element_by_xpath('//*[@class="btn btn-default"]').click()
time.sleep(10)

# Closing the webdriver
driver.close()
Harish Vutukuri
  • 1,032
  • 5
  • 13