0

I have a script that opens a number of tabs in Chrome using httr::BROWSE("*my.site.com*"). Since it opens in the browser the login credentials for the particular website are used and I can see all the webpage details. I then manually download these pages and continue on and scrape content using rvest.

Is there a way to overcome this manual step? I've tried RSelenium but cannot get past my login page. Below is what I have for RSelenium.

The first driver screenshot shows that I successfully enter my email address. However, when clicking the continue with email element the reCAPTCHA message appears.

library(RSelenium)
library(rvest)
library(tidyverse)

shell('docker run -d -p 4445:4444 selenium/standalone-firefox')
driver <- remoteDriver(remoteServerAddr = "localhost", port = 4445L, browserName = "firefox")
Sys.sleep(15)
driver$open()
driver$navigate("https://www.upwork.com/ab/account-security/login")

#~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
# login 

# enter username
element <- driver$findElement(using = "css","#login_username")
element$sendKeysToElement(list("my_email@my_email.com"))

driver$screenshot(TRUE)

# continue with email
element <- driver$findElement(using = "css","#login_password_continue")
element$clickElement()

driver$screenshot(TRUE)

Thanks for any tips.

Terryb
  • 41
  • 4
  • RSelenium should be able to do that. Without some sort of code or [reproducible example](https://stackoverflow.com/questions/5963269/how-to-make-a-great-r-reproducible-example) it's nearly impossible to say why that didn't work. – MrFlick Sep 10 '21 at 19:21

0 Answers0