Selenium - XPATH - Searching for element by innerHTML

Question

I'm learning Selenium and have a decent grasp of XPATH.

An issue I'm running into is that on a web page, there's an element I want to select that has a dynamically generated id and class. I had tried the following:

code = driver.find_element_by_xpath("//*[contains(@text='someUniqueString')]")

however, the element doesn't have any text. Instead it's a <code> element with JSON.

<codestyle="display: none" id="something-crazy-dynamic"> 
    {"dataIWantToGrab":{"someUniqueString":...}}
</code>

What I'm looking to do is search the innerHTML to find a unique string using XPATH but I can't find any good resources.

I've tried

driver.find_element_by_xpath("//*[contains(@innerHTML='someUniqueString')]")

but am receiving the error

selenium.common.exceptions.NoSuchElementException: Message: Unable to locate element: //*[contains(@innerHTML='someUniqueString')]

EDIT: Below is a link to the sibling text I'm working with

https://gist.github.com/anonymous/b227e59c942e7ec9f5a851a3b7ecdfc6

EDIT 2: I was able to get around this, not by using Selenium but with BeautifulSoup. Not ideal, but still a solution.

soup = BeautifulSoup(driver.page_source)
codes = soup.find_all("code")
found_json = [i for i in codes if i.text.find("someUniqueString") > 0]

there is a part that is constant but about 15 other elements have the same naming conventions — shartshooter, Mar 14 '17 at 05:07
you can depend on parent, child, and siblings. please share the relevant HTML code (5 elements above and below the given element) — Naveen Kumar R B, Mar 14 '17 at 05:37
@Naveen - I've included more html here - https://gist.github.com/anonymous/b227e59c942e7ec9f5a851a3b7ecdfc6 — shartshooter, Mar 14 '17 at 18:59

har07 · Accepted Answer · 2017-03-14T06:01:46.133

19

You can't use XPath to match by inner HTML, but you can use it to match by 'inner text' :

//*[text()[contains(., 'someUniqueString')]]

`demo

The above XPath should return the code element since it is parent element of the target text 'someUniqueString'.

edited Mar 14 '17 at 06:01

answered Mar 14 '17 at 05:07

har07

86,209
12
77
125

the issue I'm facing is that `innerTEXT` is returning null, but `innerHTML` is not – shartshooter Mar 14 '17 at 05:11
@kmomo It isn't literally `innerTEXT` that I meant, see the code snippet above. Looks like `innerHTML` is Selenium thing, so you might be able to use it. Only your XPath expression is a bit off, `=` should be replaced with `,` : `contains(@innerHTML,'someUniqueString')` – har07 Mar 14 '17 at 06:05
that's not working - `driver.find_element_by_xpath("//*[contains(@innerHTML,'someUniqueString')]")` is returning `Message: Unable to locate element: //*[contains(@innerHTML,'someUniqueString')]` – shartshooter Mar 14 '17 at 19:02
2

@kmomo did you try the XPath in this answer too? `//*[text()[contains(., 'someUniqueString')]]` – har07 Mar 15 '17 at 01:03

score 4 · Answer 2 · edited May 23 '17 at 12:17

Try the following XPath:

//*[contains(text(),'someUniqueString')]

Note: As the code element set with display: none, the element is NOT visible, though you can find the element. If you try to interact with the element using click or other API, you might get ElementNotVisisbleException. To put it simply, You can't interact with the elements which are NOT displayed on GUI (browser).

If you are NOT able to find the element, then there are good chances that your element is inside an iframe. In such cases, you must switch to the frame first and then use the XPath to find the element.

More details on switching between frames here.

Selenium - XPATH - Searching for element by innerHTML

2 Answers2