How to remove structure with python from this case?

Asked Jun 22 '15 at 08:47

Active Jul 01 '15 at 08:30

Viewed 146 times

1

How to remove "table" from HTML using python?

I had case like this:

`paragraph = ''' Lorem ipsum dolor sit amet, consectetur adipisicing elit. Quidem molestiae consequuntur officiis corporis sint. <table> <tr> <td> text title </td> <td> text title 2 </td> </tr> </table> lorem ipsum '''`

how to remove content with table structure as above using python? And I want the output produced to be as follows:

`paragraph = ''' Lorem ipsum dolor sit amet, consectetur adipisicing elit. Quidem molestiae consequuntur officiis corporis sint. lorem ipsum '''`

python python-2.7 beautifulsoup

edited Jul 01 '15 at 08:30
styvane

55,207

16

142

150

asked Jun 22 '15 at 08:47
Road Name

129

14

1

Could you post the code that you have tried? – Vaulstein Jun 22 '15 at 08:52

will it always start with

and end with
and can you use regex – The6thSense Jun 22 '15 at 09:38

Question

How to remove "table" from HTML using python?

I had case like this:

paragraph = '''
<p>Lorem ipsum dolor sit amet, consectetur adipisicing elit. Quidem molestiae consequuntur officiis corporis sint.<br /><br />
<table>
<tr>
<td>
    text title
</td>
<td>
    text title 2
</td>
</tr>
</table>
<p> lorem ipsum</p>
'''

how to remove content with table structure as above using python? And I want the output produced to be as follows:

paragraph = '''
<p>Lorem ipsum dolor sit amet, consectetur adipisicing elit. Quidem molestiae consequuntur officiis corporis sint.<br /><br />
<p> lorem ipsum</p>
'''

Could you post the code that you have tried? – Vaulstein Jun 22 '15 at 08:52 — Vaulstein, Jun 22 '15 at 08:52

score 6 · Answer 1 · answered Jun 22 '15 at 09:01

6

You can use BeautifulSoup especially PageElement.extract()

In [16]: from bs4 import BeautifulSoup

In [17]: soup = BeautifulSoup("""<p>Lorem ipsum dolor sit amet, consectetur adipisicing elit. Quidem molestiae consequuntur officiis corporis sint.<br /><br />
   ....: <table>
   ....: <tr>
   ....: <td>
   ....:     text title or some
   ....: </td>
   ....: </tr>
   ....: </table>
   ....: <p> lorem ipsum</p>""")

In [18]: _ = soup.table.extract()

In [19]: soup
Out[19]: 
<html><body><p>Lorem ipsum dolor sit amet, consectetur adipisicing elit. Quidem molestiae consequuntur officiis corporis sint.<br/><br/>
</p>
<p> lorem ipsum</p></body></html>

answered Jun 22 '15 at 09:01

styvane

55,207
16
142
150

thanks for your answer, but I am looking for a solution without using a module. perhaps with regex or other methods. but your answers will be my capacity for alternatives. – Road Name Jun 22 '15 at 09:08
@AriPrihantoro you don't want to use `regex` why? because it will [explode your head](http://stackoverflow.com/questions/1732348/regex-match-open-tags-except-xhtml-self-contained-tags/1732454#1732454) – styvane Jun 22 '15 at 09:19
I look for another method, instead of using the module as BeautifulSoup or another. I prefer to use methods such as regex. maybe you misunderstood my point. – Road Name Jun 22 '15 at 09:22

Bharadwaj · Answer 2 · 2015-06-22T09:13:39.050

0

You can also try this basic string formatting

paragraph = paragraph[:paragraph.find('<table>')] +     # Find the starting letter of '<table>'
            paragraph[paragraph.find('</table>')+       # Find the starting letter of </table>
            (len('<\table>')+1):]                       # Add 1 because length starts from zero

print(paragraph)

Even this work for basic text extraction

edited Jun 22 '15 at 09:13

answered Jun 22 '15 at 09:07

Bharadwaj

674
5
23

yea, i will ask like this. – Road Name Jun 22 '15 at 09:16
Would you have a lot of s?
– Bharadwaj Jun 22 '15 at 09:16
not the number of his table, if from me what if the number of columns of the table more than 1. – Road Name Jun 22 '15 at 09:18

score 0 · Accepted Answer · answered Jun 22 '15 at 09:08

0

It's complicated to use regex, a stupid way I suggested:

def remove_table(s):
    left_index = s.find('<table>')
    if -1 == left_index:
        return s
    right_index = s.find('</table>', left_index)
    return s[:left_index] + remove_table(s[right_index + 8:])

There may be some blank lines inside the result.

answered Jun 22 '15 at 09:08

LittleQ

1,740
11
14

thanks for your answer, i try your source code is working. your answer according to my case. – Road Name Jun 22 '15 at 09:59

3 Answers3