Large csv pandas memory error

Question

I'm running exactly the same one line code on two similar machines to read a 1 GB csv file.

dataframe = pd.read_csv('url_here', delimiter='|')

One machine reads it correctly, the other one gives me an empty memory error ("MemoryError:")

Both machines have 8 GB ram and an i7 processor.

What could cause this? Is there a way to increase memory availability for Python?

Thanks!

whats your `out_shape`? Also, see http://stackoverflow.com/questions/19085280/pandas-merge-error-memoryerror — agconti, Dec 04 '13 at 16:49
Working machine: Windows 8 (64b) laptop, iPython 1.0 Not working machine: Windows 7, desktop, iPython 1.0 — Alexis Eggermont, Dec 04 '13 at 21:27

score 1 · Answer 1 · edited Mar 13 '14 at 19:27

1

Try using low_memory=False:

dataframe = pd.read_csv('url_here', delimiter='|', low_memory=False)

edited Mar 13 '14 at 19:27

chopper

answered Mar 13 '14 at 19:07

Shravan

1 Answers1