IOPub data rate exceeded in Jupyter notebook (when viewing image)

Question

I want to view an image in Jupyter notebook. It's a 9.9MB .png file.

from IPython.display import Image
Image(filename='path_to_image/image.png')

I get the below error:

IOPub data rate exceeded.
The notebook server will temporarily stop sending output
to the client in order to avoid crashing it.

A bit surprising and reported elsewhere.

Is this expected and is there a simple solution?

(Error msg suggests changing limit in --NotebookApp.iopub_data_rate_limit.)

Is there a way to increase this from just the notebook itself instead of changing the config on the command line? I'm working in a shared environment and don't have rights to change jupyter on the command line. — Mike Pone, Nov 23 '21 at 14:40

Merlin · Accepted Answer · 2018-10-23T17:36:56.830

169

Try this:

jupyter notebook --NotebookApp.iopub_data_rate_limit=1.0e10

Or this:

yourTerminal:prompt> jupyter notebook --NotebookApp.iopub_data_rate_limit=1.0e10

edited Oct 23 '18 at 17:36

answered Jun 21 '17 at 14:40

Merlin

22,195
35
117
197

4

If your just looking for a temporary solution this is the easiest way to go. – mkrinblk Jul 13 '17 at 23:05
15

If I could, I would give a second upvote for using the scientific notation. – Tomasz Gandor Oct 16 '17 at 22:31
1

@TomaszGandor Although by doing so, it is a float now instead of an int. This could have undesirable effects in general, but it's probably fine here. – scottlittle Nov 07 '17 at 14:39
2

where can you run this code if you use Anaconda user interface to open up a Jupyter Notebook? – bernando_vialli Jun 25 '18 at 16:34
5

Can anyone help? I keep on trying to figure out where to put this? – bernando_vialli Aug 29 '18 at 17:41
2

I used the prompt under "Try this:" and now I can barely use Jupyter. How can I reverse it? – Tyrone_Slothrop Aug 05 '20 at 21:50
You need to put this in Anaconda prompt – Mateusz Oct 23 '21 at 08:42
This needs to go in terminal. Both his commands are the same. Needs a terminal to execute it. – Suprateem Banerjee Nov 29 '21 at 01:02
I use "jupyter lab" rather than "jupyter notebook". Note well that I don't actually really _understand_ what either is, other than that "jupyter lab is a thing that pops up my browser and allows me to type and execute python-like sagemath code with powerful multiprecision primitives". How does this answer translate to my use case? I was trying to print a huge string and ran into this error. – Szczepan Hołyszewski Apr 26 '22 at 17:30

Itay Livni · Answer 2 · 2017-12-15T04:40:53.840

95

I ran into this using networkx and bokeh

This works for me in Windows 7 (taken from here):

To create a jupyter_notebook_config.py file, with all the defaults commented out, you can use the following command line:

$ jupyter notebook --generate-config
Open the file and search for c.NotebookApp.iopub_data_rate_limit
Comment out the line c.NotebookApp.iopub_data_rate_limit = 1000000 and change it to a higher default rate. l used c.NotebookApp.iopub_data_rate_limit = 10000000

This unforgiving default config is popping up in a lot of places. See git issues:

It looks like it might get resolved with the 5.1 release

Update:

Jupyter notebook is now on release 5.2.2. This problem should have been resolved. Upgrade using conda or pip.

edited Dec 15 '17 at 04:40

answered Apr 14 '17 at 23:12

Itay Livni

2,063
23
37

2

After creating the config file, you can run `jupiter notebook`; since the jupyter_notebook_config.py was written to your Jupyter folder (for me: C:\Users\nnd\.jupyter\jupyter_notebook_config.p) ; Jupyter will pick up your changes. – The Red Pea May 07 '17 at 22:36
2

If you cannot run jupyter notebook from cmd.exe (windows 10), try doing so from 'Anaconda prompt' (if you have that installed). – andyw Aug 30 '17 at 10:58
2

@Itay Livni: my windows command line doesn't recognise the command `$ jupyter notebook --generate-config` and says the command is either wrong or couldn't be found. I have windows 10. any suggestions? – artre Oct 22 '17 at 11:00
2

@artre `notebook --generate-config` should be typed. not the dollar sign – Itay Livni Oct 22 '17 at 15:00
@ItayLivni I tried that. but also without the dollar sign i get the same error message. – artre Oct 22 '17 at 16:10
1

@artre You should browse to the location of your jupyter,exe and then run the command provided above. For me it was in `\documents\anaconda2\scripts` – Salain Nov 21 '17 at 16:51
Release 5.2.2 is not in the changelog. The default config is the same in my 6.4.9 version. – liakoyras Mar 16 '22 at 12:55

score 21 · Answer 3 · answered Feb 02 '21 at 02:55

21

Removing print statements can also fix the problem.

Apart from loading images, this error also happens when your code is printing continuously at a high rate, which is causing the error "IOPub data rate exceeded". E.g. if you have a print statement in a for loop somewhere that is being called over 1000 times.

answered Feb 02 '21 at 02:55

azizbro

1,814
3
14
23

1

Amazinng It works perfactly for me. Thanks @azizbro
`import pandas as pd df=pd.DataFrame() df = pd.read_json('applicant-schema.json') #print(df.to_string()) ` – prashant thakre Feb 15 '22 at 05:22

score 6 · Answer 4 · edited Jan 18 '20 at 03:18

6

By typing 'jupyter notebook --NotebookApp.iopub_data_rate_limit=1.0e10' in Anaconda PowerShell or prompt, the Jupyter notebook will open with the new configuration. Try now to run your query.

edited Jan 18 '20 at 03:18

Merlin

22,195
35
117
197

answered Dec 20 '19 at 22:58

munzer manzlgi

61
1
1

score 5 · Answer 5 · answered May 22 '20 at 11:27

Some additional advice for Windows(10) users:

If you are using Anaconda Prompt/PowerShell for the first time, type "Anaconda" in the search field of your Windows task bar and you will see the suggested software.
Make sure to open the Anaconda prompt as administrator.
Always navigate to your user directory or the directory with your Jupyter Notebook files first before running the command. Otherwise you might end up somewhere in your system files and be confused by an unfamiliar file tree.

The correct way to open Jupyter notebook with new data limit from the Anaconda Prompt on my own Windows 10 PC is:

(base) C:\Users\mobarget\Google Drive\Jupyter Notebook>jupyter notebook --NotebookApp.iopub_data_rate_limit=1.0e10

score 1 · Answer 6 · answered Jun 30 '21 at 14:41

1

For already running docker containers, try editing the file name - ~/.jupyter/jupyter_notebook_config.py uncomment the line - NotebookApp.iopub_data_rate_limit = and set high number like 1e10. Restart the docker, it should fix the problem

answered Jun 30 '21 at 14:41

Sincole Brans

166
11

score 1 · Answer 7 · answered Sep 24 '21 at 19:48

I ran into this problem running version 6.3.0. When I tried the top rated solution by Merlin the powershell prompt notified me that iopub_data_rate_limit has moved from NotebookApp to ServerApp. The solution still worked but wanted to mention the variation, especially as internal handling of the config may become deprecated.

score 0 · Answer 8 · answered Feb 24 '22 at 02:07

Easy workaround is to create a for loop and print. Then there wont be any issue. Printing directly wcc would cause if graph is huge. Hence any of below code will work as workaround.

wcc=list(nx.weakly_connected_components(train_graph)) for i in range(1,10): print(wcc[i])

for i in wcc): print(wcc)

Skynet · Answer 9 · 2022-04-19T19:20:42.573

0

Using Visual Studio Code, the Jupyter extension will be able to handle big data. launch from anaconda navigator

edited Apr 19 '22 at 19:20

answered Mar 24 '22 at 16:23

Skynet

15
5

score 0 · Answer 10 · answered Apr 19 '22 at 15:31

0

Like others pointed out, print statement at a high rate can cause this. Resolve it by printing modulo a number using if statement. Example in python:

k = 10
if (i % k == 0):
   print("Something")

Increase k if the warning persists.

answered Apr 19 '22 at 15:31

Toonia

1

score 0 · Answer 11 · answered Apr 29 '22 at 00:51

0

In general, trying to print something that is too long will trigger this error. I tried to print a string that was 9221593 characters long (too long), and that triggered the error.

answered Apr 29 '22 at 00:51

Javier Marchena Hurtado

1

IOPub data rate exceeded in Jupyter notebook (when viewing image)

11 Answers11

Update:

Linked