Jupyter notebook can't pickle while multiprocessing

Asked Mar 04 '19 at 14:59

Active Apr 23 '19 at 20:06

Viewed 605 times

I am trying to implement multiprocessing in Datalore however I can't understand why I get error while I am trying the standard example from the official documentation . Here is the example snippet:

from multiprocessing import Pool

def f(x):
    return x*x

if __name__ == '__main__':
    p = Pool(5)
    print(p.map(f, [1, 2, 3]))

And the error what I am getting is as follows:

PicklingError: Can't pickle <function f at 0x7fe4f81ef048>: attribute lookup f on __main__ failed

I don't know what is wrong because I do not use Pickle. Thanks in advance.

edited Apr 23 '19 at 20:06

shabunc

20,530
16
73
96

asked Mar 04 '19 at 14:59

Robert Kovacs

This question seems similar to yours. It also uses multiprocessing: https://stackoverflow.com/questions/8804830/python-multiprocessing-picklingerror-cant-pickle-type-function – solbs Apr 23 '19 at 20:06
you are getting `pickle`ing error because `multiprocessing` uses it internally – Azat Ibrakov Apr 23 '19 at 20:09
Cannot reproduce. Python 3.7.1, macOS 10.14 – ForceBru Apr 23 '19 at 20:10

Jupyter notebook can't pickle while multiprocessing

0 Answers0