How to get a dict from scrapy item?

Question

I need the values in a dict. But item uses some abstraction on top of it. How to get the fields in a dict from an item ?

I know scrapy allows dict to be returned in place of item now. But I already am using item in my code, so how to convert it.

Have a look at [http://stackoverflow.com/questions/21945067/how-list-all-fields-of-an-class-in-python-and-no-methods][1] [1]: http://stackoverflow.com/questions/21945067/how-list-all-fields-of-an-class-in-python-and-no-methods — PenguMC, Aug 06 '15 at 12:54

Robert Moskal · Accepted Answer · 2015-08-06T14:10:09.853

8

It looks to me like :

class Product(scrapy.Item):
    name = scrapy.Field()


i = Product(name='foo)
print dict(i)

gets you a dictionary {'name': 'foo'}

vars(p)
p.__dict__

gets you: {'_values': {'name': 'foo'}}

If you don't want to create a new dictionary, just grab the _values key from the above:

vars(p)['_values']
p.__dict__['_values']

edited Aug 06 '15 at 14:10

answered Aug 06 '15 at 13:04

Robert Moskal

any reason not to use `p.__dict__['_values']` – user568109 Aug 06 '15 at 13:33
No, I just figured you only needed one example. I will add for clarity. – Robert Moskal Aug 06 '15 at 14:00

1 Answers1