I have a data folders in which having around 500 CSV files. I used recursive function to read CSVs in chunk of 10 and finding similar question in CSV. API takes around 10-15 min to read, merge csv and find similar question in chunks.
I want to make stream api which will send response whenever it finds similar questions while iterating in chunks.
And i want to integrate this api in angularjs.
I referred below link, Streaming data with Python and Flask
My Folder Structure
- root/app.py
- root/data/folder1/data.csv
- root/data/folder2/data.csv
- root/data/folder3/data.csv .....
- root/data/folderN/data.csv
