Simplest way to get the equivalent of "find ." in python?

Question

What is the simplest way to get the full recursive list of files inside a folder with python? I know about os.walk(), but it seems overkill for just getting the unfiltered list of all files. Is it really the only option?

Does this answer your question? [Recursive sub folder search and return files in a list python](https://stackoverflow.com/questions/18394147/recursive-sub-folder-search-and-return-files-in-a-list-python) — Tomerikoo, Nov 16 '21 at 15:08

score 18 · Accepted Answer · edited Sep 14 '12 at 09:00

18

There's nothing preventing you from creating your own function:

import os

def listfiles(folder):
    for root, folders, files in os.walk(folder):
        for filename in folders + files:
            yield os.path.join(root, filename)

You can use it like so:

for filename in listfiles('/etc/'):
    print filename

edited Sep 14 '12 at 09:00

Lauritz V. Thaulow

45,713
12
68
88

answered Sep 14 '12 at 08:43

Blender

275,078
51
420
480

Thanks! I just wanted to make sure this function wasn't already a part of the standard library. – static_rtti Sep 14 '12 at 08:43
Nice solution! But `find .` also lists directories. The fix is very easy though. :) – Lauritz V. Thaulow Sep 14 '12 at 08:55

Martijn Pieters · Answer 2 · 2012-09-14T09:07:59.543

12

os.walk() is not overkill by any means. It can generate your list of files and directories in a jiffy:

files = [os.path.join(dirpath, filename)
    for (dirpath, dirs, files) in os.walk('.')
    for filename in (dirs + files)]

You can turn this into a generator, to only process one path at a time and safe on memory.

edited Sep 14 '12 at 09:07

answered Sep 14 '12 at 08:45

Martijn Pieters

963,270
265
3,804
3,187

score 3 · Answer 3 · answered Sep 14 '12 at 21:03

3

You could also use the find program itself from Python by using sh

import sh
text_files = sh.find(".", "-iname", "*.txt")

answered Sep 14 '12 at 21:03

amoffat

658
4
12

score 1 · Answer 4 · answered Sep 14 '12 at 08:36

Either that or manually recursing with isdir() / isfile() and listdir() or you could use subprocess.check_output() and call find .. Bascially os.walk() is highest level, slightly lower level is semi-manual solution based on listdir() and if you want the same output find . would give you for some reason you can make a system call with subprocess.

score 1 · Answer 5 · answered Nov 16 '21 at 14:56

1

pathlib.Path.rglob is pretty simple. It lists the entire directory tree

(The argument is a filepath search pattern. "*" means list everything)

import pathlib


for path in pathlib.Path("directory_to_list/").rglob("*"):
    print(path)

answered Nov 16 '21 at 14:56

Miłosz Łakomy

986
4
12

score 0 · Answer 6 · answered Sep 14 '12 at 08:44

0

import os
path = "path/to/your/dir"
for (path, dirs, files) in os.walk(path):
    print files

Is this overkill, or am I missing something?

answered Sep 14 '12 at 08:44

verbsintransit

868
3
8
17

You are absolutely right. It looks way more difficult than it actually is. – Hans Then Sep 14 '12 at 09:40

Simplest way to get the equivalent of "find ." in python?

6 Answers6