Get absolute paths of all files in a directory

Question

How do I get the absolute paths of all the files in a directory that could have many sub-folders in Python?

I know os.walk() recursively gives me a list of directories and files, but that doesn't seem to get me what I want.

Could you give an example of what input and output you expect — cwallenpoole, Mar 22 '12 at 05:18

score 91 · Accepted Answer · edited Jan 22 '21 at 03:33

91

os.path.abspath makes sure a path is absolute. Use the following helper function:

import os

def absoluteFilePaths(directory):
    for dirpath,_,filenames in os.walk(directory):
        for f in filenames:
            yield os.path.abspath(os.path.join(dirpath, f))

edited Jan 22 '21 at 03:33

Danny Varod

16,559
5
66
105

answered Mar 22 '12 at 05:20

phihag

263,143
67
432
458

4

I think it is nicer to do the abspath just once, on the `os.walk` line, than to do it N times inside the loop – wim Mar 22 '12 at 05:29
1

That works, but only by "accident". Reading `os.path.join`'s contract, I cannot find any place that guarantees that the result is absolute if one of the arguments is, although that's a sensible assumption. – phihag Mar 22 '12 at 05:32
1

@phihag That's reliable. It is not "accident", and the language is not so formal as to have any notion of "contracts" in the docs. It's documented that *if a component is an absolute path, all previous components are thrown away and joining continues from the absolute path component.* Python cannot invisibly transform into a relative path here, and it would be impossible to modify the behavior without a huge backwards breaking change. If still not convinced, you can even just read the source of `os.path.join`, which is short and simple. – wim Mar 14 '19 at 15:33

wim · Answer 2 · 2019-03-14T15:34:55.667

31

If the argument given to os.walk is absolute, then the root dir names yielded during iteration will also be absolute. So, you only need to join them with the filenames:

import os

for root, dirs, files in os.walk(os.path.abspath("../path/to/dir/")):
    for file in files:
        print(os.path.join(root, file))

edited Mar 14 '19 at 15:34

answered Mar 22 '12 at 05:19

wim

302,178
90
548
690

Okay, I see what you mean, just I didn't want the files, but wanted specific subdirs. I've posted the solution below. – Eamonn Kenny Feb 19 '16 at 10:25

MSeifert · Answer 3 · 2017-08-30T12:27:16.880

27

If you have Python 3.4 or newer you can use pathlib (or a third-party backport if you have an older Python version):

import pathlib
for filepath in pathlib.Path(directory).glob('**/*'):
    print(filepath.absolute())

edited Aug 30 '17 at 12:27

answered Aug 30 '17 at 12:13

MSeifert

133,177
32
312
322

4

This is very nice that it uses python 3, but it also shows directories. – Newskooler Mar 06 '19 at 22:05

score 10 · Answer 4 · answered Mar 22 '12 at 05:25

10

Try:

import os

for root, dirs, files in os.walk('.'):
    for file in files:
        p=os.path.join(root,file)
        print p
        print os.path.abspath(p)
        print

answered Mar 22 '12 at 05:25

the wolf

32,251
12
52
71

Anyway to do this without capturing hidden files? – Marcel Marino Dec 12 '13 at 19:11
@MarcelMarino `if not file.startswith('.')` – A.Wan Oct 28 '15 at 20:46

score 8 · Answer 5 · answered Jun 19 '20 at 20:36

8

Starting with python 3.5 the idiomatic solution would be:

import os

def absolute_file_paths(directory):
    path = os.path.abspath(directory)
    return [entry.path for entry in os.scandir(path) if entry.is_file()]

This not just reads nicer but also is faster in many cases. For more details (like ignoring symlinks) see original python docs: https://docs.python.org/3/library/os.html#os.scandir

answered Jun 19 '20 at 20:36

Titusz

1,427
1
21
30

scandir() is not recursive – crypdick Dec 10 '21 at 01:40

Blender · Answer 6 · 2012-03-22T05:32:10.360

8

You can use os.path.abspath() to turn relative paths into absolute paths:

file_paths = []

for folder, subs, files in os.walk(rootdir):
  for filename in files:
    file_paths.append(os.path.abspath(os.path.join(folder, filename)))

edited Mar 22 '12 at 05:32

answered Mar 22 '12 at 05:19

Blender

275,078
51
420
480

1

doesn't this join the `cwd` to `filename`, when you want to join the `folder`?! – wim Mar 22 '12 at 05:27

score 5 · Answer 7 · edited Jun 24 '20 at 05:50

5

All files and folders:

x = [os.path.abspath(os.path.join(directory, p)) for p in os.listdir(directory)]

Images (.jpg | .png):

x = [os.path.abspath(os.path.join(directory, p)) for p in os.listdir(directory) if p.endswith(('jpg', 'png'))]

edited Jun 24 '20 at 05:50

Abhijeet Kasurde

3,570
1
23
32

answered Nov 03 '19 at 08:28

user3041840

314
4
8

how do you make sure it's only files not directories in this oneliner? – Doons Mar 17 '20 at 12:27

score 2 · Answer 8 · edited May 22 '18 at 12:39

2

from glob import glob


def absolute_file_paths(directory):
    return glob(join(directory, "**"))

edited May 22 '18 at 12:39

MBT

17,959
17
76
99

answered May 22 '18 at 11:20

AmjadHD

135
5

6

While this code might answer the question you still might consider adding a few explanatory sentences as this increases the value of your answer for other users. – MBT May 22 '18 at 11:38
1

This only works when you also import `join` from the `os` module, like so: `from os.path import join`. Doesn't do folders recursively. – martin-martin Apr 30 '20 at 15:45

Pygirl · Answer 9 · 2020-05-01T07:14:45.197

2

Try:

from pathlib import Path
path = 'Desktop'
files = filter(lambda filepath: filepath.is_file(), Path(path).glob('*'))
for file in files:
   print(file.absolute())

edited May 01 '20 at 07:14

answered Nov 08 '19 at 18:58

Pygirl

11,977
4
24
38

Your import statement imports `Path` directly, but then you call `pathlib.Path()` in the code. Currently doesn't run unless you fix that. Otherwise nice and clean solution @Pygirl. – martin-martin Apr 30 '20 at 15:49
In this example, there is no need to make `list` out of those files, filter returns a generator. – MaLiN2223 May 01 '20 at 07:02
1

@MaLiN2223: Yeah it's true but I want to store the file list because when the generator is exhaust then files will give none. Anyway I have updated my answer :) – Pygirl May 01 '20 at 07:17

score 0 · Answer 10 · edited Sep 14 '16 at 17:01

I wanted to keep the subdirectory details and not the files and wanted only subdirs with one xml file in them. I can do it this way:

for rootDirectory, subDirectories, files in os.walk(eventDirectory):
  for subDirectory in subDirectories:
    absSubDir = os.path.join(rootDirectory, subDirectory)
    if len(glob.glob(os.path.join(absSubDir, "*.xml"))) == 1:
      print "Parsing information in " + absSubDir

score 0 · Answer 11 · answered Sep 27 '18 at 11:40

0

for root, directories, filenames in os.walk(directory):
 for directory in directories:
         print os.path.join(root, directory)
 for filename in filenames:
     if filename.endswith(".JPG"):
        print filename
        print os.path.join(root,filename)

answered Sep 27 '18 at 11:40

Robert A

327
4
3

2

While this might answer the authors question, it lacks some explaining words and links to documentation. Raw code snippets are not very helpful without some phrases around it. You may also find [how to write a good answer](https://stackoverflow.com/help/how-to-answer) very helpful. Please edit your answer. – hellow Sep 27 '18 at 13:44

score 0 · Answer 12 · answered Apr 10 '22 at 14:28

0

glob library will give you what you need directly:

from glob import glob
list_of_files = glob('your/directory/*')

answered Apr 10 '22 at 14:28

Maiia Bocharova

29
3

score -1 · Answer 13 · answered Feb 24 '22 at 11:44

-1

Try This

pth=''
types=os.listdir(pth)
for type_ in types:
     file_names=os.listdir(f'{pth}/{type_}')
     file_names=list(map(lambda x:f'{pth}/{type_}/{x}',file_names))
     train_folder+=file_names

answered Feb 24 '22 at 11:44

Tom Huang

1
1

Get absolute paths of all files in a directory

13 Answers13

Linked