How can I install packages using pip according to the requirements.txt file from a local directory?

Question

Here is the problem:

I have a requirements.txt file that looks like:

BeautifulSoup==3.2.0
Django==1.3
Fabric==1.2.0
Jinja2==2.5.5
PyYAML==3.09
Pygments==1.4
SQLAlchemy==0.7.1
South==0.7.3
amqplib==0.6.1
anyjson==0.3
...

I have a local archive directory containing all the packages + others.

I have created a new virtualenv with

bin/virtualenv testing

Upon activating it, I tried to install the packages according to requirements.txt from the local archive directory.

source bin/activate
pip install -r /path/to/requirements.txt -f file:///path/to/archive/

I got some output that seems to indicate that the installation is fine:

Downloading/unpacking Fabric==1.2.0 (from -r ../testing/requirements.txt (line 3))
  Running setup.py egg_info for package Fabric
    warning: no previously-included files matching '*' found under directory 'docs/_build'
    warning: no files found matching 'fabfile.py'
Downloading/unpacking South==0.7.3 (from -r ../testing/requirements.txt (line 8))
  Running setup.py egg_info for package South
....

But a later check revealed that none of the packages are installed properly. I cannot import the packages, and none are found in the site-packages directory of my virtualenv. So what went wrong?

Have you tried using `--no-index` so it does not even look at PyPI? — Hugo Tavares, Sep 08 '11 at 05:15
You've snipped the error message. It's generally near the bottom. — bukzor, May 05 '14 at 14:47
You could use the file paths instead of the package names, it means you'll have to change the requirements.txt file, but keep the pip install command the same. — asafge, Nov 18 '14 at 08:41
surprised nobody else linked but https://pip.pypa.io/en/stable/user_guide/#requirements-files — MrMesees, Apr 25 '16 at 08:17
I'm wondering... did your local archive contain the exact same versions of the packages that were specified in `requirements.txt`? — Kay, Dec 19 '16 at 09:30

score 1810 · Answer 1 · edited Apr 24 '22 at 20:38

1810

This works for everyone:

pip install -r /path/to/requirements.txt

Explanation:

-r, --requirement < filename >

Install from the given requirements file. This option can be used multiple times.

edited Apr 24 '22 at 20:38

George K. Wright

57
1
6

answered Mar 24 '13 at 00:47

Mike Lyons

18,740
2
14
16

378

I realize this answer doesn't address the original question, but it answers the question I had when I found this on Google... – Jonathan Dec 15 '13 at 05:50
94

for those who like to know what they type, the -r in the command just means "install from a requirements file", and is a shortcut for --requirement – Florent Chatterji Oct 06 '16 at 14:04
4

When I want to upgrade a package (e.g. Django), I change the version in my requirements.txt file and then run `pip install -r /path/to/requirements.txt`. This detects the change, upgrades the package, and leaves everything else alone. – User May 01 '17 at 08:55
pip freeze > requirements.txt – nda Mar 26 '20 at 16:04
3

while this usually works, a couple subtleties makes it fail. If any install failed for the packages in `requirements.txt`, none of them will be installed. If a required module imports a dependency during its installation (instead of just listing it as a requirement), it will fail even if the dependency precedes it in the list of dependencies, causing all modules to fail. It is probably a bug to import a dependent module during installation, but it is also possibly unexpected that the dependencies listed in `requirements.txt` aren't installed sequentially, but all at once. – iggie May 11 '20 at 19:30
In an app that has a `Django` backend and `Angular` frontend, should the `requirements.txt` file be in the root directory (and run there with `py -m pip install -r requirements.txt`) or should it be in the backend folder where files such as `manage.py` are located? – Reem Al-Assaf Dec 11 '21 at 11:35
1

@ReemAl-Assaf it doesn't matter that much. Some people prefer to keep a `package.json` and `requirements.txt` in the top level directories for the entire project, or in the sub directories where language specific things take over. It's your choice at this point. – Mike Lyons Mar 14 '22 at 23:12

score 1065 · Accepted Answer · edited Jan 28 '21 at 19:58

1065

This works for me:

$ pip install -r requirements.txt --no-index --find-links file:///tmp/packages

--no-index - Ignore package index (only looking at --find-links URLs instead).

-f, --find-links <URL> - If a URL or path to an HTML file, then parse for links to archives.

If a local path or file:// URL that's a directory, then look for archives in the directory listing.

edited Jan 28 '21 at 19:58

Peter Mortensen

30,030
21
100
124

answered May 03 '12 at 10:04

codeape

94,365
23
147
176

8

**Information on `--no-index` from command pip help install** `--no-index` Ignore package index (only looking at `--find-links` URLs instead). **Information on `--find-links` from command pip help install** `-f`, `--find-links ` If a url or path to an html file, then parse for links to archives. If a local path or file:// url that's a directory, then look for archives in the directory listing. – AWrightIV Apr 03 '15 at 18:54
1

// , This could be a very elegant solution, especially given the eternal struggle with vendorizing: http://bitprophet.org/blog/2012/06/07/on-vendorizing/ – Nathan Basanese Apr 04 '16 at 06:40
One caution with this is you may `pip install ` without using `requirements.txt` but that will not update `requirements.txt`. An alternative might be updating a docker such that it lists all the pip install commands that are run to install dependencies. – ampersands Feb 22 '18 at 23:05
1

i tried this `python -m pip install -r requirements.txt` when inside the activated venv enviroment. things installed smoothly but when i do pip list it does not show that packages, when I am in the active venv or even after deactivate venv. also not able to use that packages. dont know what's wrong here – Shreyan Mehta Feb 12 '19 at 09:53
Are you sure ``python`` refers to the activated environment's python executable (``$ which python``)? – codeape Feb 12 '19 at 13:27
1

Just a heads up: This will work as long as there's not `git+ssh` requirement in the `requirements.txt`. For the `git+ssh` pip will still try to fetch the package – John Paraskevopoulos Jul 20 '20 at 15:18

score 175 · Answer 3 · edited Jan 28 '21 at 20:00

175

For virtualenv to install all files in the requirements.txt file.

cd to the directory where requirements.txt is located
activate your virtualenv
run: pip install -r requirements.txt in your shell

edited Jan 28 '21 at 20:00

Peter Mortensen

30,030
21
100
124

answered Feb 26 '14 at 15:38

Aaron Lelevier

18,600
11
68
105

4

"pyenv virtualenv pip install requirements.txt not working" for the sake of Google... – Jerad Jul 23 '16 at 04:17
1

pip3 install -r requirements.txt worked for me in venv – Rohit Singh Aug 10 '20 at 22:38
`pip3 install -r requirements.txt` – AnonymousUser Jan 07 '22 at 05:37

score 73 · Answer 4 · edited Jan 28 '21 at 20:06

73

I had a similar problem. I tried this:

    pip install -U -r requirements.txt

(-U = update if it had already installed)

But the problem continued. I realized that some of generic libraries for development were missed.

    sudo apt-get install libtiff5-dev libjpeg8-dev zlib1g-dev liblcms2-dev libwebp-dev tcl8.6-dev tk8.6-dev python-tk

I don't know if this would help you.

edited Jan 28 '21 at 20:06

Peter Mortensen

30,030
21
100
124

answered Jan 23 '16 at 22:08

enriquetaso

867
6
8

score 50 · Answer 5 · edited Jan 28 '21 at 20:08

Use:

pip install -r requirements.txt

For further details, please check the help option:

pip install --help

We can find the option '-r' -

-r, --requirement Install from the given requirements file. This option can be used multiple times.

Further information on some commonly used pip install options (this is the help option on the pip install command):

Also the above is the complete set of options. Please use pip install --help for the complete list of options.

Safwan · Answer 6 · 2019-05-06T09:55:08.077

Short answer

pip install -r /path/to/requirements.txt

or in another form:

python -m pip install -r /path/to/requirements.txt

Explanation

Here, -r is short form of --requirement and it asks the pip to install from the given requirements file.

pip will start installation only after checking the availability of all listed items in the requirements file and it won't start installation even if one requirement is unavailable.

One workaround to install the available packages is installing listed packages one by one. Use the following command for that. A red color warning will be shown to notify you about the unavailable packages.

cat requirements.txt | xargs -n 1 pip install

To ignore comments (lines starting with a #) and blank lines, use:

cat requirements.txt | cut -f1 -d"#" | sed '/^\s*$/d' | xargs -n 1 pip install

score 28 · Answer 7 · edited Jan 28 '21 at 21:36

28

First of all, create a virtual environment.

In Python 3.6

virtualenv --python=/usr/bin/python3.6 <path/to/new/virtualenv/>

In Python 2.7

virtualenv --python=/usr/bin/python2.7 <path/to/new/virtualenv/>

Then activate the environment and install all the packages available in the requirement.txt file.

source <path/to/new/virtualenv>/bin/activate
pip install -r <path/to/requirement.txt>

edited Jan 28 '21 at 21:36

Peter Mortensen

30,030
21
100
124

answered Oct 20 '19 at 11:59

Girish Vas

620
1
8
20

2

Thanks. For windows user, to activate environment use this command : `/Scripts/activate.bat`. To deactivate environment, use this : `/Scripts/deactivate.bat`. – ibnɘꟻ Oct 16 '20 at 04:00

score 23 · Answer 8 · edited Nov 25 '15 at 17:06

23

Often, you will want a fast install from local archives, without probing PyPI.

First, download the archives that fulfill your requirements:

$ pip install --download <DIR> -r requirements.txt

Then, install using –find-links and –no-index:

$ pip install --no-index --find-links=[file://]<DIR> -r requirements.txt

edited Nov 25 '15 at 17:06

mkobit

39,564
9
145
144

answered Sep 22 '15 at 06:27

Jadav Bheda

4,571
1
27
28

`no such option: --download` – Max Malysh May 15 '20 at 20:22
1

In newer versions of pip `pip install --download` has to be `pip download`. – stackprotector Nov 24 '20 at 14:35

score 22 · Answer 9 · edited Jan 28 '21 at 20:18

22

Try this:

python -m pip install -r requirements.txt

edited Jan 28 '21 at 20:18

Peter Mortensen

30,030
21
100
124

answered Jan 28 '19 at 15:40

3

An explanation would be in order. – Peter Mortensen Jan 28 '21 at 20:18

score 15 · Answer 10 · edited Jan 28 '21 at 20:13

I work with a lot of systems that have been mucked by developers "following directions they found on the Internet". It is extremely common that your pip and your python are not looking at the same paths/site-packages. For this reason, when I encounter oddness I start by doing this:

$ python -c 'import sys; print(sys.path)'
['', '/usr/lib/python2.7', '/usr/lib/python2.7/plat-x86_64-linux-gnu',
'/usr/lib/python2.7/lib-tk', '/usr/lib/python2.7/lib-old',
'/usr/lib/python2.7/lib-dynload', '/usr/local/lib/python2.7/dist-packages',
'/usr/lib/python2.7/dist-packages']

$ pip --version
pip 9.0.1 from /usr/local/lib/python2.7/dist-packages (python 2.7)

That is a happy system.

Below is an unhappy system. (Or at least it's a blissfully ignorant system that causes others to be unhappy.)

$ pip --version
pip 9.0.1 from /usr/local/lib/python3.6/site-packages (python 3.6)

$ python -c 'import sys; print(sys.path)'
['', '/usr/local/Cellar/python/2.7.13/Frameworks/Python.framework/Versions/2.7/lib/python27.zip',
'/usr/local/Cellar/python/2.7.13/Frameworks/Python.framework/Versions/2.7/lib/python2.7',
'/usr/local/Cellar/python/2.7.13/Frameworks/Python.framework/Versions/2.7/lib/python2.7/plat-darwin',
'/usr/local/Cellar/python/2.7.13/Frameworks/Python.framework/Versions/2.7/lib/python2.7/plat-mac',
'/usr/local/Cellar/python/2.7.13/Frameworks/Python.framework/Versions/2.7/lib/python2.7/plat-mac/lib-scriptpackages',
'/usr/local/Cellar/python/2.7.13/Frameworks/Python.framework/Versions/2.7/lib/python2.7/lib-tk',
'/usr/local/Cellar/python/2.7.13/Frameworks/Python.framework/Versions/2.7/lib/python2.7/lib-old',
'/usr/local/Cellar/python/2.7.13/Frameworks/Python.framework/Versions/2.7/lib/python2.7/lib-dynload',
'/usr/local/lib/python2.7/site-packages']

$ which pip pip2 pip3
/usr/local/bin/pip
/usr/local/bin/pip3

It is unhappy because pip is (python3.6 and) using /usr/local/lib/python3.6/site-packages while python is (python2.7 and) using /usr/local/lib/python2.7/site-packages

When I want to make sure I'm installing requirements to the right python, I do this:

$ which -a python python2 python3
/usr/local/bin/python
/usr/bin/python
/usr/local/bin/python2
/usr/local/bin/python3

$ /usr/bin/python -m pip install -r requirements.txt

You've heard, "If it ain't broke, don't try to fix it." The DevOps version of that is, "If you didn't break it and you can work around it, don't try to fix it."

score 13 · Answer 11 · edited Jan 28 '21 at 20:17

13

Installing requirements.txt file inside virtual env with Python 3:

I had the same issue. I was trying to install the requirements.txt file inside a virtual environment. I found the solution.

Initially, I created my virtualenv in this way:

virtualenv -p python3 myenv

Activate the environment using:

source myenv/bin/activate

Now I installed the requirements.txt file using:

pip3 install -r requirements.txt

Installation was successful and I was able to import the modules.

edited Jan 28 '21 at 20:17

Peter Mortensen

30,030
21
100
124

answered Nov 10 '17 at 08:05

janu777

1,880
11
25

I faced this issue while installing the requirements file inside a virtual environment. I have now modified my response to address the issue – janu777 Jul 24 '18 at 06:28
1

Using Anaconda Python 3.6 on Windows, I had to do `virtualenv -p python myenv`, `myenv\Scripts\activate.bat`, `pip install -r requirements.txt` – bdforbes Aug 25 '18 at 06:13
1

Actually, on the contrary, this seems like the only answer that _does_ answer the part of the question about installing locally defined deps in `requirements.txt` to a virtualenv. Unless I am missing something? Anyway, thanks! – davnicwil Sep 19 '18 at 17:39

score 8 · Answer 12 · answered Dec 15 '21 at 22:42

8

Create virtual environment python3 -m venv virtual-env (For windows use python instead of python3)
Activate your virtual environment source virtual-env/bin/activate
Now install requirements pip install -r requirements.txt

answered Dec 15 '21 at 22:42

MD SHAYON

7,911
47
35

score 7 · Answer 13 · edited Oct 01 '19 at 06:22

7

pip install --user -r requirements.txt

OR

pip3 install --user -r requirements.txt

edited Oct 01 '19 at 06:22

4b0

20,627
30
92
137

answered Oct 01 '19 at 06:21

user1460675

367
3
9

is it possible to specify `--user` inside `requirements.txt` file? – liang Apr 04 '20 at 09:50
An explanation would be in order. – Peter Mortensen Jan 28 '21 at 20:19

score 5 · Answer 14 · answered Jan 31 '22 at 09:30

5

Use pip3 install -r requirements.txt But make sure the requirements.txt file has been pull from origin and not added to .gitignore

answered Jan 31 '22 at 09:30

Samuel Kamau

81
2
2

score 5 · Answer 15 · answered Feb 13 '22 at 11:03

5

In Windows, this can lead to less format-related path issues, if you have

c:\folder\subfolder\requirements.txt

cd c:\folder\subfolder 
pip install -r requirements.txt

answered Feb 13 '22 at 11:03

Lorenzo Bassetti

291
5
10

score -2 · Answer 16 · edited Aug 25 '21 at 05:39

-2

I have solved with running the below command:

py -m pip install ./requirements.txt

the above command will install all dependencies and libraries for the Django project.

edited Aug 25 '21 at 05:39

Suraj Rao

28,850
10
94
99

answered Aug 25 '21 at 05:37

Chatrughan Prasad

129
1
4

How can I install packages using pip according to the requirements.txt file from a local directory?

16 Answers16

Linked

Related