Skip to content

cant set up environment #119

New issue
New issue
Open
Open
cant set up environment#119

Description

@Nemunas
Nemunas
opened on May 11, 2023

mamba env create -f environment.yml
pytorch/linux-64 Using cache
pytorch/noarch Using cache
nvidia/linux-64 Using cache
nvidia/noarch Using cache
conda-forge/linux-64 Using cache
conda-forge/noarch Using cache
pkgs/main/linux-64 No change
pkgs/main/noarch No change
pkgs/r/linux-64 No change
pkgs/r/noarch No change
nvidia/label/cuda-11.8.0/linux-64 No change
https://aws-ml-conda-pre-prod-ec2.s3.us-west-2.a.. No change
nvidia/label/cuda-11.8.0/noarch No change
https://aws-ml-conda-pre-prod-ec2.s3.us-west-2.a.. No change

Looking for: ['cudatoolkit=11.6.0', 'cupy=10.4.0', 'faiss-gpu=1.7.2', 'fastparquet=0.5.0', 'nccl=2.12.12.1', 'pip=22.3.1', 'pyarrow=8.0.0', 'python=3.10.9', 'python-snappy=0.6.1', 'pytorch=1.13.1', 'pytorch-cuda=11.6', 'snappy=1.1.9', 'torchaudio=0.13.1', 'torchvision=0.14.1']

Could not solve for environment specs
Encountered problems while solving:

  • package nccl-2.12.12.1-h1a5f58c_0 is excluded by strict repo priority
  • package fastparquet-0.5.0-py36h92226af_0 requires python_abi 3.6.* *_cp36m, but none of the providers can be installed
  • package faiss-gpu-1.7.2-py3.6_h98e120b_0_cuda10.2 requires libfaiss 1.7.2 hdbd6f0c_0_cuda10.2, but none of the providers can be installed

The environment can't be solved, aborting the operation

Activity

  1. Nemunas commented on May 11, 2023

    @Nemunas
    Nemunas
    on May 11, 2023
    Author

    solved by running:
    conda config --set channel_priority false

  2. darrinh commented on May 12, 2023

    @darrinh
    darrinh
    on May 12, 2023

    Also having a problem with env setup. Intially installed on my 22.04 ubuntu desktop and it work without issue. Did a fresh install of 22.04 desktop on a new machine and get the following error:
    Could not solve for environment specs The following packages are incompatible ├─ fastparquet 0.6.3** is installable with the potential options │ ├─ fastparquet 0.6.3 would require │ │ ├─ python >=3.6,<3.7.0a0 , which can be installed; │ │ └─ python_abi 3.6.* *_cp36m, which can be installed; │ ├─ fastparquet 0.6.3 would require │ │ ├─ python >=3.7,<3.8.0a0 , which can be installed; │ │ └─ python_abi 3.7.* *_cp37m, which can be installed; │ ├─ fastparquet 0.6.3 would require │ │ ├─ python >=3.8,<3.9.0a0 , which can be installed; │ │ └─ python_abi 3.8.* *_cp38, which can be installed; │ └─ fastparquet 0.6.3 would require │ ├─ python >=3.9,<3.10.0a0 , which can be installed; │ └─ python_abi 3.9.* *_cp39, which can be installed; └─ python 3.10.9** is uninstallable because there are no viable options ├─ python 3.10.9 conflicts with any installable versions previously reported; └─ python 3.10.9 would require └─ python_abi 3.10.* *_cp310, which conflicts with any installable versions previously reported.
    both desktops have the same version of python installed: 3.10.6.

    thanks
    Darrin

  3. darrinh commented on May 12, 2023

    @darrinh
    darrinh
    on May 12, 2023

    seemed to have fixed it by install python 3.9, odd i didn't have to do that on the first install.

  4. darrinh commented on May 13, 2023

    @darrinh
    darrinh
    on May 13, 2023

    Didn't really work in the end, seems to be an issue with python3.10.6 and/or Ubuntu 22.04. A fresh server install gives the same above error as a fresh desktop install.

  5. hagope commented on May 13, 2023

    @hagope
    hagope
    on May 13, 2023

    In my environment wsl2 I needed to downgrade to python 3.9 and upgrade to pytorch-cuda=11.7:

    $ uname -r
5.15.90.1-microsoft-standard-WSL2
$ lsb_release -a
No LSB modules are available.
Distributor ID: Ubuntu
Description:    Ubuntu 20.04.3 LTS
Release:        20.04
Codename:       focal

    conda install pytorch==1.13.1 torchvision==0.14.1 torchaudio==0.13.1 pytorch-cuda=11.7 -c pytorch -c nvidia

    Also, I had to pass in memory parameters to run on my RTX 3060 12gb
    python inference/bot.py --model togethercomputer/Pythia-Chat-Base-7B -g 0:11 -r 30
    first number is VRAM limit (11gb), second is cpu RAM (30gb)

  6. darrinh commented on May 14, 2023

    @darrinh
    darrinh
    on May 14, 2023

    Thanks, it installed cleanly on Ubuntu 20.04. I do have it installed on a 22.04 instance but that was a two or three weeks ago, so perhaps something has changed in the meantime.

  7. mauhcs commented on May 15, 2023

    @mauhcs
    mauhcs
    on May 15, 2023

    I have a similar (same?) issue.
    this is my output:

    ~/OpenChatKit$ mamba env create -f environment.yml
nvidia/noarch                                        3.5kB @  35.1kB/s  0.1s
pytorch/noarch                                      10.2kB @  96.5kB/s  0.1s
nvidia/linux-64                                    120.2kB @   1.0MB/s  0.1s
pytorch/linux-64                                   167.3kB @   1.1MB/s  0.2s
pkgs/main/noarch                                   822.9kB @   1.9MB/s  0.4s
pkgs/r/linux-64                                      1.4MB @   2.5MB/s  0.5s
pkgs/r/noarch                                        1.3MB @   2.3MB/s  0.6s
pkgs/main/linux-64                                   5.7MB @   3.5MB/s  1.5s
conda-forge/noarch                                  12.2MB @   4.5MB/s  3.7s
conda-forge/linux-64                                31.4MB @   4.4MB/s 10.6s


Looking for: ['cudatoolkit=11.6.0', 'cupy=10.4.0', 'faiss-gpu=1.7.2', 'fastparquet=0.6.3', 'nccl=2.12.12.1', 'pip=22.3.1', 'pyarrow=8.0.0', 'python=3.10.9', 'python-snappy=0.6.1', 'pytorch=1.13.1', 'pytorch-cuda=11.6', 'snappy=1.1.9', 'torchaudio=0.13.1', 'torchvision=0.14.1']


Could not solve for environment specs
The following packages are incompatible
├─ fastparquet 0.6.3**  is installable with the potential options
│  ├─ fastparquet 0.6.3 would require
│  │  ├─ python >=3.6,<3.7.0a0 , which can be installed;
│  │  └─ python_abi 3.6.* *_cp36m, which can be installed;
│  ├─ fastparquet 0.6.3 would require
│  │  ├─ python >=3.7,<3.8.0a0 , which can be installed;
│  │  └─ python_abi 3.7.* *_cp37m, which can be installed;
│  ├─ fastparquet 0.6.3 would require
│  │  ├─ python >=3.8,<3.9.0a0 , which can be installed;
│  │  └─ python_abi 3.8.* *_cp38, which can be installed;
│  └─ fastparquet 0.6.3 would require
│     ├─ python >=3.9,<3.10.0a0 , which can be installed;
│     └─ python_abi 3.9.* *_cp39, which can be installed;
└─ python 3.10.9**  is uninstallable because there are no viable options
   ├─ python 3.10.9 conflicts with any installable versions previously reported;
   └─ python 3.10.9 would require
      └─ python_abi 3.10.* *_cp310, which conflicts with any installable versions previously reported.

    As suggested by @darrinh, I changed the - python 3.10.9 line to - python 3.9 in the environment.yml file and I did not have the same error anymore

    After much tweaking, I feel it might be a conda/mamba issue with more recent versions.

    I would love to know your versions. Here are mine:

    mamba --version
mamba 1.4.2
conda 23.3.1

  8. mauhcs commented on May 15, 2023

    @mauhcs
    mauhcs
    on May 15, 2023

    The above comment was done in Ubuntu 20 LTS.
    But I still cannot make it run on MacOS.

    This is my output:

    mamba env create -f environment.yml
warning  libmamba Cache file "/Users/mau/miniconda3/pkgs/cache/7fb2ce72.json" was modified by another program
warning  libmamba Cache file "/Users/mau/miniconda3/pkgs/cache/3e39a7aa.json" was modified by another program
warning  libmamba Cache file "/Users/mau/miniconda3/pkgs/cache/dd44a73b.json" was modified by another program
warning  libmamba Cache file "/Users/mau/miniconda3/pkgs/cache/4ea078d6.json" was modified by another program
pytorch/osx-64                                                No change
pytorch/noarch                                                No change
nvidia/osx-64                                                 No change
nvidia/noarch                                                 No change
anaconda/osx-64                                               No change
anaconda/noarch                                               No change
pkgs/main/noarch                                   822.9kB @   1.0MB/s  0.3s
pkgs/r/noarch                                        1.3MB @   1.4MB/s  0.6s
pkgs/r/osx-64                                      820.9kB @ 799.1kB/s  0.2s
pkgs/main/osx-64                                     5.4MB @   3.2MB/s  1.4s
conda-forge/noarch                                  12.2MB @   4.3MB/s  2.7s
conda-forge/osx-64                                  28.3MB @   4.7MB/s  7.1s


Looking for: ['cudatoolkit=11.6.0', 'cupy=10.4.0', 'faiss-gpu=1.7.2', 'fastparquet=0.6.3', 'nccl=2.12.12.1', 'pip=22.3.1', 'pyarrow=8.0.0', 'python=3.9', 'python-snappy=0.6.1', 'pytorch=1.13.1', 'pytorch-cuda=11.6', 'snappy=1.1.9', 'torchaudio=0.13.1', 'torchvision=0.14.1']


Could not solve for environment specs
The following packages are incompatible
├─ cudatoolkit 11.6.0**  does not exist (perhaps a typo or a missing channel);
├─ cupy 10.4.0**  does not exist (perhaps a typo or a missing channel);
├─ faiss-gpu 1.7.2**  does not exist (perhaps a typo or a missing channel);
├─ nccl 2.12.12.1**  does not exist (perhaps a typo or a missing channel);
└─ pytorch-cuda 11.6**  is uninstallable because it requires
   └─ cuda 11.6.* , which does not exist (perhaps a missing channel).

    Mamba and Conda versions are the same as the ubuntu version:

    % mamba --version                      
mamba 1.4.2
conda 23.3.1

    Am I supposed to be able to install in MacOS to begin with?

  9. zuketo commented on May 16, 2023

    @zuketo
    zuketo
    on May 16, 2023

    To follow up on @mauhcs comment, this also fixed it for me:

    As suggested by @darrinh, I changed the - python 3.10.9 line to - python 3.9 in the environment.yml file and I did not have the same error anymore

  10. mgleavitt commented on May 18, 2023

    @mgleavitt
    mgleavitt
    on May 18, 2023

    I'm seeing pretty much the same thing as @mauhcs on my Mac
    The Python version in my base env is 3.10.11

    (bold == red/error text)
    Could not solve for environment specs
    The following packages are incompatible
    ├─ cudatoolkit 11.6.0 does not exist (perhaps a typo or a missing channel);**
    ├─ cupy 10.4.0 does not exist (perhaps a typo or a missing channel);**
    ├─ faiss-gpu 1.7.2 does not exist (perhaps a typo or a missing channel);**
    ├─ fastparquet 0.6.3** is installable with the potential options
    │ ├─ fastparquet 0.6.3 would require
    │ │ ├─ python >=3.6,<3.7.0a0 , which can be installed;
    │ │ └─ python_abi 3.6.* _cp36m, which can be installed;
    │ ├─ fastparquet 0.6.3 would require
    │ │ ├─ python >=3.7,<3.8.0a0 , which can be installed;
    │ │ └─ python_abi 3.7.     _cp37m, which can be installed;
    │ ├─ fastparquet 0.6.3 would require
    │ │ ├─ python >=3.8,<3.9.0a0 , which can be installed;
    │ │ └─ python_abi 3.8.     _cp38, which can be installed;
    │ └─ fastparquet 0.6.3 would require
    │ ├─ python >=3.9,<3.10.0a0 , which can be installed;
    │ └─ python_abi 3.9.     _cp39, which can be installed;
    ├─ nccl 2.12.12.1 does not exist (perhaps a typo or a missing channel);    *
    ├─ python 3.10.9 is uninstallable because there are no viable options**
    │ ├─ python 3.10.9 conflicts with any installable versions previously reported;
    │ └─ python 3.10.9 would require
    │ └─ python_abi 3.10. _cp310, which conflicts with any installable versions previously reported;
    └─ pytorch-cuda 11.6 is uninstallable because it requires**
    └─ cuda 11.6. , which does not exist (perhaps a missing channel).*

  11. orangetin commented on May 24, 2023

    @orangetin
    orangetin
    on May 24, 2023
    Contributor

    @mauhcs @mgleavitt see this comment to setup the env for Mac

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions