Skip to content

psij-ci-setup not installing all dependencies  #318

Open
Open
psij-ci-setup not installing all dependencies #318

Description

@wilke
wilke
opened on Nov 4, 2022

  1. ./ ./psij-ci-setup

  2. ./psij-ci-run

     (/soft/datascience/conda/2022-09-08/psij) awilke@polaris-login-02:~/ExaWorks/psij-python> ./psij-ci-run

From https://github.com/ExaWorks/psij-python

  • branch HEAD -> FETCH_HEAD
    Traceback (most recent call last):
    File "/home/awilke/ExaWorks/psij-python/tests/ci_runner.py", line 12, in
    import requests
    ModuleNotFoundError: No module named 'requests'

Originally posted by @wilke in #317 (comment)

Activity

  1. hategan commented on Nov 4, 2022

    @hategan
    hategan
    on Nov 4, 2022
    Collaborator

    Can you please post the output of the following (run in psij-python where you ran the psij-ci-setup above):

    ls -al .packages

    pip install --target .piptest --upgrade -r requirements-tests.txt

  2. hategan commented on Jan 11, 2023

    @hategan
    hategan
    on Jan 11, 2023
    Collaborator

    @wilke ^^^

  3. wilke commented on Jan 27, 2023

    @wilke
    wilke
    on Jan 27, 2023
    CollaboratorAuthor
    ls -al .packages
ls: cannot access .packages: No such file or directory

    pip install --target .piptest --upgrade -r requirements-tests.txt
Collecting filelock
  Using cached filelock-3.9.0-py3-none-any.whl (9.7 kB)
Collecting psutil
  Using cached psutil-5.9.4-cp36-abi3-manylinux_2_12_x86_64.manylinux2010_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (280 kB)
Collecting pystache>=0.6.0
  Using cached pystache-0.6.0.tar.gz (78 kB)
  Installing build dependencies ... done
  Getting requirements to build wheel ... done
  Preparing metadata (pyproject.toml) ... done
Collecting typeguard
  Using cached typeguard-2.13.3-py3-none-any.whl (17 kB)
Collecting radical.utils
  Using cached radical.utils-1.20.1.tar.gz (159 kB)
  Preparing metadata (setup.py) ... done
Collecting radical.pilot
  Using cached radical.pilot-1.20.1.tar.gz (473 kB)
  Preparing metadata (setup.py) ... done
Collecting pytest>=6.2.0
  Using cached pytest-7.2.1-py3-none-any.whl (317 kB)
Collecting requests>=2.25.1
  Using cached requests-2.28.2-py3-none-any.whl (62 kB)
Collecting colorama
  Using cached colorama-0.4.6-py2.py3-none-any.whl (25 kB)
Collecting msgpack
  Downloading msgpack-1.0.4-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (322 kB)
     ââââââââââââââââââââââââââââââââââââââââ 322.5/322.5 kB 15.0 MB/s eta 0:00:00
Collecting netifaces
  Downloading netifaces-0.11.0-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.whl (33 kB)
Collecting ntplib
  Using cached ntplib-0.4.0-py2.py3-none-any.whl (6.8 kB)
Collecting pymongo<4
  Downloading pymongo-3.13.0-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (526 kB)
     ââââââââââââââââââââââââââââââââââââââââ 526.2/526.2 kB 22.5 MB/s eta 0:00:00
Collecting pyzmq
  Downloading pyzmq-25.0.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (1.1 MB)
     ââââââââââââââââââââââââââââââââââââââââ 1.1/1.1 MB 40.2 MB/s eta 0:00:00
Collecting regex
  Downloading regex-2022.10.31-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (772 kB)
     ââââââââââââââââââââââââââââââââââââââââ 772.3/772.3 kB 49.8 MB/s eta 0:00:00
Collecting setproctitle
  Downloading setproctitle-1.3.2-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (31 kB)
Collecting radical.saga>=1.12
  Using cached radical.saga-1.20.0.tar.gz (324 kB)
  Preparing metadata (setup.py) ... done
Collecting radical.gtod
  Using cached radical.gtod-1.20.1.tar.gz (12 kB)
  Preparing metadata (setup.py) ... done
Collecting dill
  Using cached dill-0.3.6-py3-none-any.whl (110 kB)
Collecting iniconfig
  Using cached iniconfig-2.0.0-py3-none-any.whl (5.9 kB)
Collecting attrs>=19.2.0
  Using cached attrs-22.2.0-py3-none-any.whl (60 kB)
Collecting tomli>=1.0.0
  Using cached tomli-2.0.1-py3-none-any.whl (12 kB)
Collecting packaging
  Using cached packaging-23.0-py3-none-any.whl (42 kB)
Collecting exceptiongroup>=1.0.0rc8
  Using cached exceptiongroup-1.1.0-py3-none-any.whl (14 kB)
Collecting pluggy<2.0,>=0.12
  Using cached pluggy-1.0.0-py2.py3-none-any.whl (13 kB)
Collecting charset-normalizer<4,>=2
  Downloading charset_normalizer-3.0.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (195 kB)
     ââââââââââââââââââââââââââââââââââââââââ 195.4/195.4 kB 32.5 MB/s eta 0:00:00
Collecting certifi>=2017.4.17
  Using cached certifi-2022.12.7-py3-none-any.whl (155 kB)
Collecting urllib3<1.27,>=1.21.1
  Using cached urllib3-1.26.14-py2.py3-none-any.whl (140 kB)
Collecting idna<4,>=2.5
  Using cached idna-3.4-py3-none-any.whl (61 kB)
Collecting apache-libcloud
  Using cached apache_libcloud-3.7.0-py2.py3-none-any.whl (4.2 MB)
Collecting parse
  Using cached parse-1.19.0.tar.gz (30 kB)
  Preparing metadata (setup.py) ... done
Building wheels for collected packages: pystache, radical.utils, radical.pilot, radical.saga, radical.gtod, parse
  Building wheel for pystache (pyproject.toml) ... done
  Created wheel for pystache: filename=pystache-0.6.0-py3-none-any.whl size=83618 sha256=c864725eaf034599e23d0409b37296d4ec237d43473248643df5fb7e683e8ee7
  Stored in directory: /gpfs/fs1/home/wilke/.cache/pip/wheels/fa/6d/76/0f58337c3012b198d30954e8e9168a1c3bed9785895ad51664
  Building wheel for radical.utils (setup.py) ... done
  Created wheel for radical.utils: filename=radical.utils-1.20.1-py3-none-any.whl size=346546 sha256=96503f4c870eadb2fb49c4b981d86bd3dfda58e8fb8de67a87cd30f9e7d1596f
  Stored in directory: /gpfs/fs1/home/wilke/.cache/pip/wheels/98/95/3e/f1e8a9de3071b09b5ab93752e6b84e132b235444823187b25c
  Building wheel for radical.pilot (setup.py) ... done
  Created wheel for radical.pilot: filename=radical.pilot-1.20.1-py3-none-any.whl size=1046044 sha256=ef49afb9c0e8b99de42b91c29efd952f087b642ce9af7421d85cc2f5295895f9
  Stored in directory: /gpfs/fs1/home/wilke/.cache/pip/wheels/c3/c1/06/594ccd969abc85cf657cacf4d679a32d8a9764565cbcfdb221
  Building wheel for radical.saga (setup.py) ... done
  Created wheel for radical.saga: filename=radical.saga-1.20.0-py3-none-any.whl size=699225 sha256=98fa3622082207109b6ce12a389d9b93db4bd06efc24beaf508e4ce2ffb5ebd5
  Stored in directory: /gpfs/fs1/home/wilke/.cache/pip/wheels/d4/e5/10/b7c0b709bc6693662851c5ed99e532376703e6cd199e30061e
  Building wheel for radical.gtod (setup.py) ... done
  Created wheel for radical.gtod: filename=radical.gtod-1.20.1-py3-none-any.whl size=24632 sha256=ede95020f5794b1cb8367c737f263636b620ef1a7ba90bbd5ce46dc2395415f3
  Stored in directory: /gpfs/fs1/home/wilke/.cache/pip/wheels/79/53/ad/9fb403acf96fb7d1d6d9a010a7354c95fab6f729a0dffa6e7f
  Building wheel for parse (setup.py) ... done
  Created wheel for parse: filename=parse-1.19.0-py3-none-any.whl size=24571 sha256=67317cfedfd9cf1d5c39ed5f06a1269a82b1fe5ba701262dc43cf513b5b326f0
  Stored in directory: /gpfs/fs1/home/wilke/.cache/pip/wheels/33/0f/6c/33eeed34d974ea2bbc8f569c16f473f379e3bbb0f61a3abb7a
Successfully built pystache radical.utils radical.pilot radical.saga radical.gtod parse
Installing collected packages: parse, ntplib, netifaces, msgpack, charset-normalizer, urllib3, typeguard, tomli, setproctitle, regex, pyzmq, pystache, pymongo, psutil, pluggy, packaging, iniconfig, idna, filelock, exceptiongroup, dill, colorama, certifi, attrs, requests, radical.utils, pytest, radical.gtod, apache-libcloud, radical.saga, radical.pilot
Successfully installed apache-libcloud-3.7.0 attrs-22.2.0 certifi-2022.12.7 charset-normalizer-3.0.1 colorama-0.4.6 dill-0.3.6 exceptiongroup-1.1.0 filelock-3.9.0 idna-3.4 iniconfig-2.0.0 msgpack-1.0.4 netifaces-0.11.0 ntplib-0.4.0 packaging-23.0 parse-1.19.0 pluggy-1.0.0 psutil-5.9.4 pymongo-3.13.0 pystache-0.6.0 pytest-7.2.1 pyzmq-25.0.0 radical.gtod-1.20.1 radical.pilot-1.20.1 radical.saga-1.20.0 radical.utils-1.20.1 regex-2022.10.31 requests-2.28.2 setproctitle-1.3.2 tomli-2.0.1 typeguard-2.13.3 urllib3-1.26.14

  4. wilke commented on Jan 27, 2023

    @wilke
    wilke
    on Jan 27, 2023
    CollaboratorAuthor

    This is on bebop. Will double check on Polaris.

  5. hategan commented on Feb 8, 2023

    @hategan
    hategan
    on Feb 8, 2023
    Collaborator

    I don't see evidence here that psij-ci-setup is not installing dependencies. More like evidence that it didn't run at all.

    Please do the following:

    • make a clean clone
    • run psij-ci-setup
    • ensure that the above completes successfully
    • if not, post the output

  6. hategan commented on Mar 6, 2023

    @hategan
    hategan
    on Mar 6, 2023
    Collaborator

    @wilke, any updates?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions