pipenv install fails on macOS

[mkp-bartsch]

Hello,
we use pipenv in our company to organize the dependencies of our python projects.
As package server we use our own pypi server. The pypi server forwards requests to the public pypi server if packages are not found on ours. The credentials are inserted into the URL of the Pypi server via environment variables, see below. The environment variables are configured in the .bashrc-file.

Now to the problem:

On Windows and Linux systems the installation of the pipenvironment works as expected.
On MacOS systems the username and password from the environment variables are not inserted correctly into the URL. The behaviour is same for zsh and bash. The credentials are configured in .bashrc and .zshrc file.

Used versions: (same on all test systems)

pipenv version: 2023.3.20
pip version: 23.0.1
Python version: 3.8.10
macOS 13.2.1

Example pipfile:

[[source]]
name = "Packages"
url = "https://$PYPI_USER:[email protected]/"
verify_ssl = true

[dev-packages]

[packages]
numpy = "*"

[requires]
python_version = "3.8"

It doesn't matter if private or public packages are defined. The basic problem seems to be that the URL is not built correctly. Therefore, I have only given numpy as an example here now.

Installing the pipenv:

pipenv install

Here is the output log:

adrianbartsch@MacBook-Pro-von-Adrian azure-logging % pipenv update
Running $ pipenv lock then $ pipenv sync.
Locking [packages] dependencies...
Building requirements...
Resolving dependencies...
✘ Locking Failed!
⠼ Locking...
Traceback (most recent call last):
  File "/Library/Frameworks/Python.framework/Versions/3.8/lib/python3.8/site-packages/pipenv/patched/pip/_vendor/packaging/requirements.py", line 102, in __init__
    req = REQUIREMENT.parseString(requirement_string)
  File "/Library/Frameworks/Python.framework/Versions/3.8/lib/python3.8/site-packages/pipenv/patched/pip/_vendor/pyparsing/core.py", line 1141, in parse_string
    raise exc.with_traceback(None)
pipenv.patched.pip._vendor.pyparsing.exceptions.ParseException: Expected W:(0-9A-Za-z), found ':'  (at char 0), (line:1, col:1)
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
  File "/Library/Frameworks/Python.framework/Versions/3.8/lib/python3.8/site-packages/pipenv/patched/pip/_vendor/pkg_resources/__init__.py", line 3101, in __init__
    super(Requirement, self).__init__(requirement_string)
  File "/Library/Frameworks/Python.framework/Versions/3.8/lib/python3.8/site-packages/pipenv/patched/pip/_vendor/packaging/requirements.py", line 104, in __init__
    raise InvalidRequirement(
pipenv.patched.pip._vendor.packaging.requirements.InvalidRequirement: Parse error at "':MYPYPIS'": Expected W:(0-9A-Za-z)
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
  File "/Library/Frameworks/Python.framework/Versions/3.8/lib/python3.8/site-packages/pipenv/vendor/requirementslib/models/requirements.py", line 964, in _parse_name_from_line
    self._requirement = init_requirement(self.line)
  File "/Library/Frameworks/Python.framework/Versions/3.8/lib/python3.8/site-packages/pipenv/vendor/requirementslib/models/utils.py", line 191, in init_requirement
    req = Requirement.parse(name)
  File "/Library/Frameworks/Python.framework/Versions/3.8/lib/python3.8/site-packages/pipenv/patched/pip/_vendor/pkg_resources/__init__.py", line 3148, in parse
    req, = parse_requirements(s)
  File "/Library/Frameworks/Python.framework/Versions/3.8/lib/python3.8/site-packages/pipenv/patched/pip/_vendor/pkg_resources/__init__.py", line 3094, in parse_requirements
    yield Requirement(line)
  File "/Library/Frameworks/Python.framework/Versions/3.8/lib/python3.8/site-packages/pipenv/patched/pip/_vendor/pkg_resources/__init__.py", line 3103, in __init__
    raise RequirementParseError(str(e))
pipenv.patched.pip._vendor.pkg_resources.RequirementParseError: Parse error at "':MYPYPIS'": Expected W:(0-9A-Za-z)
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
  File "/Library/Frameworks/Python.framework/Versions/3.8/lib/python3.8/site-packages/pipenv/resolver.py", line 845, in <module>
    main()
  File "/Library/Frameworks/Python.framework/Versions/3.8/lib/python3.8/site-packages/pipenv/resolver.py", line 831, in main
    _main(
  File "/Library/Frameworks/Python.framework/Versions/3.8/lib/python3.8/site-packages/pipenv/resolver.py", line 811, in _main
    resolve_packages(
  File "/Library/Frameworks/Python.framework/Versions/3.8/lib/python3.8/site-packages/pipenv/resolver.py", line 759, in resolve_packages
    results, resolver = resolve(
  File "/Library/Frameworks/Python.framework/Versions/3.8/lib/python3.8/site-packages/pipenv/resolver.py", line 738, in resolve
    return resolve_deps(
  File "/Library/Frameworks/Python.framework/Versions/3.8/lib/python3.8/site-packages/pipenv/utils/resolver.py", line 1100, in resolve_deps
    results, hashes, markers_lookup, resolver, skipped = actually_resolve_deps(
  File "/Library/Frameworks/Python.framework/Versions/3.8/lib/python3.8/site-packages/pipenv/utils/resolver.py", line 888, in actually_resolve_deps
    resolver = Resolver.create(
  File "/Library/Frameworks/Python.framework/Versions/3.8/lib/python3.8/site-packages/pipenv/utils/resolver.py", line 458, in create
    constraints, skipped, index_lookup, markers_lookup = resolver.get_metadata(
  File "/Library/Frameworks/Python.framework/Versions/3.8/lib/python3.8/site-packages/pipenv/utils/resolver.py", line 216, in get_metadata
    req, req_idx, markers_idx = self.parse_line(
  File "/Library/Frameworks/Python.framework/Versions/3.8/lib/python3.8/site-packages/pipenv/utils/resolver.py", line 273, in parse_line
    req = Requirement.from_line(line)
  File "/Library/Frameworks/Python.framework/Versions/3.8/lib/python3.8/site-packages/pipenv/vendor/requirementslib/models/requirements.py", line 2677, in from_line
    parsed_line = Line(line)
  File "/Library/Frameworks/Python.framework/Versions/3.8/lib/python3.8/site-packages/pipenv/vendor/requirementslib/models/requirements.py", line 171, in __init__
    self.parse()
  File "/Library/Frameworks/Python.framework/Versions/3.8/lib/python3.8/site-packages/pipenv/vendor/requirementslib/models/requirements.py", line 1300, in parse
    self.parse_name()
  File "/Library/Frameworks/Python.framework/Versions/3.8/lib/python3.8/site-packages/pipenv/vendor/requirementslib/models/requirements.py", line 1025, in parse_name
    name = self._parse_name_from_line()
  File "/Library/Frameworks/Python.framework/Versions/3.8/lib/python3.8/site-packages/pipenv/vendor/requirementslib/models/requirements.py", line 966, in _parse_name_from_line
    raise RequirementError(
pipenv.vendor.requirementslib.exceptions.RequirementError: Failed parsing requirement from ':MYPYPISECRET'

The value MY_PYPI_SECRET in the last line was replaced here for the contribution of me. The log printed the pypi server password from the .bashrc or .zshrc file in plain text.

Is this a bug or is it due to some configuration?

Thanks in advance!

[matteius]

@mkp-bartsch -- I am trusting that isn't the actual secret you posted in the discussion contents? I'd have to think more about your larger question though.

[mkp-bartsch]

Thanks for the hint. No this is a test environment. I changed the password again to "MYPYPISECRET" and updated the log.

Noticeably, only 8 characters of the password are ever printed in the log here and only 0-9a-ZA-Z characters are allowed. The password contains only the allowed characters. But when parsing the string, the colon : is printed here. This is of course an illegal character, but it does not belong to the password. Is the string with the credentials perhaps parsed incorrectly?
From the log:

pipenv.patched.pip._vendor.packaging.requirements.InvalidRequirement: Parse error at "':MYPYPIS'": Expected W:(0-9A-Za-z)

If I insert the access data directly in the Pipfile, instead of updating them via environment variable, then it works. But this is not practicable.
Pipfile:

[[source]]
name = "Packages"
url = "https://MYPYPIUSER:[email protected]/"
verify_ssl = true

[kalebmckale]

Are you passing the environment variables via .env file?

[mkp-bartsch]

Are you passing the environment variables via .env file?

No, I have stored the environment variables in the .zshrc and .bashrc files. The result of executing with zsh or bash is the same as described above.

I haven't been working with macOS for very long, can you tell me which .env file you're referring to?
I created a .env file in my user directory for testing purposes and added the environment variables there, but they are not being loaded and are not available in the terminal.