Repository navigation
Raise ImportWarning when loader.load_module() is used #70319
Description
Activity
Since loader.load_module() is documented as deprecated, we should consider raising an ImportWarning when it is used. That way when Python 2.7 support ends we can either remove it or have one more release where the various ImportWarnings turn into DeprecationWarnings and we finally clean up the import semantics to only be spec-based.
- addedinterpreter-core(Objects, Python, Grammar, and Parser dirs)(Objects, Python, Grammar, and Parser dirs)type-bugAn unexpected behavior, bug, or errorAn unexpected behavior, bug, or error
on Jan 15, 2016 @brett Since this was opened like years ago. Before I work on it, I was wondering If it is still relevant.
@joannah no clue if this ever happened. Could you check the code if DeprecationWarning is being raised yet?
MichaelAnckaert commented
on Aug 9, 2019 MichaelAnckaertmannequinMannequinMore actionsI checked out the source (Lib/imp.py:219) and only see the docstring marking this method als Deprecated. No exceptions are being raised.
I would like to work on this issue.
MichaelAnckaert commented
on Aug 9, 2019 MichaelAnckaertmannequinMannequinMore actionsClarification: the imp module shows a DeprecationWarning when imported. Was this what was meant?
Feel free to open a PR.
If you look at https://github.com/python/cpython/blob/master/Lib/importlib/_bootstrap.py and https://github.com/python/cpython/blob/master/Lib/importlib/_bootstrap_external.py you will notice a bunch of comments near all the calls to load_module(). Those are the places that should be somehow triggering a DeprecationWarning.
I think there's a compatibility shim function which would need to raise an exception so that anyone who has implemented load_module() as the only way to handle loading get a warning (but I think that requires certain loaders to have appropriate support which hopefully they have already but someone needs to double-check). After that every implementation of load_module() should have a warning.
A PR is now up. I ended up deprecating the load_module() methods in importlib itself and then raise ImportWarning in the import system itself when falling back to load_module().
I'm seeing the following test failure locally on master (doesn't seem to be showing up in CI though). I'm not too familiar with this stuff, but it looks related to this change:
======================================================================
FAIL: test_all (test.test___all__.AllTest) (module='distutils.command')
----------------------------------------------------------------------Traceback (most recent call last): File "/home/bucher/src/cpython/Lib/test/test___all__.py", line 55, in check_all self.assertEqual(keys, all_set, "in module {}".format(modname)) File "/home/bucher/src/cpython/Lib/contextlib.py", line 140, in __exit__ next(self.gen) File "/home/bucher/src/cpython/Lib/test/support/warnings_helper.py", line 177, in _filterwarnings raise AssertionError("unhandled warning %s" % reraise[0]) AssertionError: unhandled warning {message : ImportWarning('VendorImporter.exec_module() not found; falling back to load_module()'), category : 'ImportWarning', filename : '<frozen importlib._bootstrap>', lineno : 681, line : None}
Should we be ignoring the new warning in this test as well? I'm still not sure why I seem to be the only one seeing it.
What is "VendorImporter" (see the message of the ImportWarning)? That's not in the stdlib, so it looks like your system is injecting something via some
.pthfile or environment variable that doesn't define exec_module().Yep, looks like that was it. Thanks!
What is "VendorImporter"
@brett.cannon
VendorImporteris something comping frompkg_resources. Because of an entangled traceback and the fact that it dynamically injects a vendored copy ofsix, it's hard to spot. Here's an upstream issue I filed about this warning: pypa/setuptools#2481.I wrote benjaminp/six#343 to fix the six module. I would appreciate a review.
Note: these values reflect the state of the issue at the time it was migrated and might not reflect the current state.
Show more details
GitHub fields:
bugs.python.org fields: