Skip to content

encodings module is not documented #136162

Description

@sobolevn

Feature or enhancement

encodings contains several public and documented (at the module level) functions:

""" Standard "encodings" Package
Standard Python encoding modules are stored in this package
directory.
Codec modules must have names corresponding to normalized encoding
names as defined in the normalize_encoding() function below, e.g.
'utf-8' must be implemented by the module 'utf_8.py'.
Each codec module must export the following interface:
* getregentry() -> codecs.CodecInfo object
The getregentry() API must return a CodecInfo object with encoder, decoder,
incrementalencoder, incrementaldecoder, streamwriter and streamreader
attributes which adhere to the Python Codec Interface Standard.
In addition, a module may optionally also define the following
APIs which are then used by the package's codec search function:
* getaliases() -> sequence of encoding name strings to use as aliases
Alias names returned by getaliases() must be normalized encoding
names as defined by normalize_encoding().
Written by Marc-Andre Lemburg (mal@lemburg.com).
(c) Copyright CNRI, All Rights Reserved. NO WARRANTY.
"""#"

But, only its submodules are documented in codecs.rst:

cpython/Doc/library/codecs.rst

Lines 1487 to 1491 in 23caccf

:mod:`encodings.idna` --- Internationalized Domain Names in Applications
------------------------------------------------------------------------
.. module:: encodings.idna
:synopsis: Internationalized Domain Names implementation

Should we add encodings itself to the docs?

Linked PRs

Activity

  1. added
    type-featureA feature request or enhancement
    docsDocumentation in the Doc dir
    stdlibStandard Library Python modules in the Lib/ directory
    on Jul 1, 2025
  2. picnixz commented on Jul 1, 2025

    @picnixz
    Member

    AFAIR, users should use codecs when possible instead of directly accessing encodings and the submodules are documented but only their name is public I think (I'm on mobile so it's hard to check).

    cc @malemburg what do you recommend?

  3. malemburg commented on Jul 1, 2025

    @malemburg
    Member

    The encodings package itself provides codec search functions, which gets registered upon import and a normalization function which is used by the search functions. The search functions not only take care of mapping a codec name to codec module (within the encodings package), but also define the codec module interface which all codec modules in the encodings package have to use.

    Those search functions can be used directly as well if you want to bypass the normal codecs.lookup() API for some reason.

    If we document these, we should add a note that these functions should normally not be used directly, only in special cases, e.g. for testing purposes or to check whether a particular encodings codec module is available or not (the codecs.lookup() API scans all search functions, so it may well find other such modules elsewhere).

  4. added a commit that references this issue on Jul 8, 2025
  5. added 2 commits that reference this issue on Jul 9, 2025
  6. added 3 commits that reference this issue on Jul 9, 2025
  7. added a commit that references this issue on Jul 11, 2025
  8. added a commit that references this issue on Jul 12, 2025
  9. added a commit that references this issue on Jul 13, 2025
  10. added a commit that references this issue on Aug 4, 2025
  11. added a commit that references this issue on Aug 19, 2025
  12. added a commit that references this issue on Sep 9, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    docsDocumentation in the Doc dirstdlibStandard Library Python modules in the Lib/ directorytype-featureA feature request or enhancement

    Projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions