The devel/py-pytokens port

py3-pytokens-0.1.10 – Python 3.12+ spec-compliant tokenizer (cvsweb github mirror)

A fast, spec-compliant Python 3.12+ tokenizer that runs on older
Python versions.

The OpenBSD ports mailing-list

/usr/local/lib/python3.12/site-packages/pytokens-0.1.10.dist-info/
/usr/local/lib/python3.12/site-packages/pytokens-0.1.10.dist-info/METADATA
/usr/local/lib/python3.12/site-packages/pytokens-0.1.10.dist-info/RECORD
/usr/local/lib/python3.12/site-packages/pytokens-0.1.10.dist-info/WHEEL
/usr/local/lib/python3.12/site-packages/pytokens-0.1.10.dist-info/licenses/
/usr/local/lib/python3.12/site-packages/pytokens-0.1.10.dist-info/licenses/LICENSE
/usr/local/lib/python3.12/site-packages/pytokens-0.1.10.dist-info/top_level.txt
/usr/local/lib/python3.12/site-packages/pytokens/
/usr/local/lib/python3.12/site-packages/pytokens/__init__.py
/usr/local/lib/python3.12/site-packages/pytokens/__main__.py
/usr/local/lib/python3.12/site-packages/pytokens/__pycache__/
/usr/local/lib/python3.12/site-packages/pytokens/__pycache__/__init__.cpython-312.opt-1.pyc
/usr/local/lib/python3.12/site-packages/pytokens/__pycache__/__init__.cpython-312.pyc
/usr/local/lib/python3.12/site-packages/pytokens/__pycache__/__main__.cpython-312.opt-1.pyc
/usr/local/lib/python3.12/site-packages/pytokens/__pycache__/__main__.cpython-312.pyc
/usr/local/lib/python3.12/site-packages/pytokens/__pycache__/cli.cpython-312.opt-1.pyc
/usr/local/lib/python3.12/site-packages/pytokens/__pycache__/cli.cpython-312.pyc
/usr/local/lib/python3.12/site-packages/pytokens/cli.py
/usr/local/lib/python3.12/site-packages/pytokens/py.typed