We're back after a server migration that caused effbot.org to fall over a bit harder than expected. Expect some glitches.

The token module

This module contains a list of all tokens used by the standard Python tokenizer.

Example: Using the token module
# File: token-example-1.py

import token

print "NUMBER", token.NUMBER
print "PLUS", token.STAR
print "STRING", token.STRING

NUMBER 2
PLUS 16
STRING 3