Expand description
Types used within the tree builder code. Not exported to users.
Enums§
- Format
Entry 🔒 - Insertion
Mode 🔒 - Insertion
Point 🔒 - Process
Result 🔒 - Split
Status 🔒 - Token 🔒
- A subset/refinement of
tokenizer::Token. Everything else is handled specially at the beginning ofprocess_token.