Module lexer

Module lexer 

Source
Expand description

Lex TOML tokens

To get started, see Source::lex

Modulesยง

token ๐Ÿ”’
Lexed TOML tokens

Structsยง

Lexer
Lex TOML tokens
Token
An unvalidated TOML Token

Enumsยง

TokenKind

Constantsยง

APOSTROPHE ๐Ÿ”’
apostrophe = %x27 ; ' apostrophe
BOM ๐Ÿ”’
COMMENT_START_SYMBOL ๐Ÿ”’
comment-start-symbol = %x23 ; #
ESCAPE ๐Ÿ”’
escape = %x5C ; \
ML_BASIC_STRING_DELIM ๐Ÿ”’
ml-basic-string-delim = 3quotation-mark
ML_LITERAL_STRING_DELIM ๐Ÿ”’
ml-literal-string-delim = 3apostrophe
QUOTATION_MARK ๐Ÿ”’
quotation-mark = %x22 ; "
WSCHAR ๐Ÿ”’

Functionsยง

lex_ascii_char ๐Ÿ”’
Process an ASCII character token
lex_atom ๐Ÿ”’
Process Atom
lex_basic_string ๐Ÿ”’
Process basic string
lex_comment ๐Ÿ”’
Process Comment
lex_crlf ๐Ÿ”’
Process Newline
lex_literal_string ๐Ÿ”’
Process literal string
lex_ml_basic_string ๐Ÿ”’
Process multi-line basic string
lex_ml_literal_string ๐Ÿ”’
Process multi-line literal string
lex_whitespace ๐Ÿ”’
Process Whitespace
process_token ๐Ÿ”’

Type Aliasesยง

Stream ๐Ÿ”’