Structsยง
- Lexer ๐
Enumsยง
Functionsยง
- consume_any ๐
- consume_token ๐Return the token at the start of
input
. - is_blankspace ๐Returns whether or not a char is a blankspace (Unicode Pattern_White_Space)
- is_comment_end ๐Returns whether or not a char is a comment end (Unicode Pattern_White_Space excluding U+0020, U+0009, U+200E and U+200F)
- is_word_part ๐Returns whether or not a char is a word part (Unicode XID_Continue)
- is_word_start ๐Returns whether or not a char is a word start (Unicode XID_Start + โ_โ)
Type Aliasesยง
- TokenSpan ๐