Module token

Parsers extracting tokens from the stream

Functions

• any
  Matches one token
• any_ 🔒
• literal
  Recognizes a literal
• literal_ 🔒
• none_of
  Recognize a token that does not match a set of tokens
• one_of
  Recognize a token that matches a set of tokens
• take
  Recognize an input slice containing the first N input elements (I[..N]).
• take_ 🔒
• take_till
  Recognize the longest input slice (if any) till a member of a set of tokens is found.
• take_till0 🔒
• take_till1 🔒
• take_till_m_n 🔒
• take_until
  Recognize the input slice up to the first occurrence of a literal.
• take_until0_ 🔒
• take_until1_ 🔒
• take_until_m_n_ 🔒
• take_while
  Recognize the longest (m <= len <= n) input slice that matches a set of tokens