Module html5ever::tokenizer

The HTML5 tokenizer.

Re-exports

• pub use self::interface::CharacterTokens;
• pub use self::interface::EOFToken;
• pub use self::interface::NullCharacterToken;
• pub use self::interface::ParseError;
• pub use self::interface::CommentToken;
• pub use self::interface::DoctypeToken;
• pub use self::interface::TagToken;
• pub use self::interface::EndTag;
• pub use self::interface::StartTag;
• pub use crate::buffer_queue::FromSet;
• pub use crate::buffer_queue::NotFromSet;

Modules

• char_ref 🔒
• interface 🔒
• states
  Tokenizer states.

Macros

• eat 🔒
• eat_exact 🔒
• get_char 🔒
• go 🔒
• go_match 🔒
• peek 🔒
• pop_except_from 🔒
• sh_trace 🔒
• shorthand 🔒

Structs

• BufferQueue
  A queue of owned string buffers, which supports incrementally consuming characters.
• Doctype
  A DOCTYPE token.
• Tag
  A tag token.
• Tokenizer
  The HTML tokenizer.
• TokenizerOpts
  Tokenizer options, with an impl for Default.

Enums

• ProcessResult
• SetResult
  Result from pop_except_from containing either a character from a SmallCharSet, or a string buffer of characters not from the set.
• TagKind
• Token
• TokenSinkResult
• TokenizerResult

Traits

• TokenSink
  Types which can receive tokens from the tokenizer.

Functions

• option_push 🔒