Module tokenizer

XML5 tokenizer - converts input into tokens

Re-exports

pub use self::interface::EmptyTag;

pub use self::interface::EndTag;

pub use self::interface::ShortTag;

pub use self::interface::StartTag;

Modules

char_ref 🔒

interface 🔒

qname 🔒

states

Tokenizer states.

Macros

eat 🔒

get_char 🔒

go 🔒

pop_except_from 🔒

sh_trace 🔒

shorthand 🔒

Structs

Doctype

A DOCTYPE token. Doctype token in XML5 is rather limited for reasons, such as: security and simplicity. XML5 only supports declaring DTD with name, public identifier and system identifier

Pi

A ProcessingInstruction token.

Tag

XML 5 Tag Token

XmlTokenizer

The Xml tokenizer.

XmlTokenizerOpts

Copy of Tokenizer options, with an impl for Default.

Enums

ProcessResult

The result of a single tokenization operation

TagKind

Tag kind denotes which kind of tag did we encounter.

Token

Describes tokens encountered during parsing of input.

Traits

TokenSink

Types which can receive tokens from the tokenizer.

Functions

option_push 🔒

process_qname 🔒

Type Aliases

LocalName

Namespace

Prefix