Module utf8

Utilities for dealing with UTF-8.

This module provides some UTF-8 related helper routines, including an incremental decoder.

Functions

• decode 🔒
  Decodes the next UTF-8 encoded codepoint from the given byte slice.
• decode_last 🔒
  Decodes the last UTF-8 encoded codepoint from the given byte slice.
• is_boundary 🔒
  Returns true if and only if the given offset in the given bytes falls on a valid UTF-8 encoded codepoint boundary.
• is_leading_or_invalid_byte 🔒
  Returns true if and only if the given byte is either a valid leading UTF-8 byte, or is otherwise an invalid byte that can never appear anywhere in a valid UTF-8 sequence.
• is_word_byte 🔒
  Returns true if and only if the given byte is considered a word character. This only applies to ASCII.
• len 🔒
  Given a UTF-8 leading byte, this returns the total number of code units in the following encoded codepoint.