Module icu_segmenter::provider

🚧 [Unstable] Data provider struct definitions for this ICU4X component.

🚧 This code is considered unstable; it may change at any time, in breaking or non-breaking ways, including in SemVer minor releases. While the serde representation of data structs is guaranteed to be stable, their Rust representation might not be. Use with caution.

Read more about data providers: icu_provider

Modules

• lstm 🔒
  Data provider struct definitions for the lstm

Structs

• Baked
  Baked data
• DictionaryForWordLineExtendedV1Marker
  Marker type for UCharDictionaryBreakDataV1: “segmenter/dictionary/wl_ext@1”
• DictionaryForWordOnlyAutoV1Marker
  Marker type for UCharDictionaryBreakDataV1: “segmenter/dictionary/w_auto@1”
• GraphemeClusterBreakDataV1Marker
  Marker type for RuleBreakDataV1: “segmenter/grapheme@1”
• LineBreakDataV1Marker
  Marker type for RuleBreakDataV1: “segmenter/line@1”
• LstmDataFloat32
  The struct that stores a LSTM model.
• LstmForWordLineAutoV1Marker
  Marker type for LstmDataV1: “segmenter/lstm/wl_auto@1”
• LstmMatrix1
  The struct that stores a LSTM’s matrix.
• LstmMatrix2
  The struct that stores a LSTM’s matrix.
• LstmMatrix3
  The struct that stores a LSTM’s matrix.
• RuleBreakDataV1
  Pre-processed Unicode data in the form of tables to be used for rule-based breaking.
• SentenceBreakDataV1Marker
  Marker type for RuleBreakDataV1: “segmenter/sentence@1”
• UCharDictionaryBreakDataV1
  char16trie data for dictionary break
• UCharDictionaryBreakDataV1Marker 🔒
• WordBreakDataV1Marker
  Marker type for RuleBreakDataV1: “segmenter/word@1”

Enums

• BreakState
  Break state
• LstmDataV1
  The data to power the LSTM segmentation model.
• ModelType
  The type of LSTM model