Crate icu_datagen

icu_datagen is a library to generate data files that can be used in ICU4X data providers.

Data files can be generated either programmatically (i.e. in build.rs), or through a command-line utility.

Examples

build.rs

use icu::locid::langid;
use icu_datagen::*;
use std::fs::File;
use std::path::PathBuf;

fn main() {
    icu_datagen::datagen(
        Some(&[langid!("de"), langid!("en-AU")]),
        &icu_datagen::keys(&["list/and@1"]),
        &SourceData::default(),
        vec![Out::Blob(Box::new(File::create("data.postcard").unwrap()))],
    )
    .unwrap();
}

Command line

The command line interface can be installed with the bin Cargo feature.

$ cargo install icu_datagen --features bin

If you need to export keys for experimental components, enable the experimental Cargo feature:

$ cargo install icu_datagen --features bin,experimental

Once the tool is installed, you can invoke it like this:

$ icu4x-datagen \
>    --all-keys \
>    --locales de en-AU \
>    --format blob \
>    --out data.postcard

More details can be found by running --help.

Structs

DatagenProvider

DataProvider backed by SourceData

SourceData

Bag of options for datagen source data.

Enums

CldrLocaleSubset

Specifies a variant of CLDR JSON

CollationHanDatabase

Specifies the collation Han database to use.

Out

The output format.

Functions

all_keys

List of all supported keys

datagen

Runs ICU4X datagen.

is_missing_cldr_error

Identifies errors that are due to missing CLDR data.

is_missing_icuexport_error

Identifies errors that are due to missing ICU export data.

keys

Parses a list of human-readable key identifiers and returns a list of DataKeys.

keys_from_bin

Parses a compiled binary and returns a list of used DataKeys used by it.

keys_from_file

Parses a file of human-readable key identifiers and returns a list of DataKeys.