Version: v0.2.0

Julia API index

Every stable name Julia exports, and its extension seams.

Package: EarthSciIO 0.2.0

Documentation extracted with Base.Docs (Julia 1.13.3).

Extension-tier names are on the Julia extension page .

Stable names

JuliaCanonicalKindSummary
boundariesboundariesfunctionThe sorted, de-duplicated union B of the members’ refresh_times, in their own cadence unit.
CachecachetypeThe content-addressed cache.
cache_keycache_keyfunctionlowercase_hex(sha256(utf8(resolved_url))).
CacheEntrycache_entrytypeThe outcome of [fetch_blob]: the resolved blob plus how it was obtained.
CacheMisscache_misserrorRaised in offline mode when the blob for a resolved URL is absent.
cancel!cancelfunctionDrop all pending work at once (spec/prefetch.md §3.8).
CommitErrorcommit_errortypeThe tokens handed to a commit do not describe a consistent step (spec/writer.md §5.3): a missing or duplicate writer, a divergent fingerprint, a gap or overlap between regions,…
CommitTokencommit_tokentypeWhat one writer wrote since its previous token (spec/writer.md §5.2), returned by [write_flush!] and handed (by the caller — EarthSciIO is MPI-free) to the owner’s…
const_providerconst_providerfunctionThin constructor for a time-invariant ([CONST]) provider.
CSVReadercsv_readertypeThe csv format reader — a second reader proving a non-NetCDF format plugs into FORMAT_REGISTRY unchanged (spec/conformance.md).
datadirdata_dirfunctionResolve $EARTHSCIDATADIR (spec/cache-format.md §5).
DimWindowdim_windowtypeA named-dimension window: the Julia constructor for the wire form select = {"dims": {...}} (spec/prefetch.md §2.2).
discrete_providerdiscrete_providerfunctionThin constructor for a time-varying ([DISCRETE]) provider over times.
EpochSampleepoch_sampletypeWhat take!) returns for one epoch: a [Sample] per member, indexed by member key (ep["U"].data, ep["U"].anchor, ep["U"].changed).
FF10Readerff10_readertypeThe ff10 format reader — the RAW long-format FF10 point table (SMOKE / Emissions.jl FF10_POINT) as a points [NativeDataset] in native units.
file_source_is_currentfile_source_is_currentfunctionRung 0 as a yes/no: is the source PROVABLY the file that was ingested?
file_source_statefile_source_statefunctionRung 0 without a memo (spec/cache-format.md §4.1): is the file:// source behind a cached entry still the file that was ingested into it?
GeoTIFFReadergeotiff_readertypeThe geotiff format reader — raster bands on a native lon/lat (geographic) or x/y (projected) grid.
IndexedTimeindexed_timetypeThe indexed time mode (spec/writer.md §6.2): the time axis has a fixed length n_records = length(times) from [write_open!], the owner writes times as the time coordinate…
IntegrityErrorintegrity_errorerrorRaised when a blob’s bytes do not match its manifest sha256_content.
is_offlineis_offlinefunctionTrue if this cache is in offline (cache-only) mode.
ManifestmanifesttypeValidation + provenance record for one cached blob.
materializematerializefunctionReturn the native arrays for the source at time t.
NativeDatasetnative_datasettypeThe native arrays a reader returns from one blob: variables (data fields keyed by file_variable) and coords (the dimension-coordinate fields — e.g. the grid’s…
NativeFieldnative_fieldtypeOne native-grid array exactly as a reader decodes it: data is a Julia array whose axes correspond, in order, to dims (the on-disk dimension names, file order — e.g.…
NetCDFReadernetcdf_readertypeThe netcdf format reader, backed by NCDatasets.
OutputSchemastream_schematypeThe input to [write_open!] — a plain struct in this repo (the EarthSciAST OutputSchema maps onto it at the binding layer; no EarthSciAST dependency here).
ParquetReaderparquet_readertypeThe parquet format reader — an Apache Parquet file as a flat table.
prefetchprefetchfunctionWarm the cache for every URL the provider will need — the single URL for a [CONST] provider, the unique per-tick URLs for a [DISCRETE] one — WITHOUT decoding.
PrefetchGroupprefetch_grouptypeDecode upcoming forcing epochs of several DISCRETE providers on background workers, in a declared order, under a memory budget — bitwise identical to calling [sample_at] /…
ProviderprovidertypeA data provider over the shared cache.
read_blobread_blobfunctionRead the committed blob key of writer under scope (:static or (:record, i)).
read_output_manifestread_output_manifestfunctionRead a store’s output manifest.
read_recordread_recordfunctionRead committed record index of streaming variable var straight from the store (a directory or file:// URL; never through the cache).
read_staticread_staticfunctionRead the committed static name (dims order, region-sized, stored dtype).
refreshrefreshfunctionRe-materialize at the cadence tick t.
refresh_timesrefresh_timesfunctionThe discrete time points at which the data changes and the solver must [refresh].
RegionNotShardAlignedregion_not_shard_alignedtypeA writer’s region (spec/writer.md §4) does not start on a shard boundary, does not stop on one (or at the array end), or is out of bounds.
Sampleprefetch_sampletypeOne member’s sample for one epoch, as take!) returns it inside an [EpochSample]:
sample_atsample_atfunctionThe dataset refresh(p, t) returns — data variables AND coordinates, with the same snap-down to the cadence anchor, the same file-local record, the same records_per_sample = 2…
sample_windows_atsample_windows_atfunctionK windows at once: dataset i is identical — bitwise, coordinates included — to sample_at(with_window(p, windows[i]), t), but the source is fetched and decoded ONCE, over the…
schema_fingerprintschema_fingerprintfunctionThe stream-schema fingerprint of spec/writer.md §3.1: the sha256 of the canonical JSON of dims (time length 0 in append mode, n_records in indexed mode), time_dim,…
select_formselect_formfunctionThe wire form of a window, Dict("dims" => Dict(dim => selector, ...)) — what a reader’s select option and reader_kwargs[:select] take (spec/prefetch.md §2.2).
ShapefileReadershapefile_readertypeThe shapefile format reader — an ESRI shapefile as a feature table.
start!startfunctionDeclare the order in which epochs will be taken and begin decoding ahead of it (spec/prefetch.md §3.3): :forward (1, …, n), :reverse (n, …, 1 — the adjoint’s backward…
take!takefunctionRemoves and returns a value from a Channel in order.
with_windowwith_windowfunctionA NEW provider that shares p’s cache, reader, URL resolver and cadence and has the window w (a [DimWindow] or its wire Dict) baked in as reader_kwargs[:select].
write_blob!write_blobfunctionStore a small rank-local payload: scope is :static or (:record, i).
write_close!write_closefunctionFlush any pending data and finalize: a :single writer commits and rewrites the manifest; the owner commits its own token plus the other writers’ tokens; a contributor only…
write_commit!write_commitfunctionOwner only: verify one token per writer (spec/writer.md §5.3) and commit them; raises [CommitError] (writing nothing) when they do not tile the store.
write_flush!write_flushfunctionWrite every dirty shard of this writer’s region and return the token naming what was written since the last token.
write_invalidate!write_invalidatefunctionOwner/single, indexed mode: mark committed records uncommitted so they may be rewritten (bumps commit_seq).
write_open!write_openfunctionOpen an output store at base_url and return an opaque write handle threaded through the other write_* calls.
write_record!write_recordfunctionAppend ONE time record (append mode): t is the time coordinate value, arrays maps each variable this writer supplies to its gridded Array (the variable’s non-time dims, in…
write_record_at!write_record_atfunctionWrite record index (0-based) in indexed mode, in any order; t must equal the schema’s times[index] bitwise.
write_resumewrite_resumefunctionReopen a store after preemption (spec/writer.md §7); in append mode committed records with t > at are discarded.
write_static!write_staticfunctionWrite the time-less variable name (region-shaped when it is partitioned, full shape when replicated — owner/single only).
ZarrReaderzarr_readertypeThe zarr store-backed reader (Zarr v2 and sharded Zarr v3 chunked arrays).
ZarrWriterstream_writertypeThe zarr streaming writer (sharded Zarr v3).