dask_awkward.from_map

dask_awkward.from_map

dask_awkward.from_map(func, *iterables, args=None, label=None, token=None, divisions=None, meta=None, empty_on_raise=None, empty_backend=None, **kwargs)[source]

Create an Array collection from a custom mapping.

Parameters

  • func (Callable) – Function used to create each partition.

  • *iterables (Iterable) – Iterable objects to map to each output partition. All iterables must be the same length. This length determines the number of partitions in the output collection (only one element of each iterable will be passed to func for each partition).

  • label (str, optional) – String to use as the function-name label in the output collection-key names.

  • token (str, optional) – String to use as the “token” in the output collection-key names.

  • divisions (tuple[int, ...] | tuple[None, ...], optional) – Partition boundaries (if known).

  • meta (Array, optional) – Collection metadata array, if known (the awkward-array type tracer)

  • empty_on_raise (tuple[type[BaseException], ...], optional) – Set of exceptions that can be caught to return an empty array at compute time if file IO raises.

  • empty_backend (str,) – The backend for the empty array resulting from a failed read when empty_on_raise is defined.

  • **kwargs (Any) – Keyword arguments passed to func.

  • iterables (Iterable) –

  • args (tuple[Any, ...] | None) –

  • kwargs (Any) –

Returns

Array collection.

Return type

Array

previous

dask_awkward.from_lists

next

dask_awkward.from_parquet