DATASET_FILES_FETCHER

New worker called DATASET_FILES_FETCHER is added to workflows.

This worker:

  1. Fetches files from paths specified in a dataset.

  2. Creates outputs automatically based on file type:

    CSV/TSV/JSON → converted to datasets

    .xy → converted to curves

    Images → converted to base64 image outputs

    Other file types → converted to text or scalar outputs

Enables seamless processing of mixed file types directly from dataset paths.


Below are the outputs created for the input.

Cmd.sh

Stdout.text

commands.cfile

Outs.csv

visualization.png

Xvfb_screen0