DATASET_FILES_FETCHER¶
New worker called DATASET_FILES_FETCHER is added to workflows.
This worker:
Fetches files from paths specified in a dataset.
Creates outputs automatically based on file type:
CSV/TSV/JSON → converted to datasets
.xy → converted to curves
Images → converted to base64 image outputs
Other file types → converted to text or scalar outputs
Enables seamless processing of mixed file types directly from dataset paths.
Below are the outputs created for the input.
Cmd.sh
Stdout.text
commands.cfile
Outs.csv
visualization.png
Xvfb_screen0