.. _auto_dataset_columns_to_dataset:

*USE COLUMN VALUES TO ADD NEW DATASET COLUMN*
=============================================

Aggregates values from one or more existing dataset columns (identified by a shared prefix) into a single new column, optionally dropping the source columns afterwards. Use this worker to collapse wide-format repeated columns into a tidy single-column representation within a dataset.

When to use
-----------

Classification: **process**.

Tagged: ``column``, ``dataset``, ``pivot``, ``prefix``, ``reshape``, ``transform``, ``wide-to-long``.

Inputs
------

.. list-table::
   :header-rows: 1
   :widths: 20 20 20 20 20 20

   * - Label
     - ID
     - Type
     - Default
     - Required
     - Description
   * - Dataset
     - dataset_1
     - dataset
     - —
     - 
     - Input dataset containing the source columns whose values will be aggregated into the new column; accepts any tabular dataset connected from an upstream worker.
   * - New Column Name
     - new_column_name
     - scalar
     - —
     - 
     - Name to assign to the newly created column that will hold the aggregated values from the matched source columns.
   * - Prefix
     - prefix
     - text
     - rc_
     - 
     - String prefix used to identify which existing dataset columns should be combined into the new column (default: 'rc_'); all columns whose names start with this prefix are selected.
   * - Drop Dataset Column
     - drop_columns
     - text
     - yes
     - 
     - Whether to remove the original prefixed source columns after aggregation ('yes' drops them, 'no' retains them alongside the new column; default: 'yes').

Outputs
-------

.. list-table::
   :header-rows: 1
   :widths: 20 20 20 20

   * - Label
     - ID
     - Type
     - Description
   * - dataset_add_curves_to_column_output_1
     - dataset_add_curves_to_column_output_1
     - dataset
     - Transformed dataset containing the new aggregated column, with the original prefixed source columns dropped or retained according to the drop_columns setting.

Disciplines
-----------

- data.dataset.transform

Runnable example
----------------

A runnable example is registered for this worker. Open the example workflow on the d3VIEW canvas: `/api/workflow/example?id=dataset_columns_to_dataset <https://www.d3view.com/api/workflow/example?id=dataset_columns_to_dataset>`_

.. raw:: html

   <hr style="margin-top:2em">
   <p style="font-size:11px;color:#888">
   Auto-generated from <code>transformation</code> schema. Worker id: <code>dataset_columns_to_dataset</code>. Schema hash: <code>b632140a1177</code>. Hand-curated docs in <code>workerexamples/</code> override this page when present.
   </p>