5. Importing Data¶

In this section, we’ll go over ways we import and add data into our workflow for successful execution.

5.1. |play-circle| START Worker Configuration¶

Let’s go over the basics of how to configure the START worker as well as some useful START worker features. Check out the following video for a full example of configuring a START worker and make sure to read on for more information.

Basic Configuration¶

Click on the START worker to configure it.

^{Figure 1: Click on Start Worker}

Drag-and-drop inputs from the left onto the form-builder.

^{Figure 2: Drag-and-drop Inputs}

Then, add data for each input manually, using sample data or uploading local files.

^{Figure 3: Add Input Data}

Groups¶

Add an input group by choosing this option at the bottom. Groups are a way to organize inputs into categories and are most useful for large workflows with a lot of inputs.

^{Figure 4: Add Group}

Click on the tabs (1) at the top or the “Go to group” menu (2) at the bottom to navigate between them.

^{Figure 5: Go to Groups}

NEW as of Jan 25, 2022: By default, inputs added in different groups are now available in All inputs tab of Start worker. Number of inputs in each tab of Start worker are now specified.

^{Figure 6: All Inputs Tab and Input Counts}

Also NEW as of Jan 25, 2022: You can now right-click on the tab to remove with no inputs. You can also search for inputs in a search bar or add filtered drop-downs in the Start worker.

^{Figure 7: Auto Remove Tabs, Search Inputs and Filter Drop-downs}

Updating Inputs for Large Workflows¶

When we have large workflows with a variety of START inputs, sometimes we’ll want to change or update these inputs. Certain workflows, such as ones used for Material Calibration, will be set up with changeable input options so we can run different processes with the same or different data. As of September 2022, the structure of the input connections has been improved so saving doesn’t take long for our START worker when changing these inputs. The following video shows a large and intricate GISSMO workflow which in which we change some START worker inputs around. Saving the START worker is quicker now with this update:

We’ll get a notification at the bottom that execution could not be updated which is normal. We’ll have to re-execute when we update START worker inputs to see our new results. More on Executing here.

5.2. Custom worker input configuration¶

In the start worker, the default view is a list view where we can drag the inputs and build the workflow inputs in a list whose order is defined by us. To provide more flexibility, we now can build the start WORKER INPUTS in a widget-style where we can custom size the worker inputs in any order and in any size. To further provide separation of the inputs, we can add dividers and provide links etc to introduce the worker inputs.

^{Default View}

^{Widget View}

^{Default and Widgets view}

Example1: In this Example, we will build a simple workflow inputs and arrangee them in a two-column format.

^Example1

Examples 2: In this Example, we will build a simple workflow with Image annotator.

Example 3 : In this example, we will look at the execution model once we build a widget view.

Tour Guide support for Widgets view¶

Tour guide support is added to Inputs in Start worker for Widget view where we can add messages or Instructions for the Input Widgets and Guide me button is available to view the tour guide. Guide me button helps us to read the messages on the Widget Inputs.

5.3. |table| Using Sample Data¶

Workflows has built-in sample data for curve inputs for learning and testing purposes. We can find this option anytime we have a curve input either in the START worker or a curve worker configuration.

|plus| Add Sample in START Worker¶

Under the START worker, we can drag-and-drop a curve input into the form-builder. Then, we’ll click on “Choose Sample” to add from the an excel of sample curves.

^{Figure 8: START Worker Choose Sample Data}

Here, we can sift through the sheets for a particular type of curve. Double click the stop of a column to add as an x-range, and do the same for the y-range. In this example, we’ve chosen the first cell temperature curve in the general sheet.

^{Figure 9: Choose X and Y Range in Excel Viewer}

|plus| Add Sample in Curve Worker¶

Adding sample data to a curve worker requires us to add it to the canvas and open it for configuration. Learn how to do that under Building and Configuring.

After we open our curve worker, we can add sample data by clicking on “Choose from sample” under the drop box for the curve input.

^{Figure 10: Curve Worker Choose Sample Data}

Similarly to adding via the START worker, we’ll pick our x and y ranges for our curve in the excel viewer.

^{Figure 11: Choose X and Y Range in Excel Viewer}

Here is how our sample curve looks in the curve viewer.

^{Figure 12: Sample Curve}

Watch the following to see the full process in action:

5.4. |paperclip| Generic Parser¶

Generic Parser helps us import data from our local files into worker inputs. Learn how to add workers to the canvas for configuration under Building and Configuring. For example, we can import data from a .txt file for our worker inputs.

^{Figure 13: Generic Parser Text Upload}

5.5. |upload| Import Workflow Files¶

You can import files from your computer to help create your workflow. Supported workflow files will have the extension .JSON if unpackaged or .D3ZIP if packaged with input data. (Learn how to export your workflow here.

Click on the import button at the top left, and choose a file from your computer. In the example below, a .D3ZIP file is imported.

^{Figure 14: Import a JSON File as a Workflow}

If you already have a workflow open and want to import a local one, you can choose to replace your current workflow with the uploaded one or merge with it.

^{Figure 15: Imported Workflow}

After choosing to merge or replace, your imported workflow should appear on your Workflow Timeline as shown here:

^{Figure 16: Imported Workflow}

Here is a video tutorial on how to import a worker file.

5.6. |table| Using Datasets¶

We can upload datasets into our START worker and select specific rows/columns to add into other workers.

|plus| Add Dataset in START Worker¶

Under the START worker, we’ll drag-and-drop the dataset (1) input into the form-builder. Click on Extract (2) to upload an excel-based file.

^{Figure 17: START Worker Add Dataset Input}

The file will open in the Excel Parser for us to select which data to include. We can check Select All to include the whole dataset.

^{Figure 18: Select All Data in Excel Parser}

Save the START worker to finish.

^{Figure 19: Save START Worker}

|plus| Add Dataset Rows to a Worker¶

Adding dataset rows/columns to a worker requires us to add it to the canvas and open it for configuration. Learn how to do that under Building and Configuring.

After we open our worker, we can add a dataset row/column by choosing Previous Workers > START > Dataset Input > Row & Column under the DataSource. It’s important to note we can only add dataset rows/columns to certain workers, mainly curve(s).

^{Figure 20: Row & Column Selection for Curve Worker Data Source}

Once we choose the Row & Column option as the selection type, a new window will pop up for us to choose our row/column. Here, we’ve chosen the curve highlighted from the Time vs Time column.

^{Figure 21: Choose Row & Column}

After clicking Apply, we’ll see our curve input has been added from the dataset. The row and column will be shown, and we can also add a value for our color by. Finish by clicking Save.

^{Figure 22: Curve Input From Dataset}

Workers can be clone with edges in workflows. Right context menu options are available for the edges of the worker.

^{Clone with edges}