Portal Tutorial - Run Workflow, Diagnose and Fix Errors

Run A Workflow, Step 1

You can either initiate the process of running a workflow from Portal Wizard, or from the File Menu.

New workflow

Run A Workflow, Step 2

You can either open an existing workflow run, or you can click on the "New" button to create a new workflow. Note that if you have lots of previous runs in the system, you can search them using the "Search Criteria" box. In this example, we are viewing all workflow runs for computer "hep.fsl.noaa.gov". In this example, I click on the "New" button to create a new workflow run.

New workflow

Run A Workflow, Step 3

The run workflow window appears. Here I can name my run and choose the dates on which to run. I can also choose which workflow to run (e.g. "wrf-EastCoast") and whether to use the Internal or External workflow managers (note the External Workflow manager is only available as an option on this screen if you filled in the required information on the first tab of the Portal Wizard). You can edit or reorder tasks by clicking on the "Edit or Reorder Tasks" button, and you can also change the number of processors dedicated to each task as well as other options.

Note that the output for my run will be written to a sub directory under /export/jeff/wrfportal-runs on hep.fsl.noaa.gov.

New workflow

Run A Workflow, Step 4

Click on the "Add Date(s)" button to set the run dates for your run.

New workflow

Run A Workflow, Step 5

Go to the Actions menu and select "Run" .

New workflow

Run A Workflow, Step 6a (no errors)

After select Run to run our workflow, the Run Monitor window will appear with your tasks listed on the bottom half. If all goes well, one by one your tasks will advance to the green "done" status.

New workflow

Run A Workflow, Step 6b (an error!)

If your run errors out, you'll see your task listed in red. You can diagnose the problem by clicking on the "View Files/Logs/.nc" button to view the log files for your run.

New workflow

Run A Workflow, Step 6b (an error!, continued)

Double click the mouse on "logs" to switch to the logs directory, then click the "View as Text" button to open the file called "def_ungrib_???.log" (note: "???" is randomly assigned each run to guarantee file name uniqueness).

New workflow

Run A Workflow, Step 6b (an error!, continued)

In this case, the log file indicates that it was unable to open GRIBFILE.AAA. (Note: occasionally you can find even more information about why a run failed by looking for additional log files in the "/work" directory).

New workflow

Using the Diff Tool, Step 1

In this example run, since ungrib was unable to open the GRIBFILE.AA file, I suspect the run date may have been in error. To find out for sure, I want to compare my run configuration to an earlier one I created that ran successfully, so I use the WRF Portal Diff Tool, available on the Tools Menu.

New workflow

Using the Diff Tool, Step 2

The Diff Tool can "diff" (difference) workflows, workflow runs, or any text files you load from disk. Click on "Workflow" in the upper left to diff workflows. Click on "Workflow Run" to diff workflow runs. Click on "Text files from disk" to diff ascii text files (perhaps two different namelist.input files on your local or remote system, for example). Press the "Diff" button to perform the diff.

In this example, note how the run date is different than my earlier (successful) run..

New workflow

Re-run Entire Workflow, Step 1

To re-run my entire run for the new date, I re-open the workflow run and then select "Make Editable" from the Actions menu. This will delete all the "run" files that were created when I ran the workflow earlier, and enable me to edit anything in the window. Note that if I just wanted to re-run a subset of the tasks (like ungrib or metgrid), I could choose "Rerun Selected Tasks" and then the portal would prompt me for which tasks to re-run and then it would re-run them (without deleting the output of the earlier run).

New workflow

Re-run Entire Workflow, Step 2

When prompted, select "Yes" to proceed.

New workflow

Re-run Entire Workflow, Step 3

This time I enter the correct date of "2005-07-11" (July 11, 2005) at 00 hours.

New workflow

Re-run Entire Workflow, Step 4

def_ungrib finishes without error (as does def_metgrid and def_real). Note that def_wrf has just started running (in this screen capture).

New workflow