Jobs UI for Job Management
The Jobs UI allows users to submit and view DPS jobs from their Jupyter workspace. Users can monitor job status, access generated products, view errors, and view other job metadata.
Access the Jobs UI
From your workspace click on the View & Submit Jobs card on the Launcher tab.
The View pane lists all the jobs submitted by the user. The top table shows only a few key fields. Users can click on any row to view detailed data for the selected job such as inputs, outputs generated, and errors produced if the job failed to complete successfully.
Users can sort jobs by queued, start, and end time in ascending/descending order. Users may use the search bar to filter the job list down to jobs containing the user-provided string in any of the fields shown.
Viewing the Output of a Job
Select your job then under the
Job Details table, click the
Outputs tab. The
Products field provides the path to the product directory within the workspace.
Navigating to the product directory for the selected job above shows the following:
(base) root@workspacelbx1uqgeyqdei83w:~/my-private-bucket/dps_output/run-dps-test_ubuntu/delay10/2023/05/10/15/13/27/250000# pwd /projects/my-private-bucket/dps_output/run-dps-test_ubuntu/delay10/2023/05/10/15/13/27/250000 (base) root@workspacelbx1uqgeyqdei83w:~/my-private-bucket/dps_output/run-dps-test_ubuntu/delay10/2023/05/10/15/13/27/250000# ls _stderr.txt _stdout.txt output-2023-05-10T15:13:27.250000.context.json output-2023-05-10T15:13:27.250000.dataset.json output-2023-05-10T15:13:27.250000.met.json write-output.txt
Submit a Job
Users can submit individual jobs from the Submit pane. The following are the minimum requirements for submitting a job:
Select an Algorithm from the dropdown menu. Note: only registered algorithms will be shown.
Provide a Job Tag that may then be used to easily search for and identify the submitted job. This is the same as the
identifierfield in the maap.py submitJob() function.
Select the Resource to use for algorithm execution. This indicates the memory and disk space available.
Experimental feature: The output data will be put into a folder named for your Algorithm and the Job Tag. You can use the same Job Tag on several jobs (e.g. in a batch) to group related output data in one place. In maap.py submitJob this is the
identifier field when you use submitJob().
Algorithms may contain additional inputs that users may have to provide.
Once all inputs have been provided, the user may click Submit Job to submit the job. If the job was submitted successfully, a toast will appear in the bottom right corner containing the unique job id. Please give the Submit Job button a second to execute.
If the job failed to submit, a toast will appear indicating the job failed to submit.
Generate Job Submission Command
Users may fill out the job submission form and - instead of submitting the job - click the Copy Jupyter Notebook Code button to copy the maap-py job submission command to their clipboard to then paste it into a Jupyter notebook.