Run a Job#

Before you can run a job, you must upload the input files to a file system or a space. The job will run in the data center where the input files are stored.

Create the Job#

In the CONVERGE Horizon web interface, you can create a job from the file system or space containing the input files:

  1. Open the Create Job form.

    • If the input files are on a file system, log in to the File Manager and open the directory for your case. Click Create Job on the left.

      ../../_images/create_job_fs.png
    • If the input files are in a space, go to Spaces and click on the name of the space. Select the directory for your case and click Create Job.

      ../../_images/create_job.png
  2. Fill out the job options. When you are ready to submit the job, click Create Job.

There are also ways to create jobs outside of the CONVERGE Horizon web interface:

Check Job Status#

Go to the Jobs page to check the status of a job. You can adjust the filters at the top right to filter the results by job owner, job status, or other criteria. By default, the queue shows only your own jobs from the past week.

View the Job Log#

You can see detailed status information in the job log. On the Jobs page, click on the name of the job to open the Job Details page. Expand the Log section to view the job log.

../../_images/system_log1.png

An example system log for a job.#

Depending on job status, the job log can display one of two different logs—the system log or the horizon.log file. The system log, which shows information from the CONVERGE Horizon backend, appears when the status is Pending, Provisioning, Interactive, or Stopping. The horizon.log file, which contains standard output from CONVERGE (i.e., output that would be written to the screen if you ran the simulation locally), appears when the status is Running.

The job log shows only the most recent information from the system log or the horizon.log file. No information is displayed if the job status is Stopped or Failed.

View Job Metrics#

CONVERGE Horizon displays a number of real-time performance metrics to help you monitor jobs while they are running. On the Jobs page, click on the name of a job to open the Job Details page.

In the Application Metrics section, you can monitor up to 5 metrics selected from CONVERGE output files. The wall time from stream0/time.out and the total cell count from stream0/cell_count_ranks.out are selected by default. To add more metrics, you can select from the suggested options or click Add metric to choose any variable from the *.out files written by CONVERGE. To remove a metric, click X in the upper right corner.

For information about the data written to CONVERGE output files, consult the CONVERGE Manual (available on the Convergent Science Hub).

../../_images/application_metrics.png

An example of application metrics for a running job.#

In the Node Metrics section, you can view recent data for CPU and memory utilization.

CONVERGE Horizon updates data for the job metrics every 5 minutes (there is no need to refresh the page). Suggestions for application metrics are also updated every 5 minutes based on the job’s current output.

Monitor Job Output#

If a job is running on a file system, you can access the full set of output files in real time from the File Manager. You can also attach the file system to a workstation to perform post-processing tasks at any time during or after the run.

If a job is using a space for storage, there is no web interface that provides real-time access to the full set of output files while the job is running. Instead, you must use SSH to log in to the job cluster. After the job has stopped and the output files have been copied to the space, you can download the output files from the space.