Bureaucrats, cc_docs_admin, cc_staff
2,879
edits
Job arrays: Difference between revisions
no edit summary
No edit summary |
No edit summary |
||
| Line 41: | Line 41: | ||
<!--T:10--> | <!--T:10--> | ||
Note that, other than the initial job-submission step with <code>sbatch</code>, the load on the scheduler is the same for an array job as for the equivalent number of non-array jobs. The cost of dispatching each array task is the same as dispatching a non-array job. You should not use a job array to submit tasks with very short run times, e.g. much less than an hour. Tasks with run times of only a few minutes should be grouped into longer jobs using [[ | Note that, other than the initial job-submission step with <code>sbatch</code>, the load on the scheduler is the same for an array job as for the equivalent number of non-array jobs. The cost of dispatching each array task is the same as dispatching a non-array job. You should not use a job array to submit tasks with very short run times, e.g. much less than an hour. Tasks with run times of only a few minutes should be grouped into longer jobs using [[GLOST]], [[GNU Parallel]], or a shell loop inside of a job. | ||
== Example: Multiple directories == <!--T:11--> | == Example: Multiple directories == <!--T:11--> | ||