What is the benefit of having many tasks within one job?
I am using command line tasks and are not using task dependencies, nor parametric sweep.
If someone wants to submit multiple tasks in one go, is there any other benefit to putting them as separate tasks all in the same job? Or should I just submit them all as separate jobs with one task each?
e.g. user wants to submit 1000 tasks and be notified as each completes. If I submit these as 1000 tasks in one job, I can't see what benefits the job itself gives me vs submitting 1000 jobs - other than providing a grouping of tasks that were submitted together.
Does it reduce overhead or give better performance in terms of workload on the head node?
Thanks