Using Nitro to efficiently run lots of short jobs or tasks
Nitro facilitates the execution of large numbers of short compute tasks without the overhead of individual scheduler jobs. If you have a workload of 10,000 High Throughput Computing (HTC) tasks, each of which has a very short runtime, traditionally this means submitting 10,000 separate jobs. Using Nitro, you can instead submit a single "Nitro Job”.
You combine all of the compute tasks in a single file. When the job starts, this file is then sent to Nitro and Nitro distributes the compute tasks across the processors on the nodes allocated to the job. This provides low scheduling overhead and improved response time for executing many small compute tasks.
You can find more information on using Nitro at http://cs.hpc.nrel.gov/info/how-tos/nitro-2.0.