Name
condor_submit_dag - Manage and queue jobs within a specified DAG for
execution on remote machines
Synopsis
condor_submit_dag [ -help | -version ]
condor_submit_dag [ -no_submit ] [ -verbose ] [ -force ] [ -maxidle
NumberOfJobs ] [ -maxjobs NumberOfJobs ] [ -dagman DagmanExecutable ] [
-maxpre NumberOfPREscripts ] [ -maxpost NumberOfPOSTscripts ] [
-notification value ] [ -noeventchecks ] [ -allowlogerror ] [ -r
schedd_name ] [ -debug level ] [ -usedagdir ] [ -outfile_dir directory
] [ -config ConfigFileName ] [ -insert_sub_file FileName ] [ -append
Command ] [ -oldrescue 0|1 ] [ -autorescue 0|1 ] [ -dorescuefrom number
] [ -allowversionmismatch ] [ -no_recurse ] [ -update_submit ] [
-DumpRescue ] DAGInputFile1 [ DAGInputFile2 ... DAGInputFileN ]
Description
condor_submit_dag is the program for submitting a DAG (directed acyclic
graph) of jobs for execution under Condor. The program enforces the job
dependencies defined in one or more DAGInputFile s. Each DAGInputFile
contains commands to direct the submission of jobs implied by the nodes
of a DAG to Condor. See the Condor User Manual, section for a complete
description.
Options
-help
Display usage information.
-version
Display version information.
-no_submit
Produce the Condor submit description file for DAGMan, but do not
submit DAGMan as a Condor job.
-verbose
Cause condor_submit_dag to give verbose error messages.
-force
Require condor_submit_dag to overwrite the files that it produces,
if the files already exist. Note that dagman.outwill be appended to,
not overwritten. If new-style rescue DAG mode is in effect, and any
new-style rescue DAGs exist, the -force flag will cause them to be
renamed, and the original DAG will be run. If old-style rescue DAG
mode is in effect, any existing old-style rescue DAGs will be
deleted, and the original DAG will be run. Section details rescue
DAGs.
-maxidle NumberOfJobs
Sets the maximum number of idle jobs allowed before condor_dagman
stops submitting more jobs. Once idle jobs start to run,
condor_dagman will resume submitting jobs. NumberOfJobs is a
positive integer. If the option is omitted, the number of idle jobs
is unlimited. Note that for this argument, each individual process
within a cluster counts as a job, which is inconsistent with
-maxjobs .
-maxjobs NumberOfJobs
Sets the maximum number of jobs within the DAG that will be
submitted to Condor at one time. NumberOfJobs is a positive
integer. If the option is omitted, the default number of jobs is
unlimited. Note that for this argument, each cluster counts as one
job, no matter how many individual processes are in the cluster.
-dagman DagmanExecutable
Allows the specification of an alternate condor_dagman executable to
be used instead of the one found in the user’s path. This must be a
fully qualified path.
-maxpre NumberOfPREscripts
Sets the maximum number of PRE scripts within the DAG that may be
running at one time. NumberOfPREScripts is a positive integer. If
this option is omitted, the default number of PRE scripts is
unlimited.
-maxpost NumberOfPOSTscripts
Sets the maximum number of POST scripts within the DAG that may be
running at one time. NumberOfPOSTScripts is a positive integer. If
this option is omitted, the default number of POST scripts is
unlimited.
-notification value
Sets the e-mail notification for DAGMan itself. This information
will be used within the Condor submit description file for DAGMan.
This file is produced by condor_submit_dag . See notification within
the section of submit description file commands in the condor_submit
manual page on page for specification of value .
-noeventchecks
This argument is no longer used; it is now ignored. Its
functionality is now implemented by the
DAGMAN_ALLOW_EVENTSconfiguration macro (see section ).
-allowlogerror
This optional argument has condor_dagman try to run the specified
DAG, even in the case of detected errors in the user log
specification.
-r schedd_name
Submit to a remote schedd. The jobs will be submitted to the schedd
on the specified remote host. On Unix systems, the Condor
administrator for you site must override the default
AUTHENTICATION_METHODS configuration setting to enable remote file
system (FS_REMOTE) authentication.
-debug level
Passes the the level of debugging output desired to condor_dagman .
level is an integer, with values of 0-7 inclusive, where 7 is the
most verbose output. A default value of 3 is passed to condor_dagman
when not specified with this option. See the condor_dagman manual
page on page for detailed descriptions of these values.
-usedagdir
This optional argument causes condor_dagman to run each specified
DAG as if condor_submit_dag had been run in the directory containing
that DAG file. This option is most useful when running multiple DAGs
in a single condor_dagman . Note that the -usedagdir flag must not
be used when running an old-style rescue DAG (see section ).
-outfile_dir directory
Specifies the directory in which the .dagman.outfile will be
written. The directory may be specified relative to the current
working directory as condor_submit_dag is executed, or specified
with an absolute path. Without this option, the .dagman.outfile is
placed in the same directory as the first DAG input file listed on
the command line.
-config ConfigFileName
Specifies a configuration file to be used for this DAGMan run. Note
that the options specified in the configuration file apply to all
DAGs if multiple DAGs are specified. Further note that it is a fatal
error if the configuration file specified by this option conflicts
with a configuration file specified in any of the DAG files, if they
specify one. For more information about how condor_dagman
configuration files work, see section .
-insert_sub_file FileName
Specifies a file to insert into the .condor.subfile created by
condor_submit_dag . The specified file must contain only legal
submit file commands. Only one file can be inserted. (If both the
DAGMAN_INSERT_SUB_FILE configuration variable and -insert_sub_file
are specified, -insert_sub_file overrides DAGMAN_INSERT_SUB_FILE.)
The specified file is inserted into the .condor.subfile before the
Queue command and before any commands specified with the -append
option.
-append Command
Specifies a command to append to the .condor.subfile created by
condor_submit_dag . The specified command is appended to the
.condor.subfile immediately before the Queue command. Multiple
commands are specified by using the -append option multiple times.
Each new command is given in a separate -append option. Commands
with spaces in them must be enclosed in double quotes. Commands
specified with the -append option are appended to the
.condor.subfile after commands inserted from a file specified by the
-insert_sub_file option or the DAGMAN_INSERT_SUB_FILE configuration
variable, so the -append command(s) will override commands from the
inserted file if the commands conflict.
-oldrescue 0|1
Whether to use "old-style" rescue DAG naming (see section ) when
creating a rescue DAG (0 = false, 1 = true).
-autorescue 0|1
Whether to automatically run the newest rescue DAG for the given DAG
file, if one exists (0 = false, 1 = true).
-dorescuefrom number
Forces condor_dagman to run the specified rescue DAG number for the
given DAG. A value of 0 is the same as not specifying this option.
Specifying a non-existent rescue DAG is a fatal error.
-allowversionmismatch
This optional argument causes condor_dagman to allow a version
mismatch between condor_dagman itself and the .condor.subfile
produced by condor_submit_dag (or, in other words, between
condor_submit_dag and condor_dagman ). WARNING! This option should
be used only if absolutely necessary. Allowing version mismatches
can cause subtle problems when running DAGs.
-no_recurse
This optional argument causes condor_submit_dag to not run itself
recursively on nested DAGs (the default is that recursion is
enabled). (DAG nodes specified with the SUBDAG EXTERNALkeyword or
with submit file names ending in .condor.subare considered nested
DAGs, and, by default, condor_submit_dag -no_submit -update_submit
is run on the corresponding DAG files.)
-update_submit
This optional argument causes an existing .condor.subfile to not be
treated as an error; rather, the .condor.subfile will be
overwritten, but the existing values of -maxjobs , -maxidle ,
-maxpre , and -maxpost will be preserved.
-DumpRescue
This optional argument tells condor_dagman to immediately dump a
rescue DAG and then exit, as opposed to actually running the DAG.
(This feature is mainly intended for testing.)
See Also
Condor User Manual
Exit Status
condor_submit_dag will exit with a status value of 0 (zero) upon
success, and it will exit with the value 1 (one) upon failure.
Examples
To run a single DAG:
% condor_submit_dag diamond.dag
To run a DAG when it has already been run and the output files exist:
% condor_submit_dag -force diamond.dag
To run a DAG, limiting the number of idle node jobs in the DAG to a
maximum of five:
% condor_submit_dag -maxidle 5 diamond.dag
To run a DAG, limiting the number of concurrent PRE scripts to 10 and
the number of concurrent POST scripts to five:
% condor_submit_dag -maxpre 10 -maxpost 5 diamond.dag
To run two DAGs, each of which is set up to run in its own directory:
% condor_submit_dag -usedagdir dag1/diamond1.dag dag2/diamond2.dag
Author
Condor Team, University of Wisconsin-Madison
Copyright
Copyright (C) 1990-2009 Condor Team, Computer Sciences Department,
University of Wisconsin-Madison, Madison, WI. All Rights Reserved.
Licensed under the Apache License, Version 2.0.
See the Condor Version 7.2.4 Manual or
http://www.condorproject.org/licensefor additional notices. condor-
admin@cs.wisc.edu
date just-man-pages/condor_submit_dag(1)