Wait

It waits for successful finish of all previous components of an EVL job (in an EVS file) or all previous ‘Run’ commands in an EVL workflow (in an EWS file). So it acts similar way as standard Bash ‘wait’ command.

Once all previous components/parts of the job/workflow successfully finish the job/workflow continue further.

EVS is EVL job structure definition file, for details see ‘man 5 evl-evs’.

EWS is EVL workflow structure definition file, for details see ‘man 5 evl-ews’.

EVL job (EVS file):

If any component of an EVL job fails, it immediately cancel the whole job.

There is neither argument nor option for ‘Wait’ command in EVL job, i.e. in EVS file. More precisely: all arguments are ignored, so it can be used for comments.

EVL workflow (EWS file):

If any invoked EVL job/workflow (by ‘Run’ command) fails, then cancel only given ‘Run’ command and continue in processing others. Once all ‘Run’ commands finish (either successfully or fail), then ‘Wait’ command fails unless ‘EVL_WAIT_FAIL’ is set to 0.

When no <job>, <workflow> or <script> is specified, further processing will wait <time> for all previously fired parts (i.e. ‘Run’ commands) and fail if at least one of them fails.

When no <time> is specified by ‘--time’ option, then wait at most ‘$EVL_WAIT_TIME’, which is by default 10 hours.

<time> can be secified in seconds, minutes, hours or days, so suffix ‘s’, ‘m’, ‘h’ or ‘d’ need to be specified to the number. If no unit is specified, seconds are assumed.

When <job>, <workflow> or <script> is specified, it waits for successful run of such job/workflow/script of the current project and of the current <odate>. Different <project> and/or <odate> can be specified by the particular options.

Synopsis

Wait
  ( <job>.evl | <workflow>.ewf | <script>.sh )
  [-p|--project=<project>] [-o|--odate=<odate> | -y|--yesterday]
  [-t|--time=<time>]

Wait
  [-m|--myself [-o|--odate=<odate> | -y|--yesterday]]
  [-t|--time=<time>]

evl wait
  ( --help | --usage | --version )

Options

Standard options:

--help

print this help and exit

--usage

print short usage information and exit

--version

print version and exit

Environment Variables

EVL_WAIT_FAIL=1 ¶

EVL workflow only. whether or not to fail the whole workflow when the ‘Run’ command fails, so when zero is set, the workflow continue regardless task failures

EVL_WAIT_INTERVAL=2s ¶

EVL workflow only. the time interval between each check for ‘Wait’ command. It can be specified in seconds, minutes, hours or days, so suffix ‘s’, ‘m’, ‘h’ or ‘d’ need to be specified to the number. If no unit is specified, seconds are assumed.

EVL_WAIT_TIME=10h ¶

EVL workflow only. maximal amount of time to wait for a previous ‘Run’ commands to finish. It can be specified in seconds, minutes, hours or days, so suffix ‘s’, ‘m’, ‘h’ or ‘d’ need to be specified to the number. If no unit is specified, seconds are assumed.

Examples

EVL job

1. Run EVL job in two steps:

   Read  file.json INPUT   evd/file.evd --text-input
   Map   INPUT     MAPPED  evd/file.evd evd/stage.evd evm/file.evm
   Write MAPPED    stage.parquet        evd/stage.evd
   
   Wait "For for creation of parquet file."
   
   Run   "impala \"refresh table stage;\""
   
   End
   

EVL workflow

2. Wait for myself (i.e. the same workflow yesterday) to finish:

   Wait --myself
   

   or the inother words:

   Wait --myself --yesterday
   

   or shortly also:

   Wait -my
   

3. Wait for all jobs to finish, but at most 1 hour, then fail:

   Run file2stage.bills.evl update.bills.evl
   Run file2stage.invoices.evl
   Wait --time 1h
   

4. Wait (forever) for successful run of the job ‘file2stage_example.evl’, then continue:

   Wait job/file2stage.example.evl
   

5. Wait (at most 1 day) for the job ‘export_job.evl’ before continue:

   Wait job/export_job.evl --time 1d
   

6. Wait (at most 120 minutes) for the job ‘sftp_billing.evl’ of the different project ‘billing’ (of current ODATE):

   Wait job/sftp_billing.evl --project billing --time 120m
   

7. Wait (at most 300 seconds) for the job ‘sftp_billing.evl’ of the different project ‘billing’ of the 20240509}:

   Wait job/sftp_billing.evl --project billing --odate "20240509" --time 300
   

8. Wait (at most 6 hours) for previous run of given workflow. (Variable ‘ODATE_MINUS1’ has to be set by you.):

   Wait other_workflow.ewf --odate $ODATE_MINUS1 --time 6h