EVL – ETL Tool


Products, services and company names referenced in this document may be either trademarks or registered trademarks of their respective owners.

Copyright © 2017–2022 EVL Tool, s.r.o.

Permission is granted to copy, distribute and/or modify this document under the terms of the GNU Free Documentation License, Version 1.3 or any later version published by the Free Software Foundation; with no Invariant Sections, with no Front-Cover Texts, and with no Back-Cover Texts.

Table of Contents

Fr

(since EVL 2.0)

reg, register

it checks if at least one of <file>... is not yet with status greater than 3, if yes, then fail. If not, then for each <file>... it creates an entry in <log_file> with status 1 (REGISTERED).

skip

create an entry in <log_file> with status 4 (SKIP), which is practically the same as state 5 (PROCESSED), but it would be sometimes good to distinguish these two cases.

proc, processed

option produces an entry in <log_file> for each <file>... with status 5 (PROCESSED).

arch, archive

option firstly check if the last status of <file>... is 4 (SKIP) or 5 (PROCESSED), fail if not. If yes, then move all <file>... into <archive_dir> and set status to 6.

rerun

create an entry in <log_file> with status 0 (RERUN), which lets FR to act as no <file>... have been processed yet.

Log file <log_file> is an CSV file with this structure:

BASENAME|STATUS_ID|DIRNAME|RECORDS|REJECTED_RECS|RUN_ID|TIMESTAMP|COMMENT

Possible States are standard EVL ones:

0 | RERU | Rerun
1 | RUNN | Running (Registered)
2 | FAIL | Failed
3 | CANC | Canceled
4 | SKIP | Skipped
5 | SUCC | Successful (Processed)
6 | ARCH | Archived

Synopsis

Fr
  ( reg[ister] | skip | proc[essed] | arch[ive] | rerun )  <file>...
  [--log-file=<log_file>] [--archive-dir=<archive_dir>]

evl fr
  ( reg[ister] | skip | proc[essed] | arch[ive] | rerun )  <file>...
  [--log-file=<log_file>] [--archive-dir=<archive_dir>]

Options

--log-file=<log_file>

log CSV file to be used, when not specified value from environment variable EVL_FR_LOG_FILE is used. If such variable is not set, by default $EVL_PROJECT_LOG_DIR/FR.csv is used.

--archive-dir=<archive-dir>

possible only for ‘arch’ option and specifies the path to archive directory, if not specified, value is taken from environment variable EVL_FR_ARCHIVE_DIR. If not such variable is found, then fail.

Examples

These lines in EVL job (an ‘evs’ file):

Fr reg  /some/local/path/file
# Process file
Read    /some/local/path/file INPUT ...
...
Wait
Fr proc /some/local/path/file
Fr arch /some/local/path/file