EVL – ETL Tool


Products, services and company names referenced in this document may be either trademarks or registered trademarks of their respective owners.

Copyright © 2017–2022 EVL Tool, s.r.o.

Permission is granted to copy, distribute and/or modify this document under the terms of the GNU Free Documentation License, Version 1.3 or any later version published by the Free Software Foundation; with no Invariant Sections, with no Front-Cover Texts, and with no Back-Cover Texts.

Table of Contents

Merge

(since EVL 1.2)

Merge sorted flows or files into one (sorted) output

Merge

is to be used in EVS job structure definition file. <f_in> and <f_out> are either input and output file or flow name.

evl merge

is intended for standalone usage, i.e. to be invoked from command line. When <file> is ’-’, then read from stdin.

EVD is EVL data definition file, for details see evl-evd(5).

Synopsis

Merge
  <f_in>... <f_out> [<evd>|-d <inline_evd>] -k <key>
  [-c|--check-sort] [-i|--ignore-case]
  [--validate] [-x|--text-input] [-y|--text-output]

evl merge
  [<file>...]  [<evd>|-d <inline_evd>] -k <key>
  [-c|--check-sort] [-i|--ignore-case]
  [--validate] [-x|--text-input] [-y|--text-output]
  [-v|--verbose]

evl merge
  ( --help | --usage | --version )

Options

-c, --check-sort

check if the input is really sorted according to specified key

-d, --data-definition=<inline_evd>

either this option or the file <evd_out> must be presented. Example: -d ’some_id long sep="|", some_value string sep="\\n"’

-i, --ignore-case

be case insensitive for key fields

-k, --key=<key>

group by this key, where <key> is comma separated list of fields with type (either DESC or ASC, default type is ASC). Example: –key=’some_id’

--validate

without this option, no fields are checked against data types. With this option, all output fields are checked

-x, --text-input

suppose the input as text, not binary

-y, --text-output

write the output as text, not binary

Standard options:

--help

print this help and exit

--usage

print short usage information and exit

-v, --verbose

print to stderr info/debug messages of the component

--version

print version and exit

Examples

evl merge example.evd -k 'input_id' -y input1.bin input2.bin input3.bin

merge three (sorted) binary files, the output is in text and sorted by ’input_id’