EVL Anonymization

Table of Contents


Products, services and company names referenced in this document may be either trademarks or registered trademarks of their respective owners.

Copyright © 2017–2020 EVL Tool, s.r.o.

Permission is granted to copy, distribute and/or modify this document under the terms of the GNU Free Documentation License, Version 1.3 or any later version published by the Free Software Foundation; with no Invariant Sections, with no Front-Cover Texts, and with no Back-Cover Texts.

Version 0.2

Released

2019/07

EVL Version needed

2.1

Changes
  • Function ‘TOKENIZE’ renamed to ‘ANONYMIZE_UNIQ’ as it better describes what it does. To migrate, it is enough to replace all in anon-config file(s) and regenerate jobs.
  • Function ‘TOKENIZE_LKP’ renamed to ‘TOKENIZE’. To migrate, it is enough to replace all in anon-config file(s) and regenerate jobs.
  • Default Anonymization options can be added into project.sh:
    export EVL_ANON_DEFAULT_MIN_STRING_LENGTH=0
    export EVL_ANON_DEFAULT_MAX_STRING_LENGTH=10
    

    Then for string fields these values are used when ‘min_length’ and/or ‘max_length’ are empty in anon-config file.

  • When running generated anonymization jobs, data are appended to the target file/table, not overwritten.
  • Dates/timestamps 9999-12-31 and 4712-12-31 are not anonymized by default.
New features
  • randomization,
  • Min and Max can be specified also for dates and timestamps,
  • masking.
Migration script

To migrate your config CSV file from version 0.1, just run:

# cd to your project directory
for i in anon-config.*.csv
do
  mv $i $i.bckp
  sed 's/TOKENIZE\([^_]\)/ANONYMIZE_UNIQ\1/;
       s/TOKENIZE_LKP/TOKENIZE/' $i.bckp >$i
done