FILTER

Synopsis

HELP:   Generate filter objects for certain records to search in a archive
TYPE:   OBJECT
SYNTAX: FILTER(ROWLIST='str'/STREAM/DUMMY,DATASET[()...],OUTPUT='str'/STDOUT/STDERR,LOGGING.{},MESSAGE(),NORUN)

Description

The FILTER command is used to create a signature (which does not allow any conclusions to be drawn about the data) from a clear data set in one of its specific formats (preferably CSV). This signature is used for Bloom filtering, which can be used to search (MATCH) for segments and records in the compressed and encrypted data without decrypting or decompressing it.

To ensure that the indexing of the respective archive is known and does not have to be specified explicitly, the list of row specifications (formats) of an archive can be generated using the LIST command and can be specified using the ROWLIST parameter. This allows you to determine the maximum indexing of an archive for your search queries. If the indexing is explicitly specified in the FILTER object, a plausibility check of these values is carried out.

If the ROWLIST is specified, the format and column names must match. If wildcards are used to search for the same content across several columns with the same index, the row specifications of the archive must not be included and the indexing must be specified.

To get syntax information, please use:

   flcl SYNTAX ARCHIVE.FILTER

To get help for a parameter, please use:

   flcl HELP ARCHIVE.FILTER.parameter[.parameter[...]]

To read the manual page for a parameter, please use:

   flcl MANPAGE ARCHIVE.FILTER.parameter[.parameter[...]]
      or
   flcl HELP ARCHIVE.FILTER.parameter[.parameter[...]] MAN

To generate the user manual for the command, please use:

   flcl GENDOCU ARCHIVE.FILTER=filename

Parameters can be defined via command line (directly or by parameter file) or via properties taken from the corresponding property file.

Arguments