Versions Compared

Version Old Version 8 New Version 9
Changes made by

PIPEFORCE

PIPEFORCE

Saved on

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

Below there is an introduction to all data mapping and transformation toolings you can use in PIPEFORCE:

Transformer Commands

...

A transformer command in PIPEFORCE is a command which transforms / converts data from one structure into another. For example:

...

See the commands reference for transform.* to find all transformers commands available.

Data Commands

...

A data command in PIPEFORCE is a command which can apply some rules on given JSON data. Usually you would load a JSON document from the property store or from an external location and then you can change the JSON structure by applying the data commands.See the commands reference for data.* to find all data commands available.the JSON structure by applying the data commands. Examples of such rules:

  • Enrich - Add more information to a given JSON.

  • Filter - Remove data from a given JSON at a given location.

  • Limit - Limit a list of JSON data depending on a given condition.

  • Encrypt - Encrypt JSON data.

  • Sorter - Sorts a list using a given sort condition.

  • And more…

See the commands reference for data.* to find all data commands available.

Mapping Commands

A mapping command in PIPEFORCE is a command which maps from one JSON data structure into another by applying mapping rules.

For more details on data mapping see this section: /wiki/spaces/DEV/pages/2594668566.

PEL​

The PEL (Pipeline Expression Language) is an important tooling when it comes to data mapping and transformation. It can be used inside the parameters of nearly any command. So it is very important, that you have a good understanding of PEL in case you would like to do data transformation in PIPEFORCE.

...

See the reference documentation for details about the PEL syntax.

PEL Utils​

Additionally to the Pipeline Expression core syntax, there are Pipeline Utils available which also can help you to simplify your data transformation tasks. For data transformation these utils could be of special interest:

...

See the reference documentation for a full list of the available Pipeline Utils.

...

Integration Patterns Overview​

There are many different ways of data transformationintegration. In order to have a common understanding of the different approaches, below you can find the patterns of most of them listed and named.

...