Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

You should get familiar with all of the toolings listed here in order to make the right choice to solve your data transformation task most effectively.

Below there is an introduction to all data mapping and transformation toolings you can use in PIPEFORCE:

Transformer Commands: transform.*

A transformer command in PIPEFORCE is a command which transforms / converts data from one structure into another. A transformer is usually used to transform from an "external" data format (like XML for example) into the "internal" data format which is typically JSON. There are out-of-the box transformers to convert from CSV to JSON, from Word to PDF, from PDF to PNG and many more.Additionally you can write a custom transformation rule using a template and the transform.ftl command for exampleFor example:

  • HTML to Word

  • JSON to XML, XML to JSON

  • PDF to PNG, PNG to PDF

  • Word to PDF

Furthermore, a transformer can also transform data based on a given template. Examples are:

See the commands reference for transformerstransform.* to find all transformers commands available.

Data Commands: data.*

A data command in PIPEFORCE is a command which can apply some rules on an "internal data structure" (which is mostly JSON). So usually given JSON data. Usually you would load a JSON document from the property store or transform it from some external format using a transformer command to JSON first, an external location and then you can change the JSON structure using by applying the data commands.

See the commands reference for data.* to find all data commands available.

PEL

The PEL (Pipeline Expression Language) can be used inside the parameters of nearly any command. So it is very important, that you have a good understanding of PEL in case you would like to do data transformation in PIPEFORCE.

...

See the reference documentation for details about the PEL syntax.

PEL Utils

Additionally to the Pipeline Expression core syntax, there are Pipeline Utils available which also can help you to simplify your data transformation tasks. For data transformation these utils could be of special interest:

...