...

A data command in PIPEFORCE is a command which can apply rules on given JSON data. Usually you would load a JSON document from the property store or from an external location and then you can change the JSON structure by applying the data commands. Examples of such rulesHere is a list of important concepts in this field:

• Enrich - Add more information to a given JSON.

• Filter - Remove data from a given JSON at a given location.

• Limit - Limit a list of JSON data depending on a given condition.

• Encrypt - Encrypt JSON data (and decrypt).

• Sorter - Sorts a list using a given sort condition.

• Projection - Extract a single field value from a list of JSON objects matching a given criteria.

• Selection - Extract one or more objects from a list of JSON objects matching a given criteria.

• And more…

See the commands reference for data.* to find all data commands available.

...

See the reference documentation for a full list of the available Pipeline Utils.

Querying JSON Data

The best performing way of selecting and filtering JSON data is by applying a query directly on the database (property store). Since only the data is returned which matches the given query and the query algorithms are applied directly in the database layer, this should be the preferred way for big and very big JSON documents.

For more details on this see: JSON Property Querying.

You can also use one of the data.filter.* commands for this. But they are all working on a JSON document in memory. They are fast and effective for small to medium sized JSONs.

Integration Patterns Overview​

...