Data pipeline within PEDASI

PEDASI should support a data pipeline between receiving the data from an upstream data source and returning it to the user.

The pipeline should support operations such as:

• validation
• packaging
• detuning
• aggregation

The pipeline framework should be implemented as a separate package so that consumers of data may use the same framework to perform data transformations locally.

If possible, the details of all transformations should be stored as metadata within a data package.