Sample pipeline overview

This section describes the high-level steps that are necessary to integrate a new/existing pipeline with a deployment template.

Additional detail on each of these steps is provided in later sections.
  1. Ensure that the application name and pipeline configuration prefix match the data prefix configured in the deployment template.
  2. Place pipeline configuration files in the [appdir]/config/pipeline/ directory of the primary server.
  3. In order to enable partial updates, ensure that the project is configured with a record spec (i.e., a unique record identifier property).
  4. Ensure that any input Record Adapters requiring filenames specify the file location relative to the [appdir]/data/processing/ (or [appdir]/data/partials/processing) directory.