Automation Best Practices
- Warner, Sara
- Ruby - Mae Williams
On the platform you can easily update data in your products when your source data is refreshed through the use of a transfer notification file, or TNF. You can also assign data products to be exported whenever they are updated, on an event (refresh), or schedule basis (for example once a week).
Tasks allow you to turn what once were static engineered products into repeating engineered products. This feature allows you to automate their Spaces code and dynamically create engineered data products automatically. Automated Data Products can update on a schedule, be triggered by an update of another Data Product, or be run manually. Using code assets and Tasks saves you countless hours of updating their engineered data products as well as opening up new opportunities for discovery.
We recommend the following when you set up automation for running tasks:
Structure your workflow in smaller, manageable Spaces with a limited number of products, instead of one large Space with all the automation inside which is very challenging to maintain. You can create multiple Spaces to suit your needs.
Separate your automation by tasks that are independent from each other.
If you are working on many use cases, combining several data sets, create one automation per use case instead of one large automation that tries to address everything at once. This is easier to maintain, to update, and to get support should you need help.
There are different ways to trigger an automated task on the platform:
Update manually.
Tie updates to data product updates.
Schedule updates by date, time and interval.
Automating one task can also be used to trigger another. For example, you can trigger a task to update and then use this to trigger the automation of a use case.
You can change when an automated product updates in the Trigger section.
Automation capabilities are determined by your user role and privileges, and your product subscriptions.
Â
Further References