This article describes an example of the steps that could be taken to create a custom asset using assets or products that users already have consumption access for. This journey is described across a range of distinct personas that may be involved.
Persona 1 - Data Engineer
\uD83D\uDCD8 Writing code
The process may start with a Data engineer who does some work to create some new output data.
...
Run queries to validate the publish db now contains only the data that you want to be in the new customized data product.
Save notebook or query.
...
\uD83D\uDCD8 Creating a Task
Once the analysis work has been completed in a Space and the output has been written to the publish_db, the user comes out of the spaces portal and returns to the platform where they have the ability to create a Task.
...
Create a code asset using the saved code.
Create and run a task using the saved code.
Set trigger to run when source product updates
Add fulfilment team members to ‘share’ task.
Check task runs successfully.
Advise fulfilment team of task name and confirm product ready to be created.
Persona 2 - Data Fulfilment
\uD83D\uDCD8 Creating an Asset and adding it to a product
Now that there is a code asset being run successfully by a task, the task can be used as a source to create a data asset. This asset will update with each scheduled task run. This will ensure that consumers receive updated data feeds when they should.
| Info |
|---|
The user publishing the customized product needs to have an ‘unenforced subscription’ to the source product. This is the product that was first used in the first section of this guide “Writing code - data engineer” |
Create an asset with “Task” as the source.
...
| Info |
|---|
The user must hold a Product Administrator role to do this. |
...
Persona 3 - Customer
Now that you’ve created a product containing assets that will be updated according to the running of a code asset by a task, it is ready for consumers to subscribe to it and benefit from continually refreshing data. To do this the customer must:
...