Create and Release an Asset
- Vytas Glambinskas
- Space Sync for Confluence
Creating an asset allows users to choose from a multitude of configured connector types. The data can stay at source or be ingested to the platform. This means that no data movement is necessary and the data does not need to be stored on any particular cloud provider.
Assets can be created from a range of connector types and sources:
External sources:
AWS S3
GCP GCS
Azure Blob storage
Snowflake
BigQuery
Upload from local drive
Internal sources:
Tasks
Spaces
Note: You must have an asset creator role to perform this action.
Create an Asset
Navigate to the Assets feature by clicking Assets under the Manage menu.
On the asset management page, click Create asset. This opens the first of two setup steps
Setup step 1
Complete the form on setup step 1 providing
Insert Asset name
Select Source
Select Connector
Select Type of asset
Table
File
Provide additional details about the source data. This will depend on the asset source:
For cloud storage sources (e.g. S3, Azure Blob or GCS), this will be path to data
For data warehouse sources (e.g. Snowflake or BigQuery) this will be a selection that is dependent on source, such as a database and table/view
Indicate whether the path is to a single file or folder containing files and folders
Select whether data is to be At source or On platform.
Important: Creating an At Source Asset means that the data will not be copied to the platform, it will remain at source and be accessed at source. There is no data movement occurring with this option.
Creating an On Platform Asset means that a copy is taken and stored on the Harbr platform.
Choosing At Source or On Platform is available optionality to support your specific data storage, location and movement requirements or restrictions.
Setup step 2
Proceed to setup step 2 by clicking Start setup.
View a summary of the values set on setup step 1
Await completion of set up tasks, these could include
Data access check (File and Table assets)
Data format check (Table assets)
Schema confirmation (CSV Table assets only)
NB: In the case that the data format is found to be CSV, a schema review is required before setup can be completed. This is to allow any adjustments to the schema that has been discovered. This could be adjustments to table properties or data types. Often, no adjustment is necessary. Once this has been reviewed and the correct structure is available, the schema must be saved.
Click Finish setup.
Releasing a new asset
Once you have completed the setup of an asset you will be directed to the asset overview page. The asset will be in a draft state.
The asset must be released to acquire a Live state. Only Live assets can be added to products or consumed in spaces or export.
You can release an asset once any format validation or copy jobs have completed. These wont take more than a few minutes.
The release panel is found on the right of the asset overview page and the release button will be blue when its enabled and a release can be performed.
All tabs on the asset overview page are accessible and editable while the asset is being prepared for release so you can make adjustments to any asset details in the meantime.
References and FAQs
Related Pages