Dataset Subscription
To include datasets in your app, you request access to them during the application registration.
You can either request access using your Microsoft Azure account e-mail, or using the Tenant ID and Object ID of your Azure Active Directory user.
See the Application Wizard section for more details.
If you submit the email, you receive an e-mail invitation to Azure Data Share in your inbox. You need an Azure Blob Storage attached to your Azure Account, to store the datasets you receive.
The following section will make help you create of the Blob Storage before accepting the invitation.
Azure Subscription
You need an account on Azure, with a subscription. Use one that your company holds. If you can’t see any subscription or you do not have one yet, navigate to the Subscriptions page on Azure.
Click +Add to add a subscription. This will redirect you to the Azure Subscriptions overview page. Select one that is suitable for you.
After refreshing the page, you subscription should appear in the subscription list.
For more information about how to create a subscription, read the Azure Create Subscription documentation.
Read the Azure Subscription REST API documentation to implement functionality using REST API endpoints.
Azure Roles and Permissions
A subscription comes with certain roles and permissions.
These roles are important when you want to access the datasets.
Read more about the roles you need to have, and how to activate them in this Azure Roles and Permissions documentation .
Azure Resource Group
Create a resource group, which stores the metadata of your resources.
Navigate to Resource Groups page from the left side menu. Click +Add to add a resource group.
This will redirect you to the resource group creation page. Fill in the required fields and create the resource group.
You see your newly created resource group in the Resource Groups page.
For more information about what a resource group is and how to create one in this Azure Resource Group documentation.
Read the Azure Resource Group REST API documentation to implement functionality using REST API endpoints.
Azure Blob Storage
Create the blob storage. Navigate to Storage Accounts page from the left-side menu or type storage accounts
in the search bar.
Create a blob storage account by clicking +Add.
Enter the details for your blob storage account:
- select a subscription
- select a resource group from that subscription to associate with the blob storage
- enter a unique name for your blob storage
- select the Account kind as
Blob Storage
Click Review+Create. The rest of the fields may remain as they are by default.
This is what to expect after a successful creation of the blob storage account.
You find your blob storage account and its details in the Storage Accounts page.
For more information about what a blob storage is and how to create an account, read the Azure Blob Storage documentation.
Read the Azure Storage Account REST API documentation to implement functionality using REST API endpoints.
Watch this Azure video on how to create a blob storage account.
Accept the Data Share Invitation
Having a Subscription, a Blob Storage account, a Resource Group, and a Data Share account allows you to accept the invitation you received through the e-mail.
Search invitations
in the search bar or click the link from the invitation e-mail to be redirected to the Azure Data Share Invitations page.
Select the invitation you received.
Accept the terms and conditions.
Fill in the required fields:
- select a subscription
- select a resource group from that subscription
- select a data share account from that resource group
- enter a name for your received share
Accept the invitation.
In the Received Shares page, you see the Details of the invitation.
For more information about how to accept an invitation from your data provider using Azure Data Share, read the Azure Accept an Invitation documentation.
Read the Azure Consumer Invitation REST API documentation to implement functionality using REST API endpoints.
Watch these Azure video tutorials which explain step by step how to accept the invitation:
Mapping the Datasets
The datasets are now in your blob storage account. To be able to view or download them, you need to map them to a target.
From Received Shares page, switch to Datasets tab to see the datasets you requested the access to use.
Select the datasets you want to map and click +Map to target.
Fill in the required data and name the container in which you will store the datasets. Map the datasets to target.
You see in your storage account or Received Shares page that the datasets have been mapped.
For more information about how to map the datasets, read the Azure Map to Target documentation.
Read the Azure Data Set Mapping REST API documentation to implement functionality using REST API endpoints.
Snapshots for Datasets
After you map your received datasets, you can enable the snapshot update.
In the Received Shares page, switch to Snapshot Schedule tab.
Select the updating frequency. To enable it, click +Enable.
The data is checked for updates at the recurrence interval set up in the snapshot schedule.
If there are any changes were made to the data since your last snapshot, the datasets will be updated and copied to your storage.
You can trigger a snapshot of your datasets from the Details tab of your dataset, that updates your stored dataset copies.
For more information about what a snapshot is and how it works, read the Azure Terminology .
Read the Azure Create a Snapshot REST API documentation to implement functionality using REST API endpoints.
Download the Datasets
To manually download the datasets to your device, simply follow the path that is displayed in the Received Shares - Dataset tab.
This redirects you to the container page in which you store the datasets. Select the container.
Here you see the available datasets folders. Select the one you want to download.
The dataset in csv format is available for download. Select it to view its details.
The details of the dataset csv file are displayed. Now you can download them by clicking Download.
Use Storage Explorer to download the datasets
There is another method to download the received datasets, by using the Storage Explorer.
Navigate to your dataset container using the left side menu, and select the desired dataset for download.
Download the dataset in csv format to your device.
For more information, read the Azure Storage Explorer documentation.
If you want to be notified every time the data you subscribed to is modified, read the Azure documentation about Reacting to Blob storage events or Events Hub .
A video about creating events is also available from Azure.
Use the Data
You are now ready to use the data from your Blob Storage.
For further details on how to use the blob data using code, refer to Azure Blob Storage documentation.
In the Examples guide, you are provided with a sample client application tutorial - Deep Learning Dataset tutorial to help you learn more about how to use the datasets in an application.