If you’re new to Unstructured, read this note first.Before you can create a source connector, you must first sign up for Unstructured.
After you sign up, the Unstructured user interface (UI) appears, which you use to create the source connector.After you create the source connector, add it along with a
destination connector to a workflow. Then run the worklow as a
job. To learn how, try out the hands-on UI quickstart or watch the 4-minute
video tutorial.You can also create source connectors with the Unstructured API.
Learn how.If you need help, reach out to the community on Slack, or
contact us directly.You are now ready to start creating a source connector! Keep reading to learn how.
If you are generating an SAS token as shown in the preceding video, be sure to set the following permissions:
- Read and List for reading from the container only.
- Write and List for writing to the container only.
- Read, Write, and List for both reading from and writing to the container.
-
An Azure account. To create one, learn how.
-
An Azure Storage account, and a container within that account. Create a storage account. Create a container.
-
The Azure Storage remote URL, using the format
az://<container-name>/<path/to/file/or/folder/in/container/as/needed>
For example, if your container is namedmy-container
, and there is a folder in the container namedmy-folder
, the Azure Storage remote URL would beaz://my-container/my-folder/
. -
An SAS token (recommended), access key, or connection string for the Azure Storage account. Create an SAS token (recommended). Get an access key. Get a connection string.
Create an SAS token (recommended):
Get an access key or connection string:
- On the sidebar, click Connectors.
- Click Sources.
- Cick New or Create Connector.
- Give the connector some unique Name.
- In the Provider area, click Azure Blob Storage.
- Click Continue.
- Follow the on-screen instructions to fill in the fields as described later on this page.
- Click Save and Test.
- Name (required): A unique name for this connector.
- Recursive: Check this box to recursively access files from subfolders within the container.
-
Remote URL (required): The Azure Storage remote URL, with the format
az://<container-name>/<path/to/file/or/folder/in/container/as/needed>
For example, if your container is namedmy-container
, and there is a folder in the container namedmy-folder
, the Azure Storage remote URL would beaz://my-container/my-folder/
. - Account Name: For SAS token authentication and account key authentication, the Azure Storage account name.
- SAS Token: For SAS token authentication, the SAS token for the Azure Storage account.
- Account Key: For account key authentication, the key for the Azure Storage account.
- Connection String: For connection string authentication, the connection string for the Azure Storage account.