Skip to main content

InferredAssetAzureDataConnector

class great_expectations.datasource.data_connector.InferredAssetAzureDataConnector(name: str, datasource_name: str, container: str, execution_engine: Optional[great_expectations.execution_engine.execution_engine.ExecutionEngine] = None, default_regex: Optional[dict] = None, sorters: Optional[list] = None, name_starts_with: str = '', delimiter: str = '/', azure_options: Optional[dict] = None, batch_spec_passthrough: Optional[dict] = None, id: Optional[str] = None)#

An Inferred Asset Data Connector used to connect to Azure Blob Storage.

This Data Connector uses regular expressions to traverse through Azure Blob Storage containers and implicitly determine Data Asset name.

Much of the interaction is performed using a BlobServiceClient. Please refer to the Official Azure Documentation for more information.

Parameters:

  • name – The name of the Data Connector.

  • datasource_name – The name of this Data Connector’s Datasource.

  • container – The container for Azure Blob Storage.

  • execution_engine – The Execution Engine object to used by this Data Connector to read the data.

  • default_regex – A regex configuration for filtering data references. The dict can include a regex pattern and a list of group_names for capture groups.

  • sorters – A list of sorters for sorting data references.

  • name_starts_with – Infer as Data Assets only blobs that begin with this prefix.

  • delimiter – When included, will remove any prefix up to the delimiter from the inferred Data Asset names.

  • azure_options – Options passed to the BlobServiceClient.

  • batch_spec_passthrough – Dictionary with keys that will be added directly to the batch spec.

  • id – The unique identifier for this Data Connector used when running in cloud mode.

get_available_data_asset_names() → List[str]#

Return the list of asset names known by this DataConnector

Returns:

A list of available names