The following is a guide to using Azure Synapse Analytics Dedicated SQL Pools, formerly SQL DW. For more info, refer to What is dedicated SQL pool (formerly SQL DW) in Azure Synapse Analytics? for more info.
Refer to Microsoft Fabric Synapse Data Warehouse to set it up with dbt.
Overview of dbt-synapse
- Maintained by: Microsoft
- Authors: Microsoft (https://github.com/Microsoft)
- GitHub repo: Microsoft/dbt-synapse
- PyPI package:
- Slack channel: #db-synapse
- Supported dbt Core version: v0.18.0 and newer
- dbt Cloud support: Not Supported
- Minimum data platform version: Azure Synapse 10
pip is the easiest way to install the adapter:
pip install dbt-synapse
dbt-synapse will also install
dbt-core and any other dependencies.
For Synapse-specifc configuration please refer to Synapse Configuration
For further info, refer to the GitHub repository: Microsoft/dbt-synapse
Azure Synapse offers both Dedicated SQL Pools and Serverless SQL Pools. **Only Dedicated SQL Pools are supported by this adapter.
On Debian/Ubuntu make sure you have the ODBC header files before installing
sudo apt install unixodbc-dev
Download and install the Microsoft ODBC Driver 18 for SQL Server. If you already have ODBC Driver 17 installed, then that one will work as well.
Microsoft made several changes related to connection encryption. Read more about the changes here.
This adapter is based on the adapter for Microsoft SQL Server. Therefor, the same authentication methods are supported.
The configuration is the same except for 1 major difference:
instead of specifying
type: sqlserver, you specify
driver: 'ODBC Driver 17 for SQL Server' # (The ODBC Driver installed on your system)
server: workspacename.sql.azuresynapse.net # (Dedicated SQL endpoint of your workspace here)
You can find all the available options and the documentation and how to configure them on the documentation page for the dbt-sqlserver adapter.