Cloud and Azure

Azure SQL, Fabric, Managed Instance, migrations, Arc, hybrid scenarios, Snowflake

Part 8 — Implementing the Lakehouse: Fabric, Databricks, and AWS

Part 8 — Implementing the Lakehouse: Fabric, Databricks, and AWS – SQLYARD Leave a Comment / Articles, Data Engineering, Scripts / By SQLYARD Deep Technical Series — Building a Modern Data Warehouse and Lakehouse Part 8 — Implementing the Lakehouse: Fabric, Databricks, and AWS By SQLYARD · SQLYARD.com · April 2026 · Estimated read: 35–40 […]

Part 8 — Implementing the Lakehouse: Fabric, Databricks, and AWS Read More »

Part 7 — Implementing the Warehouse: Snowflake, Fabric, BigQuery, Synapse, and Redshift

Part 7 — Implementing the Warehouse: Snowflake, Fabric, BigQuery, Synapse, and Redshift – SQLYARD Leave a Comment / Articles, Data Engineering, Scripts / By SQLYARD Deep Technical Series — Building a Modern Data Warehouse and Lakehouse Part 7 — Implementing the Warehouse: Snowflake, Fabric, BigQuery, Synapse, and Redshift By SQLYARD · SQLYARD.com · April 2026

Part 7 — Implementing the Warehouse: Snowflake, Fabric, BigQuery, Synapse, and Redshift Read More »

Part 6 — Transformations Part 2: SCD Types, Fact Loading, Spark, and Merge Optimization

Part 6 — Transformations Part 2: SCD Types, Fact Loading, Spark, and Merge Optimization – SQLYARD Leave a Comment / Articles, Data Engineering, Scripts / By SQLYARD Deep Technical Series — Building a Modern Data Warehouse and Lakehouse Part 6 — Transformations Part 2: SCD Types, Fact Loading, Spark, and Merge Optimization By SQLYARD ·

Part 6 — Transformations Part 2: SCD Types, Fact Loading, Spark, and Merge Optimization Read More »

Part 5 — Transformations Part 1: ELT Strategy, dbt Modeling, and SQL Pipelines.

Part 5 — Transformations Part 1: ELT Strategy, dbt Modeling, and SQL Pipelines – SQLYARD Leave a Comment / Articles, Data Engineering, Scripts / By SQLYARD Deep Technical Series — Building a Modern Data Warehouse and Lakehouse Part 5 — Transformations Part 1: ELT Strategy, dbt Modeling, and SQL Pipelines By SQLYARD · SQLYARD.com ·

Part 5 — Transformations Part 1: ELT Strategy, dbt Modeling, and SQL Pipelines. Read More »

Part 4 — Ingesting Data: Fivetran, Airbyte, Snowpipe, Autoloader, Glue, ADF, and CDC

Part 4 — Ingesting Data: Fivetran, Airbyte, Snowpipe, Autoloader, Glue, ADF, and CDC – SQLYARD Leave a Comment / Articles, Data Engineering, Scripts / By SQLYARD Deep Technical Series — Building a Modern Data Warehouse and Lakehouse Part 4 — Ingesting Data: Fivetran, Airbyte, Snowpipe, Autoloader, Glue, ADF, and CDC By SQLYARD · SQLYARD.com ·

Part 4 — Ingesting Data: Fivetran, Airbyte, Snowpipe, Autoloader, Glue, ADF, and CDC Read More »

Part 3 — Building the Data Lake: Bronze, Silver, and Gold Architecture

Part 3 — Building the Data Lake: Bronze, Silver, and Gold Architecture – SQLYARD Leave a Comment / Articles, Data Engineering, Scripts / By SQLYARD Deep Technical Series — Building a Modern Data Warehouse and Lakehouse Part 3 — Building the Data Lake: Bronze, Silver, and Gold Architecture By SQLYARD · SQLYARD.com · April 2026

Part 3 — Building the Data Lake: Bronze, Silver, and Gold Architecture Read More »

Part 2 — Choosing the Architecture: Warehouse, Lake, or Lakehouse

Part 2 — Choosing the Architecture: Warehouse, Lake, or Lakehouse – SQLYARD Leave a Comment / Articles, Data Engineering / By SQLYARD Deep Technical Series — Building a Modern Data Warehouse and Lakehouse Part 2 — Choosing the Architecture: Warehouse, Lake, or Lakehouse By SQLYARD · SQLYARD.com · April 2026 · Estimated read: 30–35 min

Part 2 — Choosing the Architecture: Warehouse, Lake, or Lakehouse Read More »

Part 1 — Dimensional Modeling and Warehouse Design

Part 1 — Dimensional Modeling and Warehouse Design – SQLYARD Leave a Comment / Articles, Data Engineering, Scripts / By SQLYARD Deep Technical Series — Building a Modern Data Warehouse and Lakehouse Part 1 — Dimensional Modeling and Warehouse Design By SQLYARD · SQLYARD.com · April 2026 · Estimated read: 30–35 min Part 1 of

Part 1 — Dimensional Modeling and Warehouse Design Read More »

Part 0 — Series Overview: A Complete Guide to Building a Modern Data Warehouse and Lakehouse

Part 0 — Series Overview: Building a Modern Data Warehouse and Lakehouse – SQLYARD Leave a Comment / Articles, Data Engineering / By SQLYARD Deep Technical Series — Building a Modern Data Warehouse and Lakehouse Part 0 — Series Overview: A Complete Guide to Building a Modern Data Warehouse and Lakehouse By SQLYARD · SQLYARD.com

Part 0 — Series Overview: A Complete Guide to Building a Modern Data Warehouse and Lakehouse Read More »

Part 5. AI Powered Modeling in Microsoft Fabric: Smarter, Faster, and More Accurate Semantic Models

Introduction Modeling has always been one of the most time consuming and technically demanding parts of building analytical solutions. You need to understand the business domain, define clean relationships, choose the right grain, build DAX measures, optimize performance, and enforce governance. For many organizations, modeling becomes the bottleneck that slows down BI development. Microsoft Fabric

Part 5. AI Powered Modeling in Microsoft Fabric: Smarter, Faster, and More Accurate Semantic Models Read More »

Microsoft Fabric Series Part 4: Automatic Aggregations for DirectQuery Semantic Models

Microsoft Fabric Automatic Aggregations: Optimizing DirectQuery Semantic Models – SQLYARD Leave a Comment / Articles, Microsoft Fabric, Performance Tuning / By SQLYARD Microsoft Fabric Automatic Aggregations: Optimizing DirectQuery Semantic Models By SQLYARD · SQLYARD.com · Updated June 2026 · Estimated read: 18–22 min Automatic aggregations are a Microsoft Fabric and Power BI capability for improving

Microsoft Fabric Series Part 4: Automatic Aggregations for DirectQuery Semantic Models Read More »

Part 3. Real Time Semantic Models in Microsoft Fabric: Delivering Instant Insights at Scale

Introduction Real time analytics used to be one of the hardest problems in BI. Organizations either accepted stale dashboards or had to build complex streaming architectures with custom code, event hubs, and constant maintenance. Microsoft Fabric solves this through Real Time Semantic Models, which bring always-current data directly into the Fabric semantic layer. Instead of

Part 3. Real Time Semantic Models in Microsoft Fabric: Delivering Instant Insights at Scale Read More »

Part 2. Direct Lake in Microsoft Fabric: High Speed Analytics Without Import or DirectQuery

Introduction Direct Lake is one of the most important innovations introduced in Microsoft Fabric. It is not an incremental improvement over Import or DirectQuery. It is a new execution mode that allows the VertiPaq engine to read Delta Lake files directly in OneLake without requiring data imports, scheduled refreshes, or constant round trips to a

Part 2. Direct Lake in Microsoft Fabric: High Speed Analytics Without Import or DirectQuery Read More »

Part 1. Power BI Premium and Fabric Semantic Models: The New Foundation for Enterprise BI

Introduction Power BI has evolved from a self service reporting tool into a full enterprise analytics engine. The biggest shift in this evolution is the introduction of Fabric Semantic Models, which extend and modernize the classic Power BI dataset. When combined with Power BI Premium and the new Fabric architecture, semantic models now act as

Part 1. Power BI Premium and Fabric Semantic Models: The New Foundation for Enterprise BI Read More »

How to Be an Azure SQL DBA: Skills, Practices, And A Hands On Workshop

How to Be an Azure SQL DBA: Skills, Practices, and a Hands-On Workshop – SQLYARD Leave a Comment / Articles, Azure, Scripts / By SQLYARD How to Be an Azure SQL DBA: Skills, Practices, and a Hands-On Workshop By David Yard · SQLYARD.com · April 2026 · Estimated read: 35–40 min Table of Contents The

How to Be an Azure SQL DBA: Skills, Practices, And A Hands On Workshop Read More »

Data Governance Meets SQL: Unlocking Insights with Microsoft Purview

Data Governance Meets SQL: Unlocking Insights with Microsoft Purview | SQLYARD Leave a Comment / Articles, Cloud and Azure / By SQLYARD Data Governance Meets SQL: Unlocking Insights with Microsoft Purview By SQLYARD · SQLYARD.com · Updated June 2026 · Estimated read: 14–18 min Azure SQL • SQL Server 2022 • SQL Server on Azure

Data Governance Meets SQL: Unlocking Insights with Microsoft Purview Read More »

Building a Microsoft Fabric Medallion Lakehouse + Warehouse

From Clean Slate to Queryable Model with PySpark, Pipelines, and Direct Lake Introduction When you stand up a new analytics stack, the medallion architecture in Microsoft Fabric gives you a strong foundation. You land raw data in Bronze, standardize in Silver, and model or aggregate in Gold. Fabric lets you use Delta tables natively, wire

Building a Microsoft Fabric Medallion Lakehouse + Warehouse Read More »

🧊 From SQL to PySpark: A Complete Guide to Apache Iceberg Tables (Novice to Expert)

Introduction For years, relational databases like SQL Server, Oracle, and PostgreSQL have been the backbone of data analytics. But as organizations began collecting petabytes of data, it became clear that data warehouses alone couldn’t scale efficiently or flexibly. That’s where the data lakehouse emerged—a modern architecture that combines the best of both worlds: the low-cost,

🧊 From SQL to PySpark: A Complete Guide to Apache Iceberg Tables (Novice to Expert) Read More »

SqlVector Deep Dive: Bringing AI Vector Search to EF Core and Dapper

Introduction Vector (embedding) support in databases is no longer a fringe feature — it’s becoming essential for AI, semantic search, recommendation engines, and more. With the introduction of the vector data type in Azure SQL / SQL Server, and first-class support in .NET via SqlVector, you can now store, query, and operate on embeddings directly

SqlVector Deep Dive: Bringing AI Vector Search to EF Core and Dapper Read More »

SQL Server Dedicated Administrator Connection (DAC): what it is, how to use it, and a mini-workshop

Summary The Dedicated Administrator Connection is a back-door lifeline for SQL Server. When the instance is too stressed to accept normal connections, a sysadmin can still connect over the DAC to run lightweight diagnostics and fix problems. You can connect with sqlcmd -A or by using the ADMIN: prefix in SSMS. By default, only local

SQL Server Dedicated Administrator Connection (DAC): what it is, how to use it, and a mini-workshop Read More »