Part 14 — Full End-to-End Project and Architecture Blueprint – SQLYARD Leave a Comment / Articles, Data Engineering, Scripts / By SQLYARD Deep Technical Series — Building a Modern Data Warehouse and Lakehouse Part 14 — Full End-to-End Project and Architecture Blueprint By SQLYARD · SQLYARD.com · April 2026 · Estimated read: 35–40 min Part […]
Part 14 — Full End-to-End Project and Architecture Blueprint Read More »
Part 13 — Security, Governance, Lineage, and Compliance – SQLYARD Leave a Comment / Articles, Data Engineering / By SQLYARD Deep Technical Series — Building a Modern Data Warehouse and Lakehouse Part 13 — Security, Governance, Lineage, and Compliance By SQLYARD · SQLYARD.com · April 2026 · Estimated read: 30–35 min Part 13 of 14
Part 13 — Security, Governance, Lineage, and Compliance Read More »
Part 12 — Performance Engineering and Optimization – SQLYARD Leave a Comment / Articles, Data Engineering / By SQLYARD Deep Technical Series — Building a Modern Data Warehouse and Lakehouse Part 12 — Performance Engineering and Optimization By SQLYARD · SQLYARD.com · April 2026 · Estimated read: 30–35 min Part 12 of 14 — Deep
Part 12 — Performance Engineering and Optimization Read More »
SQL Server Archive Process Using a Stored Procedure and SQL Agent Job – SQLYARD Leave a Comment / Articles, Scripts / By SQLYARD SQL Server Archive Process Using a Stored Procedure and SQL Agent Job By David Yard · SQLYARD.com · April 2026 · Estimated read: 15–18 min Compatibility: This approach works on all SQL
SQL Server Archive Process Using a Stored Procedure and SQL Agent Job Read More »
Microsoft Fabric: The Complete Guide — OneLake, Lakehouse, Pipelines, Medallion Architecture
Getting Started with Data Clustering in Microsoft Fabric Data Warehouse – SQLYARD Leave a Comment / Articles, Azure, High Availability / By SQLYARD Getting Started with Data Clustering in Microsoft Fabric Data Warehouse Preview By David Yard · SQLYARD.com · April 2026 · Estimated read: 15–18 min Preview Feature: Data Clustering in Microsoft Fabric Data
Getting Started with Data Clustering in Microsoft Fabric Data Warehouse Read More »
Azure SQL Database Failover Groups with Multiple Secondaries: What’s New and How to Use It – SQLYARD Leave a Comment / Articles, Azure, High Availability / By SQLYARD Azure SQL Database Failover Groups with Multiple Secondaries Public Preview By David Yard · SQLYARD.com · April 2026 · Estimated read: 18–22 min What’s New, Why It
Azure SQL Database Failover Groups with Multiple Secondaries Read More »
Summary for Parts 0 through 11 Modern analytics platforms are no longer simple data warehouses with nightly ETL jobs. Enterprises today operate hybrid ecosystems of structured warehouse data, raw event streams, machine learning pipelines, operational analytics, and AI-driven automation. This requires a unified architectural approach capable of handling scale, governance, performance, flexibility, and reliability. This
This Completes the Guide to Building Modern Data Warehouses and Lakehouses Read More »
Introduction Microsoft SQL Server 2025 represents a major leap forward for data professionals. This release is designed not just to handle transactional and analytical workloads, but also to bring AI directly into the database layer, unify modern data applications, and integrate seamlessly with Microsoft Fabric. With built-in AI capabilities, deep security by default, a mission-critical
SQL Server 2025: The AI-Ready Enterprise Database from Ground to Cloud Read More »
What is Table Partitioning (in SQL Server)? Table partitioning (sometimes called horizontal partitioning) means splitting a large table (or its index) into multiple smaller “chunks” (partitions) along a partitioning key, typically a date or numeric column. Each partition holds a slice of the data range. The database engine handles it as a single logical table,
Introduction The world of data infrastructure is evolving quickly. Modern systems aren’t just about storing and querying data anymore — they’re expected to scale globally, stay online 24/7, and integrate seamlessly with DevOps pipelines. This shift has created a new discipline at the intersection of database administration, reliability engineering, and DevOps: Database Reliability Engineering (DBRE).
This post focuses on PolyBase for on-prem (or IaaS) SQL Server—not Synapse or Fabric. We’ll cover what PolyBase is, how “virtual data” works, what changed from 2019 to 2022, when it helps DBAs, developers, data-warehouse, and data-science teams, and how to set it up with copy-paste T-SQL examples. ⚠️ Important: PolyBase is great for accessing
PolyBase on SQL Server 2019 & 2022 : from setup to real-world data virtualization Read More »
If you work with SQL Server today, you’ve got three main hosting choices: classic Windows, modern Linux, and containers. Each path can deliver excellent performance and reliability. The trick is knowing when to pick which, how to set it up right, and how to leverage SQL Server features to get real gains. Below is a
This article continues from Part 1, where we looked at CPU, NUMA, and vSphere configuration best practices for SQL Server in a virtualized environment. In Part 2, we shift focus to storage and memory considerations, file initialization settings, instance design strategies, and how DNS aliases can simplify management. These optimizations build on the foundation from
Environment: Always On availability groups Summary You may see these entries in the SQL Server error log: Short version: a few lines at startup or during a planned failover are normal. Repeating messages mean something keeps trying and failing to connect to the Database Mirroring endpoint that AG uses, or a client is sending bad
SQL Server Error Log Messages You Can’t Ignore: Service Broker, Endpoints, and TDS 17836 Read More »
Amazon EC2 offers flexibility to run enterprise-grade Windows workloads with full control over the OS, networking, storage, and high availability options. Getting the foundation right is critical before layering on applications like SQL Server or business systems. This first part covers infrastructure best practices for Windows on EC2. Part 2 will focus on application-specific tuning.
This series walks through setting up a resilient SQL Server Always On Availability Group (AG) with two on-premises nodes, one Azure replica, and an Azure Cloud Witness for quorum. By the end, you’ll have a production-ready cluster with automatic failover on-prem and disaster recovery in the cloud. Part 1 — Build the Windows Server Failover
📘 SQL Always On Availability Groups – Hybrid Setup Steps Read More »
If you run Always On Availability Groups or a database is coming online after a crash or restart, you’ll eventually see background sessions with the command PARALLEL REDO TASK. They often show up as “BACKGROUND” and “sleeping” in DMVs. That is normal. These workers replay log records on a secondary replica or during crash recovery
If you’re running SQL Server with Always On Availability Groups, you’ve likely come across the PARALLEL_REDO_FLOW_CONTROL wait type. It shows up when your secondary replica’s redo thread is being throttled — essentially pausing to keep things balanced and prevent overloading the system. But when should you worry about it? And what can you do about
It is a high availability and disaster recovery solution that provides continuous data access. In order to achieve this, it employs a number of technologies including failover clustering, database mirroring, and log shipping. One of the benefits of using Microsoft SQL Server ALWAYS ON is that it can help to prevent data loss in the
What is Microsoft SQL Server ALWAYS ON? Read More »
