Azure - Bits by J.E

Bits by J.E

Azure

A collection of 5 posts

Bicep Spotter - Standards That Only Move Forward - A tool that already existed

Bicep Spotter - Standards That Only Move Forward - A tool that already existed

Building Bicep Spotter: a ratchet-based standards tool for Azure Bicep, inspired by Betterer. Accept the violations you already have, but never let new code make things worse. Standards that only move forward, with fast developer feedback before deployment. Then I discovered Checkov already did it..

Real-Time Data Streaming and Search Indexing with Azure - Part 4 - CDC event processing

Change data capture

Real-Time Data Streaming and Search Indexing with Azure - Part 4 - CDC event processing

In the last part we looked at the CDC setup and the event structure that Debezium utilizes to stream changes from our Azure SQL Server to the Azure Event Hub. This post will go through the CDC event-processing necessary to consume the events and push them into our targets

Real-Time Data Streaming and Search Indexing with Azure - Part 3 - Setting up CDC

Real-Time Data Streaming and Search Indexing with Azure - Part 3 - Setting up CDC

In the previous part of this series, we did the initial work for the system infrastructure using Azure Bicep. Today, we'll get deeper into setting up a Change Data Capture (CDC) pipeline to Azure Event Hub. CDC allows us to capture and stream real-time changes from our

Real-Time Data Streaming and Search Indexing with Azure - Part 2 - Setup Resources

Real-Time Data Streaming and Search Indexing with Azure - Part 2 - Setup Resources

In the first part of this series, I designed and explained the high-level architecture to stream database-level changes to other components. Now, we are going to focus on the Azure Infrastructure needed to take steps towards the solution. Let's get going! Azure Resources Needed To start,

Real-Time Data Streaming and Search Indexing with Azure - Part 1 - Introduction and Overview

Change data capture

Real-Time Data Streaming and Search Indexing with Azure - Part 1 - Introduction and Overview

In today's digital age, we rely on seamless data integration across multiple systems to handle everyday tasks. Imagine ordering products from your favorite online store. You expect the process to be smooth and efficient, from payment and stock management to shipping and order confirmation. Behind the scenes, various