Bits by J.E- Johan Olsson publications

Bits by J.E

Real-Time Data Streaming and Search Indexing with Azure - Part 3 - Setting up CDC

Real-Time Data Streaming and Search Indexing with Azure - Part 3 - Setting up CDC

In the previous part of this series, we did the initial work for the system infrastructure using Azure Bicep. Today, we'll get deeper into setting up a Change Data Capture (CDC) pipeline to Azure Event Hub. CDC allows us to capture and stream real-time changes from our database,

Real-Time Data Streaming and Search Indexing with Azure - Part 2 - Setup Resources

Real-Time Data Streaming and Search Indexing with Azure - Part 2 - Setup Resources

In the first part of this series, I designed and explained the high-level architecture to stream database-level changes to other components. Now, we are going to focus on the Azure Infrastructure needed to take steps towards the solution. Let's get going! Azure Resources Needed To start, we need

Real-Time Data Streaming and Search Indexing with Azure - Part 1 - Introduction and Overview

Change data capture

Real-Time Data Streaming and Search Indexing with Azure - Part 1 - Introduction and Overview

In today's digital age, we rely on seamless data integration across multiple systems to handle everyday tasks. Imagine ordering products from your favorite online store. You expect the process to be smooth and efficient, from payment and stock management to shipping and order confirmation. Behind the scenes, various

OpenTelemetry Part 3 - Observability

OpenTelemetry Part 3 - Observability

In this third part of the OpenTelemetry series, we dive into observability—the ability to monitor, track, and analyze Logs, Metrics, and Traces from distributed systems. We'll explore open-source tools and third-party libraries that help you visualize these three telemetry pillars in a consistent way. Our goal is

OpenTelemetry Part 2 - Implementation

OpenTelemetry Part 2 - Implementation

Introduction In our last discussion, we explored the basics of observability, breaking down the crucial components: Logs, Metrics, and Traces. Additionally, we highlighted the role played by the OpenTelemetry collector in orchestrating a comprehensive system visibility strategy. Now, let's shift to the practical side. Imagine this as a

OpenTelemetry Part 1 - Understanding the Pillars of Observability

OpenTelemetry Part 1 - Understanding the Pillars of Observability

In this three-part article series, I will delve deeper into the OpenTelemetry (OTEL for short) framework to gain a better understanding of telemetry and instrumentation in general, and for OTEL in particular. In the first part, I will explore the pillars of observability, the second part will focus on implementing

Azure Deployment Stacks

Azure Deployment Stacks

Welcome to the world of Azure, where 'stacking up' your resources is more than just a routine task. In this article, we'll take the frame to the stack into the world of Azure Deployment Stacks, where organizing resources is as straightforward as stacking blocks. So, grab

Configuration Validation

Configuration Validation

The fourth and final article of my series on Configuration Management. In this section, I will delve into the crucial aspects of configuration validation and testing within the context of .NET Core. In my initial post of this series, I mentioned that this can be quite a challenge, and indeed

Configuration Management

Configuration Management

As promised, I will delve into configuration management and how to provision configurations to the Azure App Configuration Store resource. The Azure resource provides a user interface, retention policies, secret storage, and various ways to provision configurations. However, when it comes to environmental configuration, cost management, sharing configurations among multiple

Configuration as a Service

Configuration as a Service

In my previous post, I talked a lot about the challenges of application configuration. In this post, I will delve deeper into the complexity and provide example implementations, focusing on the challenge of lack of standardization. All implementations in this post will use Microsoft technologies, including Azure, .NET Core, Bicep,

Application Configuration: Overcoming Challenges for Seamless Deployment

Application Configuration: Overcoming Challenges for Seamless Deployment

Behind every remarkable software lies a labyrinth of intricate configurations that determine its behavior and adaptability. As we developers embark on the journey of [continuous] deployment, we can encounter an array of challenges that can hinder the seamless transition of the applications we develop. In this blog post, we delve