DATA ENGINEERIntroduction In this blog post, the focus will be on the process of deploying OpenMetadata on a Kubernetes cluster...
Blog
Code
Change Data Capture and Kafka: Practical Overview of Connectors
DATA ENGINEERIntroduction Change Data Capture (CDC) is the process of extracting changes from a source database system and...
Firebolt
SENIOR DATA ENGINEERIntroduction Performance and scalability of data warehousing are key concerns for businesses working with...
Energy Community
DATA ENGINEER Talk about energy saving and reusable energy has been part of the conversation for a long time now. If you’ve only...
BigQuery pricing setup for a multinational company
PRINCIPAL CONSULTANT BigQuery is just one service that Google Cloud Platform provides, which is a database service, but if your...
A Custom Data Quality and Profiling Solution With Apache Spark on AWS
PRINCIPAL CONSULTANT, DATA ENGINEER One of the most important steps when doing data integration is understanding the data we’re...
Connecting VSCode using SSH to a VM Instance on GCP
DATA ENGINEERIntroduction A virtual machine, or a VM, is a virtualized instance of a computer that can perform almost all of the...
Go’s Concurrency Model
DATA ENGINEER This post attempts to demonstrate the power of utilizing concurrency, specifically the power of Go's concurrency...
Noria
DATA ENGINEERSIntroduction Nowadays, modern web applications are read-heavy, interactive, and have significant skew. We need to...