DATA ENGINEERIntroduction Data loading into Snowflake can be achieved through various methods, including Snowpipe and Snowpipe...
Snowpipe Streaming: Real-time Data Ingestion to Snowflake
read more
Blog
Code
Eclipse Mosquitto for Energy Communities Project
DATA ENGINEERAs technology advances, we increasingly want to manage our devices online. As all these devices use electrical...
Great Expectations
DATA ENGINEERIntroduction Great Expectations (GX) is an open-source Python library for data validation that allows you to...
Deploying OpenMetadata on Azure Kubernetes Service
DATA ENGINEERIntroduction In this blog post, the focus will be on the process of deploying OpenMetadata on a Kubernetes cluster...
Change Data Capture and Kafka: Practical Overview of Connectors
DATA ENGINEERIntroduction Change Data Capture (CDC) is the process of extracting changes from a source database system and...
Firebolt
SENIOR DATA ENGINEERIntroduction Performance and scalability of data warehousing are key concerns for businesses working with...
Energy Community
DATA ENGINEER Talk about energy saving and reusable energy has been part of the conversation for a long time now. If you’ve only...
BigQuery pricing setup for a multinational company
PRINCIPAL CONSULTANT BigQuery is just one service that Google Cloud Platform provides, which is a database service, but if your...
A Custom Data Quality and Profiling Solution With Apache Spark on AWS
PRINCIPAL CONSULTANT, DATA ENGINEER One of the most important steps when doing data integration is understanding the data we’re...
