Machine learning using Persistor & Google Cloud functions

Machine learning using Persistor & Google Cloud functions

Introduction Machine learning is a very hot topic in today’s world. From classification, and regression to clustering, we’ve all had some type of encounter with it. Let’s say you don’t have a machine powerful enough to train and test your model, what do you do?...
Data engineers and sustainability – part 2

Data engineers and sustainability – part 2

Benoit Boucher DATA ENGINEER How datacentres nevertheless impact the environment In the last article, we talked about the means implemented by datacentres and cloud providers to minimize their environmental impact. In this article we will list the criticisms that can...
Schema Registry Comparison

Schema Registry Comparison

Ena Dzanko, Juraj Komericki DATA ENGINEERS Introduction In many messaging scenarios, the message payload is structured and therefore (de)serialized using a schema specification. Both senders and receivers of the messages will want to validate the data with a...
Processing API Data in Azure with Python (part 2/2)

Processing API Data in Azure with Python (part 2/2)

Tihomir Habjanec, Tea Bratic DATA ENGINEERS In the first part of our blog we focused on data ingestion from a publicly available API, orchestration and monitoring. Now, let us look at our Azure Functions for processing data. We will first give a brief overview of what...