Data processing with Dataflow SQL (part 2/2)

Data processing with Dataflow SQL (part 2/2)

Iva Marusic DATA ENGINEER In previous blog post we had a short introduction to Dataflow SQL and Apache Beam in general, which will be great basis to follow content of this post. We will see which steps are needed to create simple Dataflow SQL job that reads events...
Syntio R&D team at EUvsVIRUS hackathon

Syntio R&D team at EUvsVIRUS hackathon

Mia Tadic DATA ENGINEER There’s only two options when you find yourself in the storm, you can either drown in it ORRR you can surf those waves! There’s only two options when you find yourself in the storm, you can either drown in it ORRR you can surf those...
GCP pipeline: pub/sub-lookup-storage (part 1/2)

GCP pipeline: pub/sub-lookup-storage (part 1/2)

Tea Bratic, Filip Milic DATA ENGINEERS Description of a data pipeline with simple lookup logic implemented in Google Cloud Platform. This blog post will provide a description of a data pipeline with simple lookup logic implemented in Google Cloud Platform. Lookups are...
Remote working challenges and benefits

Remote working challenges and benefits

Ana Marija Galic SENIOR DATA ENGINEER When having on-line meetings, there will be a lot of “hello”s or “can you hear me”s and a lot more of “oh, sorry i was muted”. Due to recent almost movie-like worldwide events, remote working...