Data processing with Dataflow SQL (part 1/2)

Data processing with Dataflow SQL (part 1/2)

Iva Marusic DATA ENGINEER n this sequence of blog posts, we will take a look at one of features available on Google Cloud Platform, Dataflow SQL. Recently released in Beta (March 3rd, 2020), Dataflow SQL offers creation of data processing pipelines by simply writing...
Streaming data from Twitter to GCP

Streaming data from Twitter to GCP

Mia Tadic DATA ENGINEER This blog demonstrates the task of ingesting data from remote API (i.e. Twitter’s API) to cloud (i.e. Google Cloud). Google Cloud Platform (GCP) is a suite of public cloud computing services offered by Google. The platform includes a...