Reflecting on Data Horizons 2024

Reflecting on Data Horizons 2024

On November 27th, Lindholmen Science Park hosted Data Horizons: Engineering the Future with AI and Cloud, bringing together data professionals, innovators, and enthusiasts to explore the cutting-edge intersection of AI, cloud technologies, and data engineering. The event was filled with engaging discussions, actionable insights, and exciting opportunities to connect with like-minded peers.

Meetup overview:

From Data Warehouses to Data Mesh: The Evolution of Data Platforms by Ivan Celikovic
A journey through the evolution of data platforms—from the early days of Data Warehouses and BI to the rise of Big Data, cloud analytics, and the modern shift to decentralized Data Mesh. Discover how these changes have shaped the way we unlock insights and drive innovation today!

Data Contracts by Stipe Aras-Gazic
Discussion on adapting data practices to align with dynamic, AI-driven workflows, with a focus on maintaining high standards of data quality and integrity.

A techies perspective on composable CDP by Eldar Terzic
Explore the advantages of a composable Customer Data Platform (CDP), emphasizing its flexibility, scalability, and ability to integrate with diverse tools and systems.

Chaos Engineering by Niclas Göthberg
Chaos engineering disrupts data pipelines, corrupts streams, and overloads storage. Data engineers scramble to keep insights flowing—survive this, and your data pipeline is practically unbreakable!

Key Takeaways

The Shift to Data Mesh: Moving from centralized platforms to decentralized architectures empowers teams and drives efficiency in unlocking insights.
Data Contracts Matter: Establishing clear agreements between teams ensures data quality, trust, and reliability in AI workflows.
System Resilience is Critical: Stress-testing through chaos engineering builds pipelines that can handle unforeseen challenges and ensure reliability.

What’s Next?

If you couldn’t make it, you can still benefit—presentations are now available for download to explore the insights shared during the event.

Stay tuned for more events from the Gothenburg Data Engineering Meetup Group. We’re already planning the next session to keep the conversation and innovation going!