Tagged

Big Data

A collection of 11 posts

Tech

How We Monitor Apache Airflow in Production

A quick guide on what (and how) to monitor to keep your workflows running smoothly.

Tech

Meet Hodor — Gojek’s Upstream Data Quality Tool

Learn how Gojek’s Data Engineering team built a tool to capture metrics highlighting the quality of the data we collect.

Tech

How to Unlock the Full Potential of Kafka Producers

Explaining Producer configs that improve performance in Kafka pipelines.

Data

Beast: Moving Data from Kafka to BigQuery

GOJEK’s open source solution for rapid movement of data from Kafka to Google BigQuery.

Data

DAGGERS: Data aggregation in real time

How we deploy jobs in production within few minutes and aggregate data in real time, without any developer effort.

Data

Sakaar: Taking Kafka data to cloud storage at GO-JEK

How we created a zero data loss cold storage data lake out of streaming Kafka data.

Data

Anatomy and mindset of the data army at GO-JEK

Stories from the land of data at GO-JEK

Tech

How our DIY platform creates value through network effects

A quick reckoner on how we built a self-serve platform empowering data-driven decisions inside GO-JEK

Tech

Fronting : An Armoured Car for Kafka Ingestion

We see 6 Billion+ events every day and it’s steadily rising. In order to make data-driven decisions, the completeness of data is a must.

Tech

Data infrastructure at GO-JEK

.

Tech

ATLAS: GO-JEK’s real-time geospatial visualization platform

Aggregation and visualization of billions of data points daily