Featured Post

Information Extraction at Scribd

Published
July 21, 2021
Category
Applied Research

Featured Series

Teaching an old DAG new tricks
Author:QP HouFebruary 19, 2020
Breaking up the Airflow DAG monorepo
Author:QP HouMarch 2, 2020

Core Platform Posts

Presenting Rust and Python Support for Delta Lake
Author:R Tyler CroyJuly 20, 2021
Automating Databricks with Terraform
Author:R Tyler CroyJuly 8, 2021
Kafka to Delta Lake, as fast as possible
Author:Christian WilliamsMay 19, 2021
Growing the Delta Lake ecosystem with Rust and Python
Author:R Tyler CroyMay 18, 2021
Backing up Delta Lake
Author:Kuntal Kumar BasuMay 4, 2021
Integrating Airflow with Okta
Author:Kuntal Kumar BasuApril 26, 2021
Automatically recycling EKS worker nodes
Author:KuntalbDecember 14, 2020
Integrating Databricks jobs with Datadog
Author:QP HouSeptember 15, 2020
Spark and AI Summit 2020: The revolution will be streamed
Author:R Tyler CroySeptember 9, 2020
Airflow Summit 2020: Teaching an old DAG new tricks
Author:QP HouSeptember 8, 2020
Streaming data in and out of Delta Lake
Author:R Tyler CroyJune 26, 2020
Ingesting production logs with Rust
Author:R Tyler CroyJune 24, 2020
Streaming Development Work with Kafka
Author:Christian WilliamsMarch 24, 2020
Easy read-only ECR access for the entire AWS Organization
Author:R Tyler CroyMarch 19, 2020
Breaking up the Airflow DAG monorepo
Author:QP HouMarch 2, 2020
A testimonial for using PagerDuty at Scribd
Author:R Tyler CroyFebruary 20, 2020
Teaching an old DAG new tricks
Author:QP HouFebruary 19, 2020
Changing Kafka brokers with zero data loss
Author:Trinity XiaJanuary 6, 2020
Migrating Kafka to the Cloud
Author:Christian WilliamsDecember 30, 2019
Assigning pager duty to developers
Author:Hamilton HordDecember 3, 2019
Defining the Real-time Data Platform
Author:R Tyler CroyAugust 28, 2019
Zooming out to Platform Engineering at Scribd
Author:R Tyler CroyAugust 22, 2019
What Core Platform does at Scribd
Author:R Tyler CroyMarch 28, 2019