Latest Posts

The Evolution of the Machine Learning Platform
Author:Ben ShawFebruary 5, 2024
Data and AI Summit Wrap-up
Author:R Tyler CroyJuly 21, 2022
Accelerating Looker with Databricks SQL Serverless
Author:Hamilton HordJune 28, 2022
Scribd is presenting at Data and AI Summit 2022
Author:R Tyler CroyApril 28, 2022
Armadillo makes audio players in Android easy
Author:Nathan SassSeptember 29, 2021
Categorizing user-uploaded documents
Author:Monique Alves CruzJuly 28, 2021
Information Extraction at Scribd
Author:July 21, 2021
Presenting Rust and Python Support for Delta Lake
Author:R Tyler CroyJuly 20, 2021
Identifying Document Types at Scribd
Author:Jonathan RamkissoonJuly 12, 2021
Automating Databricks with Terraform
Author:R Tyler CroyJuly 8, 2021
Kafka to Delta Lake, as fast as possible
Author:Christian WilliamsMay 19, 2021
Growing the Delta Lake ecosystem with Rust and Python
Author:R Tyler CroyMay 18, 2021
Backing up Delta Lake
Author:Kuntal Kumar BasuMay 4, 2021
Integrating Airflow with Okta
Author:Kuntal Kumar BasuApril 26, 2021
Embedding-based Retrieval at Scribd
Author:Div DasaniApril 12, 2021
Speeding up ECS Fargate deployments
Author:Nakul PathakMarch 18, 2021
Introducing Lucid: A Swift Library For Building Robust Data Flows
Author:Theo RupinMarch 16, 2021
Importing MySQL Data into Delta Lake
Author:Alex KushnirMarch 11, 2021
Unifying developer velocity metrics in Datadog with GitHub Actions
Author:Adam HofmannMarch 2, 2021
Learning from incidents: getting Sidekiq ready to serve a billion jobs
Author:Nakul PathakDecember 21, 2020
Automatically recycling EKS worker nodes
Author:KuntalbDecember 14, 2020
How we optimize Databricks clusters configuration with Apache Airflow
Author:Maksym DovhalDecember 4, 2020
Integrating Databricks jobs with Datadog
Author:QP HouSeptember 15, 2020
Spark and AI Summit 2020: The revolution will be streamed
Author:R Tyler CroySeptember 9, 2020
Airflow Summit 2020: Teaching an old DAG new tricks
Author:QP HouSeptember 8, 2020
My first week in Scribd engineering
Author:Jason DavilaAugust 26, 2020
Backing up Datadog and Performing Bulk Edits
Author:August 10, 2020
Streaming data in and out of Delta Lake
Author:R Tyler CroyJune 26, 2020
Ingesting production logs with Rust
Author:R Tyler CroyJune 24, 2020
Using Panther to monitor AWS infrastructure
Author:Patrick HApril 29, 2020
Using Terraform to integrate Datadog and AWS
Author:April 27, 2020
Reclaiming Story Points
Author:Lori BuschbaumMarch 25, 2020
Streaming Development Work with Kafka
Author:Christian WilliamsMarch 24, 2020
Guidelines and expectations for working remotely
Author:Alex BernardinMarch 23, 2020
Data hygiene while working from home
Author:Jason BentleyMarch 20, 2020
Easy read-only ECR access for the entire AWS Organization
Author:R Tyler CroyMarch 19, 2020
Breaking up the Airflow DAG monorepo
Author:QP HouMarch 2, 2020
Teaching an old DAG new tricks
Author:QP HouFebruary 19, 2020
Changing Kafka brokers with zero data loss
Author:Trinity XiaJanuary 6, 2020
Migrating Kafka to the Cloud
Author:Christian WilliamsDecember 30, 2019
Growing Data Engineering into 2020
Author:R Tyler CroyDecember 23, 2019
Lightning talks with women of Scribd: migrations, owning quality, and more!
Author:Harini IyerDecember 9, 2019
We're building the largest library in history
Author:R Tyler CroyNovember 25, 2019