#Travel

#Data Engineering

#Spark

#Google Ads API

Agoda - Data Engineer Intern

📅 2023

🔗 Website
Agoda

✈️ Agoda is an online travel platform that brings high-value and rewarding travel experiences to people all over the world through the Agoda app and Agoda website.

Scala, SQL, Apache Spark, Apache Hive, RStudio, Google Ads API

  • Migrated 12 Google Ads API report downloader applications across teams, leveraging Spark, Scala, and GitLab CI/CD to efficiently process data for large-scale data pipelines
  • Optimized algorithm performance, reducing application runtime by a linear factor from 4 hours to only 20 minutes
  • Resolved two critical production incidents caused by incorrectly formatted data returned by the Google Ads API
  • Created a Slack bot to explain SQL and Spark ETL pipelines to stakeholders using Python & GPT-3
  • Devised and implemented a data validation rule based on Bollinger Bands in SQL to improve data anomaly detection; Conducted comprehensive backtesting using RStudio against historical data to ensure correctness