RAtlanta, GASenior Data Engineer, CDP and GCP
Context
A client is building a customer data platform on Google Cloud to support customer profiles at very large scale and AI-powered customer experiences. The role is a contract-to-hire position based in Atlanta, GA, open to local candidates only.
What you'll do
- Design and build scalable data pipelines supporting more than 100 million customer profiles
- Develop real-time and near-real-time streaming pipelines for customer data ingestion, including clickstream
- Build data models and ETL/ELT processes on GCP, BigQuery and Cloud Spanner
- Support low-latency APIs and data quality, CI/CD and orchestration practices
Profile
- 15+ years of data engineering experience, with FAANG background mandatory
- 3+ years of production experience with GCP data platforms and BigQuery
- 3+ years of streaming pipelines, with Pub/Sub, Dataflow, Apache Beam or Kafka
- Strong skills in Python, PySpark, SQL, Databricks, Spark and Delta Lake, plus CDC and SCD Type 2 knowledge
- Experience with Terraform, CI/CD, orchestration tools and data quality