DHybridContract Data Engineer (Mid-Senior)
Context
A consumer-facing business serving millions of customers is running a data migration where ingestion must be fast and reliable. The pace is quick, with tight deadlines and shifting scope.
What you'll do
- Build and maintain ingestion pipelines for the data migration on AWS and Databricks
- Tune Spark jobs for speed and cost, including fixing skewed joins
- Own delivery of data workloads with limited day-to-day supervision
- Adapt pipelines quickly as deadlines tighten and scope changes
Profile
- Mid-senior experience in data engineering with strong Spark fundamentals
- Hands-on experience with AWS and Databricks
- Self-starter who works independently and moves quickly
- Experience with AI agents for testing or Rust for ingestion is a bonus