NRemote, CanadaSenior Data AI Native Engineer
Context
A remote 6-month contract for a senior engineer to lead complex enterprise data initiatives on a Databricks and AWS lakehouse platform. The role combines data engineering with software engineering practices and works at 40 hours per week.
What you'll do
- Design and build high-volume batch and streaming data pipelines on Databricks and AWS
- Lead complex enterprise data engineering initiatives and guide the technical direction of the work
- Use AI coding tools to speed up pipeline development and rapidly prototype POCs and MVPs
- Apply AI within data engineering workflows, such as data quality rules and anomaly detection
- Implement lakehouse architecture with Delta Lake and Medallion layers and govern data with Unity Catalog
Profile
- 7+ years in data engineering and software engineering on production enterprise data solutions
- 4+ years with Databricks, Delta Lake, Medallion architecture and PySpark or Spark
- 4+ years with the AWS data ecosystem such as S3, EMR, Glue, Lambda or Redshift
- Proven technical leadership of data engineering teams and hands-on work with streaming tools such as Spark Structured Streaming, Kafka, Kinesis or Auto Loader
- Daily use of GitHub Copilot or Claude Code CLI with concrete examples of productivity gains