Lead Data Engineer, AWS and Snowflake
Context
Onsite W2 contract in McLean, Virginia, for a US client building cloud-native data pipelines on AWS and Snowflake. The role leads design and delivery and works closely with stakeholders and product partners.
What you'll do
- Architect end-to-end data pipelines using AWS, Snowflake, IICS and PySpark
- Design and deploy containerized PySpark workloads on EKS, and build and tune EMR clusters for large-scale processing
- Orchestrate workflows with AWS Step Functions and Control-M, and manage metadata with AWS Glue Data Catalog and Snowflake Iceberg
- Lead Snowflake capabilities such as Iceberg Tables, Dynamic Tables, Tasks and Streams, governance and Cortex, and build RAG and Agentic AI proofs of concept
- Conduct code reviews, improve performance and mentor mid-level engineers
Profile
- 10+ years of data engineering experience with hands-on AWS data services including EKS, EMR, EC2, Step Functions, DynamoDB, Glue Data Catalog and S3
- Advanced Snowflake expertise and strong PySpark and Snowpark skills
- Hands-on IICS experience for file-based ETL ingestion
- Strong SQL and data modeling skills, with experience in RAG or Agentic AI proofs of concept and Control-M scheduling
- Proven leadership and mentoring ability, with clear communication to engineering teams and stakeholders