DDallas, TXAWS Cloud Data Engineer
Context
A US client is hiring a contract data engineer to build and run cloud data pipelines on AWS. The role is remote, based in the Dallas, TX area, on a W2 contract.
What you'll do
- Design and develop ETL and ELT pipelines using Python and PySpark on AWS
- Build and maintain an AWS data lake architecture on S3, Glue, Lambda, Redshift and EMR
- Process streaming and distributed data with Apache Spark, Kafka or Amazon Kinesis
- Model data and optimize performance across SQL and NoSQL data warehousing environments
Profile
- 2 to 5 years of experience in data engineering
- Strong Python and PySpark skills
- Hands-on experience with AWS S3, Glue, Lambda, Redshift and EMR
- Experience with SQL, NoSQL and data warehousing, Kafka or Amazon Kinesis is expected
- Nice to have: AWS Lake Formation, Athena, Glue Data Catalog, Step Functions, CI/CD, Git and AWS IAM