Senior GCP Data Engineer
Context
A US client needs a senior data engineer on a contract basis to design and maintain scalable cloud data infrastructure spanning Google Cloud Platform and Amazon Web Services. The role is based in Irving, Texas, and is a W2 contract.
What you'll do
- Design, build and maintain ETL and ELT data pipelines on GCP and AWS
- Build and manage data warehouses on BigQuery and Amazon Redshift
- Develop streaming and batch processing workflows with Dataflow, Pub/Sub, Kinesis, Glue and Spark
- Model data using dimensional (star and snowflake) schemas, data lakes and SQL or NoSQL designs
- Orchestrate workloads with Apache Airflow and Cloud Composer, and containerize them with Docker and Kubernetes
Profile
- Senior experience building data pipelines and warehouses on Google Cloud Platform
- Working knowledge of AWS data services such as S3, Glue, EMR, Lambda and Athena
- Strong skills in Python, Java, SQL, PySpark and Apache Spark
- Experience with dimensional modeling and data lake architecture
- Google Cloud Professional Data Engineer or AWS Certified Data Analytics certification is preferred