SSydneySenior Data Engineer
Context
Contract role based in Sydney, open only to candidates currently based in Australia with a valid work permit, as no visa sponsorship is offered. The engagement covers cloud-based analytics and reporting pipelines.
What you'll do
- Design and deliver end-to-end data engineering solutions on Azure Databricks
- Build and optimise batch and near-real-time ETL and ELT pipelines
- Perform data profiling, source-to-target mapping and SQL optimisation
- Implement orchestration, CI/CD and release management for data workloads
- Provide technical leadership and mentor engineers
Profile
- 7+ years of experience in data engineering, data warehousing or a related field
- At least 2 years designing and delivering solutions with Azure Databricks
- Advanced SQL and Python, with Spark or equivalent distributed processing
- Experience with orchestration tools such as Airflow or Control-M, and with structured and unstructured data formats such as JSON, XML and Avro
- Currently based in Australia with a valid work permit