SCanberra, ACTSenior Data Engineer
Context
Long-term contract within an Australian Federal Government agency, hybrid arrangement with an initial six weeks onsite, based in Canberra with other locations in Melbourne, Brisbane and Adelaide. Requires eligibility to obtain and maintain NV1 security clearance.
What you'll do
- Design and maintain enterprise data warehouses, data lakes and complex data solutions
- Build and operate ETL/ELT pipelines and data integration flows
- Perform data modelling, profiling, cleansing, validation and data quality work
- Handle API integration, data replication, acquisition and reconciliation
- Develop Python code for data extraction, transformation, testing and troubleshooting
Profile
- 3 to 5+ years of hands-on data engineering or enterprise data warehousing experience
- Strong SQL, ETL/ELT, data pipeline and data integration skills
- Experience with data modelling and data quality
- Python experience for data extraction, transformation and testing
- Desirable: Teradata, Cloudera Data Platform, Red Hat OpenShift, Apache Spark, Apache NiFi, Java, Hadoop, Git, CI/CD, and prior Australian federal government ICT project experience