RJersey City, NJSenior Azure Databricks Engineer
Context
A long-term onsite contract for an enterprise data team in the New Jersey area, working on Azure-based data engineering with Databricks. Local candidates only, available for onsite work.
What you'll do
- Design, build and maintain ETL and ELT pipelines on Azure Databricks and Azure Data Factory
- Manage data storage and governance with ADLS Gen2, Unity Catalog and Delta Lake
- Tune Apache Spark jobs for performance and optimization
- Provide production support for data pipelines and manage Git, CI/CD and workflow orchestration
Profile
- Senior-level experience with Azure Databricks, ADLS Gen2 and Azure Data Factory
- Strong hands-on skills in Python, PySpark, SQL and/or Java
- Experience with Databricks workspace, Unity Catalog and Delta Lake
- Experience with Git, CI/CD pipelines and workflow orchestration
- Good to have: AWS, Kubernetes, OpenShift, Terraform, DevOps or MLOps