VJersey City, NJData Engineer, Azure and Python
Context
A financial services organization with interest in securities and pricing data is looking for a data engineer to support its Azure data platform. Financial services or capital markets experience is a plus.
What you'll do
- Build and maintain ETL and ELT pipelines on Azure Databricks using Python and PySpark
- Orchestrate data ingestion and transformation workflows with Azure Data Factory on ADLS Gen2
- Develop Azure Functions and API services, including FastAPI endpoints
- Work with Azure databases and SQL to support data delivery
- Maintain Git-based CI/CD workflows with Jenkins
Profile
- 8 to 10+ years of data engineering experience
- Strong skills in Azure Databricks, Python, PySpark, and SQL
- Hands-on experience with Azure Data Factory, ADLS Gen2, and Azure Functions
- Experience with API development, FastAPI, Git, Jenkins, and CI/CD
- Financial services or capital markets experience, especially securities and pricing data, is a plus