NChicago, ILData Engineer
Context
A financial services organization in Chicago, IL or Naperville, IL is modernizing its data platform within AWS, with a hybrid schedule of 2 to 3 days on site each week. The role sits in agile, pod based delivery teams with business, technology, data and modeling stakeholders.
What you'll do
- Design, develop and maintain scalable data pipelines using Python and PySpark
- Integrate and transform data from multiple enterprise systems into model ready datasets
- Build and manage feature engineering pipelines for machine learning and GenAI applications
- Support deployment, monitoring and maintenance of machine learning and LLM based solutions
- Convert legacy SQL based processes into Python and PySpark frameworks
Profile
- 5+ years of data engineering, ML engineering or data platform experience, 3+ years considered for strong candidates
- Strong Python development and hands on PySpark experience with large scale data processing
- Advanced SQL skills, including complex query development and optimization
- Experience building data pipelines in enterprise environments and working with AWS services
- Experience with GenAI, LLMs or AWS Bedrock is a plus