PMalvern, PAFull Stack Developer, AI Engineering
Context
A US employer is building an internal developer platform focused on stateful, human-in-the-loop AI agent workflows. The role is onsite in Malvern, PA, on a six-month contract.
What you'll do
- Build and maintain the platform's full stack components for AI agent workflows
- Design stateful agent workflows with state graphs, checkpointing and interrupts using LangGraph in Python
- Build tool-calling agents and structured LLM outputs
- Set up LLM evaluations, including golden datasets, LLM-as-Judge scoring, A/B testing and automated regression tests
Profile
- Strong hands-on experience with LangGraph in Python, including state graphs, checkpointing, interrupts and tool-calling agents
- Experience with LLM evaluations such as golden datasets, LLM-as-Judge, A/B testing and regression testing
- Advanced prompt engineering skills and experience with structured outputs
- Strong Python development experience, with proven experience building sophisticated AI agent workflows beyond basic RAG or chatbots
- Nice to have: JavaScript, TypeScript, Node.js, AWS Bedrock (Claude), LLM observability (Arize, OpenTelemetry), Tiptap or Y.js