The role
Oyster's AI assistant needs a senior engineer to own improvements end to end, from design and evaluation to rollout. You'll also help other product teams build AI features well.
What you'll do
- Own end-to-end improvements to Oyster AI, from design to safe rollout
- Design reliable agents and tools with clear contracts and human control
- Choose retrieval, embedding and indexing strategies that respect data access
- Build evaluation loops with datasets, regression checks and automated judges
- Diagnose and fix production failures across prompts, retrieval, tools and models
What they're looking for
Must-haves
- Senior engineering judgment leading complex production work independently
- Hands-on experience shipping LLM-powered features to production
- Depth in RAG, evaluation datasets, LLM-as-judge, or agents and tool calling
- Strong coding, debugging, testing, API integration and system design
- Willingness to work in Ruby on Rails and React
Nice to have
- Production Ruby on Rails experience integrating AI into an established backend
- Slack or in-app assistant integrations with permission context
- Running retrieval, evaluation or model routing infrastructure at scale
The company
Oyster
Fully distributed global employment platform
Oyster is a global employment platform that helps companies hire, pay and care for talent anywhere. It has been distributed across 60+ countries since 2020 and is B Corp-certified.
Summarised by Jobs That Travel from Oyster's listing.
