Locations
San Francisco (Hybrid), New York (Hybrid), Columbus (Hybrid), or Remote (US)
Job Overview
We’re hiring an AI Engineer to shape how AI shows up across ReadMe’s product: from how developers explore and understand APIs to how companies author and maintain their documentation.
Responsibilities
As an AI Engineer, you’ll:
Help decide what gets built, why it matters, and how it works end-to-end.
Work on systems that are already live across thousands of developer hubs and define what they become next.
Design end-to-end AI systems: combining LLMs, embeddings, retrieval pipelines, and structured outputs into reliable product features.
Build grounding and retrieval layers: indexing docs, OpenAPI specs, and customer data to support accurate, context-aware generation.
Define evaluation systems: measuring accuracy, latency, cost, and user impact; building feedback loops to continuously improve quality.
Handle real-world complexity: malformed specs, inconsistent docs, edge-case APIs, and ambiguous user queries.
Make architectural tradeoffs: latency vs. quality, cost vs. coverage, deterministic vs. generative approaches.
Own production reliability: observability, fallbacks, rate limiting, and safe degradation when systems fail.
Work across the stack: from model orchestration and backend systems to the UI surfaces that expose them.
Key AI Focus Areas
Documentation that writes itself: AI that watches code changes and keeps docs current — from PR-level suggestions to org-wide audits that surface and fix quality issues at scale.
Answers, not search results: A conversational layer embedded directly in developer hubs, grounded in real docs, that gives developers the right answer instead of a list of links.
APIs that are agent-ready: Building systems that make APIs understandable by both humans and machines.
Qualifications
Experience building with LLMs in production, not just prototypes.
Strong JavaScript/TypeScript or Python experience.
Experience working with embeddings and retrieval systems (RAG).
Experience with prompting and structured outputs.
Experience evaluating and iterating AI systems (quality, latency, cost).
Comfort working with APIs and structured data (JSON, OpenAPI, schemas).
Experience designing and shipping end-to-end systems, from backend pipelines to user-facing product surfaces.
Strong instincts around when to use AI vs. deterministic approaches.
Experience improving AI reliability, observability, and production readiness.
Familiarity with real-world edge cases (messy data, inconsistent inputs, ambiguous queries) and how to handle them.
Growth Plan
Within one month, you’ll:
Build a deep understanding of ReadMe’s AI systems and product surfaces.
Ship meaningful improvements to existing AI features.
Get close to real customer workflows and pain points.
Within a few months, you’ll:
Own a core part of one of our AI systems.
Drive improvements in quality, reliability, and user experience.
Contribute to product and technical direction.
Within your first year, you’ll:
Be a key driver of AI across the product.
Ship systems used daily by thousands of developers and teams.
Help define how AI reshapes developer hubs and API workflows.
Benefits
Unlimited PTO with a three-week minimum.
Fully covered medical, dental, and vision insurance for you, and 100% for your dependents.
A One Medical membership.
A gym or fitness stipend of up to $150 per month.
One-to-one donation matching of up to $1,000 per year.
Twelve weeks of paid parental leave after the birth or adoption of a child.
Work from home.
Three offsite retreats per year to get together with coworkers and plan for the quarter ahead.
Equal Opportunity Statement
At ReadMe, we’re committed to cultivating a diverse and inclusive workplace. We welcome people of all different backgrounds, experiences, abilities, and perspectives. We are an equal opportunity employer and a pleasant and supportive place to work.