Skip to main content
H

AI Engineer

Harakumo
2 hours ago
Full-time
On-site
New York City, New York, United States
Own Harakumo’s AI platform: the AI Gateway, Vector DB, Memory, hosted Agents and the MCP connector that lets Claude, ChatGPT and other assistants build and run whole apps from a conversation. Build the AI services developers call through one key: an OpenAI-compatible gateway with routing, tool calling and structured output; vector search; memory for each end user; hosted agents Grow the MCP connector and its widgets so an assistant can take a one-line idea to a live, working app on Harakumo Make AI spend safe: holds, metering, spending limits and honest errors that never surprise a customer with a bill Write evals and conformance checks that prove what each model really supports, and keep the docs truthful about it What you bring

Production experience building with LLM APIs (Anthropic, OpenAI, Google or open models): tool calling, streaming, structured output, embeddings Hands-on experience with retrieval (RAG), vector databases or agent frameworks, and a sense of where they break A bias for shipping: you have launched AI features real people use, and you can show them Bonus: MCP servers, evals, cost and latency work on model traffic What we offer

Competitive salary and early-team equity (discussed in the first conversation) Remote-first, async-friendly; quarterly in-person in NYC Ownership of the AI platform from API to dashboard to docs

#J-18808-Ljbffr