r

Senior/Lead Engineer - AI Engineering

remoterocketship
3 hours ago
Full-time
On-site
East New York, New York, United States
Job Description: Design and build production AI systems β€” including agents, RAG pipelines, and LLM-powered workflows

Translate product requirements into technical designs

Develop robust evaluation frameworks and benchmarks to measure quality, safety, and regression across LLM-based features

Drive end-to-end delivery of AI features

Build and operate the application layer around foundation models

Fine-tune, distill, and adapt open and closed foundation models when warranted

Optimize inference performance, throughput, and cost across the serving stack

Apply modern AI engineering practices across heterogeneous infrastructure.

Requirements: 7+ years of software engineering experience

A demonstrated track record of shipping complex, production-grade systems

At least 1+ years building applications powered by LLMs or other foundation models

Hands-on experience designing and deploying LLM-based features in production

Strong coding skills in Python and/or TypeScript

Experience using modern AI SDKs and frameworks

Solid working knowledge of how foundation models behave in practice

Familiarity with the architectural patterns of production LLM systems

Experience with embeddings and information retrieval

Strong problem-solving and communication skills

Bachelors/Masters degree in Computer Science, a related technical field, or equivalent practical experience

Advanced degrees and open-source contributions are a plus.

Benefits: Highly competitive compensation

Benefits and rewards programs that encourage you to bring your best every day and be recognized for doing so.

An engaging, people-first work environment offering work/life balance, employee resource groups, and social events to promote interaction and camaraderie.