R

Senior Applied AI Engineer

Remotive
4 hours ago
Full-time
On-site
East New York, New York, United States
Role Description

We're looking for a Senior AI & Data Engineer (GenAI & LLM Evaluation) to help build and improve AI-powered data products. Working alongside Data Scientists, Engineers, and Delivery teams, you'll develop scalable data pipelines, build GenAI evaluation frameworks, and deploy production-ready AI solutions. This is a hands-on role where you'll own solutions from design through to deployment while working on cutting-edge Generative AI technologies. If you enjoy solving real-world problems and building practical AI solutions that make an impact, we'd love to hear from you.

Qualifications

5+ years' experience in Data Engineering, Machine Learning, AI Engineering, or Data Science.

Strong Python and SQL skills.

Hands-on experience with Generative AI and Large Language Models (LLMs).

Experience evaluating LLMs using golden datasets, model benchmarking, or LLM-as-a-Judge techniques.

Experience building and deploying production-ready ML solutions.

Strong understanding of data pipelines, validation, and quality frameworks.

Experience integrating APIs and cloud-based AI services.

Strong problem-solving and analytical skills.

Comfortable owning solutions end-to-end.

Excellent communication and stakeholder management.

Experience working in Agile, cross-functional teams.

Consulting or customer-facing experience is a plus.

Requirements

Build and maintain scalable data pipelines and workflows.

Develop evaluation frameworks for GenAI and LLM applications.

Create and maintain golden datasets for model testing.

Evaluate and benchmark LLM performance.

Build ML-assisted tools to improve delivery and automation.

Deploy production-ready AI solutions.

Work closely with delivery teams to solve technical challenges.

Continuously improve data quality, automation, and operational efficiency.

Benefits

People are at the Heart of our Business. By investing in people, we achieve exceptional results for our clients and create new opportunities for our teams to thrive.