V
AI Engineering Lead
Virtual Vocations Inc
2 hours ago
Full-time
On-site
East New York, New York, United States
Leading a remote engineering team, the AI Engineering Lead will own the architecture of production-grade AI/ML systems, establish prompt engineering standards, and mentor engineers to deliver reliable AI capabilities on a long-term contract basis.
Key Responsibilities
Define and own the architecture of production AI/ML and LLM-based systems, including agentic workflows and RAG patterns Build evaluation frameworks to measure accuracy, safety, hallucination, and regression while implementing AI observability metrics Lead, mentor, and review the work of AI engineers, setting coding and quality standards in Python
Required Qualifications
10+ years in software engineering with recent hands-on experience in production AI/ML systems Strong expertise in LLM architecture, prompt engineering, and evaluation frameworks Advanced Python skills and experience with AI observability and cost controls Proven team leadership and technical mentoring experience Bachelor's degree in computer science, engineering, information technology, or a related field (or equivalent experience)
Define and own the architecture of production AI/ML and LLM-based systems, including agentic workflows and RAG patterns Build evaluation frameworks to measure accuracy, safety, hallucination, and regression while implementing AI observability metrics Lead, mentor, and review the work of AI engineers, setting coding and quality standards in Python
Required Qualifications
10+ years in software engineering with recent hands-on experience in production AI/ML systems Strong expertise in LLM architecture, prompt engineering, and evaluation frameworks Advanced Python skills and experience with AI observability and cost controls Proven team leadership and technical mentoring experience Bachelor's degree in computer science, engineering, information technology, or a related field (or equivalent experience)