C

Senior Lead AI Engineer (LLM Customization and Finetuning)

Capital One
Full-time
On-site
New York
Overview

At Capital One, we are creating responsible and reliable AI systems, changing banking for good. We are an industry leader in using machine learning to create real-time, personalized customer experiences, with investments in technology infrastructure and world-class talent to advance AI across the business. At Capital One, you will help bring the transformative power of emerging AI capabilities to reimagine how we serve our customers and businesses who have come to love the products and services we build. Team Description

The Intelligent Foundations and Experiences (IFX) team is at the center of bringing our vision for AI at Capital One to life. We work with partners across the company to advance science and AI engineering, and we deploy proprietary solutions central to our business that deliver value to millions of customers. Our AI models and platforms empower teams to enhance products with responsible and scalable AI for high-impact outcomes. In this role, you will

Partner with a cross-functional team of engineers, research scientists, technical program managers, and product managers to deliver AI-powered products that change how our associates work and how our customers interact with Capital One. Design, develop, test, deploy, and support AI software components including foundation model training, large language model inference, similarity search, guardrails, model evaluation, experimentation, governance, and observability. Leverage a broad stack of Open Source and SaaS AI technologies such as AWS Ultraclusters, Huggingface, VectorDBs, Nemo Guardrails, PyTorch, and more. Invent and introduce state-of-the-art LLM optimization techniques to improve performance metrics such as scalability, cost, latency, and throughput for large-scale production AI systems. Contribute to the technical vision and the long-term roadmap of foundational AI systems at Capital One. The Ideal Candidate

You love to build systems, take pride in your work quality, and are motivated to do the right thing to help change banking for good. Passion for staying up-to-date with the latest research and an ability to translate scientific publications into production-ready solutions. You adapt quickly, bring clarity to big problems, ask questions, and can articulate findings concisely; you are willing to share new ideas even if they are unproven. You have a strong technical foundation in engineering and mathematics, with experience across hardware, software, and AI to identify optimization opportunities. You are a resilient trailblazer who can forge new paths to achieve business goals when the route is unknown. Basic Qualifications

Bachelor's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields with at least 6 years of AI/ML experience, or a Master's degree with at least 4 years of AI/ML experience At least 6 years of programming experience in Python, Go, Scala, or Java Preferred Qualifications

7 years of experience deploying scalable and responsible AI solutions on cloud platforms (e.g., AWS, Google Cloud, Azure) Experience designing, developing, integrating, delivering, and supporting complex AI systems Ability to lead and mentor an engineering team and influence cross-functional stakeholders Experience developing AI/ML algorithms (e.g., LLM inference, similarity search, vector databases, guardrails, memory) using Python, C++, C#, Java, or Golang Experience optimizing training and inference software to improve hardware utilization, latency, throughput, and cost Excellent communication and the ability to articulate complex AI concepts to peers Capital One will consider sponsoring a new qualified applicant for employment authorization for this position. The minimum and maximum full-time annual salaries for this role are listed below, by location. Salaries for part-time roles will be prorated. This informational salary data is provided for candidates hired to work in specified locations and may vary by location. Capital One is an equal opportunity employer (EOE, including disability/vet) committed to non-discrimination. We promote a drug-free workplace and comply with applicable laws regarding criminal background inquiries. If you require accommodations during the application process, please contact Capital One Recruiting at 1-800-304-9102 or RecruitingAccommodation@capitalone.com. For technical support or questions about Capital One's recruiting process, please email Careers@capitalone.com. This role is expected to accept applications for a minimum of 5 business days. No agencies please.

#J-18808-Ljbffr