Principal AI Engineer (AI Foundations, LLM Core)

Principal AI Engineer (AI Foundations, LLM Core) Overview:

At Capital One, we are committed to developing responsible and innovative AI systems to transform banking for the better. As a pioneer in utilizing machine learning, we provide real-time, personalized customer experiences. Our extensive investments in technology and top-tier talent, combined with our vast machine learning expertise, enable us to lead the enterprise AI landscape. Our AI and ML applications enhance customer interactions and simplify banking. We strive to build exceptional applied science and engineering teams to deliver cutting-edge capabilities and high-performance AI infrastructure. Team Description:

The Intelligent Foundations and Experiences (IFX) team embodies our vision for AI at Capital One. Collaborating closely with partners across our organization, we push the boundaries of AI science and engineering. Our proprietary models and platforms empower teams to enhance products with transformative AI capabilities efficiently and responsibly. In this role, you will: Collaborate with cross-functional teams including engineers, research scientists, and product managers to deliver AI-powered products that redefine customer and associate interactions. Design, develop, test, deploy, and support AI software components including foundation model training, large language model inference, and model observability. Utilize a diverse range of Open Source and SaaS AI technologies, including AWS Ultraclusters, Huggingface, VectorDBs, and PyTorch. Develop state-of-the-art LLM optimization techniques to enhance scalability, cost-effectiveness, latency, and throughput of large-scale AI systems. Contribute to the technical vision and long-term roadmap for foundational AI systems at Capital One. The Ideal Candidate: You take pride in building robust systems and are passionate about making a positive impact. You stay current on the latest AI research and effectively apply new techniques in production environments. You thrive on solving complex problems with clarity and are courageous in sharing innovative ideas. You possess a solid foundation in engineering and mathematics, enabling you to identify optimization opportunities. You are a resourceful pioneer capable of navigating uncharted territories to achieve business objectives. Basic Qualifications: Bachelor's degree in Computer Science, AI, Electrical Engineering, or a related field with at least 4 years of experience in developing AI/ML technologies; or a Master's degree with a minimum of 2 years of relevant experience. At least 4 years of programming experience in Python, Go, Scala, or Java. Preferred Qualifications: 6 years of experience deploying scalable AI solutions in cloud environments (AWS, Google Cloud, Azure, or similar). Hands-on experience in designing and supporting AI services. Experience in developing AI/ML algorithms (LLM Inference, Similarity Search, Guardrails) using various programming languages. Expertise in optimizing training and inference software for performance improvements. A strong passion for continually advancing AI knowledge and practical applications. Capital One is willing to consider sponsoring qualified candidates for employment authorization for this position. The salary range for this role varies based on location and experience. Capital One is an equal opportunity employer committed to non-discrimination and a drug-free workplace. We consider qualified applicants with a criminal history in accordance with applicable laws.