Senior Gen AI Engineer

Title - Senior Gen AI Engineer Location - NY/NJ

Considering applying for this job Do not delay, scroll down and make your application as soon as possible to avoid missing out.

We're seeking a hands-on Architect/Lead to design, build, and scale GenAI systems on Python and AWS. You'll own end-to-end architecture (LLMs, agents, RAG, evals), production readiness (security, cost, reliability), and developer experience-leveraging AWS (SageMaker/Bedrock) and Model Context Protocol (MCP) for safe, modular tool access.

Key Responsibilities Architect GenAI systems (text/image/code) with LLMs and agentic workflows (single-/multi-agent, tool calling, structured outputs/JSON schemas). Adopt MCP to standardize tool integrations: design/implement custom MCP servers (files, search, knowledge bases, business APIs) and client orchestration. Build RAG pipelines (chunking, embeddings, hybrid search, citations, reranking) with Pinecone/FAISS/Chroma/OpenSearch; implement knowledge refresh and governance. Engineer Python-based pipelines for ingestion, fine-tuning/parameter-efficient tuning (LoRA/QLoRA), evaluation, and deployment (FastAPI microservices). Design AWS architectures using Bedrock (models, Knowledge Bases, Agents), SageMaker (training/inference, Feature Store), Lambda, ECS/EKS, API Gateway, S3, DynamoDB, Step Functions, PrivateLink/VPC endpoints, KMS. Observability & evals: tracing (OpenTelemetry/LangSmith), offline/online evals (RAGAS/G-Eval), guardrails/toxicity/PII redaction, prompt/version management, A/B tests, canary rollouts. Performance & cost: prompt compression/caching, batch/streaming, GPU/Inferentia sizing, autoscaling, token and latency budgets. Security & governance: IAM least-privilege, KMS encryption, data residency, model/data lineage, approval workflows, policy-as-code; align with SOC2/ISO/HIPAA/PCI as applicable. Platform enablement: build reusable SDKs/templates, CI/CD for GenAI (infra as code, tests, eval gates), golden paths for product teams. Leadership: mentor AI engineers/data scientists; drive POCs to production; translate business requirements into measurable GenAI use cases and KPIs.

Required Skills: • Python: FastAPI, async I/O, testing; LangChain/LlamaIndex and/or LangGraph for agent orchestration; PyTorch; Hugging Face Transformers. • MCP: designing custom MCP servers/skills, permissioning and sandboxing tools, wiring MCP clients into apps/agents. • LLMs: GPT/Claude/Gemini/Llama; prompt engineering, tool use/function calling, structured output, safety patterns. • AWS AI/ML: Bedrock (models, Knowledge Bases, Agents for Bedrock), SageMaker (training/hosting), Lambda, ECS/EKS, S3, API Gateway, DynamoDB, CloudWatch, Step Functions. • RAG & vectors: embeddings, indexing, hybrid/bm25+vec search, rerankers; Pinecone/FAISS/Chroma/OpenSearch. • Containers & CI/CD: Docker, ECS/EKS, IaC (CDK/Terraform), GitHub Actions/CodePipeline; blue/green and canary. • MLOps/AIOps: model/package versioning, feature/embedding stores, eval harnesses, tracing, alerting, rollout/rollback strategies. • Security/compliance: IAM, VPC, KMS, Secrets Manager, data masking/PII redaction, audit logging.

Nice to Have • PEFT/LoRA/QLoRA, distillation, retrieval-adapted adapters; vector compression (PQ/HNSW tuning). • Gateway & caching: LLM gateways, response/prompt caches (Redis, Bedrock inference cache). • Guardrails: policy engines (Rebuff/ -style), content moderation, safety scoring. • Front-ends: Streamlit/Gradio/Next.js; WebSocket streaming; enterprise SSO (Cognito/Okta). • Data stack: Glue/Athena/Lake Formation; Kafka/MSK; Delta/Iceberg/Hudi.

Life at Capgemini Capgemini supports all aspects of your well-being throughout the changing stages of your life and career. For eligible employees, we offer: Flexible work Healthcare including dental, vision, mental health, and well-being programs Financial well-being programs such as 401(k) and Employee Share Ownership Plan Paid time off and paid holidays Paid parental leave Family building benefits like adoption assistance, surrogacy, and cryopreservation Social well-being benefits like subsidized back-up child/elder care and tutoring Mentoring, coaching and learning programs Employee Resource Groups Disaster Relief

Disclaimer Capgemini is an Equal Opportunity Employer encouraging diversity in the workplace. All qualified applicants will receive consideration for employment without regard to race, national origin, gender identity/expression, age, religion, disability, sexual orientation, genetics, veteran status, marital status or any other characteristic protected by law. This is a general description of the Duties, Responsibilities and Qualifications required for this position. Physical, mental, sensory or environmental demands may be referenced in an attempt to communicate the manner in which this position traditionally is performed. Whenever necessary to provide individuals with disabilities an equal employment opportunity, Capgemini will consider reasonable accommodations that might involve varying job requirements and/or changing the way this job is performed, provided that such accommodations do not pose an undue hardship. Capgemini is committed to providing reasonable accommodations during our recruitment process. If you need assistance or accommodation, please get in touch with your recruiting contact. Click the following link for more information on your rights as an Applicant Transparency Disclaimer Capgemini discloses salary range information in compliance with state and local pay transparency obligations. The disclosed range represents the lowest to highest salary we, in good faith, believe we would pay for this role at the time of this posting, although we may ultimately pay more or less than the disclosed range, and the range may be modified in the future. The disclosed range takes into account the wide range of factors that are considered in making compensation decisions including, but not limited to, geographic location, relevant education, qualifications, certifications, experience, skills, seniority, performance, sales or revenue-based metrics, and business or organizational needs. At Capgemini, it is not typical for an individual to be hired at or near the top of the range for their role. The base salary range for the tagged location is $ 103330- $ 128656 /yearly. This role may be eligible for other compensation including variable compensation, bonus, or commission. Full time regular employees are eligible for paid time off, medical/dental/vision insurance, 401(k), and any other benefits to eligible employees. xsgimln Note: No amount of pay is considered to be wages or compensation until such amount is earned, vested, and determinable. The amount and availability of any bonus, commission, or any other form of compensation that are allocable to a particular employee remains in the Company's sole discretion unless and until paid and may be modified at the Company’s sole discretion, consistent with the law.