Role:
Senior AI Engineer
Location:
Lake Mary, FL (Local's Prefers)
Contract & FTE Only
Look for Senior/Lead Engineer with 10-12+ years of genuine experience.
Core Programming
• Python Intermediate/Advanced - async programming
• API Development - FastAPI
• Writing production-grade, scalable code
• Testing (unit, integration)
• Debugging complex distributed system
LLM Fundamentals
• Prompt Engineering
• Tokenization, context windows
• Model selection
• Handling hallucinations and grounding responses
Retrieval-Augmented generation (RAG)
• Document Ingestion and preprocessing
• Chunking Strategies (semantic, recursive, sliding window)
• Embeddings
• Vector database - pgvector
• Hybrid search (keyword (BM25) + semantic)
• Re-ranking and relevance tuning
Agentic Frameworks and Orchestration
• Multi-agent coordination
• Memory Management
• Workflow orchestration
Evaluation and Observability
• LLM Evaluation metrics (accuracy, faithfulness and relevance)
• Prompt/version tracking
• Logging and Tracking
• Human in the loop (HITL) feedback loops
Deployment and MLOps
• Containerization (Docker)
• CI/CD pipelines
• Monitoring