Job Title: Agentic AI Engineer/LLMOps
Duration: 6+ Months (Temp to Hire)
Location: Newark, NJ (Hybrid)
We are looking for an
Agentic AI Developer
to join our growing Agentic AI Platform team. This role will focus on developing, integrating, and managing enterprise-scale
AI and MCP (Model Context Protocol)
systems including
Kong AI Gateway, AWS Bedrock, Azure AI Foundry, and Agentcore . The ideal candidate is hands-on, comfortable with platform engineering, and passionate about shaping the future of enterprise AI enablement.
Key Responsibilities:
* AI Gateway Management:
* Install, configure, and maintain Kong AI Gateway and related plugins (e.g., PII sanitation, observability, routing).
* Implement secure and scalable patterns for MCP server onboarding and routing.
* Agentic Platform Enablement:
* Develop and maintain enterprise agentic AI patterns for consistent and governed agent development.
* Integrate and evaluate platforms such as AWS Bedrock, Agentcore, and Azure AI Foundry for agent lifecycle management.
* Business Partnering:
* Collaborate with business units to design, develop, and deploy intelligent agents aligned with enterprise use cases.
* Create intake workflows and forms (e.g., via ServiceNow) to standardize request and approval processes for new agents or AI capabilities.
* Governance & Standards:
* Work with security and cloud teams to implement guardrails, logging standards, and LLM usage policies.
* Contribute to the development of Agentic AI engineering specifications and best practices.
* Continuous Improvement:
* Participate in platform assessments, proof-of-concepts, and production rollouts.
* Optimize cost, performance, and reliability across AI workloads.
Required Skills & Experience:
* 4+ years of experience in AI platform engineering, DevOps, or backend development.
* Hands-on experience with Kong Gateway or equivalent API/AI gateway technologies.
* Experience integrating with AWS Bedrock, Azure AI Foundry, Anthropic Claude, or Agentcore.
* Strong knowledge of Python, Node.js, or similar languages for automation and plugin development.
* Familiarity with ServiceNow, REST APIs, OAuth2/OpenID, and observability tooling
* Understanding of LLM operations, governance, and security in enterprise settings.
* Excellent collaboration skills and ability to communicate with cross-functional teams (cloud, security, business).
* Python development and API development experience
Preferred Qualifications:
* Prior experience with agentic frameworks or MCP server development.
* Knowledge of AI observability, model routing, or enterprise cost optimization.
* Contributions to AI governance, compliance, or ISO-standard development efforts.