Markon
Markon
501 – 1,000 Employees
DefenseGovernmentLogistics
Markon is a federal government professional services firm supporting intelligence, civilian, and defense agencies. Its work spans critical infrastructure, business operations, enterprise technology, facilities management, security operations, contract lifecycle support, and business transformation. The company brings together consulting and operational expertise to help government organizations manage complex missions and modernize how they work, with opportunities for professionals interested in defense, logistics, government services, and technology.

Senior AI/ML Engineer – Onsite in Annapolis Junction

Build production LLM, RAG, and agentic AI systems for Markon’s intelligence and defense clients. Integrate secure enterprise tools and governance workflows onsite in Annapolis Junction.

Description

  • Create and integrate LLM and agent orchestration workflows with LangGraph, Agno, and the NVIDIA NeMo Agent Toolkit
  • Optimize model gateway routing across frontier and open-weight models for cost, performance, and mission suitability
  • Build RAG pipelines, vector database integrations, and memory services that give agents mission context
  • Develop MCP-based tool-broker integrations for secure agent access to enterprise systems and data
  • Assess, benchmark, and refine model performance and agent behavior
  • Create automated evaluation pipelines to monitor AI quality, safety, and performance over time
  • Work with data scientists and mission analysts to turn research prototypes into production AI capabilities for the command
  • Add governance controls such as safety filters, policy enforcement, and approval gates to agentic workflows
  • Document model and agent architectures along with evaluation findings for future reuse
  • Assess emerging LLM, agent, and AI tools to maintain a current and adaptable command capability

Requirements

  • Active TS/SCI clearance with polygraph
  • Bachelor’s degree in Computer Science, Data Science, or a related field from an accredited institution; four additional years of experience may replace the degree
  • At least 10 years of experience in an engineering-related field
  • Advanced Python skills for AI and machine learning application development
  • Proven experience building or integrating production LLM or agent-based systems
  • Experience with retrieval-augmented generation, vector databases, and prompt or context engineering
  • Ability to balance competing priorities in fast-paced mission settings and escalate operational risks early
  • A master’s degree and at least eight years of relevant experience are preferred
  • Experience supporting DoD cyber operations or similar mission environments
  • Experience with LangGraph, Agno, or the NVIDIA NeMo Agent Toolkit
  • Experience with model inference or serving platforms such as NVIDIA NIM, vLLM, Ollama, or LiteLLM
  • Experience with MCP or comparable tool-broker and integration standards
  • Experience with AI evaluation frameworks, model benchmarking, and observability through logs, metrics, and traces
  • Experience supporting DoD AI or cyber mission environments

Benefits

  • Medical insurance
  • Dental insurance
  • Vision insurance
  • Life insurance
  • Short-term disability coverage
  • Long-term disability coverage
  • 401(k) matching
  • Flexible spending accounts
  • Employee assistance program
  • Training and tuition assistance
  • Paid time off
  • Paid holidays
  • Professional growth and development opportunities
  • Equal opportunity employer

Related Jobs

Alkami Technology

Technical Engineering Manager at Alkami (US Remote)

Alkami Technology
501 – 1,000 Employees
BankingConsultingMarketing

Lead software engineers and contribute hands-on to delivery at Alkami, a digital banking platform provider. Shape scalable architecture, operational practices, and cross-functional execution.

Open