Markon
Markon
501 – 1,000 Employees
DefenseGovernmentLogistics
Markon is a federal government professional services firm supporting intelligence, civilian, and defense agencies. Its work spans critical infrastructure, business operations, enterprise technology, facilities management, security operations, contract lifecycle support, and business transformation. The company brings together consulting and operational expertise to help government organizations manage complex missions and modernize how they work, with opportunities for professionals interested in defense, logistics, government services, and technology.

Senior AI and ML Engineer at Markon - Annapolis Junction, MD

Build production agentic AI, retrieval-augmented generation, and governance capabilities as a senior engineer. Support Markon’s federal intelligence and defense missions onsite in Annapolis Junction.

Description

  • Design and integrate LLM and agent orchestration workflows with LangGraph, Agno, and the NVIDIA NeMo Agent Toolkit
  • Optimize model gateway routing across frontier and open-weight models for cost, performance, and mission alignment
  • Develop and integrate retrieval-augmented generation pipelines, vector databases, and memory services
  • Implement MCP-based tool-broker integrations that provide secure access to enterprise tools and data
  • Evaluate, benchmark, and optimize models and agent behaviors
  • Build automated evaluation pipelines that measure quality, safety, and performance
  • Work with data scientists and mission analysts to turn research and prototypes into production-ready AI capabilities
  • Implement AI governance guardrails, content and safety filters, policy controls, and approval gates
  • Document model and agent architectures along with evaluation results
  • Research and assess emerging LLM, agent, and AI technologies

Requirements

  • Active TS/SCI clearance with polygraph
  • Bachelor’s degree from an accredited college or university in computer science, data science, or a related field
  • At least 8 years of experience in an engineering-related discipline
  • Advanced Python proficiency for AI and ML application development
  • Demonstrated experience building or integrating production LLM or agent-based systems
  • Experience with retrieval-augmented generation, vector databases, and prompt or context engineering
  • Ability to manage competing priorities in fast-paced mission environments and identify or escalate operational risks early
  • Experience supporting DoD cyber operations or related mission environments preferred
  • Experience with LangGraph, Agno, or the NVIDIA NeMo Agent Toolkit preferred
  • Experience with NVIDIA NIM, vLLM, Ollama, or LiteLLM preferred
  • Experience with MCP or comparable tool-broker and integration standards preferred
  • Experience with AI evaluation frameworks, model benchmarking, and AI workload observability preferred
  • Experience supporting DoD AI or cyber mission environments preferred

Benefits

  • Medical insurance
  • Dental insurance
  • Vision insurance
  • Life insurance
  • Short-term disability coverage
  • Long-term disability coverage
  • 401(k) matching
  • Flexible spending accounts
  • Employee assistance program
  • Training and tuition assistance
  • Paid time off
  • Paid holidays
  • Professional growth and development opportunities
  • Equal Opportunity Employer

Related Jobs

Nebius Group

Senior Customer AI Engineer

Nebius Group
1,001 – 5,000 Employees
Artificial IntelligenceEnterpriseSaaS

Guide customers from proof of concept to production on Nebius’s AI cloud platform, helping them deploy AI workloads reliably and at scale. Improve performance, reliability, and cost efficiency while accelerating time to production and customer value.

Open