ICF
ICF
5,001 – 10,000 Employees
ConsultingGovernmentHealthcare
ICF is a global consulting firm that helps governments, businesses, and communities address complex challenges through data, technology, and program expertise. Founded in 1969, the company works across consulting, government, and healthcare, supporting digital modernization, analytics, resilience and adaptation, energy planning, federal health programs, disaster management, infrastructure, and transportation. Its teams combine advisory services with program implementation to help clients achieve measurable results and strengthen community resilience.

Applied AI Engineer, Global Health — Remote

Build LLM pipelines, AI agents, and evaluation systems for ICF’s global health and survey programs. Create tools for reporting, analysis, translation, and field operations.

Description

  • Create LLM pipelines and agents that support survey workflows
  • Develop AI-assisted processes that turn data into reports
  • Build natural-language tools for analyzing survey data
  • Create multilingual tools for translating questionnaires
  • Develop field-support applications for interviewers and supervisors
  • Create evaluation harnesses and establish acceptance criteria with technical and survey specialists
  • Assemble expert-grounded test sets and perform non-inferiority comparisons
  • Select models according to reasoning demands, workload, cost, latency, and data-residency constraints
  • Control inference spending through token monitoring, context management, prompt caching, and batch execution
  • Integrate models with data services and full-stack applications
  • Use agentic coding tools to build, review, test, and maintain production software
  • Observe live systems and perform structured error analysis
  • Communicate both successful and unsuccessful results
  • Record methods and findings for public dissemination
  • Support the transfer of tools to institutions in partner countries

Requirements

  • Bachelor’s degree in computer science, engineering, or a related discipline, or equivalent professional experience
  • At least four years of professional software development experience, including production LLM systems used by real users
  • U.S. citizenship, as required for the federal government contract
  • Proficiency in Python or a comparable modern language such as JavaScript, TypeScript, or Go
  • Practical experience with frontier-model APIs, including tool use and retrieval-augmented generation
  • Experience designing LLM evaluations through test-set creation, automated and human grading, regression testing, and release decisions
  • Understanding of the cost, latency, and model-selection trade-offs involved in LLM systems
  • Experience deploying applications on a major cloud platform such as AWS, Azure, or Google Cloud
  • Experience with agentic coding tools including Claude Code, OpenAI Codex, Cursor, Antigravity, or GitHub Copilot agent mode
  • Experience with agent frameworks and AI evaluation tools

Benefits

  • Work remotely from within the United States
  • Occasional travel may be required
  • Reasonable accommodations are available for disabilities, veterans, and sincerely held religious beliefs
  • Equal opportunity employment
  • Confidential accommodation assistance is available throughout the application and employment process

Related Jobs

Active Nutrition International GmbH

Senior Procurement Specialist – Packaging and Raw Materials

Active Nutrition International GmbH

Lead operational procurement for packaging and raw materials at a sports nutrition company, covering supplier relationships, negotiations, and market analysis. Take primary responsibility for related audit processes and support new product launches and cost efficiency projects.

Open