LogoFresh Jobs Ahead
Aleph Alpha
Aleph Alpha
51 – 200 Employees
Artificial IntelligenceB2B
Aleph Alpha is an artificial intelligence research and application company developing large-scale models for language, image data, and strategic reasoning. Based in Heidelberg, Germany, the company focuses on turning advanced AI research into operational systems while supporting Europe’s digital sovereignty. Its work serves business and organizational use cases in the B2B technology sector.
LinkedIn
Company Jobs

Senior AI Researcher, Foundation Model Pre-Training — Aleph Alpha, Heidelberg

Lead architecture and large-scale pre-training work for Aleph Alpha’s European foundation models, shaping training methods across thousands of GPUs. Build and refine PyTorch training recipes with the Heidelberg-based hybrid team.

DEGermanyHybridFull-timeSeniorEnglish RequiredAI Research ScientistMachine Learning Engineer
Distributed SystemsPythonPyTorch

Description

  • Develop architectures and training methods for Aleph Alpha’s next generation of foundation models.
  • Lead core training recipe components, including optimizers, schedules, and initialization.
  • Create PyTorch architecture improvements that strengthen convergence, stability, and training efficiency.
  • Establish hyperparameter scaling laws and methods for scaling training runs.
  • Run small proxy experiments to forecast behavior across thousands of GPUs and reduce training risk.
  • Diagnose convergence problems, including loss spikes and divergence.
  • Troubleshoot distributed training failures such as communication bottlenecks, race conditions, and synchronization errors.
  • Work with Compute Performance, Data, Evaluation, and Post-Training teams on system and model co-design.
  • Turn mathematical analysis and experimental evidence into sound training decisions.
  • Deliver production-quality code that improves model quality, run reliability, and efficiency.

Requirements

  • Proficiency in Python and strong familiarity with PyTorch training workflows.
  • A proven record in machine learning research and software engineering, shown through shipped models, influential open-source work, or published research.
  • Strong mathematical grounding and ability to reason formally about optimization, scaling behavior, and training dynamics.
  • In-depth knowledge of transformer training dynamics, optimization, and large distributed training runs.
  • Ability to design rigorous experiments and use their findings to guide robust training decisions.
  • Practical experience pre-training large models, such as models with 7B or more parameters, on substantial infrastructure, such as clusters of 100 or more GPUs.
  • Sound software engineering practices, including maintainable, well-tested code and reproducible experiments.
  • Ability to implement complex architectures efficiently and reliably, and debug model code, training behavior, and distributed systems.
  • Clear communication and effective cross-team collaboration.
  • Eligibility to work in Germany and availability for regular on-site collaboration in Heidelberg.
  • Preferred: experience training LLMs or multimodal models on large GPU clusters with distributed frameworks such as Megatron-LM, DeepSpeed, or torchtitan.
  • Preferred: familiarity with scaling laws, hyperparameter transfer, or forecasting large-scale training behavior from proxy runs.
  • Preferred: experience profiling distributed jobs and diagnosing training anomalies.
  • Preferred: exposure to sparse training methods such as Mixture-of-Experts.
  • Preferred: top-tier publications, influential open-source contributions, or significant shipped technical work.

Benefits

  • 30 days of paid annual leave.
  • Access to fitness and wellness offerings through Wellhub.
  • Mental health support via nilo.health.
  • Substantially subsidized company pension plan.
  • Subsidized nationwide transportation ticket in Germany.
  • Budget for additional technical equipment.
  • Flexible working hours.
  • Hybrid work arrangement.
  • JobRad® bicycle leasing.

Related Jobs

MÜNZING CHEMIE GmbH

Sales Manager, Mid-Atlantic Specialty Chemicals

MÜNZING CHEMIE GmbH
501 – 1,000 Employees
ChemistryManufacturing
USUnited StatesPAPennsylvania
$110,000 – $130,000 / year
HybridFull-timeMiddleSeniorEnglish RequiredSales

Lead technical sales of specialty chemical additives across the Mid-Atlantic, serving customers in coatings, adhesives, inks, and construction. Manage existing accounts while developing new business through customer visits and project-based selling.

Open
MÜNZING

MÜNZING Mid-Atlantic Sales Manager, Specialty Chemicals

MÜNZING
51 – 200 Employees
ConstructionFood & BeverageHealthcare
USUnited StatesPAPennsylvania
$110,000 – $130,000 / year
RemoteFull-timeMiddleSeniorEnglish RequiredSales

Lead territory sales for MÜNZING’s specialty chemical additives across the Mid-Atlantic, using technical project selling to develop customer relationships and close business. Manage a $3–5 million territory and build $1–2 million in near-term business potential across coatings, adhesives, inks, and construction markets.

Open