Aleph Alpha
Aleph Alpha
51 – 200 Darbinieki
B2BMākslīgais intelekts
Aleph Alpha ir mākslīgā intelekta pētniecības un lietojumu uzņēmums, kas izstrādā liela mēroga modeļus valodai, attēlu datiem un stratēģiskajai spriešanai. Uzņēmums atrodas Heidelbergā, Vācijā, un tā uzmanības centrā ir progresīvu mākslīgā intelekta pētījumu pārvēršana praktiskās sistēmās, vienlaikus atbalstot Eiropas digitālo suverenitāti. Tā darbs kalpo uzņēmumu un organizāciju lietošanas gadījumiem B2B tehnoloģiju nozarē.

Senior AI Researcher, Foundation Model Pre-Training — Aleph Alpha, Heidelberg

Lead architecture and large-scale pre-training work for Aleph Alpha’s European foundation models, shaping training methods across thousands of GPUs. Build and refine PyTorch training recipes with the Heidelberg-based hybrid team.

Apraksts

  • Develop architectures and training methods for Aleph Alpha’s next generation of foundation models.
  • Lead core training recipe components, including optimizers, schedules, and initialization.
  • Create PyTorch architecture improvements that strengthen convergence, stability, and training efficiency.
  • Establish hyperparameter scaling laws and methods for scaling training runs.
  • Run small proxy experiments to forecast behavior across thousands of GPUs and reduce training risk.
  • Diagnose convergence problems, including loss spikes and divergence.
  • Troubleshoot distributed training failures such as communication bottlenecks, race conditions, and synchronization errors.
  • Work with Compute Performance, Data, Evaluation, and Post-Training teams on system and model co-design.
  • Turn mathematical analysis and experimental evidence into sound training decisions.
  • Deliver production-quality code that improves model quality, run reliability, and efficiency.

Prasības

  • Proficiency in Python and strong familiarity with PyTorch training workflows.
  • A proven record in machine learning research and software engineering, shown through shipped models, influential open-source work, or published research.
  • Strong mathematical grounding and ability to reason formally about optimization, scaling behavior, and training dynamics.
  • In-depth knowledge of transformer training dynamics, optimization, and large distributed training runs.
  • Ability to design rigorous experiments and use their findings to guide robust training decisions.
  • Practical experience pre-training large models, such as models with 7B or more parameters, on substantial infrastructure, such as clusters of 100 or more GPUs.
  • Sound software engineering practices, including maintainable, well-tested code and reproducible experiments.
  • Ability to implement complex architectures efficiently and reliably, and debug model code, training behavior, and distributed systems.
  • Clear communication and effective cross-team collaboration.
  • Eligibility to work in Germany and availability for regular on-site collaboration in Heidelberg.
  • Preferred: experience training LLMs or multimodal models on large GPU clusters with distributed frameworks such as Megatron-LM, DeepSpeed, or torchtitan.
  • Preferred: familiarity with scaling laws, hyperparameter transfer, or forecasting large-scale training behavior from proxy runs.
  • Preferred: experience profiling distributed jobs and diagnosing training anomalies.
  • Preferred: exposure to sparse training methods such as Mixture-of-Experts.
  • Preferred: top-tier publications, influential open-source contributions, or significant shipped technical work.

Priekšrocības

  • 30 days of paid annual leave.
  • Access to fitness and wellness offerings through Wellhub.
  • Mental health support via nilo.health.
  • Substantially subsidized company pension plan.
  • Subsidized nationwide transportation ticket in Germany.
  • Budget for additional technical equipment.
  • Flexible working hours.
  • Hybrid work arrangement.
  • JobRad® bicycle leasing.

Saistītās vakances

Empower AI

Senior VoIP Engineer – Quantico, Virginia

Empower AI

Lead secure Cisco unified communications across DoD network enclaves for Empower AI’s federal transformation and DCSA contract. On-site senior engineering role supporting mission-critical voice and collaboration services.

Atvērt
Empower AI

Service Desk Shift Supervisor (Onsite, Virginia)

Empower AI

Lead Empower AI’s Tier 0 and Tier I government IT support operation, supervising service desk analysts across multiple shifts. Oversee service levels, critical incidents, quality, and continual improvement.

Atvērt
Ausloans Finance Group

Remote Asset Finance Broker – Australia

Ausloans Finance Group

Build a client portfolio and deliver finance solutions as an Asset Finance Broker with Ausloans Finance Group, a technology-driven car finance aggregator. Work independently with aggregator support and flexible remote arrangements.

Atvērt