Aleph Alpha
Aleph Alpha
51 – 200 Angajați
B2BInteligență artificială
Aleph Alpha este o companie de cercetare și aplicații în domeniul inteligenței artificiale, care dezvoltă modele de mari dimensiuni pentru limbaj, date vizuale și raționament strategic. Cu sediul în Heidelberg, Germania, compania se concentrează pe transformarea cercetării avansate în inteligență artificială în sisteme operaționale, sprijinind în același timp suveranitatea digitală a Europei. Activitatea sa răspunde unor cazuri de utilizare pentru companii și organizații din sectorul tehnologiei B2B.

Senior AI Researcher, Foundation Model Pre-Training — Aleph Alpha, Heidelberg

Lead architecture and large-scale pre-training work for Aleph Alpha’s European foundation models, shaping training methods across thousands of GPUs. Build and refine PyTorch training recipes with the Heidelberg-based hybrid team.

Descriere

  • Develop architectures and training methods for Aleph Alpha’s next generation of foundation models.
  • Lead core training recipe components, including optimizers, schedules, and initialization.
  • Create PyTorch architecture improvements that strengthen convergence, stability, and training efficiency.
  • Establish hyperparameter scaling laws and methods for scaling training runs.
  • Run small proxy experiments to forecast behavior across thousands of GPUs and reduce training risk.
  • Diagnose convergence problems, including loss spikes and divergence.
  • Troubleshoot distributed training failures such as communication bottlenecks, race conditions, and synchronization errors.
  • Work with Compute Performance, Data, Evaluation, and Post-Training teams on system and model co-design.
  • Turn mathematical analysis and experimental evidence into sound training decisions.
  • Deliver production-quality code that improves model quality, run reliability, and efficiency.

Cerințe

  • Proficiency in Python and strong familiarity with PyTorch training workflows.
  • A proven record in machine learning research and software engineering, shown through shipped models, influential open-source work, or published research.
  • Strong mathematical grounding and ability to reason formally about optimization, scaling behavior, and training dynamics.
  • In-depth knowledge of transformer training dynamics, optimization, and large distributed training runs.
  • Ability to design rigorous experiments and use their findings to guide robust training decisions.
  • Practical experience pre-training large models, such as models with 7B or more parameters, on substantial infrastructure, such as clusters of 100 or more GPUs.
  • Sound software engineering practices, including maintainable, well-tested code and reproducible experiments.
  • Ability to implement complex architectures efficiently and reliably, and debug model code, training behavior, and distributed systems.
  • Clear communication and effective cross-team collaboration.
  • Eligibility to work in Germany and availability for regular on-site collaboration in Heidelberg.
  • Preferred: experience training LLMs or multimodal models on large GPU clusters with distributed frameworks such as Megatron-LM, DeepSpeed, or torchtitan.
  • Preferred: familiarity with scaling laws, hyperparameter transfer, or forecasting large-scale training behavior from proxy runs.
  • Preferred: experience profiling distributed jobs and diagnosing training anomalies.
  • Preferred: exposure to sparse training methods such as Mixture-of-Experts.
  • Preferred: top-tier publications, influential open-source contributions, or significant shipped technical work.

Beneficii

  • 30 days of paid annual leave.
  • Access to fitness and wellness offerings through Wellhub.
  • Mental health support via nilo.health.
  • Substantially subsidized company pension plan.
  • Subsidized nationwide transportation ticket in Germany.
  • Budget for additional technical equipment.
  • Flexible working hours.
  • Hybrid work arrangement.
  • JobRad® bicycle leasing.

Locuri de muncă similare

Bloomlife Inc

Remote Account Sales Executive, Healthcare

Bloomlife Inc

Grow Bloomlife’s remote maternal-fetal monitoring business by selling remote patient monitoring solutions to OB/GYN practices and health systems. Manage the full sales cycle, from prospecting and clinical presentations to contract negotiations and deployment handoffs.

Deschide
Illumina

Clinical Sales Specialist, Genomics — Thailand, Indonesia and Vietnam

Illumina

Support Illumina’s clinical genomics sales across Thailand, Indonesia and Vietnam, advising customers on applications, workflows and products. The role spans reproductive and genetic health, oncology, customer development and regional market growth.

Deschide
Trane Technologies

Senior Executive Assistant, Digital Leadership

Trane Technologies

Support Trane Technologies’ Digital leadership team by coordinating executive schedules, travel, meetings, communications, and procurement. The role covers leaders across the United States and requires on-site work in White Bear Lake, Minnesota, Monday through Thursday.

Deschide