Aleph Alpha
Aleph Alpha
51 – 200 Қызметкерлер
B2BЖасанды интеллект
Aleph Alpha — тіл, кескін деректері және стратегиялық пайымдау салаларына арналған ауқымды модельдер әзірлейтін жасанды интеллектіні зерттеу және қолдану компаниясы. Германияның Гейдельберг қаласында орналасқан компания озық жасанды интеллект зерттеулерін операциялық жүйелерге айналдыруға және Еуропаның цифрлық егемендігін қолдауға назар аударады. Оның жұмысы B2B технологиялар секторындағы бизнес пен ұйымдардың қолдану жағдайларына қызмет етеді.

Senior AI Researcher, Foundation Model Pre-Training — Aleph Alpha, Heidelberg

Lead architecture and large-scale pre-training work for Aleph Alpha’s European foundation models, shaping training methods across thousands of GPUs. Build and refine PyTorch training recipes with the Heidelberg-based hybrid team.

Сипаттама

  • Develop architectures and training methods for Aleph Alpha’s next generation of foundation models.
  • Lead core training recipe components, including optimizers, schedules, and initialization.
  • Create PyTorch architecture improvements that strengthen convergence, stability, and training efficiency.
  • Establish hyperparameter scaling laws and methods for scaling training runs.
  • Run small proxy experiments to forecast behavior across thousands of GPUs and reduce training risk.
  • Diagnose convergence problems, including loss spikes and divergence.
  • Troubleshoot distributed training failures such as communication bottlenecks, race conditions, and synchronization errors.
  • Work with Compute Performance, Data, Evaluation, and Post-Training teams on system and model co-design.
  • Turn mathematical analysis and experimental evidence into sound training decisions.
  • Deliver production-quality code that improves model quality, run reliability, and efficiency.

Талаптар

  • Proficiency in Python and strong familiarity with PyTorch training workflows.
  • A proven record in machine learning research and software engineering, shown through shipped models, influential open-source work, or published research.
  • Strong mathematical grounding and ability to reason formally about optimization, scaling behavior, and training dynamics.
  • In-depth knowledge of transformer training dynamics, optimization, and large distributed training runs.
  • Ability to design rigorous experiments and use their findings to guide robust training decisions.
  • Practical experience pre-training large models, such as models with 7B or more parameters, on substantial infrastructure, such as clusters of 100 or more GPUs.
  • Sound software engineering practices, including maintainable, well-tested code and reproducible experiments.
  • Ability to implement complex architectures efficiently and reliably, and debug model code, training behavior, and distributed systems.
  • Clear communication and effective cross-team collaboration.
  • Eligibility to work in Germany and availability for regular on-site collaboration in Heidelberg.
  • Preferred: experience training LLMs or multimodal models on large GPU clusters with distributed frameworks such as Megatron-LM, DeepSpeed, or torchtitan.
  • Preferred: familiarity with scaling laws, hyperparameter transfer, or forecasting large-scale training behavior from proxy runs.
  • Preferred: experience profiling distributed jobs and diagnosing training anomalies.
  • Preferred: exposure to sparse training methods such as Mixture-of-Experts.
  • Preferred: top-tier publications, influential open-source contributions, or significant shipped technical work.

Артықшылықтар

  • 30 days of paid annual leave.
  • Access to fitness and wellness offerings through Wellhub.
  • Mental health support via nilo.health.
  • Substantially subsidized company pension plan.
  • Subsidized nationwide transportation ticket in Germany.
  • Budget for additional technical equipment.
  • Flexible working hours.
  • Hybrid work arrangement.
  • JobRad® bicycle leasing.

Ұқсас жұмыс орындары

RTX

Aerothermal Engineer I (Hybrid)

RTX

Support RTX aerospace component programs through CFD, thermal analysis, and engine test-data evaluation. This hybrid role in Aguadilla focuses on aerothermal quality, performance, and operability.

Ашу
WSP in the U.S.

Property Valuation Surveyor and Land Consultant

WSP in the U.S.

Deliver property valuation, compensation and land acquisition services for infrastructure projects across Ireland. Coordinate land access, statutory acquisition processes and engagement with landowners and project stakeholders.

Ашу
Global Alliant Inc

Senior Azure and Microsoft 365 Engineer (Hybrid, Ashburn)

Global Alliant Inc

Support identity, access, and virtual desktop services across Azure and Microsoft 365. Work in a hybrid arrangement with two onsite days per week in Ashburn, Virginia.

Ашу
Ecolab

Technical Consultant, Ion Exchange Resins

Ecolab

Provide application expertise for Ecolab’s Purolite ion exchange and specialty resin technologies. Support customers across Europe with troubleshooting, technical sales, and training.

Ашу
YASH Technologies

Senior SAP S/4HANA SD Consultant

YASH Technologies

Deliver SAP S/4HANA SD order-to-cash implementations and integrations at YASH Technologies. Support rollouts, master data, pricing, tax, availability checks, and cross-functional SAP processes.

Ашу
UNESCO

Senior Water Sector Capacity Assessment Consultant, West Africa

UNESCO

UNESCO seeks a consultant to assess water-sector capacity gaps across West Africa and in a pilot country. The work includes regional recommendations and a country capacity-development plan.

Ашу
InterScripts, Inc.

Epic SmartForms Build Consultant

InterScripts, Inc.

Design and deploy complex Epic SmartForms for a pediatric health system client. Coach Epic analysts and establish reusable build standards and workflows.

Ашу
InterScripts, Inc.

Senior Epic HIM Certified Consultant (Remote, US)

InterScripts, Inc.

Provide interim Epic HIM application support for a pediatric health system, including workflow maintenance and troubleshooting. Train a new analyst, document processes, and prepare the team for a smooth transition.

Ашу