Member of Technical Staff - Pre-Training

You will research and build solutions for algorithms, scaling laws, data processing, optimizers, and model architecture. You will run experiments on language-model scaling and data efficiency, implement deep learning methods, lead research projects, optimize training infrastructure, and contribute from low-level optimization through high-level model design.

Responsibilities

• Research and build solutions across algorithms scaling laws data processing optimizers and model architecture
• Design and run experiments on language model scaling and data efficiency
• Implement deep learning methods
• Lead small research projects
• Optimize training infrastructure for efficient scaling
• Contribute from low-level optimization through high-level model design

Requirements

• Computer science
• Machine learning
• Software engineering
• ETL
• Training data
• Language model
• Distributed training
• Python
• PyTorch
• Deep learning
• Communication

Benefits

• Stock options
• Medical insurance
• Dental insurance
• Vision insurance
• Life insurance
• Annual wellness allowance
• Daily office lunch and dinner
• 22 weeks of paid parental leave
• Unlimited paid time off in the U.S.
• 30 days of vacation in the U.K.
• Visa sponsorship
• Regular off-sites
• Happy hours
• Team celebrations