Manager, ML Solutions Architecture - Token Factory
- Location
- 🇺🇸Remote · United States
- Posted
- (today)
- Type
- RemoteFull-time
- Salary
- $228K – $285K / yr
- Field
- Data Science & Analytics
About the job
This position sits within Nebius Token Factory, our serverless platform for running and customizing open-source LLMs in production. Token Factory allows for serverless inference and fine-tuning backed by in-house optimizations like custom speculative decoding, quantization, cache-aware routing and dedicated endpoints. Customers come to us to move from prototype to scaled production without the cost and complexity of building and tuning their own inference stack. Our…
Listed on Himalayas. Full description and application there.
View on Himalayas