Logo Spotify

Machine Learning Engineering Manager - LLM Serving & Infrastructure

Spotifyvia Jobgether
RemotoRemotoSêniorCLT4 dias atrás

Salário Estimado

R$ 14.681,00 - R$ 20.972,00

0de 100

Regular

Score da Vaga

Descrição da Vaga

This a Full Remote job, the offer is available from: Massachusetts (USA), New York (USA) The Personalization team makes deciding what to play next on Spotify easier and more enjoyable for every listener.


We seek to understand the world of music and podcasts better than anyone else so that we can make great recommendations to every individual and keep the world listening.


Every day, hundreds of millions of people all over the world use the products we build which include destinations like Home and Search, original playlists like Discover Weekly and Daylist, and are at the forefront of new innovations like AI DJ and AI Playlists.


Generative AI is transforming Spotify’s product capabilities and technical architecture.


Generative recommender systems, agent frameworks, and LLMs present huge opportunities for our products to serve more user needs and use cases and unlock richer understanding of our content and users.


This ML Manager will focus on the serving of a Unified Recommender model, based on open-weight LLM and transformer technology.


You will collaborate with a diverse team to establish and implement the machine learning plan for the product domain, developing innovative recommendations and agent interactions.


You will work as a technology leader, managing a team and influencing peers.


You will collaborate with internal customers and platform teams, offering the opportunity to profoundly build the direction of the entire Spotify experience.


Join us and you’ll keep millions of users listening and engaging with our platform every day! What You’ll Do• Lead a high-performing engineering team to develop, build, and deploy a high-scale, low-latency LLM Serving Infrastructure.

Drive the implementation of a unified serving layer to support multiple LLM models and inference types (batch, offline eval flows and real-time/streaming). • Lead all aspects of the development of the Model Registry for deploying, versioning, and running LLMs across production environments.
Ensure successful integration with the core Personalization and Recommendation systems to deliver LLM-powered features. • Define and champion standardized technical interfaces and protocols for efficient model deployment and scaling.
Establish and monitor the serving infrastructure's performance, cost, and reliability, including load balancing, autoscaling, and failure recovery. • Collaborate closely with data science, machine learning research, and feature teams (Autoplay, Home, Search, etc.) to drive the active adoption of the serving infrastructure.
Scale up the serving architecture to handle hundreds of millions of users and high-volume inference requests for internal domain-specific LLMs. • Drive Latency and Cost Optimization: partner with SRE and ML teams to implement techniques like quantization, pruning, and efficient batching to minimize serving latency and cloud compute costs.
Develop Observability and Monitoring: build dashboards and alerting for service health, tracing, A/B test traffic, and latency trends to ensure consistency to defined SLAs. • Contribute to Core LPM Serving: focus on the technical strategy for deploying and maintaining the core Large Personalization Model (LPM).

Who You Are• 5+ years of experience in software or machine learning engineering, with 2+ years of experience managing an engineering team.

Hands-on with ML Engineering: you have deep expertise in building, scaling, and governing high-quality ML systems and datasets, including defining data schemas, handling data lineage, and implementing data validation pipelines (e.g., HuggingFace datasets library or similar internal systems). • Deep technical background in building and operating large-scale, high-velocity Machine Learning/MLOps infrastructure, ideally for personalization, recommendation, or Large Language Models (LLMs).
Proven track record to drive complex projects involving multiple partners and federated contribution models ("one source of truth, many contributors"). • Expertise in designing robust, loosely coupled systems with clean APIs and clear separation of concerns (e.g., distinguishing between fast dev-time tools and rigorous production-like systems).
Experience integrating evaluation and testing into continuous integration/continuous deployment (CI/CD) pipelines to enable rapid 'fork-evaluate-merge' developer workflows. • Solid understanding of experiment tracking and results visualization platforms (e.g., MLFlow, custom UIs).
A pragmatic leader who can balance the need for speed with progressive rigor and production fidelity.

Where You’ll Be• This role is based in New York or Boston.

We offer you the flexibility to work where you work best! There will be some in person meetings, but still allows for flexibility to work from home.

The United States base range for this position is $176,166- $251,666 plus equity.


The benefits available for this position include health insurance, six month paid parental leave, 401(k) retirement plan, monthly meal allowance, 23 paid days off, 13 paid flexible holidays, paid sick leave.


These ranges may be modified in the future.


Spotify is an equal opportunity employer.


You are welcome at Spotify for who you are, no matter where you come from, what you look like, or what’s playing in your headphones.


Our platform is for everyone, and so is our workplace.


The more voices we have represented and amplified in our business, the more we will all thrive, contribute, and be forward-thinking! So bring us your personal experience, your perspectives, and your background.


It’s in our differences that we will find the power to keep revolutionizing the way the world listens.


At Spotify, we are passionate about inclusivity and making sure our entire recruitment process is accessible to everyone.


We have ways to request reasonable accommodations during the interview process and help assist in what you need.


If you need accommodations at any stage of the application or interview process, please let us know - we’re here to support you in any way we can.


Spotify transformed music listening forever when we launched in 2008.


Our mission is to unlock the potential of human creativity by giving a million creative artists the opportunity to live off their art and billions of fans the chance to enjoy and be passionate about these creators.


Everything we do is driven by our love for music and podcasting.


Today, we are the world’s most popular audio streaming subscription service.


This offer from "Spotify" has been enriched by Jobgether.com and got a 82% flex score.

Vagas Semelhantes

Logo CareOregon

IS Data Engineer

CareOregonLinkedIn
RemotoRemotoOntem

R$ 16k - 25k/mês

SêniorCLT

The IS Data Engineer plays a pivotal role in operationalizing and advancing data and analytics for CareOregon’s business initiatives. This involves building, managing and optimizing data pipelines and moving them effectively into production for data and analytics consumers. Consumers include busines...

RemotoRemoto6 dias atrás

R$ 14k - 24k/mês

SêniorCLT

AnacondaBe at the center of AI Anaconda is built to advance AI with open source at scale, giving builders and organizations the confidence to increase productivity, and save time, spend and risk associated with open source. 95% of the Fortune 500 including Panasonic, AmTrust, Booz Allen Hamilton and...

RemotoSan Francisco, California, Us8 dias atrás

R$ 15k - 23k/mês

SêniorCLT

the Role We’re looking for a motivated Entry-Level Python / AI Engineer to join our growing engineering team in San Francisco. This role is ideal for recent graduates or early-career engineers who are passionate about Python, machine learning, and building real-world AI-driven products. You’ll work ...

Competitive base salary up to $150,000Mentorship from experienced AI and software engineersOpportunity to work on cutting-edge AI products
RemotoBoston, Massachusetts, Us12 dias atrás

R$ 13k - 19k/mês

SêniorCLT

Insight Global is seeking an LLM Engineer to join our clients dynamic development team. This role is sitting remotely in India. This individual will enhance and expand a complex application, requiring strong communication skills and full-stack technical expertise. This role involves collaborating wi...

$15.00/hr to $20.00/hrExact compensation may vary based on several factors, including skills, experience, and education

Interessado nesta vaga?

Candidatar-se

Você será redirecionado para o site original

Informações

NívelSênior
ContratoCLT
LocalRemoto
RemotoSim
MoedaBRL
Publicada4 dias atrás
FonteJobgether

Análise de Vaga com IA

Estimativa salarial, match de tecnologias e análise de requisitos feitos com Inteligência Artificial

Powered by CodeCortex
← Voltar às Vagas