About the role
P-1592
At Databricks, we are passionate about enabling data and AI teams to solve the world's toughest problems, from making the next mode of transportation a reality to accelerating medical breakthroughs. We do this by building and running the world's best data and AI infrastructure platform so our customers can use deep data insights to improve their business. Founded by engineers, and customer obsessed, we leap at every opportunity to solve technical challenges, from designing next-gen UI/UX for interfacing with data to scaling our services and infrastructure across millions of virtual machines. And we're only getting started.
As part of the Unity AI Gateway team, you'll build the control plane that every AI request at Databricks passes through: partner and self-hosted models, agents, coding assistants, and MCP servers. It enforces budgets, routes each request to the right model, and applies guardrails inline. Unity AI Gateway is one of our fastest-growing businesses, moving trillions of tokens per week for thousands of customers.
The impact you will have
- Build the routing layer that picks the right model for each request across quality, cost, latency, availability, and remaining budget
- Improve reliability, latency, and efficiency of distributed AI workloads
- Collaborate with research, platform, infra, and AI/ML teams to deliver seamless end-to-end experiences
- Shape how developers and data scientists build and interact with AI on Databricks
What we look for
- 8+ years of experience in backend or infrastructure engineering
- Strong programming skills in Scala, or Go
- Experience with distributed systems, high-throughput APIs, or cloud-native infrastructure
- Familiarity with service-oriented architecture, deployment pipelines, and system observability
- Strong product and ownership mindset. You care about building the right solution, not just any solution
Bonus points for
- Experience with real-time serving, AI infrastructure, or GPU orchestration
- Exposure to platforms like Bedrock, Vertex AI, or Azure ML
- Experience building developer platforms or internal tools supporting AI workflows
Pay Range Transparency
Databricks is committed to fair and equitable compensation practices. The pay range(s) for this role is listed below and represents the expected salary range for non-commissionable roles or on-target earnings for commissionable roles. Actual compensation packages are based on several factors that are unique to each candidate, including but not limited to job-related skills, depth of experience, relevant certifications and training, and specific work location. Based on the factors above, Databricks anticipates utilizing the full width of the range. The total compensation package for this position may also include eligibility for annual performance bonus, equity, and the benefits listed above. For more information regarding which range your location is in visit our page here.