As a core member of the technical staff, you will architect and optimize high-throughput inference systems for large-scale generative models. You will tackle deep technical challenges in distributed systems and hardware-software co-design, directly impacting the latency and scalability of production-grade AI services for a global developer ecosystem.
This job is no longer actively hiring. Talk to Jack to find live roles.
Member of Technical Staff: AI Systems Engineer at well-funded AI infrastructure startup
Are you passionate about the low-level mechanics that power the world's most advanced AI? This well-funded London startup is looking for an AI Systems Engineer to join their core technical staff. You'll build high-throughput inference engines and solve complex distributed systems challenges at the very edge of what's possible with generative models. If you thrive on GPU optimization and high-performance engineering, this is your chance to shape the future of AI infrastructure from the ground up.
Want to apply for this role?
C
This role is no longer actively hiring, but Jack can still help you discover similar open roles that fit.
Location
London, United Kingdom
Compensation
Not Disclosed
Company
Confidential company
Role overview
About the company
Well-funded AI infrastructure startup
What you will do
- Design and implement low-level optimizations for model inference to maximize GPU utilization and minimize token latency.
- Build robust, distributed systems capable of serving frontier models with high reliability and cost-efficiency.
- Collaborate with research teams to integrate novel architectures into production-ready inference engines and serving stacks.
Who this is a fit for
- Demonstrates deep expertise in systems programming and optimizing performance-critical software in C++ or Rust.
- Has a proven track record of working with deep learning frameworks and low-level GPU acceleration libraries.
- Possesses a strong understanding of distributed systems and the mechanics of modern large language model architectures.
Why this role is remarkable
- Work at the intersection of systems engineering and cutting-edge machine learning research to define the future of model deployment.
- Join an elite technical team backed by top-tier venture capital firms during a period of rapid infrastructure scaling.
- Influence the foundational layer of AI applications by building systems that make massive models commercially viable and performant.
How Jack & Jill work together
I get to know what you’re great at, then find roles you’d never find yourself.Ok, I'll go first. I'm Jack, an AI that gets to know you on a quick call, learning what you're great at and what you want from your career. Then I help you land your dream job by finding unmissable opportunities as they come up, supporting you with applications, interview prep, and moral support.
I recruit from Jack’s network and make the intro when I spot a great match.And I'm Jill, an AI Recruiter who talks to companies to understand who they're looking to hire. Then I recruit from Jack's network, making an introduction when I spot an excellent candidate.
Jack gets to know what you're great at and what you want next, then searches 15 million jobs daily and helps you discover roles at companies like this.
Meet Jack
What happens next?
Jack’s an AI agent for job searching and career coaching. He works for you.
Jill is the AI recruiter working for the company. She recruits from Jack’s network.
If your profile’s a match and Confidential company wants to meet, Jill will make the intro. In the meantime, Jack will send you excellent alternatives.