You will architect the foundational stack for AI search, building the storage, retrieval, and indexing systems that enable agents to access knowledge at scale. This role involves moving from first-principles research to production-ready systems, ensuring that agentic workflows are fast, cheap, and capable of handling petabytes of structured information for deep research.
Back to all jobs
Learn about Jack
Infrastructure Engineer at Valyu
Information retrieval is in a renaissance, and this high-growth London startup is building the stack that makes knowledge accessible for how AI agents actually work. As an Infrastructure Engineer, you'll own the layer underneath everything—storage, retrieval, indexing, and serving—at petabyte scale. Working in Rust and Python, you will take critical systems from first-principles architecture to production-ready code in a single week. If you are a 'cracked' systems engineer who wants to build the core infrastructure for the next decade of software, this is your chance to join a lean team where the infrastructure is the product.
About this role
Role overview
About the company
Valyu is the knowledge infrastructure platform for AI agents. We help knowledge work companies transform web and proprietary information into structured, attributed context that powers reasoning, research, and decision-making. Through our search and deep research infrastructure, AI systems gain real-time access to trustworthy, domain-specific knowledge at scale. As search becomes the core primitive of AI, Valyu is building the foundation that enables agents to discover, understand, and synthesise information across thousands of sources.
What you'll do
What you will do
- Own critical infrastructure layers end-to-end, including data lakes, ingestion pipelines, and ML serving systems using Rust and Python.
- Make high-stakes architectural decisions regarding storage formats, query algorithms, and scheduling models that define long-term system performance.
- Optimize concurrency, networking, and IO at petabyte scale to drive query latency and operational costs down to the absolute minimum.
Who you are
Who this is a fit for
- A systems-focused engineer with 3+ years of experience shipping distributed systems, databases, or search infrastructure in production environments.
- Highly proficient in Rust and Python with hands-on experience operating large-scale workloads on AWS or GCP using Kubernetes and Terraform.
- A relentlessly resourceful builder who uses AI engineering tools to multiply output and possesses the "cracked" technical talent required for foundational work.
Why this role
Why this role is remarkable
- You are building the product itself; the infrastructure is the core offering that powers the next generation of AI agent workflows.
- Join a lean, high-caliber team where you have direct ownership of the stack and move from architecture to production within the same week.
- Shape the direction of information retrieval in its renaissance, working on systems-intensive challenges that most engineers never get to touch.
Jack & Jill
How Jack & Jill work together
I get to know what you’re great at, then find roles you’d never find yourself.Ok, I'll go first. I'm Jack, an AI that gets to know you on a quick call, learning what you're great at and what you want from your career. Then I help you land your dream job by finding unmissable opportunities as they come up, supporting you with applications, interview prep, and moral support.
I recruit from Jack’s network and make the intro when I spot a great match.And I'm Jill, an AI Recruiter who talks to companies to understand who they're looking to hire. Then I recruit from Jack's network, making an introduction when I spot an excellent candidate.
Meet Jack
Jack gets to know what you're great at and what you want next, then searches 15 million jobs daily and helps you discover roles at companies like this.
How does this work?
Jack’s an AI agent for job searching and career coaching. He works for you.
Jill is the AI recruiter working for the company. She recruits from Jack’s network.
If it’s a match and the company wants to meet you, they’ll make the intro. In the meantime, if you’d like, Jack will send you excellent alternatives.