ML Systems Engineer
- £100000 - £110000 per annum
- London
- Permanent
ML Systems Engineer
Distributed AI | Machine Learning Infrastructure | Edge Computing
London (2 days per week in office)
AI Startup
£100,000-£110,000 DOE + Bonus
Skills: Python, MLops, Pytorch, Grafana, Elastic Search, TensorRT
The Opportunity
An exciting opportunity to join a fast-growing AI technology business developing advanced machine learning solutions for complex, real-world environments.
The company is building a distributed AI platform that enables machine learning models to operate directly within physical infrastructure, rather than relying solely on centralised cloud environments. Its technology focuses on improving operational efficiency, enabling intelligent decision-making and supporting more sustainable infrastructure.
As an ML Systems Engineer, you'll join a specialist team responsible for building the infrastructure that allows AI models to be trained, deployed, monitored and continuously improved across multiple distributed environments.
The Role
You'll take ownership of the systems engineering behind production ML workloads, ensuring models run reliably and efficiently across heterogeneous, resource-constrained hardware.
Working closely with Applied Scientists and Research Engineers, you'll bridge the gap between research and production, building the infrastructure, deployment workflows and experimentation environments needed to take new algorithms from concept through to real-world application.
Key Responsibilities
- Design and manage workload scheduling, resource allocation and isolation across multiple concurrent ML applications.
- Own model deployment and lifecycle management, including versioning, updates, monitoring, rollbacks and fleet-wide consistency.
- Build automated deployment pipelines, staged releases and testing environments.
- Develop distributed training and fine-tuning infrastructure, including orchestration, checkpointing and recovery.
- Profile and optimise model inference across different hardware environments, including GPU and LLM workloads.
- Build monitoring, alerting and observability solutions using tools such as Grafana and the Elastic Stack.
- Develop reliable telemetry and data pipelines to support machine learning, analytics and model performance.
- Troubleshoot complex issues across infrastructure, software and ML systems.
- Work closely with research teams to accelerate experimentation and improve engineering standards.
What We're Looking For
- Strong software engineering fundamentals and excellent Python skills.
- Experience building and operating production machine learning systems, from training and data pipelines through to deployment and monitoring.
- Solid distributed systems knowledge, particularly around reliability, state management and version control.
- Experience managing multiple workloads across shared or resource-constrained hardware.
- Understanding of model optimisation, profiling and efficient inference.
- Strong knowledge of PyTorch or similar ML frameworks, including distributed training and checkpointing.
- Experience with monitoring and observability tools such as Grafana, Prometheus or the Elastic Stack.
- A hands-on engineer who enjoys solving complex technical problems and working closely with research and engineering teams.
Desirable Experience
Experience in one or more of the following would be beneficial:
- Reinforcement learning infrastructure (Ray, RLlib) or control systems.
- LLM deployment and inference optimisation (vLLM, llama.cpp, ONNX, TensorRT).
- Federated learning, transfer learning or distributed machine learning.
- Edge computing, on-premise GPU infrastructure or hardware-constrained environments.
- Device orchestration, remote deployment and fleet management.
- Simulation environments and virtualised testing infrastructure.
- Streaming and telemetry technologies such as Kafka or MQTT.
- Operating AI systems within critical or regulated infrastructure.
Why Join?
- Work on genuinely challenging problems at the intersection of AI, software engineering and distributed systems.
- Play a key role in taking advanced machine learning research into production.
- Join an ambitious, well-backed technology business at an exciting stage of growth.
- Work alongside talented Applied Scientists, Research Engineers and infrastructure specialists.
- Take ownership of systems and architecture with the opportunity to make a significant technical impact.
- Contribute to technology with real-world applications across large-scale physical infrastructure and sustainability.