GPU Infrastructure Engineer
Posted 7 days ago
With Pro, from $2.99 a week: AI tailors your resume to this job, drafts the cover letter and lists the keywords you are missing, in about 30 seconds.
Who can apply
Canada only
Salary
CA$150K–190K
Per year, CAD
Level
Mid level
Full-time
Timezone
UTC -7 to -6 to -5 to -4 to -3
About the role
About PolarGrid
PolarGrid is an early-stage Canadian company that runs managed AI inference. A customer brings a model or a serving image. We run it on dedicated GPUs behind one endpoint, serve each request from the nearest site, and move traffic to the next nearest site when one fails.
Our goal is to make AI inference fast, reliable, and secure for customers running production workloads.
The Role
This role is responsible for scaling PolarGrid's inference network from a handful of sites to a geographically distributed fleet of GPU clusters. The GPU Infrastructure Engineer will own how new sites and nodes come online, from provisioning and burn-in through validation and a staged move into production. They will define when a site is ready for customer traffic, and make sure each new site joins the network without hurting latency or reliability.
A core responsibility is running the global routing layer that sends each request to the best place to serve it. The GPU Infrastructure Engineer will work with live signals such as network latency, capacity and health, and tune routing against real traffic to keep latency low and predictable.
The role also owns reliability across the network. The GPU Infrastructure Engineer will set and track availability targets, build the health checks and automation that detect and route around failing hardware and models, keep recovery fast, and test failure handling regularly.
The GPU Infrastructure Engineer will build the observability, release and network systems needed to run a distributed GPU fleet without operations work growing with every new site. This includes end-to-end tracing and latency alerting, safe staged rollouts, network configuration as code, and security and DDoS protection at the edge.
Requirements
- Experience operating distributed systems across multiple sites or regions with high availability targets
- Strong networking fundamentals: BGP, DNS, TCP/TLS and load balancing
- Hands-on experience running bare-metal GPU fleets: provisioning, burn-in, firmware and node lifecycle
- InfiniBand or RDMA networking experience
- Experience running LLM inference engines such as vLLM, SGLang or TensorRT-LLM, including multi-node serving, cold starts and TTFT
- Deep observability skills focused on p95/p99 latency and gray failures, not just uptime
- Experience designing failover, graceful degradation and automated recovery
- Strong automation and infrastructure-as-code mindset, including CI/CD for infrastructure
- Ability to plan capacity on constrained, uneven hardware supply
- Experience building internal tooling or control planes, ideally in Go or Rust
Nice to Have
- DDoS mitigation experience
- Running DNS infrastructure at scale
- Hardware security: TPM, measured boot or confidential computing
- Real-time streaming inference, including voice and audio
- Operating remote datacenter sites with on-site technicians
- Certificate automation across many domains
- Deterministic simulation testing
Originally posted on Himalayas
Interested in this role?
You apply directly with the listing source. Remotavia never charges candidates.
Apply to Polargrid with AI in about 30 seconds
Your resume rewritten for this job, a cover letter, the interview questions to expect and the keywords you are missing. With Pro, from $2.99 for a week.
Keyword matchCover letterInterview questions
Check your resume
See which keywords from this job your resume is missing.
Track this application
Add it to your board and get a follow-up reminder.
Draft a cover letter
An honest first draft from your resume and this job.
Prepare for interviews
Likely questions based on this job description.
About Polargrid
Listing details & historyShowHide
- Employer posted
- 11 Nov 2026
- Last confirmed open
- Not yet confirmed
- Source
- Job board
- Degree
- Not mentioned
- Visa
- Not stated
- Timezone
- Not stated
- Languages
- Not stated
- Location evidence
- “Remote — Canada”
Details are read from the listing text. They are not a guarantee of work authorization; confirm with the employer.
History
- 11 Nov · Added to Remotavia