Skip to content
Remotavia
Polargrid

GPU Infrastructure Engineer

Remote in set countriesCanada onlyCA$150K–190KFull-time

Posted 7 days ago

With Pro, from $2.99 a week: AI tailors your resume to this job, drafts the cover letter and lists the keywords you are missing, in about 30 seconds.

Who can apply

Canada only

Salary

CA$150K–190K

Per year, CAD

Level

Mid level

Full-time

Timezone

UTC -7 to -6 to -5 to -4 to -3

About the role

About PolarGrid

PolarGrid is an early-stage Canadian company that runs managed AI inference. A customer brings a model or a serving image. We run it on dedicated GPUs behind one endpoint, serve each request from the nearest site, and move traffic to the next nearest site when one fails.

Our goal is to make AI inference fast, reliable, and secure for customers running production workloads.

The Role

This role is responsible for scaling PolarGrid's inference network from a handful of sites to a geographically distributed fleet of GPU clusters. The GPU Infrastructure Engineer will own how new sites and nodes come online, from provisioning and burn-in through validation and a staged move into production. They will define when a site is ready for customer traffic, and make sure each new site joins the network without hurting latency or reliability.

A core responsibility is running the global routing layer that sends each request to the best place to serve it. The GPU Infrastructure Engineer will work with live signals such as network latency, capacity and health, and tune routing against real traffic to keep latency low and predictable.

The role also owns reliability across the network. The GPU Infrastructure Engineer will set and track availability targets, build the health checks and automation that detect and route around failing hardware and models, keep recovery fast, and test failure handling regularly.

The GPU Infrastructure Engineer will build the observability, release and network systems needed to run a distributed GPU fleet without operations work growing with every new site. This includes end-to-end tracing and latency alerting, safe staged rollouts, network configuration as code, and security and DDoS protection at the edge.

Requirements

  • Experience operating distributed systems across multiple sites or regions with high availability targets
  • Strong networking fundamentals: BGP, DNS, TCP/TLS and load balancing
  • Hands-on experience running bare-metal GPU fleets: provisioning, burn-in, firmware and node lifecycle
  • InfiniBand or RDMA networking experience
  • Experience running LLM inference engines such as vLLM, SGLang or TensorRT-LLM, including multi-node serving, cold starts and TTFT
  • Deep observability skills focused on p95/p99 latency and gray failures, not just uptime
  • Experience designing failover, graceful degradation and automated recovery
  • Strong automation and infrastructure-as-code mindset, including CI/CD for infrastructure
  • Ability to plan capacity on constrained, uneven hardware supply
  • Experience building internal tooling or control planes, ideally in Go or Rust

Nice to Have

- DDoS mitigation experience

- Running DNS infrastructure at scale

  • Hardware security: TPM, measured boot or confidential computing
  • Real-time streaming inference, including voice and audio
  • Operating remote datacenter sites with on-site technicians
  • Certificate automation across many domains

- Deterministic simulation testing

Originally posted on Himalayas

Interested in this role?

You apply directly with the listing source. Remotavia never charges candidates.

Apply to Polargrid with AI in about 30 seconds

Your resume rewritten for this job, a cover letter, the interview questions to expect and the keywords you are missing. With Pro, from $2.99 for a week.

Keyword matchCover letterInterview questions

Prepare my application

Check your resume

See which keywords from this job your resume is missing.

Track this application

Add it to your board and get a follow-up reminder.

Draft a cover letter

An honest first draft from your resume and this job.

Prepare for interviews

Likely questions based on this job description.

Listing details & historyShow
Employer posted
11 Nov 2026
Last confirmed open
Not yet confirmed
Source
Job board
Degree
Not mentioned
Visa
Not stated
Timezone
Not stated
Languages
Not stated
Location evidence
“Remote — Canada”

Details are read from the listing text. They are not a guarantee of work authorization; confirm with the employer.

History

  • 11 Nov · Added to Remotavia

Similar remote jobs

See more