Engineering5 min read
How We Take a GPU Back in Two Minutes Without Dropping a Request
Spot nodes promise their owners the machine back within two minutes. Doing that without cutting off inference requests mid-answer took a draining state, a fix to a heartbeat that kept undoing it, and one switch that the whole platform obeys.
Read



