Inferenz

Nvidia filing: AI agents could signal their compute needs ahead of time

A newly published patent application describes forecasts of upcoming model calls, tokens and GPU memory to help servers plan resources.