The AI numbers are pretty solid. Papers published on Hugging face list training times and platform and convert that into CO2. Those will be full load for weeks/months across arrays of GPUs.
In this case, I don’t see why you’d need that kind of hardware for this application. You might be right that it’s not running at maximum load. If so, then somebody has been mis-sold the hardware. Whatever you’re doing it will be at a consistent load though. They are always doing the same thing.