The point about GPU’s is pretty dumb, you can rent a stack of A100 pretty cheaply for a few hours. I have done it a few times now, on runpod it’s 0.79 USD per HR per A100.
On the other hand the freely available models are really great and there hasn’t been a need for the closed source ones for me personally.