They are not factually wrong becuase their opinion does not match the popular opinion. They are factually wrong because their opinion does not align with the fact that the holocaust was not only about exterminating jews.
How can an opinion be “factually wrong?”
If I formed the opinion that the third Reich did not want to exterminate disabled people as part of the holocaust that would be factually wrong. That’s how facts and opinions work.