Not sure about the US, but a lot of former soviet countries are virulently homophobic, despite high levels of atheism.
China and Japan are also quite homophobic too, despite something like 80% of the population being atheist.
Closer to home, the UK has far more atheists (google suggests almost twice as many) than the US, but is also TERF central with plenty of homophobia and transphobia.