One thing people forget about Roe and Casey is that it was a bad decision in the first place.
Privacy about decisions in care should absolutely be a patient's right, make no mistake. The government has no business intervening in medical decisions made between competent medical professionals and their patients so long as everyone is acting in good faith and with proper consent. Including a patient seeking an abortion. The state has no sufficient interest to intervene in these decisions that justifies the profound violation of a person's liberties. In that sense, Roe is good policy that should be on the books. But it kind of never was, because it only ever really extended this specific right in the case of abortion. Which is just needlessly limited.
And it also wasn't really protecting the right to autonomy over your own body through access to abortion or otherwise. It was instead just forcibly shoving some abortions under the umbrella of this limited, incomplete right to privacy in medical decisions, with a bunch of huge loopholes formalized. In spite of what people say, there was factually no Constitutional right to an abortion under Roe. The Constitutional protection you had was one that just made it impossible in practice for the government to stop the abortions from happening, but it did so in a weak and circuitous way that, as we saw, was easy to undo.
So while the practical effect was a more just society, the reality of the decision was that it failed to truly fulfill either of its promises.
So yeah, I understand why a serious advocate for both body autonomy rights and for privacy rights would not be super stoked to merely restore Roe. In a vacuum, you really would want to separately and clearly protect both of these right formally and resiliently. But I also all but guarantee that nearly all of those "abortion rights" groups' members, if push came to shove and this was going to vote as a ballot measure or some such, would turn out and vote for it.
Good on them for pushing for more. But the advocates saying they are in a hurry to get this fixed are also right; every minute the right is missing from the state normalizes this flagrant violation of individual liberties and makes it harder to restore rights to their citizens.