Try your best to have a good time in spite of it? Not ideal like, but I know the type of person who doesn't want their personal decisions to impact anyone else having a good time.
If you compared it to drinking or green, I would probably not if my friend told me he had packed it in. Half of doing something like that with someone is the fun of doing it together.