Didn’t know I couldn’t have an HSA… what happens to the funds?

I started a new job 8/2023 with a PPO. I signed up for the HSA and have contributed about $5000 into it. I am the spouse of a military retiree and have Tricare Select (though I don't use it). Reading over this forum, I've learned that I'm ineligible for an HSA due to my eligibility for Tricare. Do I lose my $5000? Can I withdraw the funds and pay tax on the income on my next taxes?