it feels like i have to let them go but i can’t

You can do anything (law friendly) that you really want. You don't have to let them go if you don't want it, just because you feel like so. You don't have to stay with them, if you don't want it, because you're feelings tells you to not do something! I stik with that way of thinking