I have a rabbit, named Léon, knitted by my mother. I have it since I was born and it is currently living on my pillow.
I used to be quite embarassed still sleeping with him when I was a teenager, but when I turned 20, I decided I really didn't care. Some of my friends know about him and my husband is getting along with him very well. He was never bothered by the fact I sleep with Léon at nights.
I am able to sleep without it. I'm not bringing it around when I'm on weekends or holidays. But when I'm home, I'm searching for it before sleeping and when I am very tired, or especially sad and depressed, I hold him to fall asleep.
I totaly realized it's a bit weird for a 30 years old married woman, and I don't care the slightest. It doesn't hurt anyone, me included, and it's comforting me when I need to, I really don't see any reason to do otherwise.
If you're happy with your blanket, that's perfectly fine to keep it