So I've always identified as somewhere inbetween male and agender/androgynous. Is there a word for feeling somewhere in between or those two or just what it would be considered?
Demiboy? Someone who partially, but not wholly identifies as a boy regardless of their assigned gender at birth. Demiguy - Gender Wiki
Demiboy definitely describes that, but if you don't like the word (I personally don't; I feel like in a few years I'm not gonna want to be still calling myself a "boy") you could also just call yourself transmasculine. It's an umbrella term but can be used as a more specific identity essentially meaning trans in a male direction but not completely male.