I do that sometimes. Nothing strange about it. I think it immerses me as well, too.
One significant memory I have of something like this is when I read the Percy Jackson book series.
I imagined the female lead as looking like a child I saw on the cover of a picture book. It was quite weird to...