So with the 'fatherly' priestly role comes the ability to use a more familiar form of address? I could see that.

Yeah, I don't think I've ever addressed my actual younger brother as 'little brother', unless it was before he was born when I was a kid talking about how I was going to have a little brother. It just doesn't sound right, even though it's a factual description of our relationship.