Will feel good for me?

Me and my boyfriend have only had a few times. He's fingered me before(which doesn't do anything for me either), and it doesn't hurt, but when we have it doesn't feel good. Like I can feel him a little, but its not much. I've only had sex twice, but I'm worried it won't ever be much better.