When I had my first kid, I was devastated. Most of my leisure activities require immense amount of time dedicated to them (backpacking, fly fishing, hunting, distance running, etc). I thought my life was going to be over and I got into a bad depression. However, I never let my depression regarding my thoughts on this out because my wife had bad post partum. I sucked it up and took care of everything like we're supposed to.
As a man, I think its sometimes hard to have an instant connection with a baby right when they pop out of their mother. After all, we didn't carry them around for months and months with lots of ingrained biological cues and signals every hour of every day like mom does. Then after, mom breast feeds and really only has a connection with mom via that.
First child felt like an alien that had invaded my space. Over a short time, that changed. For me, at 3-4 months or so I got over my own selfishness. I really began to love being a dad. Now, my wife and kid(s) are visiting grandma and grandpa and I'm laying on the couch wishing they were here and counting the seconds when I get to see that little turd run towarda me in the airport.
I guess what I'm saying is that everything you feel is going to be normal. Take things in stride and love that baby. I'm back to doing all the things I love now that my daughter is older. I did have to give a few things up or modify them in the first few years. Now, however, backpacking, fishing, etc are much more fun because I get to teach those things to my daughter.