I had the same issue with my 320d manual when I first bought it.
There's only 25000 miles on the clock, I didn't think there could be a problem.
Took it to my dealership who did find the clutch was worn, it was replaced under warranty. New one seems much better and feels much better to use.
I would pop to your local dealership, see what they say.