How high are your revs at idle? It sounds more like the car is trying to drive rather than the gearbox clunking against the transmission tunnel.