I have never seen anyone trying to 'hoard' literal garbage.
motorsports racing is quite athletic, I agree. but for the large part, most riders and drivers of performance cars are indeed sitting and turning a wheel. i say this as a motorbike rider and performance car owner myself!
next time someone says that, just thank them for informing you they're an idiot.