Happened on several other vehicles, including my ur-Quattro.
The starter solenoid was the culprit, only when warm (heat soak from the engine/exhaust), resultng in the starter simply sticking.
Good clean and a little lube worked well.
Pain on the V8 is getting at the top bolt which comes in from the transmission side, accessed over the driveshaft.