I think any noise generated in driveline will be transmitted and felt in shift knob. You may not have wrecked anything, you just hearing things now that your senses are heightened.
If you take boot off, you can wobble the shaft and see if there is excessive play. If there was, you'd already see it under normal vibration.
TM (2020 x 1914).jpg