I ran into that on customers vehicles a couple times. Ended up engine was missing alignment dowl pin (s). Installed new pins, problem solved.
Other things that could cause this, excessive vibration due to bad motor / tranny mounts, improper or sticking t/o bearing.
Incorrect, worn, non lubricated pilot bushing / bearing.
Worn input shaft @ pilot bearing.
Good luck.