Super late update but I ended up fixing my problem. Also posting to help out anyone with possibly the same issue they're having.
It turned out to be my motor mounts. I've inspected the bushing itself on the motor mounts and it was in great condition. A couple of weeks go by and I decide to go under my car again. I noticed a hairline crack at the base of the mount, what holds it all together. It was so easy to miss, I am glad I found the problem and replaced the mounts with some solid Z1 mounts
, they work great and the car feels brand new.
Picture of my motor mounts:
https://imgur.com/a/SQdXmjo