@KiiwiWasTaken For me, you aren't kicked because of using an Xbox controller but because of the client command overflow error.
This affects some players recently, especially with a bad connection or network issues.
To solve the issue, you can follow these recommendations given by Plutonium admins on this topic (https://forum.plutonium.pw/topic/7614/error-client-command-overflow).