I only use Astro City Mini USB Arcade Stick connected to the X4 USB port which works perfectly fine during the 1st boot.D
Did you try to use a panel Joystick with a USB I/O on the X4 ? What kind of Panel Joystick did you use on X3 with this compilation .
Of course I'm using joy2key to setup the arcade stick.