Thats not an analogue control its showing joystick/gamepad input. The buttons being pressed are digital input. If the buttons are showing as permanently on in the Windows CP config then its not mame and likely an issue with the Gamepad or gamepad drivers.
You need to enable mouse control in the Mame ini (or default game options in MameUI) to use a mouse or similar analogue control as a trackball.