Hi ckuehner
Have you considered using python? Maybe with the module python VISA https://github.com/hgrecco/pyvisa or pygame http://www.pygame.org/news.html , both of them have libraries for USB controller, specially the pygame that have a joystick module http://www.pygame.org/news.html. In case you decide to try this, I’d suggest you to check this post to know how to install python modules with opkg https://communities.intel.com/thread/52633 . Let me know if this work for you.
Regards,
JPMontero_Intel