It seems to work after comparing my .config with Andreas Baer's and also setting USB Support to "built-in" and not "module". Somehow the modules are unloaded or whatever. It seems to work now. hopefully it will last...