Well I figured out what was the problem - what failed the consistency check was the game_setup.xml file that is created automatically with the new Launchpad. So I just deleted that and now it works. A really silly reason...
Okay, I opened the console when loading a game and it appears my skins are failing the consistency check. What can I do about that ? What is, essentially, the consistency check? What is it for ?