My whole point from the start is that, if you want to make a game, use Allegro and check SDL 'cause even if SDL is not a "just" a game dev, has almost everything you need (for making a game fast).
SDL is comparable to DirectX. It isn't as robust, but it is far more robust than Allegro.
I'm not saying not to use Allegro. It's a great library (as is ClanLib and other libraries). I'm just trying to stop the misinformation among non-programmers or new programmers who think that you should be using Allegro instead of a "real" API.
If what you're after is building a game with minimal programming but with more flexibility than a prebuilt engine, you can go with Allegro or ClanLib or whatever. Our Icarus Engine
may be made open source, so you may be able to avoid even more programming and have a far more flexible engine for work put in soon

If you're after building a flexible game engine, then you need to look at DirectX or SDL.