I thought the same and starting trying out Window Managers. Until after a few installations/deinstallations I started getting conflicts and wasted a full weekend just getting back to a working system. Now I simply live with whatever my distros put on my desktops unless it got real stopper-bugs that prevent me from working. I guess the positive side is that I learn some new WM now regularly (a little more often this year than I'd hoped for maybe).