So there are a few things you can do to make it more lightweight.
I made a post about awesome Window manager Has anyone used AwesomeWM?
And there was this particular guy who said he removed certain things from runing in the background and therefore he made it even more light weight.
Just becareful not to brick your system in the process, also use a window manager instead of a DE as that uses less RAM.