You can remove it from all applications in the task manager settings here:
I am not sure there is a way to remove it from only firefox.