Quite simple after all, even if I'm not sure to have really removed it, it doesn't appear anymore in new windows.

So what to do? Look into all your .rdf files (F3 or grep -i -r are your friends) containing the string "newsm". Then, get rid of all the XML elements directly containing the newsmonster's settings, and voilà.