You may not even need to be running your Font Server. You only need to run it if you want a remote X terminal to be able to use fonts from your system, or if you want to use fonts that your X server doesn't understand. It can be disabled by modifying your start up scripts.
Before you do that though, issue the command, as root, "service xfs stop" And see how your apps run without it.