You might have removed it in a wrong way. You can download the Jazz Jackrabbit uninstall aid here.

Don't forget to read the instructions!