Actually "Add/Remove" does delete registry keys... just not those added by third-party software, such as the server-list patch.
And because those keys were still present the Jazz Jackrabbit-installer complained about a "newer version".