A key advantage to installing packages with pip rather than directly invoking setup.py of the source distribution is that pip knows how to uninstall packages. Simply use the uninstall subcommand:

(test_env) $ pip uninstall palindrome-1.0.zip
Uninstalling palindrome-1.0:
Proceed (y/n)? y
Successfully uninstalled palindrome-1.0