Proper cleanup of the federation control plane is not fully implemented in this beta release of Kubefed. However, for the time being, deleting the federation system namespace should remove all the resources except the persistent storage volume dynamically provisioned for the federation control plane's etcd. You can delete the federation namespace by running the following command:
> kubectl delete ns federation-system