Properly remove all config for a deleted branch