Toilet brush canister with replaceable head