Contractors have been booed by crowds as they removed Banksy's latest artwork on the same day it was put up.