Any person to whom such permission shall be given as aforesaid, shall cause all such building material and all the rubbish arising therefrom, to be removed from the street, as soon as said building is completed, and shall leave the street in as good condition as when first occupied for such purpose.