brake magnet making noise

Hi I put a new brake magnet on one of my hubs, the problem is when i hit the brake controller the tire stops but when the controller is released I can hear the magnet release (clinking noise) I do not...