Maxair fan demise?

We have a maxair fan up over the bed. Recently it stopped working while turned on. I turned it off and removed the fuse. It was hot enough to burn my fingers. I took down the screen and tried to spin it by hand and it spins easily. I cleaned the screen and replaced it and put the fuse back in - same thing. It runs for a minute or so and then slows and stops. Then I discovered that if I hold the black fuse cap all the way up all is good. It works fine, but when I let go the fuse comes out about 1/8" against a spring and slows and stops along with heating up the fuse.

I can't see any way to replace the fuseholder. Can I just put a little ball of aluminum foil in the cap so the fuse fits tighter? I think that would work but would it be safe?

It is the correct 4A fuse. This is original to the rig and never a problem before.