Welcome to RV.net and the world or RVing!
Yes, you need to fuse it.
You only need a single pole single throw 12 volt switch.
You should be connecting both the ground and the hot to the system. The computer fans are two wire. They do not have a case acting as the ground return.
I would not use the refer circuit. I would use anew circuit or maybe a lighting circuit. Refers tend to be a little finicky when it comes to their 12 volt DC supply.
Bud
USAF Retired
Pace Arrow
2003 Chev Ice Road Tracker