It's not too hard to do, but if you aren't familiar with the electrical system in an RV, it might be better left to the pros.
There are troubleshooting techniques you can use to isolate the converter, and safety practices you must follow when replacing. The most important safety instruction is to disconnect from shore power and disconnect the battery before you start to remove it.
If you have some basic mechanical and electrical skills, it's fairly straight forward. Disconnect from the 120VAC and 12VDC sources. Remove the screws holding the converter in the housing. Pull the converter out, and disconnect the 120V and 12V wires. Take a picture of the wiring before you disconnect it so you'll know how it goes back together. Install the new converter and reconnect everything.
FWIW - The last time my converter went out, the primary symptom was the lights getting dimmer and brighter which are the exact same symptoms you are describing.