Your toyota will be maxed out for weight and underpowered.
IMHO a respectable V8 (ok ford guys---maybe a turbo 6), 1/2 ton truck is where you would want to be.
Of course I see that the 3/4 ton crowd, and a 1/2 ton owner who used half the payload for a cap, have already spoken up. I am sure the 1 ton, dually crowd will be spewing diesel comments any minute now.
EDIT:
As I have previously mentioned, I pulled our KZ Sportsment Classic 170 (19'--3500 gvwr) with a V6 Dakota when I first bought it. Put me at about 85% of tow capacity, but maxed me at payload (900 ish) with just the dog in the bed. I have pulled trailers all my life, was prepared for the wiggles I would get (even with WDH/anti-sway), and the lack of performance. As an experienced truck driver---I was not afraid to go fast down hill, in an effort to GO GO GO up the next hill.
I sure am glad the wife let me buy a Ram (16?? payload) with HEMI.
Let me also add that the opinions on here will differ---often based on what people take with them. For me, a "LOADED" trailer is my payload with the exception of a couple of Kayaks, the wife and dog.
I think many people make the mistake of thinking they can pull a trailer AND load the bed. A trailer IS the load. If you are taking the kitchen sink-----you may need a 1 ton.
Like NEED-A-VACATION said: "As mentioned, the payload of your truck is the limiting factor. All passengers, cargo (coolers, firewood, chairs, etc), any accessories added after it was built, the wdh, and the tw all add toward the payload of a vehicle."