You will hear a LOT of negative responses to this plan as you have already noticed. I say go for whatever you want to do in life. If this is what you feel is best then do it. Only you can decide what works for you. Lots of people will say it's tight quarters and it can be, but definitely doable. Thousands upon thousands do it without killing each other.
I would also do whatever it took to keep my pets. Just the way it is. Good luck and come back here for ideas.
It's not as hard as people make it out to be. Lots of sky is falling people in this world and on this forum.
And thankyou Paisley and Coleman for actually answering the question without telling them they're crazy. Some people actually want to help and not discourage.