I agree that the evolution of Google's photo cloud is sometimes a mystery. But I still find it meets my needs especially as I use it more.
As stated, captions are available using the "i" icon.
Albums (collections) cannot be sorted (yet) as you want, but a simple Ctrl-F search easily finds the one I want based on the title.
Picasa can still be used for managing photos on a PC, then upload those you want to the cloud from Picasa.
I have a Photobucket account, but seldom use it as I find Google Photos more to my liking. I am pretty sure other options would work also but it boils down to what application suite meets ones needs the best.
So far I find Google's suite is the most comprehensive and meets my needs the best, hence my preference for Google Photos. Apple and Microsoft both have competing suites, but at more cost and as far as I can tell not with more function. They just have different user interfaces and in both cases even more lock-in then with Google.