Eastern Band of Cherokee opened a new casino in Murphy last fall so they will welcome your gambling visit. There probably is some musical entertainment there also.
The Georgia Mountain Fair (Hiawassee) has summer music events. You are also close enough to Smoky Mountain Center for the Performing Arts in Franklin to attend any of the performances there. If you want local music, check with the Chamber of Commerce in each town around - there are very few weekends that do not have a Volunteer FD dinner/fund raiser/music event or a church group raising money with a dinner & music. Also by then the local farmers/tailgate markets have opened and many of them have events with live music and food.
Most of the small towns in Western NC (Murphy, Bryson City, Franklin, Sylva) have a craft brewer that serves food & often has live musical entertainment.
For hiking, Murphy is close to Chattahoochee National Forest in Georgia and Nantahala National Forest in NC. Both offer thousands of miles of trail to pick from. By Memorial Day most of the Appalachian Trail through hikers are north of that area so that trail has much less traffic than early spring.
If white water interests you, Nantahala Outdoor Center can provide either: "here's your tube, there's the river" or "sign this liability waiver, put on this helmet & life vest, I will be your guide".