Based on the color of the mold, I'd guess you are using Quick-Set? In my (limited) experience, Quick-Set may not be the best choice for what you are trying to accomplish. Clint suggested High-Strength III to me back when I got started - available at Hobby Lobby right next to the Quick-Set - and it has served me quite well when dealing with detail-laden masters, as its elasticity allows you to turn a mold virtually inside-out without damage. I think, given the hollow/cut-out in the chair back, you might find HSIII performs more to your liking. I'm looking at going "industrial-strength" with my stuff, so I am starting to look at Smooth-On's line of RTVs, as I already use and like their resins.
Casting - it's not just a hobby...every pour's an adventure!