It sounds like you have a really supportive doc (and husband) . . . that's great! I remember telling my ob (or rather her nurse) that I thought my luteal phase was on the short side, but I didn't get much of a response.
Also, I definitely don't think you're selfish for wanting to spend the summer with Miles (non-prego). Just the opposite (unselfish) as you want to give him your undivided attention. I can also totally relate to feeling like your body is back to being "yours"!! This summer I can finally wear shorts without elastic
Anyway, I guess I haven't really offered up any advice (sorry!). Just wanted to empathize -- hope you and the hubby can come to an agreement. Keep us posted.