Hmmm....
Double Stroller... I'd check all consignment stores for this. There are SO many moms (like me!) who bought a stroller and NEVER used it and are giving them to Goodwill, 2nd hand baby stores, craigslist, etc. And you have awhile to keep your eye out... as a lot of double stroller aren't really good for NEWnewborns anyway (don't lie flat, etc).
Carseat... For me personally, if I did NOT have THE safest one available, there would be no compromise. Fortunately, we DO have the Graco Snugride from DS (and I could care less about what color it is, my DS has a purple diaper that's leak proof that he wears EVERY day) (uh, cloth! LOL). I'll use it until he grows out of it or until he grows into a Britax Boulevard, and then I'll get another Boulevard.
Bouncy seat... again, craigslist, second hand stores... wherever. I'll have to agree with your DH on this one

as I found it to be on my Top Five Biggest Space Wasters... but I KNOW that some moms out there just "couldn't have lived" w/o theirs.
Here's a good one for the stroller/bouncy seat situation. Don't get it. And let him realize the inconvenience. IE, if you don't want to hold the baby or can't, make HIM hold her... and when he's looking for a place to put her down, start in on the vibrating bouncy seat. When you're out in public with NO stroller and both kids... well, let him hold one and chase the other! I'm sure he'll scoop around to the baby section by the end of THAT trip!