I like the concept of marigold and chocolate together, but not with the orange. I think it would be way too much with the gold. I do think its really going to really depend on how you are going to incorporate all of these colors into a wedding. If I used orange, then gold would have to go and the same with choosing gold then orange is gone. This is ultimate your decision either way.
I think it really depends on the amount in which you use them. The orange and gold could be harsh, but I like the ivory, chocolate, and gold a lot.