I think part of it was the ref giving it back for not calling the prior penalties. A few points:
1 - There were potentially 3 penalties that could have been called. The one that was, was a penalty. The retake was suspect.
2 - The red card was a red card. Even if it wasn't a red card, it would have been a yellow which would have been a red card.
3 - Our defense was good - we did make a few mistakes but overall, France was relying on penalty calls to score. Think about that, a team which pummeled the Netherlands 4-0 had to rely on penalty calls to score on us. That's pretty impressive. And by the way, we played with 10 men.