Tear the loaf of French bread into bite-sized pieces and let it sit out to become slightly stale.
In a large mixing bowl, combine the eggs, sugar, milk, heavy cream, and vanilla. Whisk until well blended. Optionally, add orange zest.
Gently fold in the torn pieces of bread into the custard mixture and let sit for 15-20 minutes.
Preheat your oven to 350°F (175°C).
Transfer the soaked bread mixture into a greased baking dish and bake for about 60 minutes until golden brown.
In a saucepan over medium heat, combine sugar with milk or cream, bring to a gentle simmer, stir in vanilla extract, and let thicken.
Allow the pudding to cool for a few minutes before serving. Drizzle with vanilla sauce just before serving.