In a large bowl, whisk together the eggs, milk, heavy cream (if using), granulated sugar, brown sugar, vanilla extract, cinnamon, nutmeg, and a pinch of salt. Pour this mixture evenly over the bread cubes, ensuring all pieces are coated. Press down with a spatula to make sure the bread soaks up the egg mixture.