The flour, spice, baking soda, and salt together in a medium bowl. In a larger bowl, whisk both sugars, the egg, and oil until smooth. Add the mashed sweet potato and the yogurt to the large bowl and whisk just until incorporated. Add the dry ingredients and fold until no traces of flour remain. Pour batter into the prepared loaf pan.