Rosemary and citrus go well together, very often in savory dishes but both can play to the sweet too. Rosemary and lemon was Napoleon's signature scent he had custom compounded. Sure, vanilla sugar is good too but it won't give you the contrast to make the citrus pop as we're taking about. You likely won't replace all the sugar with rosemary sugar.
8/20/16 at 12:44pm