Make a pound cake (or some sort of white, plain cake), and put a few leaves in the bottom of the cake pan before pouring in the batter. Maybe grate some lemon zest into the batter as well. Or cupcakes, one leaf per cup. They also make a soothing before bed tea - large handful to a teapot, covered with boiling water. Make some apple jelly, and add a leaf to each jar. Dry the leaves, crush them, and sprinkle on the carpet before vacuuming. They'll get sucked up into the vacuum bag, and make the job smell a little lemony.
I've never used the flowers, but I don't see why you couldn't. I think a bit of lemon might be very nice with chevre. I would not use the leaves in anything where they can't be taken out before eating, as they are tough. But you could steep them in hot milk intended for a pudding, like you might do with a vanilla bean.
I envy you your little bouquet; my lemon verbena bush died over the winter
Make soap with it! People love lemon verbena scent so I bet if you infused it in olive oil it'd make a lovely bar with the dried herbs added for texture.