Preheat your oven to 350°F (175°C) and line two baking sheets with parchment paper.

In a mixing bowl, cream together the softened butter and granulated sugar until light and fluffy.

Add the eggs, vanilla extract, and almond extract to the butter mixture, and blend until well combined.

In another bowl, whisk together the all-purpose flour, baking powder, and salt. Gradually add this dry mixture to the wet ingredients, mixing until just combined.

If desired, divide the dough into portions and add food coloring to create different shades. Mix well until you achieve your preferred colors.

Use a cookie cutter to shape the dough, or simply scoop tablespoon-sized portions of dough onto the prepared baking sheets, spacing them about 2 inches apart.

Bake in the preheated oven for 12-15 minutes or until the edges are lightly golden.

Once baked, remove the cookies from the oven and let them cool on the baking sheets for 5 minutes before transferring them to a cooling rack.

To prepare the icing, mix the powdered sugar with milk in a small bowl until you achieve a smooth consistency. If you'd like to color the icing, add a few drops of food coloring.

Drizzle the icing over the cooled cookies and, if desired, sprinkle with festive sprinkles immediately before the icing sets.