Make the sponge: Preheat oven to 350°F (175°C). Line an 8x8-inch pan with parchment.
In a bowl, whisk almond flour, coconut flour, baking powder, and salt. In another bowl, beat eggs and sweetener until pale and slightly thick. Stir in melted butter and vanilla.
Fold in dry ingredients, adding almond milk if batter is too thick. Spread evenly and bake 18–22 minutes, until golden and springy. Cool completely.
Prepare the custard: In a saucepan off heat, whisk yolks, sweetener, and half the milk/cream.
Sprinkle gelatin over remaining cold milk if using; let bloom 5 minutes. Warm yolk mixture over medium-low, stirring constantly, until it thickens slightly and coats a spoon (do not boil). Remove from heat, whisk in bloomed gelatin mixture (if using), butter, and vanilla.
Strain for ultra-smooth texture. Cool to room temp, then chill until lightly set.
Whip the cream: Beat heavy cream, powdered sweetener, and vanilla to soft peaks. Don’t overwhip.
Keep chilled.
Prep the berries: Toss berries with lemon juice and a small spoon of sugar-free jam if you want a lightly glossy layer. Pat very juicy berries dry to limit excess moisture.
Cut the sponge: Slice the cooled cake into cubes. For extra flavor, you can brush them with a mix of 1 tablespoon lemon juice and 1 tablespoon water, or a splash of unsweetened almond milk with vanilla.
Assemble the trifle: In a clear trifle bowl or glass dish, layer in this order: sponge cubes, a spoonable layer of custard, a scatter of berries, and a layer of whipped cream.
Repeat until you reach the top, finishing with whipped cream.
Chill: Cover and refrigerate at least 2 hours, ideally 4–8 hours. The layers settle and the flavors blend best with time.
Garnish and serve: Just before serving, top with extra berries, shaved sugar-free chocolate, or toasted almonds for crunch.