Copycat Payday Candy Bars

I have made this twice.. First time was with the recipe using sweeten condense milk, took almost three days to setup a wee bit, was let eating stickie toffee,Second time I used the dulce de leche. Now sitting in the fridge for two days now and worst than the first time, What is the secret of making the center more fudgie like..

1 (14-ounce) can sweetened condensed milk or dulce de leche
32 ounces (4 cups) salty roasted peanuts, divided
4 tablespoons (1/4 cup) unsalted butter
2 cups mini marshmallows
1/2 cup creamy peanut butter

Click Here For Direction >>>> Copycat Payday Candy Bars