In a medium bowl, mix together the peanut butter, softened butter, and vanilla extract until well combined. Gradually add in the powdered sugar, mixing until the mixture is smooth and holds together. The consistency should be similar to cookie dough.