Hi Angela! If this is a new exercise for you, it very well could get better with time. Just space out the days between doing them so that you build up endurance for them rather than develope a nagging pain that distracts from your effort.
You can also see if using push up handles alleviates the discomfort.
Also try stretching your fingers, wrists, and forearms before and after the exercise too.