Just don't use too much at a time. Maybe an inch at the most and till in. You can till more in in-between the rows when plants are larger. Had a friend that put 6 inches of turkey crap on and nothing grew for three years.
whats with the siding?
Even though it didn't freeze this weather certainly will set peppers and tomatoes back. Peppers for about two weeks. Soil temps are still very cool. Of course there are exceptions but for the most part this is why the end of May is a great time to plant.