I don't own one, but H4350 seems like a decent choice for 30-06 and 165gr bullets. I don't think that's the issue.
Have you found any Factory loads that shoot well? If not, it's likely something about the rifle itself (stock bedding, scope mounts, etc), or it's you.
If I can assume your...