Yeah this is something I've noticed too. Did a few sessions at a churchyard near me in Kent, old Victorian-era place, and the male voices were way more consistent than female ones. Deep, kind of monotone. One recording had what sounded like someone saying a name - couldn't make it out fully but it wasn't random noise.
My theory, for what it's worth, is that it might come down to frequency. Male voices sit lower and EVP tends to capture lower frequencies more cleanly, so you might just be picking them up easier even if female voices are present. Or maybe theres genuinely something about the energy of older male-dominated burial sites, a lot of those Victorian churchyards were dominated by prominent men, landowners, clergy etc.
Would be interested to know what equipment you're using and whether you've tried filtering the recordings after capture. Anyone else had this and compared notes across different locations?