Maybe…could be that when people with unusual traits were born, the darker included, they were attributed with special powers. It could be that they were wowed by tales of foreign spirituality. There could be many reasons. The evil Voodoo thing is based in fear of retribution. Maybe this is some way of psychologically countering that by thinking that we can use our magic for their benefit. It makes us less scary.