Sounds like it might be Utawarerumono. Hakuoro has lost his memory after succumbing to serious injuries; but thanks to a elderly woman and her granddaughter Eruruu, he is nursed back to health. His face is covered by a strange irremovable mask and he occasionally sees beastly visions. Eruruu now cares for him as he becomes accustomed to the village and its inhabitants who all bear strange ears (the women have tails too). Though these people venerate the forces of nature, desecration of an alter forces them to take drastic measures to preserve their lives from the wrath of Mutikapa-sama, guardian of the forest.