It is brought down by the Poskim that the main part of Yizkor is not the Yizkor prayer. The primary accomplishment of Yizkor (brought down by the Poskim) is the actual giving of tzedakah in the memory of the deceased. That’s more important than the prayers.