What are the main tools that verify correctness/accuracy for AI diven decisions?

In a world where AI is going to make many of the core decisions, are there any tools out there that validate and verify the results ? For example: Mortgage decision - how do we make sure the approval process for someone earning $XX, looking to buy a 2BR apartment in NY but had debt issues in the past is done correctly by an AI agent ? Would love to get inputs...