Should businesses be held accountable if AI produces biased outcomes?

Certainly, business should make sure that their AI systems are fair and unbiased, and take corrective action if necessary.

Yes. Its all about policy and how you apply it in code and in user experience. If your Ai is biased it is because your policies and practices are too.