AI Now Report 2018
Recommendation:
- Governments need to regulate AI by expanding the powers of sector-specific agencies to oversee, audit, and monitor these technologies by domain.
- Facial recognition and affect recognition need stringent regulation to protect the public interest.
- The AI industry urgently needs new approaches to governance. As this report demonstrates, internal governance structures at most technology companies are failing to ensure accountability for AI systems.
- AI companies should waive trade secrecy and other legal claims that stand in the way of accountability in the public sector.
- Technology companies should provide protections for conscientious objectors, employee organizing, and ethical whistleblowers
- Consumer protection agencies should apply “truth-in-advertising” laws to AI products and services
- Technology companies must go beyond the “pipeline model” and commit to addressing the practices of exclusion and discrimination in their workplaces.
- Fairness, accountability, and transparency in AI require a detailed account of the “full stack supply chain.”
- More funding and support are needed for litigation, labor organizing, and community participation on AI accountability issues.
Central problem and addresses the following key issues:
- The growing accountability gap in AI, which favors those who create and deploy these technologies at the expense of those most affected
- The use of AI to maximize and amplify surveillance, especially in conjunction with facial and affect recognition, increasing the potential for centralized control and oppression
- Increasing government use of automated decision systems that directly impact individuals and communities without established accountability structures
- Unregulated and unmonitored forms of AI experimentation on human populations
- The limits of technological solutions to problems of fairness, bias, and discrimination
Black boxes
As numerous scholars have noted, one significant barrier to accountability is the culture of industrial and legal secrecy that dominates AI development. Just as many AI technologies are “black boxes”, so are the industrial cultures that create them. Many of the fundamental building blocks required to understand AI systems and to ensure certain forms of accountability – from training data, to data models, to the code dictating algorithmic functions, to implementation guidelines and software, to the business decisions that directed design and development – are rarely accessible to review, hidden by corporate secrecy laws.
What is needed next?
- From Fairness to Justice
- Infrastructural Thinking
- Accounting for Hidden Labor in AI Systems
- Deeper Inter-disciplinarity
- Race, Gender and Power in AI
- Strategic Litigation and Policy Interventions
- Research and Organizing: An Emergent Coalition
Regulations
But regulation can only be effective if the legal and technological barriers that prevent auditing, understanding, and intervening in these systems are removed.