Skip to content

Main Insight

In a paper published at the International Workshop on Artificial Intelligence and Intelligent Assistance for Legal Professionals in the Digital Workplace (Legal AIIA), Dr. Bruce Hedin and Samuel Curtis present an argument for distributed competence as a means to mitigate risks posed by AI systems.

Strengthening the AI operating environment

June 21, 2023

In a new paper titled “Strengthening the AI Operating Environment: Distributed competence as a means to risk mitigation,” published at the 3rd International Workshop on Artificial Intelligence and Intelligent Assistance for Legal Professionals in the Digital Workplace (LegalAIIA 2023), Dr. Bruce Hedin and Samuel Curtis present an argument for distributed competence as a means to mitigate risks attendant upon the use of AI systems.

The authors observe that initial efforts to contain the risks posed by AI systems have been, overall, top-down in nature. Examples of these include constraints on the design of AI-enabled applications, industry best practices, and legal statutes that govern AI applications and their creators. The authors posit that bottom-up approaches focused on strengthening the environment in which AI is deployed are a necessary complement to these top-down, application-focused approaches.

The paper presents two bottom-up initiatives aimed at enhancing the human component of AI deployment:

  • Through better information – The creation of an ongoing institutionalized program of interoperable, open AI benchmarks to supply the empirical evidence needed to foster a public empowered to make informed decisions about the use of AI.
  • Through better tools – The creation of a repository of resources for local validation to provide empirical grounds for determining whether an AI system was successful in its specific circumstances.

The paper furthermore presents an overview of the work completed toward both of these initiatives to date, in collaboration with the IEEE and, in the case of the benchmarking initiative, with the Working Group on Interoperable Benchmarking of AI Systems. More information on these initiatives will be publicly available later this year.

Dr. Bruce Hedin presented the paper at the 3rd International Workshop on Artificial Intelligence and Intelligent Assistance for Legal Professionals in the Digital Workplace (LegalAIIA 2023), which was co-located with the 19th International Conference on Artificial Intelligence and Law (ICAIL 2023), in Braga, Portugal on June 19th, 2023. More publications from the workshop can be found here.

Team members

Related resources

Heavy is the Head that Wears the Crown

Heavy is the Head that Wears the Crown

In this blueprint, we explain why a tiered approach makes sense in the EU AI Act and how to build a risk-based tiered regulatory regime for GPAI – the technicalities involved, which requirements should be imposed on their corresponding tiers, and how to enforce them.

Giving Agency to the AI Act

Giving Agency to the AI Act

Earlier this year, we conducted research comparing different institutional models for an EU-level body to oversee the implementation and enforcement of the AI Act. We're pleased to share our memo: Giving Agency to the AI Act.

Response to NIST Generative AI Public Working Group Request for Resources

Response to NIST Generative AI Public Working Group Request for Resources

TFS submitted a list of clauses to govern the development of general-purpose AI systems (GPAIS) to the U.S. NIST Generative AI Public Working Group (NIST GAI-PWG).

Response to U.S. OSTP Request for Information on National Priorities for AI

Response to U.S. OSTP Request for Information on National Priorities for AI

Our response put forward national priorities focused on security standards, measurement and evaluation frameworks, and an industry-wide code of conduct for GPAIS development.

Response to U.S. NTIA AI Accountability Policy Request for Comment

Response to U.S. NTIA AI Accountability Policy Request for Comment

Our response emphasized the need for scrutiny in the design and development of general-purpose AI systems (GPAIS). We encourage the implementation of third-party assessments and audits, contestability tools for impacted persons, and a horizontal regulatory approach toward GPAIS.

Policy achievements in the EU AI Act

Policy achievements in the EU AI Act

The draft AI Act approved by the European Parliament contains a number of provisions for which TFS has been advocating, including a special governance regime tailored to general-purpose AI systems. Collectively, these operationalize safety, fairness, accountability, and transparency in the development and deployment of AI systems.