Usage Governance Advisor: From Intent to AI Governance

Evaluating the safety of AI Systems is a pressing concern for organizations deploying them. In addition to the societal damage done by the lack of fairness of those systems, deployers are concerned about the legal repercussions and reputational damage incurred by the use of models that are unsafe. Safety covers both what a model does; e.g. can it be used to reveal personal information from its training set, and how a model was built; e.g. was it only trained on licensed data sets. Determining the safety of an AI system requires gathering information from a wide set of heterogeneous sources including safety benchmarks and technical documentation for the set of models used in that system. Responsible use is encouraged through mechanisms that advise the user in taking mitigating actions when safety risks are detected. We present the Usage Governance Advisor which identifies and prioritizes risks according to the intended use case, recommends appropriate models, benchmarks and risk assessments and most importantly proposes mitigation strategies and actions.