Top frontier AI firms have outlined their safety policies to boost transparency and encourage the sharing of best practice within the AI community
Leading AI companies have today (Friday 27 October) published their safety policies following a request from the Technology Secretary last month, in a move to boost transparency and encourage the sharing of best practice within the AI community.
It comes as the UK Government reveals a set of emerging safety processes for the companies, providing information on how they can keep their models safe - and is intended to inform discussions at Bletchley Park next week.
The government paper outlines practices for AI companies including implementing responsible capability scaling – a new framework for managing frontier AI risk and something several are already putting into action. This would see AI firms set out ahead of time what risks are going to be monitored, who is notified if these risks are found, and at what level of dangerous capabilities a developer would slow or, in fact, pause their work until better safety mechanisms are in place.
Other suggestions include AI developers employing third parties to try to hack their systems to identify sources of risk and potential harmful impacts, as well as providing additional information on whether content has been AI generated or modified. At the heart of these emerging safety practices is innovation, with the UK Government clear that the only way to seize the opportunities for economic growth and public good is by understanding the risks at the frontier of AI development.
Yesterday the Prime Minister confirmed the UK will establish the world’s first AI Safety Institute to advance the world’s knowledge of AI safety, and carefully examine, evaluate and test new types of AI so there is an understanding of what each new model is capable of. It will look to share information with international partners, policymakers, private companies, academia and civil society as part of efforts to collaborate on AI safety research. Today’s announcement from the leading frontier AI companies begins the conversation about safety policies which the AI Safety Institute can now take forward through its programme of research, evaluation and information sharing working with the government’s AI Policy team.
New findings published today show international support for a government-backed AI safety institute to evaluate powerful AI to test if it is safe, with 62% of Brits surveyed backing the idea. The survey of international public opinion on AI safety across nine countries, including Canada, France, Japan, the UK and USA, amongst others, saw strong support in most nations for powerful AI to be tested by independent experts. Most respondents in all countries agreed with this, ranging from 59% in Japan to 76% in the UK and Singapore. When asked who they would trust to have overall responsibility for ensuring AI is safe, an AI safety institute was the most popular option in seven of the nine countries surveyed, and often by some distance.
Today’s paper contains processes and associated practices that some frontier AI organisations are already implementing and others that are being considered within academia and broader civil society. While there may be some processes and practices relevant for different kinds of AI organisations, others - such as responsible capability scaling - are specifically developed for frontier AI and are not designed for lower capability or non-frontier AI systems.
Technology Secretary Michelle Donelan said:
Today’s paper also highlights the long-standing technical challenges in building safe AI systems, including safety evaluations and understanding how they make decisions. Safety best practices have not yet been established for frontier AI development – which is why the UK Government has published emerging processes to inform the vital discussion of safe frontier AI at the summit.
It follows a new government discussion paper published yesterday pointing to rapid recent progress in frontier AI which is expected to continue in the coming years. This could see these models evolve at ever-greater speed, leading to a danger they will exceed human understanding, and even human control.
The UK recognises the enormous opportunities AI can unlock across the economy and society - however, without appropriate guardrails, such technologies can pose significant risks. The AI Safety Summit will focus on how best to manage the risks from frontier AI such as misuse, loss of control and societal harms. Frontier AI organisations play an important role in addressing these risks and promoting the safety of the development and deployment of frontier AI.
Frontier AI Taskforce Chair Ian Hogarth said:
Today’s publication on emerging safety practices is intended to support frontier AI companies to establish effective AI safety policies.
Adam Leon Smith, of BCS, The Chartered Institute for IT, and Chair of its Fellows Technical Advisory Group (F-TAG) said:
The UK is hosting the AI Safety Summit as the government looks long-term at the tough decisions that need to be taken for a brighter future for the next generation, powered by AI developments.
Notes to Editors