International AI Safety Report 2026
Yoshua Bengio (Chair) et al. · 2026
튜링상을 받은 컴퓨터 과학자 요슈아 벤지오가 위원장을 맡고 30여 나라와 국제기구의 전문가 100여 명이 함께 쓴 2026년 국제 AI 안전 보고서입니다. 범용 AI가 지금 무엇을 할 수 있는지, 악용 · 오작동 · 사회 전체에 미치는 위험이 어디까지 확인되었는지, 위험을 줄이는 방법은 무엇인지를 증거에 따라 정리합니다.
출처 Bengio et al. (2026), Department for Science, Innovation and Technology (UK), DSIT 2026/001 · 라이선스 OGL v3.0 · 원문
이 장은 원문만 있습니다. 문장별 해석은 앞 장부터 차례로 붙입니다.
9장 · Risks — Cyberattacks
Key information
• General-purpose AI systems can execute or assist with several of the tasks involved in conducting cyberattacks. There is now strong evidence that criminal groups and state-sponsored attackers actively use AI in their cyber operations. However, whether AI systems have increased the overall scale and severity of cyberattacks remains uncertain because establishing causal effects is difficult.
• AI systems are particularly good at discovering software vulnerabilities and writing malicious code, and now score highly in cybersecurity competitions. In one premier cyber competition, an AI agent identified 77% of vulnerabilities in real software, placing it in the top 5% of over 400 (mostly human) teams.
• AI systems are automating more parts of cyberattacks, but cannot yet execute them autonomously. At least one real-world incident has involved the use of semi-autonomous cyber capabilities, with humans intervening only at critical decision points. Fully autonomous end-to-end attacks, however, have not been reported.
• Since the publication of the previous Report (January 2025), the cyber capabilities of AI systems have continued to improve. Recent benchmark results show that the cyber capabilities of AI systems have improved across several domains, at least in research settings. AI companies now frequently report on attempts to misuse their systems in cyberattacks.
• Technical mitigations include detecting malicious AI use and leveraging AI to improve defences, but policymakers face a dual-use dilemma. Since it can be difficult to distinguish helpful uses from harmful ones, overly aggressive safeguards such as preventing AI systems from responding to cyber-related requests can hamper defenders.
General-purpose AI systems can help malicious actors conduct cyberattacks, such as data breaches, ransomware, and attacks on critical infrastructure, with greater speed, scale, and sophistication. AI systems can assist attackers by automating technical tasks, identifying software vulnerabilities, and generating malicious code, though capabilities are progressing unevenly across these tasks. This section examines the evidence on how AI systems are being used in cyber operations and the current state of AI cyber capabilities.
AI systems can be used throughout cyber operations
Extensive research shows that AI systems can now support attackers at several steps of the ‘cyberattack chain’ (Figure 2.5): the multi-stage process through which attackers identify targets, develop capabilities, and achieve their objectives. In a typical attack, adversaries first identify targets and vulnerabilities, then develop and deploy their attack capabilities, and finally maintain persistent access to achieve their objectives, such as stealing data or destroying systems. Improvements in relevant AI capabilities such as software engineering have prompted concerns that AI systems could be used to increase both the frequency and severity of cyberattacks.
Despite uneven capabilities, general-purpose AI already assists in cyberattacks
General-purpose AI is already being used in cyberattacks. Underground marketplaces now sell pre-packaged AI tools and AI-generated ransomware that lower the skill threshold for conducting attacks, making these capabilities more accessible to less sophisticated actors. Security analyses conducted by AI developers indicate that threat groups associated with nation-states are using AI systems to enhance cyber capabilities. For example, such actors have used AI systems to analyse disclosed vulnerabilities, develop evasion techniques, and write code for hacking tools.
Across all tasks relevant to cyber offence, AI capabilities are progressing, albeit unevenly (Figure 2.6). The availability of large training datasets has made AI systems particularly capable at certain tasks, such as finding vulnerabilities in publicly available code. Other tasks require capabilities that current AI systems lack, such as the precise numerical reasoning needed to break encryption.
This uneven progress means that performance in controlled settings provides only limited insight into real-world attack potential. For example, results on evaluations that involve AI models analysing source code do not reliably transfer to environments where attackers cannot access the underlying code. Most evaluations also test isolated skills rather than the ability to carry out a full attack from start to finish. Even in capture-the-flag competitions – structured cybersecurity challenges in which AI systems have recently performed well – progress remains uneven. For example, one AI system placed in the top 3% on the high school-level picoCTF 2025, yet failed to solve any challenges in PlaidCTF, a professional-level competition.
AI systems are particularly skilled at discovering vulnerabilities and writing code
One area where there is particularly strong evidence that AI systems provide meaningful assistance is in discovering ‘software vulnerabilities’: weaknesses in programs that can be exploited to compromise the security of computer systems. For example, Google’s Big Sleep AI agent was used to identify a critical memory corruption vulnerability – a type of software flaw that can allow attackers to take control of computer systems – in a database engine used in many real-world deployments. Competitors in the final phase of the DARPA AI Cyber Challenge (AIxCC) used AI systems with access to conventional security tools to find vulnerabilities in real-world software. One AI system autonomously identified 77% of the vulnerabilities introduced by the competition organisers, as well as other, unintentional vulnerabilities.
AI systems can also assist in malware development by generating malicious code, disguising it to evade detection, and adapting tools for specific targets. Security researchers have identified experimental malware that contacts an AI service while running to generate code that evades antivirus software. However, these implementations remain experimental and face significant practical constraints. For example, they rely on external AI hosting services, making them easy to disrupt once providers suspend the attacker’s accounts. Embedding an AI model directly inside the malware would avoid this vulnerability, but current AI models are too large and resource-intensive for this to be feasible.
Degree of automation in cyberattacks
Fully automated cyberattacks would remove the bottleneck of human involvement, potentially allowing attackers to launch attacks at much greater scale. AI systems can now complete an increasing number of relevant tasks autonomously. In November 2025, one AI developer reported that a threat actor used their models to automate 80–90% of the effort involved in an intrusion, with human involvement limited to critical decision points. Researchers have also demonstrated that AI systems can independently probe computer networks for security weaknesses in laboratory settings. However, general-purpose AI systems have not been reported to conduct end-to-end cyberattacks in the real world.
Research suggests that autonomous attacks remain limited because AI systems cannot reliably execute long, multi-stage attack sequences. For example, failures they exhibit include executing irrelevant commands, losing track of operational state, and failing to recover from simple errors without human intervention.
Even with AI assistance, humans remain in the loop for cyberattacks
Due to these limitations, human–AI collaboration remains the dominant paradigm for cyber operations in both research and practice. In this context, humans provide strategic guidance, break complex operations into manageable subtasks, and intervene when AI systems encounter errors or produce unsafe outputs. Meanwhile, AI systems automate technical subtasks such as code generation or target identification.
Uncertain real-world impacts
General-purpose AI is contributing to observed increases in attack speed and scale, but its exact impact on attack frequency remains unknown. Threat intelligence reports document AI involvement in several attack types, including credential theft, automated scanning, and supply chain attacks (see Table 2.3). So far, AI capabilities have primarily accelerated or scaled existing attack methods rather than created new kinds of attacks. However, establishing causation can be difficult. Observed increases in attack frequency could reflect AI assistance, but could also result from improved detection.
The offence-defence balance is critical but dynamic
Many of the same AI capabilities used for cyberattacks can also strengthen defences, creating uncertainty about whether AI benefits attackers or defenders more. For example, AI capabilities that allow an attacker to rapidly discover vulnerabilities can also be used by a defender to find and patch them first. AI companies have announced AI security agents that aim to proactively identify and fix software vulnerabilities.
Researchers have also suggested that the use of AI could help to harden digital environments by, for example, rewriting large codebases for greater security. In parallel, improved evaluation methods help assess the offensive capabilities of new AI systems before deployment, providing early warning of emerging risks. Some developers have introduced new controls in sensitive domains, such as cybersecurity and biological research, to restrict access to certain products to vetted organisations.
How this balance between offensive and defensive uses of AI evolves depends in part on choices about model access, research funding, and deployment standards. For example, the lack of standard quality-assurance methods for AI tools makes it difficult for defenders to adopt them in critical sectors where reliability is essential, while attackers face no such constraints.
Box 2.1: AI systems are themselves targets for attacks
This section mainly focuses on how AI can be used to conduct cyberattacks. But AI systems can also be the target of attacks. Attackers can exploit techniques such as prompt injection (manipulating an AI system through malicious inputs), database poisoning (corrupting the information an AI system relies on), and supply chain compromises (manipulating AI components before deployment) to manipulate model behaviour, extract sensitive information, or generate harmful outputs.
One particular kind of attack, which may prove particularly important as capabilities advance, is tampering: interfering with the development of an AI system to alter its behaviour when deployed. Tampering can allow actors to insert backdoors, triggers that cause AI models to exhibit specific behaviours under certain conditions, or influence AI model training to insert ‘hidden objectives’ that covertly guide how models behave. The feasibility of tampering in practice has not been established. Researchers have demonstrated that AI systems can be trained to pursue simple hidden objectives. Some have argued that more capable AI systems that have been tampered with will be able to execute more sophisticated behaviours, and actors will be able to insert hidden objectives which are hard to detect. However, other researchers believe that security measures will suffice to protect AI systems from tampering.
Some researchers have raised concerns that tampering raises novel risks because it could allow an individual or small group to gain significant, covert influence over the behaviour of highly capable AI models. Risks from prompt injection, data poisoning, tampering, and other attacks against AI systems are particularly serious when those systems are embedded in sensitive workflows. For example, compromising an AI system that contributes to an organisation’s cyber defences could leave that organisation vulnerable to other threats.
Updates
Since the publication of the previous Report in January 2025, evaluation and competition results suggest that the cyber capabilities of AI systems have improved, and evidence of actors using AI to conduct real-world attacks has emerged. For example, AI systems have demonstrated improved performance in vulnerability discovery. AI developers are also increasingly reporting that attackers, including some linked to nation-states, are using their models to support cyber offence operations.
Evidence gaps
A major evidence gap stems from the difficulty of reliably assessing AI cyber capabilities, as AI cyber evaluations are an emerging field. Benchmarks can overstate performance if a model was inadvertently trained on the test data. Conversely, they can understate real-world risk by failing to account for cases where an AI system fails in a situation that a human could easily handle, or by failing to elicit the model’s true capabilities. For example, for some models, third parties have reportedly used scaffolding to reveal greater cyber capabilities than those measured in pre-deployment testing. Moreover, reliably assessing AI’s impact on cyber offence is challenging. Evidence of adoption of AI by attackers is drawn primarily from incident reporting and threat-intelligence (Table 2.3), but these sources rarely allow for confident attribution, as any observed trends may be due to AI assistance or other unrelated factors.
Mitigations
Technical mitigations against AI-enabled cyber offence include preventing malicious requests to AI systems as well as proactively accelerating the development of AI-enabled cyber defences. For the former, model providers use AI systems to detect and block accounts associated with known malicious actors before they can issue harmful prompts. They also deploy specialised classifiers that identify distinctive misuse patterns (such as malware generation requests); these are integrated into their safety enforcement systems.
However, these mitigations face significant limitations. By using capable open-weight models, attackers can move their AI usage entirely offline and outside any oversight. Meanwhile, defenders face barriers to adopting AI-powered security tools due to the absence of standardised quality-assurance methods – a constraint that attackers do not face.
Challenges for policymakers
A central challenge for policymakers is mitigating the use of general-purpose AI for cyber offence without stifling defensive innovation. This difficulty arises because many of the same methods needed to build robust defensive systems (such as automated vulnerability discovery or incident response) also underpin offensive toolchains. Overly broad restrictions risk slowing the diffusion of defensive technologies and inadvertently weakening national security. Policymakers must therefore strike a careful balance: incentivising rapid response, supporting open research where it strengthens defence, and implementing safeguards that limit the uncontrolled proliferation of offensive capabilities.
이 글은 위 출처의 원문을 그 라이선스(OGL v3.0)에 따라 옮겼습니다. 참고문헌 목록과 인용 번호, 그림 · 표 · 각주 · 수식 · 부록은 빼고 절별로 나누어 실었으며, 그 밖의 문장은 원문 그대로입니다. 원 저작자와 발행 기관은 이 화면을 만들거나 검토하지 않았고, 이곳의 해석과 낱말 풀이는 공식 번역이 아닙니다.
Contains public sector information licensed under the Open Government Licence v3.0.
