Back to the database
Record STMT-WE5AAFBVoluntary

Evaluation Perspective Guide on AI Safety (Version 1.01)

AI セーフティに関する評価観点ガイド(第1.01版)

Guidelines Institutional policyEastern Asia · JPadopted

This guide provides basic considerations and evaluation perspectives for individuals involved in the development and provision of AI systems, specifically focusing on Large Language Model (LLM) systems, to conduct AI safety evaluations. It covers ten evaluation perspectives including harmful content control, prevention of misinformation, fairness, and security, drawing from domestic guidelines and international trends. The document outlines evaluation timing across development, deployment, and usage phases, as well as technical and management evaluation methodologies.

Summary and content fields are drawn from the document text and are pending editorial review.

Who issued it

AI Safety InstituteGovernment
Lead issuer
Legal forceVoluntary
Under whose authorityInstitutional policy
Judged fromfull text

Who it governs

AI developers and providersPublic sector bodiesAI deployers and usersResearchers and academics

This guide is for AI developers, providers, management supervisors, and business executives involved in building and deploying AI systems who need to conduct safety evaluations.

Sectors
Cross-sector

What the document contains

What's covered

The document covers the definition of AI safety, ten detailed evaluation perspectives (e.g., harmful information output control, prevention of misinformation, fairness, privacy, security, explainability, robustness, data quality, and verifiability), evaluation executors, evaluation timing across lifecycle phases, and evaluation methodologies.

What's missing

The document does not provide binding legal penalties, exhaustive multi-modal evaluation benchmarks, or detailed technical implementation scripts.

Key takeaways
  • The guide establishes ten specific evaluation perspectives for assessing AI safety, primarily targeting LLM systems.
  • Key elements of AI safety include human-centric principles, safety, fairness, privacy protection, security, and transparency.
  • Evaluations should be conducted across development, deployment, and usage phases by appropriate internal or external roles.
  • Both technical evaluations (such as tool-based evaluations and red teaming) and management evaluations are necessary.
  • The document references the Japanese AI Business Guidelines and international frameworks to align with global standards.
Principles it states
人間中心安全性公平性プライバシー保護セキュリティ確保透明性
Outline
1 はじめに
2 AI セーフティ
3 評価観点の詳細
4 評価実施者及び評価実施時期
5 評価手法の概要
6 評価に際しての留意事項
Issued25 September 2024
Length1,694 words · 30 pages
FormatNot recorded
Scopenational

How it scores

Pending review

Each score is backed by a quote verified against the document text. Editorial review has not yet confirmed them.

Enforcement

0/5

Consequences and compliance mechanisms with real force

screening score · 2026-10-25

Topics

ai_safety evaluation_methods large_language_models ai_governance risk_management