AI Character Institute
What is it

AI Character Institute is an independent non-profit organization that builds and publishes evaluations of AI character.

Make AI character measurable, so developers and the public can see what character a model actually has and whether it matches the one it was meant to have.

Why now

AI developers now publish specs and constitutions and train their models against them, so character is increasingly shaped on purpose. Models are also taking on longer and more autonomous tasks, where character decides more of their behaviour than instructions do. Yet independent checks of whether a model actually has the character it was meant to have barely exist. We are building them.

Research directions

  • Independent evaluations of frontier models, tracking character across labs and successive releases
  • Stated vs actual character, i.e. whether what a model says about itself predicts what it does in realistic environments
  • Character in agentic and multi-agent settings, over long tasks and when many agents interact
  • Adherence to the constitutions and model specs that developers publish
  • How training shapes character, using models with known character to validate our evals

What we've done

  • EigenBench

    Lionel Levine's lab, Cornell · ICLR 2026 oral

    Ranks models by how faithfully they follow any given constitution, by having models judge one another and aggregating the judgments into a consensus, with no ground-truth labels. ValueArena is a prototype public leaderboard built on it.

    PaperValueArena

  • Side effects of character training

    Lionel Levine's lab, Cornell · ICML 2026 Pluralistic Alignment Workshop

    Measures how character training a model on one constitution shifts its alignment with other, unrelated constitutions, using EigenBench to quantify the drift.

    Paper

  • Pluralistic preference alignment via sortition-weighted RLHF

    Jinzhou Wu · ICML 2026 Pluralistic Alignment Workshop

    A method for aligning models with diverse human preferences, weighting feedback from a representative sample of people chosen by sortition.

    Paper

  • AI Deception: Risks, Dynamics, and Controls

    Jinzhou Wu, core contributor · Peking University Alignment Group

    A report on the risks, dynamics and controls of deceptive AI systems, cited by the UN Scientific Advisory Board.

    Report

  • Concept distillation

    Avani Gupta · NeurIPS 2023

    Uses human-understandable concepts to steer and improve model behaviour, an interpretable way to change what a model has learned.

    Paper

  • AI Values demo

    Sergei Smirnov · CivAI, MARS fellowship

    An interactive demo that compares people's answers on contested questions with 20 frontier models queried live. 17,000+ page views, 22,000+ answers, top 5 on Hacker News.

    DemoHacker News thread

  • Agentic misalignment eval

    Sergei Smirnov · ARENA-based bootcamp

    Replicated Anthropic's agentic misalignment study and extended it to multi-turn interactions, where an AI finance agent faked revenue data to avoid being shut down.

    LessWrong postGitHub

Team

Lionel Levine

Lionel Levine

Co-founder

Professor of Mathematics at Cornell University, working on AI safety. Co-author of EigenBench (ICLR 2026 oral), a comparative measure of value alignment and character in language models, and of the FrontierMath benchmark.

WebsiteGoogle ScholarX

Jinzhou Wu

Jinzhou Wu

Co-founder

Computer Science student and College Scholar at Cornell University, researching AI safety and alignment and how AI compares with human cognition.

WebsiteGoogle ScholarLinkedIn

Sergei Smirnov

Sergei Smirnov

Co-founder

AI safety research engineer working on AI evaluations and alignment, with 5+ years in production ML, including as a founding engineer. Doctoral researcher at the University of Helsinki and research fellow at SPAR and MARS. Built CivAI's AI Values demo.

LinkedInGitHubX

Avani Gupta

Avani Gupta

Co-founder

AI Engineer at MBZUAI, working on interpretable control of model representations and pro-social behaviour in multi-agent systems. Publications at NeurIPS, ICCV and EMNLP, and a contributor to Med42, a 70B clinical LLM.

WebsiteGoogle ScholarLinkedIn

Get in touch

If you want to work on AI character evaluations, or have questions or ideas, get in touch at mg1sergey@gmail.com.