Session materials page

::: {.callout-note appearance="simple"} During the session (Wednesday 7 October, 11:00–12:30) - **[Follow the live record and ask a question](https://sesh-ai.dataimago.ai/sessions/aime-2026-ai-native-profession/audience)** - **Panel materials:** below on this page. - **How lain is governed:** the session proposal's addendum, [PDF page 6 onward](rendered/AIME_2026_Panel_Proposal_final_lain_2026-09-22.pdf#page=6). ::: Artificial intelligence is changing not only assessment products, but the professional work of educational measurement itself. This page brings together the materials for the panel as supplied by the presenters. **Original files are linked unchanged.** Where an original is difficult to view in a browser, a rendered copy is provided alongside it and clearly labeled. - **The session proposal** (final, 22 September 2026): [PDF](rendered/AIME_2026_Panel_Proposal_final_lain_2026-09-22.pdf) · [LaTeX source](Assets/AIME_2026_Panel_Proposal_final_lain_2026-09-22.tex) (requires the dataimago LaTeX style package; the PDF is the readable version) - **Moderator's framing slides:** [open](decks/moderator.html) · [PDF](rendered/moderator-slides.pdf) - **Data underlying the opening chart:** every AIME-Con 2026 program item, coded on three yes/no questions by two AI coders and audited by the chair ([codebook and method](data/README.md) · [coded program items](data/program-items-coded.csv) · [v1 coding](data/program-presentations.csv) · [sessions](data/program-sessions.csv) · [coding prompts, second-coder sample and agreement](data/methods/README.md)) - **The conference program:** see the official AIME-Con 2026 site. Who is on the panel | Role | | |---|---| | Session chair | Damian Betebenner, Center for Assessment | | Moderator | lain, an AI interlocutor operating under the session chair's supervision | | Panelists | Damian Betebenner · Derek Briggs · Frank Rijmen · Mohammed A. A. Abulela (with Guher Gorgun, Brian French, Brian Leventhal, Matthew Gushta) | | Discussant | Fred Oswald, University of California, Irvine |

A. Abulela (with Guher Gorgun, Brian French, Brian Leventhal, Matthew Gushta) | | Discussant | Fred Oswald, University of California, Irvine | Five guiding questions - **What has changed.** How has AI already changed educational measurement—not merely the speed of the work, but its substance, scope, and organization? What has become better, worse, or simply different? - **What that demands of professionals.** As AI becomes a collaborator rather than merely a tool, how should work be divided between people and AI? What knowledge, skills, and dispositions then define psychometric expertise, and how should graduate programs and employers develop and assess them? - **What the profession must redefine.** When AI contributes materially to an analysis, manuscript, or review, what must be verified, documented, and disclosed before others can responsibly rely on it? What does this require of peer review, training, and institutional accountability? - **What measurement science owes the evaluation of AI.** What can measurement science, in turn, contribute to the evaluation of AI systems and human–AI teams—including this panel—and what would count as improvement over the relevant alternative? - **Where authority and accountability remain human.** As AI capabilities advance, where should authority and accountability remain human? What justifies those boundaries beyond limitations of current capability, and what does this session's own use of an AI interlocutor reveal about them?

What justifies those boundaries beyond limitations of current capability, and what does this session's own use of an AI interlocutor reveal about them? Provocations Each panelist will make one claim, ground it in one example, and identify one unresolved problem. ::: {.presenter-card} Damian Betebenner, Center for Assessment **Slides:** [open](decks/betebenner-provocation.html) · [PDF](rendered/betebenner-provocation-slides.pdf) · **Statement, with longer versions:** [markdown](Assets/Damian_Betebenner-presenter/provocation_statement.md) **Claim:** AI is moving the frontier of feasible measurement research. Problems that previously required a team of specialists, or simply remained unexplored, can now be attacked by a single researcher working with AI. **Example:** Deriving theoretical properties of new dependence-based models for educational growth, translating them into software, and exploring thousands of simulated conditions would previously have taken months or years, or a team. With AI participating across the entire loop, it became tractable on the scale of weeks. **Unresolved problem:** If AI makes it possible to produce work whose complexity exceeds what its author, or a conventional peer reviewer, can independently reconstruct, what makes the result warranted, and who is accountable for deciding that the evidence is sufficient? ::: ::: {.presenter-card} Derek Briggs, University of Colorado Boulder **Slides:** [open (HTML original)](Assets/Derek_Briggs/AI_in_Peer_Review_Provocation.html) · [PDF, rendered copy](rendered/briggs-provocation-slides.pdf) · **Statement:** [markdown original](Assets/Derek_Briggs/provocations.md) {{< include Assets/Derek_Briggs/provocations.md >}} ::: ::: {.presenter-card} Frank Rijmen, Cambium Assessment **Slides:** [PowerPoint original](Assets/Frank_Rijmen/Rijmen_AIME2026_provocation_Cambium.pptx) · [PDF, rendered copy](rendered/Rijmen_AIME2026_provocation_Cambium.pdf) · [slide text and speaker notes](corpus/rijmen-slides-and-notes.html)<br> **Position brief:** [Word original](Assets/Frank_Rijmen/Rijmen_AIME2026_position_brief.docx) · [web version](corpus/rijmen-position-brief.html)<br> **Bio:** [markdown original](Assets/Frank_Rijmen/bio_Frank_Rijmen.md) {{< include Assets/Frank_Rijmen/provocation_statement.md >}} ::: ::: {.presenter-card}

{{< include Assets/Derek_Briggs/provocations.md >}} ::: ::: {.presenter-card} Frank Rijmen, Cambium Assessment **Slides:** [PowerPoint original](Assets/Frank_Rijmen/Rijmen_AIME2026_provocation_Cambium.pptx) · [PDF, rendered copy](rendered/Rijmen_AIME2026_provocation_Cambium.pdf) · [slide text and speaker notes](corpus/rijmen-slides-and-notes.html)<br> **Position brief:** [Word original](Assets/Frank_Rijmen/Rijmen_AIME2026_position_brief.docx) · [web version](corpus/rijmen-position-brief.html)<br> **Bio:** [markdown original](Assets/Frank_Rijmen/bio_Frank_Rijmen.md) {{< include Assets/Frank_Rijmen/provocation_statement.md >}} ::: ::: {.presenter-card} Mohammed A. A. Abulela, MetaMetrics, Inc. / University of Minnesota *With co-authors Guher Gorgun (University of Georgia), Brian French (Washington State University), Brian Leventhal (James Madison University), and Matthew Gushta (MetaMetrics, Inc.).* **Slides:** [PowerPoint original](Assets/Mohammed_Abulela/NCME%20AI%20Panel.pptx) · [PDF, rendered copy](rendered/NCME_AI_Panel.pdf) · [slide text, transcribed](corpus/abulela-slides-transcribed.html)<br> **Bio:** [Word original](Assets/Mohammed_Abulela/Mohammed%20Abulela's%20Bio.docx) · [web version](corpus/abulela-bio.html) **Claim:** AI-related preparation should no longer be treated only as an optional extension of graduate training in educational measurement and psychometrics. It should become an intentional part of professional preparation, while remaining grounded in validity, fairness, measurement theory, and psychometrics. **Example:** Across 90 doctoral programs, qualifying computational or AI-related coursework was identified in only 16 (17.8%). Across 44 measurement-related job advertisements, 79.5% (35) included at least one computational or AI-related area. **Unresolved problem:** What is the minimum AI-related preparation that every future measurement professional should have? What should be required? What can remain elective? How do we integrate AI without displacing validity, fairness, and psychometric foundations? <span class="muted">Transcribed from the slide images.</span> ::: Discussant ::: {.presenter-card} Fred Oswald, University of California, Irvine Fred Oswald is Professor of Education at the University of California, Irvine; editor-in-chief of *Psychological Methods*; past president of the Society for Industrial and Organizational Psychology; past chair of both the APA Committee on Psychological Tests and Assessment and the National Academies Board on Human-Systems Integration, which produced *Human-AI Teaming*; and a former member of the National Artificial Intelligence Advisory Committee. He will synthesize the provocations, press the panel toward actionable norms, and critically examine the session's own use of AI moderation. <span class="muted">Adapted from the session proposal.</span> :::

He will synthesize the provocations, press the panel toward actionable norms, and critically examine the session's own use of AI moderation. <span class="muted">Adapted from the session proposal.</span> ::: What lain was given lain is the session's AI interlocutor. Its evidence base is the documents below plus the live transcript; it has no open-web retrieval. Every item is citable in public. | Owner | Documents | |---|---| | Damian Betebenner | the session proposal; his provocation statement and slides; [the chair's source checks](corpus/chair-source-checks.html) on claims in the panel materials; chair's notes on [participants and who holds the warrant](corpus/participants-and-warrant.html), [related AIME-Con sessions](corpus/related-aime-sessions.html) [reference frameworks for the norms](corpus/reference-frameworks.html) and [AI and the open sharing of ideas](corpus/open-sharing-of-ideas.html); a demonstration document derived from another presenter's poster (not posted; described in the open-sharing note) | | Derek Briggs | his provocation statement and slides | | Frank Rijmen | his provocation statement, bio, position brief, slides, and slide text with speaker notes | | Mohammed Abulela | his slides, slide text transcribed from the images, and bio | | Fred Oswald | none (his questions are his own) | The chair's source checks leave the panelists' materials unchanged. They check a few claims against public sources so that lain, the panel and the audience can contest them on the record. About the rendered copies PDF copies of the PowerPoint files were exported with Keynote. Frank Rijmen's slides were re-exported after a layout correction on 6 October. Rendered copies may still differ slightly from the originals in fonts, icon placement, or other layout details; the original files remain authoritative. The "web version" and "slide text" files contain text extracted from the originals, with formatting changes only. Mohammed Abulela's slide text was transcribed from the slide images.