Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Narrative Landscape: Mapping Narrative Dispositions Across LLMs

About

This study proposes a quantitative framework for profiling LLM dispositions as stable, model-specific regularities in output under repeated, controlled elicitation. Using a structured narrative constraint-selection task administered across six frontier models and three instruction types, we operationalize disposition through two dimensions: "consistency", measured as cross-replication selection overlap via Jaccard similarity, and "diversity", measured as dispersion across options via the inverse Simpson index. We further introduce Narrative Landscape, a PCA-based visualization that maps each model's selection profile into a shared space for direct comparison. Results reveal a clear rigidity-exploration spectrum across model families and show that instruction types shift the geometry of selection spaces even when scalar metrics appear similar, indicating that comparable scores can mask qualitatively distinct selection topologies.

Donghoon Jung, Jiwoo Choi, Songeun Chae, Seohyon Jung• 2026

Related benchmarks

TaskDatasetResultRank
Narrative GenerationNarrative Constraints Dataset--
18
Showing 1 of 1 rows

Other info

Follow for update