From Instructions to ODRL Usage Policies: An Ontology Guided Approach
About
This study presents an approach that uses large language models such as GPT-4 to generate usage policies in the W3C Open Digital Rights Language ODRL automatically from natural language instructions. Our approach uses the ODRL ontology and its documentation as a central part of the prompt. Our research hypothesis is that a curated version of existing ontology documentation will better guide policy generation. We present various heuristics for adapting the ODRL ontology and its documentation to guide an end-to-end KG construction process. We evaluate our approach in the context of dataspaces, i.e., distributed infrastructures for trustworthy data exchange between multiple participating organizations for the cultural domain. We created a benchmark consisting of 12 use cases of varying complexity. Our evaluation shows excellent results with up to 91.95% accuracy in the resulting knowledge graph.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| ODRL generation | ODRL 770-use-case Complex - Recursive | Grammar Score96.32 | 12 | |
| ODRL generation | ODRL 770-use-case (ALL Use Cases) | Grammar Score94.83 | 12 | |
| ODRL generation | ODRL 770 Simple Use Cases | Grammar Score96.14 | 12 | |
| ODRL generation | ODRL 770-use-case Complex - Parallel | Grammar Score92.23 | 12 |