Measuring the openness of AI foundation models: competition and policy implications
Thibault Schrepel & Jason Potts
What the paper says
This paper provides the first comprehensive evaluation of AI foundation model licenses as drivers of innovation commons. We introduce our analysis by outlining how AI licenses regulate access privileges to the fundamental inputs of AI innovation commons. We show that AI licenses operate as a bottleneck, as their level of openness directly influences the flow of knowledge and information into the commons. We then introduce a new methodology for evaluating the openness of AI foundation models. Our methodology extends beyond purely technical considerations to more accurately reflect AI licenses’ contribution to innovation commons. We proceed to apply it to today’s most prominent models—including OpenAI’s GPT-4, Meta’s Llama 3, Google’s Gemini, Mistral’s 8×7B, and MidJourney’s V6—and find significant differences from existing AI openness rankings. We conclude by proposing concrete policy recommendations for regulatory and competition agencies interested in fostering AI commons based on our findings.
5 citations
Evidence weight
Balanced mode · F 0.40 / M 0.15 / V 0.05 / R 0.40
| F · citation impact | 0.41 × 0.4 = 0.16 |
| M · momentum | 0.63 × 0.15 = 0.09 |
| V · venue signal | 0.50 × 0.05 = 0.03 |
| R · text relevance † | 0.50 × 0.4 = 0.20 |
† Text relevance is estimated at 0.50 on the detail page — for your query’s actual relevance score, open this paper from a search result.