Model Card Report Ontology

OntoBee AberOWL OLS Bioregistry

Model card reports are documents detailing transparent metadata information relating to machine learning models Mitchell, et al., 2019. Analogous with drug labels and nutritional labels, the goal of model cards are to communicate relevant information on all aspects of a machine learning model that have undergone any experimentation to stakeholders, developers, end-users, policy makers, etc. Typically they are short static documents that outline the machine learning models’ meta information (e.g.,name of the model, creators, licensing, versioning), performance and limitation information (e.g., evaluation metrics, datasets evaluated, training data), ethical particulars (e.g., risks, sensitive data, harm reduction), potential users (e.g., impacted users, primary users), etc.

The National Institutes of Health, through their Bridge2AI initiative, expressed interest in model cards as an artifact to communicate specifics and promote transparency for AI-based machine learning models in biomedical research. However, these reports are presented in static documents, and have the potential to impede any possible retrieval, analysis, and aggregation of these reports. Model card reports translated as RDF-based formats could help in this effort, including supplementing application tools to analyze AI-based machine learning models.

This work encodes the various structures of model card reports and align them to standard OBO Foundry ontologies (specifically the Information Artifact Ontology and the Software Ontology) to help formalize and enrich these documents, and essentially make these reports computable for indexing, searching and aggregation.