Resource

X-PHI Transparency & Quality of Reporting Inventory

Field-specific inventory for assessing whether experimental philosophy papers report the information needed for replicability, reproducibility, interpretability, generalizability, and meta-analysis.

Experimental philosophy does not yet have reporting standards comparable to those used in fields such as medicine, psychology, or neuroscience. The X-PHI TQRI was developed to make reporting quality in the field visible, comparable, and open to systematic assessment.

Within the project, the inventory is being used in a large-scale survey study of papers sampled from PhilPapers, while the explorer provides a public view of the coded results by section of the inventory and by individual question.

Open inventory Open result explorer

Project records and code

OSF project record
Public OSF project for the survey study on transparency and quality of reporting in experimental philosophy.
OSF pre-registration
Public preregistration describing the study questions, sampling procedure, coding plan, and analyses.
GitHub repository
Repository for the survey study, including sampling, prescreening, and inventory materials.

Tool preview

Inventory and explorer

Logged-in view of the X-PHI Transparency and Quality of Reporting Inventory showing the example paper and the transparency section.

Inventory interface

Logged-in view of the example paper, showing how the inventory is organized into sections and item-level coding criteria.

Dashboard view of the Metacoder Explorer with tabs and reporting-quality visualizations.

Explorer dashboard

The explorer visualizes coded results and lets users inspect patterns by inventory part and by individual question.

Inventory and explorer

What you can access here

An inventory with roughly 100 questions covering transparency, theoretical background, methods, results, and conclusions.
Coding criteria designed to track whether papers report the information needed for replication, data reuse, and meta-analysis.
An explorer for reviewing the coded material by inventory section and by individual item.
Linked OSF and GitHub records documenting the study design, repository structure, and project materials.

Related output

ESPP 2025 poster

The inventory is discussed in the ESPP 2025 poster on whether experimental philosophy is ready for meta-analyses.

Open conference page