Wigle, AugustineAugustineWigleBéliveau, AudreyAudreyBéliveauSalanti, GeorgiaGeorgiaSalanti0000-0002-3830-8508Rücker, GertaGertaRückerSchwarzer, GuidoGuidoSchwarzerMavridis, DimitrisDimitrisMavridisNikolakopoulou, AdrianiAdrianiNikolakopoulou2025-06-242025-06-242025-06https://boris-portal.unibe.ch/handle/20.500.12422/212318Network meta-analysis (NMA) is an extension of pairwise meta-analysis that facilitates the estimation of relative effects for multiple competing treatments. A hierarchy of treatments is a useful output of an NMA. Treatment hierarchies are produced using ranking metrics. Common ranking metrics include the Surface Under the Cumulative RAnking curve (SUCRA) and P-scores, which are the frequentist analogue to SUCRAs. Both metrics consider the size and uncertainty of the estimated treatment effects, with larger values indicating a more preferred treatment. Although SUCRAs and P-scores themselves consider uncertainty, treatment hierarchies produced by these ranking metrics are typically reported without a measure of certainty, which might be misleading to practitioners. We propose a new metric, Precision of Treatment Hierarchy (POTH), which quantifies the certainty in producing a treatment hierarchy from SUCRAs or P-scores. The metric connects three statistical quantities: The variance of the SUCRA values, the variance of the mean rank of each treatment, and the average variance of the distribution of individual ranks for each treatment. POTH provides a single, interpretable value that quantifies the extent of certainty in producing a treatment hierarchy. We show how the metric can be adapted to apply to subsets of treatments in a network, for example, to quantify the certainty in the hierarchy of the top three treatments. We calculate POTH for a database of NMAs to investigate its empirical properties, and we demonstrate its use on two published networks.enP‐scorenetwork meta‐analysisrankingsurface under the cumulative ranking curvetreatment hierarchyuncertainty600 - Technology::610 - Medicine & health300 - Social sciences, sociology & anthropology::360 - Social problems & social servicesarticle10.48620/887224054262210.1002/sim.70176