Water polo players benefit from greater odds of success when maintaining their tactical position against their opponents. This study evaluated the reliability and validity of a water-based resistance test to replicate this skill.Thirty-three water polo players participated in this study (19 males and 14 females, 14 from senior and 19 from junior national teams). Data were collected during two regular training sessions, separated by one week, using a load cell to instrument a weight stack resistance setup on the pool deck. Performance parameters such as mean force, maximum force, mean peak force and total impulse were defined with custom Python scripts. Test-retest reliability was assessed using intra-class correlations (ICC3,1). Group comparisons were explored between male and female players. Level of significance was set at p < 0.05. The reliability findings were high to very high for the mean force, maximum force, mean peak force, inter-stroke range, and total impulse (ICC 0.85-0.93, p < 0.01). Group comparisons showed significantly greater values in male players for these variables (p < 0.01, ES = 1.05-9.36) with large to very large effect sizes. However, there was no significant difference in endurance measured between sexes (p = 0.88, ES = 0.04). This study presents a methodology with satisfactory metrological qualities for field applications using simple and affordable equipment. The testing apparatus presented in this study can readily be replicated in a variety of training environments by practitioners working with water polo teams. Coaches can use this approach to evaluate individual player progress or to compare performance across a group of water polo players.