Large randomized clinical trials or aggregates of clinical trials represent the highest levels of clinical evidence because they minimize different sources of confounding and bias. The current review provides an in-depth discussion of the challenges faced and methods we can use to overcome these obstacles to tailor novel designs of pragmatic effectiveness trials to pain medicine. The authors describe their experiences with an open-source learning health system to collect high-quality evidence and conduct pragmatic clinical trials within a busy academic pain center.