Assessing Observational Studies of Spinal Fusion and Chemonucleolysis

STUDY DESIGN: Literature review and survey of spine surgeons. OBJECTIVES: To identify reasons for variation in results among observational studies of spinal surgery. SUMMARY AND BACKGROUND DATA: Orthopedic treatments are often evaluated by observational studies rather than randomized controlled trials. The value of observational studies is debated. METHODS: A literature search was performed to find several observational studies that compared the same spinal surgeries. Possible confounders for these studies were identified by a survey of spinal surgeons. Study characteristics from these articles were tested for an association with study results. RESULTS: Most observational studies were case series. Articles studied in depth included 20 evaluating chemonucleolysis and 14 evaluating spinal arthrodesis for patients who had herniated disc or spinal stenosis. For each treatment comparison, results varied from strongly favoring one treatment to strongly favoring the other. Apparent causes of the variation were patient selection criteria, the choice of outcome measure, and follow-up rate. Few studies reported on the potential confounders identified by physician surveys, and only one study used statistical methods to reduce the influence of confounding. CONCLUSIONS: The results suggest that review of several comparable observational studies may help evaluate treatment, identify patient types most likely to benefit from a give treatment, and provide information about study features that can improve the design of subsequent observational or randomized controlled studies. The potential of comparative observational studies has not been realized because of current inadequacies in their design, analysis, and reporting.