Identifying spatially variable genes (SVGs) is a key step in the analysis of spatially resolved transcriptomics (SRT) data. SVGs provide biological insights by defining transcriptomic differences within tissues, which was previously unachievable using RNA-sequencing technologies. However, the increasing number of published tools designed to define SVG sets currently lack benchmarking methods to accurately assess performance. This study compares results of 5 purpose-built packages for SVG identification across 8 public and 3 simulated datasets and highlights discrepancies between results. Additional tools for generation of simulated data and development of benchmarking methods are required to improve methods for identifying SVGs.