Sorghum mosaic virus (SrMV, the genus Potyvirus of the family Potyviridae) is a causal agent of common mosaic in sugarcane and poses a threat to the global sugar industry. In this study, a total of 901 sugarcane leaf samples with mosaic symptom were collected from eight provinces in China and were detected via RT-PCR using a primer pair specific to the SrMV coat protein (CP). These leaf samples included 839 samples from modern cultivars (Saccharum spp. hybrids) and 62 samples from chewing cane (S. officinarum). Among these, 632 out of 901 (70.1%) samples were tested positive for SrMV. The incidences of SrMV infection were 72.3% and 40.3% in modern cultivars and chewing cane, respectively. Phylogenetic analysis showed that all tested SrMV isolates were clustered into three clades consisting of six phylogenetic groups based on 306 CP sequences (this study = 265 and GenBank database = 41). A total of 10 SrMV isolates from South America (the United States and Argentina) along with 106 isolates from China were clustered in group D, while the remaining 190 SrMV isolates from Asia (China and Vietnam) were dispersed in five groups. The SrMV isolates in group F were limited to Yunnan province in China, and those in group A were spread over eight provinces. A significant genetic heterogeneity was elucidated in the nucleotide sequence identities of all SrMV CPs, ranging from 69.0% to 100%. A potential recombination event was postulated among SrMV isolates based on CP sequences. All tested SrMV CPs underwent dominant negative selection. Geographical isolation (South America vs. Asia) and host types (modern cultivars vs. chewing cane) are important factors promoting the genetic differentiation of SrMV populations. Overall, this study contributes to the global understanding of the genetic evolution of SrMV and provides a valuable resource for the epidemiology and management of the mosaic in sugarcane.