Sweet sorghum silage (SS; Sorghum dochna 'Dochna') has been extensively studied in recent years as a supplementary forage-to-corn silage (CS; Zea mays L.), but there are still relatively few studies on its effects on the rumen environment of sheep. Determining the short-term impact of converting roughage from corn straws to SS compared to CS on rumen fermentation and bacterial population dynamics was the main goal of the current study. Twelve female thin-tailed Han sheep (29.8 ± 1.34 kg) were randomly divided into one of two treatments: concentrate supplemented with SS or CS, respectively. During the 15-day pretest period, concentrate was fed in two separate feedings at 0800 h and 1800 h, and ensure that the animals were all consumed within an hour of being fed. Thereafter, the animals had free access to corn straw. The feeding procedures during the pretest period were the same as during the measurement period. Rumen fluid was collected via sheep esophageal tube on the last day of adaptation phase (1-7 days) and stabilisation phase (8-30 days), respectively. The results showed that there was a similarity in the total concentration of VFA (volatile fatty acid) and the proportions of acetate, propionate, butyrate, and branched-chain VFA (P > 0.05) and microbial diversity indices (P > 0.05) between the two silage groups throughout the experimental period. The concentration of Ammonia nitrogen (P = 0.001) and proportion of valerate (P = 0.028) decreased in the CS and SS groups, respectively. The abundance and predicted function of rumen bacteria in the SS group did not differ significantly (P > 0.05) between the two measurement phases. However, the abundance of Prevotella_1 (P = 0.038) was higher in the CS group than in the SS group at 7 d. The abundances of Firmicutes (P = 0.005) and Ruminococcaceae_NK4A214_group (P = 0.002) increased, while the abundances of Bacteroidetes (P = 0.044), Proteobacteria (P = 0.046), and Prevotella_1 (P = 0.009) decreased in the CS group at 30 d. Genes related to pyruvate metabolism (P = 0.020) were significantly higher at 30 d than at 7 d, whereas purine metabolism (P = 0.007), pyrimidine metabolism (P = 0.007), and metabolic pathways (P = 0.010) were lower at 30 d in the CS group. In conclusion, this study indicated that SS maintained a steady rumen environment, while CS caused high fluctuations in bacterial abundance and predicted function for sheep.