Recent studies report that the gut microbiome can enhance systemic and antitumor immunity by modulating responses to antibody immunotherapy in melanoma patients. In this study, we found that icariside I, a novel anti-cancer agent isolated from Epimedium, significantly inhibited B16F10 melanoma growth in vivo through regulation of gut microbiota and host immunity. Oral administration of icariside I improved the microbiota community structure with marked restoration of Lactobacillus spp. and Bifidobacterium spp. abundance in the cecal contents of tumor-bearing mice. We also found that icariside I improves the levels of microbiota-derived metabolites such as short-chain fatty acids (SCFAs) and indole derivatives, consequently promoting repair of the intestinal barrier and reducing systemic inflammation of tumor-bearing mice. Icariside I exhibited strong immunological anti-tumor activity, directly manifested by up-regulation of multiple lymphocyte subsets including CD4+ and CD8+ T cells or NK and NKT cells in peripheral blood of tumor-bearing mice. Collectively, these results suggest that icariside I, via its microbiome remodeling and host immune regulation properties, may be developed as an anticancer drug.