The prevalence of diabetes mellitus is one of the major medical problems that the modern world is currently facing. Type 1 and Type 2 diabetes mellitus both result in early disability and death, as well as serious social and financial problems. In some cases, synthetic drugs can be quite effective in the treatment of diabetes, though they have side effects. Plant-derived pharmacological substances are of particular interest. This review aims to study the antidiabetic properties of secondary plant metabolites. Existing review and research articles on the investigation of the antidiabetic properties of secondary plant metabolites, the methods of their isolation, and their use in diabetes mellitus, as well as separate articles that confirm the relevance of the topic and expand the understanding of the properties and mechanisms of action of plant metabolites, were analyzed for this review. The structure and properties of plants used for the treatment of diabetes mellitus, including plant antioxidants, polysaccharides, alkaloids, and insulin-like plant substances, as well as their antidiabetic properties and mechanisms for lowering blood sugar, are presented. The main advantages and disadvantages of using phytocomponents to treat diabetes are outlined. The types of complications of diabetes mellitus and the effects of medicinal plants and their phytocomponents on them are described. The effects of phytopreparations used to treat diabetes mellitus on the human gut microbiota are discussed. Plants with a general tonic effect, plants containing insulin-like substances, plants-purifiers, and plants rich in vitamins, organic acids, etc. have been shown to play an important role in the treatment of type 2 diabetes mellitus and the prevention of its complications.