Small RNA has become a crucial regulator of protein synthesis during spermatogenesis. Alterations in small RNA function prove to be detrimental to proper spermatogenesis. As many patients suffer from idiopathic infertility, understanding the molecular mechanisms of small RNA identifies possible causes of certain types of infertility. With a comprehensive review of the history of miRNA and piRNA function and specificity in the testis from a wide range of studies offers a view of detrimental defects of small RNA. By combining a concise overview of small RNA mechanism and recent research we explain how some cases of male infertility can be a product of complications in specific small RNA functions. The future direction section offers insight into how infertility treatment may be approached with a novel perspective.