Review Articles

Risk of Bias Assessment in Non-Randomized Studies of Interventions for Premenstrual Syndrome: A Systematic Review


Objective: Premenstrual syndrome (PMS) is a very prevalent condition that affects premenopausal women and can result in monthly debilitating emotional and physical symptoms. The objective of this systematic review was to determine which predictive factors were associated with an increased amount of bias in non-randomized studies (NRSs) of PMS.
Materials and methods: A search of the EMBASE and Medline electronic databases was completed from January 1, 2010 to December 2021. The methodological quality of the included studies was independently evaluated and critically appraised using the Risk of Bias in Non-Randomized Studies - of Interventions (ROBINS-1) tool. Associations of different factors with the risk of bias levels were assessed using a univariate logistic regression. Odds ratio and 95% confidence interval (CI) were reported.
Results: Of the 1668 studies, 38 were determined to be eligible for inclusion. The ROBINS-1 tool identified that 12 studies were of low/moderate risk of bias (31.6%) and 26 were of serious/critical risk (68.4%). Evidence of relationships between the ROBINS-1 score and impact factor (OR=0.20; 95% CI, 0.07 to 0.57; p= 0.003) and number of authors (OR=0.65; 95% CI, 0.43 to 0.99; p= 0.046) were identified, whereas no relationships were found with the number of citations, the sample size, the funding type, or the conflict-of-interest statement.
Conclusion: The systematic review concludes that the methodological rigor of non-randomized studies of PMS can vary, with fewer authors and a lower impact factor showing evidence of association with a decreased quality of evidence.

1. Fernández MDM, Saulyte J, Inskip HM, Takkouche B. Premenstrual syndrome and alcohol consumption: a systematic review and meta-analysis. BMJ Open 2018; 8: e019490.
2. Rapkin AJ, Winer SA. Premenstrual syndrome and premenstrual dysphoric disorder: quality of life and burden of illness. Expert Rev Pharmacoecon Outcomes Res 2009; 9: 157–70.
3. O’Brien PMS, Bäckström T, Brown C, Dennerstein L, Endicott J, Epperson CN, et al. Towards a consensus on diagnostic criteria, measurement and trial design of the premenstrual disorders: the ISPMD Montreal consensus. Arch Womens Ment Health 2011; 14: 13–21.
4. Jarosz AC, Jamnik J, El-Sohemy A. Hormonal contraceptive use and prevalence of premenstrual symptoms in a multiethnic Canadian population. BMC Women’s Health 2017; 17: 87.
5. Halbreich U, Backstrom T, Eriksson E, O’Brien S, Calil H, Ceskova E, et al. Clinical diagnostic criteria for premenstrual syndrome and guidelines for their quantification for research studies. Gynecol Endocrinol 2007; 23: 123–30.
6. Reeves BC. Principles of research: limitations of non-randomized studies. Surgery (Oxford) 2008; 26: 120–4.
7. Sørensen HT, Lash TL, Rothman KJ. Beyond randomized controlled trials: A critical comparison of trials with nonrandomized studies. Hepatology 2006; 44: 1075–82.
8. Odierna DH, Forsyth SR, White J, Bero LA. The cycle of bias in health research: a framework and toolbox for critical appraisal training. Account Res 2013; 20: 127-41.
9. Naci H. What to do (or not to do) when randomization is not possible. J Heart Lung Transplant 2017; 36: 1174-7.
10. Moher D, Liberati A, Tetzlaff J, G Altman D, Prisma Group . Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. BMJ 2009; 339: b2535.
11. Sterne JA, Hernán MA, Reeves BC, Savović J, Berkman ND, Viswanathan M, et al. ROBINS-I: a tool for assessing risk of bias in non-randomised studies of interventions. BMJ 2016; 12; 355: i4919.
12. R Core Team (2020). R: A language and environment for statistical computing. R Foundation for Statistical Computing, Vienna, Austria.URL
13. Anil A, Peker T, Göktaş T, Kilic S, Erbaş D. Importance of acupuncture on premenstrual syndrome. Clin Exp Obstet Gynecol 2012; 39: 209–13.
14. Anwar S, Shami N, Asif S. Use of Low Dose Danazol in Luteal Phase Only as Management of Premenstrual Syndrome and Mastalgia. PJMHS 2015; 9.
15. Bakay.K, Ulubaşoğlu H, Atan T, Alaçam H, Güven D, Batioğlu S. The effect of physical activity on the levels of the hormones, serotonin and melatonin in premenstrual syndrome. Clinical and Experimental Obstetrics & Gynecology 2018; 10: 425–7.
16. Bertone-Johnson ER, Chocano-Bedoya PO, Zagarins SE, Micka AE, Ronnenberg AG. Dietary vitamin D intake, 25-hydroxyvitamin D3 levels and premenstrual syndrome in a college-aged population. J Steroid Biochem Mol Biol 2010; 121: 434–7.
17. Chai N, Wu Y, Zhang M, Wu W-B, Zhang H, Kong F-W, et al. Remote intervention using smartphone for rural women suffering from premenstrual syndrome: A propensity score matched analysis. Medicine (Baltimore) 2018; 97: e11629.
18. Chen BF, Powell MC, O’Beirne C. An observation study of the clinical evaluation of symptom relief and side effects associated with taking ulipristal acetate (esmya) including its effect on pre-menstrual syndrome. J Obstet Gynaecol 2017; 37: 645–8.
19. Chung M-S, Kim G-H. Effects of Elsholtzia splendens and Cirsium japonicum on premenstrual syndrome. Nutr Res Pract 2010; 4: 290-4.
20. Crow E, Jeannot E. Premenstrual syndrome: Symptomatic and diagnosed prevalence, dualistic treatment approach – A cross-sectional study in Ukraine. Int J Prev Med 2017; 8: 66.
21. Danno K, Colas A, Terzan L, Bordet M-F. Homeopathic treatment of premenstrual syndrome: a case series. Homeopathy 2013; 102: 59–65.
22. Ekenros L, Hirschberg AL, Bäckström T, Fridén C. Postural control in women with premenstrual symptoms during oral contraceptive treatment. Acta Obstet Gynecol Scand 2011; 90: 97–102.
23. ama CRB, Lasmar R, Gama GF, Oliveira L, Ribeiro MG, Geller M. Premenstrual syndrome: Clinical assessment of treatment outcomes following Borago officinalis extract therapy. Revista Brasileira de Medicina 2014; 71: 211-217.
24. Can Gürkan Ö, Türk Öğün S, Potur DK, Kömürcü N. The Effect of A Sleep Hygiene Interventions in Women with Premenstrual Syndrome. Zeynep Kamil Tıp Bülteni 2017; 48: 162-7.
25. Horbatiuk O, Binkovska A, Herych O, Ropotan A, Zhylko N, Mandziy I, et al. Using micronized progesterone for treatment of premenopausal age women suffering from severe premenstrual syndrome. Current Issues in Pharmacy and Medical Sciences 2017; 30: 138–41.
26. Itsekson AM, Soriano D, Zolti M, Seidman DS, Carp HJA. Intradermal sex hormone desensitization for relief of premenstrual symptoms may improve the obstetric outcome of women with recurrent pregnancy loss. Gynecol Endocrinol 2013; 29: 169–72.
27. Jang D, Kim MD, Lee SJ, Kim IJ, Park SI, Won JY, et al. The Effect of Uterine Artery Embolization on Premenstrual Symptoms in Patients with Symptomatic Fibroids or Adenomyosis. J Vasc and Interv Radiol 2014; 25: 833-38.
28. Johny M, Kumar SS, Rajagopalan A, Mukkadan JK. Vestibular stimulation for management of premenstrual syndrome. J Nat Sci Biol Med 2017; 8: 82–6.
29. Kamagata E, Yamada K. Improvements in Quality-Adjusted Life Years and Cost-Utility after Pharmacotherapy for Premenstrual Dysphoric Disorder: A Retrospective Study. Clin Drug Investig 2018; 38: 49-55.
30. Klein-Laansma CT, Jansen JCH, van Tilborgh AJW, Van der Windt DAWM, Mathie RT, Rutten ALB. Semi-standardised homeopathic treatment of premenstrual syndrome with a limited number of medicines: Feasibility study. Homeopathy 2010; 99: 192–204.
31. Lamarche LJ, Driver HS, Forest G, De Koninck J. Napping during the late-luteal phase improves sleepiness, alertness, mood and cognitive performance in women with and without premenstrual symptoms. Sleep and Biological Rhythms 2010; 8: 151–9.
32. Lukes AS, McBride RJ, Herring AH, Fried M, Sherwani A, Dell D. Improved Premenstrual Syndrome Symptoms after NovaSure Endometrial Ablation. J Minim Invasive Gynecol 2011; 18: 607–11.
33. Maddineshat M, Keyvanloo S, Lashkardoost H, Arki M, Tabatabaeichehr M. Effectiveness of Group Cognitive-Behavioral Therapy on Symptoms of Premenstrual Syndrome (PMS) ‎. Iran J Psychiatry 2016; 11: 30–6.
34. Marcinko I, Torjanac M. The Difference in the Severity of Premenstrual Symptoms between Users and Non-users of Oral Contraceptives. Coll Antropol 2015; 39: 855–62.
35. Merki-Feld GS, Hund M. Clinical experience with the combined contraceptive vaginal ring in Switzerland, including a subgroup analysis of previous hormonal contraceptive use. The European Journal of Contraception & Reproductive Health Care 2010; 15: 413-22.
36. Momoeda M, Sasaki H, Tagashira E, Ogishima M, Takano Y, Ochiai K. Efficacy and Safety of Vitex agnus-castus extract for Treatment of Premenstrual Syndrome in Japanese Patients: A Prospective, Open-label Study. Adv Ther 2014 Mar; 31: 362–73.
37. Norouzi Javidan A, Haghollahi F, Ramezanzadeh F, Yekaninejad MS, Amiri Z, Noroozi M, et al. Effects of ethinyl estradiol plus desogestrel on premenstrual symptoms in Iranian women. Acta Med Iran 2014; 52: 837–43.
38. Nyberg S. Mood and physical symptoms improve in women with severe cyclical changes by taking an oral contraceptive containing 250-mcg norgestimate and 35-mcg ethinyl estradiol. Contraception 2013; 87: 773–81.
39. Pang Y, Liu H, Duan G, Liao H, Liu Y, Feng Z, et al. Altered Brain Regional Homogeneity Following Electro-Acupuncture Stimulation at Sanyinjiao (SP6) in Women with Premenstrual Syndrome. Front Hum Neurosci 2018; 12: 104.
40. Scordalakes C, delRosario R, Shimer A, Stankiewicz R. Efficacy and patient satisfaction after NovaSure and Minerva endometrial ablation for treating abnormal uterine bleeding: a retrospective comparative study. Int J Womens Health 2018; 10: 137–45.
41. Segebladh B, Bannbers E, Moby L, Nyberg S, Bixo M, Bäckström T, et al. Allopregnanolone serum concentrations and diurnal cortisol secretion in women with premenstrual dysphoric disorder. Arch Womens Ment Health 2013; 16: 131–7.
42. Sharma B, Misra R, Singh K, Sharma R, Archana null. Comparative study of effect of anuloma-viloma (pranayam) and yogic asanas in premenstrual syndrome. Indian J Physiol Pharmacol 2013; 57: 384–9.
43. Steinberg EM, Cardoso GMP, Martinez PE, Rubinow DR, Schmidt PJ. Rapid response to fluoxetine in women with premenstrual dysphoric disorder. Depress Anxiety 2012; 29: 531–40.
44. Takeda T, Imoto Y, Nagasawa H, Takeshita A, Shiina M. Fish Consumption and Premenstrual Syndrome and Dysphoric Disorder in Japanese Collegiate Athletes. J Pediatr Adolesc Gynecol 2016; 29: 386–9.
45. Takeda T, Kondo A, Koga S, Hayakawa J, Hayakawa K, Hiramatsu K, et al. Effectiveness of ethinylestradiol/drospirenone for premenstrual symptoms in Japanese patients with dysmenorrhea: Open-label pilot study: Ethinylestradiol/drospirenone for PMS. J Obstet Gynaecol Res 2015; 41: 1584–90.
46. Tjandrawinata RR, Nofiarny D, Susanto LW, Hendri P, Clarissa A. Symptomatic treatment of premenstrual syndrome and/or primary dysmenorrhea with DLBS1442, a bioactive extract of Phaleria macrocarpa. Int J Gen Med 2011; 4: 465–76.
47. Tsai F-H, Chu I-H, Lin T-Y, Liang J-M, Hsu H-T, Wu W-L. Preliminary evidence on the effect of Yoga on the reduction of edema in women with premenstrual syndrome. European Journal of Integrative Medicine 2017; 9: 63–8.
48. 48.Tsai SY. Effect of Yoga Exercise on Premenstrual Symptoms among Female Employees in Taiwan. Int J Environ Res Public Health 2016; 13: 721.
49. Wu W-L, Lin T-Y, Chu I-H, Liang J-M. The Acute Effects of Yoga on Cognitive Measures for Women with Premenstrual Syndrome. J Altern Complement Med 2015; 21: 364–9.
50. Zhang H, Zhu M, Song Y, Kong M. Baduanjin exercise improved premenstrual syndrome symptoms in Macau women. J Tradit Chin Med 2014; 34: 460–4.
51. Saha S, Saint S, Christakis DA. Impact factor: a valid measure of journal quality? J Med Libr Assoc. 2003; 91: 42–6.
52. Tahamtan I, Safipour Afshar A, Ahamdzadeh K. Factors affecting number of citations: a comprehensive review of the literature. Scientometrics 2016; 107: 1195–225.
IssueVol 16, No 2 (June 2022) QRcode
SectionReview Articles
Premenstrual Syndrome Non-Randomized Controlled Trials Systematic Review

Rights and permissions
Creative Commons License This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
How to Cite
Tehfe H, Chow R, Li S, Kim P, Samari S, Hayawi L, Webster R, Ben Fadel N. Risk of Bias Assessment in Non-Randomized Studies of Interventions for Premenstrual Syndrome: A Systematic Review. J Family Reprod Health. 2022;16(2):93-101.