Applying a statistical method in transvaginal ultrasound training: lessons from the learning curve cumulative summation test (LC-CUSUM) for endometriosis mapping
© The Author(s). 2017
Received: 1 July 2017
Accepted: 8 September 2017
Published: 3 October 2017
Methods available for assessing the learning curve, such as a predefined number of procedures or direct mentoring are lacking. Our aim was to describe the use of a statistical method to identify the minimal training length of an experienced sonographer, newly trained in deep infiltrating endometriosis (DIE) mapping by evaluating the learning curve of transvaginal ultrasound (TVUS) in the preoperative assessment of endometriosis.
A retrospective study in a tertiary referral center for endometriosis. Reports and stored data from TVUS scans performed by one operator with training in general gynecological ultrasound, but not in endometriosis mapping, were analyzed retrospectively for patients who subsequently underwent laparoscopy, which served as a reference standard. The performance of TVUS was assessed for the following sites: endometriomas, bladder, vagina, pouch of Douglas, bowel and uterosacral ligaments, and correlated with laparoscopic findings. Sensitivity, specificity, PPV, NPV, and accuracy were calculated, and the operator’s diagnostic performance was assessed using the learning curve cumulative summation test (LC-CUSUM).
Data from 94 women were available for analysis. The learning curve using the LC-CUSUM graph showed that the sonographer reached the predefined level of proficiency in detecting endometriosis lesions after 20, 26, 32, 31, 38, and 44 examinations for endometriomas, bladder nodules, vaginal nodules, pouch of Douglas obliteration, bowel nodules, and uterosacral ligament nodules, respectively.
LC-CUSUM allows monitoring of individual performance during the learning process of new methodologies. This study shows that a sonographer trained in general gynecologic ultrasonography, who devotes time to learn TVUS for DIE mapping, can achieve proficiency for diagnosing the major types of endometriotic lesions after examining less than 50 patients who subsequently undergo surgery in a training setting.
KeywordsTransvaginal ultrasound Endometriomas Deep infiltrative endometriosis Learning curve LC-CUSUM Individualized assessment
Endometriosis is a common benign gynecological condition with a prevalence rate of up to 15%  in reproductive age women. It is defined as the presence of endometrial tissue, glands and stroma outside the endometrial cavity. The clinical manifestations of endometriosis vary widely and may include secondary dysmenorrhea, chronic pelvic pain, dyspareunia, dyschezia, intermittent diarrhea and constipation, hematochezia, dysuria, pain on urination, irritable bladder, and hematuria. The mean age at diagnosis of endometriosis is 25–29 years and may be higher in women who present with infertility rather than pelvic pain . Deep infiltrating endometriosis (DIE) is defined as endometriotic lesions that penetrate more than 5 mm from under the peritoneum . These may be multifocal and are most commonly found in the uterosacral ligaments, posterior vaginal fornix, retro cervical region, rectovaginal septum, vesicouterine pouch, bladder, and anterior wall of the recto sigmoid.
The available pre-operative diagnostic tools include the patient’s history, pelvic examination, transvaginal ultrasonography (TVUS), and magnetic resonance imaging (MRI) [3, 4]. A negative imaging workup does not exclude endometriosis. An average diagnostic delay from symptom onset till definitive diagnosis can be up to 12 years [5, 6]. Chronic pelvic pain and infertility significantly affect the patient’s quality of life and carry a high economic burden . It is imperative that a prompt and accurate diagnosis is reached in order to bypass the diagnostic delay and refer patients for adequate care by endometriosis specialists in dedicated centers , to improve counseling and preoperative preparation and to determine the multidisciplinary team to be present in order to allow definitive surgical treatment.
While it is recognized that TVS should be the first-line imaging examination for the preoperative work-up of patients , its performance for diagnosing endometriosis and more specifically endometriomas, has been shown to be accurate only in the hands of experienced sonographers [3, 10–14]. Most experienced sonographers will easily identify endometriotic cysts [4, 12, 13], whereas sonographic diagnosis of DIE lesions requires skill and dedication, after which reported accuracy can be as high as 99% [3, 4, 8–11, 14]. The determination of how much experience is required to reach proficiency in the diagnosis of DIE is extremely important for planning training programs, and is not sufficiently known [4, 8].
Biau et al. introduced the learning curve cumulative summation test (LC-CUSUM) that was specifically designed to determine when a level of proficiency has been reached. The LC-CUSUM is a statistical tool which is performed in order to indicate when a process has reached a predefined level of performance [15–17]. The importance of establishing a learning curve is significant for quality assurance, patient safety, and cost analysis, and has been previously described for varied procedures, in surgery and in obstetrics and gynecology.
The purpose of this study was to determine the learning curve of TVUS in the preoperative assessment of endometriosis and in particular DIE by an experienced sonographer, newly trained in endometriosis mapping.
This study evaluated the performance of dedicated TVUS for the diagnosis of endometriosis and DIE. All the examinations were performed by the same sonographer with previous experience in gynecological ultrasound but without previous experience in DIE mapping expect for an introductory course. She had previously performed more than 10,000 gynecological general examinations over the years but had not performed dedicated endometriosis scanning apart from the incidental endometriomas and no specific DIE scanning. She had undergone training and learning DIE mapping as described by previous authors [3, 8–11, 14] during 2010–2011. Starting from May 2011, all patients referred to our endometriosis center underwent TVS as preoperative assessment. Out of 250 patients who were examined during the study period, the 94 who underwent surgery at our institution were included in the analysis. The remaining women either did not qualify for surgery or were operated on at another institution. The indications for surgery were intractable pain or infertility. The patient’s clinical history and symptoms were obtained from the electronic hospital records. These data included patient’s age, body mass index (BMI, kg/m2), parity, previous cesarean sections, smoking history, dysmenorrhea, dyspareunia, urinary and gastrointestinal symptoms, infertility history, fertility treatment and type, and number of previous IVF cycles.
The TVUS were carried out using a transvaginal 5–9 MHz probe with 2D/3D capabilities (Voluson 730 or E6, GE Medical Systems). Images were interpreted in real-time and were stored for later analysis. The examination was performed in a standardized way for all patients. This included a thorough evaluation of all pelvic viscerae, for lesions consistent with endometriosis: endometriomas, tubal adhesions, vagina, posterior and lateral vaginal fornices, the retro cervical area with torus uterinum, the parametria laterally, the rectovaginal septum, the bowel, peritoneal surfaces, bladder and vesicouterine pouch, and uterosacral ligaments, as previously described by other authors [18–20]. Organ mobility was evaluated in the anterior and posterior compartment. Movement of the posterior surface of the uterus, cervix or vagina in relation to the bowel was examined in order to determine pouch of Douglas obliteration, previously described as the “sliding sign” [21, 22]. For a more thorough description of the methodology, please refer to the Appendix.
The reference standard for diagnosis was defined as surgical findings during laparoscopy. Success of the ultrasound procedure was defined as agreement between TVUS findings and surgical findings. All of the patients underwent laparoscopic surgery by trained endoscopic surgeons in a multidisciplinary team which included also urological and colorectal surgeons as required. Pelvic endometriosis was diagnosed based on any of the following: presence of endometrial tissue (endometrial glands and stroma) in pathological examination in at least one resected lesion, direct visualization of deep pelvic lesions of endometriosis associated with only fibrosis at biopsy, direct visualization of deep pelvic lesions of endometriosis which could not be resected, or complete cul-de-sac obliteration secondary to endometriosis which was deemed unresectable, because of a significant surgical risk to adjacent structures. The severity of endometriosis at surgery was evaluated retrospectively by one of the co-authors who were blinded to the ultrasound report, based on the Revised American Society for Reproductive Medicine (ASRM) Classification  and the histo-pathological reports were reviewed. The findings at TVUS were compared with the descriptive visual findings at surgery. Pathological confirmation of the presence of endometriosis in resected lesions was obtained later but was not a prerequisite for inclusion as surgical findings are those that determine severity.
Statistical analysis was performed using SPSS software (SPSS, IBM Corporation, Chicago, IL, USA). Continuous variables were expressed as means ± SD or medians, while categorical variables were expressed as frequencies and percentages. Sensitivity, specificity, positive predictive value (PPV), negative predictive value (NPV), and accuracy were calculated for the diagnosis of endometriomas, bladder nodules, vaginal nodules, pouch of Douglas obliteration, bowel nodules (including rectum, sigma, and Douglas pouch), and uterosacral ligament nodules with the results of laparoscopic surgery as the reference standard for diagnosis. The analysis was performed by anatomic location. Statistical significance was set at P < 0.05.
A standard CUSUM test monitors a sequential procedure with ability to reject the null hypothesis H0 that the process is in control , while the alternative hypothesis H1 is that the process is out of control. The process is deemed acceptable as long as the CUSUM score remains below a limit known as h. The learning curve summation (LC-CUSUM) test was used to assess whether the process has reached a predefined level of performance by signaling when the process can be considered to be in control [16, 17]. The LC-CUSUM sequentially tests the inverted hypotheses, the null hypothesis, namely, inadequate performance (H0), against the alternative hypothesis, namely, adequate performance (H1). It computes a score, from the successive outcomes, with successes yielding an increase in the score and failures yielding a decrease in the score, i.e., negative scores for correct interventions and positive scores for incorrect results are calculated as previously reported by Biau et al. [16, 17]. Once the summation score reaches a predefined level (h), the test rejects the null hypothesis in favor of the alternative hypothesis, which indicates an adequate performance level. The LU-CUSUM remains responsive at all times, so that as performance improves the trainee do not need to compensate unnecessarily for previous failures. Acceptable (P 1) and unacceptable (P 0) failure rates, the required level of performance and the properties of the test have to be set. Acceptable and unacceptable failure rates for this study were set at 10% (P 1 = 0.10) and 25% (P 0 = 0.25), respectively. These limits were chosen assuming that the pooled failure rates for an expert examiner could be around 10–25%, taking into account both false positive and false negative results. The failure rates were chosen based on the accuracy of TVUS for diagnosing endometriomas and DIE in experienced hands [24–26]. Type I (α) and type II (β) error rates were set at 0.1. A limit h = 2.0 was chosen from computer simulations which means that the risk of declaring a trainee proficient when his or her performance is inadequate was limited to 10% over 100 procedures. CUSUM values are plotted on the y-axis, and the number of examinations is plotted on the x-axis. Horizontal lines are plotted at regular intervals on the y-axis, defining h0 and h1 for the spacing between acceptable and unacceptable boundary lines, respectively. Competence is declared when the plot falls below two consecutive boundary lines.
Ethical approval was given from our local research ethics committee. Informed consent was not required as the ultrasound assessment was offered as part of standard clinical care at our center.
Demographic data and symptoms in 94 patients who underwent transvaginal sonography (TVUS) and subsequent laparoscopic surgery for endometriosis
Value (n = 94)
Age, mean ± SD, years (range)
34.1 ± 6.0 (20–47)
BMI, mean ± SD, kg/m2 (range)
23.6 ± 4.8 (16.9–40.2)
Parity, median (range)
Previous cesarean section (%)
Urinary complaints (%)
Gastrointestinal complaints (%)
Previous IVF treatments (%)
Number of IVF cycles, median (range)
Surgical findings in 94 patients with pelvic endometriosis. Sensitivity, specificity, PPV, NPV, and accuracy for TVUS findings and agreement with endometriosis findings at laparoscopy
(n = 94)
Pouch of Douglas obliteration
Bowel lesions (rectum, sigma, POD)
There were 57 endometriomas at surgery. The sonographer diagnosed all of the endometriomas correctly. There were also other lesions including one borderline serous tumor, one peritoneal cyst, one corpus luteum cyst, and one multicystic benign mesothelioma with decidual changes. None of these lesions was mistaken for an endometrioma, and they were all recognized as other lesions. Based on the LU-CUSUM curve it, takes the sonographer 20 examinations to become proficient at diagnosing endometriomas correctly.
Pouch of Douglas obliteration
Forty-eight (51.1%) of women had pouch of Douglas obliteration. The graphs for vaginal nodules and pouch of Douglas obliteration are very similar. There were three false negative diagnoses, which were the same cases described above. There were four false positives by the sonographer. Based on the LU-CUSUM curve, it takes the sonographer 31 examinations to become proficient at diagnosing pouch of Douglas obliteration correctly.
Fifty patients had lesions in at least one of the uterosacral ligaments, which the sonographer diagnosed correctly in 65% of the patients. There were 20 false negative diagnosis by the sonographer were the lesions were deep in adhesions so that the uterosacral ligament was poorly visualized. Not all were resectable and were thus determined based on visualization during surgery. There were 13 false positives where lesions were assumed to occur in large conglomerates of adhesions but were not found after the adhesions were dissolved. In both of these situations, this did not affect the actual surgical procedure which was determined by the presence of vaginal, bowel nodules or pouch of Douglas obliteration. Based on the LU-CUSUM curve, it takes the sonographer 44 examinations to become proficient at diagnosing uterosacral ligament lesions correctly.
TVUS is increasingly utilized in the many developing subspecialties of gynecological imaging. Some of these fields entail specialized and structured training programs. Ultrasound diagnosis of endometriosis is such a developing field and is now considered to be the first-line imaging modality for disease mapping . Despite this, it is not widely known up to this time how many clinical examinations are required in order to train an experienced ultrasonographer to be proficient in endometriosis imaging. This study shows that a sonographer trained in general gynecological ultrasound, who devotes time to learn TVUS for DIE mapping, can apparently achieve proficiency for diagnosing the varied types of endometriotic lesions within 44 examinations provided that the patient subsequently undergoes surgery and that feedback is available.
Learning a new procedure carries the risk of unacceptable standards, therefore continuous supervision and monitoring is required until an acceptable level of performance is reached. Several factors may influence the learning process, these being the procedure, the trainee, the mentor, the setting, all of which will affect the time and number of procedures required to complete the learning process .
Tammaa et al.  recently described the length of time required to become proficient in diagnosing pouch of Douglas obliteration and deep infiltrating endometriosis of the rectum with TVUS. However, their study defined the expert sonographer as the reference standard rather than laparoscopic surgery . Bazot et al.  described their results of the learning curve of four inexperienced trainees in the diagnosis of endometriomas, finding LC-CUSUM to be adequate for this purpose, but their reference standard was also the expert sonographer rather than surgery . Saba et al.  described the learning curve in the detection of ovarian and deep endometriosis by using MRI findings and by comparing them with surgical results. In this retrospective study, datasets were analyzed by the same performer before surgery and re-analyzed 12 and 24 months later to determine proficiency and results were compared between the analyses. They found that the performer’s expertise over time increased diagnostic accuracy, but that it takes at least 1 year of intensive training and at least 100 exams of patients with endometriosis, in order to acquire adequate experience. Alcazar et al.  evaluated an intensive training program for ultrasound diagnosis of adnexal masses using LC-CUSUM graph analyses. They found that this methodology can be used in the evaluation of the feasibility of a training program .
Recently, Piessens et al.  described their experience with a sonographer learning endometriosis screening in just 1 week of specialized training. Using the LU-CUSUM, this sonographer achieved competency within 38 scans for POD obliteration and 36 scans for bowel lesions. The study was also performed by an experienced gynecological sonographer, who had not previously performed DIE mapping. Overall, more than 100 examinations were performed . Our findings also lend support to their findings, while we additionally described uterosacral ligament evaluation.
Our study has several strengths and limitations which should be acknowledged: a significant strength is the use of a validated statistical model for assessing the learning curve, the LU-CUSUM, which was described . However, the acceptable and unacceptable failures were chosen arbitrarily based on previous reports. These values can be modified according to recommendations which are applicable to the specified procedure .
A significant strength of the present study is the fact that the analysis was performed against the reference standard of surgery with histo-pathological confirmation. The definitive diagnosis was only reached after surgery, which occasionally took place months after the ultrasound exam. The performance of these recommended 44 exams, with adequate surgical feedback, can take time depending on how many endometriosis surgeries are performed each week. In our study, this took well over a year and approximately 250 scans overall.
The accuracy of TVUS in diagnosis of endometriomas and DIE in our study is in concordance with previous reports [12–14] and with two recent meta-analyses [25, 26]. This provides further confirmation that TVUS remains the first-line imaging technique for suspected DIE. A sonographer with general gynecological experience is expected to diagnose all ovarian endometriomas correctly, as indeed was the case in our study. The present study also had a very good sensitivity for diagnosing bladder nodules, which were identified with the standardized approach. The preoperative diagnosis of bowel involvement and pouch of Douglas obliteration greatly impacts decision-making . While competency is achieved reasonably fast, any missed diagnosis may be harmful. It is therefore imperative to ensure that the trainee and the surgeon speak the same language, as most inaccuracies may be the result of a different terminology. The surgeon was not blinded to the ultrasound report in this study, because he was expected to plan surgery based upon it. Furthermore, despite the high proficiency of our surgeons, some very deep lesions may not have been seen on laparoscopy and could have been missed . The poorer performance which was obtained in the diagnosis of uterosacral ligament lesions is also in concordance with previous reports, and is in fact somewhat better in our study.
An additional limitation of our study is that all of the patients had TVUS because of suspected DIE, which may have caused a diagnostic bias. The analysis was performed in a tertiary referral center with a high number of advanced cases of severe endometriosis with multiple lesions, which does not reflect the standard patient population. Therefore, we analyzed more locations of endometriosis in an attempt to overcome this potential bias.
All of the TVUS examinations were performed by a single operator with training in general gynecological sonography, who had previously not been exposed to DIE scanning. This limits the generalization of our data to other potential operators, with a different degree of expertise in general gynecological imaging, who may in practice have a different learning curve. At the time of the study, this was the only trained sonographer at our center dedicated to endometriosis mapping, thus inter-observer comparisons cannot be discussed. Furthermore, the sonographer in question received tertiary referrals from other centers where eventually the surgery was undertaken. This may have affected the learning curve as well. Similar studies are necessary in order to learn more about the learning curve for different performance and competency levels. A trainee should ideally show evidence of satisfactory performance, before he or she can be encouraged to perform the procedure without supervision .
While the LC-CUSUM has been used here to assess the performance of a single individual, it may prove useful for monitoring the introduction of a new procedure in any setting where feedback is available and corrective actions can be implemented, or in monitoring new trainees, who have the advantage of being trained by an experienced DIE sonographer. It may also prove useful for professional societies that are responsible for developing guidelines for good practice . It is clear that any general gynecologic sonographer could benefit from such training, provided that feedback on diagnosis is available. We believe that our experience may serve as a guiding point to other operators who aim to learn endometriosis mapping. With the new consensus opinion recently published by Guerriero et al. , better standardization and education is becoming feasible.
This study shows that a sonographer trained in general gynecologic ultrasonography, who devotes time to learn TVUS for DIE mapping, can achieve proficiency for diagnosing the major types of endometriotic lesions after examining less than 50 patients who subsequently undergo surgery in a training setting. This goal can be accomplished within a reasonable time frame in many tertiary referral centers involved in the care of endometriosis patients. Diagnostic accuracy may be further advanced in these centers by improving agreement on terminology and feedback between surgeons and imaging specialists. Determining the learning curve for DIE TVUS mapping can aid training programs in dedicated endometriosis centers and may be of value to general gynecology TVUS education programs as well. Improving training for new ultrasound performers may in the future enable earlier non-invasive diagnosis of endometriosis which will have a favorable impact on the healthcare of women. Despite the fact that we have described the experience of a single operator, we believe that this may encourage other gynecological ultrasound experts to further their expertise into the field of endometriosis mapping.
Prof. Daniel S. Seidman and Prof. Gideon Koren for manuscript review and corrections.
VHE contributed to the project development, research design, data collection, data analysis, and manuscript writing. JLA contributed to the research design, data analysis, and critical manuscript reading. NA contributed to the data collection and critical manuscript reading. ES contributed to the critical manuscript reading. RA contributed to the critical manuscript reading. MG contributed to the data collection and critical manuscript reading. DS contributed to the data collection, data analysis, and critical manuscript reading. All authors read and approved the final manuscript.
Ethics approval and consent to participate
Was obtained from the Sheba Medical Center IRB.
Consent for publication
This was not required since examinations were performed as part of clinical practice.
On behalf of all authors, the corresponding author states that there is no competing interest.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Open AccessThis article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made.
- Melis GB, Ajossa S, Guerriero S et al (1994) Epidemiology and diagnosis of endometriosis. Ann N Y Acad Sci 734:352–357View ArticlePubMedGoogle Scholar
- Dmowski WP, Lesniewicz R, Rana N, Pepping P, Noursalehi M (1997) Changing trends in the diagnosis of endometriosis: a comparative study of women with pelvic endometriosis presenting with chronic pelvic pain or infertility. Fertil Steril 67:238–243View ArticlePubMedGoogle Scholar
- Bazot M, Thomassin I, Hourani R, Cortez A, Darai E (2004) Diagnostic accuracy of transvaginal sonography for deep pelvic endometriosis. Ultrasound Obstet Gynecol 24:180–185View ArticlePubMedGoogle Scholar
- Bazot M, Darai E, Biau DJ, Ballester M, Dessolle L (2011) Learning curve of transvaginal ultrasound for the diagnosis of endometriomas assessed by the cumulative summation test (LC-CUSUM). Fertil Steril 95:301–303View ArticlePubMedGoogle Scholar
- Ballard K, Lowton K, Wright J (2006) What’s the delay? A qualitative study of women’s experiences of reaching a diagnosis of endometriosis. Fertil Steril and agreement with endometriosis findings at laparoscopyand agreement with endometriosis findings at laparoscopy 86:1296–1301Google Scholar
- Hudelist G, Fritzer N, Thomas A et al (2012) Diagnostic delay for endometriosis in Austria and Germany: causes and possible consequences. Hum Reprod 27:3412–3416View ArticlePubMedGoogle Scholar
- Nnoaham KE, Hummelshoj L, Webster P et al (2011) World Endometriosis Research Foundation Global Study of Women’s Health consortium. Impact of endometriosis on quality of life and work productivity: a multicenter study across ten countries. Fertil Steril 96:366–373View ArticlePubMedPubMed CentralGoogle Scholar
- Tammaa A, Fritzer N, Strunk G, Krell A, Salzer H, Hudelist G (2014) Learning curve for the detection of pouch of Douglas obliteration and deep infiltrating endometriosis of the rectum. Hum Reprod 29:1199–1204View ArticlePubMedGoogle Scholar
- Piketty M, Chopin N, Dousset B et al (2009) Preoperative work-up for patients with deeply infiltrating endometriosis: transvaginal ultrasonography must definitely be the first-line imaging examination. Hum Reprod 24:602–607View ArticlePubMedGoogle Scholar
- Hudelist G, Ballard K, English J et al (2011) Transvaginal sonography vs. clinical examination in the preoperative diagnosis of deep infiltrating endometriosis. Ultrasound Obstet Gynecol 37:480–487View ArticlePubMedGoogle Scholar
- Hudelist G, English J, Thomas A, Tinelli A, Singer CF, Keckstein J (2011) Diagnostic accuracy of transvaginal ultrasound for non-invasive diagnosis of bowel endometriosis: systematic review and meta-analysis. Ultrasound Obstet Gynecol 37:257–263View ArticlePubMedGoogle Scholar
- Alcazar JL, Laparte C, Jurado M, Lopez-Garcia G (1997) The role of transvaginal ultrasonography combined with color velocity imaging and pulse Doppler in the diagnosis of endometrioma. Fertil Steril 67:487–491View ArticlePubMedGoogle Scholar
- Van Holsbeke C, Van Calster B, Guerriero M et al (2009) Imaging in gynaecology: how good are we in identifying endometriomas? Facts Views Vis ObGyn 1:7–17PubMedPubMed CentralGoogle Scholar
- Abrao MS, Gonçalves MO, Dias JA Jr, Podgaec S, Chamie LP, Blasbalg R (2007) Comparison between clinical examination, transvaginal sonography and magnetic resonance imaging for the diagnosis of deep endometriosis. Hum Reprod 22:3092–3097View ArticlePubMedGoogle Scholar
- Wohl H (1977) The cusum plot: Its’ utility in the analysis of clinical data. N Engl J Med 296:1044–1045View ArticlePubMedGoogle Scholar
- Biau DJ, Porcher R, Salomon LJ (2008) CUSUM: a tool for ongoing assessment of performance. Ultrasound Obstet Gynecol 31:252–255View ArticlePubMedGoogle Scholar
- Biau DJ, Williams SM, Schlup MM, Nizard RS, Porcher R (2008) Quantitative and individualized assessment of the learning curve using LC-CUSUM. Br J Surg 95:925–929View ArticlePubMedGoogle Scholar
- Van Holsbeke C, Van Calster B, Guerriero S et al (2010) Endometriomas: their ultrasound characteristics. Ultrasound Obstet Gynecol 35:730–740PubMedGoogle Scholar
- Guerriero S, Ajossa S, Mais V, Risalvato A, Lai MP, Melis GB (1998) The diagnosis of endometriomas using colour Doppler energy imaging. Hum Reprod 13:1691–1695View ArticlePubMedGoogle Scholar
- Exacoustos C, Malzoni M, Di Giovanni A et al (2014) Ultrasound mapping system for the surgical management of deep infiltrating endometriosis. Fertil Steril 102:143–150View ArticlePubMedGoogle Scholar
- Hudelist G, Fritzer N, Staettner S et al (2013) Uterine sliding sign: a simple sonographic predictor for presence of deep infiltrating endometriosis of the rectum. Ultrasound Obstet Gynecol 41:692–695View ArticlePubMedGoogle Scholar
- Reid S, Lu C, Casikar I et al (2013) Prediction of pouch of Douglas obliteration in women with suspected endometriosis using a new real-time dynamic transvaginal ultrasound technique: the sliding sign. Ultrasound Obstet Gynecol 41:685–691View ArticlePubMedGoogle Scholar
- American Society for Reproductive Medicine (1997) Revised American Society for Reproductive Medicine Classification of endometriosis. Am Soc Reprod Med 5:817–821Google Scholar
- Alcázar JL, Guerriero S, Laparte C, Ajossa S, Ruiz-Zambrana A, Melis GB (2011) Diagnostic performance of transvaginal gray-scale ultrasound for specific diagnosis of benign ovarian cysts in relation to menopausal status. Maturitas 68:182–188View ArticlePubMedGoogle Scholar
- Guerriero S, Ajossa S, Minguez JA et al (2015) Accuracy of transvaginal ultrasound for diagnosis of deep endometriosis in uterosacral ligaments, rectovaginal septum, vagina and bladder: systematic review and meta-analysis. Ultrasound Obstet Gynecol 46:534–545View ArticlePubMedGoogle Scholar
- Guerriero S, Ajossa S, Orozco R et al (2015) Accuracy of transvaginal ultrasound for diagnosis of deep endometriosis in the rectosigmoid: systematic review and meta-analysis. Ultrasound Obstet Gynecol 47:281–289View ArticlePubMedGoogle Scholar
- Saba L, Guerriero S, Sulis R et al (2011) Learning curve in the detection of ovarian and deep endometriosis by using Magnetic Resonance comparison with surgical results. Eur J Radiol 79:237–244View ArticlePubMedGoogle Scholar
- Alcazar JL, Diaz L, Florez P, Guerriero S, Jurado M (2013) Intensive training program for ultrasound diagnosis of adnexal masses: protocol and preliminary results. Ultrasound Obstet Gynecol 42:218–223View ArticlePubMedGoogle Scholar
- Piessens S, Healey M, Maher P, Tsaltas J, Rombauts L (2014) Can anyone screen for deep infiltrating endometriosis with transvaginal ultrasound? Aust N Z J Obstet Gynaecol 54:462–468View ArticlePubMedGoogle Scholar
- Guerriero S, Condous G, Van Den Bosch T et al (2016) Systematic approach to sonographic evaluation of the pelvis in women with suspected endometriosis, including terms, definitions and measurements: a consensus opinion from the International Deep Endometriosis Analysis (IDEA) group. Ultrasound Obstet Gynecol. https://doi.org/10.1002/uog.15955