Scholarly article on topic 'Developing an index for the orthodontic treatment need in paediatric patients with obstructive sleep apnoea: a protocol for a novel communication tool between physicians and orthodontists'

Developing an index for the orthodontic treatment need in paediatric patients with obstructive sleep apnoea: a protocol for a novel communication tool between physicians and orthodontists Academic research paper on "Clinical medicine"

Share paper
Academic journal
BMJ Open
OECD Field of science

Academic research paper on topic "Developing an index for the orthodontic treatment need in paediatric patients with obstructive sleep apnoea: a protocol for a novel communication tool between physicians and orthodontists"

BMJ Open Developing an index for the orthodontic treatment need in paediatric patients with obstructive sleep apnoea: a protocol for a novel communication tool between physicians and orthodontists

Mostafa Altalibi,1 Humam Saltaji,1 Mary Roduta Roberts,2 Michael P Major,3

Joanna MacLean,4 Paul W Major5

To cite: Altalibi M, Saltaji H, Roduta Roberts M, et al. Developing an index for the orthodontic treatment need in paediatric patients with obstructive sleep apnoea: a protocol for a novel communication tool between physicians and orthodontists. BMJ Open 2014;4:e005680. doi:10.1136/bmjopen-2014-005680

► Prepublication history and additional material is available. To view please visit the journal ( 10.1136/bmjopen-2014-005680).

Received 12 May 2014 Revised 14 August 2014 Accepted 18 August 2014


For numbered affiliations see end of article.

Correspondence to

Dr Mostafa Altalibi;


Introduction: Sleep disordered breathing in the paediatric population can manifest as an array of different systemic symptoms; among them is a distinct malocclusion and craniofacial phenotype. Emerging research suggests that the treatment of this malocclusion and/or craniofacial phenotype through orthodontic intervention may help with the symptoms of these patients. Selecting the patients who would benefit from orthodontic treatment can be a difficult task for the physician with minimal dental training. Therefore the aim of this study is to develop a simple index to be used by medical professionals to identify those paediatric patients with orthodontic treatment needs who may benefit their obstructive sleep apnoea (OSA) symptoms.

Methods and analysis: The methodology in this project has been devised through the WHO's recommendations on developing an index, with modifications based on the specific needs of this study. Based on the available literature, a draft index will be produced and subjected to multiple iterative revisions based on the feedback from: the Index Development Group, a group of multidisciplinary and internationally acclaimed experts in the field; the External Review Group, a group of potential end users and interested parties and the Steering Committee. Once the index has been formalised, it will be subjected to a pair of reliability tests using physicians and orthodontists scored 2 weeks apart. Subsequently, the index will be validated using dichotomous responses from orthodontists on whether they would treat a patient for OSA symptoms, and comparing the responses to the score of the index on the same patient. Ethics and dissemination: The index will be translated into French and will be presented in orthodontic and medical conferences, workshops, seminars, round table discussions, and free copies for download will be made available on the website of the University of Alberta Interdisciplinary Airway Research Clinic ( Furthermore, the index will be

Strengths and limitations of this study

This index will help physicians and other medical professionals understand and identify which patients with obstructive sleep apnoea with malocclusions and craniofacial phenotypes are likely to benefit from targeted orthodontic treatment and will allow them to refer these patients accordingly.

This index development acknowledges the multifactorial nature of sleep disorder breathing (SDB) and the need for multidisciplinary care. The ideal end result of this index is to facilitate and enhance effective collaboration between invested dental and medical specialties. Development of a validated index will facilitate future epidemiology studies, allow for quality assurance and guide funding allocation. It will also allow long-term follow-up and audit in order to enter into comparisons with other centres.

published in a peer-reviewed medical journal to further increase the exposure of the index.


Snoring, although ubiquitous in the adult population, is considered abnormal in children and adolescents.1 More importantly, it may serve as an indicator of a more severe respiratory problem that presents as a continuum, from primary snoring to obstructive sleep apnoea (OSA). Reports vary on the prevalence of OSA, ranging from 0.7% to 5% of the population under 18 years old.2-8 Moreover, breathing-induced sleep disorders have been proven to have a profound effect on

the child's behaviour, growth and development; the myriad of symptoms include: morning tension-type headaches, excessive morning thirst, excessive fatigue and sleepiness, abnormal shyness, withdrawn and depressive presentation, pattern of attention-deficit/hyperactivity disorder, memory impairments, aggressiveness and irritability, among many others.9-13 Other physiological processes that can be affected include stunted growth,14 high blood pressure,15 damage to the heart: ventricular hypertrophy,16

and cor pulmonale. In addition to behavioural and systemic health consequences, craniofacial development is also affected. These patients generally have a craniofacial component contributing to their OSA, which would manifest as a retrognathic maxilla18 or mandible, a long lower face height and restriction in the space of the upper airway.19 20 Furthermore, when evaluating the polysomno-grophy of these patients, the evidence suggests that palatal expansion and mandibular advancement appliances21-26 can be of benefit at reducing the severity of OSA. Reverse pull headgear,27-32 and maxillary and mandibular advancement surgery33 have also been shown to have great promise at helping this group of patients. Since orthodontic treatment of the OSA craniofacial phenotype is an integral component to multidisciplinary care, it is essential for medical professionals (physicians, nurses, etc) to recognise the phenotype that would benefit from orthodontic treatment. Unfortunately, there are no guidelines for non-dental trained practitioners to help identify which children with sleep disorder breathing (SDB) would benefit from orthodontic treatment. Therefore, this study aims to develop an index that can summarise the need for orthodontic treatment, in select cases of children with OSA, to physicians and adjunct medical professionals. Once the index is developed, it will be assessed for reliability and will be validated. On completion, this index will equip medical professionals with a simple way to assess which patients have malocclusions that contribute to their OSA and may benefit from orthodontic treatment.


This research is classified as an applied interdisciplinary medical research. The overall study design involves components of qualitative analysis and quantitative analysis. The qualitative components comprise focus groups and committee meetings. The quantitative components comprise reliability tests and a cross-sectional validity test.

Initial development

In accordance with the WHO's recommendations on developing an index,34 development of the index will be achieved through the following objectives:

1. Establishing a Steering Committee;

2. Scoping the index;

3. Reviewing the literature;

4. Drafting the index;

5. Organising an Index Development Group (IDG);

6. Organising an External Review Group (ERG).

Steering Committee

The Steering Committee will be established a priori, and will be identified by the principal investigator based on the required expertise in the involved fields and based on availability and access. The Steering Committee will be responsible for overseeing every aspect of the study. It will be composed of a representative group of three experts in orthodontics, paediatric sleep medicine and a methodologist specialising in psychometric property analysis. Their responsibilities will include: scoping the index, overseeing evidence retrieval, drafting the index, selecting members of the IDG and ERG, and finalising the index. In these meetings, unanimous consensus through discussion must be reached on all decisions before proceeding to the next step.

Scoping the index

Scoping is the process of defining what factors will be investigated in the literature for inclusion in the index. Scoping will be achieved through the combined experience and expertise of the Steering Committee, and each factor that is suggested will be further investigated in the literature to establish an evidence-based approach to the development of the index.

Reviewing the literature

For each of the scoped factors, the literature will be reviewed to establish relevance. Specifically, the evidence must demonstrate that appropriate treatment of the cra-niofacial factor in question will lead to an improvement in the OSA symptoms. The literature search will not be a systematic review, and will include results from PubMed, MEDLINE, EMBASE, Web of Science, Scopus, the Cochrane Library and grey literature. The search strategy, including inclusion criteria, exclusion criteria and key words, will be devised through the advice of the Steering Committee. The searches themselves will be done in duplicate, using two different assessors. Of the relevant articles, hand searches will be performed on the bibliography lists. The results will be discussed and consensus will be reached between both assessors for the results of the search. Priority will be given to the results of well-conducted and well-reported systematic reviews and randomised control trials. Each of the factors will be assessed on its effect on paediatric OSA. Furthermore, the literature will be searched for the cra-niofacial morphology of paediatric patients with OSA. All of this information will be brought back to the Steering Committee for discussion of inclusion/elimination of factors in the index.

Drafting the index

Since this index will have visual-rating scales for each of the craniofacial and occlusal factors, the Steering Committee will devise an outline suitable for displaying each of the factors representing the index. The factors in the drafted index will also have a number of levels that will divide the factor into categories of severity. The

number of levels for a given factor will also be determined by the Steering Committee. Details describing the nature of the illustrations, the amount of levels that each of the factors will have and the general layout of the index will be agreed on by the Steering Committee, and the graphic artist will then design a preliminary version of the index based on the relevant factors and the feedback from the Steering Committee.

The index development meeting

The IDG is formed by a group of external multidisciplin-ary experts who provide evidence-based recommendations on the content, layout and development process of the index. This eclectic group will be chosen by the Steering Committee based on experience in the field, expertise and ability to contribute, availability and access. The group should be small enough to be able to have effective discussions, yet large enough to ensure appropriate representation from all stakeholders. In this study, we plan on including a broad spectrum of medical specialists, family physicians, orthodontists and methodologists. The goals of this meeting are to gain additional information to strengthen the index, as well as to gain the professional credibility of a broad range of experts on the topic of paediatric OSA.

Once members have been chosen by the Steering Committee and have accepted the invitation to participate, the IDG members will be emailed a document 4 days prior to the meeting, explaining the purpose of the index and meeting, how the meeting will proceed, what to expect in the meeting and a brief literature review of the orthodontic techniques currently available to help with the symptoms of OSA. Moreover, every member will be randomly assigned a number in order to maintain anonymity of the responses.

Procedure of the IDG meeting

The meeting will start with a brief introduction summarising the literature review, the purpose of the index and its relevance. The meeting will then proceed to collect feedback (see online supplementary appendix 1) on the aforementioned chosen factors using a modified Delphi technique,35 36 which is a communication technique that structures the meeting and minimises bias in responses. Participants' responses will be collected through a web-based response portal. Each factor will be explored through yes or no questions, and yes responses followed up with a scale of 1-9 based on its importance for decision-making. Once all the feedback is received on a particular factor, the summary of the results will be displayed for everyone to see. Discussion will ensue for a maximum of 5 min, with each person talking no more than 1 min. Then everyone will be asked to re-enter their feedback on the website for the same factor in light of the discussion. This cycle will continue until a consensus of greater than 80% of the members is reached. Once consensus is reached we will move on to

the next factor and the participants will be asked to give feedback on this new factor in a similar manner.

In addition, two negative control factors will be used to calibrate the responses. The first negative control will be of orthodontic relevance but will have no effect on the amelioration of the symptoms of OSA (ie, crowding or impacted canine). The second negative control will be of relevance to OSA symptoms, but cannot be changed by orthodontic treatment (ie, body mass index or neck circumference).

Once all the factors have been discussed and consensus reached, we will get feedback through the website on the: alignment—importance of the index and whether the development process is appropriate; relevance— content analysis and whether all the factors identified are important; representation—if there is anything that needs to be added to the index (see online supplementary appendix 2). Finally, additional written feedback will be accepted at the very end of the session.

All the feedback from the IDM will be summarised and presented to the Steering Committee, and decisions will be made to remove factors, modify factors and/or modify the outline and layout of the index. These modifications will subsequently be presented to the graphic artist and a second draft will be procured.

The ERG meeting

The ERG is composed of end users and interested parties. The group will also be identified based on the advice of the Steering Committee based on the ability of the group to assess the index and contribute to its development, availability and access. This group is not responsible for any content analysis, instead it will be responsible for reviewing the layout, simplicity and ease of use. It will also be responsible for assessing the usefulness of the index in the healthcare setting and to give feedback on the feasibility of implementing the index in practice. The goal of this meeting is to gain end user approval for the ease and feasibility of administering the index. This group should be large enough to be a representative sample of the population, yet small enough to allow for ease of explanation and healthy discussion. It is not as structured as the IDM, and allows for the participants to freely express their opinions in an open forum.

In this meeting, we will explain the theory behind the index by briefly reviewing the literature and then explain the purpose of the index. Subsequently we will show the group a pilot version of the index and a paper will be distributed to receive their feedback based on the following questions:

1. Do you understand the purpose of the index?

2. Do you understand what each factor is assessing?

A. If not, which one(s) do you not understand and why?

3. On a scale of 1-10, how simple would you rate this index to understand and use?

4. Would you use this index in your practice?

5. Other recommendations.

By compiling the comments and scores onto a table, the results will display the feedback from the ERG meeting. All these results will be presented to the Steering Committee, and decisions will be made to modify the outline and layout of the index. These modifications will subsequently be presented to the graphic artist and a third draft will be procured.


Reliability of the index will be tested within a group that represents the typical end user population. This includes physicians of family medicine, paediatricians, paediatric ENT or paediatric sleep physicians. Reliability will also be assessed within a group of orthodontists who, by their training, are experts at assessing malocclusion and cra-niofacial morphology. Therefore 10-20 physicians and orthodontists will be recruited as examiners in this study.

A pool of 15-40 randomly selected patient charts from the University of Alberta Inter-disciplinary Airway Research Clinic (I-ARC) will be recruited as reliability test participants, and their intraoral and extraoral photographs will be used in the reliability assessment. After a brief explanation about the use and application of the index, the physicians as well as the orthodontists will apply the developed index to the sample patient pool's pictures once. In order to diminish recall bias, application of the index will be repeated 2 weeks later.

Intra-rater reliability and inter-rater reliability between the physicians, between the orthodontists, and between the physicians and orthodontists will be compared. The reliability will be assessed using interclass correlation coefficients and Bland-Altman plots.


The index will be validated using dichotomous responses from orthodontists on whether specific patients would require orthodontic treatment to help their OSA symptoms and comparing them to the score that the index gave those same patients. This will be achieved by setting up a website where 30 orthodontists with experience in dealing with paediatric OSA will be recruited to take the assessment. The website will contain extraoral and intraoral pictures of patients randomly selected from the Interdisciplinary Airway Research Clinic diagnosed with OSA, and the orthodontists will be asked to rate these patients, using a 'yes' or 'no' response, on whether they would benefit from orthodontic treatment for their OSA symptoms. The index will then be applied on the same patients by the principal investigator and the score of each patient will be recorded. Using a stepwise multiple logistic regression, each of the identified factors will be given a weight; this will represent the relative importance of the factor. Once analysed, if the correlation is high between the expert scores and the cluster groups then the clusters are meaningful and valid. Furthermore, a cut-off for most efficient score above which to refer will be chosen using a graph and observing the value that optimises the

sensitivity, specificity and overall accuracy of the index. Finally, four grades of treatment need will be determined using the 25th centile ranges. The grades will be:

1. Minimal need;

2. Mild need;

3. Moderate need;

4. Severe need.


The development plan of this index has been conceived through a modification of the WHO handbook for guideline development,34 as well as reviewing the orthodontic literature for ways indices have been previously developed. The WHO provided an excellent starting point; from there modifications were made to cater to the specifics of this study, given that there are differences between developing a guideline and an index for orthodontic treatment need. The literature was useful, and among the index development protocols reviewed, some assessed the orthodontic treatment need within the entire population,37-40 while others assessed it for a given subpopulation41-46; each had strengths and weaknesses, and thus we further modified our methods, synthesising a protocol for our particular needs from the available literature and using the experience and expertise of the authors. Through this protocol we aim to develop an index that fulfils all of the following


1. Gradient of numeric values: the severity of the orthodontic treatment need within the paediatric patients with OSA should be defined within a numerical scheme that demonstrates a finite and progressive gradient from low need to high need.

2. Equal sensitivity: should demonstrate equal sensitivity throughout the scale.

3. Clinical importance: the numerical scale should correspond with the clinically appraised orthodontic treatment need of paediatric patients with OSA.

4. Statistical ease: should be amendable to statistical analysis.

5. Reliability: should have a high intra-rater and interrater reliability.

6. Practical: the instruments required to score the index should be practical to the setting in which it will be administered.

7. Minimal judgement: applying the index should require minimal judgement.

8. Simple: the index should not have a high financial or time cost, and thereby should be simple enough to administer to many patients.

9. Detect change: The index should be able to detect changes in orthodontic treatment need in paediat-ric patients with OSA.

10. Validity: should be valid over time.

Validity can be characterised into different types: face validity, content validity, construct validity and criterion validity.48 In this study, we will examine these kinds of

validity at different stages of development. The first draft of the index will focus on establishing face validity. Feedback from the Steering Committee and IDG will assist in establishing content and construct validity. Assuming that the 'gold standard' in assessing the orthodontic treatment need in paediatric patients with OSA is an orthodontist with experience in dealing with paediat-ric patients with OSA, then the subsequent modification of the index based on the reliability tests and the dichot-omous responses from the orthodontists provides the index with the necessary criterion-related validity evidence through statistical means.49


This index will help physicians and other medical professionals identify which craniofacial phenotypes may benefit from orthodontic treatment as part of their multidisciplinary OSA management. Furthermore, due to the diverse medical effects of sleep deprivation, there will be a trend to make sleep apnoea into a centralised service, where the main focus is for a highly trained multidisciplinary team to treat a high volume of patients to a standardised protocol, where meticulous documentation is exercised. This index is part of that documentation process. It will allow for quality assurance, funding allocation and epidemiological studies to be performed. It will also allow long-term follow-up and audit in order to enter into comparisons with other centres.

Dissemination plan

The dissemination of this index will be performed through a variety of ways in order to maximise its reach. Primarily, it will be published in a peer-reviewed journal, which will allow its introduction to the scientific literature. The journal should be a respected medical journal with broad reach, in order to allow the greatest number of physicians to be exposed to the index. Subsequently, it will be translated into French, in order for it to be accessible to the entire Canadian and American population of medical professionals. Moreover, the index will be presented at national and international conferences to increase the awareness of the index among the scientific community. Finally, the index will be used at the University of Alberta's Interdisciplinary Airway Research Center, and more research will be conducted, so that future research in this centre will incorporate it. It will also be placed on the University of Alberta's Interdisciplinary Airway Research Center's website under the physician section, to further educate doctors who visit the site on the index.

Author affiliations

1Orthodontic Graduate Program, School of Dentistry, University of Alberta, Edmonton, Alberta, Canada

2Faculty of Rehabilitation Medicine, Department of Occupational Therapy, University of Alberta, Edmonton, Alberta, Canada 3Orthodontics, School of Dentistry, Inter-disciplinary Airway Research Clinic (I-ARC), University of Alberta, Edmonton, Alberta, Canada

4Division of Respiratory Medicine, Department of Pediatrics, University of Alberta, Edmonton, Alberta, Canada

5School of Dentistry, University of Alberta, Edmonton, Alberta, Canada

Contributors MA, HS, MRR, MM, JM and PWM conceived and designed the study. MA drafted the manuscript and integrated critical feedback from all of the other authors. All of the authors approved the final version of the manuscript.

Competing interests None.

Ethics approval The proposed research has received ethical approval numbered Pro00045067 from the University of Alberta Ethics Board.

Provenance and peer review Not commissioned; externally peer reviewed.

Open Access This is an Open Access article distributed in accordance with the Creative Commons Attribution Non Commercial (CC BY-NC 4.0) license, which permits others to distribute, remix, adapt, build upon this work non-commercially, and license their derivative works on different terms, provided the original work is properly cited and the use is non-commercial. See: http://


1. O'Brien LM, Mervis CB, Holbrook CR, etat. Neurobehavioral implications of habitual snoring in children. Pediatrics 2004;114:44-9.

2. Lumeng JC, Chervin RD. Epidemiology of pediatric obstructive sleep apnea. ProcAm Thorac Soc 2008;5:242-52.

3. Gislason T, Benediktsdottir B. Snoring, apneic episodes, and nocturnal hypoxemia among children 6 months to 6 years old. An epidemiologic study of lower limit of prevalence. Chest 1995;107:963-6.

4. Ali NJ, Pitson DJ, Stradling JR. Snoring, sleep disturbance, and behaviour in 4-5-year-olds. Arch Dis Child 1993;68:360-6.

5. Redline S, Tishler PV, Schluchter M, et at. Risk factors for sleep-disordered breathing in children. Associations with obesity, race, and respiratory problems. Am J Respir Crit Care Med 1999; 159 (5 Pt 1):1527-32.

6. Bixler EO, Vgontzas AN, Lin HM, etat. Sleep disordered breathing in children in a general population sample: prevalence and risk factors. Sleep 2009;32:731-6.

7. Li AM, So hK, Au CT, etat. Epidemiology of obstructive sleep apnoea syndrome in Chinese children: a two-phase community study. Thorax 2010;65:991-7.

8. O'Brien LM, Holbrook CR, Mervis CB, etat. Sleep and neurobehavioral characteristics of 5- to 7-year-old children with parentally reported symptoms of attention-deficit/hyperactivity disorder. Pediatrics 2003;111:554-63.

9. Huynh NT, Morton PD, Rompre PH, etat. Associations between sleep-disordered breathing symptoms and facial and dental morphometry, assessed with screening examinations. Am J Orthod Dentofacial Orthop 2011;140:762-70.

10. Beebe DW. Neural and neurobehavioral dysfunction in children with obstructive sleep apnea. PLoS Med 2006;3:e323.

11. Chervin RD, Archbold KH, Dillon JE, etat. Inattention, hyperactivity, and symptoms of sleep-disordered breathing. Pediatrics 2002;109:449-56.

12. Crabtree VM, Varni JW, Gozal D. Health-related quality of life and depressive symptoms in children with suspected sleep-disordered breathing. Sleep 2004;27:1131-8.

13. Halbower AC, Degaonkar M, Barker PB, et at. Childhood obstructive sleep apnea associates with neuropsychological deficits and neuronal brain injury. PLoS Med2006;3:e301.

14. Bar A, Tarasiuk A, Segev Y, et at. The effect of adenotonsillectomy on serum insulin-like growth factor-I and growth in children with obstructive sleep apnea syndrome. J Pediatr 1999;135:76-80.

15. Marcus CL, Greene MG, Carroll JL. Blood pressure in children with obstructive sleep apnea. Am J Respir Crit Care Med 1998;157(4 Pt 1):1098-103.

16. Amin RS, Kimball TR, Bean JA, etat. Left ventricular hypertrophy and abnormal ventricular geometry in children and adolescents with obstructive sleep apnea. Am J Respir Crit Care Med 2002;165:1395-9.

17. Sofer S, Weinhouse E, Tal A, etat. Cor pulmonale due to adenoidal or tonsillar hypertrophy or both in children. Noninvasive diagnosis and follow-up. Chest 1988;93:119-22.

18. Korayem MM, Witmans M, MacLean J, etat. Craniofacial morphology in pediatric patients with persistent obstructive sleep

Open Access @

apnea with or without positive airway pressure therapy: a 34.

cross-sectional cephalometric comparison with controls. Am J Orthod Dentofacial Orthop 2013;144:78-85.

19. Katyal V, Pamula Y, Martin AJ, et al. Craniofacial and upper airway 35. morphology in pediatric sleep-disordered breathing: systematic

review and meta-analysis. Am J Orthod Dentofacial Orthop 2013;143:20-30; e3. 36.

20. Flores-Mir C, Korayem M, Heo G, etal. Craniofacial morphological characteristics in children with obstructive sleep apnea syndrome: a systematic review and meta-analysis. J Am Dent Assoc 37. 2013;144:269-77.

21. Carvalho FR, Lentini-Oliveira D, Machado MA, etal. Oral appliances

and functional orthopaedic appliances for obstructive sleep apnoea 38. in children. Cochrane Database Syst Rev 2007;(2):CD005520.

22. Villa MP, Bernkopf E, Pagani J, et al. Randomized controlled study of an oral jaw-positioning appliance for the treatment of obstructive

sleep apnea in children with malocclusion. Am J Respir Crit Care 39.

Med 2002;165:123-7.

23. Schutz TC, Dominguez GC, Hallinan MP, etal. Class II correction improves nocturnal breathing in adolescents. Angle Orthod 40. 2011;81:222-8.

24. Cozza P, Polimeni A, Ballanti F. A modified monobloc for the 41. treatment of obstructive sleep apnoea in paediatric patients. Eur J

Orthod 2004;26:523-30.

25. Zhang C, He H, Ngan P. Effects of twin block appliance on

obstructive sleep apnea in children: a preliminary study. Sleep 42.

Breath 2013;17:1309-14.

26. Pliska BT, Almeida F. Effectiveness and outcome of oral appliance therapy. Dent Clin North Am 2012;56:433-44.

27. Hiyama S, Suda N, Ishii-Suzuki M, etal. Effects of maxillary 43. protraction on craniofacial structures and upper-airway dimension.

Angle Orthod2002;72:43-7. 44.

28. Oktay H, Ulukaya E. Maxillary protraction appliance effect on the size of the upper airway passage. Angle Orthod 2008;78:209-14.

29. Kilinc AS, Arslan SG, Kama JD, et al. Effects on the sagittal 45. pharyngeal dimensions of protraction and rapid palatal

expansion in class III malocclusion subjects. Eur J Orthod

2008;30:61-6. 46.

30. Sayinsu K, Isik F, Arun T. Sagittal airway dimensions following maxillary protraction: a pilot study. Eur J Orthod 2006;28:184-9.

31. Kaygisiz E, Tuncer BB, Yuksel S, etal. Effects of maxillary 47. protraction and fixed appliance therapy on the pharyngeal airway.

Angle Orthod2009;79:660-7.

32. Lee JW, Park KH, Kim SH, et al. Correlation between skeletal 48. changes by maxillary protraction and upper airway dimensions.

Angle Orthod2011;81:426-32.

33. Holty JE, Guilleminault C. Maxillomandibular advancement for the 49. treatment of obstructive sleep apnea: a systematic review and meta-analysis. Sleep Med Rev2010;14:287-97.

World Health Organization (2012) WHO Handbook for guideline development. Available: handbook_mar2010_1.pdf (aaccessed 10 Sep 2013). Rowe G, Wright G. The Delphi technique as a forecasting tool: issues and analysis. Int J Forecasting 1999; 15:353-75.

Dalkey N, Helmer O. An experimental application of

the Delphi method to the use of experts. Manag Sci 1963;


Richmond S, Shaw WC, O'Brien KD, et al. The development of the PAR Index (Peer Assessment Rating): reliability and validity. Eur J Orthod 1992;14:125-39.

Richmond S, Shaw WC, Roberts CT, et al. The PAR Index (Peer Assessment Rating): methods to determine outcome of orthodontic treatment in terms of improvement and standards. Eur J Orthod 1992;14:180-7.

Daniels C, Richmond S. The development of the index of complexity, outcome and need (ICON). J Orthod 2000; 27:149-62.

Brook PH, Shaw WC. The development of an index of orthodontic

treatment priority. Eur J Orthod 1989;11:309-20.

Mars M, Batra P, Worrell E. Complete unilateral cleft lip and palate:

validity of the five-year index and the Goslon yardstick in predicting

long-term dental arch relationships. Cleft Palate Craniofac J


Mars M, Plint DA, Houston WJ, et al. The Goslon Yardstick: a new system of assessing dental arch relationships in children with unilateral clefts of the lip and palate. Cleft Palate J 1987;24:314-22.

Johnson N, Sandy J. An aesthetic index for evaluation of cleft repair. Eur J Orthod 2003;25:243-9.

Mossey PA, Clark JD, Gray D. Preliminary investigation of a modified Huddart/Bodenham scoring system for assessment of maxillary arch constriction in unilateral cleft lip and palate subjects. Eur J Orthod 2003;25:251 -7.

Tothill C, Mossey PA. Assessment of arch constriction in patients with bilateral cleft lip and palate and isolated cleft palate: a pilot study. Eur J Orthod 2007;29:193-7.

Huddart AG, Bodenham RS. The evaluation of arch form and occlusion in unilateral cleft palate subjects. Cleft Palate J 1972;9:194-209.

Summers CJ. The occlusal index: a system for identifying and scoring occlusal disorders. Am J Orthod 1971;59:552-67.

Streiner DL, Norman GR. Health measurement scales: a practical guide to their development and use. Oxford: Oxford Medical Publications, 1995.

Terwee CB, Bot SDM, de Boer MR, etal. Quality criteria were proposed for measurement properties of health status questionnaires. J Clin Epidemiol 2007;60:34-42.

Developing an index for the orthodontic treatment need in paediatric patients with obstructive sleep apnoea: a protocol for a novel communication tool between physicians and orthodontists

Mostafa Altalibi, Humam Saltaji, Mary Roduta Roberts, Michael P Major, Joanna MacLean and Paul W Major

BMJ Open 2014 4:

doi: 10.1136/bmjopen-2014-005680

Updated information and services can be found at:

These include:

Supplementary Material

References Open Access

Email alerting service

Supplementary material can be found at: 680.DC1.html

This article cites 46 articles, 16 of which you can access for free at:

This is an Open Access article distributed in accordance with the Creative Commons Attribution Non Commercial (CC BY-NC 4.0) license, which permits others to distribute, remix, adapt, build upon this work non-commercially, and license their derivative works on different terms, provided the original work is properly cited and the use is non-commercial. See:

Receive free email alerts when new articles cite this article. Sign up in the box at the top right corner of the online article.

Topic Articles on similar topics can be found in the following collections

Collections Dentistry and oral medicine (19)

Ear, nose and throat/otolaryngology (29) Health services research (583) Paediatrics (271)

To request permissions go to:

To order reprints go to:

To subscribe to BMJ go to: