Scholarly article on topic 'Improving the Effectiveness of Electronic Health Record-Based Referral Processes'

Improving the Effectiveness of Electronic Health Record-Based Referral Processes Academic research paper on "Medical engineering"

Share paper
Academic journal
BMC Med Inform Decis Mak
OECD Field of science

Academic research paper on topic "Improving the Effectiveness of Electronic Health Record-Based Referral Processes"

Medical Informatics & Decision Making


Improving the Effectiveness of Electronic Health Record-Based Referral Processes

Adol Esquivel1, Dean F Sittig2, Daniel R Murphy3 and Hardeep Singh3*


Electronic health records are increasingly being used to facilitate referral communication in the outpatient setting. However, despite support by technology, referral communication between primary care providers and specialists is often unsatisfactory and is unable to eliminate care delays. This may be in part due to lack of attention to how information and communication technology fits within the social environment of health care. Making electronic referral communication effective requires a multifaceted "socio-technical" approach. Using an 8-dimensional socio-technical model for health information technology as a framework, we describe ten recommendations that represent good clinical practices to design, develop, implement, improve, and monitor electronic referral communication in the outpatient setting. These recommendations were developed on the basis of our previous work, current literature, sound clinical practice, and a systems-based approach to understanding and implementing health information technology solutions. Recommendations are relevant to system designers, practicing clinicians, and other stakeholders considering use of electronic health records to support referral communication.


Outpatient referrals, defined as processes that include a transfer of responsibility for some aspect of patient's care from a referring provider to a secondary service or provider, [1] are an important but challenging aspect of primary care practice. Successful coordination of referrals hinges upon effective and timely communication to facilitate information sharing and transfer of patient care responsibilities between outpatient providers [2-10]. However, referral communication related to both provider-provider and provider-patient interactions [3,11-14] is prone to breakdown [2,14-22]. The growing use of referral care [23] suggests the need for improving reliability and efficiency of the referral process to create a greater impact on health care quality.

In accordance with the 2009 Health Information Technology for Economic and Clinical Health Act (HITECH) and its Meaningful Use goals for effective use of

* Correspondence:

3Houston VA HSR&D Center of Excellence and The Center of Inquiry to Improve Outpatient Safety Through Effective Electronic Communication, both at the MichaelE. DeBakey Veterans Affairs MedicalCenter and the Section of Health Services Research, Department of Medicine, Baylor College of Medicine, VA MedicalCenter (152), 2002 Holcombe Blvd, Houston 77030, TX, USA

Fulllist of author information is available at the end of the article

Bio Med Central

electronic health records (EHRs), healthcare institutions are increasingly adopting technology to support patient care. By 2015, hospitals are expected to demonstrate, among other things, the capability to exchange key clinical information among providers of care and other patient-authorized entities electronically [24]. This increasing adoption of health information technology holds promise for improving referral communication in health care [25-28]. However, early adopters of these technologies, mostly large integrated systems, have encountered novel communication challenges and unintended consequences that are important to understand in order to reduce future care delays [18,29-35].

Many referrals between primary care providers (PCPs) and specialists do not take place within the same practice or institution; and in general, providers don't have access to the same EHR. However, efforts to address communication challenges using EHRs will be essential given the emphasis on coordination of care and exchange of relevant clinical information by the Patient Protection and Affordable Care Act of 2010 [36]. Recent reform initiatives call for healthcare institutions to become Accountable Care Organizations (ACOs) [37] and demonstrate the use of evidence-based medicine and the application of evolving technologies to support a strong foundation for coordinated primary care. They also

© 2012 Esquivel et al.; licensee BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.Org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

create an expectation of continuous process improvement based on measurement of clinical quality and outcomes [38]. EHR-based referrals thus would be an essential component of patient care through ACOs. Even when supported by technology, referral communication between PCPs and specialists is often unsatisfactory [39]. This might be partially due to lack of attention on how communication technology fits with the social environment in which it is implemented [40,41]. Addressing these key challenges in making electronic referral communication effective [11,12,42] requires a multifaceted "socio-technical" approach [43].

Although efforts have been made to improve and standardize overall EHR usability, [44,45] there are presently no standards that specifically address the design or use of electronic systems in outpatient referral communication, and best practices in this area are limited [6,19,39,46-48]. In fact, no available turn-key EHR system can fully support the complexities of most referral processes. Furthermore, referral processes are highly variable across health care settings, and EHRs that support referrals are often heavily customized to reflect unique organizational requirements [19,49,50]. Although complete standardization of referral practices is neither possible nor desirable, several aspects of referral communication are amenable to strategies to reduce the risk of unintended consequences and delays in patient care.

This article describes ten recommendations that represent potential best practices to design, develop, implement, improve, and monitor electronic outpatient referral communication. Recommendations are grounded in a socio-technical model for health information technology [43]. This model uses 8 interrelated dimensions to identify

challenges related to developing, implementing, and using information technology within health care (hardware & software, clinical content, human-computer interface, people, workflow & communication, organizational features, external rules and regulations, and measurement & monitoring). The recommendations are also based on current literature, sound clinical practice, our previous work, and a systems-based approach to understanding and implementing health information technology solutions. We also categorized recommendations according to the dimensions of the socio-technical model with which they are most closely related (Table 1). Some recommendations have an established evidence-base and others are based on our experiences or perspectives, but most are not widely adopted by institutions and/or current EHRs. Thus, we believe these recommendations are relevant to all system designers, practicing clinicians, and other stakeholders considering the use of EHRs to support referral communication.

Recommendation #1: Include real-time clinician-to-clinician communication features as part of the referral system

Providers often prefer traditional face-to-face or synchronous communication, such as telephone conversations. While excessive reliance on the EHR and other health information technology may diminish the use of real-time communication, certain critical situations require the interactivity afforded by direct conversation. In fact, some estimates propose that up to 60% of providers' time in clinic is devoted to synchronous conversation [51]. In some cases, such as when a referral is urgent, real-time communication may be required to

Table 1 Recommendations Summary and their relation to Socio-Technical dimensions

Recommendation Primary Socio-Technical Dimension*

1 Include real-time clinician-to-clinician communication Hardware & Software features as part of the referralsystem.

2 Design and use electronic standardized referraltemplates Human-Computer Interface that include both structured and free-text fields.

3 Enforce electronic capture of the reason for the referral. ClinicalContent

4 Bring PCPs and specialists together to collaboratively develop People referral guidelines for inclusion into the electronic referral system

5 Integrate patient communication into the electronic referralprocess People

6 Use automation to pre-populate electronic referralrequests Workflow & Communication with patient-specific data

7 Include the capability of electronic consultations (information-only referrals). Workflow & Communication

8 Close the communication loop by providing referralstatus tracking Workflow & Communication and feedback capabilities and integrating these tools into providers' workflows

9 Standardize and maintain up-to-date institutional policies and Organization Policies & Procedures procedures for electronic referrals.

10 Monitor electronic referralcommunication performance. Measurement & Monitoring

^Although recommendation may be associated with more than one dimension of the socio-technical mode, this table identifies the dimension each recommendation most directly relates to.

expedite the referral process [52,53]. Specialists may also want to speak directly to referring providers if there is any doubt about a referral's appropriateness or urgency, even when PCPs and specialists share access to the patient's record. EHRs can facilitate real-time phone conversations or internet-based audio-, video-, or text-based conferencing interactions by providing easily accessible and updated contact information for specialists and PCPs (or their clinics) on the referral interface [54-57]. This flexibility should be specified in any policies and procedures governing outpatient referrals [58].

Recommendation #2: Design and use standardized electronic referral templates that include both structured and free-text fields

The content, form, and style of referral letters influences the referral process [5,16,59-61]. Several studies have shown increased provider satisfaction and more consistent and timely feedback from specialists when referral templates are used to standardize referral communication [16,62,63]. Electronic systems provide an excellent opportunity to create, maintain, and disseminate the use of standardized templates [64,65]. However, the interface of electronic referral templates should be designed to avoid excessive constraints that can limit providers' ability to explain and document relevant findings [4]. Thus, when designing electronic referral templates, humancomputer interface designers must maintain a delicate balance between structured fields to capture required essential information and free-text fields to allow providers to qualify and expand on their findings freely.

Recommendation #3: Enforce electronic capture of the reason for the referral

More than fifty years ago, Williams et al. determined that providing a clear reason for a referral was an essential step in the outpatient referral process [13]. Since then, multiple studies have shown that providers' failure to clearly state the reason for referral (a problem identified in 20-88% of referrals [7,8,21,50]) remains a major barrier to effective referral communication [20,66]. The inclusion of a clear reason to justify a referral is not only regarded as good professional practice but it has also been shown to expedite the referral process [2,7,22,67]. Therefore, electronic systems should be designed to prevent referrals from being transmitted unless they have a clearly defined reason to justify them. In addition to a standard set of generic choices, such as those proposed by Forrest et al. (to seek advice, to request a technical procedure, and to request co-management of the patient), electronic systems should give providers the option to expand and elaborate on their selection when needed [68].

Recommendation #4: Bring PCPs and specialists together to collaboratively develop referral guidelines for inclusion into the electronic referral system

EHRs offer a robust platform for integrating referral guidelines into providers' workflows at the point of care, and referral guidelines can improve the referral process in several ways. For instance, they can help providers determine the appropriateness of a referral prior to initiating the request [42,47] or allow a provider to anticipate the specialist's referral information and patient work-up needs, improving efficiency and quality. People comprise one of the key dimensions of the socio-technical model. While EHRs are valuable delivery vehicles for referral guidelines, effective outcomes will only be achieved by collaborative efforts between referring providers and specialists to facilitate communication, decrease referral denials, and clarify referral expectations. While collaboration across different practice settings and institutions will be challenging to operationalize, it must also be encouraged keeping in line with the national focus on reducing health care costs and overutilization [19,69]. For instance, solo practitioners and small independent practices lacking formal organizational structures can leverage their existing networks of specialists to develop mutually agreed-upon referral guidelines. Additionally, third parties involved in regulatory, reimbursement, or quality improvement activities (e.g., regional extension centers, payers, or medical societies) can facilitate the development and dissemination of a basic set of guidelines as a starting point. Service agreements between PCPs and specialists that include referral guidelines can facilitate provider access to specialists and reduce inappropriate referrals by suggesting evidence-based pathways or alternatives to referrals [70-73]. However, given the complexity of some referrals, systems should remain sufficiently flexible to allow providers to bypass guidelines and submit a referral request that may not appear to adhere to guideline criteria by appropriately justifying its urgency and clinical need.

Recommendation #5: Integrate patient communication into the electronic referral process

As early as 1971, researchers pointed out that the success of outpatient referrals was related in part to patient-related variables, [2] such as patient's illness and socioeconomic background. However, subsequent work has paid little attention to the patient's role in outpatient referral communication. In recent years, the growth of personal health records and other consumer electronic communication tools have modernized and fundamentally transformed patient-provider communication [74]. Nevertheless, patient-related communication remains

vulnerable to breakdowns. For instance, these communication failures can account for a substantial number of incomplete referrals resulting in missed appointments and delays in care [53,75]. Attributes similar to those expected of provider-to-provider electronic communication (i.e., secure, timely, reliable, and actionable) [76] must also be used to inform tools to enhance patient-centered communication [77]. These attributes should be the hallmark of effective electronic communication within the patient-centered medical home model [78-80]. Hence, EHRs aimed at supporting referral communication should include functionality to allow the patient to provide additional information if and when needed, and to permit patients to become an active decision-maker during the referral process (i.e. allow them to schedule and cancel appointments, select providers, ask questions). Given the low adoption and use of existing patient communication tools [81,82], novel methods beyond traditional web-based portals are needed. System developers and administrators should explore how to leverage technologies such as smart phone apps, social media portals, and electronic outreach programs [83,84] as well as consider alternative forms of patient access or outreach in order to make patient communication more reliable. This will enable patients to have secure and timely access to relevant information such as referral status updates, reminders to increase patient compliance, and tools to facilitate communication with their physician.

Recommendation #6: Use automation to pre-populate electronic referral requests with patient-specific data

If used appropriately, electronic referrals have the potential to enhance provider workflow by automating certain tedious or repetitive steps where manual effort is unnecessary. The cognitive load imposed by the use of structured templates, referral guidelines, and use of computerized interfaces increases the time commitment and complexity of initiating and managing referrals [85]. In a recent study, referring PCPs and specialists both suggested the use of automation to pre-populate electronic referral requests in order to decrease both workload and cognitive load [9]. In a separate study, auto-population was commended by providers as a mechanism to improve the efficiency of the consultation process [86]. Electronic referrals should harness the benefits of EHR data and use it to automatically pre-populate fields in the referral template whenever possible (e.g., demographic data, current medication list, recent relevant laboratory test results [18]). Ultimately, more advanced EHRs could even use rule-based pre-population to supply additional relevant information based on the patient's diagnosis or age group.

Recommendation #7: Include the capability of electronic consultations (information-only referrals)

The conceptual definition of "referral" implies an actual transfer of responsibility for some aspect of the patient's care and an encounter with another provider. In contrast, a strict consultation involves seeking a colleague's opinion about a particular aspect of the care of the patient, but at no time is the patient under the direct care of the consultant [1,87]. For example, certain referral questions are addressed more efficiently through consultation or information exchanges between the referring PCP and the specialist, which does not necessarily require a physical encounter between the patient and the specialist [9]. Workflow efficiency might be improved if electronic consultations are effectively used. Electronic health records can facilitate these consultations through more flexible and efficient electronic consultation processes that minimize delays (i.e., "information-only" referrals that do not require a patient visit). A successful example of this practice is the established telemedicine modality known as "store-and-forward" in which the provider exchanges relevant patient information with the consultant asynchronously and requests his or her opinion electronically [88,89]. These strategies, if implemented appropriately, can also minimize delays and inefficiencies in care related to unnecessary referrals [48].

Recommendation #8: Close the communication loop by providing and integrating referral status tracking and feedback capabilities into providers' workflows

Coordination of care is more effective when all interested parties are aware of the status of the referral request. Referring providers should receive timely feedback from the specialists upon denial, approval, or completion of each referral [9]. However, studies suggest that specialists fail to provide feedback in 15-45% of referrals [4,7,22,61]. Similarly, specialists may need to discuss requests with the referring providers before or after approving them. In engineering, a closed-loop control system is one in which feedback is needed to control the states or outputs of a dynamic system [90]. Often used in decision support systems, [91,92] closed-loop control can improve electronic referrals by ensuring that communication is coupled with timely and appropriate feedback. Effectively closing the loop on all outpatient referral communication requires considerable resources and efforts from all stakeholders; however, EHRs can help to close the referral communication loop in multiple ways. For example allowing providers to document and access each other's notes about encounters, orders, and other relevant information, or by automatically notifying providers of changes in the status of the referral as it progresses through the referral stages. Additionally,

the EHR can notify the referring provider when the specialist has reviewed, approved, or denied a referral request or has asked for additional information [86]. These tools must integrate into providers' workflow in order to leverage improvements in reliability and efficiency. Nevertheless, as with other types of electronic communication in healthcare, it is important not to overload providers with excessive notifications about status updates [93]. Thus, while electronic referral communication must be comprehensive, it should be implemented in a non-intrusive manner so that information remains available to providers and patients on demand.

Recommendation #9: Standardize and maintain up-to-date institutional policies and procedures for electronic referrals

Within institutions, lack of clear policies and procedures can result in unnecessary heterogeneity across referral processes causing inefficiencies in patient care, provider dissatisfaction, and potential for delays in diagnosis and treatment [9]. Even when organizations develop policies and procedures governing referrals, the adoption of health information technology often translates into profound changes in performance and culture [94,95]. Organizations must carefully review and continuously update policies and procedures related to referrals to ensure they reflect appropriate use of electronic tools [40]. Referral policies and procedures should provide detailed guidance with respect to every facet of the use of technology supporting the referral process. For example, to assure compliance and effective use of health information technology for referrals, organizations need to have clearly documented roles and responsibilities for PCPs, specialists, and supporting staff during key stages of the referral process. Additionally, referral policies and procedures should outline the minimum information PCPs should include in the electronic referral request, as well as expected turnaround times for specialists to respond to the referral. They should also incorporate details about the tools available to providers to monitor timeliness and effectiveness of electronic referral communication [19]. Finally, they should allow the flexibility to account for different levels of urgency and importance across clinical problems and specialties, permitting providers to expedite a particular referral when necessary [40,52,96,97]. A clear and common understanding of referral processes with documented policies and procedures of how the technology should be used by PCPs, specialists, and supporting staff is essential for success.

Recommendation #10: Monitor electronic referral communication performance

Recent literature has revealed several serious health information technology-related errors that arose from

faulty system design, configuration, or implementation processes [98-101]. Organizations must continuously monitor and evaluate the usability, performance, benefits, and drawbacks of their electronic referral systems [40]. As with any health information technology-related process, referral communication should be monitored and revised, as needed, [43] to ensure that all stakeholders' needs are being met in a safe and efficient manner. For instance, in our previous work we found that about 7% of electronic referrals at our institution had no follow-up action by specialists at 30 days [29]. Continuous monitoring and frequent assessments of several process measurements (e.g., completed referrals, no-shows/missed appointments, and denied or cancelled referrals) should be part of the organization's ongoing efforts to ensure the effectiveness of their electronic referral communication practices.


EHR-based referrals offer the possibility of greatly improving existing outpatient referral processes. However, technology-facilitated referral processes have not yet reached their potential and will soon be put to the test given the rapid adoption of EHRs. Our proposed recommendations highlight the need to consider the socio-technical context in which information technology-based tools are implemented. Allowing for some flexibility in the referral process and monitoring communication outcomes are vital to effective implementation. As healthcare organizations continue to adopt and use EHRs, the success of technology-enabled referral processes will depend on their ability to remain patient-centered and responsive to providers' needs. The recommendations presented address key areas within seven of the eight socio-technical dimensions, all of which must be performed while adhering to external rules and regulations (e.g., HIPAA or HITECH act), as suggested by the model's eighth dimension. We envision that these recommendations will be useful for several types of stakeholders as they move forward in designing, implementing, and improving their electronic referral systems.


EHR: Electronic Health Record; HITECH: Health Information Technology for Economic and ClinicalHealth Act; PCP: Primary Care Provider; ACO: Accountable Care Organization; HIPAA: Health Information Portability and Accountability Act.

Competing interests

The author(s) declare that they have no competing interests. Author's contributions

AE participated in conceptualization and drafting of the manuscript. DFS participated in conceptualization and revising of the manuscript. DRM participated in conceptualization and drafting of the manuscript. HS participated in conceptualization and revising of the manuscript.


Dr. Singh is supported by an NIH K23 career development award (K23CA125585), the VA NationalCenter of Patient Safety, and in part by the Houston VA HSR&D Center for Excellence (HFP90-020). Dr. Sittig is supported in part by a SHARP contract from the Office of the NationalCoordinator for Health Information Technology (ONC #10510592).

Author details

department of ClinicalEffectiveness and Performance Measurement, St. Luke's EpiscopalHealth System, Houston, TX. 2University of Texas Schoolof Biomedicallnformatics and the UT-MemorialHermann Center for Healthcare Quality & Safety, Houston, TX, USA. 3Houston VA HSR&D Center of Excellence and The Center of Inquiry to Improve Outpatient Safety Through Effective Electronic Communication, both at the MichaelE. DeBakey Veterans Affairs MedicalCenter and the Section of Health Services Research, Department of Medicine, Baylor College of Medicine, VA MedicalCenter (152), 2002 Holcombe Blvd, Houston 77030, TX, USA.

Received: 30 March 2012 Accepted: 24 August 2012 Published: 13 September 2012


1. McWhinney IR: A textbook of family medicine. USA: Oxford University Press; 1997.

2. Shortell SM, Anderson OW: The physician referral process: a theoretical perspective. Health Serv Res 1971, 6:39-48.

3. Byrd JC, Moskowitz MA: Outpatient consultation: interaction between the general internist and the specialist. J Gen Intern Med 1987, 2:93-98.

4. Newton J, Eccles M, Hutchinson A: Communication between general practitioners and consultants: what should their letters contain? BMJ 1992, 304:821-824.

5. Westerman RF, Hull FM, Bezemer PD, Gort G: A study of communication between general practitioners and specialists. Br J Gen Pract 1990, 40:445-449.

6. Chen AHM, Yee HF Jr: Improving the primary care-specialty care interface: getting from here to there. Arch Intern Med 2009, 169:1024-1026.

7. McPhee SJ, Lo B, Saika GY, Meltzer R: How good is communication between primary care physicians and subspecialty consultants? Arch Intern Med 1984, 144:1265-1268.

8. Gandhi TK, Sittig DF, Franklin M, Sussman AJ, Fairchild DG, Bates DW: Communication breakdown in the outpatient referral process. J Gen Intern Med 2000, 15:626-631.

9. Hysong SJ, Esquivel A, Sittig DF, Paul LA, Espadas D, Singh S, Singh H: Towards successful coordination of electronic health record based-referrals: a qualitative analysis. Implement Sci 2011, 6:84.

10. O'Malley AS, Reschovsky JD: Referral and consultation communication between primary care and specialist physicians: Finding common ground. Arch Intern Med 2011, 171:56-65.

11. Forrest CB, Majeed A, Weiner JP, Carroll K, Bindman AB: Comparison of specialty referral rates in the United Kingdom and the United States: retrospective cohort analysis. BMJ 2002, 325:370-371.

12. Roland M: General practitioner referral rates. BMJ 1988, 297:437-438.

13. Williams TF, White KL, Fleming WL, Greenberg BG: The referral process in medical care and the university clinic's role. J Med Educ 1961, 36:899-907.

14. Deckard GJ, Borkowski N, Diaz D, Sanchez C, Boisette SA: Improving timeliness and efficiency in the referral process for safety net providers: application of the Lean Six Sigma methodology. J Ambul Care Manage 2010, 33:124-130.

15. Javalgi R, Joseph WB, Gombeski WR Jr, Lester JA: How physicians make referrals. J Health Care Mark 1993, 13:6-17.

16. Jenkins S, Arroll B, Hawken S, Nicholson R: Referral letters: are form letters better? Br J Gen Pract 1997, 47:107-108.

17. Munro C: Referral of Patients-A Neglected Aspect of Medical Practice. Hong Kong Prac 1989, 11:523-526.

18. Sittig DF, Gandhi TK, Franklin M, Turetsky M, Sussman AJ, Fairchild DG, Bates DW, Komaroff AL, Teich JM: A computer-based outpatient clinical referral system. Int J Med Inform 1999, 55:149-158.

19. Kim Y, Chen AH, Keith E, Yee HF Jr, Kushel MB: Not perfect, but better: primary care providers' experiences with electronic referrals in a safety net health system. J Gen Intern Med 2009, 24:614-619.

20. Lee T, Pappius EM, Goldman L: Impact of inter-physician communication on the effectiveness of medical consultations. Am J Med 1983, 74:106-112.

21. Conley J, Jordan M, Ghali WA: Audit of the consultation process on general internal medicine services. Qual Saf Health Care 2009, 18:59-62.

22. Cummins RO, Smith RW, Inui TS: Communication failure in primary care. Failure of consultants to provide follow-up information. JAMA 1980, 243:1650-1652.

23. Barnett ML, Song Z, Landon BE: Trends in Physician Referrals in the United States, 1999-2009. Arch Intern Med 2012,172:163-170.

24. Public Inspection: Medicare and Medicaid Programs: Electronic Health Record Incentive Program -Stage 2. [


25. Kalogriopoulos NA, Baran J, Nimunkar AJ, Webster JG: Electronic medical record systems for developing countries: review. Conf Proc IEEE Eng Med Biol Soc 2009, 2009:1730-1733.

26. McCullough JS, Casey M, Moscovice I, Prasad S: The effect of health information technology on quality in U.S. hospitals. Health Aff (Millwood) 2010, 29:647-654.

27. Roberts J: Personal electronic health records: from biomedical research to people's health. Inform Prim Care

2009, 17:255-260.

28. Blumenthal D: Launching HITECH. N Engl J Med 2010, 362:382-385.

29. Singh H, Esquivel A, Sittig DF, Murphy D, Kadiyala H, Schiesser R, Espadas D, Petersen LA: Follow-up actions on electronic referral communication in a multispecialty outpatient setting. J Gen Intern Med 2011, 26:64-69.

30. Novak LL: Improving health IT through understanding the cultural production of safety in clinical settings. Stud Health Technol Inform 2010, 157:175-180.

31. Callahan D: Medical progress: unintended consequences. Hastings Cent Rep 2009, Suppl:13-14.

32. Bernstam EV, Hersh WR, Sim I, Eichmann D, Silverstein JC, Smith JW, Becich MJ: Unintended consequences of health information technology: a need for biomedical informatics. J Biomed Inform 2010, 43:828-830.

33. Weiner M, El Hoyek G, Wang L, Dexter PR, Zerr AD, Perkins AJ, James F, Juneja R: A web-based generalist-specialist system to improve scheduling of outpatient specialty consultations in an academic center. J Gen Intern Med 2009, 24:710-715.

34. Shaw LJ, de Berker DAR: Strengths and weaknesses of electronic referral: comparison of data content and clinical value of electronic and paper referrals in dermatology. Br J Gen Pract 2007, 57:223-224.

35. Campbell EM, Sittig DF, Guappone KP, Dykstra RH, Ash JS: Overdependence on technology: an unintended adverse consequence of computerized provider order entry. AMIA Annu Symp Proc 2007:94-98.

36. U.S. Congress: Patient Protection and Affordable Care Act 2010.

37. Fisher ES, Shortell SM: Accountable Care Organizations. JAMA 2010, 304:1715-1716.

38. Mountford J, Davie C: Toward an Outcomes-Based Health Care System.

JAMA 2010, 304:2407-2408.

39. Chen AH, Kushel MB, Grumbach K, Yee HF Jr: Practice profile. A safety-net system gains efficiencies through "eReferrals" to specialists. Health Aff (Millwood) 2010, 29:969-971.

40. Sittig DF, Singh H: Eight rights of safe electronic health record use. JAMA 2009, 302:1111-1113.

41. Berg M, Aarts J, van der Lei J: ICT in health care: sociotechnical approaches. Methods Inf Med 2003,42:297-301.

42. Grimshaw JM, Winkens RAG, Shirran L, Cunningham C, Mayhew A, Thomas R, Fraser C: Interventions to improve outpatient referrals from primary care to secondary care. Cochrane Database Syst Rev 2005, CD005471.

43. Sittig DF, Singh H: A new sociotechnical model for studying health information technology in complex adaptive healthcare systems. Qual Saf Health Care 2010, 19(Suppl 3):i68-174.

44. Armijo D, McDonnell C, Werner K: Electronic Health Record Usability: Interface Design Considerations. Rockville, MD: Agency for Healthcare Research and Quality; 2009. AHRQ Publication No. 09(10)-0091-2-EF.

45. Schumacher RM, Lowry SZ: NIST Guide to the Processes Approach for Improving the Usability of Electronic Health Records. Gaithersburg, MD: National Institute of Standards and Technology; 2010:5-10.

46. Chen AH, Yee HF Jr: Improving primary care-specialty care communication: lessons from San Francisco's safety net: comment on

"Referral and consultation communication between primary care and specialist physicians. Arch Intern Med 2011, 171:65-67.

47. Kim-Hwang JE, Chen AH, Bell DS, Guzman D, Yee HF Jr, Kushel MB: Evaluating electronic referrals for specialty care at a public hospital. J Gen Intern Med 2010, 25:1123-1128.

48. Katz MH: How can we know so little about physician referrals? Arch. Intern. Med. 2012, 172:100.

49. Augestad KM, Revhaug A, Vonen B, Johnsen R, Lindsetmo R-O: The one-stop trial: does electronic referral and booking by the general practitioner (GPs) to outpatient day case surgery reduce waiting time and costs? A randomized controlled trial protocol. BMC Surg 2008, 8:14.

50. Gandhi TK, Keating NL, Ditmore M, Kiernan D, Johnson R, Burdick E, Hamann C: Improving referral communication using a referral tool within an electronic medical record. In Advances in Patient Safety: New Directions and Alternative Approaches, Agency for Healthcare Research and Quality. Edited by Henriksen K, Battles JB, Keyes MA, Grady ML Rockville MD 2008:4.

51. Tang PC, Jaworski MA, Fellencer CA, Kreider N, LaRosa MP, Marquardt WC: Clinician information activities in diverse ambulatory care practices. Proc AMIA Annu Fall Symp 1996, :12-16.

52. Coiera E: Communication systems in healthcare. Clin Biochem Rev 2006, 27:89-98.

53. Singh H, Petersen LA, Daci K, Collins C, Khan M, El-Serag HB: Reducing referral delays in colorectal cancer diagnosis: is it about how you ask? Qual Saf Health Care 2010, 19:e27.

54. Robertson KJ: Diabetes and the Internet. Horm Res 2002, 57:110-112.

55. Saxena S, Kumar V, Giri V: Telecardiology for effective healthcare services. J Med Eng Technol 2003, 27:149.

56. Forti S, Galvagni M, Galligioni E, Eccher C: A real time teleconsultation system for sharing an oncologic web-based electronic medical record. AMIA Annu Symp Proc 2005, 2005:959.

57. Gwozdek AE, Klausner CP, Kerschbaum WE: The utilization of Computer Mediated Communication for case study collaboration. J Dent Hyg 2008, 82:8.

58. Coiera E: When conversation is better than computation. J Am Med

Inform Assoc 2000, 7:277-286.

59. Esquivel A, Dunn K, McLane S, Te'eni D, Zhang J, Turley JP: When your words count: a discriminative model to predict approval of referrals. Inform Prim Care 2009, 17:201-207.

60. Graham PH: Improving communication with specialists. The case of an oncology clinic. Med J Aust 1994, 160:625-627.

61. Epstein RM: Communication between primary care physicians and consultants. Arch Fam Med 1995, 4:403-409.

62. Tan GB, Cohen H, Taylor FC, Gabbay J: Referral of patients to an anticoagulant clinic: implications for better management. Qual Health Care 1993, 2:96-99.

63. Elcuaz Viscarret R, Beorlegui Aznárez J, Cortés Ugalde F, Goñi Murillo C, Espelosín Betelu G, Sagredo Arce T: Analysis of emergency referrals to dermatology. Aten Primaria 1998, 21:131-136.

64. Cameron JR, Ahmed S, Curry P, Forrest G, Sanders R: Impact of direct electronic optometric referral with ocular imaging to a hospital eye service. Eye (Lond) 2009, 23:1134-1140.

65. Scott K: The Swansea electronic referrals project. J Telemed Telecare 2009, 15:156-158.

66. Piterman L, Koritsas S: Part II. General practitioner-specialist referral process. Intern Med J 2005, 35:491 -496.

67. Goldman L, Lee T, Rudd P: Ten commandments for effective consultations. Arch Intern Med 1983, 143:1753-1755.

68. Forrest CB: A typology of specialists' clinical roles. Arch Intern Med 2009, 169:1062-1068.

69. Salerno SM, Hurst FP, Halvorson S, Mercado DL: Principles of effective consultation: an update for the 21st-century consultant. Arch Intern Med 2007, 167:271 -275.

70. Mitus AJ: The birth of InterQual: evidence-based decision support criteria that helped change healthcare. Prof Case Manag 2008, 13:228-233.

71. CM protocol results in decreased denials. Healthcare Benchmarks Qual Improv 2009, 16:20-22.

72. Lucassen A, Watson E, Harcourt J, Rose P, O'Grady J: Guidelines for referral to a regional genetics service: GPs respond by referring more appropriate cases. Fam Pract 2001, 18:135-140.

73. Fertig A, Roland M, King H, Moore T: Understanding variation in rates of referral among general practitioners: are inappropriate referrals

important and would guidelines help to reduce rates? BMJ 1993, 307:1467-1470.

74. Reti SR, Feldman HJ, Ross SE, Safran C: Improving personal health records for patient-centered care. J Am Med Inform Assoc 2010, 17:192-195.

75. Singh H, Hirani K, Kadiyala H, Rudomiotov O, Davis T, Khan MM, Wahls TL: Characteristics and Predictors of Missed Opportunities in Lung Cancer Diagnosis: An Electronic Health Record-Based Study. J Clin Oncol 2010, 28:3307-3315.

76. de Meyer F, Lundgren PA, de Moor G, Fiers T: Determination of user requirements for the secure communication of electronic medical record information. Int J Med Inform 1998, 49:125-130.

77. Tang PC, Ash JS, Bates DW, Overhage JM, Sands DZ: Personal health records: definitions, benefits, and strategies for overcoming barriers to adoption. J Am Med Inform Assoc 2006, 13:121 -126.

78. Davis K, Schoenbaum SC, Audet A-M: A 2020 vision of patient-centered primary care. J Gen Intern Med 2005, 20:953-957.

79. Nutting PA, Miller WL, Crabtree BF, Jaen CR, Stewart EE, Stange KC: Initial lessons from the first national demonstration project on practice transformation to a patient-centered medical home. Ann Fam Med 2009, 7:254-260.

80. Reid RJ, Fishman PA, Yu O, Ross TR, Tufano JT, Soman MP, Larson EB: Patient-centered medical home demonstration: a prospective, quasi-experimental, before and after evaluation. Am J Manag Care 2009,


81. Carrell D, Ralston JD: Variation in Adoption Rates of a Patient Web Portal with a Shared Medical Record by Age, Gender, and Morbidity Level.

AMIA Annual Symposium Proceedings 2006, 2006:871.

82. Kaelber DC, Jha AK, Johnston D, Middleton B, Bates DW: A Research Agenda for Personal Health Records (PHRs). Journal of the American Medical Informatics Association 2008,15:729-736.

83. Eysenbach G: Medicine 2.0: Social Networking, Collaboration, Participation, Apomediation, and Openness. Journal of Medical Internet Research 2008,10(3):e22.

84. Gibbons MC: Use of Health Information Technology among Racial and Ethnic Underserved Communities. American Health Information Management Association: Perspectives in Health Information Management / AHIMA; 2011:8.

85. Patel VL, Kushniruk AW: Interface design for health care environments: the role of cognitive science. Proc AMIA Symp 1998:29-37.

86. Warren J, White S, Day KJ, Gu Y, Pollock M: Introduction of Electronic Referral from Community Associated with More Timely Review by Secondary Services. Applied Clinical Informatics 2011, 2:546-564.

87. Palen TE, Price D, Shetterly S, Wallace KB: Comparing virtual consults to traditional consults using an electronic health record: an observational case^control study. BMC Medical Informatics and Decision Making 2012, 12:65.

88. Hersh W, Helfand M, Wallace J, Kraemer D, Patterson P, Shapiro S, Greenlick M: A systematic review of the efficacy of telemedicine for making diagnostic and management decisions. J Telemed Telecare 2002, 8:197-209.

89. Callahan CW, Malone F, Estroff D, Person DA: Effectiveness of an Internet-based store-and-forward telemedicine system for pediatric subspecialty consultation. Arch Pediatr Adolesc Med 2005, 159:389-393.

90. The control handbook. New York\: CRC Press; 1996.

91. Gardner RM: Clinical decision support systems: the fascination with closed-loop control. Yearb Med Inform 2009:17-21.

92. Gaudinat A: Closing the loops in biomedical informatics from theory to daily practice. Yearb Med Inform 2009:37-39.

93. Murphy DR, Reis B, Sittig DF, Singh H: Notifications received by primary care practitioners in electronic health records: a taxonomy and time analysis. Am J Med 2012, 125(209):e1 -7.

94. Brynjolfsson E, Hitt LM: Beyond computation: Information technology, organizational transformation and business performance. J Econ Perspect 2000, 14:23-48.

95. Southon FC, Sauer C, Grant CN: Information technology in complex health services: organizational impediments to successful technology transfer and diffusion. J Am Med Inform Assoc 1997, 4:112-124.

96. Toussaint PJ, Coiera E: Supporting communication in health care. Int J Med Inform 2005, 74:779.

97. Ash JS, Berg M, Coiera E: Some Unintended Consequences of Information Technology in Health Care: The Nature of Patient Care Information System-related Errors. J Am Med Inform Assoc 2004, 11:104-112.

98. Magrabi F, Ong M-S, Runciman W, Coiera E: An analysis of computer-related patient safety incidents to inform the development of a classification. J Am Med Inform Assoc 2010, 17:663-670.

99. Magrabi F, Ong M-S, Runciman W, Coiera E: Using FDA reports to inform a classification for health information technology safety problems. J Am Med Inform Assoc 2012, 19:45-53.

100. Sittig DF, Singh H: Defining health information technology-related errors: new developments since to err is human. Arch Intern Med 2011, 171:1281-1284.

101. Sittig DF, Ash JS, Zhang J, Osheroff JA, Shabot MM: Lessons from "Unexpected increased mortality after implementation of a commercially sold computerized physician order entry system.". Pediatrics 2006, 118:797-801.


Cite this article as: Esquivel et al.: Improving the Effectiveness of Electronic Health Record-Based Referral Processes. BMC Medical Informatics and Decision Making 2012 12:107.

Submit your next manuscript to BioMed Central and take full advantage of:

• Convenient online submission

• Thorough peer review

• No space constraints or color figure charges

• Immediate publication on acceptance

• Inclusion in PubMed, CAS, Scopus and Google Scholar

• Research which is freely available for redistribution

Submit your manuscript at Tpntral >_ciiuai