BMC Health Services Research »J-c«^
Open Access
Research article
Effects of insurance status on children's access to specialty care: a systematic review of the literature
Asheley Cockrell Skinner*1 and Michelle L Mayer1,2
Address: department of Health Policy and Administration, University of North Carolina at Chapel Hill, Chapel Hill, North Carolina, USA and 2Cecil G. Sheps Center for Health Services Research, University of North Carolina at Chapel Hill, Chapel Hill, North Carolina, USA
Email: Asheley Cockrell Skinner* - asheley@unc.edu; Michelle L Mayer - michelle_mayer@unc.edu * Corresponding author
Published: 28 November 2007 Received: 26 September 2006
Accepted: 28 NOVember 2007 BMC Health Services Research 2007, 7:194 doi:l 0.1186/1472-6963-7-194 H
This article is available from: http://www.biomedcentral.eom/l472-6963/7/l94
© 2007 Skinner and Mayer; licensee BioMed Central Ltd.
This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
Abstract
Background: The current climate of rising health care costs has led many health insurance programs to limit benefits, which may be problematic for children needing specialty care. Findings from pediatric primary care may not transfer to pediatric specialty care because pediatric specialists are often located in academic medical centers where institutional rules determine accepted insurance. Furthermore, coverage for pediatric specialty care may vary more widely due to systematic differences in inclusion on preferred provider lists, lack of availability in staff model HMOs, and requirements for referral. Our objective was to review the literature on the effects of insurance status on children's access to specialty care.
Methods: We conducted a systematic review of original research published between January 1, 1992 and July 31, 2006. Searches were performed using Pubmed.
Results: Of 30 articles identified, the majority use number of specialty visits or referrals to measure access. Uninsured children have poorer access to specialty care than insured children. Children with public coverage have better access to specialty care than uninsured children, but poorer access compared to privately insured children. Findings on the effects of managed care are mixed.
Conclusion: Insurance coverage is clearly an important factor in children's access to specialty care. However, we cannot determine the structure of insurance that leads to the best use of appropriate, quality care by children. Research about specific characteristics of health plans and effects on health outcomes is needed to determine a structure of insurance coverage that provides optimal access to specialty care for children.
Background
In recent years, access to pediatric specialty care has become a concern in the United States. While much of this concern stems from a known maldistribution and assumed shortage of these providers [1], insurance status is another important determinant of access. In the current
economic climate, many states facing budget shortfalls are seeking ways to reduce expenditures in their Medicaid and State Children's Health Insurance (SCHIP) programs, including reducing covered services, increasing copay-ments, limiting those eligible for coverage [2], and implementing enrollment freezes in SCHIP [3]. Families with
private insurance are also struggling, as employers turn to lower-cost plans with reduced benefits and increased cost-sharing, require greater employee contributions to premiums, particularly for family coverage, or offer catastrophic-only coverage [4].
These changes in the availability and benefit structures of health insurance could detrimentally affect access to specialty care. Uninsured adults and those in health maintenance organizations (HMOs) are significantly less likely than privately insured persons to use specialty care, and those covered by Medicaid are the least likely of all to use specialty care [5]. In contrast, other studies found that managed care enrollees receive more referrals from their primary care physician than other adults [6] and that removal of gatekeeping mechanisms does not increase use of specialty care [7].
The effects of insurance on children's access to specialty care may differ from the effects that have been noted in adult populations. For example, the supply-side effects of insurance status are less certain for pediatric specialty care as pediatric subspecialists are heavily concentrated in academic medical centers [8,9]. Here managed care arrangements may indirectly influence the number of pediatric subspecialists by changing institutional staffing plans [10]. In addition, fewer than 5% of providers in any given pediatric specialty are located in HMOs [9], which may limit access for these children despite having insurance coverage. The demand for specialty services also differs markedly between pediatric and adult populations. With a few notable exceptions, chronic pediatric conditions are relatively rare, leading to less demand for these providers relative to their internal medicine counterparts.
Although previous research demonstrates a strong relationship between insurance status and primary care access, these findings may differ for pediatric specialty care. Pediatric specialists, with their heavy concentration in academic medical centers, may be less sensitive to price than primary care physicians. Consequently, commonly-held differences between private insurance, Medicaid, and self-pay patients may not be as strong for children's specialty care. Coverage for primary care needs is common across private insurance, Medicaid, and SCHIP plans whereas coverage for specialty care varies more widely, often with greater copayments and more stringent definitions of medical necessity in private insurance plans. More generous specialty coverage by Medicaid may minimize differences between public and private coverage in access to subspecialty care.
On the other hand, access to specialty care may be more complex than access to primary care, magnifying the effects of insurance status for a child. In most cases, chil-
dren are referred to specialty care from a primary care physician, which may serve as an additional barrier to accessing and using specialty care, particularly for children who are uninsured. Also, specialty care is generally more expensive, whether paid out of pocket or with greater insurance copayments, which may have an even greater negative effect on children who are uninsured or low-income insured. Among privately insured children, gate-keeping arrangements or restrictions on referrals to out of network providers may constrain access.
To develop a more complete picture of access to pediatric specialty care, it is important to understand how insurance status affects access to and actual use of this care. While specialty care is often required of children with special health care needs, it is not limited to this group, as children without chronic medical needs may also need access to specialty care. To this end, we performed a literature review to summarize the effects of insurance on children's access to specialty care.
Methods Search Protocol
This review is part of a broader review of access to and quality of specialty care for children that has been previously described [11]. We used Pubmed to search for all articles related to our question of interest. Because of inconsistencies in the assignment of MeSH terms to articles, we used an exhaustive list of MeSH terms to identify articles (Additional File 1). Each individual specialty was searched for relevant articles and all articles were cross-referenced with children or pediatrics.
Eligibility Criteria
To be retained for the literature synthesis, each article had to 1) present original data, 2) study children or adolescents or physicians involved in their care, 3) address the effects of insurance on access to or use of specialty care, and 4) be performed in the United States.
We included English-language articles published between January 1, 1992 and July 31, 2006. We excluded editorials, comments, letters, review articles and meta-analyses, practice guidelines, and policy statements. Because we were interested in physician care of children with medical problems requiring specialty care we excluded articles on dentistry, nursing, and primary care, acute illness (such as upper respiratory infections), immunizations, reproductive health and prenatal care. In addition, we excluded all studies of mental health issues, because insurance for mental health coverage often differs markedly from coverage for other specialty care. We also excluded studies related to ancillary or non-physician services, such as physical therapy and prescription medications, as access to these services differs in the frequency of use relative to
physician services and insurance coverage policies. We did not exclude studies based on their quality, opting instead to include all relevant studies and discuss the strengths and weaknesses as part of the review.
Our initial search strategy identified 2406 abstracts that were potentially relevant to our broader review on access to and quality of specialty care for children (Figure 1). Each abstract was reviewed relative to our exclusion criteria by two reviewers. The senior author (MLM) reviewed disputed abstracts and made the final decision on their inclusion; 491 relevant abstracts were identified for full abstraction. We also reviewed these articles' references for overlooked citations. Two separate reviewers then abstracted each complete article. The primary author (ACS) reviewed all articles to validate their inclusion.
Definitions
We approached the review with a broad definition of access, aiming to capture all studies that examined how children seek out and use specialty care, which is defined as care delivered by non-primary care physicians. We looked for measures such as utilization, absence of unmet needs, referrals, availability of specialists and appointments, and length of time to referral. Terminology is inconsistent throughout the literature; however, we use consistent terms throughout this review even when they differ from the term used by the original author. Insurance refers to a source of payment for medical services. Uninsured reflects a lack of payment source other than self-pay. Public insurance includes Medicaid and the State Children's Health Insurance Program (SCHIP). Private insurance refers to any coverage that is not publicly funded, including employer-based coverage and individually-pur-
chased coverage. We define a gatekeeping arrangement as one in which patients must visit or receive a referral from a primary care physician before visiting a specialist (i.e., the patient is not able to self-refer without financial consequences). We refer to fee-for-service arrangements as those that reimburse physicians on a per-service basis, rather than a capitated arrangement, and that allow patients to self-refer. We refer to HMOs as those plans that require patients to receive virtually all care within a specified group of physicians, with payment usually made in the form of capitation. The term "managed care" is often used in the literature, referring to insurance of varying types, but typically it requires or provides incentives for using a defined network of providers. If the form of managed care is not evident we refer to this simply as managed care.
Literature Synthesis
From each included article, we abstracted information on the type of specialty care, research design and methods, sample characteristics, type of comparison (e.g., uninsured vs. insured, Medicaid vs. private, etc.), and findings relevant to the effects of insurance on access to specialty care. Three primary comparisons of the effects of insurance were explored: (1) differences between children with and without insurance, (2) differences between children with public vs. other forms of insurance (generally private), and (3) differences between children in managed care vs. other forms of insurance. Whenever possible, we described characteristics of the insurance coverage. Some articles examined more than one of these comparisons. Substantial variation in methods and measures precluded formal meta-analyses. Therefore, results are presented in narrative form.
Figure!
Distribution of articles included in full literature review.
Results
Thirty articles met all inclusion criteria (Tables 1). Most (67%) of the included studies examined all "specialty care," rather than focusing on a single specialty. The remaining studies examined specialists for asthma, juvenile rheumatoid arthritis, cardiac care, urology, and otolaryngology.
Uninsured
The reviewed studies consistently show a negative association between uninsurance and access to specialty care for children (Table 2). In the five studies that address use of specialty care by uninsured children, these children receive less specialty care than both their privately and publicly insured counterparts [12-16].
The five studies identified on uninsured children found that they use less specialty care and experience greater delays in referrals than do insured children [12-16]. An evaluation of Child Health Plus in New York State showed
Table 1: Characteristics of included articles.
Specialty Number Percent
All/Not specific 20 67
Asthma specialist 6 20
Juvenile rheumatoid arthritis specialist 1 3
Cardiology 1 3
Urology 1 3
Otolaryngology 1 3
Sample Location
Local/Other 12 40
State 12 40
National 6 20
Access Measure
Utilization 17 57
Referral rate 3 10
Referral type 1 3
Satisfaction with availability of specialists 1 3
Unmet need 5 17
Time to referral 1 3
Appointment availability 2 7
Study Population 0
Patients 26 87
Physicians 3 10
Both 1 3
While few studies have examined the effect of being uninsured on children's access to specialty care, many studies have demonstrated that lack of insurance negatively affects access to physician services for children [17-19]. Our findings here are consistent with this previous research. It is unclear if lack of insurance reduces parents' efforts to obtain specialty care for their children or acts as a barrier in instances where people have tried to obtain care.
The lack of insurance may create a two-fold barrier to specialty care, further complicating access for uninsured children. Uninsured children have more difficulty accessing primary care [20], which may be necessary for parents to even realize a need for specialty care. Even if they do receive primary care, the greater expense of specialty care makes it more difficult to obtain than primary care.
On the other hand, uninsured children may use less specialty care because they need less specialty care. None of the studies included here consider selection into insurance plans. Parents may choose to not insure their child if they are confident the child has few needs for health care, particularly the more expensive specialty care.
a five-fold increase in specialist visits before and after enrollment for previously uninsured children [16]. A study of referral delays found that uninsured children had the greatest length of time before referral to a cardiac specialist for congenital heart disease [15]. One national study found that uninsured children with recurrent ear infections were less likely to have a seen a specialist than children with public or private insurance [14]. Another national survey showed that any period of uninsurance is associated with significantly greater unmet needs for care [13], a finding that held when examining results for children in Mississippi [12].
Public insurance
Eighteen studies examined differences in access to care for children with Medicaid or SCHIP (Table 3) [13-16,21-33]. Many of these studies suggest that children with public insurance have better or similar access to care, compared to children with private insurance. In a study of pediatricians' referral patterns, children with Medicaid received more specialty referrals than children with private insurance [24]. Similarly, a study of asthmatic children found that children in a state health insurance plan for low-income children and children with Medicaid were more likely to be referred to a specialist than children with pri-
Table 2: Summary of articles addressing the effects of uninsurance on access to specialty care.
Author Year Sample Size Data Source Study Design Access Measure Statistic Comparison Findings Endogeneity/ Selection
Kane et al. 2005 700 National Survey Cross- Unmet needs Logistic regression; Ever uninsured OR = 8.6, No consideration of
[12] of CSHCN, sectional likelihood of unmet vs. insured all p < 0.001 selection into
single state need year insurance
Mayer et al. 2003 38,866 National Survey Cross- Unmet need Logistic regression; Private insurance OR = 4.29, No consideration of
[13] of CSHCN sectional likelihood of unmet vs. uninsured p < 0.0l selection into
need for specialty care coverage type
Park et al. 2002 1,985 National Health Cross- Utilization Proportion having Uninsured vs. any Less likely vs. No consideration of
[14] Interview Survey sectional seen a specialist insurance type any insurance selection into
(exact values not coverage type
reported)
Perlstein et al. 1997 544 Regional cardiac Retrospective Time to t-test; mean age at Uninsured vs. 251 days vs. 80 No consideration of
[15] registry cohort referral referral "commercial" days, p < 0.05 selection into
coverage type
Szilagyi, et al. 2000 2,126 Single SCHIP Quasi- Utilization t-test, difference in Uninsured vs. Fivefold No consideration of
[16] experimental number of specialist following SCHIP increase in selection in
visits (pre- and post- enrollment utilization after program
enrollment) SCHIP
enrollment
S Table 3: Summary of articles addressing the effects of public insurance on access to specialty care.
Author Year Sample Size Data Source Study Design Access Measure Statistic Comparison Findings Endogeneity/Selection
Cabana et al. [21] 2002 3,163 Single MCO Cross-sectional Utilization Logistic regression; likelihood Medicaid vs. non-Medicaid Private with copay: OR = Single MCO with Medicaid and
of specialty care insured 2.52, p < 0.05 Private w/o private; patients do not choose
copay: OR = 3.40, p = NS
Damiano et al. [22] 2003 463 State SCHIP Prospective cohort Unmet need McNemar; unmet need pre- SCHIP vs. prior coverage 40% vs. 13%; p < 0.05 No consideration of selection
vs. post-enrollment into program
Davidoff et al. [23] 2005 3413 National Health Interview Quasi-experimental Utilization Change in proportion with any SCHIP ineligible vs. SCHIP +3.8, p = NS Groups compared on eligibility,
Survey visit eligible not enrollment
Forrest et al. [24] 1999 27,104 National practice-based Prospective Referral rates t-test, percent referred; Medicaid vs. Private 4.46% vs. 2.61%, p < 0.001 No consideration of selection
research network logistic regression, likelihood into coverage type
of referral to specialty
Holl et al [25] 2000 1,730 Single SCHIP Quasi-experimental Utilization Change in proportion with any Prior to SCHIP enrollment Age < 1 year: 15.5% vs. 16.1%, No consideration of selection
specialist visit vs. after enrollment p = NS; Age 1-5 years: 19.7% into program
vs. 19.4%, p = NS
Hwang et al. [26] 2005 54 Clinics in a single state Cross-sectional Appointment t-test, proportion offering Private insurance vs. 96% vs. 41%, p < 0.0001 Physician offices; no patient
availability appointment Medicaid selection
Kempe et al. [27] 2000 596 Pediatric practices in a Retrospective Referral rates X2; proportion with referral Private insurance vs. 11% vs. 20%, p = 0.09 No consideration of selection
single state cohort Medicaid into coverage type
Kempe et al [28] 2005 480 Single SCHIP Prospective cohort Utilization Logistic regression; saw Prior to enrollment vs. OR = 1.96, p < 0.05; OR = No consideration of selection
specialist when needed; any after enrollment 1.22, p = NS into program
specialist visit
Mayer et al. [13] 2004 38,866 National Survey of Cross-sectional Unmet need Logistic regression; likelihood Private insurance vs. Medicaid: OR = 1.26, p = NS; No consideration of selection
CSHCN of unmet need for specialty Medicaid and SCHIP SCHIP: OR = 0.82, p = NS into coverage type
Ortega et al. [29] 2001 1,002 Multiple hospitals; single Retrospective Utilization X2;percent seeing an asthma Private insurance vs. 30% vs. 6%, p < 0.001 No consideration of selection
geographic region cohort specialist Medicaid into coverage type
Park et al. [14] 2002 1,985 National Health Interview Cross-sectional Utilization Proportion having seen a Private insurance vs. public Less likely vs. private No consideration of selection
Survey specialist insurance insurance into coverage type
Perlstein et al. [15] 1997 544 Regional cardiac registry Retrospective Time to referral t-test; mean age at referral Medicaid vs. "commercial" 168 days vs. 80 days, p < 0.05 No consideration of selection
cohort into coverage type
Price et al. [34] 1999 94 Single hospital Cross-sectional Utilization t-test; number of specialist Medicaid vs. fee-for-service All: 3 vs. 6, p = NS; asthma- No consideration of selection
visits related: 2 vs.4, p < 0.05 into coverage type
Szilagyi, et al. [3 1] 2000 187 Single SCHIP, children Quasi-experimental Utilization X2 and t-test; percent seeing Prior to SCHIP enrollment Any specialist: 30% vs. 40%, p No consideration of selection
with asthma specialist, number of visits vs. after enrollment = 0.02; Visits: 0.36 vs. 0.48, p = 0.02 into program
Szilagyi, et al. [16] 2000 2,126 Single SCHIP Quasi-experimental Utilization t-test, difference in number of Prior to SCHIP enrollment 0.174 more visits after No consideration of selection
specialist visits vs. after enrollment enrollment, p < 0.001 into program
Szilagyi et al. [30] 2004 2,644 Single SCHIP Prospective cohort Utilization and Logistic regression, change in Prior to SCHIP enrollment 15.5 percentage point No consideration of selection
unmet need unmet needs pre- and post- vs. after enrollment decrease after enrollment, p < into program
enrollment 0.01
Wang et al. [32] 2004 100 Clinics in single state Cross-sectional Appointment Percentage comparisons, no Private PPO vs. Medicaid 97% vs. 27% Physician offices; no patient
availability statistical test, percent offering selection
an appointment
Zwanziger, et al. [33] 2000 1,910 Single SCHIP Quasi-experimental Utilization OLS, change in expenditures Prior to SCHIP enrollment $71.85 increase after No consideration of selection
pre- and post-enrollment vs. after enrollment enrollment into program
ф со
"<ö ф î
vate insurance [27]. Children with special health care needs who had public insurance were no more likely than children with private insurance to have unmet needs for specialty care [13].
Several additional studies also show a positive effect, but do not isolate the effects to compare public coverage to private coverage, instead showing the effects of enrollment into public insurance programs, pooling children who were previously uninsured and those who previous had private insurance coverage. Enrollment in the Iowa SCHIP program significantly reduced unmet need for specialty care compared to the period before enrollment [22]. Children who were eligible for SCHIP at its inception had a small but not statistically significant increase in the likelihood of having any specialist visit [23]. Two studies found that children overall and asthmatic children specifically used more specialty care in their first year with New York State's Child Health Plus coverage, a state-run health program that now includes SCHIP, than in the previous year with another type of coverage, including no insurance [16,31]. Another study of Child Health Plus found that enrollment had a small positive effect on specialty care utilization and accounted for a $.21 average increase in expenditures per child, compared to the child's previous insurance status [33]. Two additional studies of Child Health Plus found no significant difference in utilization of specialty care after enrollment in SCHIP, compared to the year prior to enrollment for all children and children up to age five [25,28]. Finally, enrollment in Child Health Plus was related to significantly fewer unmet needs for specialty care [25,30]. Because these studies group previously uninsured children with those who were insured prior to enrollment we cannot isolate the effects of public insurance by different types of previous coverage.
Although studies suggest that children with public insurance have improved access, particularly if they would otherwise be uninsured, additional studies indicate that they fare worse, compared to privately insured children. Children enrolled in Medicaid managed care organizations were less likely to receive specialty care than children enrolled through non-Medicaid coverage [21]. Similarly, children with "public insurance" were less likely to have seen a specialist than children with private insurance [14]. A study of asthmatic children found that those covered by Medicaid were less likely than children with private insurance to receive specialty asthma care, and when they did, they were less likely to receive it from a board-certified physician [29]. A study of children with severe asthma found that Medicaid-insured children had fewer visits to specialists for sick care or asthma care than children with other forms of insurance [34]. A study that examined referrals from pediatricians found that Medicaid-insured children with congenital heart disease were referred to a
pediatric cardiologist at older ages than children with managed care or other private insurance [15]. Two studies that assessed physicians' willingness to accept Medicaid patients showed that children with Medicaid were less likely to be able to get an appointment with either an otolaryngologist [32] or a urologist [26].
The literature investigating the effects of Medicaid or SCHIP coverage on access to specialty care for children is less conclusive than that investigating uninsurance. It is important to note that six of the eleven articles that found either no effect or improvement in specialty care access were samples from the New York State's Child Health Plus program [16,25,28,30,31,33]. Of the seventeen studies that we reviewed, only three studies of public insurance used nationally representative samples [13,14,23]. Therefore, the findings of the studies are not generalizable to Medicaid and SCHIP plans in every state.
Although Medicaid and SCHIP certainly appear to improve access for children who would otherwise be uninsured, Medicaid enrollees appear less likely than children with private coverage to receive a referral to specialty care, to receive specialty care, or to receive that care from a board-certified physician [14,15,21,29,34], and more likely to have difficulties finding a physician willing to accept Medicaid [26,32]. One exception to this is the finding that Medicaid children appear to have more specialty referrals, although these studies do not address whether Medicaid children receive the specialty care to which they are referred [24,27].
The fact that children enrolled in Medicaid and SCHIP have better access then their uninsured counterparts has great importance for current attempts by states to control costs through enrollment freezes, coverage limits, or eligibility reductions [2,3]. Many children may find themselves uninsured due to these policy changes. Lack of coverage, coupled with low incomes, will likely have a significant negative impact on their ability to receive the specialty care they need [13].
One aspect of public insurance not addressed by these studies is the extent to which the scope of covered services affects access to specialty care. Medicaid programs tend to have broad definitions of covered services, while separate SCHIP plans and private insurance plans may have more restrictive guidelines for medical necessity and covered services [35,36]. Therefore, the reason for the greater difficulty accessing care among those with public insurance is not clear. It is possible that it is more difficult for those with Medicaid to find physicians willing to accept Medic-aid, or that this population simply faces more barriers in obtaining specialty care, such as transportation, obtaining
primary care and its referrals, or recognizing needs for specialty care.
Another important consideration for public insurance programs, often not addressed by current studies, is the endogeneity of public insurance and specialty care. Among the 18 studies that examine public insurance, only four are designed in a way that limits the effects of selection into the Medicaid or SCHIP programs. Specialists often have systems in place to determine if children qualify for public insurance programs and help them obtain coverage. If this is true, children with public insurance may seem to fare relatively well only because they are already under care for a specialist. In addition, publicly insured children may enroll in the programs primarily because their parents know their children need specialty care. The studies consistently show that children use more specialty care after enrollment, which could indicate that the parents seek out coverage specifically due to health care needs. If considering the entire population of children, who do not have prior specific needs for specialty care, the increase in specialty care use might be much smaller.
Managed care
The findings of the 14 articles that investigated differences in specialty care access between children in managed care arrangements and those in other insurance arrangements were highly inconsistent (Table 4). One set of studies found that managed care arrangements have no effect or a positive effect on access to specialty care. One study found no significant differences in the number of specialty visits for Medicaid-insured infants receiving coverage through a managed care arrangement compared to fee-for-service arrangements [37]. Another reported no differences in use of specialty care for children in Medicaid primary care case management arrangements, compared to traditional fee-for service arrangements [38]. A third found that removal of gatekeeping requirements in a managed care organization resulted in no significant increases in overall utilization of any specialists, although the increase in first-time visits was significant [39]. Children with disabilities are less likely to report an unmet need for a specialist visit if they are in managed care, compared to children in fee-forservice plans [40]. Similarly, another study found that children in a Medicaid HMO were more likely to receive a specialist visit than those in a gatekeeping arrangement, while children in fee-for-service are less likely to receive a specialist visit than the gatekeeping arrangement [41]. A small study of asthmatic children found that those in capitated managed care had more visits to specialists for sick care and asthma care [34]. Pediatricians reported more parental pressure to provide a referral for children in gate-keeping arrangements relative to FFS; however, pediatricians still provided more referrals for children in
gatekeeping arrangements after excluding those made at a parent's request [24]. Finally, mechanisms employed by managed care appeared to increase the use of specialty care - there were more specialist visits in an MCO when there were fewer physicians paid on a FFS basis and when a bonus was offered to physicians who met quality of care standards [42], and children in mandatory Medicaid HMO arrangements were more likely to have specialty care visit than those in FFS arrangements [38].
Five studies reported that children in managed care arrangements had worse access to specialty care [15,4346]. One found that 8.7% of pediatricians report referring children in managed care to specialists less than children with fee-for-service insurance [43]. A study of HMO satisfaction reported that families with children in HMOs were less likely than those with other types of coverage to be "very satisfied" with the choice of specialists available to them, which may suggest access barriers [46]. Another study reports that switching to a gatekeeping arrangement resulted in significantly fewer specialist visits for all children. Children with chronic conditions who enrolled in a gatekeeping arrangement had a 57% decrease in specialist use, while children who remained in a FFS arrangement had a 31% increase in specialist use [45]. A small study of children with juvenile rheumatoid arthritis found that those in managed care were more likely to first be referred to an orthopedist rather than a rheumatologist than those in fee-for-service [44]. Another study of physician referral patterns found that children with managed care were older than children with other private insurance at the time of initial referral to cardiac specialist for congenital heart disease [15].
The effects of managed care on access are much less clear than the effects of public insurance. One well-studied aspect of managed care is the use of gatekeeping arrangements, where the child must receive a specialty referral from his or her primary care physician. Gatekeeping arrangement have been found to have positive [24,41], negative [45], and neutral effects [39] on specialty care access. When comparing managed care generally to fee-for-service arrangements, the evidence is also mixed. Children in managed care appear to have later referrals to specialty care, and physicians claim that managed care creates barriers to referrals, including administrative barriers and lack of appropriate care in the plan [41,43,45,46].
There are several potential reasons for the varied results seen for the effects of managed care arrangements on access to specialty care. One previous study showed that families with special needs children are significantly less likely to enroll in gatekeeping plans [47], a finding also seen in one study included here [45]. Thus, the population that might be most susceptible to constraints
^ Table 4: Summary of articles addressing the effects of managed care on access to specialty care.
Author
^ Alessandrini et al. [37] hT- Cartland and "jz Yudkowsky [43]
O Cuesta et al. [44] O L J
"c Ferris et al. [39] CD O
® Ferris et al. [45] O
o Forrest et al [24]
Garrett et al [38]
Year Sample Data Source Size
Study Design
Access Measure
Statistic
Comparison
Findings
Endogeneity/Selection
MC mandated' no patient ^ selection
Study is of physician behavior; no patient selection Examines insurance type at initial referral, prior to diagnosis
Single MCO initiated removal of gatekeeping; no patient choice
Patient voluntarily selected into coverage type No consideration of selection into type of plan
Mandatory enrollment into program type
No consideration of selection into coverage type
Patients seek managed care exemptions
No consideration of selection into coverage type No consideration of selection into coverage type Voluntary selection into plan type
Lake [46]
Mitchell, Khatutsky, and Swigonski [40] Perlstein et al. [15]
Price et al. [34]
Roberto et al. [53]
2001 1992 2000
2001 1999
2001 1997 1999 2005
Shenkman at al. [42] 2004
553 Single hospital
1,264 American Academy of Cross-sectional Pediatrics Fellows
49 Single hospital
59,952 Single MCO
l,839 Single insurance plan
27,l04 National practice-based research network
34,280 National Health Interview Survey
12,383 Community Tracking Survey
966 Single SCHIP
544 Regional cardiac registry
94 Single hospital
935 Single Medicaid program
2,333 Single SCHIP
Prospective cohort Utilization
Referral rates Retrospective cohort Referral type
Quasi-experimental Utilization
Prospective cohort Utilization Prospective Referral rates
Retrospective
Cross-sectional
Utilization
Satisfaction
Cross-sectional Unmet need
Retrospective cohort Time to referral
Cross-sectional Utilization
Quasi-experimental Utilization
Cross-sectional
Shields, et al. [41]
6,231 Single Medicaid program Cross-sectional
Utilization
Utilization
X2; % with a specialty visit; number of visits X2; frequency of referral of MCO patients
t-test; number of specialist visits and proportion new specialist visits t-test; change in visits
t-test, percent referred; logistic regression, likelihood of referral to specialty Probit; mandatory PCCM vs. FFS, mandatory HMO vs. FFS; likelihood of any specialist visit Logistic regression; difference in percent satisfied with choice of specialists
X2; percent with unmet need for specialist
t-test; mean age at referral
t-test; number of specialist visits
Probit; change in access to specialist
Logistic regression; likelihood of a specialist visit
Logistic regression; likelihood of specialist visit
Managed care vs. fee-for-service Managed care vs. fee-for-service Initial referral is to rheumatologist vs. orthopedic surgeon With gatekeeping vs. without gatekeeping
Gatekeeping vs. indemnity Gatekeeping vs. no gatekeeping
Fee-for-service vs. primary care case management or HMO
Managed care vs. fee-for-service Managed care vs. "commercial" Capitated plan vs. fee-for-service Fee-for-service vs. partially capitated managed care Plans with certain managed care characteristics vs. those without
HMO vs. primary care case management plan
10% vs. 12%, p = 0.68; 0.2 vs. 0.2, p = 0.65
More frequent: 2.5%; less frequent, 8.7%; p < 0.05 Managed care: 83% vs. 17%; "Traditional commercial": 58% vs. 42%; p = NS Visits: 0.28 vs. 0.28, p = NS; % new visits: 30.6% vs. 34.8%; p < 0.05
57% decrease vs. 31% increase; p = 0.005 Medicaid, OR = 1.86, p < 0.001 ; Private, OR = 1.76, p < 0.01
PCCM = 0.003, p = NS; HMO = 0.378, p < 0.05
-8.3%, p < 0.05
6.0% vs. 10.6%, p = NS
140 days vs. 80 days, p < 0.05
All: 7.5 vs. 6, p = NS; asthma-related: 5 vs. 4, p,0.05 b = 0.221, p < 0.05
Percent paid on FFS basis: 0.950, p = 0.003; Bonus for quality profile: l.7l4, p = 0.0003
OR = l.80, p < 0.05
Mandatory enrollment into specific plan
Voluntary selection into coverage type
CB CD CO CD
CO CD O
CD CD Ï O
imposed by gatekeeping selectively avoids these plans. Six of the 14 included studies consider selection bias into managed care plans. Although inconsistency remains, there is a trend towards greater similarities between children enrolled in managed care and those in fee-for-service plans when the plan type or characteristics are mandated, either by changes from the managed care organization or public insurance policies.
Under gatekeeping arrangements, primary care physicians may refer children more because they are required to provide the referral for coverage of the specialty care as opposed to merely recommending self-referral or they feel more pressure from parents to make a referral under these arrangements [24]. Because these studies do not address the issue of the appropriateness of the referral, physicians may also feel time and financial pressures to see as many patients as possible, and use referrals to specialists as a way to divert the care of more complicated and time-consuming patients.
The lack of appropriate care in managed care organizations is of particular concern. Because children in managed care are often limited in which physicians they are allowed to see, they may find themselves unable to obtain the specific type of specialty care needed. Patients in managed care report less satisfaction with the choice of providers available to them [46] and children in managed care with juvenile rheumatoid arthritis appear more likely to be first referred to an orthopedist than a rheumatologist [44]. No other current studies examine the extent to which insurance affects the type of specialty care provider seen or if the cause is limited supply of specialty physicians due to managed care. The literature is peppered with unreferenced comments that certain types of managed care arrangements, such as staff model HMOs and IPAs lack pediatric subspecialty care providers in their networks [48,49]. These comments may reflect evidence that a very small percentage of pediatric subspecialists practice in HMOs [9]. Yet, no other studies have demonstrated differences in the types of subspecialists seen (i.e., adult vs. pediatric subspecialists) by insurance type or explored the effects of the changes in health care financing and organization on the availability of pediatric subspecialty care.
The current attempts by employers to rein in ever-rising health care costs makes it important to understand how their efforts will affect children, particularly those who regularly need specialty care. Although the data are certainly not clear, the use of managed care plans may affect which specialists children can see or require a higher copayment to see their current physician. The move to plans with greater cost-sharing for services, in the form of copayments or premium contributions, will have detri-
mental effects on children who need care the most, particularly in families with the lowest incomes.
Discussion
This review provides evidence that the availability and structure of insurance affects children's access to specialty care. However, it also demonstrates that current research is lacking in its ability to show which arrangements best improve the health of children needing specialty care. None of the studies included here explore the relationship between insurance coverage, access to specialty care, and health outcomes.
Quality of literature
The current literature on children's access to specialty care lacks in many areas. Most of the research uses narrow samples that do not permit generalization to a larger population, do not consider differences in types of specialists or quality of care, do not consider the effects on health outcomes, use limited measures of access to care, and do little to help us understand why there are differences. The existing literature merely demonstrates that differences in access to subspecialty care exist by insurance status.
The primary limitation of current research is the inability to make generalizations across the pediatric population. The studies vary greatly in populations sampled, methods, and means of measuring access to specialty care. For example, studies of managed care effects may be based in a small area, include Medicaid-only populations, or use different definitions of managed care.
The characteristics of current research also leave us unable to answer several important questions. First, the majority of studies that examine access to specialty care for children do not consider differences by insurance in the type of providers used by children, such as a pediatric versus an adult specialist. A study of Medicaid children showed that only a minority of children with serious medical conditions received their care from pediatric subspecialists and that many relied on adult specialists and general pediatricians for their care [50]. The extent to which non-Medic-aid children with chronic conditions rely on adult subspecialists and general pediatricians and the relative quality of these providers are important but poorly understood issues.
Another limitation is the lack of information about the child's health outcomes. Although children in gatekeep-ing arrangements may be more likely to receive a specialty referral, this does not necessarily indicate that they are receiving the most appropriate course of treatment. Similarly, uninsured children may have a higher threshold of illness before they are willing to seek specialty care, but the extent to which such delays actually result in poorer
outcomes is not known. Newacheck and colleagues found that while use of managed care by children did lower use of physician services, there was no significant difference in health status [51], although it is not known whether such findings would hold true for children in need of specialty care.
If use of specialty care will not improve a child's health, lower likelihood of referral for certain children is not necessarily a problem. Unfortunately, most research relies on two main outcome measures - physician referral rates and patient utilization. Other measures could improve the ability to make recommendations about what types of insurance provide optimal coverage. One possibility already mentioned is the use of health outcomes. Another possibility is measuring unmet need, the extent to which a child cannot receive care that is needed. Additional information about the symptoms and illness that led to the specialty referral might allow professional judgments of need and appropriateness of referrals.
The research to date also does not allow us to understand the reasons why children with different insurance types have differing access to specialty care. Because so many pediatric specialists are located in academic medical centers, it is likely that they are less sensitive to the price differences between Medicaid, SCHIP, and private insurance. One explanation for this is that insurance coverage is a greater barrier to seeking coverage than actually obtaining it. Insurance type has been shown to affect whether parents of children with special health care needs perceive any need for care at all [52]. Perhaps differences in use of specialty care are caused, in part, by differences in the extent to which parents seek out specialty care or primary care physicians refer children.
We have not considered all health care needs here, only specialty care. The users of specialty care are often, but not always, children with special health care needs. These children frequently need a broad array of services, including physical and occupational therapy, and prescription medications. Because such services are often needed more frequently than physician visits, we would expect the effects of insurance to have a more dramatic effect on these services. Children with mental health conditions may also be particularly vulnerable to the effects of insurance status given the historical lack of parity between coverage for physical and mental health conditions. These are also areas where children with public coverage, particularly Medicaid, fare better as private insurance plans often have limitations of the number of visits covered for mental health visits and other non-physician services.
Conclusion
Although there is a growing body of literature on the effects of insurance on children's access to specialty care, findings have been so varied that it is not possible to draw firm conclusions about the effects of differing types of insurance. It is clear, however, that children with some form of coverage receive more referrals and make greater use of specialty care than children with no insurance.
This review demonstrates limitations in the current literature that should be pursued in the future. First, additional research is needed on how well Medicaid and SCHIP patients can access specialty care, relative to privately insured children. Second, while overall utilization and referral rates are useful starting points for studying access to specialty care, it is also important to understand how insurance affects the types of specialists seen. Finally, future research should address how these differences affect health outcomes.
Based on the current literature, we cannot determine the structure of insurance that leads to the best use of appropriate, quality care by children. Only with additional research about the specific characteristics of health plans and the effects on health outcomes will it be possible to determine a structure of insurance coverage that provides optimal access to specialty care for children.
Competing interests
The author(s) declare that they have no competing interests.
Authors' contributions
ACS carried out the literature review, synthesized the literature, and drafted and revised the manuscript. MLM conceived of the idea, carried out the literature review, synthesized the literature, and assisted in revising the manuscript. Both authors read and approved the final manuscript.
Additional material
Additional file 1
Search criteria. Detailed description of the search criteria used in the literature review. Click here for file
[http://www.biomedcentral.com/content/supplementary/1472-6963-7-194-S1.doc]
Acknowledgements
The research was supported, in part, through grant #I-K02-HS0I3309-0IAI from the Agency for Healthcare Research and Quality. Dr. Skinner's time was funded, in part, by National Research Service Award, #H-T32-HS00032-I4, from the Agency for Healthcare Research and Quality. We
wish to thank Indu Adhikary for her assistance with the literature review.
We also thank Morris Weinberger for comments. Finally, we appreciate
the input from the reviewers, whose comments significantly improved the
paper.
References
1. Mayer ML: Are we there yet? Distance to care and relative supply among pediatric medical subspecialties. Pediatrics 2006, 118:2313-2321.
2. Smith V, Ramesh R, Gifford K, Ellis E, Wachino V, O'Malley M: States respond to fiscal pressure: A 50-state update of state Medicaid spending growth and cost containment actions. In Book States respond to fiscal pressure: A 50-state update of state Medicaid spending growth and cost containment actions (Editor ed.Aeds.) City: Kaiser Family Foundation, Kaiser Commission on Medicaid and the Uninsured; 2003.
3. Ross D, Cox L: Out in the cold: Enrollment freezes in six State Children's Health Insurance Programs withhold coverage from eligible children. In Book Out in the cold: Enrollment freezes in six State Children's Health Insurance Programs withhold coverage from eligible children (Editor ed.Aeds.) City: Kaiser Commission on Medicaid and the Uninsured, Kaiser Family Foundation; 2003.
4. Claxton G, Holve E, Finder B, Gabel J, Pickreign J, Whitmore H, Hawkins S, Dhont K: Employer Health Benefits: 2003 Annual Survey. In Book Employer Health Benefits: 2003 Annual Survey (Editor ed.^eds.) City: Kaiser Family Foundation and Health Research and Educational Trust; 2003.
5. Clancy CM, Franks P: Utilization of specialty and primary care: the impact of HMO insurance and patient-related factors. J Fam Pract 1997, 45:500-508.
6. Franks P, Clancy CM: Referrals of adult patients from primary care: demographic disparities and their relationship to HMO insurance. J Fam Pract 1997, 45:47-53.
7. Ferris TG, Chang Y, Blumenthal D, Pearson SD: Leaving gatekeeping behind - effects of opening access to specialists for adults in a health maintenance organization. N Engl J Med 2001, 345:1312-1317.
8. Oliver TK Jr, Tunnessen WW Jr, Butzin D, Guerin R, Stockman JA 3rd: Pediatric work force: data from the American Board of Pediatrics. Pediatrics 1997, 99:241-244.
9. Stoddard JJ, Cull WL, Jewett EA, Brotherton SE, Mulvey HJ, Alden ER: Providing pediatric subspecialty care: A workforce analysis. AAP Committee on Pediatric Workforce Subcommittee on Subspecialty Workforce. Pediatrics 2000, 106:1325-1333.
10. Thompson JW, Chesney RW, Stocks RM, Shmerling J, Herron P: Pediatric hospitals' and physician strategies for the 21 st century. Clinical pediatrics 1999, 38:259-263.
11. Mayer ML, Skinner AC: Too many, too few, too concentrated? A review of the pediatric subspecialty workforce literature. Arch Pediatr Adolesc Med 2004, 158:1158-1165.
12. Kane DJ, Zotti ME, Rosenberg D: Factors associated with health care access for Mississippi children with special health care needs. Matern Child Health J 2005, 9:S23-3I.
13. Mayer ML, Skinner AC, Slifkin RT: Unmet need for routine and specialty care: data from the National Survey of Children With Special Health Care Needs. Pediatrics 2004, ll3:eI09-II5.
14. Park CH, Kogan MD, Overpeck MD, Casselbrant ML: Black-white differences in health care utilization among US children with frequent ear infections. Pediatrics 2002, l09:E84-84.
15. Perlstein MA, Goldberg SJ, Meaney FJ, Davis MF, Zwerdling Kluger C: Factors influencing age at referral of children with congenital heart disease. Arch Pediatr Adolesc Med 1997, 151:892-897.
16. Szilagyi PG, Zwanziger J, Rodewald LE, Holl JL, Mukamel DB, Trafton S, Shone LP, Dick AW, Jarrell L, Raubertas rF: Evaluation of a state health insurance program for low-income children: implications for state child health insurance programs. Pediatrics 2000, 105:363-371.
17. Newacheck PW, Hughes DC, Hung YY, Wong S, Stoddard JJ: The unmet health needs of America's children. Pediatrics 2000, 105:989-997.
18. Newacheck PW, McManus M, Fox HB, Hung YY, Halfon N: Access to health care for children with special health care needs.
Pediatrics 2000, 105:760-766.
19. Newacheck PW, Pearl M, Hughes DC, Halfon N: The role of Medicaid in ensuring children's access to care. Jama 1998, 280:1789-1793.
20. Newacheck PW, Stoddard JJ, Hughes DC, Pearl M: Health insurance and access to primary care for children. N Engl J Med
1998, 338:513-519.
21. Cabana M, Bruckman D, Rushton JL, Bratton SL, Green L: Receipt of asthma subspecialty care by children in a managed care organization. Ambul Pediatr 2002, 2:456-461.
22. Damiano PC, Willard JC, Momany ET, Chowdhury J: The impact of the Iowa S-SCHIP program on access, health status, and the family environment. Ambul Pediatr 2003, 3:263-269.
23. Davidoff A, Kenney G, Dubay L: Effects of the State Children's Health Insurance Program Expansions on children with chronic health conditions. Pediatrics 2005, 1 l6:e34-42.
24. Forrest CB, Glade GB, Starfield B, Baker AE, Kang M, Reid RJ: Gatekeeping and referral of children and adolescents to specialty care. Pediatrics 1999, 104:28-34.
25. Holl JL, Szilagyi PG, Rodewald LE, Shone LP, Zwanziger J, Mukamel DB, Trafton S, Dick AW, Barth R, Raubertas RF: Evaluation of New York State's Child Health Plus: access, utilization, quality of health care, and health status. Pediatrics 2000, 105:71 1-718.
26. Hwang AH, Hwang MM, Xie HW, Hardy BE, Skaggs DL: Access to urologic care for children in California: Medicaid versus private insurance. Urology 2005, 66:170-173.
27. Kempe A, Beaty B, Englund BP, Roark RJ, Hester N, Steiner JF: Quality of care and use of the medical home in a state-funded capitated primary care plan for low-income children. Pediatrics 2000, 105:1020-1028.
28. Kempe A, Beaty BL, Crane LA, Stokstad J, Barrow J, Belman S, Steiner JF: Changes in access, utilization, and quality of care after enrollment into a state child health insurance plan. Pediatrics 2005, 115:364-371.
29. Ortega AN, Belanger KD, Paltiel AD, Horwitz SM, Bracken MB, Lead-erer BP: Use of health services by insurance status among children with asthma. Med Care 2001, 39:1065-1074.
30. Szilagyi PG, Dick AW, Klein JD, Shone LP, Zwanziger J, McInerny T: Improved access and quality of care after enrollment in the New York State Children's Health Insurance Program (SCHIP). Pediatrics 2004, 1 l3:e395-404.
31. Szilagyi PG, Holl JL, Rodewald LE, Yoos L, Zwanziger J, Shone LP, Mukamel DB, Trafton S, Dick AW, Raubertas RF: Evaluation of New York State's Child Health Plus: children who have asthma. Pediatrics 2000, 105:719-727.
32. Wang EC, Choe MC, Meara JG, Koempel JA: Inequality of access to surgical specialty health care: why children with government-funded insurance have less access than those with private insurance in Southern California. Pediatrics 2004, 1 l4:e584-590.
33. Zwanziger J, Mukamel DB, Szilagyi PG, Trafton S, Dick AW, Holl JL, Rodewald LE, Shone LP, Jarrell L, Raubertas RF: Evaluating Child Health Plus in upstate New York: how much does providing health insurance to uninsured children increase health care costs? Pediatrics 2000, 105:728-732.
34. Price MR, Norris JM, Bucher Bartleson B, Gavin LA, Klinnert MD: An investigation of the medical care utilization of children with severe asthma according to their type of insurance. J Asthma
1999, 36:271-279.
35. Fox HB, McManus MA: A national study of commercial health insurance and medicaid definitions of medical necessity: what do they mean for children? Ambul Pediatr 2001, 1:16-22.
36. Markus A, Rosenbaum S, Stein RE, Joseph J: From SCHIP benefit design to individual coverage decisions. In Policy brief George Washington University; 2006:1-24.
37. Alessandrini EA, Shaw KN, Bilker WB, Perry KA, Baker MD, Schwarz DF: Effects of Medicaid managed care on health care use: infant emergency department and ambulatory services. Pediatrics 2001, 108:103-1 10.
38. Garrett B, Davidoff AJ, Yemane A: Effects of Medicaid managed care programs on health services access and use. Health Serv Res 2003, 38:575-594.
39. Ferris TG, Chang Y, Perrin JM, Blumenthal D, Pearson SD: Effects of removing gatekeeping on specialist utilization by children in a health maintenance organization. Arch Pediatr Adolesc Med 2002, 156:574-579.
40. Mitchell JB, Khatutsky G, Swigonski NL: Impact of the Oregon Health Plan on children with special health care needs. Pediatrics 200I, 107:736-743.
41. Shields AE, Finkelstein JA, Comstock C, Weiss KB: Process of care for Medicaid-enrolled children with asthma: served by community health centers and other providers. Med Care 2002, 40:303-3 I4.
42. Shenkman E, Tian L, Nackashi J, Schatz D: Managed care organization characteristics and outpatient specialty care use among children with chronic illness. Pediatrics 2005, 115: I547-1554.
43. Cartland JD, Yudkowsky BK: Barriers to pediatric referral in managed care systems. Pediatrics 1992, 89: I83-192.
44. Cuesta IA, Kerr K, Simpson P, Jarvis JN: Subspecialty referrals for pauciarticular juvenile rheumatoid arthritis. Arch Pediatr Ado-lesc Med 2000, 154: I22-125.
45. Ferris TG, Perrin JM, Manganello JA, Chang Y, Causino N, Blumenthal D: Switching to gatekeeping: changes in expenditures and utilization for children. Pediatrics 200I, 108:283-290.
46. Lake T: Do HMOs make a difference? Consumer assessments of health care. Inquiry I999, 36:4I I-4I8.
47. West DW, Stuart ME, Duggan AK, DeAngelis CD: Evidence for selective health maintenance organization enrollment among children and adolescents covered by Medicaid. Arch Pediatr Adolesc Med I996, 150:503-507.
48. Gruskin A, Williams RG, McCabe ER, Stein F, Strickler J, Chesney RW, Mulvey HJ, Simon JL, Alden ER: Final report of the FOPE II Pediatric Subspecialists of the Future Workgroup. Pediatrics 2000, 106: I224-1244.
49. Williams RG, Stein LD, Leslie LK: Training pediatricians for the evolving generalist-specialist interface in the managed care era. Pediatrics I998, 101:779-783. discussion 783-774.
50. Kuhlthau K, Ferris TG, Beal AC, Gortmaker SL, Perrin JM: Who cares for medicaid-enrolled children with chronic conditions? Pediatrics 200I, I08:906-912.
51. Newacheck PW, Hung YY, Marchi KS, Hughes DC, Pitter C, Stoddard JJ: The impact of managed care on children's access, satisfaction, use, and quality of care. Health Serv Res 200I, 36:3I5-334.
52. Mayer ML, Slifkin RT, Skinner AC: The effects of rural residence and other social vulnerabilities on subjective measures of unmet need. Med Care Res Rev 2005, 62:617-628.
53. Roberto PN, Mitchell JM, Gaskin DJ: Plan choice and changes in access to care over time for SSI-eligible children with disabilities. Inquiry 2005, 42: I45-159.
Pre-publication history
The pre-publication history for this paper can be accessed here:
http://www.biomedcentral.com/1472-6963/7/194/pre pub
Publish with BioMecl Central and every scientist can read your work free of charge
"BioMed Central will be the most significant development for disseminating the results of biomedical research in our lifetime." Sir Paul Nurse, Cancer Research UK
Your research papers will be:
• available free of charge to the entire biomedical community
• peer reviewed and published immediately upon acceptance
• cited in PubMed and archived on PubMed Central
• yours — you keep the copyright
Submit your manuscript here: f BioMedcentral
http://www.biomedcentral.com/info/publishing_adv.asp ^