Should We Have Health Care Performance Transparency? By Whom? And How?
Brian Klepper
Last week the New York Times reported that New York's Attorney General (AG) office threatened UnitedHealthcare (UHC) with a lawsuit if it proceeded with the September release of a physician profiling report. The details were fuzzy, but apparently the AG was responding to charges by different physician groups – the AMA and the St. Louis Metropolitan Medical Society were named - that UHC's methodology is based purely on cost and does not consider quality. The Times piece includes this snippet:
Linda A. Lacewell, a senior lawyer in the office of Attorney General Andrew M. Cuomo, wrote in the letter that the ranking would apparently be used to steer consumers toward selected doctors. “To compound the situation,” she wrote, “we understand that employers may act on these ‘ratings’ to offer financial inducements such as lower co-payments or deductibles to promote ‘cost-effective’ doctors to their employees.”
Ms. Lacewell said patients might be steered toward doctors based on flawed data and UnitedHealthcare’s “profit motive.” She wrote, “Consumers may be encouraged to choose doctors because they are cheap rather than because they are good.”
Without more information, it is hard to know what's going on here. But UHC and the NY AG's office each have a point and each are suspect. Here's what we know:
Ingenix, a UHC subsidiary, is a health care analytics firm which owns and licenses Episode Treatment Groups (ETGs), a highly-regarded and widely-used health care patient classification system. ETGs are used by many other reputable analytical companies, like MedStat, MedAI, and ProfSoft. One would assume that UHC's analyses of physician performance in New York and elsewhere used this tool, but who knows?
On the other hand, the Ingenix tool violates what I think of as a core rule of transparency, which is that any tool used to achieve transparency must be transparent as well. Ingenix' ETG algorithm is proprietary, which basically means that the people being evaluated can't find out exactly how the evaluation works. This invariably makes them worry that they're getting shafted.
Let's apply this problem to a real life example. I use this tool to evaluate the performance of all the doctors, by specialty, within a network. I'm going to publicly publish the results – the identification of high, average or low performing physicians – and then tie the results to payment levels.
I approach a low performing physician and show him the results, and he's aghast. “How did you arrive at THAT?” he asks. “I can't tell you,” I say. “It's a secret.”
Now take this problem of a proprietary evaluation methodology, and embed it in a profit-driven company that has been caught in disputes involving money on more than one occasion. It's not impossible to see why the AG's office is skeptical of UHC's intentions or approach.
The AG's Ms. Lacewell is concerned that the UHC analysis might steer patients to doctors based on cost rather than quality. That might be the case if UHC's analytical tool was set up that way. But unless UHC is not using their own tools, it is not likely. ETGs and other contemporary health care analytical tools provide risk-adjusted evaluations of value. That is, they hold outcomes constant and then compare cost. Or they hold cost constant and compare outcomes.
The point here is that we most certainly want to identify better and poorer performers. We want to steer patients to the better ones and give the poorer ones reasons to improve.
We have a crisis in health care in large measure because the performance of doctors, hospitals, health plans, drug companies, device companies and everyone else involved in health care has been hidden. The lack of accountability has resulted in tremendously excessive cost and a tolerance for poor and sometimes dangerous quality. Worse, the lack of transparency has created an opportunistic culture throughout health care. Professionals and companies in every health care sector gild the lily with inappropriate and wasteful products and services, because they're mostly certain that the excesses won't be detected.
Of all the things we can do to fix health care, performance transparency is the most important. Only if we can see what has transpired – what processes have and have not been conducted, and what the outcomes have been – can we identify problems and opportunities and then begin to address them.
The New York Attorney General is right to be skeptical of the evaluative neutrality of UHC or, for that matter, any organization dedicated to profit rather than the public interest.
On the other hand, New York's AG's office should smell the coffee. To make health care and any other public function work, we need to publicly report performance information. Patients have a right to know how doctors compare within specialty and how hospitals compare within service. They'll certainly want to go to the ones that have better track records, and the employers who pay for much of their care want to encourage them to learn which ones are best.
The AG's office should also be skeptical of the doctors' motives. Are the physicians against any public reporting of their performance, or just that done by for-profit entities like UHC?
To heal health care, we need transparency. But it should be provided by neutral organizations that don't have conflicts of interest, and handled to assure doctors and everyone else involved in health care that the reporting will be fair and without prejudice.
Health care is too important for patients and purchasers to not have objective information. Only if we get this accomplished properly can we say that we've taken the first steps to really fixing America's health care system.
Brian Klepper is a health care analyst based in Atlantic Beach, Florida. You can reach him at bklepper@gmail.com.

Reader Comments (8)
I may not be an automotive engineer, but I surely can decide which auto I want to buy using all the available data and by own judgement. I expect to be able to make the same judgements on the medical care that I seek and I pay for.
Didn't mean to insult you, Lynn. But tell me, if you don't have access to any quality or financial data, how exactly WOULD you make an informed decision?
How about a real life situation. You live in a mid-sized community. Your child needs open heart surgery. Everybody in town points to a local (adult) surgical group and says they're "really good." Do you take their word for it, do you insist on going with the curmudgeonly pediatric surgeon who nobody likes, or do look around the country? How, exactly, do you make your choice on the surgeon?
If you're buying an automobile, there's MUCH more experiential data and expert opinions available on each make and model from Consumer Reports, Edmunds and elsewhere. Where do you plan to get your information about medical/health care?
Excellent post. I am a big advocate of price and quality transparency in healthcare as well. While I think it is fair to not completely trust insurers, especially the for profits, I am troubled by doctors' and the AMA's decades long history of turf protection and trying to stifle competition at every turn.
I think it might be more useful if CMS took the leadership position in what United is trying to do. Suppose Ingenix did this work for CMS and shared the inner workings of its system subject to a confidentiality agreement. Suppose CMS then tells the public that after thorough examination, the Ingenix system is a very credible approach to assessing provider cost-effectiveness and value delivered. Suppose it also agreed to give underperforming providers enough information about the reasons for their underperformance so they would have some insight into how to improve. Suppose CMS were willing to vet all similar systems and give them the equivalent of FDA approval for a new drug if they warrant it. United and other insurers could then move forward with implementation of similar systems throughout their networks. Employers could incorporate changes in benefit design like lower deductibles and co-pays for choosing the most cost-effective providers. Who knows? Healthcare might actually start to look and operate like every other normal market in our economy.
There's a ton of data out there, we're working hard on making it accessible, I think we're on the cusp of comparative health care data being believed to be a valid resource. However, there's no lack of it. We just don't have a cars.com or Carfax version of it yet.
(1) Brian Klepler wrote:
> The point here is that we most certainly
> want to identify better and poorer
> performers. We want to steer patients to
> the better ones and give the poorer ones
> reasons to improve.
But we can't take an overly simplicstic view of "better" vs "poorer." Any measurement system that by design says to the measurees "half of you (everybody below "average") are going to labeled and treated as Losers no matter how hard you work at it" inherently is not going to be well-received by the community being rated.
So we need measurement & reward systems that recognize the truly poor performers but also provide incentives (something other than "fight with all your might") for year-to-year-to-year progress in the right direction by the broad majority of the mainstream performers.
(2) A reader commented:
> I find the concerns about giving me, as a
> consumer access to financial and quality
> data to be insulting. The implication is
> that I am incapable of making an informed
> decision.
Some of the decisions are beyond you or me or anybody in the current environment,
Simplistic hypothetical example. You and your family are all healthy, You employer offers you a choice of two health plans, one of which's marketing claim to fame is centered around the outstanding cardiac providers and program it has assembled, while the other is the diabetes network of choice. Let's assume "the data" supports the notion that the first plan is indeed excellent in cardiac care but mediocre in diabetes, and for the second plan the situation is exactly reversed.
The tool you would need to decide which plan is better for you at your annual benefits renewal time is a crystal ball to see into the future .. .are you going to need cardiac or diabetes care in the upcoming year?
Which is not to say that information for informed decision-making isn't useful or good, because clearly it is; but as users, we need to be consciously aware of its limitations and warts.
As a bonus, an insidious detail of the plan is that "notification" is not the same as "pre-authorization." The referring provider can properly notify United of the radiology referral, the performing provider can confirm that proper notification was made, and United can still deny the claim!
"Transparency" is the buzzword of late in healthcare debate, but true transparency doesn't come from payers ranking payees.
I have created a website that uses social networking to expose health care pricing and collect consumer comments/recommendations about providers. The contents of the directory are contributed by consumers to share with other consumers, and everyone can participate – including the insured and uninsured. The website, www.OutOfPocket.com is a collaborative effort by consumer champions. The prices in the directory are posted by consumers and supplemented with pricing from directories such as Medicare. By enabling consumers to collaborate, I hope to encourage a consumer-driven market. This is my small contribution towards helping reform our unsustainable health care system.
I specifically asked about how transparent they are with doctors who don't measure up and what guidance, if any, do they offer for improving his or her rating. They claim to be very transparent regarding how the rating was determined, where the doctor fell short (if applicable) and what he or she needs to do to improve. United also claims to have vetted its analytics with the various medical specialty societies. It also seems that it would be a simple matter for regulators to require that insurers provide this information and to make it easy for providers to correct insurer mistakes in their file or to at least dispute them.
If doctors claim that insurers are totally opaque and insurers (at least United) claim they are transparent, they can't both be right, but it shouldn't be that hard to resolve.