FENa and FEUrea revisited

At Renal Week I went to Mark Perazella’s talk on “Urine Microscopy for Diagnosis and Prognosis in Hospital-acquired AKI.” Perazella published the interesting paper in CJASN in 2008 on using urinalysis microscopy for prognosis. His talk focused on the same subject. The gist is that a trained observer of urine microscopy is not only more accurate at diagnosing the etiology than FENa and FEurea but can provide prognostic information. Additionally, urine microscopy performs as well as the novel biomarkers: KIM-1, NGAL and IL-18.

As part of his talk Perazella threw-up some slides with some surprising statistics on the diagnostic utility of FEUrea and FENa:

From Pepin AJKD 2007: 50:566-573

A sensitivity of 48% without diuretics? A specificity of 33% with diuretics? Terrible. A second study showed similarly terrible numbers:

From Darmon et al. Critical Care 2011: 15 R178.

Only a bit better than a coin toss.

I felt shamed. I had been teaching and using urinary acute renal failure indices for 20 years and to see that they sucked sucked, kinda hurt. But then as I thought about it, I remembered seeing primary data that was quite a bit more compelling. So I went back to the primary literature.

The fractional excretion of sodium was invented in 1976 by Carlos Hugo Espinel. His initial series was published in JAMA. In that study he found 100% sensitivity and specificity in 17 oliguric patients.

Holy shit! Shrier is a member of the
Indiana Basketball Hall of Fame!

The study that is usually referenced as the mother of the fractional excretion of sodium comes from Mr. Sodium himself, Robert Schrier (fun fact: the founding member of my practice, Joseph Beals, was college roomates with Robert Schrier). This group found excellent performance of FENa in 85 patients:

Dr. Kohn is in the middle

FEUrea was invented by Kaplan and Kohn in 1992 (Fun fact: Dr. Kohn was one of my professors at University of Chicago) but the technique was not validated until 2002 when Cavounis et al prospectively looked at 102 patients with AKI. I remember reviewing the Cavounis article in journal club with Dr. Kohn in the room.

Results for using FENa to diagnose pre-renal disease (<1%)

  • 92% sensitivity without diuretics
  • 48% sensitivity with diuretics
  • 76% sensitivity for the entire cohort

Results for FEUrea to diagnose pre-renal disease (<35%)

  • 90% sensitivity without diuretics
  • 88% sensitivity with diuretics
  • 89% sensitivity for the entire cohort

Kim et al looked at 107 patients with acute kidney injury. Instead of pre-renal versus ATN they used transient versus persistent. They also looked at the performance of the AKI indices in the context of diuretics. (disclosure, I just read the abstract)

Results for using FENa to diagnose pre-renal disease (<1%)

  • 96% sensitivity 100% specificity without diuretics
  • 63% sensitivity 98% specificity with diuretics

Results for FEUrea to diagnose pre-renal disease (<30%)

  • 92% sensitivity 87% specificity without diuretics
  • 96% sensitivity 83% specificity with diuretics

Diskin et al looked at 100 oliguric patients and evaluated FENa and FEUrea. They used 40% for the line with FEUrea and 1% for FENa.

  • FENa 54% sensitivity
  • FEUrea 95% sensitivity
This was all the data I could find on trials that look at FENa and FEUrea. Overall, it performed quite well in most studies. In fact the two trials that Perazella quoted were the only two with the indices embarrassing themselves.
Jonathon Gotfried’s article in the Cleveland Clinic Journal was a great resource for this article.

Shame on you US News and World Report

So I was browsing my twitter feed yesterday and saw this from @okarol

One perspective on the proposed changes to how the distribute kidneys fb.me/100dAwkxi
— Karol Franks (@okarol) November 12, 2012

Then I saw almost the exact same message was on my Facebook feed from The Kidney Group:

Twitter’s most followed Kidney Practice: the kidney group should be ashamed of this post.

Both posts point to the same article in US News and World Report about the proposed change to the transplant guidelines and describes the change as unethical.

To understand what is driving the desire to change the current system and to understand how the proposed system is superior, one needs to understand the shortcomings of the current way organs are distributed.

First, unlike hearts or livers, people can live for years on dialysis waiting for a transplant. This is why we have 75,000 people on the kidney transplant list. Tragically, only 16,843 were transplanted in 2010.

Look at the 15,000 people listed for
the second or third time (USRDS)

Currently the most common reason for a kidney transplant to fail is death with a functioning graft. On the one hand, death with a functioning graft is an ideal outcome, this is how the vast majority of people without kidney disease die, i.e. they die with a kidney still capable of supporting life. But in the world of kidney transplant, death with a functioning graft is a measure of inefficiency. We live in a world with a vast undersupply of organs and not only are there not enough organs to go around, but an increasingly common reason for patients to be listed for a transplant is re-listing after their first transplant failed. If all of these patients had been matched to a kidney that better lined up with their life-expectency they would not be getting back in, an already overcrowded, line.

Over time total graft failure and return to dialysis/transplant has fallen but death with a functional graft has remained flat. Better graft matching could mean more people living with transplants. (USRDS)

Another problem with the current list is how wait-time is calculated. Currently time on the list starts from the time a patient is approved for a transplant. This seems fair until you see who is not getting referrals to transplant. There is data that shows that patients dialyzed in commercial dialysis facilities (the vast-majority of dialysis patients) are less likely to get referred for transplant. Other studies have pointed to minorities and patients without commercial insurance being less likely to be referred for transplant.

Michigan no longer uses that system for calculating wait-time. In Michigan, the clock starts the first day of dialysis. So a dialysis patient that takes three years to finally find his way to a transplant center and get listed would get credit for three years of wait time as soon as he was approved for transplant. This largely neutralizes any discrimination he would have suffered from being randomized to a bone-head nephrologist or living in a racist medical system. This is a smart change and it is used by the proposed transplant allocation system.

The current system is over 25 years old and suffers from limited medical knowledge available at the time it was created. The current system looks at factors that affect graft survival (HLA matching) but ignores factors associated with recipient survival (diabetes, age, etc).

We grade patients antibody levels (PRA) on a continuous scale from 1 to 100. Patients with higher levels have more difficulty finding matches. In order to help these patients with additional burdens in finding a match they are awarded points. Unfortunately the current system awards a fixed value if the level is over 80 and does not appreciate the continuous nature of this factor. The proposed system treats this as the continuous value it is.

Currently, there are a lot of discarded kidneys that could be used to benefit patients but the current system ranks kidneys as Standard Criteria or Extended Criteria. A system that recognized that not all recipients need 20 years of renal function would allow more of these marginal kidneys to be used.

It is interesting that Laine Ross’s article does not address any of the weaknesses of the current system. The reader is left with the impression that the current system is fine except for a vague mention of “inefficiencies.” She does not elaborate on what inefficiencies means but, make no mistake, it means we can get more people living with a transplant by changing how we allocate the organs. The new system plans on doing that, so if you agree with Laine you are arguing for less people living with a transplant.

The centerpiece of the proposed system is a system that ranks both recipients and the kidneys. The top 20% of candidates (by estimated years of life remaining) are matched to the top 20% of kidneys. Getting young people high quality kidneys that will last decades makes sense to me but apparently ethicists from the University of Chicago feel that putting 20 year old kidneys in 68 year old diabetics is a good use of a scarce resource. By giving young people long lasting kidneys we can avoid these patients losing their kidneys and getting re-listed. This will help reduce the total wait list.

The rank list also works on the bottom end of the scale, acceptable but marginal kidneys at the bottom of the scale, the worst 15%, are made available to patients on a voluntary basis. Older patients and patients who are failing dialysis can be desperate for a kidney. This is intended to expand the project that began with extended criteria donors and reduce the number of viable kidneys that are wasted.

Outside of the top 20% and the bottom 15% the system does not change. This new allocation is really just a revision to update and fix some weaknesses with the current system.

Ross calls out the 20% rule because it can not magically determine the exact time of death of everyone in the queue for a transplant. Seems like a pretty high bar to cross. The system that is proposed has a c-statistic of 0.72, which is where she get’s her:

…their model will get it right about 75 percent of the time.

The system is just as accurate as the system used to determine life expectancy for liver transplants and does a very good job of preventing the primary problem of putting kidneys with a short life expectancy in patients with a long life expectancy. The system does not need to be perfect to be better than the current system which is totally blind to this important issue. Interestingly, the Kidney Committee, looked at a better system to predict life-expectancy but it was so complex that people were suspicious. They settled on the current system because it is simple and does a good enough job. I agree that transparency is an important quality in any system that will be distributing kidneys.

Reading the whole article it looks like a hit-peice trying to score ethical points while lives hangs in the balance. This is the third attempt to revise the transplant allocation program. Ethicists have repeatedly deep six-ed previous attempts and while we try to find the perfect system we are trapped in a system that everyone agrees has significant ethical lapses and wastes both kidneys and years of transplant viability.

Update: The Kidney Group has removed the link to the article from their Facebook page. @okarol has blocked me on Twitter. No peep from U.S. News and World Report. This post made it to the RenalWEB homepage.

Do we need to EVOLVE our views on EBM in dialysis

I have posted on the release of the EVOLVE data at Kidney Week 2012 at the eAJKD blog.

This is a big deal and when I read the @NEJM tweet it makes me mad.

Cinacalcet doesn’t lower death or major CV event risks in patients undergoing dialysis. nej.md/U4yeSv #kidneywk12
— NEJM (@NEJM) November 3, 2012

That tweet provides only the first sentence in what should be an important and longer discussion of the findings of EVOLVE. To completely discount EVOLVE as @fish2phil and @Nephroboy do…

@kidney_boy these are statistical machinations attempting to squeeze a diamond out of coal.
— Homer W. Smith (@fish2phil) November 4, 2012

It’s cack. “@kidney_boy: My first take on EVOLVE: biggest, longest, RCT ever undertaken in dialysis population ajkdblog.org/2012/11/04/kid…
— Nephroboy (@nephroboy) November 4, 2012

…leaves the nephrologist in a bit of a bind. If we ignore studies that don’t meet their primary endpoint, what are we left with? Here is a list of ALL the randomized controlled trials in dialysis that use hard outcomes. This list ignores any study where the end-point is an improvement in a biochemical parameter, echographic finding, or vital sign:

  1. NCDS from 1981: Positive. We learned that small molecule clearance is better than large molecule clearance
  2. Normalization of hematocrit: Negative. No advantage and nearly significant disadvantage to normalizing the hemoglobin
  3. HEMO: Negative. Definitively negative trial showing that small molecule clearance can not get any better with thrice weekly hemodialysis
  4. ADAMEX Negative. Peritoneal dialysis version of HEMO, same result
  5. AURORA Negative. Statin trial with rosuvastatin
  6. 4D Negative. Statin trial with atorvastatin
  7. SHARP Positive, kind of. Statin plus ezetimibe was able to reduce CV endpoints however they lumped dialysis and CKD patients together. The dialysis patients alone were not powered to find a difference and they did not. I think most nephrologists, in the face of 4D and AURORA are pretty skeptical of this data approach.
  8. DCOR Negative. Trial of sevelamer versus calcium containing binders.
  9. IDEAL Negative. Trial of early versus late initiation of dialysis. No advantage for early start. Some may argue that this is a CKD rather than dialysis study.
  10. EVOLVE. Negative.
Is that it? I can’t think of any others. Nephrology operates in an evidence desert. (Hat tip Dr. Dale)

I’m a nephrologist because I’m comfortable operating in a low evidence environment.#FaithBasedSpecialty
— Joel Topf (@kidney_boy) November 3, 2012

So if you want to throw EVOLVE away because it didn’t reach statistical significance what are you going to do? The questions that EVOLVE attempted to answer do not go away because the study was negative.

In a few weeks I will start going through the November labs for dozens of patients who trust me to give them the best dialysis care. Some of them will have a PTH over 600 and a calcium over 8.4. What will I do? If I am relying on randomized controlled data I will probably just sit in a corner and cry. I could rely on Block’s, Floege’s and Kalantar-Zedah’s data that ties increased PTH with increased risk of death. All of that data is, of course, controlled for age the sin for which Homer Smith is pounding the EVOLVE crew for:

@kidney_boy …not only adjusting for age, but may really be adjusting for important unmeasured covariates that correlate with age.
— Homer W. Smith (@fish2phil) November 5, 2012

Of course if you accept the data that elevated PTH is bad, none of the observational data provides any guidance on what happens when you lower PTH.

To see what happens when you lower the PTH we need to look at the data from the mortality studies done with paricalcitol (Zemplar) and doxercalciferol (Hecterol).*

* The reason there is no link to those studies is that those studies don’t exist. Thanks Abbott. Thanks Genzyme. I have heard rumors of a Zemplar trial conducted in the 90’s but the data was never published and the study buried in the bad old days before trials.gov.

So what is the EBM dedicated nephrologist to do?
I bet if the skeptical nephrologist went to his dialysis patients and explaned to them:

USRDS 2012 Annual Data Report
  • Dialysis patients have a 3 year survival of 50%.
  • There is a drug that is already approved (i.e. not experimental) that recently has been shown to have an 89% chance of being able to reduce mortality by 17%

That every one of his patients would beg for the drug.

Final thoughts: The first time I heard about intention to treat was during the HIV epidemic. Some of drugs were so toxic, especially in the early days of HAART when patients were taking handfuls of pills, that significant number of patients weren’t able to tolerate them. I remember an ID doc expressing frustration that he needed to know if the drug would save the lives of the patients he had that could tolerate the drug. If they can’t tolerate it, he was going to stop the drug, but if they could tolerate it he needed to know if it slowed the virus. In the middle of the epidemic, there is no room for statistical purity.

Like that ID doctor, I want to know if the drug will work if the patient actually swallows the pill, and the answer to that is a definitive “Yes.” Hazard ratio for death of 0.83 P=0.009.

Disclosures: I was a principle investigator in EVOLVE, that means my practice was paid to recruit, and administer a bitch of a study that lasted longer than it was supposed to. It was a lot of work, a lot of meetings, a lot of signatures, a lot of responsibility, and not so much money. My name will not be among the authors.

My name on page 53 on the supplement

Reata, a no show at ASN Kidney Week

What do you do when your tentpole molecule fails it’s phase three clinical trial? I guess you don’t even build your booth at Renal Week.

At Kidney Week 2010 in Denver, Reata presented the results of BEAM, the phase II trial of bardoxolone as part of the late breaking clinical trial data. They shocked the world by showing increased GFR in diabetic nephropathy. The data was published in the NEJM in July 2011. But even before publishing they began work on the phase III trial, BEACON.

I can attest to the excitement that BEACON generated. I was not an investigator but I did enroll one patient in the trial and even had friends calling me trying to get loved ones in the trial. I outlined my experience with bardoxolone in the diabetic nephropathy talk that I gave to the Michigan State Medical Society (Keynote | PDF). On October 18th, Reata terminated BEACON due to “excess serious adverse events and mortality.”

Unfortunately, October 18th was only 2 weeks before the Start of KidneyWeek 2012, the premier nephrology conference in the U.S. Reata had already signed on with the American Society of Nephrology to be a Diamond Level Sponsor:

Not only were they a Diamond Sponsor, but they had bought top billing on the Abstract Book with a full page ad on the back cover:

The ad implores you join them at booth 1529. I went by there just to see how the company would try to spin this disaster. But there was no booth 1529. The map shows it between Amgen and Otsuka, but there is just a pharmacy and an EMR company in its place. It’s like the opposite of when Obi-Wan goes to Yoda trying to find the Planet Kamino.


Lost a Planet Master Obi-Wan Has

Poor Reata. Evidence-based medicine can be such a bitch.

I’d show pictures, but taking pictures of the booths is forbidden by ASN policy. Whisky Tango Foxtrot

Saline versus Ringer’s Solution. Fight!

Internists use normal saline.
Surgeons use lactated ringers.

Its a cultural difference, perpetuated by dogma.

Here’s how Burton Rose characterized Ringer’s solution in his classic Clinical Physiology of Acid-Base and Electrolyte disorders:

This what I was taught. That is what I teach and this is what I believed, but I’m turning.
METHODS
The Study was a bundle-of-care study, in which a number of practices were changed all at once. The study was conducted in a single ICU at the University of Melbourne. For six months outcomes were tracked with usual care to act as the control group, then the bundle was phased-in and after 6 months, they tracked a second 6 month block to represent the experimental group. By spacing the control experimental groups as they did, they eliminated seasonal variation in illnesses. 

During the control phase, physicians were able to prescribe IV fluids per personal preference. During the experimental period, chloride rich solutions were restricted to specific clinical conditions: hyponatremia, traumatic brain injury and cerebral edema. Otherwise patients were given low chloride solutions: Hartman’s solution, plasma-Lye 148 and 4% albumin.

The primary outcome was the change in creatinine and incidence of AKI, using RIFLE criteria. Secondary outcomes included need for acute dialysis, length of of ICU and hospital stay and survival.

RESULTS

The study consisted of 1644 admissions to the ICU, 760 in the control period and 773 in the experimental period. The two cohorts were well matched with significant differences only with metabolic diagnosis being more common in the control period (7 vs 4.4%) and neurologic disorders being more common in the experimental period (6.2 vs 8.8%).

The difference in the fluids being used was dramatic and this resulted in significant differences in electrolyte exposure:

The authors demonstrated a statistically significant difference in the change in serum creatinine,(increase of 0.25 in the control group vs 0.16 experimental group) which is of questionable clinical significance. More impressive was the decrease in AKI by RIFLE criteria.
With Cox proportional hazards model adjustment they found a hazard ratio of 0.52 (P=0.01) for AKI.
The authors actually use a modified RIFLE criteria as they only used changes in serum creatinine and ignore changes in urine output. This is convenient as most of the studies that have validated the RIFLE criteria have likewise used creatinine limited criteria. As a refresher for those of you sleeping in AKI class here is how the RIFLE criteria grades AKI: 
The most important finding was a decreased need for acute dialysis: 78 patients during control versus 49 with the low chloride bundle (P=0.005).
There was no difference in length of ICU or hospital stay, and no change in survival.
In the discussion the authors acknowledge that their study design precludes a deep analysis of what was responsible for the reduction in AKI. By changing nearly all of the fluids at the same time it is difficult to assign blame to any one change. Was it the decrease in chloride? Or the increase in alkali? Increased potassium? Despite this limitation the authors provide the rational for blaming chloride for AKI.
They point out that chloride in normal saline is no where near physiologic at 154 mEq/L. They point to observational study data showing decreased dialysis with Plasmalyte compared to saline.  Animal studies showing better cortical perfusion with decreased chloride exposure. They suggest that Tubulo-glomerular feedback maybe responsible for this. 
Tubulo-glomerular Feedback is the driving principle behind the theory of Acute Renal Success. Acute renal success is a theory which attempts to explain the conundrum of oliguria in ATN. Patients with ATN have intact glomeruli, yet in some cases they have a GFR of zero. Why do normal appearing glomeruli cease to filter? They cease to filter because if the they did, the damaged tubules would not be able to reabsorb the filtrate and the kidney would excrete all of the body’s plasma in about half an hour.
The glomeruli can only safely filter 100 ml per minutes if the tubules reabsorb 99+% of that fluid. In ATN that reassurance is lost and the intact glomeruli need a way to detect the failure of reabsorption. Chloride sensors in the thick ascending loop of Henle signal the glomeruli to decrease filtration when activated. So in cases of ATN, the glomeruli initially filter normally but when the proximal tubule and Loop of Henle fail to reabsorb the chloride, chloride floods these receptors triggering a feedback mechanism to shutdown the glomeruli associated with that tubule.
In this article the authors suggest the non-physiologic, high chloride solutions we use in patients may result in excess chloride delivery to the thick ascending limb of the loop of Henle triggering tubulo-glomerular feedback decreasing GFR. 
This is an intriguing paper and I look forward to more data, even if it means the surgeons were right.
Update: Jim Smith and I had a great back-and-forth on this. Open this link to follow all of the fireworks.

Thoughts on QR codes at Medical Conferences

I am just back from Med 2.0. It was a great conference that did so many things right. One of the things that was right, was that every talk, every poster, every rapid fire session has its own web page. Here is what the top of those pages look like:

The square in the upper right, if you’r are not familiar, is a QR-code. All posters are supposed to use this label and all presentations are supposed to display this graphic on the title slide. When you scan the code with a smart phone (you can find an excellent free, QR-scanner for the iPhone here, life hacker endorsement of said scanner here), the smart phone will open up the web page for the talk or poster. Cool idea. Unfortunately, it was poorly executed by most presenters. Here is a typical title slide:

Using my iPhone from my seat in the middle of the auditorium, I had no chance of getting an accurate scan. Since I am one of those annoying conference participants who photographs every slide, I have found myself scanning my MacBook screen to get the links. Absurd, and really no easier than using the conference website to search for the presentation page. The right way to do it is the way John Ainsworth did it in his presentation on using Drupal to create a low tech, no software, SMS-notification system across 11 countries, 6 languages and 3 time zones:

Medicine 2.0: Conversations from the hallway

This week-end I am in Boston at the Medicine 2.0 Conference. It has been awesome. I am tweeting and bloggin about it at eAJKD (blog | Twitter)

At one of the sessions on medical education, I made a comment on Beaumont’s mandatory medical student attendance. Afterwards, Brian Alper, the founder of DynaMed came up to me to talk. He started to tell me about Dynamed, I told him I was familiar. When I was working with the students on the Team Based Learning, a number of them told me how much they loved the product. They even told me that it was better than UpToDate, a statement that gave me chest pain.

I had to tell him about my terrible experience looking up Goodpasture’s in Dynamed. He looked at me and said, “So, you’re the one.”

He was totally professional and pulled up the current version of the topic on his iPad. Wow! What a change. The topic looks completely rewritten and in a comprehensive style. It now has an author, a wide variety of treatment options including plasmapheresis and immunosuppressants. He told me that he would email me the topic. I plan on revising my review of DynaMed, but for now all I can say is that it looks a lot better.

Chicken Noodle Soup versus Normal Saline. Fight!

More than a few times this week, I have found myself prescribing Jewish Penicillin, chicken noodle soup. CNS is rich in sodium so it is just about the best way to prescribe volume repletion in the out-patent arena. So i was delighted to see one of the dietician students projects on display in the hospital:

1720 mg of sodium per can of Swanson 100% Natural Chicken Broth (two 240 mL servings per can). So how does that stack up against old faithful, normal saline?

Normal saline has 154 mmol of sodium per liter or 3,542 mg of sodium per liter (154 mEq x 23 mg per mmol, the molecular weight of sodium), so a can of chicken soup is equivalent to about half a bag of normal saline.

Update: I don’t get many good comments on Blogger but I got this pitch perfect comment on Twitter:

@kidney_boy Nice. Didn’t fully appreciate that a bag of saline was 3.5gm Na! Makes me laugh thinking of the 2gm Na diet pts getting IVF!
— Aaron Logan (@pyknosis) September 15, 2012

Team based learning, reason for optimism about medical education

In general, as I have progressed through my education, I have felt that the quality of education has been on a downward vector.

  • I believe that duty hour work restrictions have diminished continuity of care and reduced the drive for residents to read and learn about their patients, because the patients feel less like “their patients.”
  • I think the emphasis on fraud prevention that has meant that attendings need to see and be present for all of the meaningful aspects of patient encounters has diminished fellow autonomy and delayed the maturation process that senior residents and fellows undergo.
  • I think the addition of alternative medicine curriculum to medical schools is an inexcusable retreat from the goal of medical scientists.

But I have recently experienced a vision for the future of medical education at Oakland University William Beaumont Medical school and I am blown away. Don’t worry future doctors are going to be just fine.

OUWB is one of the newest medical schools in the country and has it’s first two classes of medical students enrolled, classes of 2015 and 2016. The second years are finishing up the renal section. It is an integrated unit including histology, pathology, physiology and pathophysiology. I was privileged to have an integral role in developing the curriculum. One of the parts that I spent hours on was developing Team Based Learning modules (TBL).

Typical MD Lab from Scott Hall
(http://conjoint.med.wayne.edu/mdlabs.php)

Team based learning is OUWB’s version of the small group learning sessions that have always been a part of the first two years of medical school. During my years at Wayne State they were called MD Labs. The sessions were sprinkled through out the curricula. I went to a few and they were of widely variable quality. I didn’t go to many, because they didn’t count toward your grade. That told me that The Dean didn’t think they were important enough to count so I took the hint spent my limited hours cranking on stuff that counted.

The TBL is a reinterpretation of those small group sessions that I see as wildly successful. The success is not by accident and comes from the novel structure of the sessions. A TBL is made up of preparation and three segments:

Prep

The preparatory reading is a chapter, or article or handout that covers all of the main ideas of the session. For proteinuria and glomerular disease the students were assigned a chapter in Harrison’s. For CKD and AKI the students were given review articles in BMJ (Hilton R. 2006) and NEJM (Abboud, Henrich 2010). For Sodium and Water, I wrote a 41 page chapter on the subject. Be warned I have been told that it has a lot of typos.


    Individual Readiness Assessment Test (iRAT)

    As soon as the session starts the students have a multiple choice test of 10 questions. All of the answers should be found in the assigned reading. The test score is part of the students grade in the section. This means that all of the students need to do the prep work and all of the students need to show up for the session. Two huge improvements to the Wayne State MD labs.
    Gunning for grades on the iRAT

      Team Readiness Assessment Test (tRAT)

      After completing the fill-in-the-bubble iRAT, the students then work in 5 person teams on the exact same questions they just answered. The teams have scratch off pads that work like instant lottery tickets with the correct answers. When the team answers a question they get instant feedback if they were right or wrong. This is closed book but the students all work together. After the all of the teams complete their tRAT there is a brief discussion of any questions that were troubling. The proctors walk around the room during the exercise and listen to the team discussions to they get a sense of what questions are difficult/poorly written.
      If you scratch off three horse shoes you win $60.
        Look at her notes. Every tricky nephrology
        question starts with “let’s draw a nephron.”

        Application Exercise

        Application questions are complex questions that supposed to integrate physiology and clinical medicine in to a complex multiple choice question. The questions are all open book, and in this age of WiFi, laptops and the WWW, we should really rename open book as open Google. The teams get 15-20 minutes per question and then simultaneously display their answer. Then the proctors lead a discussion on the reasoning behind the answers and different strategies the teams used to get to the answer.

        The things I love about the TBL

        • It is part of the grade. Curriculum directors need to understand that the medical school curriculum has more information than is possible to learn and students are rational actors. They will sacrifice important but uncounted learning opportunities in order to prepare for counted exams. There is no way to make something meaningful without making it part of the grade.
        • The iRAT happens right when the students walk in to the room. I love how this makes it clear that the students are being graded on preparation. The important thing is getting the students to learn the material before the session starts. This paragraph from Regis School of pharmacy states it perfectly:

        To promote active and collaborative learning, students are sometimes asked to work in groups in class or on projects outside of class. While group work does benefit student learning, unfortunately it is often plagued by “social loafers”, or students who do not pull their weight in terms of helping the group. As a result, many students learn to dislike group work and may seek to avoid it. TBL is different. TBL ensures that each member of the team is held accountable for their own learning outside of class. Students who do not prepare adequately before class will perform poorly on the iRAT and will not be able to contribute in a meaningful manner to the tRAT and application exercises. As a result, most students who would normally remain “social loafers” in a group learning project are instead quickly motivated to do the assigned work out of class in order to perform well on the iRAT. In addition, as teams work together and compete with other teams in the class, loyalty to the team develops among each member. This further motivates the “social loafers” to prepare outside of class so that they can contribute and help the team succeed.

        In the cut throat world of medical school any system that allowed a “social loafer” to benefit from the group while contributing nothing would be a recipe for a short lived project. The iRAT gives a clear message: come to class prepared, or you will suffer.

        • The application exercises are open google. To me, this was the most interesting part of TBL. Clinical medicine is, of course, open book. Everyday I am consulting Dr. Google, Epocrates and UpToDate. My information gathering strategies were developed on the fly in my clinical practice. No one taught me these types of skills and no where in medical school were there any opportunities to practice hone them. The students of OUWB are working together, comparing notes, seeing which resources work best. I heard students explain the virtues of DynaMed (a POS in my opinion). I spoke with students who distanced themselves from Wikipedia until I told them I was a fan and had no reservations about using the crowd sourced encyclopedia. After hearing me extol its virtues they quickly changed their tune and agreed that it was easy to filter good from bad wiki pages (referenced, with mainstream journals, avoid political topics) and that the good ones never steered them wrong.

        People used, Google, Wikipedia, UpToDate and a strange
        resource called a “book” 

        Summary

        The portable computer revolution of iPads and smart phones allows us to bring the library to the bedside, it is time for medical schools to appreciate and embrace this pivot in the history if medicine. TBLs are the best example I have seen of of this.