The physician loan traded a rate premium of roughly 0.125% to 0.50% for no-PMI financing when the borrower had nothing to put down. Once equity crosses 20%, that trade flips on its head: a conventional rate-and-term refinance becomes the cheaper monthly payment. But the whole exercise hinges on one figure–the new conventional loan must close at 80% LTV or lower against the current appraised value.
The 80% LTV gate is the whole game.
And clearing it without reclassifying the loan as cash-out is the job.
Why physicians refinance out of a doctor loan in 2026
A doctor who put 5% down in late 2022 or 2023 and bought in a strong metro has likely seen appraisal gains plus three years of amortization push the loan toward 80% LTV. The 2026 rate spread between physician products and conventional 30-year financing has compressed to roughly 0.125% to 0.50%, per current lender rate sheet surveys. On a $570,000 balance, 0.25 percentage points is about $1,200 of interest in year one–enough to recover closing costs inside 24 to 30 months.
Two groups should stay put. Physicians still above 80% LTV with no cash to bring to closing, and those whose student loan DTI picture would fail conventional underwriting. The physician program’s generous DTI math (particularly on IBR and $0-payment treatment) is the stickiest reason doctors remain in doctor loans past the point where equity would otherwise allow the switch.
The 80% LTV gate: the only rule that matters
Fannie Mae and Freddie Mac calculate LTV on a rate-and-term refinance as the new loan amount divided by the current appraised value, not the original purchase price. There’s no “physician exception” in agency underwriting. Private mortgage insurance applies to every conventional borrower who closes above 80% LTV, regardless of occupation.
The transaction must also stay inside the rate-and-term bucket. Fannie Mae’s “limited cash-out refinance” and Freddie Mac’s “no cash-out refinance” both allow the new loan to pay off the existing first mortgage plus closing costs, with borrower cash back capped at the lesser of 2% of the new loan amount or $2,000. Take more cash at closing and the loan gets reclassified as cash-out, which carries higher LLPAs and tighter LTV caps.
Three paths to reach 80% LTV
Path 1: appreciation plus amortization. The cheapest path is the one that costs nothing. A $600,000 purchase with 5% down in 2022 sits at roughly $570,000 after three years of amortization on a 30-year fixed. If the home now appraises at $750,000, LTV lands at 76%. No cash needed, no second lien, no structural complication. The planning question becomes break-even, not qualification.
Path 2: cash-in refinance. A borrower above 80% can bring money to closing to pay the balance down to the 80% line. This stays a rate-and-term refinance under agency rules. Deploying $30,000 of cash to dodge PMI and secure a lower rate pencils out in roughly two to four years for most mid-six-figure balances, but only if that cash wasn’t earning a comparable risk-adjusted return elsewhere.
Path 3: 80/10/10 piggyback. If appraised equity gets the borrower to 90% LTV but not 80%, a first mortgage at 80% plus a HELOC or closed-end second at 10% preserves liquidity and keeps PMI off the first. Second liens price higher than firsts (often by 1.5 to 3 percentage points), and they complicate any future refinance because the second-lien holder has to subordinate. Run the blended rate against a cash-in scenario before signing anything.
Appraisal strategy: the single biggest kill risk
Will the appraisal support 80% LTV? That’s the question that decides whether the plan survives contact with underwriting.
A conventional appraiser pulls three to six comparable sales, ideally closed in the last 90 days within one mile, and adjusts for square footage, lot, condition, and features. A physician with a thin equity cushion should prepare a comp packet before the inspection–recent nearby sales supporting the target value, documentation of post-purchase improvements with receipts and permits, and any cosmetic repairs completed before the appraiser arrives. The work happens before the appraiser rings the doorbell, not after the report lands with a low number.
But if the appraisal comes in below the value needed to clear 80% LTV, options narrow fast. A reconsideration of value (ROV) request can be submitted through the lender with new comps the appraiser missed; Fannie Mae’s 2024 ROV policy requires lenders to accept borrower-initiated ROV requests that meet the format rules. A second appraisal costs $500 to $800 and may or may not come in higher. The remaining options are cash-in restructuring, the piggyback route, or waiting another six to twelve months for amortization and appreciation to do their work.
Worth knowing: appraisal waivers are sometimes offered through Fannie Mae’s Value Acceptance (formerly PIW) or Freddie Mac’s ACE on refinance loans with strong AUS findings. A waiver removes appraisal risk entirely, but it isn’t available for every property or loan file.
Student loan DTI: the second kill risk
Conventional underwriting treats student loans more strictly than physician programs do. And the distinction between Fannie Mae and Freddie Mac can decide the deal.
Fannie Mae permits the actual monthly payment reported on the credit report, including $0 payments under an income-driven plan. So a resident or early-attending physician with a documented $0 IBR payment can use $0 for DTI on a Fannie-backed conventional refinance.
Freddie Mac uses the greater of the actual payment or 0.5% of the outstanding student loan balance when the reported payment is $0 or missing. On a $280,000 student loan balance, that imputes a $1,400 monthly obligation, which can push DTI past 45% on its own. So shop both investors–the answer isn’t the same shop to shop.
The July 1, 2026 regulatory shift matters here too. Borrowers already enrolled in the Income-Based Repayment plan before July 1, 2026 can remain in IBR through at least July 2028 under the current Federal Student Aid transition schedule. Federal Direct Loans originated after July 1, 2026 lose IBR eligibility, and the Repayment Assistance Plan (RAP) is replacing older IDR plans on a rolling calendar. Pull current payment documentation directly from StudentAid.gov and the loan servicer before applying; a credit report lagging a plan change can raise DTI mid-file and kill the deal at the worst possible moment.
PSLF-track physicians should document the plan, the current payment, and the qualifying payment count. Because a borrower close to forgiveness has a stronger case with a lender willing to underwrite to the $0 or near-$0 payment reported on the plan.
Rate, LLPAs, and a worked example
High-credit, low-LTV borrowers hit the most favorable LLPA buckets. A physician with a 760 FICO closing a rate-and-term refinance at 76% LTV sits in the best grid cells under the 2023 LLPA structure (which remains in force per current FHFA notices). That stacking widens the realized spread between a physician loan and a conventional refi beyond the headline rate difference.
Here’s the worked example. Original physician loan: $600,000 at 7.25% fixed 30-year, originated Q4 2022. Current balance: roughly $570,000 after 36 months. Appraised value: $750,000. LTV: 76%. Conventional rate-and-term quote: 6.75% fixed 30-year, net out-of-pocket roughly $4,500 after lender credit. Monthly principal and interest drops from about $4,094 to about $3,697, a $397 reduction. Break-even on $4,500 lands near month 12. Rate numbers are illustrative–refresh against current lender sheets before relying on them.
The catch: discount points on a rate-and-term physician refi rarely pencil unless the borrower plans to hold the loan past year seven, which most doctors with growing families and job-hop risk simply won’t do. The break-even horizon on buydowns tends to run longer than the physician’s typical home-tenure window.
Timing and break-even
Break-even math is arithmetic–net closing costs divided by monthly payment reduction equals the months to recoup. But if the existing physician loan is an ARM approaching its reset date, the comparison shifts from current rate to likely post-reset rate, which argues for acting sooner rather than waiting for more amortization. Rate locks on a rate-and-term refinance commonly run 30, 45, or 60 days; a 60-day lock with a float-down option is often the right choice when appraisal is the critical path.
When to stay in the physician loan
Three scenarios argue against moving. The appraisal would likely land at 82% to 85% LTV with no cash available, and piggyback costs would erode the savings. Or the student loan picture is about to change (PSLF forgiveness inside twelve months, a mandatory RAP transition pending), so waiting until the new payment figure stabilizes prevents a mid-file blowup. Or the remaining physician loan is already priced within 0.125% of conventional, and closing costs would take 40 or more months to recover–at which point the math just doesn’t justify the paperwork.
Run the refinance break-even calculation at current lender quotes. If the file clears the 80% LTV gate cleanly and the math works inside your horizon, the move pays.
FAQ
Can I refinance a physician loan to conventional without paying PMI? Yes, if the new loan closes at 80% LTV or lower against the current appraised value. There’s no physician exception to conventional PMI rules.
How do Fannie Mae and Freddie Mac count IBR payments in 2026? Fannie Mae uses the actual payment on the credit report, including $0. Freddie Mac uses the greater of the actual payment or 0.5% of the outstanding balance when the reported figure is $0.
Is a cash-in refinance still rate-and-term? Yes. Bringing cash to closing to lower the balance stays inside the rate-and-term bucket under Fannie Mae and Freddie Mac rules.
What if the appraisal comes in low? Submit a reconsideration of value with new comps, order a second appraisal, restructure with cash-in or a piggyback, or wait six to twelve months for amortization and appreciation to catch up.
Key takeaways
The 80% LTV gate decides the refinance. Appraisal risk and student loan DTI decide whether the file closes. Shop both Fannie and Freddie on the student loan question, and keep every dollar of cash back at closing under the 2% or $2,000 agency cap to avoid a cash-out reclassification.
