This is a reported complication.
Nice review of polycythemia, with full text: Current applications of therapeutic phlebotomy
Mention of this complication in a textbook of hematology.
Patients with Horseshoe Kidneys have increased risk of renal cell carcinoma, so make sure you rule this out before just sending the patient for phlebotomy.