Well, it certainly depends on which schools you are applying to.
An overall GPA of 2.35 may scare some admission commitee members away... that is quite low. And I'm guessing when they see the grades for your first, second, and third years, they will be a bit hesitant. But a 3.75 for physics is definitely nothing to laugh at.
If you do really well on the GRE general and subject... and you can get good letters of rec... AND perhaps include in your personal statement a bit about your new found determination and academic success in physics... I'd say you'd have a good shot of getting into a variety of decent schools. Just make sure you take the rigorous undergrad physics classes... and not only the required ones. Most admissions committes are concerned that you have a solid background in all areas of physics (especially, of course, mechanics, E+M, thermo, QM, relativity, and nuclear/particles).
Well hope this helps. Don't get discouraged... it's still definitely worth applying. ^_^