You're not totally screwed. Work hard, reduce class load, and improve your GPA. Do well on general GRE and PGRE. Engage in research and try to do a publication, talk or poster. Depending on what year you are in you can improve your GPA significantly. You should be able to get in somewhere but don't count on gaining ivy league admission.
I was a freshman when this happened. I should note that while in high school I spent two years at a community college, so upon recalculating, my GPA is like a 3.47. Is that decent?
Also, why should I care about the Ivy League? What's so important about them? What if I got into UCLA?
I'm not sure what you mean when you say you were in college while in high school, but it doesn't matter because 3.47 is pretty good. No one looks at your "freshman GPA". They only care about your overall GPA. Of course they also care about poor grades in physics courses.
You shouldn't care about ivy league admission but many people do so I addressed it.
I don't know what happens if you get into UCLA.
It sounds like you just finished your freshman year. If so, follow our advice and improve your grades and you will do fine. Plus you've already taken some 2nd and 3rd year courses so your upcoming class load won't be as heavy. If you've already taken many of the hard classes why not pad upcoming semesters with easy courses to boost your GPA?