Without knowing anything else other than your physics GRE (GPA, research experience, schools you are applying to etc..), it is difficult to effectively judge how this score will impact your applications. However, many people have been admitted to schools with scores lower than 680 so your chances are certainly not doomed. Remember, the PGRE is not the only part of your application. Hope this helps you to feel better. Good Luck!