The problem is quite a big one, some players save games were causing the game to crash and some fans have been asking for solutions to the "Saved Game Loading Crash Issue". Untill a patch is released here is a simple fix for this:
Right Click the games icon (BioShockInfinite.exe) and the click properties in the drop down menu. From here click the compatibility tab and select "Windows Vista SP2". This should then allow your saved games to load!
Did this fix help you? Did it not? Have you heard about the problems with this version of the game? Let us know in the comments below!