Which version of EM correctly describes spacetime?

They both seem to do a fairly good job.

Which offers a more fundamental picture?

By identifying gauge-related classes of bundles we arrive at the holonomies. Both descriptions describe the same (non-ST) degrees of freedom.