Transport experiments in strong magnetic fields show a variety of fascinating phenomena like the quantum Hall effect, weak localization or the giant magnetoresistance. Often they originate from the atomic-scale structure inaccessible to macroscopic magnetotransport experiments. To connect spatial information with transport properties, various advanced scanning probe methods have been developed. Capable of ultimate spatial resolution, scanning tunnelling potentiometry has been used to determine the resistance of atomic-scale defects such as steps and interfaces. Here we combine this technique with magnetic fields and thus transfer magnetotransport experiments to the atomic scale. Monitoring the local voltage drop in epitaxial graphene, we show how the magnetic field controls the electric field components. We find that scattering processes at localized defects are independent of the strong magnetic field while monolayer and bilayer graphene sheets show a locally varying conductivity and charge carrier concentration differing from the macroscopic average.