Without it you are risking that the malicious driver will be loaded first and then make itself invisible to the later drivers.

Of course there are ways to bypass this too, but it adds a whole other layer of complexity.

Tldr

Secure boot is there so drivers loaded at boot time can trust that nothing was tampered with before they were loaded.