Boot Freezing after installing AMD Drivers in Linux Lite 4.8

[Anarcho Pingu]

So I recently installed Linux Lite 4.8 and installed a driver for my GPU (MSI RX 580 4G) because I was having frame rate problems playing games.
Driver: https://github.com/GPUOpen-Drivers/AMDVLK
So I installed following the directions for Ubuntu and now every time I boot with

Code:

nomodeset

or

Code:

quiet splash

, it will freeze and not ever go to the login screen.