When trying various packages in linux from different repositories it is difficult to know what package was installed from what source.
Fortunately, as described by https://askubuntu.com/a/43348 there is a program/script called ppa-purge
which allows you to uninstall every package installed from a specific repository.
Install it with:
sudo apt install ppa-purge
Next, find the repo in /etc/apt/sources.list.d/
in my case it was
$ cat /etc/apt/sources.list.d/intel-gpu-jammy.list
deb [arch=amd64,i386 signed-by=/usr/share/keyrings/intel-graphics.gpg] https://repositories.intel.com/gpu/ubuntu/ jammy client
Now run
sudo ppa-purge -s repositories.intel.com ppa:gpu/ubuntu
It will build a list of custom packages and correctly revert anything installed from that, nice!