Reduce dependencies by removing unused ones

[digikar99]

If you can wait before merging, I will also try to look into other systems. But it might take some time.

Reducing dependencies for plot/vega would be slightly non-trivial

[github-actions]

Thank you for your submission, we really appreciate it. Like many open-source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution. You can sign the CLA by just posting a Pull Request Comment same as the below format.

---

I have read the CLA Document and I hereby sign the CLA

---

_{You can retrigger this bot by commenting recheck in this Pull Request. Posted by the CLA Assistant Lite bot.}

[snunez1]

Can you sign the CLA please? Otherwise all looks fine.

[digikar99]

Since the changes are trivial, feel free to cherry pick them and commit under someone who has already signed the CLA. I don't know what I'm doing with life so I'd like to avoid signing.