Nevermind, found a way.
For posterity, it's the "library" button at the bottom left, then either "add media to Local Library" and/or "Import active (current) playlist to Local Library". Turns out this was always an option, is much easier than how I was doing it, and I'm a blind idiot. Just for others like me who might be confused in future.