I've definitely done it before. It used to be my primary way to stream music at work from my home server. This was likely a decade ago so I couldn't say exactly how it was set up (I've since switched to the, now seemingly abandoned, Subsonic) but knowing me SSH probably played a key part.