Hey everybody - great news! After beating my head against a wall all weekend trying to get remote playback working beyond my Shield, I finally made some progress.
I can now stream to and control an instance of the Plex Web Player using Phlex, without all this stuff about play queues I was seeing when logging the web player’s output traffic. Same goes for the windows 10 app - Playback to that works like a charm!!
However, playing to Plex Media Player is still problematic, and I’m trying to work out why. Right now, the only issue I see is an error about being unable to lock up subscriber. The command gets through, is formatted correctly…there’s just something different about PMP that makes it tougher to talk to. I’ll keep at it…but I’m still quite happy that I’ve expanded playback to web and the 10 app. I’ll probably spin up a 'Nix VM this evening to install PMP on there and see how it works.
All in all, I’m doing a buttload more in terms of caching and scraping and storing and displaying, and trying to make sure that this could, in theory, play as well from Plex Cloud or a remote server as it can locally. This means lots of extra calls to Plex.TV for full server info, but also means this should be super-flexible when done.
Still need to do a lot of bug squashing on the final output JSON for playback commands…It’s largely uniform, but there are also some things I threw in there for my own purposes while testing that need to get pulled out, as well as some stuff that just doesn’t make it out despite being a successful command.
Regardless…still chugging along. I might hang it up early tonight and try to get some actual sleep…but odds are just as likely that I’m up till 2 again tonight now that I’ve made real progress. 
@Flippage said:
Well I think there’s 2 sets of commands with google actions.
One is to speak directly to apps.
The other is to ask google to speak to plex first, etc and then throw the commands at it.
I think the first is only for Google partners? Or maybe you just have to request it to be added or something.
Sorry I’m probably just talking out of my **** ahah. I’m just going off things I’ve heard tbh.
Either way, I’m happy with IFTTT for now, And maybe someone can give you a hand with the Google actions in future.
That sounds right. I did apply for an “action”, but because I was just kinda bombing through it, it was denied for a bunch of issues that I have yet to correct and resubmit. Been working more on “make it work” before worrying about how to tie it to the full-blown AI bit.
However, that’s not to say that I’m not considering how to interact with an AI agent at some point in the future. As it works now, with every command submitted, you get back a JSON-formatted Array which contains the originally submitted command, the parsed command as the app interprets it, the entire XML section for the media if some is found, as well as a result of the playback command if it makes it to that point.
So, basically, it’s designed so that not only can you easily send commands to Plex in plain spoken English, but the results sent back to whatever is calling it can be parsed and interpreted and (hopefully) spoken. I think now that I have a less abstract idea of what I want and need to do with IFTTT, I will re-submit for an actual widget maker thingamabob that better outlines how a google conversation could flow with this fella.