Scraping Javascript based Webpages

Hi all,

I have written a number of agents that all use web page scraping to retrieve metadata. I have now become stuck. One page I need to scrape loads its content after the page has rendered and so when I scrape it…it is empty.

I have done some research and get why my page is empty, however with python not being my primary language I cannot seem to find a guide on which modules to use, how to install them to work on plex and how to reference them in my agent file…or even an agent that currently does this so I can look at some code. It all ends up in a huge mess.

I would appreciate any help anyone could give me as its a real show stopper.

Thanks in advance

Yoadster.