data18.com Metadata Agent

I have found this metadata scrapper on XMBC which works very well. I have taken a look at it as well at a Agents that I have already installed to see if I would be able to convert the code but I have close to absolutely 0 skills on coding. Is there anybody who would like to take a chance ?



Attached is the file with the XBMC Code !!! Thanks a lot

Sorry, forgot to really attach the code I have found for XBMC as well as to mention that this would be an adult metadataagent!

Nobody interested in giving it a try to transport the XBMC code to Plex for this Adult Agent ?

I'll take a stab at it today.  I am fairly new to all of this but it can't be too hard.

I think it will have to work similar to the KINK agent where the title will need to contain the series show ID, which will make naming files a pinta.

Seems like a useful agent for non feature releases (Excalibur agent works well for feature).

The search on the website is very precise and has many more titles available then Excalibur for example. Unfortunately no clue on how to code :( If you have code you would like to have tested let me know! 

Thanks a lot !

The search on the website is very precise and has many more titles available then Excalibur for example. 

Yep you are right about that.

I have the code mostly working. 
For some reason that I cannot see, the Posters (covers) are not loading. At least not on my computer.  Everything looks like it is working properly so I have no idea why it isn't working. 
Posters seem to be fixed now.  Not sure why  :blink: ...

Cast (actors) are not working yet; but that shouldn't be too hard of a fix. Fixed.

If you can give it a try on a small library and see if your Posters load.

This was my first shot at anything here or even using python and xpath. I used the Excalibur Films agent as a template (well ..more find and replace then a template  :ph34r: )

Edited with updates to fix the actors section.

Edit 2 --> Posters now work

This agent loads metadata for adult movies on data18.com.  I will see if I can get content to work as well....

Edit 3 --> Removed zip file...  it is now in a later post below.

Hey !!! 

I will give it a try tonight. I cannot access sites like data18 from corporate network but will give you a ping back tonight !

Thanks a lot

I updated the zip file again.  Not sure why but my posters are now loading; so I uploaded the latest files.  Looks like everything is working for movies now.

I updated the zip file again.  Not sure why but my posters are now loading; so I uploaded the latest files.  Looks like everything is working for movies now.

I made a small try and it got the poster for one movie but the line I was using was really no good. I will give it another try at home. I recall having seen on some forum for the original xvmc scrapper that there were comments about the poster pulling. Let me see if I can find them again. I will keep you posted for the moment it looked really good !

Hey,

I made a few more minor changes.  Data18 cannot search by date, so any generic name creates difficulty.

I figured out how to get more accurate search results.

See attached (remember to restart your Plex server after copying over the new files).

It seems to work pretty well for me; good enough to get most results and then use Excalibur for the remainder or vice versa.

Edited to remove zip file

Hi


Just ran on a selection of 80 titles.


Good news are: it is lightning fast and has a very high hit rate.

Not so great news are: still has problems with the poster (3rd degree was the one which worked least)


Will make another trial later. Is there any logs/data i could provide you with?


Not so great news are: still has problems with the poster (3rd degree was the one which worked least)

Will make another trial later. Is there any logs/data i could provide you with?

Hey Spanishu,

I take it that some posters worked for you, but some did not. I think data18 tries to block access to its posters, and that might be what is causing poster problems.  Changing your ip address seems to help.

The log that might help is Plex Media Server/Logs/PMS Plugin Logs/com.plexapp.agents.data18.log; though to be honest, there probably isn't anything in there.

For most movies, data18 has posters listed as "front cover" and "back cover".  I noticed that some only have a "cover" (back and front cover combined).

Right now the code is only looking for the "front cover".  If you PM me one of the movie names that didn't work for you I can see if I can find out why.

Hi Chidychi,

tried it on a new large section and most movies got identified and most got their corresponding info but the Covers was an extremely low level. I guess you are right that they are blocking the access somehow. Is there a chance to pull the posters from another site in case data18 fails automatically ?

Plex metadata agents work by using the website to give the movie an ID.  That ID is in the URL for Data18.

That ID is how Plex searches for the poster.

To use another site, we would need to find a site that uses the same ID, or find a site that has its own metadata and use it (Excalibur Films).

It looks like the posters won't load because they are being requested without a proper referrer.

There may be a way to send the referrer when the request is made for the poster.  I just don't know enough on how this stuff works to know if that is possible.

Hello chidychi,

You can replace the cover retrieval code:

    # Get Thumb and Poster
    try:
      #Log('Poster Sequence')
      img = html.xpath('//img[@class="yborder" and @alt="Enlarge Cover" and contains(@src, "/covers/")]')[0]
      thumbUrl = img.get('src')
      thumb = HTTP.Request(thumbUrl)
      Log('thumbUrl: ' + thumbUrl)
      posterimg = covershtml.xpath('//img[@alt="front cover"]')[0]
      posterUrl = posterimg.get('src').strip()
      Log('posterUrl: ' + posterUrl)
      metadata.posters[posterUrl] = Proxy.Preview(thumb)
      #Log('Poster Sequence End')
    except: pass

with this:

    # Get Thumb and Poster
    try:
      #Log('Poster Sequence')
      posterUrl = covershtml.xpath('//img[@alt="front cover"]/@src')[0]
      Log('posterUrl: ' + posterUrl)
      metadata.posters[posterUrl] = Proxy.Media(HTTP.Request(posterUrl, headers={'Referer': coversURL}).content)
      #Log('Poster Sequence End')
    except: pass


Since you have to send a valid referer headers, we cannot work with a thumb a this moment, but that doesn't really matter, because there's only 1 image to grab anyway.

Thanks Sander1

That did the trick.

I am going to create a new thread to get the zip file in the first post.

http://forums.plexapp.com/index.php/topic/66061-adult-data18com-metadata-agent-release/

Cheers!

Edit to add link to new thread.

Hi @chidychi, I know the post is a bit outdated but is it still possible to download the zip anywhere. Is it still working?

Sorry @ragren I just noticed this now.
As far as I know this is still working.
You need to use “WebTools” which took over for Unsupported App Store.

This topic was automatically closed 90 days after the last reply. New replies are no longer allowed.