[Rel] HTTP Anidb Metadata Agent (HAMA)

@ZeroQI said:
@saitoh183: implemented the filelist creation (didn’t published yet). took some time since so much was removed. got to look at your logs, and i can’t find a reason why it behaves like that for the season… It shouldn’t try with this naming convention. will dig more into this. will solve but will take some time but have your filelist so got all i need to reproduce
@ZeroQI
Np… Yesterday I was able to get it to work and I was then able to reproduce the problem. I will pm you with a link to my test content with the details… It might help figure out the problem

@saitoh183 said:

@ZeroQI said:
@saitoh183: implemented the filelist creation (didn’t published yet). took some time since so much was removed. got to look at your logs, and i can’t find a reason why it behaves like that for the season… It shouldn’t try with this naming convention. will dig more into this. will solve but will take some time but have your filelist so got all i need to reproduce
@ZeroQI
Np… Yesterday I was able to get it to work and I was then able to reproduce the problem. I will pm you with a link to my test content with the details… It might help figure out the problem

@ZeroQI

So after much testing i finally figured it out. The Scanner doesnt like srt files and in some cases thumb.jpg file. Once removed, all the problematic files scanned in properly. Here is a zip of a few of them so you can test it out and maybe figure out what part of your code is failing when those files are present. You will need to remove the files first from the plex library and then re-add them with files in my zip. This should reproduce my problem. If you cant get it to trigger the problem, i would be more then happy to do a teamviewer session with you and show you it on my system.

That is an amazing feedback, i know which part of code is triggered… will have a new version saturday to correct

@ZeroQI said:
That is an amazing feedback, i know which part of code is triggered… will have a new version saturday to correct

Also episode that are part 1’s that are named like (1) also dont scan in well…

example : Attack on Titan - 01 - To You, 2000 Years in the Future - The Fall of Zhiganshina (1 )[EveTaku].mkv

this would create a Season 2000 eps 1

I had to change it to:

Attack on Titan - 01 - To You, 2000 Years in the Future - The Fall of Zhiganshina part 1 [EveTaku].mkv

then it scanned in correctly

Also Shows like Gintama (2015) Scan in as 2006 Gintama even if i added the anidb number to the folder name. and it seem to only do that after i add eps 1

Ranma 1/2 Nettou Hen does a similar problem…even if i add the anidb as well, entire series gets placed under Season 1989

Fairy Tail 2014 does the same as Gintama

@saitoh183 said:
Also Shows like Gintama (2015) Scan in as 2006 Gintama even if i added the anidb number to the folder name. and it seem to only do that after i add eps 1

I had a similar problem with Fairy Tail. I usually can just add the year to the end of a title, and that will fix the problem. However, using “Fairy Tail (2014)” didn’t do anything. I actually had to go to the original series and rename the folder to “Fairy Tail (2011)” in addition to adding the year to the second series. At this point, it finally worked.

Now, unfortunately for me, Hunter x Hunter wasn’t nearly so nice. As much as I tried, I couldn’t get it to work as it kept lumping the remake into the original even with the year on both series. I think the issue there is that Hunter x Hunter (2011) has two listed official titles, and the first one is “HUNTERxHUNTER (2011)” where the second is “Hunter X Hunter (2011)”. Once I used that first title, it worked fine.

Unfortunately, I don’t have any Gintama sequel series to test with.

@saitoh183: implemented filelist + remove other files from the algorythm so jpg and srt shouldn’t change anything now. will have to recheck and reproduce with filename provided but that should already fix some. updated absolute series scanner alpha on github

@ZeroQI said:
@saitoh183: implemented filelist + remove other files from the algorythm so jpg and srt shouldn’t change anything now. will have to recheck and reproduce with filename provided but that should already fix some. updated absolute series scanner alpha on github

I will give it try as soon as possible. Right now the problem of shows making season number out the year of the anime is the problem I have left.

@ZeroQI said:
@saitoh183: implemented filelist + remove other files from the algorythm so jpg and srt shouldn’t change anything now. will have to recheck and reproduce with filename provided but that should already fix some. updated absolute series scanner alpha on github

just tried it and now it adds ssa subtitle files as video files

and all the artwork

tried to reproduce and don’t have that… i believe you updated wrongly the scanner
Nonetheless i edited the logging so it list if ext not supported, and if supported and does not match the skipped files regex it is added to filelist or reason not to include is listed. there was an issue in folders with srt and jpg that caused files missing in filelst, now resolved

Scanner call - root: '/volume1/MegaRaid/Anime/■■■ Sub En/_test Users/ZeroQI', path: 'Naruto Shippuden', dirs: '1', files: '7'
=============================================================================================================================================================
"/volume1/MegaRaid/Anime/■■■ Sub En/_test Users/ZeroQI/Naruto Shippuden/@eaDir" match ignore_dirs_rx: "@eaDir"
file: '/volume1/MegaRaid/Anime/■■■ Sub En/_test Users/ZeroQI/Naruto Shippuden/Naruto Shippuden - 170 - Search for the Fourth Hokage's Legacy - Part 1 [HorribleSubs].eng.srt', ext: 'srt' not in video_ext
file: '/volume1/MegaRaid/Anime/■■■ Sub En/_test Users/ZeroQI/Naruto Shippuden/Naruto Shippuden - 171 - Search for the Fourth Hokage's Legacy - Part 2 [HorribleSubs].eng.srt', ext: 'srt' not in video_ext
"Naruto Shippuden" s0001e170 "Naruto Shippuden - 170 -  An Opening [HorribleSubs].mkv" "An Opening" 
"Naruto Shippuden" s0001e171 "Naruto Shippuden - 171 -  A True Ending .mp4" "A True Ending" 
"Naruto Shippuden" s0001e001-002 "Naruto Shippuden - E001-E002 - SD TV - SiCKRAGE.avi" "11"
"Naruto Shippuden" s0001e003-004 "Naruto Shippuden - E003-E004 - SD TV - SiCKRAGE.avi" "11"
"Naruto Shippuden" s0001e005-006 "Naruto Shippuden - E005-E006 - SD TV - SiCKRAGE.avi" "11"
-------------------------------------------------------------------------------------------------------------------------------------------------------------

@ZeroQI said:
tried to reproduce and don’t have that… i believe you updated wrongly the scanner
Nonetheless i edited the logging so it list if ext not supported, and if supported and does not match the skipped files regex it is added to filelist or reason not to include is listed. there was an issue in folders with srt and jpg that caused files missing in filelst, now resolved

Scanner call - root: '/volume1/MegaRaid/Anime/Jap Sub En/_test Users/ZeroQI', path: 'Naruto Shippuden', dirs: '1', files: '7'
=============================================================================================================================================================
"/volume1/MegaRaid/Anime/Jap Sub En/_test Users/ZeroQI/Naruto Shippuden/@eaDir" match ignore_dirs_rx: "@eaDir"
file: '/volume1/MegaRaid/Anime/Jap Sub En/_test Users/ZeroQI/Naruto Shippuden/Naruto Shippuden - 170 - Search for the Fourth Hokage's Legacy - Part 1 [HorribleSubs].eng.srt', ext: 'srt' not in video_ext
file: '/volume1/MegaRaid/Anime/Jap Sub En/_test Users/ZeroQI/Naruto Shippuden/Naruto Shippuden - 171 - Search for the Fourth Hokage's Legacy - Part 2 [HorribleSubs].eng.srt', ext: 'srt' not in video_ext
"Naruto Shippuden" s0001e170 "Naruto Shippuden - 170 -  An Opening [HorribleSubs].mkv" "An Opening" 
"Naruto Shippuden" s0001e171 "Naruto Shippuden - 171 -  A True Ending .mp4" "A True Ending" 
"Naruto Shippuden" s0001e001-002 "Naruto Shippuden - E001-E002 - SD TV - SiCKRAGE.avi" "11"
"Naruto Shippuden" s0001e003-004 "Naruto Shippuden - E003-E004 - SD TV - SiCKRAGE.avi" "11"
"Naruto Shippuden" s0001e005-006 "Naruto Shippuden - E005-E006 - SD TV - SiCKRAGE.avi" "11"
-------------------------------------------------------------------------------------------------------------------------------------------------------------

I will retry…i think i forgot to restart plex…often i replace the scanner and just hit refresh on a show …because i have people watching remotely so i couldnt reboot

@saitoh183 said:

@ZeroQI said:
@saitoh183: implemented filelist + remove other files from the algorythm so jpg and srt shouldn’t change anything now. will have to recheck and reproduce with filename provided but that should already fix some. updated absolute series scanner alpha on github

I will give it try as soon as possible. Right now the problem of shows making season number out the year of the anime is the problem I have left.

does the update fix also this issue?

Solve the wrong ep number. Should solve season, to test. Give me failing filenames and will fix. Algorythm identical to old scanner now since unrelated files removed from filelist

@saitoh183 said:

@ZeroQI said:
tried to reproduce and don’t have that… i believe you updated wrongly the scanner
Nonetheless i edited the logging so it list if ext not supported, and if supported and does not match the skipped files regex it is added to filelist or reason not to include is listed. there was an issue in folders with srt and jpg that caused files missing in filelst, now resolved

Scanner call - root: '/volume1/MegaRaid/Anime/Jap Sub En/_test Users/ZeroQI', path: 'Naruto Shippuden', dirs: '1', files: '7'
=============================================================================================================================================================
"/volume1/MegaRaid/Anime/Jap Sub En/_test Users/ZeroQI/Naruto Shippuden/@eaDir" match ignore_dirs_rx: "@eaDir"
file: '/volume1/MegaRaid/Anime/Jap Sub En/_test Users/ZeroQI/Naruto Shippuden/Naruto Shippuden - 170 - Search for the Fourth Hokage's Legacy - Part 1 [HorribleSubs].eng.srt', ext: 'srt' not in video_ext
file: '/volume1/MegaRaid/Anime/Jap Sub En/_test Users/ZeroQI/Naruto Shippuden/Naruto Shippuden - 171 - Search for the Fourth Hokage's Legacy - Part 2 [HorribleSubs].eng.srt', ext: 'srt' not in video_ext
"Naruto Shippuden" s0001e170 "Naruto Shippuden - 170 -  An Opening [HorribleSubs].mkv" "An Opening" 
"Naruto Shippuden" s0001e171 "Naruto Shippuden - 171 -  A True Ending .mp4" "A True Ending" 
"Naruto Shippuden" s0001e001-002 "Naruto Shippuden - E001-E002 - SD TV - SiCKRAGE.avi" "11"
"Naruto Shippuden" s0001e003-004 "Naruto Shippuden - E003-E004 - SD TV - SiCKRAGE.avi" "11"
"Naruto Shippuden" s0001e005-006 "Naruto Shippuden - E005-E006 - SD TV - SiCKRAGE.avi" "11"
-------------------------------------------------------------------------------------------------------------------------------------------------------------

I will retry…i think i forgot to restart plex…often i replace the scanner and just hit refresh on a show …because i have people watching remotely so i couldnt reboot

@ZeroQI
So i tried again and its the same issue…the seasons seem resolved for Fate Zero II (2012) but it still creates a show called seasons which contains a single file season01-poster.jpg and creates a Special season within the show with all the other artwork files
clearart.png
banner.jpg
fanart.jpg
poster.jpg

and even the hidden file thumbs.db

Seasons not fixed for Ranma 1/2 anidb-193

Partal logs with both shows that i tried

http://pastebin.com/BYsnM4qq

@saitoh183 : Pastebin is giving me an error: ‘This page has been removed!’
I need the filelist and partial log for wrong seasons show and ranma.
My code does only accept files in the supported extensions list so it’s weird…

Just an update. I am still on Alpha v3 or however you want to name it. Have had no reason major issues thus far that forced to me to sweet talk the GF to down the server to upgrade or felt the need to stay up till 3am to do it.

Did however notice that it merged the Fate stay night unlimited bladeworks season 1 and the movie. Previously I would just unmatched it and go on as normal, however that option seems to not be available any more. Would updating to latest versions fix this or is this a Plex issue? none of my normal series/movies does this so not sure

As always thanks for all the hard work on this much appreciated. If our local currency hadn’t gone to ■■■■ I would have donated by now

@chrno: The alpha changed the way the eps were added per folder call so it is more standard from plex point of vue so that might lead to the need to re-create the library at times if files are not picked up due to a cache issue and being skipped by plex as nothing in the folder changed…

I use a synology box (ds1815+) and only edit the scanner without restarting and works grand for me

I would need the filelist for all your Fate stay night stuff and custom scanner log (the one my scanner creates) would be nice… Since i already created fixes, i offer limited support to previous versions, as what good is it to me if a previous version has issues that the latest doesn’t possibly have?

May i ask why you didn’t add the newest scanner without downtime under another name, create a test library pointing to your anime folder and using the newest scanner ? I don’t see that needing downtime…

Didn’t know you don’t have to restart for that. I just always restart the server after updating/changing any of the agents/scanner on the thing. Other then that it been working like charm so had no reason to update it. Been adding a steady stream of anime to it and its been picking it up and cataloging it correctly.

That said Ill update the thing tonight. Oh and I already fixed it by just adding the anidbid to the movie and did a refresh of the lib. Dunno who thought it was a good idea to give the movie and series the exact same name.

Just thought Id mention the fact that I no longer had the option to unmatch episodes where it groups multiple episodes/movie up like I use to be.

agents are loaded when you start the server but scanner reload each time the scanner file is updated
Well cannot solve aniDB entries sharing the same name, especially not in the scanner, but that is why i included the anidb force in the title (or anidb.id file)…

I think it depends how the scanner grouped them, if it was on the same scanner call or not (which is why i want to use every scanner call properly instead of all in the original scan).

Let me know if any bug is there on latest scanner and include the filelist and custom scanner log (normal scanner log if there is a python error in it)

@ZeroQI said:
@saitoh183 : Pastebin is giving me an error: ‘This page has been removed!’
I need the filelist and partial log for wrong seasons show and ranma.
My code does only accept files in the supported extensions list so it’s weird…

@ZeroQI
sorry about that…

Also both shows have the anidb-XXX in title. i added 2 logs…the other has Fairy tail 2014