[Rel] HTTP Anidb Metadata Agent (HAMA)

captainNacho · March 17, 2020, 9:36pm

Issues recognizing OP/EDs in tvdb4

The metadata for OP/EDs in tvdb4 is pulled for the absolute episode number
Ex: ED1 for Naruto is S00E151 and is available in specials folder as seen below:

But the metadata for the ED is pulled for S07E151 (absolute episode 151), see below:

From my understanding of scanner log it looks like OP/ED are being detected properly, just metadata matching is off in tvdb4 mode
Naruto Shippuden [tvdb4-79824].filelist.log (53.7 KB)
Naruto Shippuden [tvdb4-79824].scanner.log (110.5 KB)

@ZeroQI Anyway to fix this mismatch?

Also is there anyway for ASS to pull OP/ED names from Anidb for metadata? OP/ED would be then listed something like below

Ending #1: Nagareboshi: Shooting Star (1-18)
(NC)ED #1: Nagareboshi: Shooting Star (1-18)

ZeroQI · March 17, 2020, 10:54pm

@captainNacho Here are ASS first lines in the readme

Plex scanner responsibilities

A Plex Series Scanner makes the video files showing in Plex and populate the following for the video files:

Series name

Series year

Season number

Episode number

Episode title (not filled by plex default series scanner, but ASS fills it, but this will be overwritten by the metadata agent)

You can instruct Hama to pick the AniDB title for episode titles… if series and title priorities diverge, episode priority is after the ‘|’

Seem similar in resolution to Tales of Zestiria the X [tvdb5-311014] · Issue #373 · ZeroQI/Hama.bundle · GitHub
Need to process it at some point. Lowered from 10 to 6 the hama bug reports.
Should get to it at some point…

captainNacho · March 18, 2020, 1:44am

I did read that, however my issue is improper metadata match as the OP/EDs are scanned properly into Specials at proper numbers.

Everything works perfectly in anidb mode. The problem just occurs in tvdb4 mode.

I do understand that the metadata agent will override the title ASS fills, but since there is no metadata available on both AniDB and TVDB for Episodes 100+/150+ it shouldn’t it remain as is?

I’m not sure I quite follow this. Could you elaborate with an example if possible?

Also I’m not sure how this is relevant here. My understanding is in this the user is trying to have a single season with mixed specials and regular episodes.

Please let me know if I understood something incorrectly.

Thanks in advance

ZeroQI · March 18, 2020, 2:37am

You attached scanner only logs. i cannot see the metadata used that would have been indicated by the agent per series log

aniDB has metadata for opening/ending, the episode number is a convention used as i had to assign an episode number.

title field default setting in agent settings is “AniDB, TheTVDB | TheTVDB, AniDB”, first part is series, second is episodes

For the bug report, it’s going all over the place but lastly, It seems that when i changed from absolute numbering to tvdb absolute index, I didn’t update the scanner and agent enough… there is a mapping issue and the fix should fix your too, or so i thought until it stroke me…

You use tvdb numbering but expect anidb specific specials (op/ed) to be recognized?
Pick a convention, anidb or tvdb, and stick to it
maybe it could be fixed by bypassing mapping for tvdb4 for specials 100+ but I don’t understand people that adds opening/ending in Plex, what use in streaming an opening… It should go in an “Extras” folder to be skipped… Low priority for resolution and still have 6 bug report to implement, some are a year old, so…

captainNacho · March 18, 2020, 5:25am

Oh I was under the impression that OP/ED always get picked up from AniDB independently of forced guid. Thank you for the clarification.

I mean I don’t look around for OP/ED to add to my shows. If they are provided in a batch and indexing them is an option then I try to add it.

I was just curios regarding why there was a mismatch. It seems like forced tvdb guids won’t pick up specials from anidb

Thanks for the detailed explanation.

Eonian · March 21, 2020, 4:24am

Hi, I am having difficulties when trying to get HAMA agent to work, fix matching was able to find results but still unable to download metadata at all. Any help would be greatly appreciated!!

Logs.zip (1.5 MB)

PhoenixHawk · March 23, 2020, 2:06am

Anyone elses HAMA stopped matching completely? I have ad to use TheTVDB to get info for a while now. I only tend to load once I have the full set of episodes. Any tips would be appreciated.

holyslayerpt · March 30, 2020, 1:29pm

I don’t know why but my library items always show up duplicated with one being show and the other being the season. Image in attachment.

ZeroQI · April 2, 2020, 10:21am

Tvdb numbering use tvdb specials and anidb numbering use anidb specials. I had to make the distinction.
Episodes from each are mapped with scudlee’s anime-lists to each other using the Id as base so anidb by default unless seasons are present or I’d forced…
It is already complex so I would like to avoid too many changes. Generally files downloaded are anidb ready but for big series tvdb4 is attractive.
Need to fix other stuff before looking at that.

@ holyslayerpt check your library settings, hide seasons if only one, hide items in collections. That is a plex issue, nothing the agent can change to fix that…

@ PhoenixHawk check the readme, check the series specific logs for error, if you can’t fix paste the logs

ZeroQI · April 2, 2020, 10:28am

@Eonian There is an internal error so your database is maybe corrupted. try to Empty thrash, clean bundles, optimise database (libraries global action)

2020-03-21 14:51:36,723 (802617400) : CRITICAL (agentservice:588) - Exception in update for com.plexapp.agents.hama://tvdb-279827?lang=en (most recent call last):
File “/usr/local/share/plexmediaserver/Resources/Plug-ins-740d4c206/System.bundle/Contents/Code/agentservice.py”, line 429, in update_task
self.agent_update_metadata(identifier, media_type, guid, id, lang, dbid, parentGUID, force, version, parentID, periodic)
File “/usr/local/share/plexmediaserver/Resources/Plug-ins-740d4c206/System.bundle/Contents/Code/agentservice.py”, line 1290, in agent_update_metadata
kwargs=kwargs
File “/usr/local/share/plexmediaserver/Resources/Plug-ins-740d4c206/Framework.bundle/Contents/Resources/Versions/2/Python/Framework/components/messaging.py”, line 86, in call_external_function
packed_result = self._core.networking.http_request(url, cacheTime=0, timeout=None, immediate=True).content
File “/usr/local/share/plexmediaserver/Resources/Plug-ins-740d4c206/Framework.bundle/Contents/Resources/Versions/2/Python/Framework/components/networking.py”, line 346, in http_request
return HTTPRequest(self._core, url, data, h, url_cache, encoding, errors, timeout, immediate, sleep, opener, follow_redirects, method)
File “/usr/local/share/plexmediaserver/Resources/Plug-ins-740d4c206/Framework.bundle/Contents/Resources/Versions/2/Python/Framework/components/networking.py”, line 118, in init
self.load()
File “/usr/local/share/plexmediaserver/Resources/Plug-ins-740d4c206/Framework.bundle/Contents/Resources/Versions/2/Python/Framework/components/networking.py”, line 158, in load
f = self._opener.open(req, timeout=self._timeout)
File “/usr/local/share/plexmediaserver/Resources/Python/lib/python2.7/urllib2.py”, line 435, in open
response = meth(req, response)
File “/usr/local/share/plexmediaserver/Resources/Python/lib/python2.7/urllib2.py”, line 548, in http_response
‘http’, request, response, code, msg, hdrs)
File “/usr/local/share/plexmediaserver/Resources/Python/lib/python2.7/urllib2.py”, line 473, in error
return self._call_chain(*args)
File “/usr/local/share/plexmediaserver/Resources/Python/lib/python2.7/urllib2.py”, line 407, in _call_chain
result = func(*args)
File “/usr/local/share/plexmediaserver/Resources/Python/lib/python2.7/urllib2.py”, line 556, in http_error_default
raise HTTPError(req.get_full_url(), code, msg, hdrs, fp)
HTTPError: HTTP Error 500: Internal Server Error

Lightless · April 2, 2020, 11:23am

Is it possible to set the “Original Title” field of a series to Japanese romanji?

Also, I’ve fixed up the MyAnimeList agent portion if you’re interested in some source code.

Hergonoway · April 5, 2020, 9:01pm

I’m completely lost with show rating settings

I’m not english, so the only thing I may assume is that “content rating” is related to age restriction and not rating (like a note from 1 to 10) of the show :

T-EM ‘content_rating’
–E- ‘content_rating_age’

But for the rest is there somewhere a complete explanation of all of these fields :

T-EM ‘rating’
T–M ‘rating_image’
T–M ‘audience_rating’
T–M ‘audience_rating_image’
T–M ‘rating_count’

I try to match this (the percentage)

with this one “Average” from Anidb (not the one above : “Rating”, which is witchcraft) ; note : I don’t care about episode rating, here I need only the show (I’m using Anidb1 mode)

xm03x · April 10, 2020, 1:08am

Recently I too had the same issue as many with the HamaTV scanner suddenly no longer working. I updated to the most recent version of HamaTV and the ASS scanner and deleted the necessary XML cache file which got HamaTV matching again, but I have noticed an issue with some of my anime not getting scanned.
For the most part I follow the folder structure of \Anime\Show Name\Individual Episode\Video file

IE:

\Anime\Tower of God[HorribleSubs] Tower of God - 01 [1080p][HorribleSubs] Tower of God - 01 [1080p].mkv

\Anime\Tower of God[HorribleSubs] Tower of God - 02 [1080p][HorribleSubs] Tower of God - 02 [1080p].mkv

Last week when i updated HamaTV/ASS the new series detected fine, but this week when i added episode 2, HamaTV detected the file and essentially says i have 2 versions of episode 1 even though naming conventions are within Hama’s normal detection. This folder structure worked fine before and actually is how a good portion of my anime is currently set up and is still detecting fine, but new titles added since updating such as “Tower of God” will only detect properly if individual episodes are in the anime title’s folder:

\Anime\Tower of God[HorribleSubs] Tower of God - 01 [1080p].mkv

\Anime\Tower of God[HorribleSubs] Tower of God - 02 [1080p].mkv

The same thing happened with Black Clover:

Original folder structure:

\Anime\Black Clover[HorribleSubs] Black Clover - 129 [1080p][HorribleSubs] Black Clover - 129 [1080p].mkv

Did not detect until i removed the episode folder for the file:

\Anime\Black Clover[HorribleSubs] Black Clover - 129 [1080p].mkv

Is this just part of how HamaTV is now coded and i just need to change how I organize my anime files or is there something in the scanners settings i can adjust? I have multiple drives mapped with Anime shares in Plex and have been using HamaTV since at least 2016 and never had an issue like this before.

Thanks for any help you may be able to give.

ZeroQI · April 16, 2020, 10:59pm

@Lightless Definitely interested in MyAnimeList fix. Sort title can be set but original title can’t be set by the agent, it’s been broken on Plex side forever, can’t fix it my code is ready already…

@ergonoway I added the fields but are undocumented. Couldn’t find how to use from other plex agents due to no documentaion…

@ xm03x
You mean “\Anime\Tower of God[HorribleSubs]\Tower of God - 01 [1080p][HorribleSubs]\Tower of God - 01 [1080p].mkv” ?

Most metadata based software expect a /series /ep xx.ext structure. That is bad and you should feel bad (insert meme)
ASS will consider you have a “Tower of God” grouping folder and “Tower of God - 01” series with 1 x s01e01 episode…
single ep in series folder is s01e01 by definition, so behaving like expected with multiple series mostly grouping to the same series due to the title and multiple s01e01 episodes…

Go in your series folder, do search ., Ctrl+a, Ctrl+c, right click on your series folder and voila, all files are in the series folder and you can delete the episode folders…

IIGTRII · April 20, 2020, 10:51am

Ok before I explain my issue I just wanted to thank all of you guys who worked on this agent. It is a great tool for managing anime and I’ve been using it for years now.

Now here is my issue, and please bear with me as how I use HAMA is very specific to me. For years now I’ve been using the older version of HAMA (I believe its ver 0.4) and it’s been working perfectly so I didn’t really need to update until two days ago when it stoped fetching data. a quick read through this thread showed that there was an issue with anime-titles.xml and it required deleting and grabbing the latest version of HAMA which I did and now it fetching.

The reason I said how I use HAMA is specific to me is the way I have my anime library setup. My library configuration is like this: Scanner is set to ASS of course, and default agent is TheTVDB. The reason is most animes coming out nowdays are seasonal animes, so I prefer TheTVDB so I set it to the default. Now for long running animes like One Piece and Detective Conan which both have 900+ episodes I don’t want seasonal episode number (S02xE12 for example) I need absolute number. But here is the thing, I don’t want to put 900 episodes in one folder as scrolling is going to be a pain in the ass. So what I did is place the episodes in their seasonal folders as per TheTVDB and have them shown in absolute order. This set up is perfect for me as I dont need to scroll a lot and I get to maintain absolute numbering.

Now since I updated to the new HAMA, it’s not detecting episode names for absolute numbers with multiple seasons. The only way to make it work is to force ID which I dont want to do for all of series.

I don’t understand the changes that happened since the update but I’d like the same functionality as it was before. Basically what I want is tvdb3 functionality by default.

Keep in mind that I use Sonarr and it auto renames my episodes to absolute number for animes. If you need the logs then plz guide me which ones you need as there are many.

FinalDoom · April 23, 2020, 7:22am

Hi ZeroQI,

I’m having problems with getting hama to match anidb-1311. It appears to not even be querying anidb at all for some reason, even when manually entering the ID for title (forces most others to correctly match).

I’ve been having this issue occasionally, and I figured it was network issues (having some DNS problems) or rate limits or something… but now I’ve got this show I’m trying to match that it happens 100% of the time.

Normally, I can get a show to force match anidb by entering the id as the title (anidb-1311 in this case) and it’ll match directly with anidb.

This time, though, I enter the id and it immediately comes back with “no matches found”.
From the logs, it looks like it’s not even looking at anidb cache or api at all, and I can’t force it to.
This is a new install, new library, new series.

Main plugin log:

2020-04-23 06:46:04,830 (7fd179bdd700) :  INFO (agentkit:961) - Searching for matches for {'show': 'anidb-1311', 'id': '28235', 'year': '1999'}
2020-04-23 06:46:04,830 (7fd179bdd700) :  DEBUG (networking:143) - Requesting 'http://127.0.0.1:32400/library/metadata/28235/tree'
2020-04-23 06:46:04,846 (7fd179bdd700) :  INFO (common:135) - ==== common.PlexLog(file="/var/lib/plexmediaserver/Library/Application Support/Plex Media Server/Plug-in Support/Data/com.plexapp.agents.hama/DataItems/_Logs/Anime/Ginga_Eiyuu_Densetsu_Gaiden_(1999)_[anidb-1311].agent-search.log")
2020-04-23 06:46:04,855 (7fd179bdd700) :  DEBUG (networking:138) - Fetching 'http://thetvdb.com/api/GetSeries.php?seriesname=anidb-1311' from the HTTP cache
2020-04-23 06:46:04,861 (7fd179bdd700) :  DEBUG (runtime:88) - Sending packed state data (104 bytes)
2020-04-23 06:46:04,861 (7fd179bdd700) :  DEBUG (runtime:924) - Response: [200] str, 320 bytes

Referenced log:

=============================================================================================================================================================
common.PlexLog(file="/var/lib/plexmediaserver/Library/Application Support/Plex Media Server/Plug-in Support/Data/com.plexapp.agents.hama/DataItems/_Logs/Anime/Ginga_Eiyuu_Densetsu_Gaiden_(1999)_[anidb-1311].agent-search.log", movie=False)
[!] file:       "/mnt/media/Anime/Ginga_Eiyuu_Densetsu_Gaiden_(1999)_[anidb-1311]/Season_02/[LEGEND]_Ginga_Eiyuu_Densetsu_Gaiden_(1999)_-_S02E24_-_Those_Who_Recapture,_Part_2_-_[720p][4468AE1F].mkv"
[ ] library:    "Anime"
[ ] root:       "/mnt/media/Anime"
[ ] path:       "Ginga_Eiyuu_Densetsu_Gaiden_(1999)_[anidb-1311]/Season_02"
[ ] Plex root:  "/var/lib/plexmediaserver/Library/Application Support/Plex Media Server"
[ ] Log folder: "Plug-in Support/Data/com.plexapp.agents.hama/DataItems/_Logs/Anime"
[ ] Log file:   "Ginga_Eiyuu_Densetsu_Gaiden_(1999)_[anidb-1311].agent-search.log"
[ ] Logger:     "0x7fd179bdd700"
[ ] mode:       "w"
=== Search() ================================================================================================================================================
title: 'Ginga Eiyuu Densetsu Gaiden', name: 'None', filename: '%2Fmnt%2Fmedia%2FAnime%2FGinga_Eiyuu_Densetsu_Gaiden_%281999%29_%5Banidb-1311%5D%2FSeason_02%2F%5BLEGEND%5D_Ginga_Eiyuu_Densetsu_Gaiden_%281999%29_-_S02E28_-_The_Third_Tiamat_Battle_%28Part_2_of_2%29_-_%5B720p%5D%5BE387F6DA%5D%2Emkv', manual: 'False', year: '1999'
start: 2020-04-23 06:38:56,944610
=============================================================================================================================================================
--- force id ------------------------------------------------------------------------------------------------------------------------------------------------
--- source searches -----------------------------------------------------------------------------------------------------------------------------------------
=== TheTVDB.Search() ========================================================================================================================================
=============================================================================================================================================================
end: 2020-04-23 06:38:56,961703

I also get the following including a tvdb error in the main logs when searching alternate titles:

2020-04-23 07:05:18,221 (7f7e8a7fc700) :  INFO (agentkit:961) - Searching for matches for {'openSubtitlesHash': 'df2e96bc138d9d1d', 'episode': '28', 'episodic': '1', 'show': 'Ginga Eiyuu Densetsu Gaiden', 'season': '2', 'plexHash': 'e6e83839ce9ef8eb18ad907e32d630d1220b0701', 'filename': '%2Fmnt%2Fmedia%2FAnime%2FGinga_Eiyuu_Densetsu_Gaiden_%281999%29_%5Banidb-1311%5D%2FSeason_02%2F%5BLEGEND%5D_Ginga_Eiyuu_Densetsu_Gaiden_%281999%29_-_S02E28_-_The_Third_Tiamat_Battle_%28Part_2_of_2%29_-_%5B720p%5D%5BE387F6DA%5D%2Emkv', 'year': '1999', 'duration': '1535960', 'id': '28235'}
2020-04-23 07:05:18,222 (7f7e8a7fc700) :  DEBUG (networking:143) - Requesting 'http://127.0.0.1:32400/library/metadata/28235/tree'
2020-04-23 07:05:18,237 (7f7e8a7fc700) :  INFO (common:135) - ==== common.PlexLog(file="/var/lib/plexmediaserver/Library/Application Support/Plex Media Server/Plug-in Support/Data/com.plexapp.agents.hama/DataItems/_Logs/Anime/Ginga_Eiyuu_Densetsu_Gaiden_(1999)_[anidb-1311].agent-search.log")
2020-04-23 07:05:18,251 (7f7e8a7fc700) :  DEBUG (networking:138) - Fetching 'http://thetvdb.com/api/GetSeries.php?seriesname=Ginga%20Eiyuu%20Densetsu%20Gaiden' from the HTTP cache
2020-04-23 07:05:18,257 (7f7e8a7fc700) :  DEBUG (runtime:88) - Sending packed state data (104 bytes)
2020-04-23 07:05:18,257 (7f7e8a7fc700) :  DEBUG (runtime:924) - Response: [200] str, 320 bytes
2020-04-23 07:05:26,277 (7f7e8a7fc700) :  DEBUG (runtime:717) - Handling request GET /:/plugins/com.plexapp.agents.hama/messaging/function/X0FnZW50S2l0OlNlYXJjaA__/Y2VyZWFsMQoxCmxpc3QKMApyMAo_/Y2VyZWFsMQoyCmRpY3QKZGljdAo2CnMyCmVuczQKbGFuZ2IxczYKbWFudWFsYjFzNwpwcmltYXJ5aTAKczcKdmVyc2lvbnIxCnM2Cmt3YXJnc3M3ClRWX1Nob3dzMTAKbWVkaWFfdHlwZTMKczQKMTk5OXM0CnllYXJzNQoyODIzNXMyCmlkczEwCmFuaWRiLTEzMTFzNApzaG93cjAK
2020-04-23 07:05:26,278 (7f7e8a7fc700) :  DEBUG (runtime:49) - Received packed state data (80 bytes)
2020-04-23 07:05:26,279 (7f7e8a7fc700) :  DEBUG (runtime:814) - Found route matching /:/plugins/com.plexapp.agents.hama/messaging/function/X0FnZW50S2l0OlNlYXJjaA__/Y2VyZWFsMQoxCmxpc3QKMApyMAo_/Y2VyZWFsMQoyCmRpY3QKZGljdAo2CnMyCmVuczQKbGFuZ2IxczYKbWFudWFsYjFzNwpwcmltYXJ5aTAKczcKdmVyc2lvbnIxCnM2Cmt3YXJnc3M3ClRWX1Nob3dzMTAKbWVkaWFfdHlwZTMKczQKMTk5OXM0CnllYXJzNQoyODIzNXMyCmlkczEwCmFuaWRiLTEzMTFzNApzaG93cjAK
2020-04-23 07:05:26,280 (7f7e8a7fc700) :  INFO (agentkit:961) - Searching for matches for {'show': 'anidb-1311', 'id': '28235', 'year': '1999'}
2020-04-23 07:05:26,280 (7f7e8a7fc700) :  DEBUG (networking:143) - Requesting 'http://127.0.0.1:32400/library/metadata/28235/tree'
2020-04-23 07:05:26,294 (7f7e8a7fc700) :  INFO (common:135) - ==== common.PlexLog(file="/var/lib/plexmediaserver/Library/Application Support/Plex Media Server/Plug-in Support/Data/com.plexapp.agents.hama/DataItems/_Logs/Anime/Ginga_Eiyuu_Densetsu_Gaiden_(1999)_[anidb-1311].agent-search.log")
2020-04-23 07:05:26,303 (7f7e8a7fc700) :  DEBUG (networking:138) - Fetching 'http://thetvdb.com/api/GetSeries.php?seriesname=anidb-1311' from the HTTP cache
2020-04-23 07:05:26,308 (7f7e8a7fc700) :  DEBUG (runtime:88) - Sending packed state data (104 bytes)
2020-04-23 07:05:26,309 (7f7e8a7fc700) :  DEBUG (runtime:924) - Response: [200] str, 320 bytes
2020-04-23 07:05:31,614 (7f7e8a7fc700) :  DEBUG (runtime:717) - Handling request GET /:/plugins/com.plexapp.agents.hama/messaging/function/X0FnZW50S2l0OlNlYXJjaA__/Y2VyZWFsMQoxCmxpc3QKMApyMAo_/Y2VyZWFsMQoyCmRpY3QKZGljdAo2CnMyCmVuczQKbGFuZ2IxczYKbWFudWFsYjFzNwpwcmltYXJ5aTAKczcKdmVyc2lvbnIxCnM2Cmt3YXJnc3M3ClRWX1Nob3dzMTAKbWVkaWFfdHlwZTMKczQKMTk5OXM0CnllYXJzNQoyODIzNXMyCmlkczUKYTEzMTFzNApzaG93cjAK
2020-04-23 07:05:31,614 (7f7e8a7fc700) :  DEBUG (runtime:49) - Received packed state data (80 bytes)
2020-04-23 07:05:31,615 (7f7e8a7fc700) :  DEBUG (runtime:814) - Found route matching /:/plugins/com.plexapp.agents.hama/messaging/function/X0FnZW50S2l0OlNlYXJjaA__/Y2VyZWFsMQoxCmxpc3QKMApyMAo_/Y2VyZWFsMQoyCmRpY3QKZGljdAo2CnMyCmVuczQKbGFuZ2IxczYKbWFudWFsYjFzNwpwcmltYXJ5aTAKczcKdmVyc2lvbnIxCnM2Cmt3YXJnc3M3ClRWX1Nob3dzMTAKbWVkaWFfdHlwZTMKczQKMTk5OXM0CnllYXJzNQoyODIzNXMyCmlkczUKYTEzMTFzNApzaG93cjAK
2020-04-23 07:05:31,616 (7f7e8a7fc700) :  INFO (agentkit:961) - Searching for matches for {'show': 'a1311', 'id': '28235', 'year': '1999'}
2020-04-23 07:05:31,616 (7f7e8a7fc700) :  DEBUG (networking:143) - Requesting 'http://127.0.0.1:32400/library/metadata/28235/tree'
2020-04-23 07:05:31,630 (7f7e8a7fc700) :  INFO (common:135) - ==== common.PlexLog(file="/var/lib/plexmediaserver/Library/Application Support/Plex Media Server/Plug-in Support/Data/com.plexapp.agents.hama/DataItems/_Logs/Anime/Ginga_Eiyuu_Densetsu_Gaiden_(1999)_[anidb-1311].agent-search.log")
2020-04-23 07:05:31,635 (7f7e8a7fc700) :  DEBUG (networking:143) - Requesting 'http://thetvdb.com/api/GetSeries.php?seriesname=a1311'
2020-04-23 07:05:32,057 (7f7e8a7fc700) :  DEBUG (runtime:88) - Sending packed state data (104 bytes)
2020-04-23 07:05:32,057 (7f7e8a7fc700) :  DEBUG (runtime:924) - Response: [200] str, 320 bytes
2020-04-23 07:06:04,096 (7f7e8a7fc700) :  DEBUG (runtime:717) - Handling request GET /:/plugins/com.plexapp.agents.hama/messaging/function/X0FnZW50S2l0OlNlYXJjaA__/Y2VyZWFsMQoxCmxpc3QKMApyMAo_/Y2VyZWFsMQoyCmRpY3QKZGljdAo2CnMyCmVuczQKbGFuZ2IxczYKbWFudWFsYjFzNwpwcmltYXJ5aTAKczcKdmVyc2lvbnIxCnM2Cmt3YXJnc3M3ClRWX1Nob3dzMTAKbWVkaWFfdHlwZTMKczQKMTk5OXM0CnllYXJzNQoyODIzNXMyCmlkczU5CkhlbGRlbnNhZ2VuIHZvbSBLb3Ntb3NpbnNlbCDpioDmsrPoi7Hpm4TkvJ3oqqzlpJbkvJ0gKDE5OTkpczQKc2hvd3IwCg__
2020-04-23 07:06:04,097 (7f7e8a7fc700) :  DEBUG (runtime:49) - Received packed state data (80 bytes)
2020-04-23 07:06:04,098 (7f7e8a7fc700) :  DEBUG (runtime:814) - Found route matching /:/plugins/com.plexapp.agents.hama/messaging/function/X0FnZW50S2l0OlNlYXJjaA__/Y2VyZWFsMQoxCmxpc3QKMApyMAo_/Y2VyZWFsMQoyCmRpY3QKZGljdAo2CnMyCmVuczQKbGFuZ2IxczYKbWFudWFsYjFzNwpwcmltYXJ5aTAKczcKdmVyc2lvbnIxCnM2Cmt3YXJnc3M3ClRWX1Nob3dzMTAKbWVkaWFfdHlwZTMKczQKMTk5OXM0CnllYXJzNQoyODIzNXMyCmlkczU5CkhlbGRlbnNhZ2VuIHZvbSBLb3Ntb3NpbnNlbCDpioDmsrPoi7Hpm4TkvJ3oqqzlpJbkvJ0gKDE5OTkpczQKc2hvd3IwCg__
2020-04-23 07:06:04,098 (7f7e8a7fc700) :  INFO (agentkit:961) - Searching for matches for {'show': 'Heldensagen vom Kosmosinsel \xe9\x8a\x80\xe6\xb2\xb3\xe8\x8b\xb1\xe9\x9b\x84\xe4\xbc\x9d\xe8\xaa\xac\xe5\xa4\x96\xe4\xbc\x9d (1999)', 'id': '28235', 'year': '1999'}
2020-04-23 07:06:04,099 (7f7e8a7fc700) :  DEBUG (networking:143) - Requesting 'http://127.0.0.1:32400/library/metadata/28235/tree'
2020-04-23 07:06:04,113 (7f7e8a7fc700) :  INFO (common:135) - ==== common.PlexLog(file="/var/lib/plexmediaserver/Library/Application Support/Plex Media Server/Plug-in Support/Data/com.plexapp.agents.hama/DataItems/_Logs/Anime/Ginga_Eiyuu_Densetsu_Gaiden_(1999)_[anidb-1311].agent-search.log")
2020-04-23 07:06:04,119 (7f7e8a7fc700) :  DEBUG (networking:143) - Requesting 'http://thetvdb.com/api/GetSeries.php?seriesname=Heldensagen%20vom%20Kosmosinsel%20▒~J~@河▒~K▒▒~[~D▒~]説▒~V▒~]%20(1999)'
2020-04-23 07:06:04,119 (7f7e8a7fc700) :  DEBUG (sandbox:19) - ERROR: TVDB Loading search XML failed, Exception: 'URL can't contain control characters. '/api/GetSeries.php?seriesname=Heldensagen%20vom%20Kosmosinsel%20\xe9\x8a\x80\xe6\xb2\xb3\xe8\x8b\xb1\xe9\x9b\x84\xe4\xbc\x9d\xe8\xaa\xac\xe5\xa4\x96\xe4\xbc\x9d%20(1999)' (found at least '\xe9')'
2020-04-23 07:06:04,121 (7f7e8a7fc700) :  DEBUG (runtime:88) - Sending packed state data (104 bytes)
2020-04-23 07:06:04,121 (7f7e8a7fc700) :  DEBUG (runtime:924) - Response: [200] str, 320 bytes
2020-04-23 07:06:10,726 (7f7e8a7fc700) :  DEBUG (runtime:717) - Handling request GET /:/plugins/com.plexapp.agents.hama/messaging/function/X0FnZW50S2l0OlNlYXJjaA__/Y2VyZWFsMQoxCmxpc3QKMApyMAo_/Y2VyZWFsMQoyCmRpY3QKZGljdAo2CnMyCmVuczQKbGFuZ2IxczYKbWFudWFsYjFzNwpwcmltYXJ5aTAKczcKdmVyc2lvbnIxCnM2Cmt3YXJnc3M3ClRWX1Nob3dzMTAKbWVkaWFfdHlwZTMKczQKMTk5OXM0CnllYXJzNQoyODIzNXMyCmlkczMyCkdpbmdhIEVpeXV1IERlbnNldHN1IEdhaWRlbiAxOTk5czQKc2hvd3IwCg__
2020-04-23 07:06:10,727 (7f7e8a7fc700) :  DEBUG (runtime:49) - Received packed state data (80 bytes)
2020-04-23 07:06:10,728 (7f7e8a7fc700) :  DEBUG (runtime:814) - Found route matching /:/plugins/com.plexapp.agents.hama/messaging/function/X0FnZW50S2l0OlNlYXJjaA__/Y2VyZWFsMQoxCmxpc3QKMApyMAo_/Y2VyZWFsMQoyCmRpY3QKZGljdAo2CnMyCmVuczQKbGFuZ2IxczYKbWFudWFsYjFzNwpwcmltYXJ5aTAKczcKdmVyc2lvbnIxCnM2Cmt3YXJnc3M3ClRWX1Nob3dzMTAKbWVkaWFfdHlwZTMKczQKMTk5OXM0CnllYXJzNQoyODIzNXMyCmlkczMyCkdpbmdhIEVpeXV1IERlbnNldHN1IEdhaWRlbiAxOTk5czQKc2hvd3IwCg__
2020-04-23 07:06:10,728 (7f7e8a7fc700) :  INFO (agentkit:961) - Searching for matches for {'show': 'Ginga Eiyuu Densetsu Gaiden 1999', 'id': '28235', 'year': '1999'}
2020-04-23 07:06:10,729 (7f7e8a7fc700) :  DEBUG (networking:143) - Requesting 'http://127.0.0.1:32400/library/metadata/28235/tree'
2020-04-23 07:06:10,742 (7f7e8a7fc700) :  INFO (common:135) - ==== common.PlexLog(file="/var/lib/plexmediaserver/Library/Application Support/Plex Media Server/Plug-in Support/Data/com.plexapp.agents.hama/DataItems/_Logs/Anime/Ginga_Eiyuu_Densetsu_Gaiden_(1999)_[anidb-1311].agent-search.log")
2020-04-23 07:06:10,747 (7f7e8a7fc700) :  DEBUG (networking:143) - Requesting 'http://thetvdb.com/api/GetSeries.php?seriesname=Ginga%20Eiyuu%20Densetsu%20Gaiden%201999'
2020-04-23 07:06:10,978 (7f7e8a7fc700) :  DEBUG (runtime:88) - Sending packed state data (104 bytes)
2020-04-23 07:06:10,978 (7f7e8a7fc700) :  DEBUG (runtime:924) - Response: [200] str, 320 bytes
2020-04-23 07:06:15,495 (7f7e8a7fc700) :  DEBUG (runtime:717) - Handling request GET /:/plugins/com.plexapp.agents.hama/messaging/function/X0FnZW50S2l0OlNlYXJjaA__/Y2VyZWFsMQoxCmxpc3QKMApyMAo_/Y2VyZWFsMQoyCmRpY3QKZGljdAo2CnMyCmVuczQKbGFuZ2IwczYKbWFudWFsYjFzNwpwcmltYXJ5aTAKczcKdmVyc2lvbnIxCnM2Cmt3YXJnc3M3ClRWX1Nob3dzMTAKbWVkaWFfdHlwZTEwCnMxNgpkZjJlOTZiYzEzOGQ5ZDFkczE3Cm9wZW5TdWJ0aXRsZXNIYXNoczIKMjhzNwplcGlzb2RlczEKMXM4CmVwaXNvZGljczI3CkdpbmdhIEVpeXV1IERlbnNldHN1IEdhaWRlbnM0CnNob3dzMQoyczYKc2Vhc29uczQwCmU2ZTgzODM5Y2U5ZWY4ZWIxOGFkOTA3ZTMyZDYzMGQxMjIwYjA3MDFzOApwbGV4SGFzaHMyMzIKJTJGbW50JTJGbWVkaWElMkZBbmltZSUyRkdpbmdhX0VpeXV1X0RlbnNldHN1X0dhaWRlbl8lMjgxOTk5JTI5XyU1QmFuaWRiLTEzMTElNUQlMkZTZWFzb25fMDIlMkYlNUJMRUdFTkQlNURfR2luZ2FfRWl5dXVfRGVuc2V0c3VfR2FpZGVuXyUyODE5OTklMjlfLV9TMDJFMjhfLV9UaGVfVGhpcmRfVGlhbWF0X0JhdHRsZV8lMjhQYXJ0XzJfb2ZfMiUyOV8tXyU1QjcyMHAlNUQlNUJFMzg3RjZEQSU1RCUyRW1rdnM4CmZpbGVuYW1lczQKMTk5OXM0CnllYXJzNwoxNTM1OTYwczgKZHVyYXRpb25zNQoyODIzNXMyCmlkcjAK
2020-04-23 07:06:15,495 (7f7e8a7fc700) :  DEBUG (runtime:49) - Received packed state data (80 bytes)
2020-04-23 07:06:15,496 (7f7e8a7fc700) :  DEBUG (runtime:814) - Found route matching /:/plugins/com.plexapp.agents.hama/messaging/function/X0FnZW50S2l0OlNlYXJjaA__/Y2VyZWFsMQoxCmxpc3QKMApyMAo_/Y2VyZWFsMQoyCmRpY3QKZGljdAo2CnMyCmVuczQKbGFuZ2IwczYKbWFudWFsYjFzNwpwcmltYXJ5aTAKczcKdmVyc2lvbnIxCnM2Cmt3YXJnc3M3ClRWX1Nob3dzMTAKbWVkaWFfdHlwZTEwCnMxNgpkZjJlOTZiYzEzOGQ5ZDFkczE3Cm9wZW5TdWJ0aXRsZXNIYXNoczIKMjhzNwplcGlzb2RlczEKMXM4CmVwaXNvZGljczI3CkdpbmdhIEVpeXV1IERlbnNldHN1IEdhaWRlbnM0CnNob3dzMQoyczYKc2Vhc29uczQwCmU2ZTgzODM5Y2U5ZWY4ZWIxOGFkOTA3ZTMyZDYzMGQxMjIwYjA3MDFzOApwbGV4SGFzaHMyMzIKJTJGbW50JTJGbWVkaWElMkZBbmltZSUyRkdpbmdhX0VpeXV1X0RlbnNldHN1X0dhaWRlbl8lMjgxOTk5JTI5XyU1QmFuaWRiLTEzMTElNUQlMkZTZWFzb25fMDIlMkYlNUJMRUdFTkQlNURfR2luZ2FfRWl5dXVfRGVuc2V0c3VfR2FpZGVuXyUyODE5OTklMjlfLV9TMDJFMjhfLV9UaGVfVGhpcmRfVGlhbWF0X0JhdHRsZV8lMjhQYXJ0XzJfb2ZfMiUyOV8tXyU1QjcyMHAlNUQlNUJFMzg3RjZEQSU1RCUyRW1rdnM4CmZpbGVuYW1lczQKMTk5OXM0CnllYXJzNwoxNTM1OTYwczgKZHVyYXRpb25zNQoyODIzNXMyCmlkcjAK
2020-04-23 07:06:15,497 (7f7e8a7fc700) :  INFO (agentkit:961) - Searching for matches for {'openSubtitlesHash': 'df2e96bc138d9d1d', 'episode': '28', 'episodic': '1', 'show': 'Ginga Eiyuu Densetsu Gaiden', 'season': '2', 'year': '1999', 'filename': '%2Fmnt%2Fmedia%2FAnime%2FGinga_Eiyuu_Densetsu_Gaiden_%281999%29_%5Banidb-1311%5D%2FSeason_02%2F%5BLEGEND%5D_Ginga_Eiyuu_Densetsu_Gaiden_%281999%29_-_S02E28_-_The_Third_Tiamat_Battle_%28Part_2_of_2%29_-_%5B720p%5D%5BE387F6DA%5D%2Emkv', 'plexHash': 'e6e83839ce9ef8eb18ad907e32d630d1220b0701', 'duration': '1535960', 'id': '28235'}
2020-04-23 07:06:15,497 (7f7e8a7fc700) :  DEBUG (networking:143) - Requesting 'http://127.0.0.1:32400/library/metadata/28235/tree'
2020-04-23 07:06:15,512 (7f7e8a7fc700) :  INFO (common:135) - ==== common.PlexLog(file="/var/lib/plexmediaserver/Library/Application Support/Plex Media Server/Plug-in Support/Data/com.plexapp.agents.hama/DataItems/_Logs/Anime/Ginga_Eiyuu_Densetsu_Gaiden_(1999)_[anidb-1311].agent-search.log")
2020-04-23 07:06:15,519 (7f7e8a7fc700) :  DEBUG (networking:138) - Fetching 'http://thetvdb.com/api/GetSeries.php?seriesname=Ginga%20Eiyuu%20Densetsu%20Gaiden' from the HTTP cache
2020-04-23 07:06:15,524 (7f7e8a7fc700) :  DEBUG (runtime:88) - Sending packed state data (104 bytes)
2020-04-23 07:06:15,525 (7f7e8a7fc700) :  DEBUG (runtime:924) - Response: [200] str, 320 bytes

There is no filelist, scanner, or update logs for this series.

Even after manually download 1311.xml (the entry is present in anime-titles.xml) it still won’t resolve/read the file/even consider anidb. All the settings for the plugin are default.

Any clues?

Edit: File list, all eps do exist and are sanely labelled via filebot (anidb resolution):

[usr@machine /mnt/fullmedia/Anime]# ls Ginga_Eiyuu_Densetsu_Gaiden_\(1999\)_\[anidb-1311\]/Season_02/
[LEGEND]_Ginga_Eiyuu_Densetsu_Gaiden_(1999)_-_S02E01_-_Hero_of_El_Facile_-_[720p][E207D3A9].mkv                                   [LEGEND]_Ginga_Eiyuu_Densetsu_Gaiden_(1999)_-_S02E15_-_Those_Who_Revolt,_Part_1_-_[720p][DB451856].mkv
[LEGEND]_Ginga_Eiyuu_Densetsu_Gaiden_(1999)_-_S02E02_-_A_New_Hero_-_[720p][2D3B3672].mkv                                          [LEGEND]_Ginga_Eiyuu_Densetsu_Gaiden_(1999)_-_S02E16_-_Those_Who_Revolt,_Part_2_-_[720p][DA694A68].mkv
[LEGEND]_Ginga_Eiyuu_Densetsu_Gaiden_(1999)_-_S02E03_-_Profile_of_a_Hero_-_[720p][F31AA99A].mkv                                   [LEGEND]_Ginga_Eiyuu_Densetsu_Gaiden_(1999)_-_S02E17_-_Those_Who_Revolt,_Part_3_-_[720p][77AFF298].mkv
[LEGEND]_Ginga_Eiyuu_Densetsu_Gaiden_(1999)_-_S02E04_-_Journeys_Past_-_[720p][FC1E996E].mkv                                       [LEGEND]_Ginga_Eiyuu_Densetsu_Gaiden_(1999)_-_S02E18_-_Those_Who_Revolt,_Part_4_-_[720p][A78A637A].mkv
[LEGEND]_Ginga_Eiyuu_Densetsu_Gaiden_(1999)_-_S02E05_-_A_Goddess'_Favorite_(2nd_Tiamat_Battle)_-_[720p][82D5307F].mkv             [LEGEND]_Ginga_Eiyuu_Densetsu_Gaiden_(1999)_-_S02E19_-_Those_Who_Duel,_Part_1_-_[720p][57EA9FB9].mkv
[LEGEND]_Ginga_Eiyuu_Densetsu_Gaiden_(1999)_-_S02E06_-_A_Hero's_Death_(2nd_Tiamat_Battle)_-_[720p][1FB92DF3].mkv                  [LEGEND]_Ginga_Eiyuu_Densetsu_Gaiden_(1999)_-_S02E20_-_Those_Who_Duel,_Part_2_-_[720p][569828C2].mkv
[LEGEND]_Ginga_Eiyuu_Densetsu_Gaiden_(1999)_-_S02E07_-_Between_the_Mourning_Dress_and_the_Service_Uniform_-_[720p][E62ECF13].mkv  [LEGEND]_Ginga_Eiyuu_Densetsu_Gaiden_(1999)_-_S02E21_-_Those_Who_Duel,_Part_3_-_[720p][0EBAA0FA].mkv
[LEGEND]_Ginga_Eiyuu_Densetsu_Gaiden_(1999)_-_S02E08_-_Planet_POW_Camp_-_[720p][ECC3D6D7].mkv                                     [LEGEND]_Ginga_Eiyuu_Densetsu_Gaiden_(1999)_-_S02E22_-_Those_Who_Duel,_Part_4_-_[720p][E00E757A].mkv
[LEGEND]_Ginga_Eiyuu_Densetsu_Gaiden_(1999)_-_S02E09_-_Prisoner_and_Hostage_-_[720p][37635CCC].mkv                                [LEGEND]_Ginga_Eiyuu_Densetsu_Gaiden_(1999)_-_S02E23_-_Those_Who_Recapture,_Part_1_-_[720p][05BD0013].mkv
[LEGEND]_Ginga_Eiyuu_Densetsu_Gaiden_(1999)_-_S02E10_-_A_Rebellion_of_Microscopic_Size_-_[720p][E9119E3B].mkv                     [LEGEND]_Ginga_Eiyuu_Densetsu_Gaiden_(1999)_-_S02E24_-_Those_Who_Recapture,_Part_2_-_[720p][4468AE1F].mkv
[LEGEND]_Ginga_Eiyuu_Densetsu_Gaiden_(1999)_-_S02E11_-_Hero_of_Iconia_-_[720p][83831001].mkv                                      [LEGEND]_Ginga_Eiyuu_Densetsu_Gaiden_(1999)_-_S02E25_-_Those_Who_Recapture,_Part_3_-_[720p][6E76C45C].mkv
[LEGEND]_Ginga_Eiyuu_Densetsu_Gaiden_(1999)_-_S02E12_-_Thread_from_Bygone_Days_-_[720p][E3E14F7E].mkv                             [LEGEND]_Ginga_Eiyuu_Densetsu_Gaiden_(1999)_-_S02E26_-_Those_Who_Recapture,_Part_4_-_[720p][EB71FC53].mkv
[LEGEND]_Ginga_Eiyuu_Densetsu_Gaiden_(1999)_-_S02E13_-_The_End_of_One_Journey_-_[720p][8FDCA26F].mkv                              [LEGEND]_Ginga_Eiyuu_Densetsu_Gaiden_(1999)_-_S02E27_-_The_Third_Tiamat_Battle_(Part_1_of_2)_-_[720p][6AAF248E].mkv
[LEGEND]_Ginga_Eiyuu_Densetsu_Gaiden_(1999)_-_S02E14_-_Looking_for_a_Way_Out_-_[720p][C83C70C5].mkv                               [LEGEND]_Ginga_Eiyuu_Densetsu_Gaiden_(1999)_-_S02E28_-_The_Third_Tiamat_Battle_(Part_2_of_2)_-_[720p][E387F6DA].mkv

ZeroQI · May 3, 2020, 11:21pm

@ FinalDoom Can you tell me:

why you use an underscore before the force id and all around?
why you force an anidbid for anidb numbering when you have a season 2 which anidb doesn’t support on both the episode filenames and inside a season 2 folder, which cause a rightfull tvdb search? forcing the tvdbid would make more sense…

@IIGTRII Please answer the following

Are episodes showing up in Plex with the right season and episode number (in your case season tvdb_season eisode abs_number)?
did you append [tvdb3-xxxxx] to the series folder or put a tvdb3.id tag inside the series folder?

FinalDoom · May 4, 2020, 1:23am

I use underscores because I’m running on Linux, and spaces make typing paths a pain in the butt compared to underscores. Most things treat underscores as spaces anyway for UI purposes, but having to quote or escape spaces on CLI is super obnoxious.

Season 2 is from FileBot pulling from anidb–It’s the second series of Ginga Eiyuu Densetsu Gaiden: https://anidb.net/anime/1310 vs https://anidb.net/anime/1311. FileBot might be supplementing with TVDB data, not sure.

I have seasons in most of my anime, and hama has no trouble with them. I’m using the plex scanner, because the ASS was not picking things up at all, regardless of numbering. Or something like that. It’s been a while.

Renaming this one from Season_02 to Season_01 and _S02E to _S01E made it match. I didn’t try matching again before doing this rename, however, so I can’t say that was definitively what made it match. I renamed it back to Season 2 afterward, and it still matched. So maybe I was hitting some weird rate limit or something the other day.

This is one of if not the only series that has this issue, though. I’ve got 23 others that have no Season_01 and start on Season_02 or Season_05 etc. as appropriate for the series as a whole (collection, not individual title) and they all match fine.

All in all, fixed… but not sure why. Thanks for checking in @ZeroQI and for the great plugin.

IIGTRII · May 4, 2020, 9:26am

Yes, episodes are showing with the correct season and absolute number so it is not a scanner issue. Episodes showing as (episode 25, episode 26…etc).
As I mentioned, if I append [tvdb3-xxxxx] to the eries folder or by using tvdb3.id tag inside it works perfectly fine, but that is not what I need. I need the default behaviour of the agent to be tvdb3 mode and applies to all series. As I dont want to go through all my series and rename the folders and look up series ID one by one, I really prefer it to be like that by default.

ZeroQI · May 4, 2020, 11:37am

If a series has a 12 eps first season and 24 eps second Season, then using absolute numbering, the agent can’t figure out if s02e13 is ep 13 or 25 using absolute numbering…

It is why it was changed and seem to be working as designed and this part will not be changed as a result.

I would be very wary about using a naming convention on disk that isn’t anidb nor tvdb…
If it is not worth your time to put a tvdb3.id in each series folder, then maybe this isn’t the numbering convention for you to use.

In your case the scanner doesn’t need the tvdb id as no conversion is taking place so i could consider making the tvdb3.id not needing the tvdbid inside but I never considered that functionality and not sure it can just work like that and there are actually bugs to correct before that…

Topic		Replies	Views
[Release] HTTP Anidb Metadata Agent (HAMA) Dev/API Corner scanner-agent-dev	63	2036	December 20, 2019
[Release] [Alpha] [v0.1.3][v0.1.4 demo-7] Plex Anime Multi Source Agent (AMSA) Dev/API Corner scanner-agent-dev	54	3238	January 8, 2020
Series Better ABsolute Scanner (S - BABS) Dev/API Corner scanner-agent-dev	68	3024	December 21, 2019
Where is the folder location for the Scanner? General Discussions	15	1650	January 7, 2020
MyAnimeList.net Metadata Agent Dev/API Corner scanner-agent-dev	101	1436	December 20, 2019

[Rel] HTTP Anidb Metadata Agent (HAMA)

Plex scanner responsibilities

Related topics