Absolute Series Scanner (for anime mainly)

Dev Community Dev/API Corner
721

I hope this helps, otherwise I have no other file that fits

722

@cbanks79 Looked through all logs, can only find one ‘Fairy Tail’ log and it’s for ‘Fairy Tail S2’


723

Ok, so here is the link for Fairy Tail on anidb Anime List - AniDB I renamed the folders based on the anidb and only 2009 and 2014 comes out right. 2011 is put in the same folder as 2009.

724

What agent are you guys using?

725

@cbanks79 Logs is not of HAMA beta branch so logging is difficult to read and only contain “anidbid-12834 Kakegurui”
the folder names are all good with the right anidb id so it is HAMA that mess it up and load main serie XML from AniDB for the OAV and regroup in the same sereis due to the series title
 What happens with HAMA beta branch ?

@brushrop03 You can use the following:

Can You Mix TV Series and TV Movies in the Same Library?
726

@ZeroQI Thanks. Got it all installed.

I installed this scanner a while ago, but assuming it needs to be updated. I can’t remember how to download and install. Can someone help me out. My technical skills are only so-so.

727

@brushrop03 The readme has all the answers generally: https://github.com/ZeroQI/Absolute-Series-Scanner

Install / Update

Note:

  • “Scanners” and “Series” folder are not created by default and will need to be created.
  • “Scanners” folder will be at the same level as “Plug-in Support” folder (in other words the same parent directory)
  • “Absolute Series Scanner.py” resides in Series folder, do not create an additional folder not listed like “absolute-series-scanner-master” and add the correct permissions on the init.py file. This should be done with chmod +x under linux
  • Once the scanner is installed correctly, when creating a library you can select the custom scanner, otherwise the drop-down selection list is not shown when creating a TV Series library on the advanced tab.
728

Yup I got it. Thanks

729

@ZeroQI I installed the beta branch, closed the server and restarted it. I had removed the original Hama before installing it. Even how the settings look are different

I’m at my wits end as to what I can do. But I do have the 2011 folder showing in a different section because I scanned for it by itself first, then added the rest of the folders.

730

@cbanks79 Settings looks normal. Yes beta is way different and two years off now from main branch.
Can i have agent logs (search and update and scanner filelist) for Fairy Tail (2011) and 2009 after a manual match ? logs will be in same folders as scanner logs so _Logs.zip would allow me to reproduce your library exactly so i can correct the issue


731

Hopefully this is what you need, I was going to zip the whole folder, but here you go

732

@cbanks79 please give me the whole folder. as i need the logs with your folders name. at the very least filelists for Fairy Tail (2011) and 2009

733

@ZeroQI that’s the thing, they’re not in the folder

734

Thanks for the logs. that and the precise description (fairy tail (2011) ends up with fairy tail) i could locate the issue

Scanner filelist

Library: 'no valid X-Plex-Token.id', root: 'G:\OVA\Fairy Tail (2011) [anidb-8132]', path: '', files: '6', dirs: '0', Plex scan date: 2018-05-26 04:56:27
Fairy Tail (2011) - 01 - Welcome to Fairy Hills!!.mp4
Fairy Tail (2011) - 02 - Fairy Academy Yankee-kun and Yankee-chan!.mp4
Fairy Tail (2011) - 03 - Memory Days.mp4
Fairy Tail (2011) - 04 - Fairies` Training Camp.mp4
Fairy Tail (2011) - 05 - The Exciting Ryuzetsu Land.mp4
Fairy Tail (2011) - 06 - Fairy Tail x Rave.mp4

Scanner logs

Library: 'no valid X-Plex-Token.id', root: 'G:\OVA\Fairy Tail (2011) [anidb-8132]', path: '', files: '6', dirs: '0', Plex scan date: 2018-05-26 04:56:28
"Fairy Tail" s0001e001 "Welcome to Fairy Hills!!"
"Fairy Tail" s0001e002 "Fairy Academy Yankee-kun and Yankee-chan!"
"Fairy Tail" s0001e003 "Memory Days"
"Fairy Tail" s0001e004 "Fairies' Training Camp"
"Fairy Tail" s0001e005 "The Exciting Ryuzetsu Land"
"Fairy Tail" s0001e006 "Fairy Tail x Rave"

Logs are created based on the folder name directly inside root folder
Force IDs work only on series folder, ie folders inside a library root(s) folders , not the root folder

You did add ‘G:\OVA\Fairy Tail (2011) [anidb-8132]’ as root folder seemingly so it did add as"Fairy Tail" the episodes.

  • either add ‘G:\OVA’ and not ‘G:\OVA\Fairy Tail (2011) [anidb-8132]’
  • or add 'G:\OVA\Fairy Tail; which contain ‘Fairy Tail (2011) [anidb-8132]’ folder as SERIES folder

I did an upgrade of the scanner that does not remove (2011) for files in root folder but you should still not the series folder as root folder

735

Was going to post to get help but doing a full refresh actually worked. Thought I’d post this anyway to lure users searching for solutions. Using ASS commit 7fcdd0f9efb0c85686a666d3bd9ffeb08dde4425 (May 23, 2018) and Hama commit 68c3be55791ed2c6ccbe0ffaf127a61addb01f57 (May 25, 2018) with linuxserver/plex:latest docker build bm5ssofvebfysrsza6zansh (Plex ver 1.13.2.5102) on unRAID 6.5.1, all file systems local.

I think Hama’s AniDB HTTP cache for a series I attempted to add yesterday got thwacked because I was using/abusing Filebot at the same time and earned an API ban, and I couldn’t figure out how to force the cache to refresh. After getting a new WAN IP, that one series’ metadata still wouldn’t load. Tried wiping local cache and metadata manually (rm -rf /Metadata/TV Shows/
bundle/ of matching one) as well as with Plex’s ‘clean bundles’ feature between Library recreations and Plex reboots, but it didn’t work. Plex Media Scanner.log showed that it was still finding the old (empty) metadata from when it was added before, so it didn’t try to download it again.

...
May 26, 2018 16:01:38.512 [0x15486b862800] DEBUG -       * Scanning Berserk [tvdb2-73752] Season 1 Episode 4
May 26, 2018 16:01:38.512 [0x15486b862800] DEBUG - Looking for path match for [/unraid_media/anime/Berserk [tvdb2-73752]/Berserk - 04 - The Hand of God - 720p.x264.AAC[2.0-eng].mkv]
May 26, 2018 16:01:38.512 [0x15486b862800] DEBUG - Skipping hash check, no size match for 497908091 bytes.
May 26, 2018 16:01:38.513 [0x15486b862800] DEBUG - No match for hash.
May 26, 2018 16:01:38.513 [0x15486b862800] DEBUG - Checking descendants of Berserk [tvdb2-73752]
May 26, 2018 16:01:38.514 [0x15486b862800] DEBUG -  -> FOUND metadata item (show)
May 26, 2018 16:01:38.514 [0x15486b862800] DEBUG -  -> We found a local media item with rooted metadata in Berserk [tvdb2-73752]
May 26, 2018 16:01:38.514 [0x15486b862800] DEBUG - Found existing show 76233
May 26, 2018 16:01:38.515 [0x15486b862800] DEBUG - Downloading document http://127.0.0.1:32400/library/changestamp
...

But all the info it had was an xml with empty fields. Here’s the local metadata bundle Info.xml:

<?xml version='1.0' encoding='utf-8'?>
<TV_Show id="tvdb2-73752">
  <rating/>
  <title_sort/>
  <art/>
...
  <reviews/>
  <banners/>
  <similar/>
</TV_Show>

Removing library and restarting Plex didn’t do the trick. I must have been missing some local cache, one that had bad data in it from yesterday’s AniDB API ban. A more complete reinstall did work, though it was certainly overkill. Here’s the steps:

  1. Remove these from your root Plex directory (rm -rf)

    Plug-ins/Hama.bundle
    Plug-in Support/Metadata Combination/com.plexapp.agents.hama
    Plug-in Support/Preferences/com.plexap.agents.hama.xml
    Plug-in Support/Caches/com.plexap.agents.hama
    Plug-in Support/Data/com.plexapp.agents.hama

  2. Delete the media library, empty Plex trash, clean bundles, optimize database, then stop PMS.

  3. Put Hama.bundle (Beta-agent, currently) and the Plug-in Support folders back (Helpful link to stuff you put in Plug-in Support directory: https://github.com/ZeroQI/Hama.bundle/releases/download/v1.0/Plug-in.Support.folders.zip), following GitHub readme, then apply proper owner, group and permissions. For me this means this:

    $ cd “/mnt/user/appdata/plex/config”
    $ chown -R uplex:users * ; chmod -R 755 *; ls -lah

    total 0
    drwxrwxrwx 1 uplex users 14 May 24 04:54 ./
    drwxrwxrwx 1 root root 12 May 24 04:53 
/
    drwxr-xr-x 1 uplex users 38 May 24 04:54 Library/

Of course if you have some special permissions this will overwrite them, so put them back or avoid those files/dirs. Don’t delete the Hama stuff in Plug-in Support if you don’t have to, as it downloads everything over again and can overtax our shared and free resources like AniDB or TheTVDB.

Sorry for muddying up your thread ZeroQI, thought it might help others to repeat the above steps yet again. (I know you’ve repeated them in a dozen different ways already.)

736

@ZeroQI I placed the folders in the Fairy Tail folder. It recognized all three, but now it’s listing 2014 as a Special.

737

@cbanks79 it is listing as season 0 all episodes which is wrong and possibly a big I added. reproduced the issue, corrected but “serie S2 - ep - title.ext” not recommended as anidb specials naming is Sx too


@tyblu very good post but it is an agent situation, the scanner thread limit the visibility of people potentially needing it. I will put a workaround in place in case of too small XML files to not store them. I would have manually searched a series manually called clear-cache to clear Plex cache which to limit to one day, deleted the XML cached file manually. Plug in support folders are automatically created with beta branch no need to add the zip.

738

Just wanted to show the most impressive listing ASS has done for me yet, merging anidb (AniDB specials notation), anidb2, and tvdb in 5 different folders and all in a grouping folder:

./Hajime no Ippo/Hajime no Ippo - Champion Road [anidb2-982]/Hajime no Ippo - Champion Road - Complete Movie - 480p.DVD.x264[1.8Mbps].AAC[2.0].mkv
./Hajime no Ippo/Hajime no Ippo - Boxer's Fist [tvdb-79685]/Hajime no Ippo - S00E01 - Boxer's Fist - 480p.DVD.x264[2.2Mbps].Vorbis[2.0].mkv
./Hajime no Ippo/Hajime no Ippo AniDB Extras [anidb-129]/Hajime no Ippo - OP3 - 480p.DVD.x264[3.4Mbps].Vorbis[2.0].mkv
./Hajime no Ippo/Hajime no Ippo AniDB Extras [anidb-129]/Hajime no Ippo - ED1 - 480p.DVD.x264[2.2Mbps].Vorbis[2.0].mkv
./Hajime no Ippo/Hajime no Ippo AniDB Extras [anidb-129]/Hajime no Ippo - ED2 - 480p.DVD.x264[3.6Mbps].Vorbis[2.0].mkv
./Hajime no Ippo/Hajime no Ippo AniDB Extras [anidb-129]/Hajime no Ippo - ED3 - 480p.DVD.x264[2.7Mbps].Vorbis[2.0].mkv
./Hajime no Ippo/Hajime no Ippo AniDB Extras [anidb-129]/Hajime no Ippo - ED4 - 480p.DVD.x264[3.7Mbps].Vorbis[2.0].mkv
./Hajime no Ippo/Hajime no Ippo AniDB Extras [anidb-129]/Hajime no Ippo - OP1 - 480p.DVD.x264[2.5Mbps].Vorbis[2.0].mkv
./Hajime no Ippo/Hajime no Ippo AniDB Extras [anidb-129]/Hajime no Ippo - OP2 - 480p.DVD.x264[2.8Mbps].Vorbis[2.0].mkv
./Hajime no Ippo/Hajime no Ippo - Kimura Tatsuya vs Mashiba Ryo [anidb2-1086]/Hajime no Ippo - Kimura Tatsuya vs Mashiba Ryo - Complete Movie - 480p.DVD.x264[2.0Mbps].AAC[5.1].mkv
./Hajime no Ippo/Hajime no Ippo [anidb2-129]/Hajime no Ippo - 15 - Test of Endurance - 480p.DVD.x264.Vorbis[2.0-eng].mkv
./Hajime no Ippo/Hajime no Ippo [anidb2-129]/Hajime no Ippo - 17 - Ippo on the Beach - 480p.DVD.x264.Vorbis[2.0-eng].mkv
./Hajime no Ippo/Hajime no Ippo [anidb2-129]/Hajime no Ippo - 19 - KO Dream - 480p.DVD.x264.Vorbis[2.0-eng].mkv
...
./Hajime no Ippo/Hajime no Ippo [anidb2-129]/Hajime no Ippo - 62 - The Road Back - 480p.DVD.x264.Vorbis[2.0-eng].mkv
./Hajime no Ippo/Hajime no Ippo [anidb2-129]/Hajime no Ippo - 64 - Hot Rod Era - 480p.DVD.x264.Vorbis[2.0-eng].mkv
./Hajime no Ippo/Hajime no Ippo [anidb2-129]/Hajime no Ippo - 70 - The Young Punk - 480p.DVD.x264.Vorbis[2.0-eng].mkv

Thanks again!

739

@tyblu Excellent! Most people only post issues
 I am glad you like anidb2 since it is unique to my scanner. Unique enough for a donation (link in signature) :wink:

  • If using Hama beta branch, In agent settings, set ‘Local’ as Metadata source for ‘collection’ field and it will create a collection for all series in the grouping folder, that could be helpful in your case
740

Will do! (again :wink: )

TheTVDB has been having plenty of API issues this week (more 503 responses). Assuming that more of my anime series’ have this empty xml info, should I have to find and delete them once TVDB gets their ■■■■ together, or could I just wait for the cached data to expire then use Plex’s ‘refresh metadata’ feature?