Absolute Series Scanner (for anime mainly)

deusxanime · December 26, 2016, 11:11pm

@ZeroQI - been sick the past couple days, so sorry for delays… Updated to latest ASS/HAMA masters, restarted Plex, and things looking better now. At least everything seems to be matching, mapping, and merging correctly now. It looks like it might not be using the anime-list-custom.xml in some of the series folders though, or not interpreting them correctly. Here’s some examples:

For “A Certain Magical Index - The Miracle of Endymion” movie I have this custom xml:

<?xml version="1.0" encoding="utf-8"?>
<anime-list>
  <anime anidbid="8694" tvdbid="83322" defaulttvdbseason="0" imdbid="unknown">
    <name>Gekijouban Toaru Majutsu no Index: Endymion no Kiseki</name>
    <mapping-list>
	  <mapping anidbseason="0" tvdbseason="0">;1-6;</mapping>
      <mapping anidbseason="1" tvdbseason="0">;1-5;</mapping>
    </mapping-list>
</anime-list>

It seems to only map the Special 01 to s0e05 though, not to s0e06 as it should, and the main movie itself doesn’t seem to map at all, not sure where that is getting lost to.

For “Another” I have this custom xml in the directory:

<?xml version="1.0" encoding="utf-8"?>
<anime-list>
  <anime anidbid="8556" tvdbid="254349" defaulttvdbseason="1">
    <name>Another</name>
    <mapping-list>
      <mapping anidbseason="0" tvdbseason="0">;2-3;</mapping>
    </mapping-list>
  </anime>
</anime-list>

But it is mapping the Special 02 to s0e02 still and not s0e03 as it should.

Strike Witches and SAO both look like they are working correctly still and mapping with the custom xml, which is good. Logs did get genereated properly now with the latest code, so I’m attaching them all.

ZeroQI · December 27, 2016, 7:31am

@deusxanime it sees the “A Certain Magical Index - The Miracle of Endymion” as s01e01. Rename ‘Special 01’ en ‘S01’ ou ‘s00e01’. Same for the other serie. Will try to add support in scanner.

deusxanime · December 27, 2016, 1:15pm

@ZeroQI - I think I see part of the problem. It doesn’t seem to apply the custom xml to the specials located in the specials folder. Looking at the scanner log, I see a couple places this happens. For Another:

Scanner call - root: '/mnt/videos/anime', path: 'Another [anidb2-8556]', dirs: '1', files: '13'
-------------------------------------------------------------------------------------------------------------------------------------------------------------
file: '/mnt/videos/anime/Another [anidb2-8556]/anime-list-custom.xml', ext: 'xml' not in video_ext
Loading local custom mapping - url: '/mnt/videos/anime/anime-list-custom.xml'
anidbTvdbMapping() - anidb: '8556', tvbdid: '254349', defaulttvdbseason: '1', name: 'Another', mappingList: '{'s0e2': 's0e3', 'episodeoffset': None}'
-------------------------------------------------------------------------------------------------------------------------------------------------------------
"Another [tvdb-254349]" s0001e001 "Another - Ep 01 (BD 1280x720, JPN+ENG) [CBM] [35ED63AE].mkv" "(, Jpn+Eng)"
"Another [tvdb-254349]" s0001e002 "Another - Ep 02 (BD 1280x720, JPN+ENG) [CBM] [578A07B1].mkv" "(, Jpn+Eng)"
"Another [tvdb-254349]" s0001e003 "Another - Ep 03 (BD 1280x720, JPN+ENG) [CBM] [3B7F036F].mkv" "(, Jpn+Eng)"
"Another [tvdb-254349]" s0001e004 "Another - Ep 04 (BD 1280x720, JPN+ENG) [CBM] [339B8625].mkv" "(, Jpn+Eng)"
"Another [tvdb-254349]" s0001e005 "Another - Ep 05 (BD 1280x720, JPN+ENG) [CBM] [69F02E77].mkv" "(, Jpn+Eng)"
"Another [tvdb-254349]" s0001e006 "Another - Ep 06 (BD 1280x720, JPN+ENG) [CBM] [255CEF5F].mkv" "(, Jpn+Eng)"
"Another [tvdb-254349]" s0001e007 "Another - Ep 07 (BD 1280x720, JPN+ENG) [CBM] [C5623BC6].mkv" "(, Jpn+Eng)"
"Another [tvdb-254349]" s0001e008 "Another - Ep 08 (BD 1280x720, JPN+ENG) [CBM] [1312D980].mkv" "(, Jpn+Eng)"
"Another [tvdb-254349]" s0001e009 "Another - Ep 09 (BD 1280x720, JPN+ENG) [CBM] [F807C7B9].mkv" "(, Jpn+Eng)"
"Another [tvdb-254349]" s0001e010 "Another - Ep 10 (BD 1280x720, JPN+ENG) [CBM] [938CDAB9].mkv" "(, Jpn+Eng)"
"Another [tvdb-254349]" s0001e011 "Another - Ep 11 v2 (BD 1280x720, JPN+ENG) [CBM] [25795457].mkv" "(, Jpn+Eng)"
"Another [tvdb-254349]" s0001e012 "Another - Ep 12 (BD 1280x720, JPN+ENG) [CBM] [46D91E07].mkv" "(, Jpn+Eng)"

Scanner call - root: '/mnt/videos/anime', path: 'Another [anidb2-8556]/specials', dirs: '0', files: '1'
-------------------------------------------------------------------------------------------------------------------------------------------------------------
Use existing: '/tmp/ASS-tmp-anime-list-master.xml'
anidbTvdbMapping() - anidb: '8556', tvbdid: '254349', defaulttvdbseason: '1', name: 'Another', mappingList: '{'episodeoffset': ''}'
-------------------------------------------------------------------------------------------------------------------------------------------------------------
"Another [tvdb-254349]" s0000e002 "Another - Special 02 - Flash Animation (BD 1280x720) [CBM] [012551F0].mkv" "7" "Flash Animation"

And for Sound! Euphonium S1

Scanner call - root: '/mnt/videos/anime', path: 'Sound! Euphonium [anidb2-10889]', dirs: '1', files: '14'
-------------------------------------------------------------------------------------------------------------------------------------------------------------
file: '/mnt/videos/anime/Sound! Euphonium [anidb2-10889]/anime-list-custom.xml', ext: 'xml' not in video_ext
Loading local custom mapping - url: '/mnt/videos/anime/anime-list-custom.xml'
anidbTvdbMapping() - anidb: '10889', tvbdid: '289884', defaulttvdbseason: '1', name: 'Hibike! Euphonium', mappingList: '{'s0e8': 's0e7', 's0e6': 's0e5', 's0e7': 's0e6', 's0e4': 's0e3', 's0e5': 's0e4', 's0e2': 's0e1', 's0e3': 's0e2', 's0e1': 's0e8', 'episodeoffset': None}'
-------------------------------------------------------------------------------------------------------------------------------------------------------------
"Sound! Euphonium [tvdb-289884]" s0001e001 "Sound! Euphonium - Ep 01 (BD 1280x720 Hi10P) [FFF] [E2A58F25].mkv"
"Sound! Euphonium [tvdb-289884]" s0001e002 "Sound! Euphonium - Ep 02 (BD 1280x720 Hi10P) [FFF] [537FA6EC].mkv"
"Sound! Euphonium [tvdb-289884]" s0001e003 "Sound! Euphonium - Ep 03 (BD 1280x720 Hi10P) [FFF] [B7EA41E3].mkv"
"Sound! Euphonium [tvdb-289884]" s0001e004 "Sound! Euphonium - Ep 04 (BD 1280x720 Hi10P) [FFF] [0E3431A4].mkv"
"Sound! Euphonium [tvdb-289884]" s0001e005 "Sound! Euphonium - Ep 05 (BD 1280x720 Hi10P) [FFF] [EA161304].mkv"
"Sound! Euphonium [tvdb-289884]" s0001e006 "Sound! Euphonium - Ep 06 (BD 1280x720 Hi10P) [FFF] [74881146].mkv"
"Sound! Euphonium [tvdb-289884]" s0001e007 "Sound! Euphonium - Ep 07 (BD 1280x720 Hi10P) [FFF] [F0EA3210].mkv"
"Sound! Euphonium [tvdb-289884]" s0001e008 "Sound! Euphonium - Ep 08 (BD 1280x720 Hi10P) [FFF] [0594B295].mkv"
"Sound! Euphonium [tvdb-289884]" s0001e009 "Sound! Euphonium - Ep 09 (BD 1280x720) [FFF] [3A46D94F].mkv"
"Sound! Euphonium [tvdb-289884]" s0001e010 "Sound! Euphonium - Ep 10 (BD 1280x720) [FFF] [B9D6DAA3].mkv"
"Sound! Euphonium [tvdb-289884]" s0001e011 "Sound! Euphonium - Ep 11 (BD 1280x720 Hi10P) [FFF] [7CFDF245].mkv"
"Sound! Euphonium [tvdb-289884]" s0001e012 "Sound! Euphonium - Ep 12 (BD 1280x720 Hi10P) [FFF] [4BFB6690].mkv"
"Sound! Euphonium [tvdb-289884]" s0001e013 "Sound! Euphonium - Ep 13 (BD 1280x720 Hi10P) [FFF] [C7044438].mkv"

Scanner call - root: '/mnt/videos/anime', path: 'Sound! Euphonium [anidb2-10889]/specials', dirs: '0', files: '8'
-------------------------------------------------------------------------------------------------------------------------------------------------------------
Use existing: '/tmp/ASS-tmp-anime-list-master.xml'
anidbTvdbMapping() - anidb: '10889', tvbdid: '289884', defaulttvdbseason: '1', name: 'Hibike! Euphonium', mappingList: '{'episodeoffset': ''}'
-------------------------------------------------------------------------------------------------------------------------------------------------------------
"Sound! Euphonium [tvdb-289884]" s0000e001 "Sound! Euphonium - Special 01 [Ep 14 OVA] - Ready, Set, Monaka (BD 1280x720) [Waku] [6DBAB735].mkv" "7" "Ready, Set, Monaka"
"Sound! Euphonium [tvdb-289884]" s0000e002 "Sound! Euphonium - Special 02 - The Everyday Life of Band 1 (BD 1280x720 Hi10P) [FFF] [444B00EC].mkv" "7" "The Everyday Life of Band 1"
"Sound! Euphonium [tvdb-289884]" s0000e003 "Sound! Euphonium - Special 03 - The Everyday Life of Band 2 (BD 1280x720 Hi10P) [FFF] [B71B6CD1].mkv" "7" "The Everyday Life of Band 2"
"Sound! Euphonium [tvdb-289884]" s0000e004 "Sound! Euphonium - Special 04 - The Everyday Life of Band 3 (BD 1280x720 Hi10P) [FFF] [C472400A].mkv" "7" "The Everyday Life of Band 3"
"Sound! Euphonium [tvdb-289884]" s0000e005 "Sound! Euphonium - Special 05 - The Everyday Life of Band 4 (BD 1280x720 Hi10P) [FFF] [164247B9].mkv" "7" "The Everyday Life of Band 4"
"Sound! Euphonium [tvdb-289884]" s0000e006 "Sound! Euphonium - Special 06 - The Everyday Life of Band 5 (BD 1280x720) [FFF] [9F26A0C9].mkv" "7" "The Everyday Life of Band 5"
"Sound! Euphonium [tvdb-289884]" s0000e007 "Sound! Euphonium - Special 07 - The Everyday Life of Band 6 (BD 1280x720 Hi10P) [FFF] [FD5410C4].mkv" "7" "The Everyday Life of Band 6"
"Sound! Euphonium [tvdb-289884]" s0000e008 "Sound! Euphonium - Special 08 - The Everyday Life of Band 7 (BD 1280x720 Hi10P) [FFF] [90DAB6E6].mkv" "7" "The Everyday Life of Band 7"

As you can see for both of those, it loads the custom xml mapping file for the main series, but seems to skip/miss it for the specials folder and just use the main /tmp xml, which causes it not to use the custom mappings.

For the Index movie I’m still having some trouble. I believe I figured out why it was treating the special as the main movie episode. It was previously named “A Certain Magical Index - The Miracle of Endymion - Special 01 - Index-tan The Movie (BD 1280x720 Hi10P) [UTW & Mazui] [A26D6D00].mkv” and I think it was picking up the “Movie” word and thus thinking it was the main movie. After removing that and just changing the name to “A Certain Magical Index - The Miracle of Endymion - Special 01 - Index-tan (BD 1280x720 Hi10P) [UTW & Mazui] [A26D6D00].mkv” it is now properly treating it as a special. But it is still running into 2 problems - it is not using the custom mapping xml again in the specials directory, so it just sets it now as s0e01 and not s0e06 as it should, and it is still for some reason completely dropping the main movie file for reasons I can’t figure out. Here is the scanner log and you can see there is no mention of the main movie file “A Certain Magical Index - The Miracle of Endymion 01 (BD 1280x720 Hi10P, AAC 6ch) [UTW & Mazui] [D77968AE].mkv” in there:

Scanner call - root: '/mnt/videos/anime', path: 'A Certain Magical Index - The Miracle of Endymion [anidb2-8694]', dirs: '1', files: '2'
-------------------------------------------------------------------------------------------------------------------------------------------------------------
file: '/mnt/videos/anime/A Certain Magical Index - The Miracle of Endymion [anidb2-8694]/anime-list-custom.xml', ext: 'xml' not in video_ext
Scanner call - root: '/mnt/videos/anime', path: 'A Certain Magical Index - The Miracle of Endymion [anidb2-8694]/specials', dirs: '0', files: '1'
-------------------------------------------------------------------------------------------------------------------------------------------------------------
Use existing: '/tmp/ASS-tmp-anime-list-master.xml'
anidbTvdbMapping() - anidb: '8694', tvbdid: '83322', defaulttvdbseason: '0', name: 'Gekijouban Toaru Majutsu no Index: Endymion no Kiseki', mappingList: '{'s1e1': 's0e5', 'episodeoffset': ''}'
-------------------------------------------------------------------------------------------------------------------------------------------------------------
"A Certain Magical Index - The Miracle of Endymion [tvdb-83322]" s0000e001 "A Certain Magical Index - The Miracle of Endymion - Special 01 - Index-tan (BD 1280x720 Hi10P) [UTW & Mazui] [A26D6D00].mkv" "7" "Index-tan"

Here’s the custom xml mapping for it again, in case you want to see:

<?xml version="1.0" encoding="utf-8"?>
<anime-list>
  <anime anidbid="8694" tvdbid="83322" defaulttvdbseason="0" imdbid="unknown">
    <name>Gekijouban Toaru Majutsu no Index: Endymion no Kiseki</name>
    <mapping-list>
	  <mapping anidbseason="0" tvdbseason="0">;1-6;</mapping>
      <mapping anidbseason="1" tvdbseason="0">;1-5;</mapping>
    </mapping-list>
</anime-list>

ZeroQI · December 27, 2016, 5:38pm

@deusxanime added fix to search for custom mapping in parrent folders

github.com

ZeroQI/Absolute-Series-Scanner/blob/master/Scanners/Series/Absolute Series Scanner.py

# -*- coding: utf-8 -*-

###### library  ########################################################### Functions, Constants #####
import sys                                                           # getdefaultencoding, getfilesystemencoding, platform, argv
import os                                                            # path, listdir
import tempfile                                                      # NamedTemporaryFile
import time                                                          # strftime
import datetime                                                      # datetime
import re                                                            # match, compile, sub
import fnmatch                                                       # translate
import logging, logging.handlers                                     # FileHandler, Formatter, getLogger, DEBUG | RotatingFileHandler
import Utils                                                         # SplitPath
import Media                                                         # Episode
import VideoFiles                                                    # Scan
import Stack                                                         # Scan
import inspect                                                       # getfile, currentframe
import ssl                                                           # SSLContext
import zipfile                                                       # ZipFile, namelist
import json                                                          # loads
from lxml import etree                                               # fromstring

This file has been truncated. show original

Both works after recreating library since anidb2 title wasn’t ammended to tvdb

deusxanime · December 27, 2016, 8:02pm

@ZeroQI - something broken in latest master. I updated ASS to latest github master, deleted library, and recreated. It almost immediately stops, library is empty, and no ASS or HAMA logs generated.

ZeroQI · December 27, 2016, 8:32pm

@deusxanime pasted hama code into ass github page…
updated, please update the scanner

deusxanime · December 27, 2016, 10:07pm

@ZeroQI - Updated ASS py to latest github code and working again. =)

Specials that use custom xml do seem to be working now! Checked SW, SAO, Sound! Euphonium, Another and seem to be good.

Only thing that seems to be an issue still is that “A Certain Magical Index - The Miracle of Endymion” both the movie and special now are just getting completely lost/dropped. Here’s what I see in the scanner log for it:

Scanner call - root: '/mnt/videos/anime', path: 'A Certain Magical Index - The Miracle of Endymion [anidb2-8694]', dirs: '1', files: '2'
-------------------------------------------------------------------------------------------------------------------------------------------------------------
file: '/mnt/videos/anime/A Certain Magical Index - The Miracle of Endymion [anidb2-8694]/anime-list-custom.xml', ext: 'xml' not in video_ext
Scanner call - root: '/mnt/videos/anime', path: 'A Certain Magical Index - The Miracle of Endymion [anidb2-8694]/specials', dirs: '0', files: '1'
-------------------------------------------------------------------------------------------------------------------------------------------------------------

As you can see, it doesn’t even list either of the mkv files in that directory. The files do show up in the filelist though, so not sure what is causing them to be skipped. Attaching new logs/filelist.

edit: The only thing different about those files I can think of is that they have pretty long filenames. There isn’t a character limit that would cause some issue in the code is there? Too long of a name for a variable causing issue?

ZeroQI · December 27, 2016, 10:58pm

@deusxanime thanks for your assistance. it gets better at last.
Re-created your library with dummy files from the filelist and same happens… somewhere in the code it doesn’t reach through.
Recreqted few times the librqry, getting close

Edit: culprit is
with open(scudlee_filename_custom, 'r') as scudlee_file: scudlee_mapping_content = etree.fromstring( scudlee_file.read() )

cause this error in Plex Media Scanner.log:
Dec 27, 2016 23:17:56.112 [0xf3fab780] ERROR - Error in Python: Running scanner:
Traceback (most recent call last):
File “/volume1/Plex/Library/Application Support/Plex Media Server/Scanners/Series/Absolute Series Scanner.py”, line 400, in Scan
with open(scudlee_filename_custom, ‘r’) as scudlee_file: scudlee_mapping_content = etree.fromstring( scudlee_file.read() )
File “lxml.etree.pyx”, line 2743, in lxml.etree.fromstring (src/lxml/lxml.etree.c:52665)
File “parser.pxi”, line 1573, in lxml.etree._parseMemoryDocument (src/lxml/lxml.etree.c:79932)
File “parser.pxi”, line 1452, in lxml.etree._parseDoc (src/lxml/lxml.etree.c:78774)
File “parser.pxi”, line 960, in lxml.etree._BaseParser._parseDoc (src/lxml/lxml.etree.c:75389)
File “parser.pxi”, line 564, in lxml.etree._ParserContext._handleParseResultDoc (src/lxml/lxml.etree.c:71739)
File “parser.pxi”, line 645, in lxml.etree._handleParseResult (src/lxml/lxml.etree.c:72614)
File “parser.pxi”, line 596, in lxml.etree._raiseParseError (src/lxml/lxml.etree.c:72123)
XMLSyntaxError: None

Seem like your mapping file is invalid or empty as it’s what caused it for me…
Please update to https://github.com/ZeroQI/Absolute-Series-Scanner/blob/master/Scanners/Series/Absolute%20Series%20Scanner.py and let me know if all works as expected

Once the scanner works will make sure the agent can catch all meta properly and rest

deusxanime · December 28, 2016, 3:45am

@ZeroQI - It is now finding the files again, but as you said it doesn’t seem to like my custom xml file and thus instead falls back on the scudlee xml. This means the movie gets mapped to s0e05 and since the special doesn’t have an entry in the scudlee xml it just goes to s0e01.

Scanner call - root: '/mnt/videos/anime', path: 'A Certain Magical Index - The Miracle of Endymion [anidb2-8694]', dirs: '1', files: '2'
-------------------------------------------------------------------------------------------------------------------------------------------------------------
file: '/mnt/videos/anime/A Certain Magical Index - The Miracle of Endymion [anidb2-8694]/anime-list-custom.xml', ext: 'xml' not in video_ext
Invalid custom mapping file content
Use existing: '/tmp/ASS-tmp-anime-list-master.xml'
anidbTvdbMapping() - anidb: '8694', tvbdid: '83322', defaulttvdbseason: '0', name: 'Gekijouban Toaru Majutsu no Index: Endymion no Kiseki', mappingList: '{'s1e1': 's0e5', 'episodeoffset': ''}'
-------------------------------------------------------------------------------------------------------------------------------------------------------------
"A Certain Magical Index - The Miracle of Endymion [tvdb-83322]" s0000e005 (Orig: s01e01) "A Certain Magical Index - The Miracle of Endymion 01 (BD 1280x720 Hi10P, AAC 6ch) [UTW & Mazui] [D77968AE].mkv" "(, 6Ch)"

Scanner call - root: '/mnt/videos/anime', path: 'A Certain Magical Index - The Miracle of Endymion [anidb2-8694]/specials', dirs: '0', files: '1'
-------------------------------------------------------------------------------------------------------------------------------------------------------------
Invalid custom mapping file content
Use existing: '/tmp/ASS-tmp-anime-list-master.xml'
anidbTvdbMapping() - anidb: '8694', tvbdid: '83322', defaulttvdbseason: '0', name: 'Gekijouban Toaru Majutsu no Index: Endymion no Kiseki', mappingList: '{'s1e1': 's0e5', 'episodeoffset': ''}'
-------------------------------------------------------------------------------------------------------------------------------------------------------------
"A Certain Magical Index - The Miracle of Endymion [tvdb-83322]" s0000e001 "A Certain Magical Index - The Miracle of Endymion - Special 01 - Index-tan (BD 1280x720 Hi10P) [UTW & Mazui] [A26D6D00].mkv" "7" "Index-tan"

I’ve gone over my custom xml for that and cannot figure out what is wrong. The thing that jumps out at me about it that is different from others I’ve used is that it uses 2 “mapping” tags, one for anidb s0 and s1 separately. I’ve seen that used in scudlee so I assumed that was supported, but just to verify, can ASS handle that?

Attaching my custom xml for that, maybe the file will give you more info than just pasting the contents like normal.

edit: Nevermind, it was totally a typo! Sorry was missing the closing </anime> tag. I don’t know how long I looked at it and didn’t notice… ugh. Anyway things are looking pretty good from here at this point. Was there anything else we needed to test? Otherwise I can start adding some more series and see if I run into any other problems as I go.

ZeroQI · December 28, 2016, 8:11am

@deusxanime I like the fact you put relevant informatioon to solve the issue without me asking specifically. I found the error:
“/anime” tag is missing before “/anime-list”

Edit. seem like you found before i posted the reply…

I might add DingMatt custom mappings http://rawgit.com/Dingmatt/AMSA/master/Plug-in%20Support/Data/com.plexapp.agents.amsa/DataItems/anime-list-corrections.xml under the vqriable ANIDB_TVDB_MAPPING_MOD to be handled.

What is your opinion on that knowinf ScudLee has unfortunately been inactive for 2 months?

deusxanime · December 28, 2016, 2:03pm

@ZeroQI - It looks like that is the same idea, supplementing the ScudLee list with corrections. How would you handle it if you included the DingMatt list? Would you still allow local override as well? So would it check local > DingMatt > Scudlee for mappings?

If you do that I think it could be a good idea, but would hate to lose the local custom mappings since we put work into it and always nice to have the option of local file in case something happens with DingMatt sometime in the future. Also, I can immediately fix my local files and keep going with sorting, whereas a github list I still have to wait for corrections to get pushed to master before they would affect my library (and even then I’d have to recreate my library or Plex dance to pick up future corrections, right?).

ZeroQI · December 28, 2016, 2:12pm

@deusxanime Exactly, local, Dingmatt, then scudlee.
yes, the scanner is not meant to rerun for the folder if nothing changed in it, and that male the developpment a pain since you need to recreate the library at any change that change the ep mapping…

I could see with Dingmatt and host the file like the tvdb4 mappings and put him you as collaborators or do the same on his github…

deusxanime · December 28, 2016, 3:09pm

@ZeroQI - I saw quite a bit of activity on the HAMA threads and you were doing some fixes for them. To be safe and test I updated to latest ASS and HAMA github masters and still working well on my CentOS Plex box! Do you not have a way to test on Windows? If you think it would be helpful, I could setup a cloud Windows box for you to test on (heck even a linux box too if you think it would help). I have a lot of unused cloud space which I’d be fine with “donating” for you to use for a while. It is at Cloud At Cost, which isn’t terribly stable or fast, but might be better than nothing. =)

Looking through my series though reminded me of the other bug I had… Still don’t seem to be picking up individual season posters, they all just use the same poster as series. Example with SAO:

Not a huge deal, but it is kind of nice to have different artwork for them, especially since with anime mapping to TVDB you don’t know the series name always and the artwork can help remind you which season is which series. I swear that used to load different artwork for each season - it should correct? Any idea what might cause it? I tried fixing a while back if you remember by completely deleting all my HAMA directories and starting from scratch, but it still doesn’t seem to work.

Also, I don’t think this is a bug, but more a limitation due to odd name, but Occultic;Nine doesn’t match initially because the semi-colon in the name, even with [anidb-xxxx] tagging. Previously I’ve tried to removed the “;” and then it matches automatically. No big deal to manual match on it and the couple other series that use “;” in the name, but if easy to parse/sanitize name and fix that would be cool. If you think it could introduce more bugs than it is worth, I’m totally OK skipping it.

Back to DingMatt custom list, was thinking of asking about being contributor on it then I could just update directly. =) Help updates faster and help others who use anidb2-xxxx mapping! If you and DingMatt are OK with it, I could update it directly as I work on loading my anime into Plex. Would also help me learn to use github which I’ve been meaning to do.

ZeroQI · December 28, 2016, 3:38pm

@deusxanime No need for windows server. i only used path to load the custom xml and forgot about backslash in windows path and forgot to escape it.

Yes it posters+ep screencap used to work but is i believe a plex bug:

PMS 1.2.7 not affected according https://www.reddit.com/r/PleX/comments/5inl7g/psa_plex_server_v133_metadata_is_still_broken_for/

Can you test scanner+agent on 1.2.7 and we correct all bugs on this until fixed on PMS 1.3.3 ?

now steins;gate use to work with semicolon so will make this work again

Please ask to be contributor. will take some time adding support as i don’t want the same agent debacle again…

deusxanime · December 28, 2016, 4:50pm

@ZeroQI - Thanks, I think you pointed out that bug to me a while back, but I had forgotten since we’ve done so much in the mean time… Since my Plex server is a VM, I’ll take a snapshot of it and then roll it back to 1.2.7 and see if that fixes it, just to confirm.

No big deal on the semi-colon issue. If you think you can fix it easily that is cool, but as I said we’ve come so far to get it stable that I hate to introduce bugs over such a minor issue.

deusxanime · December 28, 2016, 5:53pm

@ZeroQI - I rolled back to Plex v1.2.7 and can confirm season artwork is now loading again.

One thing that came back up though, that I had forgotten about as it hasn’t been an issue for a while, is that I had to do the Unmatch, then re-Match, dance to get some series to merge. As you can see a bunch of them (ex: Chi’s Sweet Home, Nanoha, Show By Rock, etc) show up as 2 different series until I do that.

Other than that, at least we can confirm the season artwork not loading is a bug in the newer versions of Plex, now just waiting for them to fix it… I’m guessing even once they fix it, it will take having to recreate the library from scratch to get it to populate them correctly?

deusxanime · December 28, 2016, 6:13pm

One other thing I noticed as I was about to shutdown my v1.2.7 test and delete the snapshot, but Strike Witches seems to have just lost/dropped S2 for some reason.

And this wasn’t just it not merging correctly, there was no other “Strike Witches” series listed in the library.

I don’t know what the differences between Plex versions is and how that would affect Plex/HAMA, but just in case you wanted to look I grabbed the logs from it before deleting snapshot and going back to v1.3.3. Sorry I didn’t clean them out before starting so they probably have some old stuff in there as well, didn’t think I’d need them when I started this.

ZeroQI · December 28, 2016, 6:37pm

Logs look as they should.
The only thing i could do to avoid that is for anidb2 to give the same title, just the force id and maybe it would detect as the same serie better…
Please test on PMS 1.2.7 the below and recreate the library:

github.com

ZeroQI/Absolute-Series-Scanner/blob/ed576152f0b9b14e5aa39ee7ffdbd885cfa4c6e4/Scanners/Series/Absolute Series Scanner.py

# -*- coding: utf-8 -*-
### Python library  ####### Functions and structures ###  #import Stack, VideoFiles, fnmatch ### Plex Media Server\Plug-ins\Scanners.bundle\Contents\Resources\Common ###
import sys                                              # getdefaultencoding, getfilesystemencoding, platform
import os                                               # path, listdir
import tempfile                                         # NamedTemporaryFile
import time                                             # strftime
import re                                               # match, compile, sub
import unicodedata                                      # normalize
from lxml import etree                                  # fromstring
import Utils                                            # SplitPath
import Media                                            # Episode
import Stack                                            # Scan
import logging, logging.handlers                        #
try:                 from urllib.request import urlopen # urlopen Python 3.0 and later
except ImportError:  from urllib2        import urlopen # urlopen Python 2.x #import urllib2 # urlopen

### Log variables, regex, skipped folders, words to remove, character maps ###  ### http://www.zytrax.com/tech/web/regex.htm  # http://regex101.com/#python
TVDB_HTTP_API_URL         = 'http://thetvdb.com/api/A27AD9BE0DA63333/series/%s/all/en.xml'
ASS_MAPPING_URL           = 'http://rawgit.com/ZeroQI/Absolute-Series-Scanner/master/tvdb4.mapping.xml'
ANIDB_TVDB_MAPPING        = 'http://rawgit.com/ScudLee/anime-lists/master/anime-list-master.xml'

This file has been truncated. show original

deusxanime · December 28, 2016, 7:54pm

@ZeroQI - It is still not merging all series on Plex v1.2.7. This time it didn’t completely merge A Certain Scientific Railgun or Nanoha (which as you can see is showing up as 3 series after initial scan), along with a couple others. The Unmatch/re-Match dance merges them though, as expected.

It did at least find all of SW this time it looks like though, no S2 missing.

I’m not too worried about it as I won’t be sticking with that version, but I guess up to you how much you want to troubleshoot it. I’ll be keeping mine up to date and hopefully they’ll fix the season artwork bug in v1.3.4+. Do you want me to do any other testing on v1.2.7? I don’t want to keep it here too long because if people watch stuff on my Plex server while I have it like this, they’ll lose any watch status when I delete the snapshot and revert my VM back.

I did remember to delete my logs this time before recreating the library, so they should be cleaner for you this time.

ZeroQI · December 28, 2016, 8:16pm

That’s ok lets get rid of it if you have logs as it’s all i needed.
Thanks for testing

Topic		Replies	Views
Series Better ABsolute Scanner (S - BABS) Dev/API Corner scanner-agent-dev	68	3027	December 21, 2019
Better ABsolute Scanner (BABS) Dev/API Corner scanner-agent-dev	67	24022	December 20, 2019
Custom Plex Scanners Français - French	23	1045	December 20, 2019
[Rel] HTTP Anidb Metadata Agent (HAMA) Dev/API Corner scanner-agent-dev	2122	71305	July 28, 2023
[REL] Extended Personal Media Scanner Dev/API Corner scanner-agent-dev	77	14517	December 21, 2019

Absolute Series Scanner (for anime mainly)

Related topics