Plex Dashboard is Empty

Thank you very much for the effort in capturing the diagnostics

I have been looking at the logs and the attempt to capture the xml responses. I am concerned about the following being returned for the reqs 6, 8 & 9 in the list above

This page contains the following errors:
error on line 239 at column 304: xmlParseCharRef: invalid xmlChar value 65535
Below is a rendering of the page up to the first error.

Req 6
http://localhost:32400/hubs/home/recentlyAdded?type=8&X-Plex-Token=xxxxxxxxxxxxxxxxxxxxxxxx
Req 8
http://localhost:32400/hubs?excludeFields=summary&count=12&includeEmpty=1&includeFeaturedTags=1&excludePlaylists=1&X-Plex-Token=xxxxxxxxxxxxxxxxxxxxxxxx
Req 9
http://localhost:32400/hubs?excludeFields=summary&count=12&includeEmpty=1&includeFeaturedTags=1&excludePlaylists=1&onlyTransient=1&X-Plex-Token=xxxxxxxxxxxxxxxxxxxxxxxx

will have to try these with curl.exe (from https://curl.haxx.se/download.html)

Should be easier with curl.exe

Need to download the curl package and extract the curl.exe from the bin folder in the downloaded zip
Download page https://curl.haxx.se/download.html
Go for Win64 - Generic downloads
Two potential downloads to pick from
Win64 x86_64 zip and Win64 x86_64 7zip
I tried both and for some reason the first has no bin folder
So download the 7zip version which downloads curl-7.58.0-win64-mingw.7z
If you do not have 7zip - you can get it from http://7-zip.org/download.html

Unzip the file Win64 x86_64 7zip
Locate the bin folder and from it copy out curl.exe to the directory you are going to work in
lets say you are going to work in directory c:\users\xxxx\downloads
So copy out curl.exe to the downloads folder
Open command window - start / run / cmd.exe and in that window, type in
cd c:\users\xxxxxx\downloads
and then we can run curl.exe commands
picking up 6, 8 and 9
The syntax would be

curl.exe "http://localhost:32400/hubs/home/recentlyAdded?type=8&X-Plex-Token=xxxxxxxxxxxxxxxxxxxxxxxx" > req6b.txt
curl.exe "http://localhost:32400/hubs?excludeFields=summary&count=12&includeEmpty=1&includeFeaturedTags=1&excludePlaylists=1&X-Plex-Token=xxxxxxxxxxxxxxxxxxxxxxxx" > req8b.txt
curl.exe "http://localhost:32400/hubs?excludeFields=summary&count=12&includeEmpty=1&includeFeaturedTags=1&excludePlaylists=1&onlyTransient=1&X-Plex-Token=xxxxxxxxxxxxxxxxxxxxxxxx" > req9b.txt

Running these one at a time and the output will be in the file name we specify at the end of each line
To copy to a windows command line window, select the above command text and copy, then in the window, click in top left corner and select edit and paste
Once you get one to work, the rest would be easy

So we do the requests in command line window using curl and sending the output to file using > filename.txt syntax

I may need you to send me copy of the database - before and after - lets hold fire on that for now and just we try and get the xml and logs

when you are restoring the database from a backup, are you making sure:

  • Plex Media Server is shutdown and no processes running, and
  • these are deleted com.plexapp.plugins.library.db-wal and com.plexapp.plugins.library.db-shm

https://support.plex.tv/articles/202485658-restore-a-database-backed-up-via-scheduled-tasks/

@sa2000 said:
when you are restoring the database from a backup, are you making sure:

  • Plex Media Server is shutdown and no processes running, and
  • these are deleted com.plexapp.plugins.library.db-wal and com.plexapp.plugins.library.db-shm

https://support.plex.tv/articles/202485658-restore-a-database-backed-up-via-scheduled-tasks/

Correct.
That is the procedure i use.
I’m assuming right clicking the Plex in the system tray and exiting shuts down “all” of it’s processes.
I do delete the 2 files you mention, just prior to starting the database repair.
What about the “com.plexapp.plugins.library.blobs.db” file?
I “think” i have been deleting it - but it immediately recreates it. Dont ask why - i though the primary .db file was the only one you keep. And if i was supposed to keep it - how do i go back? i still have the one from Jan 28

@Burninator_237 said:

@sa2000 said:
when you are restoring the database from a backup, are you making sure:

  • Plex Media Server is shutdown and no processes running, and
  • these are deleted com.plexapp.plugins.library.db-wal and com.plexapp.plugins.library.db-shm

https://support.plex.tv/articles/202485658-restore-a-database-backed-up-via-scheduled-tasks/

Correct.
That is the procedure i use.
I’m assuming right clicking the Plex in the system tray and exiting shuts down “all” of it’s processes.
I do delete the 2 files you mention, just prior to starting the database repair.
What about the “com.plexapp.plugins.library.blobs.db” file?
I “think” i have been deleting it - but it immediately recreates it. Dont ask why - i though the primary .db file was the only one you keep. And if i was supposed to keep it - how do i go back? i still have the one from Jan 28

The blobs database is a new database for other purposes and it does get recreated

@sa2000 said:

@Burninator_237 said:

@sa2000 said:
when you are restoring the database from a backup, are you making sure:

  • Plex Media Server is shutdown and no processes running, and
  • these are deleted com.plexapp.plugins.library.db-wal and com.plexapp.plugins.library.db-shm

https://support.plex.tv/articles/202485658-restore-a-database-backed-up-via-scheduled-tasks/

Correct.
That is the procedure i use.
I’m assuming right clicking the Plex in the system tray and exiting shuts down “all” of it’s processes.
I do delete the 2 files you mention, just prior to starting the database repair.
What about the “com.plexapp.plugins.library.blobs.db” file?
I “think” i have been deleting it - but it immediately recreates it. Dont ask why - i though the primary .db file was the only one you keep. And if i was supposed to keep it - how do i go back? i still have the one from Jan 28

The blobs database is a new database for other purposes and it does get recreated

So deleting the blobs database was oK?
I am using SQlite3.exe version 3.22.0.0
Does the version of this have any effect?

@Burninator_237 said:

@sa2000 said:

@Burninator_237 said:

@sa2000 said:
when you are restoring the database from a backup, are you making sure:

  • Plex Media Server is shutdown and no processes running, and
  • these are deleted com.plexapp.plugins.library.db-wal and com.plexapp.plugins.library.db-shm

https://support.plex.tv/articles/202485658-restore-a-database-backed-up-via-scheduled-tasks/

Correct.
That is the procedure i use.
I’m assuming right clicking the Plex in the system tray and exiting shuts down “all” of it’s processes.
I do delete the 2 files you mention, just prior to starting the database repair.
What about the “com.plexapp.plugins.library.blobs.db” file?
I “think” i have been deleting it - but it immediately recreates it. Dont ask why - i though the primary .db file was the only one you keep. And if i was supposed to keep it - how do i go back? i still have the one from Jan 28

The blobs database is a new database for other purposes and it does get recreated

So deleting the blobs database was oK?
I am using SQlite3.exe version 3.22.0.0
Does the version of this have any effect?

yes should be ok - it did get recreated

SQLite3 version 3.22.0.0 is the current version so should be ok

I am not really sure as to why you are using sqlite3 to repair the database. There is no indication of any integrity check failures and if you want to restore the database from a backup - you can do that without sqlite3 by moving files around and renaming

@sa2000 said:

@Burninator_237 said:

@sa2000 said:

@Burninator_237 said:

@sa2000 said:
when you are restoring the database from a backup, are you making sure:

  • Plex Media Server is shutdown and no processes running, and
  • these are deleted com.plexapp.plugins.library.db-wal and com.plexapp.plugins.library.db-shm

https://support.plex.tv/articles/202485658-restore-a-database-backed-up-via-scheduled-tasks/

Correct.
That is the procedure i use.
I’m assuming right clicking the Plex in the system tray and exiting shuts down “all” of it’s processes.
I do delete the 2 files you mention, just prior to starting the database repair.
What about the “com.plexapp.plugins.library.blobs.db” file?
I “think” i have been deleting it - but it immediately recreates it. Dont ask why - i though the primary .db file was the only one you keep. And if i was supposed to keep it - how do i go back? i still have the one from Jan 28

The blobs database is a new database for other purposes and it does get recreated

So deleting the blobs database was oK?
I am using SQlite3.exe version 3.22.0.0
Does the version of this have any effect?

yes should be ok - it did get recreated

SQLite3 version 3.22.0.0 is the current version so should be ok

I am not really sure as to why you are using sqlite3 to repair the database. There is no indication of any integrity check failures and if you want to restore the database from a backup - you can do that without sqlite3 by moving files around and renaming

I’m using sqlite3 to ensure there is no corruption. It’s a habit i’ve acquired over the years. In the line of work i used to be in, people loved to say “database corruption” as the catch all to every issue. I just got used to rebuilding as a method of rejecting the claim. No offense intended.

If i simply copy and rename, i have to delete com.plexapp.plugins.library.db-wal and com.plexapp.plugins.library.db-shm.
Do i delete the com.plexapp.plugins.library.blobs.db file as well, or leave it, or copy the orignal that is with the Jan 28 database when i move that datbase in?

Are we any closer to a solution or do you need more time or more tests done?

@Burninator_237 said:
Are we any closer to a solution or do you need more time or more tests done?

I am not. I am waiting for the curl output text files to replace the browser ones that did not return the xml. Hope it is straightforward. I did not see all the actual xml when the dashboard was empty

See my earlier post
http://forums.plex.tv/discussion/comment/1612541/#Comment_1612541

@Burninator_237 said:

@sa2000 said:

@Burninator_237 said:

@sa2000 said:

@Burninator_237 said:

@sa2000 said:
when you are restoring the database from a backup, are you making sure:

  • Plex Media Server is shutdown and no processes running, and
  • these are deleted com.plexapp.plugins.library.db-wal and com.plexapp.plugins.library.db-shm

https://support.plex.tv/articles/202485658-restore-a-database-backed-up-via-scheduled-tasks/

Correct.
That is the procedure i use.
I’m assuming right clicking the Plex in the system tray and exiting shuts down “all” of it’s processes.
I do delete the 2 files you mention, just prior to starting the database repair.
What about the “com.plexapp.plugins.library.blobs.db” file?
I “think” i have been deleting it - but it immediately recreates it. Dont ask why - i though the primary .db file was the only one you keep. And if i was supposed to keep it - how do i go back? i still have the one from Jan 28

The blobs database is a new database for other purposes and it does get recreated

So deleting the blobs database was oK?
I am using SQlite3.exe version 3.22.0.0
Does the version of this have any effect?

yes should be ok - it did get recreated

SQLite3 version 3.22.0.0 is the current version so should be ok

I am not really sure as to why you are using sqlite3 to repair the database. There is no indication of any integrity check failures and if you want to restore the database from a backup - you can do that without sqlite3 by moving files around and renaming

I’m using sqlite3 to ensure there is no corruption. It’s a habit i’ve acquired over the years. In the line of work i used to be in, people loved to say “database corruption” as the catch all to every issue. I just got used to rebuilding as a method of rejecting the claim. No offense intended.

If i simply copy and rename, i have to delete com.plexapp.plugins.library.db-wal and com.plexapp.plugins.library.db-shm.
Do i delete the com.plexapp.plugins.library.blobs.db file as well, or leave it, or copy the orignal that is with the Jan 28 database when i move that datbase in?

The blobs database has the loudness audio deep analysis and does link to the main database - so i suppose it would make sense to keep them in step and restore both from the same day. Earlier I thought it was the EPG database - but that is a separate one

Ok. Thankyou.
Then i patiently wait for you to get back to me on what’s next.
Thanks for all the support thus far.

@Burninator_237 said:
Ok. Thankyou.
Then i patiently wait for you to get back to me on what’s next.
Thanks for all the support thus far.

I have already said what next. Basically the browser getting the xml did not work for some of the dashboard requests and we need to use curl.exe instead of the browser. So need to repeat the test - no need for all 9 just 3 out of the 9 and logs and screenshots taking immediately so that I can match the displayed time with log entries

See my earlier post
http://forums.plex.tv/discussion/comment/1612541/#Comment_1612541

Have a Look at the instructions and let me know if anything not clear - have a dummy run first

@sa2000 said:

@Burninator_237 said:
Ok. Thankyou.
Then i patiently wait for you to get back to me on what’s next.
Thanks for all the support thus far.

I have already said what next. Basically the browser getting the xml did not work for some of the dashboard requests and we need to use curl.exe instead of the browser. So need to repeat the test - no need for all 9 just 3 out of the 9 and logs and screenshots taking immediately so that I can match the displayed time with log entries

See my earlier post
http://forums.plex.tv/discussion/comment/1612541/#Comment_1612541

Have a Look at the instructions and let me know if anything not clear - have a dummy run first

Apologies for missing this… I will try to get to this on Sunday and post back or PM to you the zips as soon as i get it.
Your earlier mention of:
“See my earlier post
http://forums.plex.tv/discussion/comment/1612541/#Comment_1612541
I did not see an earlier post. It does not appear in my comment timeline for some reason.

@Burninator_237 Thank you for sending me the curl.exe output for the requests for the dashboard

The scan is picking new media files that were not in the database before and these for some reason have a lot of invalid character representation in the xml

Need to identify where these non standard are coming from - whether from filenames or mp3 tags
They are music tracks / albums

title="I and Love and You"
parentTitle="The Avett Brothersu爀"

I dont seem to be able to send up my database files - they are too large and over the limit of this board
However, i did notice the following after the library scan is completed

  1. The dashboard is still showing, but i havent logged out yet
  2. after the library scan, indeed some media files are added - Avett Brothers being the only new music files in the dashbaord
  3. even though avett brothers show in the dashboard, my music library says it’s empty
  4. after i log out and then back in, the dashboard is now empty. So is the music library. The other libraries are showing.
  5. Upon inspecting the metadata of the avett brothers tracks, there are erroneous characters in the tags

I have not yet tried resetting the system leaving the avett brothers out. But i will in the morning.

That’s it - it’s solved.
I deleted the music that was in question - the avett brothers - ran the optimization, clean bundles, empty trash - and now my music library are back and so is my dashboard.
Thank you for all your support!

Excellent news - wasn’t easy to find

Could you let me have one of these files please - one that had the characters I identified earlier

Done. PM’d it to you.
Thanks again.
Let me know if you need any more data.

@Burninator_237 said:
Done. PM’d it to you.
Thanks again.
Let me know if you need any more data.

Thank you - the issue has now been raised with the development team to see if the erroneous extended characters can be stripped

Plex Media Server beta release 1.12.0.4829 which has just been released is now resilient to corrupt tags / titles and will substitute a ? for any illegal character

See Release Note
http://forums.plex.tv/discussion/comment/1625060/#Comment_1625060

  • Avoid generating invalid XML when media contains invalid metadata (#8192).

This screenshot shows how the specific tracks would now show