Identify/metadata issues

[Khalew 0]

So for a numebr of weeks now I've been getting the same issues with movies. TV stuff is working fine. The background pickup for movies used to work just fine and was working on file name as far as I can tell as I have some movies grouped in folders and some not. I have tried manually using the dinetify option with IMDB or Movie DB ID and it just returns nothing. Here's the log

 

2020-05-01 22:13:20.692 Info HttpClient: GET https://api.themoviedb.org/3/find/tt7713068?api_key=f6bd687ffa63cd282b6ff2c6877f2669&external_source=imdb_id

2020-05-01 22:13:21.253 Info HttpServer: HTTP POST http://192.168.1.252:8096/emby/Sessions/Playing/Progress. UserAgent: Roku/DVP-9.20 (519.20E04806A)

2020-05-01 22:13:21.253 Info HttpServer: HTTP Response 204 to 192.168.1.234. Time: 0ms. http://192.168.1.252:8096/emby/Sessions/Playing/Progress

2020-05-01 22:13:31.861 Info HttpServer: HTTP POST http://192.168.1.252:8096/emby/Sessions/Playing/Progress. UserAgent: Roku/DVP-9.20 (519.20E04806A)

2020-05-01 22:13:31.877 Info HttpServer: HTTP Response 204 to 192.168.1.234. Time: 16ms. http://192.168.1.252:8096/emby/Sessions/Playing/Progress

2020-05-01 22:13:40.706 Error HttpClient: Connection to https://api.themoviedb.org/3/find/tt7713068?api_key=f6bd687ffa63cd282b6ff2c6877f2669&external_source=imdb_id timed out

2020-05-01 22:13:40.738 Error ProviderManager: Error searching

*** Error Report ***

Version: 4.4.2.0

Command line: C:\Users\Keir\AppData\Roaming\MediaBrowser-Server\system\EmbyServer.dll -noautorunwebapp

Operating system: Microsoft Windows NT 6.1.7601 Service Pack 1

64-Bit OS: True

64-Bit Process: True

User Interactive: True

Runtime: file:///C:/Users/Keir/AppData/Roaming/MediaBrowser-Server/system/System.Private.CoreLib.dll

System.Environment.Version: 3.1.3

Processor count: 4

Program data path: C:\Users\Keir\AppData\Roaming\MediaBrowser-Server

Application directory: C:\Users\Keir\AppData\Roaming\MediaBrowser-Server\system

MediaBrowser.Model.Net.HttpException: MediaBrowser.Model.Net.HttpException: Connection to https://api.themoviedb.org/3/find/tt7713068?api_key=f6bd687ffa63cd282b6ff2c6877f2669&external_source=imdb_id timed out

---> System.Threading.Tasks.TaskCanceledException: The operation was canceled.

   at System.Net.Http.ConnectHelper.ConnectAsync(String host, Int32 port, CancellationToken cancellationToken)

   at System.Net.Http.HttpConnectionPool.ConnectAsync(HttpRequestMessage request, Boolean allowHttp2, CancellationToken cancellationToken)

   at System.Net.Http.HttpConnectionPool.CreateHttp11ConnectionAsync(HttpRequestMessage request, CancellationToken cancellationToken)

   at System.Net.Http.HttpConnectionPool.GetHttpConnectionAsync(HttpRequestMessage request, CancellationToken cancellationToken)

   at System.Net.Http.HttpConnectionPool.SendWithRetryAsync(HttpRequestMessage request, Boolean doRequestAuth, CancellationToken cancellationToken)

   at System.Net.Http.RedirectHandler.SendAsync(HttpRequestMessage request, CancellationToken cancellationToken)

   at System.Net.Http.DecompressionHandler.SendAsync(HttpRequestMessage request, CancellationToken cancellationToken)

   at System.Net.Http.HttpClient.FinishSendAsyncBuffered(Task`1 sendTask, HttpRequestMessage request, CancellationTokenSource cts, Boolean disposeCts)

   at Emby.Server.Implementations.HttpClientManager.CoreHttpClientManager.SendAsyncInternal(HttpRequestOptions options, String httpMethod)

   --- End of inner exception stack trace ---

   at Emby.Server.Implementations.HttpClientManager.CoreHttpClientManager.SendAsyncInternal(HttpRequestOptions options, String httpMethod)

   at Emby.Server.Implementations.HttpClientManager.CoreHttpClientManager.SendAsync(HttpRequestOptions options, String httpMethod)

   at MovieDb.MovieDbProvider.GetMovieDbResponse(HttpRequestOptions options)

   at MovieDb.MovieDbSearch.FindMovieByExternalId(String id, String externalSource, String providerIdKey, CancellationToken cancellationToken)

   at MovieDb.MovieDbProvider.GetMovieSearchResults(ItemLookupInfo searchInfo, CancellationToken cancellationToken)

   at MediaBrowser.Providers.Manager.ProviderManager.GetSearchResults[TLookupType](IRemoteSearchProvider`1 provider, TLookupType searchInfo, CancellationToken cancellationToken)

   at MediaBrowser.Providers.Manager.ProviderManager.GetRemoteSearchResults[TItemType,TLookupType](RemoteSearchQuery`1 searchInfo, BaseItem referenceItem, CancellationToken cancellationToken)

Source: Emby.Server.Implementations

TargetSite: Void MoveNext()

InnerException: System.Threading.Tasks.TaskCanceledException: The operation was canceled.

Source: System.Private.CoreLib

TargetSite: Void Throw()

   at System.Net.Http.ConnectHelper.ConnectAsync(String host, Int32 port, CancellationToken cancellationToken)

   at System.Net.Http.HttpConnectionPool.ConnectAsync(HttpRequestMessage request, Boolean allowHttp2, CancellationToken cancellationToken)

   at System.Net.Http.HttpConnectionPool.CreateHttp11ConnectionAsync(HttpRequestMessage request, CancellationToken cancellationToken)

   at System.Net.Http.HttpConnectionPool.GetHttpConnectionAsync(HttpRequestMessage request, CancellationToken cancellationToken)

   at System.Net.Http.HttpConnectionPool.SendWithRetryAsync(HttpRequestMessage request, Boolean doRequestAuth, CancellationToken cancellationToken)

   at System.Net.Http.RedirectHandler.SendAsync(HttpRequestMessage request, CancellationToken cancellationToken)

   at System.Net.Http.DecompressionHandler.SendAsync(HttpRequestMessage request, CancellationToken cancellationToken)

   at System.Net.Http.HttpClient.FinishSendAsyncBuffered(Task`1 sendTask, HttpRequestMessage request, CancellationTokenSource cts, Boolean disposeCts)

   at Emby.Server.Implementations.HttpClientManager.CoreHttpClientManager.SendAsyncInternal(HttpRequestOptions options, String httpMethod)

 

2020-05-01 22:13:40.738 Info HttpServer: HTTP Response 200 to 192.168.1.224. Time: 40093ms. http://192.168.1.252:8096/emby/Items/RemoteSearch/Movie

2020-05-01 22:13:42.828 Info HttpServer: HTTP POST http://192.168.1.252:8096/emby/Sessions/Playing/Progress. UserAgent: Roku/DVP-9.20 (519.20E04806A)

2020-05-01 22:13:42.844 Info HttpServer: HTTP Response 204 to 192.168.1.234. Time: 16ms. http://192.168.1.252:8096/emby/Sessions/Playing/Progress

2020-05-01 22:13:45.636 Info HttpServer: HTTP GET http://192.168.1.252:8096/emby/System/Logs/embyserver.txt. UserAgent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/81.0.4044.129 Safari/537.36

 

As said though TV identification is auto working. I have disabled the local firewall. Not tried restarting everything  like server and router but this did used to work just fine.

 

I am running server 4.4.2

[Happy2Play 8297]

 

So for a numebr of weeks now I've been getting the same issues with movies. TV stuff is working fine. The background pickup for movies used to work just fine and was working on file name as far as I can tell as I have some movies grouped in folders and some not. I have tried manually using the dinetify option with IMDB or Movie DB ID and it just returns nothing. Here's the log

 

2020-05-01 22:13:20.692 Info HttpClient: GET https://api.themoviedb.org/3/find/tt7713068?api_key=f6bd687ffa63cd282b6ff2c6877f2669&external_source=imdb_id

2020-05-01 22:13:21.253 Info HttpServer: HTTP POST http://192.168.1.252:8096/emby/Sessions/Playing/Progress. UserAgent: Roku/DVP-9.20 (519.20E04806A)

2020-05-01 22:13:21.253 Info HttpServer: HTTP Response 204 to 192.168.1.234. Time: 0ms. http://192.168.1.252:8096/emby/Sessions/Playing/Progress

2020-05-01 22:13:31.861 Info HttpServer: HTTP POST http://192.168.1.252:8096/emby/Sessions/Playing/Progress. UserAgent: Roku/DVP-9.20 (519.20E04806A)

2020-05-01 22:13:31.877 Info HttpServer: HTTP Response 204 to 192.168.1.234. Time: 16ms. http://192.168.1.252:8096/emby/Sessions/Playing/Progress

2020-05-01 22:13:40.706 Error HttpClient: Connection to https://api.themoviedb.org/3/find/tt7713068?api_key=f6bd687ffa63cd282b6ff2c6877f2669&external_source=imdb_id timed out

2020-05-01 22:13:40.738 Error ProviderManager: Error searching

*** Error Report ***

Version: 4.4.2.0

Command line: C:\Users\Keir\AppData\Roaming\MediaBrowser-Server\system\EmbyServer.dll -noautorunwebapp

Operating system: Microsoft Windows NT 6.1.7601 Service Pack 1

64-Bit OS: True

64-Bit Process: True

User Interactive: True

Runtime: file:///C:/Users/Keir/AppData/Roaming/MediaBrowser-Server/system/System.Private.CoreLib.dll

System.Environment.Version: 3.1.3

Processor count: 4

Program data path: C:\Users\Keir\AppData\Roaming\MediaBrowser-Server

Application directory: C:\Users\Keir\AppData\Roaming\MediaBrowser-Server\system

MediaBrowser.Model.Net.HttpException: MediaBrowser.Model.Net.HttpException: Connection to https://api.themoviedb.org/3/find/tt7713068?api_key=f6bd687ffa63cd282b6ff2c6877f2669&external_source=imdb_id timed out

---> System.Threading.Tasks.TaskCanceledException: The operation was canceled.

   at System.Net.Http.ConnectHelper.ConnectAsync(String host, Int32 port, CancellationToken cancellationToken)

   at System.Net.Http.HttpConnectionPool.ConnectAsync(HttpRequestMessage request, Boolean allowHttp2, CancellationToken cancellationToken)

   at System.Net.Http.HttpConnectionPool.CreateHttp11ConnectionAsync(HttpRequestMessage request, CancellationToken cancellationToken)

   at System.Net.Http.HttpConnectionPool.GetHttpConnectionAsync(HttpRequestMessage request, CancellationToken cancellationToken)

   at System.Net.Http.HttpConnectionPool.SendWithRetryAsync(HttpRequestMessage request, Boolean doRequestAuth, CancellationToken cancellationToken)

   at System.Net.Http.RedirectHandler.SendAsync(HttpRequestMessage request, CancellationToken cancellationToken)

   at System.Net.Http.DecompressionHandler.SendAsync(HttpRequestMessage request, CancellationToken cancellationToken)

   at System.Net.Http.HttpClient.FinishSendAsyncBuffered(Task`1 sendTask, HttpRequestMessage request, CancellationTokenSource cts, Boolean disposeCts)

   at Emby.Server.Implementations.HttpClientManager.CoreHttpClientManager.SendAsyncInternal(HttpRequestOptions options, String httpMethod)

   --- End of inner exception stack trace ---

   at Emby.Server.Implementations.HttpClientManager.CoreHttpClientManager.SendAsyncInternal(HttpRequestOptions options, String httpMethod)

   at Emby.Server.Implementations.HttpClientManager.CoreHttpClientManager.SendAsync(HttpRequestOptions options, String httpMethod)

   at MovieDb.MovieDbProvider.GetMovieDbResponse(HttpRequestOptions options)

   at MovieDb.MovieDbSearch.FindMovieByExternalId(String id, String externalSource, String providerIdKey, CancellationToken cancellationToken)

   at MovieDb.MovieDbProvider.GetMovieSearchResults(ItemLookupInfo searchInfo, CancellationToken cancellationToken)

   at MediaBrowser.Providers.Manager.ProviderManager.GetSearchResults[TLookupType](IRemoteSearchProvider`1 provider, TLookupType searchInfo, CancellationToken cancellationToken)

   at MediaBrowser.Providers.Manager.ProviderManager.GetRemoteSearchResults[TItemType,TLookupType](RemoteSearchQuery`1 searchInfo, BaseItem referenceItem, CancellationToken cancellationToken)

Source: Emby.Server.Implementations

TargetSite: Void MoveNext()

InnerException: System.Threading.Tasks.TaskCanceledException: The operation was canceled.

Source: System.Private.CoreLib

TargetSite: Void Throw()

   at System.Net.Http.ConnectHelper.ConnectAsync(String host, Int32 port, CancellationToken cancellationToken)

   at System.Net.Http.HttpConnectionPool.ConnectAsync(HttpRequestMessage request, Boolean allowHttp2, CancellationToken cancellationToken)

   at System.Net.Http.HttpConnectionPool.CreateHttp11ConnectionAsync(HttpRequestMessage request, CancellationToken cancellationToken)

   at System.Net.Http.HttpConnectionPool.GetHttpConnectionAsync(HttpRequestMessage request, CancellationToken cancellationToken)

   at System.Net.Http.HttpConnectionPool.SendWithRetryAsync(HttpRequestMessage request, Boolean doRequestAuth, CancellationToken cancellationToken)

   at System.Net.Http.RedirectHandler.SendAsync(HttpRequestMessage request, CancellationToken cancellationToken)

   at System.Net.Http.DecompressionHandler.SendAsync(HttpRequestMessage request, CancellationToken cancellationToken)

   at System.Net.Http.HttpClient.FinishSendAsyncBuffered(Task`1 sendTask, HttpRequestMessage request, CancellationTokenSource cts, Boolean disposeCts)

   at Emby.Server.Implementations.HttpClientManager.CoreHttpClientManager.SendAsyncInternal(HttpRequestOptions options, String httpMethod)

 

2020-05-01 22:13:40.738 Info HttpServer: HTTP Response 200 to 192.168.1.224. Time: 40093ms. http://192.168.1.252:8096/emby/Items/RemoteSearch/Movie

2020-05-01 22:13:42.828 Info HttpServer: HTTP POST http://192.168.1.252:8096/emby/Sessions/Playing/Progress. UserAgent: Roku/DVP-9.20 (519.20E04806A)

2020-05-01 22:13:42.844 Info HttpServer: HTTP Response 204 to 192.168.1.234. Time: 16ms. http://192.168.1.252:8096/emby/Sessions/Playing/Progress

2020-05-01 22:13:45.636 Info HttpServer: HTTP GET http://192.168.1.252:8096/emby/System/Logs/embyserver.txt. UserAgent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/81.0.4044.129 Safari/537.36

 

As said though TV identification is auto working. I have disabled the local firewall. Not tried restarting everything  like server and router but this did used to work just fine.

 

I am running server 4.4.2

 

 

Can't really compare TV and Movies unless you are only using one provider, TMDB.  But the majority of users that have Time out issues is a environmental issue.  All we can do is supply suggestions, Firewall, VPN, Proxies, security software and possibly IPv6 issues.

 

Does the connection still time out if you click on the url that is timing out above?

[Khalew 0]

yes the api call works just fine. I turned off the remote access and added a 443 rule specifically to the server outbound and low and behold it worked.

[Luke 37116]

yes the api call works just fine. I turned off the remote access and added a 443 rule specifically to the server outbound and low and behold it worked.

Thanks for the feedback !

[Nick D_CA 0]

I am also having the same issue where Emby is now only trying to identify items based on filename and not using the folder name. Seems to have started around the same time as others too. Please let me know what the steps are to revert back to including folder name when identifying items. 

 

2020-05-15 19:09:16.071 Info App: MovieDbProvider: Finding id for item: TnPy1CDYaN132ibtA5PjfzOEQ0On

Based on file/folder structure: "\\192.168.1.10\Media\Movies\Scoob (2020)\TnPy1CDYaN132ibtA5PjfzOEQ0On.mkv"

[Khalew 0]

So the searching keeps intermittantly collapsing. Despite the rule i add to the gateway, if I restart the server itself (not just restart EMBY) then it comes back and it behaves itself. Not sure if that really tells us anything.

[Luke 37116]

 

I am also having the same issue where Emby is now only trying to identify items based on filename and not using the folder name. Seems to have started around the same time as others too. Please let me know what the steps are to revert back to including folder name when identifying items. 

 

2020-05-15 19:09:16.071 Info App: MovieDbProvider: Finding id for item: TnPy1CDYaN132ibtA5PjfzOEQ0On

Based on file/folder structure: "\\192.168.1.10\Media\Movies\Scoob (2020)\TnPy1CDYaN132ibtA5PjfzOEQ0On.mkv"

 

 

I'm not sure yet, but we're going to be putting out a 4.4.3 update that has other fixes that could potentially impact this.

[dbxl 0]

hello,

emby 4.4.3 on debian

tmdb for metadata

the same issue here for quite some time. emby identify movies based on filename and not using the folder name.

regards

[Luke 37116]

14 hours ago, dbxl said:

hello,

emby 4.4.3 on debian

tmdb for metadata

the same issue here for quite some time. emby identify movies based on filename and not using the folder name.

regards

Hi there, can you please go over an example? Thanks.

[dbxl 0]

hi,

i'm not quite sure, but i think from the end of march the automatic identification no longer worked via the folder name.

my naming schema that worked until end of march without any problem:

\movies\idiocracy (2006)\somerandomfilename1080.mkv

and now i have to change the filename like this so that the automatic identification works and match the tmdb entry:

\movies\idiocracy (2006)\idiocracy (2006).mkv

update to 4.4.3 dont fix the issue.

[dbxl 0]

ok, i found a clue and will test it:

https://emby.media/community/index.php?/topic/67792-library-scan-using-file-name-instead-of-folder-name/&do=findComment&comment=677487

 

Edited June 25, 2020 by dbxl

[dbxl 0]

7 hours ago, dbxl said:

ok, i found a clue and will test it:

https://emby.media/community/index.php?/topic/67792-library-scan-using-file-name-instead-of-folder-name/&do=findComment&comment=677487

 

clue dont help.
\subs subfolder isnt the issue.

my test ...

automatic identification works:

\movies\idiocracy (2006)\folder.jpeg
\movies\idiocracy (2006)\idiocracy (2006).mkv
\movies\idiocracy (2006)\subs\idiocracy.sub

automatic identification dont work:

\movies\idiocracy (2006)\folder.jpeg
\movies\idiocracy (2006)\some34random34filename1080.mkv
\movies\idiocracy (2006)\subs\idiocracy.sub

[Luke 37116]

1 hour ago, dbxl said:

clue dont help.
\subs subfolder isnt the issue.

my test ...

automatic identification works:

\movies\idiocracy (2006)\folder.jpeg
\movies\idiocracy (2006)\idiocracy (2006).mkv
\movies\idiocracy (2006)\subs\idiocracy.sub

automatic identification dont work:

\movies\idiocracy (2006)\folder.jpeg
\movies\idiocracy (2006)\some34random34filename1080.mkv
\movies\idiocracy (2006)\subs\idiocracy.sub

Hi, please attach the emby server log from when you imported it. Thanks !

[Happy2Play 8297]

7 hours ago, dbxl said:

clue dont help.
\subs subfolder isnt the issue.

my test ...

automatic identification works:

\movies\idiocracy (2006)\folder.jpeg
\movies\idiocracy (2006)\idiocracy (2006).mkv
\movies\idiocracy (2006)\subs\idiocracy.sub

automatic identification dont work:

\movies\idiocracy (2006)\folder.jpeg
\movies\idiocracy (2006)\some34random34filename1080.mkv
\movies\idiocracy (2006)\subs\idiocracy.sub

If your system is identifying by FILENAME instead of FOLDERNAME I can see this being a issue.

We still need to know why some systems are using FILE instead of Folder.

[dbxl 0]

hi there

OK. I created 2 test movies and copied them to the server after restarting emby.

automatic identification works:

\foo\bar\7500 (2019)\folder.jpeg
\foo\bar\7500 (2019)\7500 (2019).mkv
\foo\bar\7500 (2019)\subs\filename.sub

automatic identification dont work:

\foo\bar\the green mile (1999)\folder.jpeg
\foo\bar\the green mile (1999)\ökslkedjf879p8rkjrlkgklmväe.mkv
\foo\bar\the green mile (1999)\subs\filename.sub

thanks for your help.

embyserver.txt

[Happy2Play 8297]

5 hours ago, dbxl said:

hi there

OK. I created 2 test movies and copied them to the server after restarting emby.

automatic identification works:

\foo\bar\7500 (2019)\folder.jpeg
\foo\bar\7500 (2019)\7500 (2019).mkv
\foo\bar\7500 (2019)\subs\filename.sub

automatic identification dont work:

\foo\bar\the green mile (1999)\folder.jpeg
\foo\bar\the green mile (1999)\ökslkedjf879p8rkjrlkgklmväe.mkv
\foo\bar\the green mile (1999)\subs\filename.sub

thanks for your help.

embyserver.txt 76.72 kB · 1 download

Yes as already stated we still don't know why some systems are using File instead of Folder name.

2020-06-26 07:28:34.437 Info MediaProbeManager: ProcessRun 'ffprobe' Execute: /opt/emby-server/bin/ffprobe -i file:"/srv/video/videothek/the green mile (1999)/ökslkedjf879p8rkjrlkgklmväe.mkv"

2020-06-26 07:28:35.080 Info App: MovieDbProvider: Finding id for item: ökslkedjf879p8rkjrlkgklmväe

I just skimmed the topic as there are totally different issues discussed, but the only test I can suggest is if you created a New Library with a New Folder path and placed this media in it, is it still improperly identified?

I know I have yet been able to reproduce this File vs Folder name issue on any of my Windows systems.

[dbxl 0]

It is astonishing that it worked wonderfully until the end of March. I'm sure I haven't changed anything in the system except for occasional debian updates.

What I just notice about the screenshot ... the release date is recognized in both movies!?

OK. I will create and test a new library.

Thank you so far.

[Luke 37116]

On 6/26/2020 at 7:39 AM, dbxl said:

It is astonishing that it worked wonderfully until the end of March. I'm sure I haven't changed anything in the system except for occasional debian updates.

What I just notice about the screenshot ... the release date is recognized in both movies!?

OK. I will create and test a new library.

Thank you so far.

Let us know how you get on. Thanks.

[dbxl 0]

Hello. Apologies for the late reply.

I have now created a new library and copied some films into it for testing. What can I say ... they are identified again by the folder name. Yeah ...
What will be the best way to get this behavior from existing libraries? Delete the existing library and just create a new one with the same name and folder paths?

Thank you so far.

 

 

[Carlo 4330]

One method would be to create one new library at a time and move content over.  Mayby 500 movies at time and stage it.

[dbxl 0]

OK. I will consider and test something. I still have a few Kodi clients accessing emby. I don't want to adjust the smb paths on the clients.

[Happy2Play 8297]

9 hours ago, dbxl said:

Hello. Apologies for the late reply.

I have now created a new library and copied some films into it for testing. What can I say ... they are identified again by the folder name. Yeah ...
What will be the best way to get this behavior from existing libraries? Delete the existing library and just create a new one with the same name and folder paths?

Thank you so far.

 

 

One other thing would be comparing the old and new library options.xml.

\Emby-Server\programdata\root\default\"each library"

[Luke 37116]

@dbxl has this helped?

[dbxl 0]

Sorry for the late reply. I am not on the PC every day.

I think the problem is solved. The movies are again identified reliably on the basis of the folder name.
I renamed the old libraries, waited a little and then created new ones with the same folder paths and names.
It worked so perfectly for one library, for another I waited until the next day until the newly created library recognized the contents. Whatever the reason ... now it works perfectly as before. At Kodi I updated the databases in the emby-for-kodi addon.
Thanks for your help. emby is really a nice piece of software.

[Luke 37116]

Thanks for the feedback.