shaefurr 1337 Posted November 30, 2014 Share Posted November 30, 2014 My movie collection is 1780 movies. Just gave it a go average from 10 runs, average all movies time is around 5.6 seconds, average fast movies time is around 3.1 seconds Link to comment Share on other sites More sharing options...
Luke 37994 Posted November 30, 2014 Share Posted November 30, 2014 the "before" numbers that i'm seeing here are not really that high so i'm wondering how much of a problem this actually is. maybe the new reductions i have will be good enough so that you don't need whatever hack is being done here. Link to comment Share on other sites More sharing options...
shaefurr 1337 Posted November 30, 2014 Share Posted November 30, 2014 I never thought it was slow, but just for comparison, loading all movies in MBT average load time is 2.4 seconds. Link to comment Share on other sites More sharing options...
xnappo 1595 Posted November 30, 2014 Author Share Posted November 30, 2014 Yeah, MBT can do things we can't in XBMC - but I am working on it as you can see @@Luke - thanks - that will help a lot once available. xnappo Link to comment Share on other sites More sharing options...
Luke 37994 Posted November 30, 2014 Share Posted November 30, 2014 it should be in the dev build tomorrow sometime. Link to comment Share on other sites More sharing options...
xnappo 1595 Posted November 30, 2014 Author Share Posted November 30, 2014 Just pushed a new version to the beta repo with improved Fast Movies 1 & 2. Please test again. xnappo Link to comment Share on other sites More sharing options...
im85288 1493 Posted November 30, 2014 Share Posted November 30, 2014 Hi @@xnappo - I noticed the new beta release with the experimental speed improvements included. As yet I cannot test it..due to GTA5 on Xbox One hogging my attention and TV...but would it be possible to position the temporary "fast movies" and "fast movies 2" at the bottom of the collection so as not to alter with the current positioning of the standard movie items? Currently for example Recently Added Movies are located at: xbmb3c.std.movies.1 - Recently Added Movies But with the new change (and I know it is temporary this moves to position 3. If you put these at the bottom: # EXPERIMENTAL + collections.append({'title':'Fast ' + __language__(30170), 'sectype' : 'std.movies', 'section' : 'movies' , 'address' : MB_server , 'path' : '/mediabrowser/Users/' + userid + '/Items?&SortBy=SortName&Recursive=true&SortOrder=Ascending&IncludeItemTypes=Movie&IsFast=true&format=json' ,'thumb':'', 'poster':'', 'fanart_image':'', 'guiid':''}) + collections.append({'title':"Fast All Movies 2" , 'sectype' : 'std.movies', 'section' : 'fastmovies' , 'address' : 'FastMovies', 'path': 'FastMovies', 'thumb':'', 'poster':'', 'fanart_image':'', 'guiid':''}) + # /EXPERIMENTAL Then no impact will be made on the skins that use these positions. Link to comment Share on other sites More sharing options...
shaefurr 1337 Posted November 30, 2014 Share Posted November 30, 2014 Ok, so average on 1788 movies for 10 runs. All movies is average 4.6 seconds (1 second faster than previous version) Fast movies is average 2.4 seconds Fast movies 2 is average .5 seconds, though it only shows a folder labeled missing, and im not sure about the .5 second time, its almost instant. Link to comment Share on other sites More sharing options...
Luke 37994 Posted November 30, 2014 Share Posted November 30, 2014 yea honestly, you want to find ways to improve all of the views rather than doing something like this. so hopefully Fast Movies is just an experiment. I mean think about the usability aspect and waf seeing Movies and Fast Movies menu options. that's why i'm suggesting to stop and wait for the next dev server and then go from there. maybe we can reach a point where it's good enough and you don't have to pursue this anymore. Link to comment Share on other sites More sharing options...
xnappo 1595 Posted November 30, 2014 Author Share Posted November 30, 2014 (edited) That is with the new beta? Something wrong with Fast Movies 2 then - can you post a log? Make sure you restarted XBMC. Edited November 30, 2014 by xnappo Link to comment Share on other sites More sharing options...
shaefurr 1337 Posted November 30, 2014 Share Posted November 30, 2014 Ya Version 0.9.724 Weird I had restarted it before hand, did it again and now its working. All movies - 4.6 fast movies - 3.2 fast movies 2 - 2.2 1 Link to comment Share on other sites More sharing options...
xnappo 1595 Posted November 30, 2014 Author Share Posted November 30, 2014 (edited) Sorry - I didn't think of that Ian - just pushed another with them moved to the end. This is purely an experiment to understand JSON parsing vs. server time. Much more work will be needed to implement a real speedup - but the server change is not going to solve the whole problem - it is needed in conjunction with 'Fast Movies 1' otherwise there will be no images There are not many views where there are more than 100 results - so I don't *completely* agree with your statement @@Luke - but '1' is more of a general solution than '2' for sure. Chris Edited November 30, 2014 by xnappo 1 Link to comment Share on other sites More sharing options...
xnappo 1595 Posted November 30, 2014 Author Share Posted November 30, 2014 I moved 'Fast Movies' and 'Fast Movies 2' to the end of the list to prevent skin index issues. Link to comment Share on other sites More sharing options...
xnappo 1595 Posted December 1, 2014 Author Share Posted December 1, 2014 (edited) the "before" numbers that i'm seeing here are not really that high so i'm wondering how much of a problem this actually is. maybe the new reductions i have will be good enough so that you don't need whatever hack is being done here. Keep in mind we are dealing with a fast machine. AND his XBMC database number would have been less than a second. Making good progress though - if we background load the unimportant data, and don't always provide it from the server on every query we will be set. xnappo Edited December 1, 2014 by xnappo 1 Link to comment Share on other sites More sharing options...
dark_slayer 103 Posted December 1, 2014 Share Posted December 1, 2014 (edited) the "before" numbers that i'm seeing here are not really that high so i'm wondering how much of a problem this actually is. maybe the new reductions i have will be good enough so that you don't need whatever hack is being done here. It's definitely worthwhile coming from an XBMC-MySQL user. Virtually every skin and every view state resulted in loading 1500 movies in less than 1s (about how many movies I had before I ditched the SQL server) Keep in mind we are dealing with a fast machine. AND his XBMC database number would have been less than a second. Making good progress though - if we background load the unimportant data, and don't always provide it from the server on every query we will be set. xnappo This is very true as well, the numbers over wifi are usually double for MB3 but were usually 1s for MySQL Just pushed a new version to the beta repo with improved Fast Movies 1 & 2. Please test again. xnappo Okay, got some testing time in (library at 1723 movies today) Intel x64 OpenELEC 13.2 wired w/ your Nox skin All Movies ~ 4.5s Fast All Movies ~ 2.6s Fast All Movies 2~ 1.3s rMBP Helix x64 Beta 5 wireless-AC w/ Titan All Movies ~ 8.7s Fast All Movies ~ 5.8s Fast All Movies 2~ 1.6s (ARE YOU KIDDING ME!!!) Something else that I noticed was that using the view "Info Wall" (which I really like in Nox4) doesn't ever seem to display "Plots" for anything, and when changing the "All Movies" view to "Info Wall" confirmed that behavior inside the add-on (in addition to the main menu entry). However, when loading "Fast All Movies" and "Fast All Movies 2" the Nox4 "Info Wall" view gets all of the Plots populated Edited December 1, 2014 by dark_slayer Link to comment Share on other sites More sharing options...
dark_slayer 103 Posted December 1, 2014 Share Posted December 1, 2014 Also, MB3 add-on version was 0.9.725 for both (hope that was right) Link to comment Share on other sites More sharing options...
dark_slayer 103 Posted December 1, 2014 Share Posted December 1, 2014 (edited) The only thing is that I'm getting a ton of errors now "URL error: OutOfMemoryException" In addition to "Cannot Connect: IP.Of.MB3.Server:Port" http://xbmclogs.com/show.php?id=359697 Edited December 1, 2014 by dark_slayer Link to comment Share on other sites More sharing options...
dark_slayer 103 Posted December 1, 2014 Share Posted December 1, 2014 (edited) If the speed up idea needs >2GB ram (what I have in OE) that will be problematic as I'm sure it's somewhat targeted towards the RPi which unfortunately has less than 1GB ram Edited December 1, 2014 by dark_slayer Link to comment Share on other sites More sharing options...
dark_slayer 103 Posted December 1, 2014 Share Posted December 1, 2014 Went over to server and it had applied an update. After a restart, my issues above went away So, looks like false alarm sorry (edited with strikethrough) Link to comment Share on other sites More sharing options...
e123enitan 247 Posted December 1, 2014 Share Posted December 1, 2014 Hi All, I am working on some ideas to speed up things for large collections/slow machines. I have two methods of doing this I have been prototyping. One is easier to implement and will only get full improvements with a server change from @@Luke. The second is more difficult, but should be quite fast. Some things like sorting will be very difficult with the second, however. I would like some users with large collections to give these a shot an let me know the speed-up from 'All Movies' to 'Fast Movies' and then 'Fast Movies 2'. I am out of town, and testing over the internet isn't really working well. To try it out, replace the files in the attached zip in your plugin.video.xbmb3c/resources/lib folder, then into Video->Addons-MediaBrowser and go to the above nodes. Thanks, xnappo Link to comment Share on other sites More sharing options...
e123enitan 247 Posted December 1, 2014 Share Posted December 1, 2014 Count me in I have over a 2000+ collection classed my adult, children, foreign and movies . 2 Android kit kat dedicated to xbmc, and 2 win7. I have always being concern of the slow pace of android when it comes to in/out load of movies class which is over 1000+. Let me know if my profile fits your needs and steps or guidelines for the testing purposes Cheers Eni Link to comment Share on other sites More sharing options...
xnappo 1595 Posted December 1, 2014 Author Share Posted December 1, 2014 Sure, just load up the latest beta and test 'All Movies' vs. 'Fast Movies' vs. 'Fast Movies 2'. You get to these through 'Video Addons'->MediaBrowser. The new ones are at the bottom. A note: 'Fast Movies 2' does not work in a way that is extendable to multiple collections. My goal is to get Fast Movies and Fast Movies 2 close enough to one another to not need 2. Changes @@Luke is working on with the server will be needed to test that though. In case you are interested - here is the technical difference: All Movies - when you select this, the AddOn send a query for all the data for all the movies - this is a ton of info with studios, multiple artwork links etc etc. This has to be parsed and added to the XBMC list using tons of JSON parsing. Fast Movies - still pulls down all the data - this is the bit Luke is working on - having a reduced dataset call available to the server. However much of the JSON parsing has already been done by a background thread and added to an in-RAM database. Fast Movies 2 - doesn't pull down any data. The entire list has already been built in the background, and we just display it. But this has a lot of problem with supporting multiple end-points, sorting, watched status, deleting etc etc. xnappo Link to comment Share on other sites More sharing options...
e123enitan 247 Posted December 1, 2014 Share Posted December 1, 2014 Sure, just load up the latest beta and test 'All Movies' vs. 'Fast Movies' vs. 'Fast Movies 2'. You get to these through 'Video Addons'->MediaBrowser. The new ones are at the bottom. A note: 'Fast Movies 2' does not work in a way that is extendable to multiple collections. My goal is to get Fast Movies and Fast Movies 2 close enough to one another to not need 2. Changes @@Luke is working on with the server will be needed to test that though. In case you are interested - here is the technical difference: All Movies - when you select this, the AddOn send a query for all the data for all the movies - this is a ton of info with studios, multiple artwork links etc etc. This has to be parsed and added to the XBMC list using tons of JSON parsing. Fast Movies - still pulls down all the data - this is the bit Luke is working on - having a reduced dataset call available to the server. However much of the JSON parsing has already been done by a background thread and added to an in-RAM database. Fast Movies 2 - doesn't pull down any data. The entire list has already been built in the background, and we just display it. But this has a lot of problem with supporting multiple end-points, sorting, watched status, deleting etc etc. xnappo OK I will give a try when I get home tonight and provide a feedback, technical terms sounds like a rocket science, what is jason a person's name wondering how to translate this to accounting and financial terms which I am fluent with Debit/Credit I shall keep you posted Cheers Link to comment Share on other sites More sharing options...
e123enitan 247 Posted December 1, 2014 Share Posted December 1, 2014 pls provide link to the latest repo? Thanks Link to comment Share on other sites More sharing options...
xnappo 1595 Posted December 1, 2014 Author Share Posted December 1, 2014 http://mediabrowser.tv/community/index.php?/topic/9984-kodi-beta-repo/ Link to comment Share on other sites More sharing options...
Recommended Posts