Memory consumption over time

Windows specific questions, problems.

Moderators: Moderator, Global Moderator

User avatar
ciaobaby
Forum addict
Forum addict
Posts: 2771
Joined: Sat May 18, 2013 4:08 pm

Re: Memory consumption over time

Post by ciaobaby » Thu Apr 10, 2014 11:21 pm

What you are missing is that, the Windows caching 'issue' has been a 'feature' of every Windows version going back to NT4, so any and every application that Windows "considers" may requires many files that need to be ready to be opened WILL cause the memory runaway.

It was originally  intended to speed up opening files if and when they where needed, by keeping a reference to the file GUID and the file "meta data" cached, but drives increased in size, applications grew more complex and required more and more files to be open to run, this 'optimistic referencing' just became a resource hog, and is so entrenched into the Windows core processes it will be a long time before M$ can get rid of it.

Why BT clients cause the problem to be more evident is that they are constantly reading and writing to multiple 'files' so Windows is always "thinking" that all those files need to be available in memory constantly whenever the BT client is running. But as soon as the client is closed, the cached references are no longer needed so Windows clears them out and releases the memory.

The 'fix' is to totally rewrite all the I/O routines and bypass Windows file handling completely. However BitTorrent tried that in uTorrent v3.3 and I think we all know what happened there.
Smarter than the av-er-age bear, Boo Boo.

http://qbforums.shiki.hu/index.php/topic,3084.0.html

jeps
Veteran
Veteran
Posts: 78
Joined: Sun Sep 02, 2012 5:03 pm

Re: Memory consumption over time

Post by jeps » Fri Apr 11, 2014 6:58 am

Why do you keep on stating the obvious?

To sum it up:
I don't care that qBittorrent/libtorrent uses +4 GB of cache, really.
I do care that qBittorrent has a memory/handle leak, that will make it crash after ~100 hours of running.

User avatar
ciaobaby
Forum addict
Forum addict
Posts: 2771
Joined: Sat May 18, 2013 4:08 pm

Re: Memory consumption over time

Post by ciaobaby » Fri Apr 11, 2014 5:26 pm

Why do you keep on stating the obvious?
Because you seem unable to grasp that is NOT a qBitTorrent memory leak.
Smarter than the av-er-age bear, Boo Boo.

http://qbforums.shiki.hu/index.php/topic,3084.0.html

nub
Newbie
Newbie
Posts: 12
Joined: Sat Oct 12, 2013 12:35 am

Re: Memory consumption over time

Post by nub » Fri May 23, 2014 7:02 pm

This problem is EXTREMELY annoying, hope it will be fixed soon.

I don't want to switch to another client but seems like i'll be forced to if this isn't addressed, QBT eats up 7gb+ of ram within minutes, please fix this.

User avatar
Nemo
Administrator
Administrator
Posts: 1518
Joined: Sat Jul 24, 2010 6:24 pm

Re: Memory consumption over time

Post by Nemo » Fri May 23, 2014 7:51 pm

Im wondering how its possible to reach that high of ram usage. Since the very first versions of qBittorrent till the newest I've never seen it go any higher than +-100MB and it only gets that high when it runs for days straight with alot of torrents loaded in it which is acceptable. I don't see it as a bug from qBittorrent to be honest. Also im wondering why so many other users don't experience this (also myself as I said) cause then I would be thinking that it could be indeed qBittorrent's fault.
Last edited by Nemo on Fri May 23, 2014 8:03 pm, edited 1 time in total.
Forum Rules and Guidelines

Forum Admin.
Dutch & Turkish Translator.


Image
Image

User avatar
ciaobaby
Forum addict
Forum addict
Posts: 2771
Joined: Sat May 18, 2013 4:08 pm

Re: Memory consumption over time

Post by ciaobaby » Fri May 23, 2014 8:09 pm

qBT can NOT use 7GiB of memory, it would have crashed LONG before that point,  2GiB is the ABSOLUTE maximum that a 32bit application can manage, trying to address more than that WILL cause a fatal exception (crash).
Smarter than the av-er-age bear, Boo Boo.

http://qbforums.shiki.hu/index.php/topic,3084.0.html

User avatar
Nemo
Administrator
Administrator
Posts: 1518
Joined: Sat Jul 24, 2010 6:24 pm

Re: Memory consumption over time

Post by Nemo » Fri May 23, 2014 8:15 pm

Yes true. One thing that could be possible is that he is using Dayman's 64Bit build on his 64Bit machine (just guessing..). But then again.. How in the world do you reach 7GiB. Both versions are working flawless really.
Forum Rules and Guidelines

Forum Admin.
Dutch & Turkish Translator.


Image
Image

nub
Newbie
Newbie
Posts: 12
Joined: Sat Oct 12, 2013 12:35 am

Re: Memory consumption over time

Post by nub » Fri May 23, 2014 9:33 pm

Its not the QBT process itself that uses the memory, but when i have it open the memory consumption will go over 7gb, as soon as i close QBT, everything goes back to normal.

User avatar
ciaobaby
Forum addict
Forum addict
Posts: 2771
Joined: Sat May 18, 2013 4:08 pm

Re: Memory consumption over time

Post by ciaobaby » Fri May 23, 2014 10:24 pm

That's because it is the Windows dumb cache system that reserves memory for files that  might, only might be used at a micro seconds notice.

BitTorrent clients, depending on the type of jobs that are running, can hold a large number of file handles open, M$ Windows reserves memory for EVERY single file name that is 'in use' or referenced. When you close the application that is holding the file handles, the references are released, M$ Windows revokes the cache, then everybody puts two and two together find that it equals six and blame qBitTorrent.

Read this thread as well. http://qbforums.shiki.hu/index.php/topic,2607.0.html

If qBitTorrent did have a "memory leak", builds that were running on Linux and Mac would also exhibit this problem, that does not happen; ergo the issue is Windows only
Smarter than the av-er-age bear, Boo Boo.

http://qbforums.shiki.hu/index.php/topic,3084.0.html

nub
Newbie
Newbie
Posts: 12
Joined: Sat Oct 12, 2013 12:35 am

Re: Memory consumption over time

Post by nub » Fri May 23, 2014 11:21 pm

I've never had this problem before, it only happens for maximum 2 months or so.

User avatar
ciaobaby
Forum addict
Forum addict
Posts: 2771
Joined: Sat May 18, 2013 4:08 pm

Re: Memory consumption over time

Post by ciaobaby » Sat May 24, 2014 1:35 pm

it only happens for maximum 2 months or so.
??

That's somewhat  ambiguous as a statement;

do you mean it it only happens every two months or so?

if so have you noticed what changes at those times

OR

it takes around two months to get to that point, after you have restarted qBitTorrent?
Smarter than the av-er-age bear, Boo Boo.

http://qbforums.shiki.hu/index.php/topic,3084.0.html


nub
Newbie
Newbie
Posts: 12
Joined: Sat Oct 12, 2013 12:35 am

Re: Memory consumption over time

Post by nub » Sat May 24, 2014 3:20 pm

What i mean is i haven't ever experienced this issue with QBT before, it only started showing up in the past 2 months.

I don't remember other torrent clients doing this in the past either, with one exception being utorrent but that was an old version and the problem was fixed in a future release, this was a long time ago though.
Last edited by nub on Sat May 24, 2014 5:56 pm, edited 1 time in total.

nub
Newbie
Newbie
Posts: 12
Joined: Sat Oct 12, 2013 12:35 am

Re: Memory consumption over time

Post by nub » Sat May 24, 2014 3:24 pm

[quote="sledgehammer_999"]
http://qbforums.shiki.hu/index.php/topi ... l#msg11326
[/quote]

Good to hear !
Last edited by nub on Sat May 24, 2014 3:26 pm, edited 1 time in total.

Post Reply