Everything slow.

[leison]

Hello people,

My everything is locking and using too much memory. I have 5 hard disk in case USB 3.0 and many files, I believe it is locking for having many files, about 157,060,956 files, does anyone have any suggestions how to avoid this type of problem?


Sorry for my English.

[therube]

> using too much memory

About how much memory?

Are all your drive NTFS?
What settings do you have enabled under; Tools | Options -> Indexes?

[leison]

> using too much memory

About how much memory?

Are all your drive NTFS?
What settings do you have enabled under; Tools | Options -> Indexes?

I attached images with the options and amount of memory used.

Ty

[therube]

OK, that's the NTFS tab. How about the Indexes tab also.

(That is a lot of memory.)
Is Everything using that kind of memory from the start, or does it increase over time?
If the latter, a gradual increase, sporadic increases, or is it eating periodic large chucks?
(Oh, but then that is also a huge number of files, 100x more then I have, so maybe what you're seeing isn't out of the ordinary?)

[leison]

OK, that's the NTFS tab. How about the Indexes tab also.

(That is a lot of memory.)
Is Everything using that kind of memory from the start, or does it increase over time?
If the latter, a gradual increase, sporadic increases, or is it eating periodic large chucks?
(Oh, but then that is also a huge number of files, 100x more then I have, so maybe what you're seeing isn't out of the ordinary?)

Memory usage is super high right from the start.

I am attached in the image of the index, ty.

[NotNull]

... 157,060,956 files ...

That's enormous! (*) Do you back-up the entire Internet or something?

I'm not surprised that this takes 12GB+ of RAM; that's about 78 bytes per file to save filename, path,filesize and date. That sounds about right.


There are a couple of things you could do to improve performance:

• First of all, make sure that your Everything version is 1.4.1.900 or newer (64-bit, of course) as it has some performance improvements (more about that here).
  You can download the most recent version (currently 1.4.1.904) here:
  http://www.voidtools.com/forum/viewtopic.php?f=2&t=5718
• You could reduce the information that is indexed (see viewtopic.php?t=5177). That would shave off 10% of your RAM usage per item (roughly) at the price of some speed
• You could split your Everything database in multiple ones, where you put the seldom used/needed files in a database that is not loaded into RAM and all other files in the 'normal' Everything. When you need one of those seldom used files, load that database.
  If you don't need half of the files on a somewhat regular basis, that would save you half of the RAM (6GB)
  If that's the route you want to go: we (all forum users) can help you with that.

Oh, almost forgot an important question: When and where is Everything slow? On startup? On exit? With certain queries?


(*) Suppose you bought the very first PC in 1981 and started hoarding files ever since ... You would need to create around 500 new files EVERY hour from that monent on, to get that amount of files!!

[void]

Some suggestions:

• Please try Everything 904 or later as it has support for thread yielding.
• Try disabling Search as your type.
• Try limiting the maximum number of threads Everything uses, for example, if you have 8 logical processors, try setting the max threads in Everything to 4:
  • In Everything, type in the following search and press ENTER:
    /max_threads=4
• If you don't need real-time updating temporarily disable updating with /monitor_pause:
  • In Everything, type in the following search and press ENTER:
    /monitor_pause
  (I suspect USB I/O is causing the issue so this should help)
• Resume monitoring with /monitor_resume
  • In Everything, type in the following search and press ENTER:
    /monitor_resume
• See optimal settings to get the best performance from "Everything".