[Deque]

Holy crap.. This is mindblowing..
Aprox. how much data did you go through to get these stats so precise??
(I'm guessing somewhere in the Eb range)

Gigabyte range only.
It is more about the numbers than the size of the data.
I've got 103277 pieces of malware (75 GB) and 33178 pieces of clean samples (16 GB).
I am about to collect more clean samples, though. I will update the program when I got more data.

Here are some accuracy results of the current setup.
I think it can get better.

---

False positives for good files. E.g. if I decide files above 50% probability are malicious, 8,7% get a false positive.

Code:

files read: 33178 malicious by threshold 0.99: 174 ratio 0.005244439086141419 malicious by threshold 0.80: 1088 ratio 0.03279281451564289 malicious by threshold 0.50: 2883 ratio 0.08689493037555006

Bad files detection ratio. E.g. if I decide files above 50% are malicious, 94% of all malicious files are detected as malicious.

Code:

files read: 39000 malicious by threshold 0.99: 13888 ratio 0.3561025641025641 malicious by threshold 0.80: 21795 ratio 0.5588461538461539 malicious by threshold 0.50: 36657 ratio 0.939923076923077

(Note: I stopped here at 39000, because the ratio didn't change much.)