Page 7 of 11

Re: QTS Hero... ZFS? What? When?

Posted: Wed Dec 25, 2019 7:23 pm
by Moogle Stiltzkin

Re: QTS Hero... ZFS? What? When?

Posted: Wed Dec 25, 2019 9:30 pm
by P3R
I gave a correct answer to your question and threw in a little joke as a bonus.

To see my answers I'm afraid you have to deal with that sometimes I'll give you a little more than you asked for.

If you don't like my posts then please feel free to add me as a foe, or deal with the whole content.

Re: QTS Hero... ZFS? What? When?

Posted: Wed Dec 25, 2019 11:10 pm
by dolbyman
x51 and x53 units in the list..what happened to "mid range" units or higher?

wonder how well they cope

Re: QTS Hero... ZFS? What? When?

Posted: Thu Dec 26, 2019 4:45 am
by adamyh
I think ZFS will be fine. There is less overhead for snapshots and scrubs compared to ext4. The dedup requires lots of memory through. The challenge is the ZIL. That’s where I/O is key.

Re: QTS Hero... ZFS? What? When?

Posted: Thu Dec 26, 2019 7:21 am
by Moogle Stiltzkin
wait, do we will still need to do raid scrubs with zfs ?

at least they did say for file system check, that should no longer be required for zfs? so i am assuming they may remove that if you install qts hero?

Re: QTS Hero... ZFS? What? When?

Posted: Thu Dec 26, 2019 7:55 am
by P3R
Moogle Stiltzkin wrote:
Thu Dec 26, 2019 7:21 am
wait, do we will still need to do raid scrubs with zfs ?
It's an integral part of ZFS and one key to the reliability.

Re: QTS Hero... ZFS? What? When?

Posted: Thu Dec 26, 2019 8:31 am
by P3R
adamyh wrote:
Thu Dec 26, 2019 4:45 am
The dedup requires lots of memory through. The challenge is the ZIL. That’s where I/O is key.
Yes and with almost all the TS-X5X (desktop) models being limited to 4 bays or less there is no help to expect from SLOG SSDs (except in the very few PCIe models). I don't know but add limited amounts of (non-ECC) RAM and I doubt that the TS-X5X user experience will be as positive as you think.

The early adopters are so sold on the ZFS-idea that the disadvantages will not matter to them. It will be more interesting to see how the second wave of users, that aren't ZFS-fans, will react to the possible performance limitations, not to mention the very limited RAID expansion/migration possibilities.

Re: QTS Hero... ZFS? What? When?

Posted: Thu Dec 26, 2019 8:38 am
by Moogle Stiltzkin
P3R wrote:
Thu Dec 26, 2019 7:55 am
Moogle Stiltzkin wrote:
Thu Dec 26, 2019 7:21 am
wait, do we will still need to do raid scrubs with zfs ?
It's an integral part of ZFS and one key to the reliability.
ah i c. ty :'

P3R wrote:
Thu Dec 26, 2019 8:31 am
Yes and with almost all the TS-X5X (desktop) models being limited to 4 bays or less there is no help to expect from SLOG SSDs (except in the very few PCIe models). I don't know but add limited amounts of (non-ECC) RAM and I doubt that the TS-X5X user experience will be as positive as you think.

The early adopters are so sold on the ZFS-idea that the disadvantages will not matter to them. It will be more interesting to see how the second wave of users, that aren't ZFS-fans, will react to the possible performance limitations, not to mention the very limited RAID expansion/migration possibilities.
when the time comes we can add a poll and see how users feel about it. i just hope that it is rock stable..... :?

and yes you are right about the limited raid expansion. i think if you want to expand, you need to start from scratch. for me... thats ok.... i don't do this often, and i keep backups. but for people that want to slot in a new hdd and expand the current raid, they'd probably be annoyed.


i just notice rob released a demo video of the qts hero :'
https://www.youtube.com/watch?v=gCxtX4qwSus


the part i was looking at is that pre compression and post compression storage sizes are both displayed. this is important because if your destination is not using a zfs compression, then you will need to look at pre compression disk space usage to check that it will fit when backing up. (check the qnap response about this in this thread somewhere explaining how this works)

did anyone else spot what other hurdles there may be with this qts hero :'


data reduction statistics.... it doesn't seem as if it would show you how much space was saved based on filters like directory locations, media type etc..... it just show you a general statistics.... not sure if possible, but if it could inform the user what filtered media where compression is benefiting the most, that would be useful to know.

atm how i check on this is perhaps using qsirch (or the windows tree size app) to then sort by highest storage usage files in order, then replace the ones eating up the most space. I get a lot of savings by replacing x264 videos with x265 for an almost similar level of quality but a lot of space savings.

i would also usually notice that some videos have flac audio, so i'd probably replace that with AAC or opus versions which use less space, but still acceptable quality for most people.


@18:20 into the video, rob mentions that snapshots seem to be more faster. but does it also have better space savings for creating snapshots? or is that similar to the current snapshots in that aspect?


a funny pic analogy i found that sums up wut qts hero does for you. before and after :mrgreen:
Image

QTS Hero... ZFS? What? When?

Posted: Sun Jan 05, 2020 5:00 am
by Trexx
NASWorld has a QTS Hero in-line compression test video up

https://youtu.be/YPBk6-ryNnE


Sent from my iPhone using Tapatalk

Re: QTS Hero... ZFS? What? When?

Posted: Sun Jan 05, 2020 8:17 am
by Moogle Stiltzkin
so for qts hero do you suggest we select thin provisioning as shown in that video demo you linked?

or can i still use thick as usual? or is that not a good setting for zfs?

Re: QTS Hero... ZFS? What? When?

Posted: Sun Jan 05, 2020 9:32 am
by P3R
Trexx wrote:
Sun Jan 05, 2020 5:00 am
NASWorld has a QTS Hero in-line compression test video up...
I can record a 5 minute video with dramatic music that show you that a string is exactly 1 meter or 3.28084 feet long. Unfortunately that will not tell you how long strings are...

Without knowing exactly what data was compressed that video is just another Youtube waste of 5 minutes and 34 seconds of the viewers life (hopefully most at least skip through most of it if they feel the urge to watch). To save everyone else wasting their time, the claim made in the video is that 143.93 GB of totally unknown data can be compressed by 28.98 GB or 19.72 %... :S

Different (loss-less) compression algorithms can of course be slightly more or less effective but the differences are usually small and depend on what data is compressed. Encrypted or already compressed data will not really benefit from compression. Most media file formats today are already compressed.

Use Zip or any other compression tool on your own data sets to get an idea of how much you will be able to gain from inline ZFS compression. That will be much, much more useful than this YT-video.

Re: QTS Hero... ZFS? What? When?

Posted: Mon Jan 06, 2020 12:55 pm
by occamsrazor
I'm confused... is Hero available yet or not? This link doesn't work for me.. https://stage-software.qnap.com/qts-hero-edition.html

Re: QTS Hero... ZFS? What? When?

Posted: Mon Jan 06, 2020 9:20 pm
by P3R
occamsrazor wrote:
Mon Jan 06, 2020 12:55 pm
I'm confused... is Hero available yet or not?
As far as I know not as a separate software yet. It may be bundled on the new Special Edition Qnap models named TS-hXXXX if they're already available.
It's probably a test site that for a short time was available outside the organization by mistake. It was only a (non-working I believe) shop for buying the license, not the actual firmware.

Re: QTS Hero... ZFS? What? When?

Posted: Tue Jan 07, 2020 12:44 am
by storageman
The QTS Hero will be available to buy as OS for a select number of models.
I would recommend minimum 32GB of RAM regardless of what Qnap say.

Re: QTS Hero... ZFS? What? When?

Posted: Fri Feb 07, 2020 5:51 am
by qrusher
i think qts-h mode currently available on some series fw quite time
if some one can boot device on a last fw wo hdd there you can see init screen that let chng device init mode to qts-h

i think

https://www.qnap.com/en/how-to/faq/arti ... as-devices

after reinit from installed qts

x77u
x72u
x83u