HDD write speed suddenly very slow

Discuss and share your WD drive experience
User avatar
dolbyman
Guru
Posts: 20459
Joined: Sat Feb 12, 2011 2:11 am
Location: Vancouver BC , Canada

Re: HDD write speed suddenly very slow

Post by dolbyman » Tue Oct 16, 2018 3:40 am

can't say for RAM but CPU calculations for RAID0 are less than for RAID5 (parity calc)

maybe one disks is slow (internal problems?) maybe try to build a 3 disk RAID5 and test it with several disk combinations
:'

User avatar
Trexx
Ask me anything
Posts: 5304
Joined: Sat Oct 01, 2011 7:50 am
Location: Minnesota

Re: HDD write speed suddenly very slow

Post by Trexx » Tue Oct 16, 2018 4:12 am

Run this to get your actual HDD Read perf.

Code: Select all

qcli_storage -T


You could also do an iperf3 test by installing the package on your QNAP from http://qnapclub.eu and then testing from your desktop/laptop (assuming they have a package supported on your model).
Paul

Model: TS-877-1600 FW: 4.4.3.x
QTS (SSD): [RAID-1] 2 x 1TB WD Blue m.2's
Data (HDD): [RAID-5] 6 x 3TB HGST DeskStar
VMs (SSD): [RAID-1] 2 x 500GB Evo 860
Ext. (HDD): TR-004 [Raid-5] 4 x 4TB HGST Ultastor
RAM: Kingston HyperX Fury 64GB DDR4-2666
GPU: EVGA GTX 1060 6GB
UPS: CP AVR1350

Model:TVS-673 32GB FW: 4.4.3.x Test/Backup Box
Model:TS-228a FW: 4.4.3.x Test/Backup Box
-----------------------------------------------------------------------------------------------------------------------------------------
NAS RAID Rebuild Times | Live QTS Videos | | QNAP NAS Guide | Information needed when you ask for HELP | QNAP Links, Tutorials, etc.
2018 Plex NAS Compatibility Guide | QNAP Plex FAQ | Moogle's QNAP Faq

AlBundyLoves69
Starting out
Posts: 13
Joined: Thu Jan 28, 2016 1:25 am

Re: HDD write speed suddenly very slow

Post by AlBundyLoves69 » Tue Oct 16, 2018 4:20 am

Trexx wrote:Run this to get your actual HDD Read perf.

Code: Select all

qcli_storage -T


You could also do an iperf3 test by installing the package on your QNAP from http://qnapclub.eu and then testing from your desktop/laptop (assuming they have a package supported on your model).


This is the result - it looks OK, or not, or is it only reading performance?

Code: Select all

Start testing!
Performance test is finished 100.000%...
Enclosure  Port  Sys_Name      Throughput    RAID        RAID_Type    RAID_Throughput   Pool
NAS_HOST   1     /dev/sdb      144.20 MB/s   /dev/md1    RAID 1       136.32 MB/s       1
NAS_HOST   2     /dev/sda      139.46 MB/s   /dev/md1    RAID 1       136.32 MB/s       1

User avatar
dolbyman
Guru
Posts: 20459
Joined: Sat Feb 12, 2011 2:11 am
Location: Vancouver BC , Canada

Re: HDD write speed suddenly very slow

Post by dolbyman » Tue Oct 16, 2018 4:34 am

what drive models was it again ?

AlBundyLoves69
Starting out
Posts: 13
Joined: Thu Jan 28, 2016 1:25 am

Re: HDD write speed suddenly very slow

Post by AlBundyLoves69 » Tue Oct 16, 2018 4:36 am

dolbyman wrote:what drive models was it again ?


QNAP HS-251
2x WDC WD40EFRX-68WT0N0 4TB

User avatar
Trexx
Ask me anything
Posts: 5304
Joined: Sat Oct 01, 2011 7:50 am
Location: Minnesota

Re: HDD write speed suddenly very slow

Post by Trexx » Tue Oct 16, 2018 5:15 am

AlBundyLoves69 wrote:
Trexx wrote:Run this to get your actual HDD Read perf.

Code: Select all

qcli_storage -T


You could also do an iperf3 test by installing the package on your QNAP from http://qnapclub.eu and then testing from your desktop/laptop (assuming they have a package supported on your model).


This is the result - it looks OK, or not, or is it only reading performance?

Code: Select all

Start testing!
Performance test is finished 100.000%...
Enclosure  Port  Sys_Name      Throughput    RAID        RAID_Type    RAID_Throughput   Pool
NAS_HOST   1     /dev/sdb      144.20 MB/s   /dev/md1    RAID 1       136.32 MB/s       1
NAS_HOST   2     /dev/sda      139.46 MB/s   /dev/md1    RAID 1       136.32 MB/s       1


In terms of performance... you may be hitting a bottleneck due to the CPU (Intel Celeron J1800) as typically your raid throughput should be almost double your individual drive throughput.

I would suggest opening a helpdesk ticket with QNAP if you haven't already.
Paul

Model: TS-877-1600 FW: 4.4.3.x
QTS (SSD): [RAID-1] 2 x 1TB WD Blue m.2's
Data (HDD): [RAID-5] 6 x 3TB HGST DeskStar
VMs (SSD): [RAID-1] 2 x 500GB Evo 860
Ext. (HDD): TR-004 [Raid-5] 4 x 4TB HGST Ultastor
RAM: Kingston HyperX Fury 64GB DDR4-2666
GPU: EVGA GTX 1060 6GB
UPS: CP AVR1350

Model:TVS-673 32GB FW: 4.4.3.x Test/Backup Box
Model:TS-228a FW: 4.4.3.x Test/Backup Box
-----------------------------------------------------------------------------------------------------------------------------------------
NAS RAID Rebuild Times | Live QTS Videos | | QNAP NAS Guide | Information needed when you ask for HELP | QNAP Links, Tutorials, etc.
2018 Plex NAS Compatibility Guide | QNAP Plex FAQ | Moogle's QNAP Faq

AlBundyLoves69
Starting out
Posts: 13
Joined: Thu Jan 28, 2016 1:25 am

Re: HDD write speed suddenly very slow

Post by AlBundyLoves69 » Tue Oct 16, 2018 6:27 am

Trexx wrote:
In terms of performance... you may be hitting a bottleneck due to the CPU (Intel Celeron J1800) as typically your raid throughput should be almost double your individual drive throughput.

I would suggest opening a helpdesk ticket with QNAP if you haven't already.


I have opened already a week ago a ticket and may be THIS is the reason why QNAP doesn't answer since more than 1 week because they know they don't have any solution for me...
Another ticket of mine - opened after this one - has been answered after 1 day....

AlBundyLoves69
Starting out
Posts: 13
Joined: Thu Jan 28, 2016 1:25 am

Re: HDD write speed suddenly very slow

Post by AlBundyLoves69 » Tue Oct 16, 2018 7:17 am

Guys, I don't understand it.

After removing/creating the volume for at least 10 times and restarting the NAS several times, it suddenly got fixed.
Now the NAS is even faster than before:
  1. 14 days ago backup 730 GB needed 150 minutes
  2. now, 135 minutes

What I noticed was, that when the problems started, the NAS had around 85% of used RAM. Now, I cannot explain why and how, the NAS has ~40% used RAM and apparently this fixed the performance issue.

How ever, I disabled Apache because I need the Browser Interface only for updating the firmware.
When I have to update the firmware again, I enable Apache for the one session and disable it afterwards. I noticed that Apache was using lot of RAM.

User avatar
dolbyman
Guru
Posts: 20459
Joined: Sat Feb 12, 2011 2:11 am
Location: Vancouver BC , Canada

Re: HDD write speed suddenly very slow

Post by dolbyman » Tue Oct 16, 2018 7:24 am

not sure if qnap uses apache for the QTS gui.. so apache would be for websites installed NOT for NAS QTS web GUI

@ Trexx

That performance test was for RAID1 .. would that also result in 2x through output increase ?

AlBundyLoves69
Starting out
Posts: 13
Joined: Thu Jan 28, 2016 1:25 am

Re: HDD write speed suddenly very slow

Post by AlBundyLoves69 » Tue Oct 16, 2018 5:20 pm

[quote="dolbyman"]not sure if qnap uses apache for the QTS gui.. so apache would be for websites installed NOT for NAS QTS web GUI

I tested it: Apache is needed for QTS. Stopping the service and the web interface stops immediately working.

User avatar
Trexx
Ask me anything
Posts: 5304
Joined: Sat Oct 01, 2011 7:50 am
Location: Minnesota

Re: HDD write speed suddenly very slow

Post by Trexx » Tue Oct 16, 2018 10:04 pm

dolbyman wrote:not sure if qnap uses apache for the QTS gui.. so apache would be for websites installed NOT for NAS QTS web GUI

@ Trexx

That performance test was for RAID1 .. would that also result in 2x through output increase ?


The test will show your individual drives read performance as well as the RAID (if applicable) as a whole. So for a Raid-1 mirror, it can read from either drive, and on my SSD RAID-1, I get almost a 2x value vs. the individual drive. For say a 4 drive raid-5, you would be just under 4x the individual value. Of course this assume you are being CPU constrained, etc. since this is still SW raid and not HW offloaded Raid.
Paul

Model: TS-877-1600 FW: 4.4.3.x
QTS (SSD): [RAID-1] 2 x 1TB WD Blue m.2's
Data (HDD): [RAID-5] 6 x 3TB HGST DeskStar
VMs (SSD): [RAID-1] 2 x 500GB Evo 860
Ext. (HDD): TR-004 [Raid-5] 4 x 4TB HGST Ultastor
RAM: Kingston HyperX Fury 64GB DDR4-2666
GPU: EVGA GTX 1060 6GB
UPS: CP AVR1350

Model:TVS-673 32GB FW: 4.4.3.x Test/Backup Box
Model:TS-228a FW: 4.4.3.x Test/Backup Box
-----------------------------------------------------------------------------------------------------------------------------------------
NAS RAID Rebuild Times | Live QTS Videos | | QNAP NAS Guide | Information needed when you ask for HELP | QNAP Links, Tutorials, etc.
2018 Plex NAS Compatibility Guide | QNAP Plex FAQ | Moogle's QNAP Faq

User avatar
Trexx
Ask me anything
Posts: 5304
Joined: Sat Oct 01, 2011 7:50 am
Location: Minnesota

Re: HDD write speed suddenly very slow

Post by Trexx » Tue Oct 16, 2018 10:06 pm

AlBundyLoves69 wrote:Guys, I don't understand it.

After removing/creating the volume for at least 10 times and restarting the NAS several times, it suddenly got fixed.
Now the NAS is even faster than before:
  1. 14 days ago backup 730 GB needed 150 minutes
  2. now, 135 minutes

What I noticed was, that when the problems started, the NAS had around 85% of used RAM. Now, I cannot explain why and how, the NAS has ~40% used RAM and apparently this fixed the performance issue.

How ever, I disabled Apache because I need the Browser Interface only for updating the firmware.
When I have to update the firmware again, I enable Apache for the one session and disable it afterwards. I noticed that Apache was using lot of RAM.


If your memory footprint is reduced you would see performance improvement from a couple areas:
- reduced usage of swap space which will take performance in general
- usage of memory for caching storage (depending if you have that enabled in storage manager)
Paul

Model: TS-877-1600 FW: 4.4.3.x
QTS (SSD): [RAID-1] 2 x 1TB WD Blue m.2's
Data (HDD): [RAID-5] 6 x 3TB HGST DeskStar
VMs (SSD): [RAID-1] 2 x 500GB Evo 860
Ext. (HDD): TR-004 [Raid-5] 4 x 4TB HGST Ultastor
RAM: Kingston HyperX Fury 64GB DDR4-2666
GPU: EVGA GTX 1060 6GB
UPS: CP AVR1350

Model:TVS-673 32GB FW: 4.4.3.x Test/Backup Box
Model:TS-228a FW: 4.4.3.x Test/Backup Box
-----------------------------------------------------------------------------------------------------------------------------------------
NAS RAID Rebuild Times | Live QTS Videos | | QNAP NAS Guide | Information needed when you ask for HELP | QNAP Links, Tutorials, etc.
2018 Plex NAS Compatibility Guide | QNAP Plex FAQ | Moogle's QNAP Faq

User avatar
dolbyman
Guru
Posts: 20459
Joined: Sat Feb 12, 2011 2:11 am
Location: Vancouver BC , Canada

Re: HDD write speed suddenly very slow

Post by dolbyman » Mon Mar 16, 2020 12:56 pm

please stop digging up old threads for blerps

User avatar
OneCD
Ask me anything
Posts: 8088
Joined: Sun Aug 21, 2016 10:48 am
Location: "... there, behind that sofa!"

Re: HDD write speed suddenly very slow

Post by OneCD » Tue Mar 17, 2020 8:40 am

IHTurbo wrote:
Tue Mar 17, 2020 8:21 am
I have no idea what a blerp is, but maybe you should delete the Posts older than yesterday then.

All knowledge is cumulative.
And what harm is it doing exactly?
@dolbyman is kindly advising you as to local forum etiquette preferred by the daily contributors.

Which is to not revive old, inactive threads. Currently, we're working on the premise that if a topic hasn't been posted-to for one year, it's dead and should be left alone.

ImageImageImageImageImageImageImageImageImageImageImageImageImageImageImageImageImage

Locked

Return to “Western Digital Drive Discussion”