File Transfer (Win10-PC to NAS) slow on 10Gbe Connection

FTP Server, File Server, DDNS, SAMBA, AFP, NFS
Post Reply
Elfwyn
New here
Posts: 7
Joined: Wed Oct 21, 2020 10:15 am

File Transfer (Win10-PC to NAS) slow on 10Gbe Connection

Post by Elfwyn » Wed Oct 21, 2020 12:02 pm

Hello,

(Im new to this Forum and I hope I got everything right in my first post - please tell me if something is missing)

file transfers between my Windows 10(pro) PC and my QNAP TVS-673e over 10Gbe are averaging at 0.9 GBit/s and seldomly peak at 2 GBit/s

Machine Hardware:
--------------------------------
-The NAS has a AMD R-Serie RX-421BD Quad-Core 2,1 CPU and is running with QTS Version 4.4.3.1439
-The Windows 10 PC has a Intel Core i5 4690K Quad-Core 3,5 CPU.

Network Hardware:
--------------------------------
-Both machines have the Qnap QXG-10G1T with the AQC107 Chipset
-The Driver and Firmware for the Network Card have been updated to 2.1.21.0 on the Windows machine
-The Networt Card on the PC is situated in a PCIe 3.0 16x lane that utilizes 4x due to sharing according both to the Mainboard manual and HWInfox64.
-The Network Card on the NAS is in the supported PCIe 3.0 x4 expansion slot.


Network Configuration:
--------------------------------
-On the Windows Network Driver Jumbo Packet is set to 9014 Bytes.
-On the NAS Extension Card Jumbo Frame is set to 9000 respectively.
-Both Network Cards are connected directly through a short CAT 6(A) cable.
-The 10Gbe Network Card in the NAS is configured with a static IP
-The Windows PC has Network Drive mapped to the static IP of the NAS 10Gbe Adapter.

-The Primary 1Gbe Network Adapter on the NAS is getting a dynamic IP from the Network router and is connected to the Internet. (I have tried disconnecting the secondary 1Gbe connection on the NAS during the test and it had no effects on the 10Gbe speed)
-The Windows PC is also connected through a different 1Gbe Adapter to that same 1Gbe Network.


Harddrive Configuration / Raid Configuration
--------------------------------------------------
The NAS is Running Raid 1 with 2 x 8 TB WD-Red-PLUS 5400rpm Drives
Additionally there are 2 WD-RED 500 GB M.2 SATA SSDs configured in Raid 1 as Read/Write Cache.

Monitoring:
-----------------------------------
- I have seen no Packet losses using Network Monitoring Tools
- I tested speed with both small and large files (up to 14GB)
With large files the speed ramps up to about 2GBit/s and then quickly drops to about 1GBit/s for the rest of the copy process.
- Network Activity data is taken from both QTS Resourcemonitor and Windws 10 Resourcemonitor.

Conclusion:
------------------------------------
-The only bottleneck I could discern so far ist the 5400rpm Raid 1 Drives in the NAS.
-I had hoped that the SATA SSDs would mitigate the slow HDD speed through the write caching,
but I did not think it would be that bad.
I really have no idea if this is the cause of my problem.
To test this further I have ordered a Nvme Extension Card with 2 Seagate Cache drives and will use the SSDs for a tiered storage instead.

Thank you

Elf

User avatar
dolbyman
Guru
Posts: 20515
Joined: Sat Feb 12, 2011 2:11 am
Location: Vancouver BC , Canada

Re: File Transfer (Win10-PC to NAS) slow on 10Gbe Connection

Post by dolbyman » Wed Oct 21, 2020 12:54 pm

try to put the 10GbE network in a sepperate subnet..and test again

Elfwyn
New here
Posts: 7
Joined: Wed Oct 21, 2020 10:15 am

Re: File Transfer (Win10-PC to NAS) slow on 10Gbe Connection

Post by Elfwyn » Thu Oct 22, 2020 5:59 am

I have set up a Subnet in the following way:

Internet Router now has a subnetmask of 25 providing IPs from 1-127 through its DHCP Server
The Qnap Nas now has a Virtual Switch using a subnetmask of 25 and provides IPs from 128 to 254 through its own DHCP Server.
The Windows PC 10Gbe Ethernet is set to use the dynamic IP Resollution provided by the Virtual Switch

On a large File test I now had - at least for the initial run - a consistent file transfer rate of 230 MB/s (1.8 GBit/s)
which is finally out of the 1GbE territory.

Next I will try PCIe Nvme Caching to speed it up further.

I have also enabled Snapshots now for the first time, but I am not sure what kind of Impact that would have on Network performance / write speed with caching enabled.

User avatar
dolbyman
Guru
Posts: 20515
Joined: Sat Feb 12, 2011 2:11 am
Location: Vancouver BC , Canada

Re: File Transfer (Win10-PC to NAS) slow on 10Gbe Connection

Post by dolbyman » Thu Oct 22, 2020 6:08 am

I would have just put the 10GbE in a simple separate subnet to task .. left at /24

e.g.
Router and all the rest of the network devices (including 1GbE port from NAS)
192.168.0.0/24 (DHCP)
10GbE interface and the dedicated 10GBE card on your test computer
192.168.168.10.0/24 (fixed IP or DHCP whatever you like here)

Then access the SMB share from the client PC to the NAS via \\192.168.10.x and test away


I have a similar scenario at home.

I got a 5GbE USB-C adapter on my NUC
192.168.10.10 NAS 10GbE (fixed IP)
192.168.10.20 NUC 5GbE (fixed IP)

I have up and download speeds around 350MB\s (probably limitation of the 5GbE adapter)

Elfwyn
New here
Posts: 7
Joined: Wed Oct 21, 2020 10:15 am

Re: File Transfer (Win10-PC to NAS) slow on 10Gbe Connection

Post by Elfwyn » Thu Oct 22, 2020 10:25 pm

Using 2 Seagate Ironwolf Nvme 480TB Drives in Raid 1 on a PCIe 3.0 x4 Qnap Card and my former Cache Drives (2 WDRed 500 GB SATA M.2 Drives) in a QTier Configuration I now get up to 580 MB/s on large files (Around 4.5 GBit/s).

It is a steady increase, but I am still unsure where the bottleneck could be.
I will next try to reconfigure my Network in the suggested way.

User avatar
dolbyman
Guru
Posts: 20515
Joined: Sat Feb 12, 2011 2:11 am
Location: Vancouver BC , Canada

Re: File Transfer (Win10-PC to NAS) slow on 10Gbe Connection

Post by dolbyman » Thu Oct 22, 2020 11:27 pm

So you use Qtier with slower drives (SATA) to tier faster drives (NVMe), or the other way around ?

Elfwyn
New here
Posts: 7
Joined: Wed Oct 21, 2020 10:15 am

Re: File Transfer (Win10-PC to NAS) slow on 10Gbe Connection

Post by Elfwyn » Fri Oct 23, 2020 1:37 am

Tier 1 is Cache 2x Nvme M.2 SSD (Raid 1)
Tier 2 is 2x SATA M.2 SSD (Raid 1)
Tier 3 is 2x HDD 5200rpm (Raid 1)

before I had

Cache 2x SATA M.2 SSD (Raid 1)
2x HDD 5200rpm (Raid 1)

User avatar
dolbyman
Guru
Posts: 20515
Joined: Sat Feb 12, 2011 2:11 am
Location: Vancouver BC , Canada

Re: File Transfer (Win10-PC to NAS) slow on 10Gbe Connection

Post by dolbyman » Fri Oct 23, 2020 1:39 am

what is the speed on a pure SSD volume (NVME to get to 10GbE speeds) ?

Tiering is hit and miss for many

Elfwyn
New here
Posts: 7
Joined: Wed Oct 21, 2020 10:15 am

Re: File Transfer (Win10-PC to NAS) slow on 10Gbe Connection

Post by Elfwyn » Fri Oct 23, 2020 2:47 am

I converted my 2 Nvme SSDs into a Raid 0 Volume.
When Copying a 14-GB File from my Windows PC (Source Drive is a Samsung 960 EVO Nvme SSD) to that Volume over the 10GbE Network I got consistent Transfer speeds of 660 MB/s (5.2 GBit/s)

Post Reply

Return to “File Sharing”