www.pegasos.org :: View topic - Slow Gigabit upload

www.pegasos.org

Linux, BSD, Unix etc. - Slow Gigabit upload

judas - Nov 04, 2006 - 19:52
Post subject: Slow Gigabit upload

Hi,

using Suse 10 linux, I get 30Mb/s on download but only 2Mb/s on upload.
The onboard VIA does 9Mb/s in both directions.
?
Anyone has Gigabit working full speed in both directions ?

BTW: I tried with FTP, NC, NFS and Samba.
bye

Trizt - Nov 05, 2006 - 04:48
Post subject: Re: Slow Gigabit upload

It's a long time since I used the onboard Gigabit nic, but as far as I can remember I got quite okey speeds in both directions, but switched to a PCI gigabit nic which works better for me. You can play a bit with some of the kernel values to speed things up.

Code:

echo 0 > /proc/sys/net/ipv4/tcp_sack
echo 0 > /proc/sys/net/ipv4/tcp_timestamps
echo 0 > /proc/sys/net/ipv4/tcp_window_scaling
echo 1024 > /proc/sys/dev/rtc/max-user-freq
echo 2500000 > /proc/sys/net/core/wmem_max
echo 2500000 > /proc/sys/net/core/rmem_max
echo "4096 5000000 5000000" > /proc/sys/net/ipv4/tcp_rmem
echo "4096 65536 5000000" > /proc/sys/net/ipv4/tcp_wmem

If you want to speed up the NFS, you can tweak with the following values (must be set before NFS is started on the server, assuming you already set the wmem_max and rmem_max)

Code:

echo "1048560" > /proc/sys/net/core/rmem_default
echo "1048560" > /proc/sys/net/core/wmem_default

I think you should see some speed increase, the default values seems to be more fit for an 8Mbit connection

judas - Nov 05, 2006 - 09:18
Post subject:

Hi,
thanks a lot for your tweaking tips.
Unfortunately this didn't speed up my network.

I also tried a PCI Gigabit card ( realtek 8110 chip). It was properly detected, link was detected up, but no paket sent successfully.

What model of PCI Gigabit did you use ?

bye
Mr Walk

Trizt - Nov 05, 2006 - 09:39
Post subject:

The card I have is

Code:

00:06.0 Ethernet controller: D-Link System Inc Gigabit Ethernet Adapter (rev 11)
Subsystem: D-Link System Inc DGE-530T Gigabit Ethernet Adapter
Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B-
Status: Cap+ 66MHz+ UDF- FastB2B+ ParErr- DEVSEL=medium >TAbort- <TAbort- <MAbort- >SERR- <PERR-
Latency: 255 (5750ns min, 7750ns max)
Interrupt: pin A routed to IRQ 9
Region 0: Memory at 80004000 (32-bit, non-prefetchable) [size=16K]
Region 1: I/O ports at fe001200 [size=256]
Expansion ROM at 80020000 [disabled] [size=128K]
Capabilities: [48] Power Management version 2
Flags: PMEClk- DSI- D1+ D2+ AuxCurrent=0mA PME(D0+,D1+,D2+,D3hot+,D3cold+)
Status: D0 PME-Enable- DSel=0 DScale=1 PME-
Capabilities: [50] Vital Product Data

It uses the skge module and it works fine for me.

Forgot to mention, the harddrive speed will most likely be the limitation for you, it won't get any faster for you are using gigabit network, to get more out of your harddrives you need to play with the hdparm settings or attache a SATA-II card and hard drivers for it.

judas - Nov 08, 2006 - 20:10
Post subject:

I'll try to buy the same card. thnx

BTW: Harddrive speed is not my limitation. I use netcat and the file like /proc/kcore ( = raw mem image).

judas - Nov 29, 2006 - 19:49
Post subject:

I finally solved my gigbit problem.

It seemed to be caused by the Suse10-kernel. Now I installed 10.1 and Gigabit works flawless at full speed in both directions.

judas - Dec 28, 2006 - 15:28
Post subject:

Hi,

well, I was quite too optimistic with my solution of the Gigabit prob:

The Marvell makes the system lock, giving a nice Ooops of the kernel.

The Dlink-Card you used (which I bought, too) works flawless... you might think , but doing a "dmesg" show lots of fails of HW checksums of this card.
Although it doesn't lock my system, I doubt of its reliability for server usage ...

Which Linux distributions are working well with Gigabit on Peg2 ?

ironfist - Dec 28, 2006 - 16:43
Post subject:

Gentoo

Trizt - Dec 28, 2006 - 20:27
Post subject:

I guess Gentoo and Debian are the two which has people working or has worked with the gigabit driver. Not sure pick of distro will change things for you, it's still the same driver and of course the same hardware.

When it comes to my d-link card, I do not get any extra logs in dmesg, so it works well for me, so it could be that your card is broken, or in worst case maybe ecen your PCI is damaged.

At this moment, my server been up and workign for 208 days 10 hours and 36 minutes.

judas - Dec 28, 2006 - 22:46
Post subject:

Up to which rate did you test receiving on gigabit ?

More then 30Mb/s for 2 minutes ?

BTW: I doubt, it`s a hw prob, as I own 3 Peg2 and 2 Dlink-cards.