|
|
Chelsio “Terminator” T580-LP-CR – I have a pair of them. 2×40G Ethernet or 8×10G Ethernet (or mix and match to get 1×40G plus 4×10G). Offloaded TCP, UDP, iSCSI, FCoE, RDMA, PTP and even NAT. Probably not that exciting to anyone else, but they’re fucking wicked network cards.
[ATTACHED IMAGE - CLICK FOR FULL SIZE]
|
|
|
|
Re: New toy (greek pr0n) n/t
[Re: Vas Crabb]
#342107 - 07/03/15 04:04 PM
|
|
|
|
|
Re: New toy (geek pr0n)
[Re: Vas Crabb]
#342117 - 07/03/15 08:33 PM
|
|
|
Interesting. Though I'm kinda curious why one would bother these days with Wifi an all.....
|
Scifi frauds. SF illuminates.
_________________
Culture General Contact Unit (Eccentric)
|
|
|
Re: New toy (geek pr0n)
[Re: Traso]
#342124 - 07/03/15 10:10 PM
|
|
|
> Interesting. Though I'm kinda curious why one would bother these days with Wifi an all.....
Throughput on those sorts of cards is pretty killer. If he wired it up correctly and got the balancing right he could probably hit 3-4 gigabytes per second. It would take you about 2-3 seconds to copy a DVD across a network. I have a rack at work of this sort of stuff that I mess with daily. It is pretty fun to play with. It really changes the way you look at software when the network is not the bottleneck.
The best I have got out of my wifi is 45 meg a second and that is if I hold everything 'just right'. I typically get 30 MB a second. The router wired interface itself can peak at about 100 meg a second (being a 1 gigabit interface).
|
|
|
Tomu Breidah |
No Problems, Only Solutions
|
|
|
Reged: 08/14/04
|
Posts: 6820
|
Loc: Neither here, nor there.
|
|
Send PM
|
|
|
Re: New toy (geek pr0n)
[Re: lharms]
#342125 - 07/03/15 10:46 PM
|
|
|
> > Interesting. Though I'm kinda curious why one would bother these days with Wifi an > all..... > > Throughput on those sorts of cards is pretty killer. If he wired it up correctly and > got the balancing right he could probably hit 3-4 gigabytes per second. It would take > you about 2-3 seconds to copy a DVD across a network.
![](//www.mameworld.info/ubbthreads/images/graemlins/icon_eek.gif)
Dayum!
|
LEVEL-4
|
|
|
Re: New toy (geek pr0n)
[Re: Traso]
#342132 - 07/04/15 04:57 AM
|
|
|
> Interesting. Though I'm kinda curious why one would bother these days with Wifi an all.....
Wifi? Hahaha! That NIC is at least an order of magnitude faster than any wifi. With wifi all devices on the network are sharing the same aggregate bandwidth, whereas with copper/fibre each link has full dedicated bandwidth. You don’t need to worry about identifying and authenticating with the network when it’s taken care of by what you plug in where. Wifi suffers from wireless propagation and interference issues. Also wifi latency is bad because of the channel sounding and training sequences needed to try pushing high bandwidths over radio.
High-speed networking has a number of applications:
- High-speed data acquisition, where sensors produce data at very high rates and you have to get it to storage/processing (e.g. radio astronomy, particle accelerators)
- Storage centralisation/virtualisation, where you have all your disks managed by storage appliances and access it over the network (e.g. data centre or home SAN)
- Distributed computing where you need rapid synchronisation between nodes – the interconnect is usually the bottleneck in these cases
- Latency-critical applications where you need to respond to an input as quickly as possible (e.g. options market making, spread trading, statistical arbitrage)
That Chelsio NIC accelerates a number of common use cases. It does iSCSI and FCoE allowing you to use networked storage without the OS having to worry about the network part of it.
The Chelsio TCP offload engine takes care of window management, stream reconstruction, checksums and retransmissions so the OS doesn't have to do this. That alone saves significant CPU resources, memory bandwidth and cache thrashing. On top of that it also allows the final data to be DMA’d straight into the application’s address space, avoiding slow transitions between kernel mode and user mode and minimising copying. This improves wire-to-application latency enormously.
You can also go the other way and map a ring buffer to receive raw frames with no preprocessing applied. You can disable the NIC’s interrupts, run hot polling the buffer, and never sleep or get scheduled out by the kernel (so you never end up in a situation where data is available but you need to wait to be scheduled to process it).
So as I said, it’s a specialised piece of kit and not exciting for most people, but it does what it does very well. You have to be a geek to appreciate it.
|
|
|
|
Re: New toy (geek pr0n)
[Re: Tomu Breidah]
#342133 - 07/04/15 05:27 AM
|
|
|
> > Throughput on those sorts of cards is pretty killer. If he wired it up correctly and > > got the balancing right he could probably hit 3-4 gigabytes per second. It would take > > you about 2-3 seconds to copy a DVD across a network. > > Dayum!
Remember I’d also need to set up my storage properly to achieve that. A single SAS disk can transfer 6Gb/s at the interface and less at the platters/flash. So I’d need to have high-performance storage pools at both ends unless everything’s going to be cached in RAM.
|
|
|
italie![Administrator Administrator](//www.mameworld.info/ubbthreads/images/adm.gif) |
MAME owes italie many thank yous, hah
|
|
|
Reged: 09/20/03
|
Posts: 15246
|
Loc: BoomTown
|
|
Send PM
|
|
|
I came <nt>
[Re: Vas Crabb]
#342138 - 07/04/15 06:20 AM
|
|
|
|
|
Re: New toy (geek pr0n)
[Re: Vas Crabb]
#342139 - 07/04/15 06:31 AM
|
|
|
> > > Throughput on those sorts of cards is pretty killer. If he wired it up correctly > and > > > got the balancing right he could probably hit 3-4 gigabytes per second. It would > take > > > you about 2-3 seconds to copy a DVD across a network. > > > > Dayum! > > Remember I’d also need to set up my storage properly to achieve that. A single SAS > disk can transfer 6Gb/s at the interface and less at the platters/flash. So I’d need > to have high-performance storage pools at both ends unless everything’s going to be > cached in RAM.
What kind of cable are you using? Cat 6A?
|
|
|
|
Re: New toy (geek pr0n)
[Re: Waremonger]
#342140 - 07/04/15 06:39 AM
|
|
|
> What kind of cable are you using? Cat 6A?
QSFP+ direct attach twinax (this kind of thing). Have to be careful not to bend it too hard or it gets ruined. It doesn’t handle being put in cable management arms well at all.
|
|
|
|
Re: I came
[Re: italie]
#342141 - 07/04/15 06:41 AM
|
|
|
> Really fast too.
Yeah, iSCSI offload is great for virtualising and centralising your porn storage without a performance penalty when you want to watch it.
|
|
|
Andrew |
Girl Watcher
|
|
|
Reged: 09/21/03
|
Posts: 5082
|
Loc: Boston, Mass.
|
|
Send PM
|
|
|
|
![](//www.mameworld.info/ubbthreads/images/graemlins/icon_rolleyes.gif)
.
[ATTACHED IMAGE]
|
--
A story of one man and his obsession with the female anatomy.
|
|
|
Re: New toy (geek pr0n)
[Re: Vas Crabb]
#342145 - 07/04/15 07:56 AM
|
|
|
>Remember I’d also need to set up my storage properly to achieve that. A single SAS disk can transfer 6Gb/s at the interface and less at the platters/flash. So I’d need to have high-performance storage pools at both ends unless everything’s going to be cached in RAM.
What you dont have a multi stage 3par system that can handle 300k IOPs per sec? ![](//www.mameworld.info/ubbthreads/images/graemlins/wink.gif)
I wish I did! The best I can get out of my sys at work is about 'only' 700-900 meg a second for exactly that reason (so 30-40 seconds to copy a DVD ). I have not bothered to bond the network connections out as the software is not stressing it out anyway. Dont have the budget for that sort of HW at the time though that would spike out the connections Had to go with what I call the 'poor mans' SAS. Been having a lot more luck going thru optimizing particular bits of the software to run better (less CPU and less IO). It was originally a bit of a rush job. So there are some long standing design issues. Network hardware is not one of them...
|
|
|
|
I kicked its ass <nt>
[Re: Andrew]
#342146 - 07/04/15 11:08 AM
|
|
|
|
|
Re: New toy (geek pr0n)
[Re: Vas Crabb]
#342198 - 07/06/15 01:53 PM
|
|
|
That is some serious network hardware you got there. At one place I worked at for a while (a university lab doing research into genetics) we had a cluster/supercomputer that used Infiniband networking linking everything together. The gear was probably something like that I suspect.
|
|
|
|
Re: New toy (geek pr0n)
[Re: jonwil]
#342201 - 07/06/15 02:02 PM
|
|
|
> That is some serious network hardware you got there. > At one place I worked at for a while (a university lab doing research into genetics) > we had a cluster/supercomputer that used Infiniband networking linking everything > together. The gear was probably something like that I suspect.
InfiniBand uses a switched fabric topology with native transactions, channels and RDMA, and it’s not routable. Ethernet is a kind of lowest common denominator that everything eventually devolves to. InfiniBand does a better job as interconnect for a compute cluster. Ethernet has the advantage of using well-understood routable protocols with standardised programming interfaces.
|
|
|
GatKong![Moderator Moderator](//www.mameworld.info/ubbthreads/images/mod.gif) |
Tetris Mason
|
|
|
Reged: 04/20/07
|
Posts: 5907
|
Loc: Sector 9
|
|
Send PM
|
|
|
It got put down in your permanent record.
[Re: MooglyGuy]
#342206 - 07/06/15 04:49 PM
|
|
|
|
|
Re: New toy (geek pr0n)
[Re: Vas Crabb]
#342634 - 07/18/15 08:13 AM
|
|
|
> Wifi? Hahaha! That NIC is at least an order of magnitude faster than any wifi...So as I said, it’s a specialised piece of kit and not exciting for most people, but it does what it does very well. You have to be a geek to appreciate it.
Yeah. I understand. It's an industrial/commercial device, rather than a consumer one.
|
Scifi frauds. SF illuminates.
_________________
Culture General Contact Unit (Eccentric)
|
|