MAMEWorld >> The Loony Bin
View all threads Index   Threaded Mode Threaded  

Pages: 1

Vas Crabb
BOFH
Reged: 12/13/05
Posts: 4464
Loc: Melbourne, Australia
Send PM


New toy (geek pr0n)
#342102 - 07/03/15 12:21 PM Attachment: terminator.jpg 521 KB (0 downloads)


Chelsio “Terminator” T580-LP-CR – I have a pair of them. 2×40G Ethernet or 8×10G Ethernet (or mix and match to get 1×40G plus 4×10G). Offloaded TCP, UDP, iSCSI, FCoE, RDMA, PTP and even NAT. Probably not that exciting to anyone else, but they’re fucking wicked network cards.

[ATTACHED IMAGE - CLICK FOR FULL SIZE]

Attachment



Robbbert
Sir
Reged: 08/21/04
Posts: 3203
Loc: A long way from you
Send PM


Re: New toy (greek pr0n) n/t new [Re: Vas Crabb]
#342107 - 07/03/15 04:04 PM





Traso
MAME Fan
Reged: 01/15/13
Posts: 2687
Send PM


Re: New toy (geek pr0n) new [Re: Vas Crabb]
#342117 - 07/03/15 08:33 PM


Interesting. Though I'm kinda curious why one would bother these days with Wifi an all.....



Scifi frauds. SF illuminates.
_________________

Culture General Contact Unit (Eccentric)



lharms
MAME Fan
Reged: 01/07/06
Posts: 908
Send PM


Re: New toy (geek pr0n) new [Re: Traso]
#342124 - 07/03/15 10:10 PM


> Interesting. Though I'm kinda curious why one would bother these days with Wifi an all.....

Throughput on those sorts of cards is pretty killer. If he wired it up correctly and got the balancing right he could probably hit 3-4 gigabytes per second. It would take you about 2-3 seconds to copy a DVD across a network. I have a rack at work of this sort of stuff that I mess with daily. It is pretty fun to play with. It really changes the way you look at software when the network is not the bottleneck.

The best I have got out of my wifi is 45 meg a second and that is if I hold everything 'just right'. I typically get 30 MB a second. The router wired interface itself can peak at about 100 meg a second (being a 1 gigabit interface).



Tomu Breidah
No Problems, Only Solutions
Reged: 08/14/04
Posts: 6820
Loc: Neither here, nor there.
Send PM


Re: New toy (geek pr0n) new [Re: lharms]
#342125 - 07/03/15 10:46 PM


> > Interesting. Though I'm kinda curious why one would bother these days with Wifi an
> all.....
>
> Throughput on those sorts of cards is pretty killer. If he wired it up correctly and
> got the balancing right he could probably hit 3-4 gigabytes per second. It would take
> you about 2-3 seconds to copy a DVD across a network.




Dayum!






LEVEL-4



Vas Crabb
BOFH
Reged: 12/13/05
Posts: 4464
Loc: Melbourne, Australia
Send PM


Re: New toy (geek pr0n) new [Re: Traso]
#342132 - 07/04/15 04:57 AM


> Interesting. Though I'm kinda curious why one would bother these days with Wifi an all.....

Wifi? Hahaha! That NIC is at least an order of magnitude faster than any wifi. With wifi all devices on the network are sharing the same aggregate bandwidth, whereas with copper/fibre each link has full dedicated bandwidth. You don’t need to worry about identifying and authenticating with the network when it’s taken care of by what you plug in where. Wifi suffers from wireless propagation and interference issues. Also wifi latency is bad because of the channel sounding and training sequences needed to try pushing high bandwidths over radio.

High-speed networking has a number of applications:

  • High-speed data acquisition, where sensors produce data at very high rates and you have to get it to storage/processing (e.g. radio astronomy, particle accelerators)
  • Storage centralisation/virtualisation, where you have all your disks managed by storage appliances and access it over the network (e.g. data centre or home SAN)
  • Distributed computing where you need rapid synchronisation between nodes – the interconnect is usually the bottleneck in these cases
  • Latency-critical applications where you need to respond to an input as quickly as possible (e.g. options market making, spread trading, statistical arbitrage)


That Chelsio NIC accelerates a number of common use cases. It does iSCSI and FCoE allowing you to use networked storage without the OS having to worry about the network part of it.

The Chelsio TCP offload engine takes care of window management, stream reconstruction, checksums and retransmissions so the OS doesn't have to do this. That alone saves significant CPU resources, memory bandwidth and cache thrashing. On top of that it also allows the final data to be DMA’d straight into the application’s address space, avoiding slow transitions between kernel mode and user mode and minimising copying. This improves wire-to-application latency enormously.

You can also go the other way and map a ring buffer to receive raw frames with no preprocessing applied. You can disable the NIC’s interrupts, run hot polling the buffer, and never sleep or get scheduled out by the kernel (so you never end up in a situation where data is available but you need to wait to be scheduled to process it).

So as I said, it’s a specialised piece of kit and not exciting for most people, but it does what it does very well. You have to be a geek to appreciate it.



Vas Crabb
BOFH
Reged: 12/13/05
Posts: 4464
Loc: Melbourne, Australia
Send PM


Re: New toy (geek pr0n) new [Re: Tomu Breidah]
#342133 - 07/04/15 05:27 AM


> > Throughput on those sorts of cards is pretty killer. If he wired it up correctly and
> > got the balancing right he could probably hit 3-4 gigabytes per second. It would take
> > you about 2-3 seconds to copy a DVD across a network.
>
> Dayum!

Remember I’d also need to set up my storage properly to achieve that. A single SAS disk can transfer 6Gb/s at the interface and less at the platters/flash. So I’d need to have high-performance storage pools at both ends unless everything’s going to be cached in RAM.



italieAdministrator
MAME owes italie many thank yous, hah
Reged: 09/20/03
Posts: 15246
Loc: BoomTown
Send PM


I came <nt> new [Re: Vas Crabb]
#342138 - 07/04/15 06:20 AM



Really fast too.



Waremonger
Reged: 01/18/05
Posts: 910
Send PM


Re: New toy (geek pr0n) new [Re: Vas Crabb]
#342139 - 07/04/15 06:31 AM


> > > Throughput on those sorts of cards is pretty killer. If he wired it up correctly
> and
> > > got the balancing right he could probably hit 3-4 gigabytes per second. It would
> take
> > > you about 2-3 seconds to copy a DVD across a network.
> >
> > Dayum!
>
> Remember I’d also need to set up my storage properly to achieve that. A single SAS
> disk can transfer 6Gb/s at the interface and less at the platters/flash. So I’d need
> to have high-performance storage pools at both ends unless everything’s going to be
> cached in RAM.

What kind of cable are you using? Cat 6A?



Vas Crabb
BOFH
Reged: 12/13/05
Posts: 4464
Loc: Melbourne, Australia
Send PM


Re: New toy (geek pr0n) new [Re: Waremonger]
#342140 - 07/04/15 06:39 AM


> What kind of cable are you using? Cat 6A?

QSFP+ direct attach twinax (this kind of thing). Have to be careful not to bend it too hard or it gets ruined. It doesn’t handle being put in cable management arms well at all.



Vas Crabb
BOFH
Reged: 12/13/05
Posts: 4464
Loc: Melbourne, Australia
Send PM


Re: I came new [Re: italie]
#342141 - 07/04/15 06:41 AM


> Really fast too.

Yeah, iSCSI offload is great for virtualising and centralising your porn storage without a performance penalty when you want to watch it.



Andrew
Girl Watcher
Reged: 09/21/03
Posts: 5082
Loc: Boston, Mass.
Send PM


I saw <nt> new [Re: italie]
#342144 - 07/04/15 07:03 AM Attachment: tumblr_nam1meMMts1tggwujo1_500.gif 1285 KB (0 downloads)















.

[ATTACHED IMAGE]

Attachment



--
A story of one man and his obsession with the female anatomy.



lharms
MAME Fan
Reged: 01/07/06
Posts: 908
Send PM


Re: New toy (geek pr0n) new [Re: Vas Crabb]
#342145 - 07/04/15 07:56 AM


>Remember I’d also need to set up my storage properly to achieve that. A single SAS disk can transfer 6Gb/s at the interface and less at the platters/flash. So I’d need to have high-performance storage pools at both ends unless everything’s going to be cached in RAM.

What you dont have a multi stage 3par system that can handle 300k IOPs per sec?

I wish I did! The best I can get out of my sys at work is about 'only' 700-900 meg a second for exactly that reason (so 30-40 seconds to copy a DVD ). I have not bothered to bond the network connections out as the software is not stressing it out anyway. Dont have the budget for that sort of HW at the time though that would spike out the connections Had to go with what I call the 'poor mans' SAS. Been having a lot more luck going thru optimizing particular bits of the software to run better (less CPU and less IO). It was originally a bit of a rush job. So there are some long standing design issues. Network hardware is not one of them...



MooglyGuy
Renegade MAME Dev
Reged: 09/01/05
Posts: 2261
Send PM


I kicked its ass <nt> new [Re: Andrew]
#342146 - 07/04/15 11:08 AM


> .



jonwil
Lurker
Reged: 10/06/03
Posts: 536
Send PM


Re: New toy (geek pr0n) new [Re: Vas Crabb]
#342198 - 07/06/15 01:53 PM


That is some serious network hardware you got there.
At one place I worked at for a while (a university lab doing research into genetics) we had a cluster/supercomputer that used Infiniband networking linking everything together. The gear was probably something like that I suspect.



Vas Crabb
BOFH
Reged: 12/13/05
Posts: 4464
Loc: Melbourne, Australia
Send PM


Re: New toy (geek pr0n) new [Re: jonwil]
#342201 - 07/06/15 02:02 PM


> That is some serious network hardware you got there.
> At one place I worked at for a while (a university lab doing research into genetics)
> we had a cluster/supercomputer that used Infiniband networking linking everything
> together. The gear was probably something like that I suspect.

InfiniBand uses a switched fabric topology with native transactions, channels and RDMA, and it’s not routable. Ethernet is a kind of lowest common denominator that everything eventually devolves to. InfiniBand does a better job as interconnect for a compute cluster. Ethernet has the advantage of using well-understood routable protocols with standardised programming interfaces.



GatKongModerator
Tetris Mason
Reged: 04/20/07
Posts: 5907
Loc: Sector 9
Send PM


It got put down in your permanent record. new [Re: MooglyGuy]
#342206 - 07/06/15 04:49 PM









Traso
MAME Fan
Reged: 01/15/13
Posts: 2687
Send PM


Re: New toy (geek pr0n) new [Re: Vas Crabb]
#342634 - 07/18/15 08:13 AM


> Wifi? Hahaha! That NIC is at least an order of magnitude faster than any wifi...So as I said, it’s a specialised piece of kit and not exciting for most people, but it does what it does very well. You have to be a geek to appreciate it.


Yeah. I understand. It's an industrial/commercial device, rather than a consumer one.



Scifi frauds. SF illuminates.
_________________

Culture General Contact Unit (Eccentric)


Pages: 1

MAMEWorld >> The Loony Bin
View all threads Index   Threaded Mode Threaded  

Extra information Permissions
Moderator:  GatKong 
0 registered and 133 anonymous users are browsing this forum.
You cannot start new topics
You cannot reply to topics
HTML is enabled
UBBCode is enabled
Thread views: 2458