Table of Contents
Advertisement
Quick Links
Advertisement
Table of Contents
Related Manuals for Endace EDM01-25
Summary of Contents for Endace EDM01-25
- Page 1 DAG 8.4I Card User Guide EDM01-25...
- Page 2 Endace and any named company, or any sponsorship or endorsement by any named company. Use of the Endace products described in this document is subject to the Endace Terms of Trade and the Endace End User License Agreement (EULA).
-
Page 3: Table Of Contents
EDM01-25v4 DAG_8.4I_Card_User_Guide Contents Introduction Overview ..................................1 Card Features ................................1 Purpose of this User Guide ............................1 System Requirements..............................2 General ................................... 2 Operating System ..............................2 Other Systems................................ 2 Card Description ................................ 3 Battery removal – don’t do it! ..........................3 Card Architecture ............................... - Page 4 EDM01-25v4 DAG_8.4I_Card_User_Guide Synchronizing Clock Time Overview ................................... 31 DUCK Configuration ............................... 31 Common Synchronization ............................31 Network Time Protocol ............................32 Timestamps ................................33 Example ................................33 Dagclock ..................................34 Dagclock Statistics reset ............................. 35 Dagclock output explained ..........................36 Card with Reference ..............................
-
Page 5: Introduction
Introduction Overview The Endace DAG 8.4I card provides the means to transfer data into the memory of the host computer. Substantial buffering is provided to avoid packet loss in cases where data capture is limited by the PCIe bus bandwidth. Further, unlike a Network Interface Card (NIC), Endace products actively manage the movement of network data into memory while only consuming a minimal amount of the host computer's resources. -
Page 6: System Requirements
For details of the supported operating systems, see one of the following documents: • EDM04-01 DAG Software Installation Guide • Current release notes - See the Documentation CD or the Endace support website • https://www.endace.com/support Requires 12V external power via 4.2mm Pitch Mini-Fit Jr , 6 way, (PCI Express Card •... -
Page 7: Card Description
EDM01-25v4 DAG_8.4I_Card_User_Guide Card Description The Endace InfiniBand DAG 8.4I card is for use in InfiniBand networks running at 10 Gigabits per second over 4x copper cabling using single data rate (SDRx4, 2.5 Gigabits per second). The interface to the computer is an 8-lane PCIe, which has a throughput (receive- only) of 13 Gigabits per second. -
Page 8: Card Architecture
EDM01-25v4 DAG_8.4I_Card_User_Guide Caution Risk of explosion if the battery is replaced by an incorrect type. Dispose of used batteries carefully. Card Architecture SDRx4 Infiniband data, received by the two Infiniband interfaces, flows directly in to the Field Programmable Gate Array (FPGA). The FPGA contains the packet record processor and the DAG Universal Clock Kit (DUCK) timestamp engine. -
Page 9: Installation
EDM01-25v4 DAG_8.4I_Card_User_Guide Installation Introduction The DAG 8.4I card operates on an 8 lane PCIe bus and can be installed in any free 8 lane PCIe slot. The PCIe bus allows multiple DAG cards to be installed without affecting the bandwidth used by each DAG 8.4I card. Best performance (13 Gigabits per second) can only be achieved using an 8-lane PCIe slot, however the DAG card will function in a 4-lane PCIe slot. -
Page 10: Port Connectors
Some modern PSU units have connectors on the power supply designed to fit directly to this. Otherwise use the Endace supplied adapter cable to connects this input to a standard 5.25" Drive power connector on the system power supply unit. -
Page 11: Configuring The Dag Card
EDM01-25v4 DAG_8.4I_Card_User_Guide Configuring the DAG card Introduction Configuring the DAG 8.4I card ready for capturing data requires the following steps: Setting up the FPGA (page ) • Preparing the DAG card for use (page • Configuring the DAG Card (page •... -
Page 12: Setting Up The Fpga
EDM01-25v4 DAG_8.4I_Card_User_Guide Setting up the FPGA All DAG cards have at least one Field-Programmable Gate Array (FPGA). The FPGA contains the firmware for the DAG card. The firmware defines how the DAG card operates when capturing data and contains the specific configuration. Note: Some DAG cards have multiple FPGA's. -
Page 13: Dagrom
EDM01-25v4 DAG_8.4I_Card_User_Guide dagrom is a software utility that enables you to configure the FPGA on Endace DAG cards. dagrom The following is a list of options available in dagrom Option Description Use alternate (stable) half. [Default is current half.] Factory / User. -
Page 14: Loading New Firmware Images Onto A Dag Card
5vlx110tff1738 2008/03/03 16:53:05 Loading new firmware images onto a DAG Card New DAG card FPGA images are released regularly by Endace as part of software packages. They can be downloaded from the Endace website at https://www.endace.com/support Endace recommends you use the... -
Page 15: Configuring The Dag Card
EDM01-25v4 DAG_8.4I_Card_User_Guide Configuring the DAG card Display Current Configuration Once you have loaded the FPGA image you should run the tool without dagconfig arguments to display the current card configuration and verify the firmware has been loaded correctly. To display the default configuration for the first card, use: dagconfig –d0 where "0"... -
Page 16: Dagconfig Tokens Explained
EDM01-25v4 DAG_8.4I_Card_User_Guide dagconfig tokens explained align64 Sets the packets to be all generated as multiples of 8 bytes, 64-bit aligned, ( ) before align64 being received by the host. Not a configurable option. buffer_size The buffer size=nMB indicates that a total of n MB of memory have been allocated to the DAG card in total. - Page 17 EDM01-25v4 DAG_8.4I_Card_User_Guide You can split the DAG card's allocated memory between the receive and transmit stream buffers to suit your own requirements. The split is displayed as a ratio as shown below: mem=X:Y where: is the memory allocated in MB to the stream is the memory allocated in MB to the stream.
- Page 18 EDM01-25v4 DAG_8.4I_Card_User_Guide slen Before you begin to capture data you can set the size that you want the captured packets to be. You can do this using the tool to define the packet snaplength ( dagconfig slen Note: The snaplength value must be a multiple of 8 and in the range 48 to 9600 per card inclusive.
-
Page 19: Dagconfig Options
EDM01-25v4 DAG_8.4I_Card_User_Guide dagconfig options is a software utility used to configure and display statistics. dagconfig By default all commands, unless otherwise defined, run on device 0 ( ). Commands only apply to one DAG card. The following is a list options available in . -
Page 20: Viewing The Dag Card Status
EDM01-25v4 DAG_8.4I_Card_User_Guide Viewing the DAG card status Interface Status When you have configured the card according to your specific requirements you can view the interface statistics to check the status of each of the links using: dagconfig –d0 –s For more information see (page 15). -
Page 21: Extended Statistics
EDM01-25v4 DAG_8.4I_Card_User_Guide Extended Statistics Extended statistics are also available: There are multiple printout levels. The statistics displayed below are printout level 0. The following example shows the extended statistics. dagconfig –e Port rx_byte_count Status Conditions A definition of each status condition up to printout level 2 is described below: Condition Definition Indicates the port the status conditions apply to. -
Page 23: Using Your Dag Card To Capture Data
Data is collected in Extensible Record Format (ERF) which can then be viewed using dagbits or converted to other formats using dagconvert When capturing high speed data Endace recommends you use , see Capturing data at dagsnap high speed... -
Page 24: Dagsnap
EDM01-25v4 DAG_8.4I_Card_User_Guide dagsnap is a data capture software utility. dagsnap The following is a list of the options available in dagsnap Option Description Use the DAG device referred to by DEVICE. Supported syntax includes -d DEVICE 0, dag1, and /dev/dag3 to refer to DAG cards, and 0:2, dag1:0, and --device DEVICE /dev/dag2:0 to refer to specific streams on cards. -
Page 25: Capturing Data At High Speed
Data Formats (page ) later in this User Guide for more information on the Endace ERF record format. Increasing Buffer Size You can increase the size of the host computer buffer to enable it to cope with bursts of high traffic load on the network link. -
Page 26: Viewing Captured Data
(page dagbits Note: decodes and displays ERF header fields and packet contents are displayed dagbits as a Hex dump only. To decode higher level protocols, Endace recommends using a third party application, see Using third party applications (page Examples Test live traffic on dag0, stream 0 for 60 seconds running the lctr, flags and fcs tests:... -
Page 27: Additional Capture Feature
EDM01-25v4 DAG_8.4I_Card_User_Guide Expected number of packets to receive. Returns an error if the actual number is -n NUM different. Set legacy format to PoS (default: ATM). DAG 3.5S capture parameters. -P PARAMS Quiet. This instructs dagbits to suppress summary information when terminating. -
Page 28: Dagconvert
EDM01-25v4 DAG_8.4I_Card_User_Guide Dagconvert is a software utility for converting data to various file formats. Supported formats dagconvert are: File format Description Read ERF records directly from DAG card (input only). ERF (Extensible Record Format) file (input and output). Legacy ATM files (input only). Legacy Ethernet files (input only). -
Page 29: Using Third Party Applications
EDM01-25v4 DAG_8.4I_Card_User_Guide Using third party applications Once the captured data is in Pcap format you can use third party applications to examine and process the data. The third party applications include: Wireshark /Tshark (formerly Ethereal /Tethereal) • Wireshark (version 0.99.8 onwards) can read native InfiniBand packets. Note: Wireshark can also read ERF formatted data. -
Page 31: Classification
EDM01-25v4 DAG_8.4I_Card_User_Guide Classification Overview The DAG 8.4I classification feature, allows you to accept or reject InfiniBand packets based upon the following: • SLID - Source Identifier DLID - Destination Identifier • • SL - Service Level LNH - Local Routing Header field Link Next Header •... -
Page 32: Filter_Loader Application
EDM01-25v4 DAG_8.4I_Card_User_Guide filter_loader application application loads the filters into the TCAM and associated memory and filter_loader activates the filtering operation. The flow of data is shown below: ©2008Endace Technology Ltd. Confidential - Version 3 - June 2008... -
Page 33: Filter_Loader Operation
Packets are captured in either ERF or PCAP format depending on the application used to capture the data. Filter rule set are manually written in the Endace filter format. A DAG card running classification firmware supports up to eight databases, one active and the other inactive. -
Page 35: Synchronizing Clock Time
Common synchronization sources include GPS or CDMA (cellular telephone) time receivers. Endace also provides the TDS 2 Time Distribution Server modules and TDS 6 expansion units that enable you to connect multiple DAG cards to a single GPS or CDMA unit. -
Page 36: Network Time Protocol
EDM01-25v4 DAG_8.4I_Card_User_Guide Network Time Protocol NTP (Network Time Protocol) can be used to synchronize a computer clock to a network based reference. When the NTP daemon starts, it exchanges packets with network time servers to establish the correct time. If the computer clock is significantly different, the NTP can adjust the computer clock in a single large 'step'. -
Page 37: Timestamps
EDM01-25v4 DAG_8.4I_Card_User_Guide Timestamps ERF files contain a hardware generated timestamp of each packet’s arrival. The format of this timestamp is a single little-endian 64-bit fixed point number, representing the number of seconds since midnight on the 1 January 1970. The high 32-bits contain the integer number of seconds, while the lower 32-bits contain the binary fraction of the second. -
Page 38: Dagclock
EDM01-25v4 DAG_8.4I_Card_User_Guide Dagclock The DUCK is very flexible and can be used with or without an external time reference. It can accept synchronization from one of several input sources and also be made to drive its synchronization output from one of several sources. Synchronization settings are controlled by the utility. -
Page 39: Dagclock Statistics Reset
EDM01-25v4 DAG_8.4I_Card_User_Guide Dagclock Statistics reset Statistics are reset to zero when the following occur: Loading a DAG driver • Loading firmware • with a option • dagclock with a command. • dagclock set or reset Example To view the default configuration: dagclock dagclock –d0... -
Page 40: Dagclock Output Explained
EDM01-25v4 DAG_8.4I_Card_User_Guide Dagclock output explained Muxin Lists the time input source for this DAG card. The options are dagclock RS422in, Hostin, Overin or Auxin. Example muxin rs422 Muxout Lists the time output source for this DAG card. The options are dagclock RS422out, Hostout, Overout or Loop. - Page 41 EDM01-25v4 DAG_8.4I_Card_User_Guide Crystal This line reports on the DAG card crystal oscillator. Output Description Actual The DAG card's crystal frequency calculated based on the reference clock. Synthesized The target time stamping frequency. Different for each DAG card type. Example crystal Actual 100000028Hz Synthesized 67108864Hz Input This line reports on the time pulses received by the DAG card.
-
Page 42: Card With Reference
This is derived directly from an external reference source or distributed through the Endace TDS 2 (Time Distribution Server) module which allows two DAG cards to use a single receiver. It is also possible for more than two DAG cards to use a single receiver by “daisy-chaining”... -
Page 43: Single Card No Reference
EDM01-25v4 DAG_8.4I_Card_User_Guide Single Card No Reference When a single DAG card is used with no external reference, the DAG card can be synchronized to the host computer clock. Most computer clocks are not very accurate by themselves, but the DUCK drifts smoothly at the same rate as the computer clock. The synchronization achieved with this method is not as accurate as using an external reference source such as GPS. -
Page 44: Two Cards No Reference
EDM01-25v4 DAG_8.4I_Card_User_Guide Two Cards No Reference Overview If you are using two DAG cards in a single host computer with no reference clock, you must synchronize the DAG cards using the same method if you wish to compare the timestamps between the two DAG cards. -
Page 45: Synchronizing With Host
EDM01-25v4 DAG_8.4I_Card_User_Guide Synchronizing with Host To prevent the DAG card clock time-stamps drifting against UTC, the master DAG card can be synchronized to the host computer’s clock which in turn utilizes NTP. This provides a master signal to the slave DAG card. Configure one DAG card to synchronize to the computer clock and output a RS-422 synchronization signal to the second DAG card as follows: dagclock –d0 none overin overout... -
Page 46: Connector Pin-Outs
EDM01-25v4 DAG_8.4I_Card_User_Guide Connector Pin-outs Overview DAG cards have an 8-pin RJ45 connector for time synchronization. The connector has two bi-directional RS422 differential circuits, A and B. The Pulse Per Second (PPS) signal is carried on circuit A, and the SERIAL packet is connected to the B circuit. Pin Assignments The 8-pin RJ45 connector pin assignments and plugs and sockets are shown below: Out PPS+... -
Page 47: Data Formats
EDM01-25v4 DAG_8.4I_Card_User_Guide Data Formats Overview The DAG Card produces trace files in its own native format called ERF (Extensible Record Format). The ERF type depends upon the type of connection you are using to capture data. The DAG 8.4I supports the following ERF Types: ERF Type Description TYPE_INFINIBAND... -
Page 48: Generic Erf Header
EDM01-25v4 DAG_8.4I_Card_User_Guide Generic ERF Header All ERF records share some common fields. Timestamps are in little-endian (Pentium native) ® byte order. All other fields are in big-endian (network) byte order. All payload data is captured as a byte stream in network order, no byte or re-ordering is applied. The generic ERF header is shown below: The fields are described below: timestamp... - Page 49 EDM01-25v4 DAG_8.4I_Card_User_Guide wlen Wire length. Packet length "on the wire" including some protocol overhead. The exact interpretation of this quantity depends on physical medium. This may contain padding. extension Extension headers in an ERF record allow extra data relating to each packet to be transported headers to the host.
-
Page 50: Erf 21. Type_Infiniband
EDM01-25v4 DAG_8.4I_Card_User_Guide ERF 21. TYPE_INFINIBAND Type Bit 7 1 = Extension header present. See Extension Headers (page Bits 6:0 Type 21 Short description TYPE_INFINIBAND Long description Type 21 Infiniband Variable Length Record. This record format captures Infiniband data. Used in conjunction with EH 3. -
Page 51: Extension Headers (Eh)
EDM01-25v4 DAG_8.4I_Card_User_Guide Extension Headers (EH) Introduction The addition of an Extension Header into the ERF record allows extra data relating to the packet to be transported to the host. The extension header allows certain features to be added independently of ERF types, for example, features shared by different ERF records do not have to be implemented separately. -
Page 52: Eh 3. Classification
EDM01-25v4 DAG_8.4I_Card_User_Guide EH 3. Classification Type Bit 7 Extension header present Bits 6:0 Type 3 Short description Classification Long description Used with ERF 21. TYPE_INFINIBAND (page Entries marked Metadata are derived by firmware. Entries marked SRAM are stored in the TCAM Associated SRAM. Note: The following is provisional and subject to change. -
Page 53: Troubleshooting
EDM01-25v4 DAG_8.4I_Card_User_Guide Troubleshooting Reporting Problems If you have problems with a DAG 8.4I card or Endace supplied software which you are unable to resolve, please contact Endace Customer Support at support@endace.com Supplying as much information as possible enables Endace Customer Support to be more effective in their response to you. -
Page 55: Version History
EDM01-25v4 DAG_8.4I_Card_User_Guide Version History Version Date Reason March 2008 First release May 2008 Added Classification information June 2008 Added ERF Extension header information. Added card features and firmware image list. November 2008 Updated Buffer_size and mem dagconfig tokens and associated cross references.
Need help?
Do you have a question about the EDM01-25 and is the answer not in the manual?
Questions and answers