User Guide Introduction Although IEEE 1588 Precision Time Protocol (PTP) support has been part of Intel's controller product line for generations. Intel only recently began developing PTP-optimized Ethernet Network Adapter products. The adoption of PTP in Ethernet connections is growing rapidly. Although the leader use case being considered is the build-out of 5G infrastructure, other applications that exist in datacenters, point of presence, financial, industrial, and energy sectors.
Page 6
® Intel Ethernet Network Adapter E810-XXVDA4T User Guide • ITU-T G.8271 • ITU-T G.8273 • ITU-T G.8273.2 • ITU-T G.8275.1 • ITU-T G.8275.2 Note: Linux PTP project information can be found at: http://linuxptp.sourceforge.net/ 646265-004 Did this document help answer your questions?
• Driver support for Linux PTP stack (ptp4l) to send synchronization messages and synchronize the host system clock to the adapter's PHC. This is present in all Intel network adapters. • Newly-developed utility (ts2phc) for the Linux PTP stack optimized for synchronizing the PHC to a 1PPS input, rather than PTP messages.
Page 8
® Intel Ethernet Network Adapter E810-XXVDA4T User Guide Table 2 provides additional information on the E810-XXVDA4T: Table 2. E810-XXVDA4T Product Information Product Description 1588 PTP/SyncE/GNSS 10/25GbE SFP28 PCIe adapter E810-XXVDA4TG1 (no GNSS) Product Codes E810-XXV-DA4TGG1 (with GNSS) Host Interface PCIe 3.0x16 or PCIe 4.0x8/x16 (x16 connector)
® Intel Ethernet Network Adapter E810-XXVDA4T User Guide Architecture The block diagram for the E810-XXVDA4T is shown in Figure 1. The E810-XXVDA4T provides two coaxial input/output SMA connectors, two U.FL connectors, and an optional GNSS input connector, as shown in Figure U.FL2...
Page 10
® Intel Ethernet Network Adapter E810-XXVDA4T User Guide The optional GNSS module has a connection to an external antenna via an SMB female connector at the bottom of the faceplate. A cable with an SMB male connector and the characteristics listed in...
® Intel Ethernet Network Adapter E810-XXVDA4T User Guide Synchronization Signaling The E810-XXVDA4T has two SMA connectors at the faceplate and two on-board U.FL connectors for 1588 high precision timing connectivity. Each SMA signal can be configured to be an input or an output.
1. Support for Extended PTP and SyncE, but no GNSS console data yet. Legend: ® Supported with Intel NVM and software driver. ® Not supported with Intel NVM and software driver. Supported but Not Validated. Available in a future release. ® Refer to the Intel Ethernet Controller E810 Feature Support Matrix for additional NVM and software driver details.:...
Page 13
6. Download and install linuxptp, version 3.1.1 or later from SourceForge: https://sourceforge.net/projects/linuxptp/ or use: # git clone git://git.code.sf.net/p/linuxptp/code linuxptp 7. Download and install synce4l from: https://github.com/intel/synce4l or use: #git clone http://github.com/intel/synce4l synce4l 646265-004 Did this document help answer your questions?
Building a synce4l Tool 1. Download the latest synce4l from: https://github.com/intel/synce4l or use: #git clone http://github.com/intel/synce4l synce4l 2. Navigate to the extracted directory and compile the source code: # cd synce4l # make 646265-004 Did this document help answer your questions?
Page 15
® Intel Ethernet Network Adapter E810-XXVDA4T User Guide 3. To install the program and related man pages into /usr/local, run make install with root privileges. # make install This enables you to run the tools from any directory. 4. For more details related to installing synce4l, go to: https://github.com/intel/synce4l...
® Intel Ethernet Network Adapter E810-XXVDA4T User Guide Configuring the E810-XXVDA4T Using the Linux Kernel Interface Note: The way we communicate with the Linux kernel interface might change in a later revision of the driver. Introduction The Linux kernel provides the standard interface for controlling external synchronization pins. Older versions that do not have this feature are not supported.
® Intel Ethernet Network Adapter E810-XXVDA4T User Guide In the following example, the ens260f0 net interface exposes pins through the ptp7 interface: #ls -R /sys/class/net/*/device/ptp/*/pins /sys/class/net/ens260f0/device/ptp/ptp7/pins: GNSS SMA1 SMA2 U.FL1 U.FL2 Users can also run ethtool -T <interface_name> to show the PTP clock number.
® Intel Ethernet Network Adapter E810-XXVDA4T User Guide External Connectors External connector configuration is available only on the port that owns the PTP timer. By default, it is Port 0. The E810-XXVDA4T has four connectors for external 1PPS signals: SMA1, SMA2, U.FL1, and U.FL2 •...
® Intel Ethernet Network Adapter E810-XXVDA4T User Guide Note: If more than one TTY interface is needed (like both ts2phc and gpsmon) you can multiplex the TTY using open source `ttybus` project* - “Use case 1” from their README. https://github.com/danielinux/ttybus Periodic Outputs from DPLL (SMA and U.FL Pins)
® Intel Ethernet Network Adapter E810-XXVDA4T User Guide EEC DPLL: Current reference: GNSS-1PPS Status: locked_ho_acq PPS DPLL: Current reference: GNSS-1PPS Status: locked_ho_acq Phase offset [ns]: 3647 The first section of the log shows the status of CGU inputs (references), including its index number.
® Intel Ethernet Network Adapter E810-XXVDA4T User Guide DPLL monitoring can be enabled (on) or disabled (off) by using the ethtool command in the Linux kernel. # export ETH=ens801f0 ethtool --show-priv-flags $ETH Private flags for ens801f0: link-down-on-close : off fw-lldp-agent...
Page 25
® Intel Ethernet Network Adapter E810-XXVDA4T User Guide 1| invalid| 7000| 1| invalid| 7000| valid| | pin| enabled| dpll| freq| eSync| 156250000| 156250000| In the “in” table. the pin numbers are referred from the DPLL Priority See Section 4.2, “DPLL Priority”.
® Intel Ethernet Network Adapter E810-XXVDA4T User Guide Example: # export ETH=enp1s0f0 Set freq to 10 MHz on input pin 4: DPLL will lock only if 10 MHz signals arrive on SMA1 and it has been enabled for input. # echo "in pin 4 freq 10000000" > /sys/class/net/$ETH/device/pin_cfg Set freq to 10 MHz on output pin 1: SMA2 will drive 10 MHz signal with embedded 1PPS if it has been enabled for output.
® Intel Ethernet Network Adapter E810-XXVDA4T User Guide 4.12 1PPS Signals from E810 Device to DPLL The E810-XXVDA4T implements two 1PPS signals coming out of the MAC (E810 device) to the DPLL. They serve as the phase reference (CVL-SDP20) and as both phase and frequency reference (CVL- SDP22) signals.
® Intel Ethernet Network Adapter E810-XXVDA4T User Guide 4.15.1 Prerequisites and Steps to Fully Enable GNSS Features Prerequisites: • Linux Kernel 4.19+. Supported kernels can be found at: https://cateee.net/lkddb/web-lkddb/GNSS_UBX_SERIAL.html A long-term support kernel is strongly recommended. Check: https://www.kernel.org/ • Ensure that the gnss, gnss_serial, and gnss_ubx modules are all enabled in kernel config file.
Page 31
11. Extend Python serial library to recognize the E810-XXVDA4T: a. You can manually add /dev/gnss* and /dev/ttyGNSS* into list_ports_linux.py to extend Python serial API capability to recognize the COM port from Intel ice driver, Following is a example: def comports(include_links=False): devices = glob.glob('/dev/ttyS*')
Page 32
® Intel Ethernet Network Adapter E810-XXVDA4T User Guide Setup compliance verification: Before starting the gpsd APIs, the Antenna setup and GNSS firmware must be done. • Antenna compliance: — All the GNSS applications’ performance is expected to get good quality of antenna signal so the software APIs can run on top of stable NMEA sentences.
Page 33
® Intel Ethernet Network Adapter E810-XXVDA4T User Guide Note: Configuring the device is recommended via ubxtool. Pygpsclient configuration options might be unstable. — xgps xgps is a easy-use GUI to sanity check GNSS sky-view without a complex config process.
Page 34
® Intel Ethernet Network Adapter E810-XXVDA4T User Guide — ubxtool ubxtool is an original vendor-supported tool that can make use of u-Blox vendor commands on support protocol version 29.20 to ZED-F9T-00B. If the 5G deploy environment does not allow you to use the Desktop environment, you can consider ubxtool as efficient CLI for local and remote access.
® Intel Ethernet Network Adapter E810-XXVDA4T User Guide 4.15.5 Check GNSS Overall Configuration Performance You might want to check your antenna and GNSS receiver overall performance with the Time-to-First-Fix (TTFF) value. After a power-down (warm starts, hot starts), the GNSS device triggers a next TTFF value based on antenna setting (or skyview, etc.).
® Intel Ethernet Network Adapter E810-XXVDA4T User Guide Configuration Setup The E810-XXVDA4T provides two coaxial input-output SMA connectors, two unidirectional U.FL connectors and an optional GNSS input connector, as shown in the following two illustrations. U.FL2 U.FL1 Optional GNSS Module...
Figure 5. External Connections: PTP Grand Leader with Optional GNSS Module GNSS Server E810-XXVDA4T Gen4 x8 System Clock Generation Intel® Xeon® Scalable Processor Figure 6. External Connections: Single E810-XXVDA4T Configuration with GNSS 646265-004 Did this document help answer your questions?
® Intel Ethernet Network Adapter E810-XXVDA4T User Guide 5.2.2 Software Configuration System Clock phc2sys ts2phc Network ptp4l Tx/Rx Timestamps 1PPS GNSS Time of Day (through serial port) Figure 7. Linux Software Stack Overview: Single E810-XXVDA4T with GNSS Software Stack Before proceeding, it is recommended to set all SDP pins and U.FL to off (see Section 4.0).
Page 42
® Intel Ethernet Network Adapter E810-XXVDA4T User Guide 4. Run phc2sys: # ./phc2sys -s $ETH -O -37 -m The -O -37 can be used to accommodate for leap seconds Note: To update linuxptp version, use git clone: git clone git://git.code.sf.net/p/linuxptp/code To get an appropriate leapfile for RHEL-based Linux distributions: https://github.com/eggert/tz/blob/main/leap-seconds.list...
® Intel Ethernet Network Adapter E810-XXVDA4T User Guide Boundary Clock Configuration 5.4.1 External Connections Red = 1PPS input Blue = ptp4l Green = Optional 1PPS output Leader Grand Leader Port0 Port1 Port2 Port3 SMA1 SMA2 U.FL1 E810-XXVDA4T U.FL2 Figure 9.
Page 46
® Intel Ethernet Network Adapter E810-XXVDA4T User Guide Note: DPLL only syncs to SDP20/SDP22 if it is the higher priority. Setting SDP20 is the preferred method for synchronizing 1PPS outputs. 3. Enable SMA1 output (for visibility): # echo 2 1 > /sys/class/net/$ETH/device/ptp/ptp*/pins/SMA1 •...
® Intel Ethernet Network Adapter E810-XXVDA4T User Guide Port Configured as Follower The E810-XXVDA4T has one PHC that is shared across all the ports. As a result, only one PTP follower can be run as shown. 5.5.1 External Connections Green = 1PPS output...
Page 48
® Intel Ethernet Network Adapter E810-XXVDA4T User Guide Note: If U.FL1 if set to Tx then SMA1 is also set to Rx and cannot be changed. Make sure no 1PPS input is connected to SMA1 if using U.FL1 as Tx.
® Intel Ethernet Network Adapter E810-XXVDA4T User Guide SyncE Setup This configuration shows how to specifically setup SyncE. Note that users can use this SyncE configuration with tools such as ptp4l together for clock recovery. SyncE ITU G.811 and G8262 can assist with better frequency synchronization.
Two E810-XXVDA4T without GNSS Configuration Figure 12 shows two E810-XXVDA4T in a system with a cell site router. Server E810-XXVDA4T Gen4 x8 PHC1 System Clock Generation Intel® Xeon® Gen4 x8 E810-XXVDA4T Scalable Processor PHC2 Intel® vRAN Accelerator ACC100 Gen3 x16 Mt.
Page 51
® Intel Ethernet Network Adapter E810-XXVDA4T User Guide System Clock phc2sys phc_ctl PHC2 PHC1 Network NIC1 NIC2 ptp4l ptp4l Figure 13. External Connections: Two E810-XXVDA4T without GNSS Linux Software Stack NIC1 Linux software stack: System Clock phc2sys PHC1 Network ptp4l Tx/Rx Timestamps Figure 14.
Page 52
® Intel Ethernet Network Adapter E810-XXVDA4T User Guide NIC2 Linux software stack: System Clock phc_ctl PHC2 Network ptp4l Tx/Rx Timestamps Figure 15. External Connections: Two E810-XXVDA4T without GNSS NIC1 Software Stack NIC2 configuration: 1. Run one instance of ptp4l per E810-XXVDA4T: # ptp4l -m -f config.cfg -i ens2f0 -i ens2f1 -i ens2f2 -i ens2f3...
Figure 16 shows two E810-XXVDA4T in a system with a 1PPS connection between them. U.FL/SMA 1PPS Server E810-XXVDA4T Gen4 x8 PHC1 System Clock Generation U.FL/SMA 1PPS Intel® Xeon® Gen4 x8 Scalable Processor E810-XXVDA4T PHC2 Intel® vRAN Accelerator ACC100 Gen3 x16 Adapter Figure 16.
Page 54
® Intel Ethernet Network Adapter E810-XXVDA4T User Guide NIC1 Linux software stack: System Clock phc2sys PHC1 Network ptp4l Tx/Rx Timestamps Figure 18. Linux Software Stack Overview: NIC1 (no GNSS) NIC1 configuration: 1. Enable 1PPS output on U.FL1: # echo 2 1 > /sys/class/net/ens1f0/device/ptp/ptp*/pins/U.FL1 or SMA 1: # echo 2 1 >...
Page 55
® Intel Ethernet Network Adapter E810-XXVDA4T User Guide NIC2 Linux software stack: System Clock phc_ctl ts2phc PHC2 Network ptp4l Tx/Rx Timestamps 1PPS U.FL/SMA Figure 19. Linux Software Stack Overview: NIC2 (no GNSS) NIC2 configuration: 1. Enable 1PPS input on U.FL2: # echo 1 2 >...
® Intel Ethernet Network Adapter E810-XXVDA4T User Guide Example ts2phc Configuration File [global] use_syslog verbose logging_level ts2phc.pulsewidth 100000000 # For GNSS module ts2phc.nmea_serialport /dev/ttyGNSS_BBDD_0 #BB bus number DD device number /dev/ ttyGNSS_1800_0 leapfile /home/<USER>/linuxptp-3.1/leapseconds.list [enp1s0f0(dev/ptp4)] ts2phc.extts_polarity rising Note: The leapfile option is available but not necessary for the program to run.
® Intel Ethernet Network Adapter E810-XXVDA4T User Guide [unicast_master_table] table_id logQueryInterval UDPv4 192.168.2.1 [enp1s0f3] serverOnly unicast_master_table 5.10 Example synce4l Configuration File for BC Note: For GM mode, ensure that input_mode = external is used in the config file. # Global section is for debuging mostly...
Page 62
® Intel Ethernet Network Adapter E810-XXVDA4T User Guide input_mode line //use this for SyncE follower # input_mode external //use this for SyncE leader # These values are sent to the peers on configured ports ONLY when 'external' # mode is enabled.
Page 63
® Intel Ethernet Network Adapter E810-XXVDA4T User Guide # the port is no longer a valid source (marked as QL-failed) # Valid QL must be received for more then "recover_time" seconds on that port # to use its PHY recovered signal again as a valid source...
Page 64
® Intel Ethernet Network Adapter E810-XXVDA4T User Guide # next configured interface for the device [enp1s0f1] recover_clock_enable_cmd echo 1 0 > /sys/class/net/enp1s0f1/device/phy/synce recover_clock_disable_cmd echo 0 0 > /sys/class/net/enp1s0f1/device/phy/synce ############################################################ # next SyncE device section #[<synce2>] #input_mode line # input_mode external # new port belonging to the "new"...
® Intel Ethernet Network Adapter E810-XXVDA4T User Guide Initial Test Setup Two E810-XXVDA4T adapters on two systems with a Trimble GM200 used as a timeserver. Test Diagram Oscilloscope Red = 1pps Blue = ptp4l Green = Scope 1pps Leader Follower...
® Intel Ethernet Network Adapter E810-XXVDA4T User Guide 4. Run ptp4l: # ifconfig $ETH 192.168.2.1 # ./ptp4l -i $ETH -m 5. Run synce4l (optional): #./synce4l -f configs/synce4l.cfg -m Note: Refer to Section 5.10, “Example synce4l Configuration File for BC”. Note: For GM mode, ensure that input_mode = external is used in the config file.
® Intel Ethernet Network Adapter E810-XXVDA4T User Guide 6.2.3 Test Results C1 = Trimble GM C2 = Leader E810-XXVDA4T C3 = Follower E810-XXVDA4T Figure 27. Test Results 646265-004 Did this document help answer your questions?
Page 68
® Intel Ethernet Network Adapter E810-XXVDA4T User Guide NOTE: This page intentionally left blank. 646265-004 Did this document help answer your questions?
® Intel Ethernet Network Adapter E810-XXVDA4T User Guide Appendix A Notes • If you cannot find the SMA or ptpX files, you should check that: — You have the latest NVM. — You have the latest driver. — You ran make install.
Page 70
• If you are experiencing problems where ethtool -T does not show Hardware Tx or Rx, you might need to reinsert the Intel ice driver with make install to include the DPK. • GNSS software referenced in this document has tendency to stop cat /dev/ttyGNSS_BBFF functionality.
® Intel Ethernet Network Adapter E810-XXVDA4T User Guide Appendix B Glossary and Acronyms Table 8. Definition of Terms Term Definition Active Antenna Unit Baseband Unit Boundary Clock Best Main Clock Core Network CPRI Common Public Radio Interface Centralized Unit Distributed Unit...
Page 72
® Intel Ethernet Network Adapter E810-XXVDA4T User Guide Table 8. Definition of Terms [continued] Term Definition Time of Day Top of Second uRLLC Ultra-Reliable and Low Latency Communications Microseconds s 646265-004 Did this document help answer your questions?
Page 73
® Intel Ethernet Network Adapter E810-XXVDA4T User Guide NOTE: This page intentionally left blank. 646265-004 Did this document help answer your questions?
Page 74
No license (express or implied, by estoppel or otherwise) to any intellectual property rights is granted by this document. This document (and any related software) is Intel copyrighted material, and your use is governed by the express license under which it is provided to you.
Need help?
Do you have a question about the E810 VDA4T Series and is the answer not in the manual?
Questions and answers