Artesyn SharpSwitch PCIE-9205 Installation And Use Manual
  1. Manuals
  2. Brands
  3. Artesyn Manuals
  4. PCI Card
  5. SharpSwitch PCIE-9205
  6. Installation and use manual

Artesyn SharpSwitch PCIE-9205 Installation And Use Manual

Hide thumbs Also See for SharpSwitch PCIE-9205:
Table of Contents

Advertisement

Quick Links

Download this manual
SharpSwitch™ PCIE-9205
Installation and Use
P/N: 6806800U18B
October 2016

Advertisement

Table of Contents
loading
Need help?

Need help?

Do you have a question about the SharpSwitch PCIE-9205 and is the answer not in the manual?

Questions and answers

Related Manuals for Artesyn SharpSwitch PCIE-9205

Summary of Contents for Artesyn SharpSwitch PCIE-9205

  • Page 1 SharpSwitch™ PCIE-9205 Installation and Use P/N: 6806800U18B October 2016...
  • Page 2 Artesyn reserves the right to revise this document and to make changes from time to time in the content hereof without obligation of Artesyn to notify any person of such revision or changes.

  • Page 3: Table Of Contents

    SharpSwitch PCIE-9205 ........
  • Page 4 Related Documentation ............. . . 73 Artesyn Embedded Technologies - Embedded Computing Documentation ....73 Related Specifications .
  • Page 5 Commands ............66 Table A-1 Artesyn Embedded Technologies - Embedded Computing Publications ....73 Table A-2 Related Specifications .
  • Page 6 List of Tables SharpSwitch™ PCIE-9205 Installation and Use (6806800U18B)
  • Page 7 List of Figures Figure 1-1 PCIE-9205 Card ............29 Figure 1-2 Faceplate .
  • Page 8 List of Figures SharpSwitch™ PCIE-9205 Installation and Use (6806800U18B)

  • Page 9: About This Manual

    Sicherheitshinweise provides a German translation of the chapter, “Safety Notes”.  SharpSwitch PCIE-9205  provides a brief overview about the PCIE-9205 card and information that you need after you have successfully installed the hardware. Related Documentation lists related documentation and specifications.
  • Page 10 About this Manual About this Manual Abbreviation Definition IPMI Intelligent Platform Management Interface Loss Of Signal Management Engine Peripheral Component Interconnect PCI-E or PCIe PCI Express PCI-SIG PCI Special Interest Group Power Supply Unit SATA Serial ATA Serial Over LAN System Services Framework Trusted Platform Module VCCI...
  • Page 11 About this Manual Notation Description <text> Notation for variables and keys [text] Notation for software buttons to click on the screen and parameter description Repeated item for example node 1, node 2, ..., node Omission of information from example/command that is not necessary at the time being Ranges, for example: 0..4 means one of the integers 0,1,2,3, and 4 (used in registers) Logical OR...
  • Page 12 About this Manual About this Manual Summary of Changes This manual has been revised and replaces all prior editions. Part Number Date Description 6806800U18B October 2016 Updated the section Installation and Configuration on page 6806800U18A June 2016 Initial version SharpSwitch™ PCIE-9205 Installation and Use (6806800U18B)

  • Page 13: Safety Notes

    Artesyn intends to provide all necessary information to install and handle the product in this manual. Because of the complexity of this product and its various uses, we do not guarantee that the given information is complete.
  • Page 14 Safety Notes The product generates and uses radio frequency energy and, if not installed properly and used in accordance with this user's documentation, may cause harmful interference to radio communications. Operating the product in a residential area is likely to cause harmful interference, in which case the user will be required to correct the interference at his own expense.
  • Page 15 Safety Notes System Damage Environmental contamination can impair system operation. Locate the system in a stable area free of excess movement and jarring and free of dust, smoke, and electrostatic discharge (ESD). Make sure that the temperature does not exceed the operating temperature given in the environmental requirements in this manual and allow room for proper air flow for cooling.
  • Page 16 Safety Notes Operation System Overheating Cooling Vents Improper cooling can lead to card and system damage and may void the manufacturer’s warranty. To ensure proper cooling and undisturbed airflow through the system always operate the system in a horizontal position. Do not obstruct the ventilation openings at the front and rear of the system.
  • Page 17 The cabling should follow existing cable paths using existing or similar cable fastenings. Never change the system's cabling as delivered by Artesyn. Check proper function of the system after cabling extensions. To avoid injuries always ensure that cables are securely installed so that nobody can trip over them.
  • Page 18 Safety Notes The interfaces 'USB1', 'USB2' and 'Console' are considered as debug/maintenance ports. During normal operation no cables must be connected to these ports.Cables attached to these ports during maintenance must not exceed a length of 3m. QSFP Modules Personal Injury and Damage of the PCIE card and QSFP Modules Installing and using QSFP modules which are not fully certified and which do not meet all relevant safety standards may damage the PCIE card and the QSFP modules and may lead to personal injury.
  • Page 19 Safety Notes Environment Environmental Damage Improperly disposing of used products may harm the environment. Always dispose of used products according to your country’s legislation and manufacturer’s instructions. SharpSwitch™ PCIE-9205 Installation and Use (6806800U18B)
  • Page 20 Safety Notes SharpSwitch™ PCIE-9205 Installation and Use (6806800U18B)

  • Page 21: Sicherheitshinweise

    Verletzungen oder Schäden am System zur Folge haben. Artesyn ist darauf bedacht, alle notwendigen Informationen zum Einbau und zum Umgang mit dem System in diesem Handbuch bereit zu stellen. Da es sich jedoch bei dem System um ein komplexes Produkt mit vielfältigen Einsatzmöglichkeiten handelt, können wir die...
  • Page 22 Sicherheitshinweise Das Produkt wurde getestet und erfüllt die für digitale Geräte der Klasse A gültigen Grenzwerte gemäß den FCC-Richtlinien Abschnitt 15 bzw. EN 55022 Klasse A. Diese Grenzwerte sollen einen angemessenen Schutz vor Störstrahlung beim Betrieb des Produkts in Geschäfts-, Gewerbe- sowie Industriebereichen gewährleisten.
  • Page 23 Sicherheitshinweise Beachten Sie folgende allgemeinen Sicherheitshinweise vor der Installation und Verkabelung des Systems: Bauen Sie das System sicher ein. Stellen Sie sicher, dass Kabel und Leitungen nicht im Weg  sind. Stellen Sie sicher, dass der Systemaufbau anwenderfreundlich ist.  Beschädigung des Systems Verschmutzungen können das System beschädigen.
  • Page 24 Sicherheitshinweise Fehlfunktion Unsachgemäßer Ein- und Ausbau von PCIE-Karten kann zu einer Fehlfunktion des PCIE-Karten führen. Vergewissern Sie sich, dass die Karte über alle Stecker an die Backplane angeschlossen und die Stromversorgung gewährleistet ist. Betrieb Überhitzung des Systems Lüftungsschlitze Unzureichende Lüftung kann Schäden an PCIE-Karten und am System verursachen und den Verlust der Garantie zur Folge haben.
  • Page 25 Achten Sie darauf, dass Sie das Stromkabel mit der richtigen Polarität anschließen.. Verkabelung/Kabelführung Verletzungsgefahr Verändern Sie nie die von Artesyn ausgelieferte Verkabelung des Systems. Stellen Sie sicher, dass die Verkabelung schon existierenden Kabelführungen folgt und bestehende oder ähnliche Befestigungen verwendet. Überprüfen Sie nach der Erweiterung der Verkabelung, ob das System ordnungsgemäß...
  • Page 26 Sie sicherstellen, dass Kontakte und Kabel des Systems während des Betriebs nicht berührt werden können. Falls Sie Fragen bezüglich der Verkabelung haben, wenden Sie sich an die für Sie zuständige Geschäftsstelle von Artesyn. Beschädigung der Kabel Werden Kabel geknickt, kann das Kabel beschädigt werden und der Datentransfer nicht mehr stattfinden.
  • Page 27 Sicherheitshinweise Verletzungsgefahr Optische QSFP Module können als Laserprodukte klassifiziert sein. Wenn Sie solche QSFP Module installieren und betreiben, so gelten die entsprechenden Bestimmungen für Laserprodukte für das gesamte PCIE card. Werden diese Bestimmungen nicht eingehalten, so können Verletzungen die Folge sein. Wenn Sie QSFP Module betreiben, die als Laserprodukte klassifiziert sind, stellen Sie sicher, dass die entsprechenden Bestimmungen für Laserprodukte eingehalten werden.
  • Page 28 Sicherheitshinweise SharpSwitch™ PCIE-9205 Installation and Use (6806800U18B)

  • Page 29: Sharpswitch Pcie-9205

    Product Damage Do not attempt to insert and operate the PCIE-9205 card in any other system other than the Artesyn MaxCore system. This may not only damage the PCIE-9205 card, but also the system the card is plugged into. Although the PCIE-9205 card looks similar to a standard PCI-Express card, it is not a standard PCI-E compliant product.
  • Page 30 SharpSwitch PCIE-9205 In the MaxCore platform, a PCIE-9205 card (placed in slot 1 or slot 15) acts as a host CPU in the fabric mode. It will act only as an endpoint card in the base mode. Figure 1-2 shows the faceplate view of PCIE-9205 card.

  • Page 31: Processor

    SharpSwitch PCIE-9205 1.1.1 Processor The PCIE-9205 card provides one Intel® Xeon® Processor D (also known as Broadwell-DE SoC) processor and an Intel FM10840 (also known as RedRock Canyon) NIC/Switch. 1.1.2 Memory The processor can be equipped with up to four DDR4 SO-DIMMs (two per Memory channel).

  • Page 32: Sata

    For PCIE-9205 cards operated in MaxCore’s slot 1 and slot 15, the CPU has four SATA3 ports connecting to the Hard Disk Drives installed in MC3000 IO Panel. Artesyn’s System Services Framework (SSF) for MaxCore allows configuring the assignment of these HDDs to the respective CPU ports.

  • Page 33: Uart (Com Port)

    SharpSwitch PCIE-9205 1.1.7 UART (COM port) The Xeon Processor D comes with an integrated dual UART controller. The serial console COM0 of the processor can be accessed through a USB connection from a host computer (there is no direct serial access). For this purpose, the PCIE-9205 provides an on- board dual USB-to-Serial converter.

  • Page 34: Real Time Clock

    SharpSwitch PCIE-9205 1.1.8 Real Time Clock The CPU on the PCIE-9205 card is provided with a battery backed up Real Time Clock (RTC). The RTC’s battery backups on the PCIE-9205 are provided through backup capacitors. The capacitor is capable to bridge the time needed to exchange the card between slots or systems.

  • Page 35: Bios

    The BIOS is based on the Insyde UEFI BIOS, which in turn is based on the Intel BIOS for Grangeville platform with multiple Artesyn extensions and enhancements. The following are the main features of BIOS: Initialization of the CPU, build-in PCH and memory ...

  • Page 36: Accessing The Card Using Serial Console Redirection

    SharpSwitch PCIE-9205 When you are not sure about configuration settings, restore the default values. Restoring BIOS default values affects all setup items and resets options that are previously  altered. If you set the default values, the displayed default values take effect only after the BIOS ...

  • Page 37: Bios Startup

    SharpSwitch PCIE-9205 1.2.2 BIOS Startup After power-on or CPU reset, the BIOS starts and displays the following banner on the console screen. Figure 1-3 BIOS Console Screen After that BIOS performs hardware testing and initialization. After completion of this process, the BIOS displays a more detailed information as shown below.

  • Page 38: Bios Setup

    SharpSwitch PCIE-9205 If no key is pressed on the keyboard for some time (for 3 seconds, by default), the BIOS starts with booting OS according to the list of boot options (boot devices). Press <F2> functional key on the keyboard, to enter BIOS Setup.

  • Page 39: Main Menu

    SharpSwitch PCIE-9205 1.2.3.1 Main menu Initially, the BIOS Setup Main menu is displayed, as shown in the following figure. Figure 1-5 BIOS Setup Main menu The Main menu shows the BIOS version, processor, and memory information. It allows you to change the system date and time displayed on the screen.

  • Page 40: Advanced Menu

    SharpSwitch PCIE-9205 1.2.3.2 Advanced menu Using the BIOS Setup Advanced menu, you can configure different hardware and feature parameters, which are organized in the form of sub-menus. The sub-menus are labeled with “>” symbol. Figure 1-6 BIOS Setup Advanced menu Using vertical arrow keys, you can navigate to the required sub-menu and enter into it by pressing <Enter>...

  • Page 41: Figure 1-7 Platform Information Sub-Menu

    SharpSwitch PCIE-9205 The figure below shows the content of Platform Information sub-menu. It shows the card type (Platform Board Type), the chipset type and stepping information about the Management Engine (ME). Figure 1-7 Platform Information sub-menu SharpSwitch™ PCIE-9205 Installation and Use (6806800U18B)

  • Page 42: Figure 1-8 Peripheral Configuration Sub-Menu

    SharpSwitch PCIE-9205 The following figure shows the Peripheral Configuration sub-menu screen. Figure 1-8 Peripheral Configuration sub-menu SharpSwitch™ PCIE-9205 Installation and Use (6806800U18B)

  • Page 43: Figure 1-9 Pch Sata Configuration Sub-Menu

    SharpSwitch PCIE-9205 The following figure shows the PCH SATA Configuration sub-menu, which shows the Chipset’s SATA controller settings. Figure 1-9 PCH SATA Configuration sub-menu SharpSwitch™ PCIE-9205 Installation and Use (6806800U18B)

  • Page 44: Figure 1-10 Pch Ssata Configuration Sub-Menu

    SharpSwitch PCIE-9205 The following figure shows the PCH sSATA Configuration sub-menu, which shows the Chipset’s sSATA controller settings. Figure 1-10 PCH sSATA Configuration sub-menu SharpSwitch™ PCIE-9205 Installation and Use (6806800U18B)

  • Page 45: Figure 1-11 Video Configuration Sub-Menu

    SharpSwitch PCIE-9205 The following figure shows the Video Configuration sub-menu screen. Figure 1-11 Video Configuration sub-menu The default value of Display Mode implies no usage of VGA controller (Ignore VGA Option ROM and I/O Space). If necessary, it allows to assign a VGA controller to a particular PCIE-9205 or 9205 card.

  • Page 46: Figure 1-12 Usb Configuration Sub-Menu

    SharpSwitch PCIE-9205 The following figure shows the USB Configuration sub-menu screen. Figure 1-12 USB Configuration sub-menu SharpSwitch™ PCIE-9205 Installation and Use (6806800U18B)

  • Page 47: Figure 1-13 Console Redirection Sub-Menu

    SharpSwitch PCIE-9205 The Console Redirection sub-menu shown below represents various available settings for console redirection feature. There are global settings usually used for both COMA and COMB ports. They can be overridden using settings in appropriate port’s sub-menus. Figure 1-13 Console Redirection sub-menu SharpSwitch™...

  • Page 48: Figure 1-14 Advanced Menu - Expert View Enabled

    SharpSwitch PCIE-9205 The Advanced menu also has Expert View option. Enabling this option displays additional sub-menus as shown in the following figure. Figure 1-14 Advanced menu - Expert View enabled A detailed description of additional sub-menus is not in the scope of this document.

  • Page 49: Security Menu

    SharpSwitch PCIE-9205 1.2.3.3 Security menu The BIOS Setup Security menu displays security relevant information and changeable options including Supervisor Password. Figure 1-15 Security menu SharpSwitch™ PCIE-9205 Installation and Use (6806800U18B)

  • Page 50: Power Menu

    SharpSwitch PCIE-9205 1.2.3.4 Power menu The Power menu of the BIOS Setup collects options allowing under particular circumstances to reduce power consumption. Figure 1-16 Power menu 1.2.3.5 Boot menu The BIOS Setup Boot menu represents options that influence the BIOS behavior regarding the initialization and utilization for subsequent Operating System boot.
  • Page 51 SharpSwitch PCIE-9205 The following figure shows Boot menu. Figure 1-17 Boot menu The Boot Type option allows to choose between Legacy, UEFI, and Dual Boot types. If Dual type is chosen, you can decide whether UEFI or Legacy boot devices have to be tried for booting first.
  • Page 52 SharpSwitch PCIE-9205 The EFI sub-menu collects all UEFI boot options and allows to rearrange the order in which they are tried. Figure 1-18 Boot EFI Sub menu SharpSwitch™ PCIE-9205 Installation and Use (6806800U18B)

  • Page 53: Figure 1-19 Boot Legacy Sub Menu

    SharpSwitch PCIE-9205 The Legacy sub-menu allows you to organize all legacy options in a single plain list or according to their types (Normal case) as shown in the figure below. Figure 1-19 Boot Legacy Sub menu SharpSwitch™ PCIE-9205 Installation and Use (6806800U18B)

  • Page 54: Exit Menu

    SharpSwitch PCIE-9205 1.2.3.6 Exit menu The BIOS Setup Exit menu provides different options for saving or discarding changes and also loading different sets of default settings, as shown in the following figure. Figure 1-20 Exit menu Software Overview 1.3.1 Host OS...

  • Page 55: Pcie-9205 Software

    “fm10k” and it is capable to operate both physical and virtual functions 1.3.2 PCIE-9205 Software The PCIE-9205 card comes pre-installed with CentOS 7.2 and various additional packages. The following are Artesyn-specific extensions: Firmware update utilities  Access utilities to card logic ...

  • Page 56: Firmware Upgrade

    FM10K Switch PCIE- 9205 CPLD Hardware Artesyn Software / Hardware 1.3.2.1 Firmware Upgrade The PCIE-9205 card has two firmware devices that need to be upgraded, when required. The first device is the CPU with the BIOS firmware and the second is the CPLD. The root file system includes the latest firmware images for both the devices and a firmware command line utility (FCU) to execute the upgrade procedure.
  • Page 57 SharpSwitch PCIE-9205 When you call FCU with the help option fcu –help or fcu –h, a list of supported operations are displayed on the screen. FCU supports the following Firmware Recovery Images (FRI): pcie9205-cpld-<version>.fri – Firmware image for the CPLD ...
  • Page 58 SharpSwitch PCIE-9205 #00 Device: pcie9205-cpu Bank #0 - Version: 1.1.00000000 #01 Device: pcie9205-cpu Bank #0 - Version: 1.1.00000000 ********************[[[[[REPORT END]]]]]******************* 1.3.2.1.3 Upgrade Operation Upgrade operation uploads the firmware image to the device. Before the upload process, the firmware image is validated first and the FCU verifies if the image is applicable to the firmware device.
  • Page 59 SharpSwitch PCIE-9205 ***************[[[[[REPORT BEGIN]]]]]**************** Operation: Upgrade Current BIOS version is 00.09.06 version from image 3.0.3.0 and running ME 3.0.3.7 are different Management(ME) must be in recovery mode before performing the BIOS upgrade kernel.reboot_type = 112 Result: Reboot needed to continue...

  • Page 60: Switch Management

    SharpSwitch PCIE-9205 ***************[[[[[REPORT END]]]]***************** 3. Reboot the system. The CPU comes up with the new version. reboot 1.3.2.1.5 Upgrading CPLD To upgrade the CPLD, enter the same options that are used to upgrade the BIOS. To activate the new CPLD firmware, you have to power-cycle the chassis.

  • Page 61: Table 1-2 Mcpu Commands

    SharpSwitch PCIE-9205 Each PEP is seen as an Ethernet device (NIC) from the CPU from which it is being accessed. The vendor/device ID of these devices is 0x8086/0x15a4, the subsystem vendor/sysbsystem ID is 0x1223/0x2020. When booting PCIE-9205, the following two fm10k network instances are visible: The PCIe Gen3 x 8 connection of PEP4 with a maximum bandwidth of 64GBit/sec.
  • Page 62 SharpSwitch PCIE-9205 device : 0x15a4 class : 0x20000 pci location@mcpu : 3c:00.0 plx switch plx station plx port : 12 slot: 11 device: 2 func: 1 vendor : 0x8086 device : 0x15a4 class : 0x20000 pci location@mcpu : 3e:00.0 plx switch...
  • Page 63 SharpSwitch PCIE-9205 plx switch plx station plx port : 14 slot: 11 device: 4 func: 1 vendor : 0x8086 device : 0x15a4 class : 0x20000 pci location@mcpu : 42:00.0 plx switch plx station plx port : 15 [root ~]# lspci -vv -s 42:00.0 | grep -A7 "Vital Product Data"...
  • Page 64 SharpSwitch PCIE-9205 0000:42:00.0 'Ethernet Switch FM10000 Host Interface' if=enp18s0 drv=fm10k unused= 1.3.2.2.2 IES API Intel Ethernet Switch (IES) is an API, which abstracts the fm10k switch capabilities. It is mainly used on PCIE-9205 by the SSF agent that provides the switch management service for the MaxCore SSF framework.
  • Page 65 SharpSwitch PCIE-9205 The following section contains the list of commands in fmShell. To display help, use the command fmShell –h  To start fmShell interactively as IES client (Ctrl-C or Ctrl-D to exit), use the command  fmShell –iLs –...

  • Page 66: Table 1-3 Fmshell Commands

    SharpSwitch PCIE-9205 Table 1-3 fmShell Commands Command Name Description Lists a selection of useful commands for PCIE-9205. toolHelp Show generic help on the shell interpreter. help Shows the current state of one or all ports: bdPortShow port|-1 Port#/name link-state speed dfl. VLAN admin-state.
  • Page 67 SharpSwitch PCIE-9205 Table 1-3 fmShell Commands (continued) Command Name Description 22/PEP2 FM_PORT_MODE_UP|FM_PORT_STATE_DOWN 23/PEP3 FM_PORT_MODE_UP|FM_PORT_STATE_UP 24/PEP4 Shows port counters of a specific port or all ports. bdPortCountShow port|- “all”, if set to 1, shows all counters of a port, otherwise only those that 1,[all,[“filter-...
  • Page 68 SharpSwitch PCIE-9205 Table 1-3 fmShell Commands (continued) Command Name Description Dump transceiver (QSFP) state for QSFP1 (port 1) or QSFP2 (port 5). fmPlatformDumpXcvr Eeprom 0,(1|5) This can be used to check signal levels, Loss of Signal (LOS) indications and so on.

  • Page 69: Services

    SharpSwitch PCIE-9205 1.3.2.3 Services This section lists PCIE-9205 specific services started or executed at boot time via systemd. Service files are located within /usr/lib/systemd/system. 1.3.2.3.1 Switch Software switchd.service is responsible of switch management. This service provides interface for functionalities including L2, L3, Server Load balancing, and match-lists. The service can be started, stopped, and monitored via systemctl.

  • Page 70: Tools

    SharpSwitch PCIE-9205 The service can be started, stopped, and monitored via systemctl. By disabling the thermd service, the BMC might decide to set the chassis cooling/fan speed to maximum after some time. To monitor the temperature readings, thermd can be configured to write actual readings into a log file.

  • Page 71: Installation And Configuration

    SharpSwitch PCIE-9205 – pcie9205ctrl – Tool for miscellaneous PCIE-9205 specific operation, not for general use. – recovery_boot – Script for re-booting the card prior to update BIOS (puts Intel ME into recovery mode). – thermd – Thermal monitor daemon. etc directory ...
  • Page 72 SharpSwitch PCIE-9205 1.3.2.5.3 Configuration when Shelf ID is not 1 If PCIE-9205 is nCPU and if the Shelf ID is not 1, you need modify the following files as mentioned below: 1. Modify emindTcpAddress and ShelfHostIPAddress in /opt/ssf/etc/config/bcsim/ssfApi.conf file and assign them with ShelfHost IP address.

  • Page 73: Related Documentation

    The publications listed below are referenced in this manual. You can obtain electronic copies of Artesyn Embedded Technologies - Embedded Computing publications by contacting your local Artesyn sales office. For released products, you can also visit our Web site for the latest copies of our product documentation.
  • Page 74 Related Documentation SharpSwitch™ PCIE-9205 Installation and Use (6806800U18B)
  • Page 76 Artesyn Embedded Technologies, Artesyn and the Artesyn Embedded Technologies logo are trademarks and service marks of Artesyn Embedded Technologies, Inc. All other product or service names are the property of their respective owners. © 2016 Artesyn Embedded Technologies, Inc.

Table of Contents