Overview The UfiSpace S9321‐64E/EO is a high‐performance, versatile open networking white box switch that is designed to address the fast‐growing segment of the AI/ML networking and providing high speed, low latency interconnects. With 64 x 800GE QSFP‐DD or OSFP ports, the S9321‐64E/EO switch is where computer resources and GPUs are centralized and managed in a structured way utilizing high‐ efficiency Ethernet connectivity. The S9321‐64E/EO is the epitome of future networking with a powerful 4‐core processor and 64 high‐speed 800GE interfaces. It comes with redundant, hot swappable components for convenience, increased availability, reliability and lower costs of maintenance. This document describes the hardware installation process for S9321‐64E/EO. S932‐64E/EO Hardware Installation Guide | 1 ...
Preparation Installation Tools Phillips #2 Screw Driver 4‐AWG green‐and‐yellow wire for grounding 4‐AWG for DC power wire Crimping tool Wire stripping tool All illustrations within this document are for reference purposes only. Actual objects may differ. • PC with terminal emulation software. Refer to the "Initial System Setup" section for details. • Baud rate: 115200 bps • Data bits: 8 • Parity: None • Stop bits: 1 • Flow control: None S932‐64E/EO Hardware Installation Guide | 2 ...
Installation Environment Requirements • Power Reserve: The S9321‐64E power supply is available with: 1. DC Version: 1+1 Redundant and hot swappable, active‐active ‐40 to ‐72V DC power supply field replaceable unit or; 2. AC Version: 1+1 Redundant and hot swappable, active‐active 200 to 240V AC power supply field replaceable unit. To ensure the redundant, active‐active feed power design functions properly, a field with dual power circuit is recommended with a reserve of at least 3000 watts on each power circuit. • Space Clearance: The S9321‐64E/EO chassis width is 17.16 inches (43.6cm) and is shipped with an adjustable mounting rail kit suited for standard 19 inch (48.3cm) wide racks. The depth of the S9321‐64E/EO chassis is 30 inches (76.2cm) without the field replaceable units (FRUs). The handle of fan FRU is 1.1 inch (2.9cm) and the handle of the PSU FRU is 1.2 inches (3.0cm). Therefore, to accommodate the fan, power supply handles, airflow and cabling, a minimum space clearance of 6 inches (15.2cm) is needed at front and back of the S9321‐ 64E/EO. A total minimum reserve depth of 42 inches (106.6cm) is required. Figure 1. • Cooling: The S9321‐64E/EO airflow direction is front‐to‐back. Make sure the equipment on the same rack have the same airflow direction. Figure 2. S932‐64E/EO Hardware Installation Guide | 3 ...
Figure 3. Preparation Check List Task Check Date Power voltage and electric current requirement DC version: ‐40 to ‐72V DC, 80A maximum x2 or; AC version: 200 to 240V AC, 16A maximum x2 Installation spacing requirement S9321‐64E/EO chassis spacing requires a height of 2RU (3.45”/8.8cm), a width of 19” (48.3cm), and a depth of 42 inches (106.6cm) Thermal requirement S9321‐64E/EO working temperature is 0°C to 45°C (32°F to 113°F), airflow direction is front‐to‐back Installation tools required #2 Philips screwdriver, wire‐stripping tools for stripping 4‐AWG, crimping tool for ground lug Accessories required PC with USB ports and terminal emulation software S932‐64E/EO Hardware Installation Guide | 4 ...
Package Contents Accessory List Item Description Spec. & Dimensions Qty. Weight 1 x Grounding Lug (# 4 AWG) 1.65” x 1.45” x 0.55” Grounding Kit and 1 (41.91 x 36.83 x 13.97mm) 1 set 0.05lbs (21.1g)/1 set Screw Kit 2 x Screw: M4*L8.0mm 2 x M4 Lock Washers 4 x DC Lug (# 4 AWG) Grounding Kit 2 2.4” x 0.6” x 0.42” 1 set 0.18lbs (81.48g)/1 set (DC Only) (60.96 x 15.24 x 10.688mm) 30.4” x 1.7” x 0.9” 7.01lbs (3.178kg)/2 set Adjustable Mounting 3 (771 x 44 x 22mm) 2 set Rail (for 4 post) (3.5lbs (1.589kg)/1 set) (22”~33” rack depth) Screw Kit 4 (for adjustable 2 x Screw M4.0*L5.5mm ...
Component Physical Information Specification Item Description S9321‐64E: 92.99lbs(42.18kg) Total package contents S9321‐64EO: 92.29lbs(41.86kg) S9321‐64E: 52.28lbs(23.72kg) Chassis without FRU S9321‐64EO: 52.33lbs(23.74kg) DC PSU: 4.19lbs (1.9kg) Power Supply Unit (PSU) AC PSU: 4.6lbs (2.08kg) Weight Fan module 1.6lbs (741g) Ground lug 0.045lbs (20.37g) Adjustable mounting rail 3.5lbs (1.589kg) Micro USB cable 0.06lbs (25.5g) RJ45 to DB9 Female cable 0.23lbs (105g) AC power cord (AC version only) 0.77lbs (350g) S9321‐64E/EO (W x D x H) 17.16” x 30” x 3.45” (436 x 762 x 87.7mm) Dimension PSU (W x D x H) 2.67 x 17.66” x 1.60” (68 x 448.7 x 40.6mm) Fan (W x D x H) 3.19” x 6.09” x 3.21” (81 x 154.8 x 81.5mm) S932‐64E/EO Hardware Installation Guide | 6 ...
Identifying Your System S9321‐64E/EO Overview Figure 4. PSU Overview Power supply unit (PSU) with 1+1 Redundancy. Hot swappable, field replaceable unit (FRU). AC Version: Figure 5. S932‐64E/EO Hardware Installation Guide | 7 ...
DC Version: Figure 6. Fan Overview 3+1 Redundant, hot swappable, field replaceable unit (FRU). Figure 7. S932‐64E/EO Hardware Installation Guide | 8 ...
Port Overview Port ID Form Factor Maximum Support Distance Support Speed 0 ~ 63 QSFP‐DD or 1.24 mi (2KM) 400G/800G OSFP The S9321‐64E features 64x800G QSFP‐DD ports, while the S9321‐64EO is equipped with 64x800G OSFP ports. Figure 8. S9321‐64E: The upper 32 ports support 16W, while the bottom 32 ports support 23W. S9321‐64EO: 16 ports marked in red support 30W, while the remaining 48 ports support 16W. Figure 9 S932‐64E/EO Hardware Installation Guide | 9 ...
Rack Mounting It is recommended that installation be done by at least two trained professionals. One individual should hold the router in position, while the other secures it in place onto the rail slides. 1. Separate the adjustable mounting rail slides. 1.1 Pull apart the inner and outer rails until it is locked in place. An audible click can be heard when the rails are locked in place. 1.2 Pull the white tab forward to unlock the rails in order to completely separate the inner rail from the outer rail. The white tab is located on the inner rail. 1.3 Once the inner rail is separated, push the tab located on the outer rail to unlock and slide the middle rail back. Figure 10. 2 Install the inner rails onto the chassis. 2.1 The inner rail has key‐shaped holes where attachment pins on the chassis can be aligned. The chassis has 5 attachment pins on each side, for a total of 10 pins. Fit the key‐shaped holes with the attachment pins and pull back to hold the inner rack in place. Make sure the locking screw of the inner rail is positioned at the front of the chassis. 2.2 After the attachment pins are secured to the inner rail, lock the inner rail to the chassis using two M4 screws (one on each chassis side). S932‐64E/EO Hardware Installation Guide | 10 ...
Page 14
Figure 11. 3 Fix the outer rails onto the rack. 3.1 The outer rails have two brackets on the front and rear. Pull back the clip of the rear bracket to attach it onto the rack. An audible click can be hear when the bracket is secured onto the rack. 3.2 Once the rear bracket is secured, pull back the clip of the front bracket attach it to the rack. An audible click can be heard when the bracket is secured onto the rack. Figure 12. 4 Insert the Chassis to complete the installation. 4.1 Pull the middle rail fully extended into lock position, an audible click can be heard when the middle rail is fully extended and locked into position. 4.2 Insert the chassis by lining up the inner rails into the slot of the middle rail. 4.3 Slide the chassis into the middle rail until it hits a stop. 4.4 Push the blue release tab on each rail to unlock the rails and slide the chassis all the way into the rack. 4.5 Lock the chassis into place by using the screw on the front of the inner rail. S932‐64E/EO Hardware Installation Guide | 11 ...
Installing Fan Modules The fan modules are hot swappable field replaceable units (FRUs), which can be replaced while the router is operating as long as all the remaining modules are installed and in operation. The fans come pre‐installed and the following steps are instructions on how to install a new fan module. 1. Locate the release tab on the fan module. Then press and hold the release tab to unlock the fan module. Figure 14. 2. While holding down the release tab, grip the fan handle and gently pull the fan module out of the fan bay. Figure 15. 3. Align the new fan module with the fan bay, ensuring that the fan module’s power connector is in the correct position. 4. Carefully slide the new fan module into the fan bay and gently push until it is flush with the case. 5. An audible click will be heard when the fan module is installed correctly. The fan module will not go in all the way if it is installed in the wrong direction. Figure 16. S932‐64E/EO Hardware Installation Guide | 13 ...
Installing Power Supply Units The power supply unit (PSU) is a hot swappable field replaceable unit and can be replaced while the router is operating as long as the remaining (second) PSU is installed and in operation. The AC and DC PSU follow the same steps for installation. The PSU comes pre‐installed and the following are instructions on how to install a new PSU. If power input for AC power supply is only 110V, there will only be 1500 watts per power supply and will not be enough power for the power supply to be changed while the router is in operation. In order for AC power supply to be changed while the router is in operation, ensure that 220V power is supplied. Safety Notices Caution! Shock hazard! TO DISCONNECT POWER, REMOVE ALL POWER CORDS FROM UNIT. DC: AC: Figure 17. 1. Locate the release tab on the PSU. Then press and hold down the release tab to unlock the PSU. 2. While holding down the release tab, grip the PSU's handle and firmly pull it out of the power bay. DC Version: AC Version: Figure 18. ...
Page 18
3. Align the new PSU with the power bay, ensuring the PSU’s power connector is in the correct position. 4. Carefully slide the new PSU into the power bay and gently push until it is flush with the case. 5. An audible click will be heard when the PSU is installed correctly. The PSU will not go in all the way if it is in the wrong direction. DC Version: AC Version: Figure 19. S932‐64E/EO Hardware Installation Guide | 15 ...
Grounding the Router It is recommended that equipment changes be done on a grounded rack system. This will reduce or prevent the risk of shock hazards, equipment damage, and potential of data corruption. The router can be grounded from the router's case, a grounding lug, M4 screws and washers are provided with the package contents, however, the grounding wire is not included. The location for securing the grounding lug is at the rear of the case and is covered with a protective label. The following instructions are for installing the grounding lug onto the case. This equipment must be grounded. Do not defeat the ground conductor or operate the equipment without correctly grounding the equipment. If there is any uncertainty about the integrity of the equipment's grounding, please contact the electrical inspection authority or a certified electrician. 1. Before grounding the router, ensure that the rack is properly grounded and in compliance with local regulatory guidelines. Ensure that there is nothing that can obstruct the connection for grounding and remove any paint or materials that may prevent good grounding contact. 2. Strip the insulation from a size #4 AWG grounding wire (not provided within the package contents), leaving 1.125”+/‐0.02” (28.6+/‐0.5mm) of exposed grounding wire. 3. Insert the exposed grounding wire all the way into the hole of the grounding lug (provided with package contents). 4. Using a crimping tool, firmly secure the grounding wire to the grounding lug. Figure 20. 5. Locate the designated location for securing the grounding lug, which is located on the rear of the router and remove the protective label. S932‐64E/EO Hardware Installation Guide | 16 ...
Page 20
Figure 21. 6. Using 2 M4 screws and 2 washers (provided with the package contents), firmly lock the grounding lug to the designated grounding location on the router. Figure 22. S932‐64E/EO Hardware Installation Guide | 17 ...
Connecting Power DC Version Dangerous voltage! Must be powered off before removing! Verify that all electrical connections are grounded before powering on The DC power source must be reliably grounded 1. Ensure there is enough power to supply the system. The maximum system power consumption is 2279 watts. It is recommended to ensure that enough power is reserved from the power distribution system before installation. Also, please ensure that both PSUs have been properly installed before powering up the equipment, as the S9321‐64E/EO is designed to support 1 + 1 power redundancy. Testing criteria for maximum power are as follows: Temperature:40⁰C Optics: full populated Note Traffic: 100% load 2. Attach the DC power cables to the lugs. The UL 1015, #4 AWG DC power cable (not provided) must be attached to a two‐hole lug before connecting to the PSU. The following instructions are for connecting the DC Power Cable to the lug: 2.1 Strip the insulation from a DC Power Cable, leaving 0.94” +/‐0.02” (23.9+/‐0.5mm) of exposed cable 2.2 I nsert the exposed DC power cable into the heat shrink tubing, the length of heat shrink tubing should not less than 38.5mm. 2.3 Insert the exposed DC power cable all the way into the hollow tube of the lug (provided with the package contents). ...
Page 22
2.5 Move the heat shrink tubing to cover any exposed metal on the DC power cable and lug. Figure 24. 2.6 Use a heat source to secure the heat shrink tubing in place. Allow the heat shrink tubing to cool before attaching the DC power cable. An example of the installed DC version with insulation material as below. Figure 25. S932‐64E/EO Hardware Installation Guide | 19 ...
Page 23
3. Attach the power cable. Locate the DC power screw‐type terminal block located on the PSU. Remove the plastic cover that is protecting the terminal block by pushing from the top or bottom of the cover and flipping open the cover outwards. Secure the two‐hole lug (with the DC power cable attached) to the terminal block as depicted in the following figure. Figure 26. 4. Tighten the screws to the specified torque. Tighten the screws to a torque value of 14.0+/‐0.5kgf.cm. If the torque is not enough, the lug will not be secure and may cause malfunctions. If the torque is too much, the terminal block or lug may be damaged. Secure the plastic cover back onto the terminal block. The figure below depicts how it should look once the lug is attached and the protective plastic cover reinstalled. Figure 27. 5. Feed DC power into the system. The PSU will immediately output 12.3V and 12VSB to the system with a ‐40V to ‐72V DC power source. The PSU has a built in 150 amperes fast acting fuse based on the PSU maximum capacity, which will act as a second‐tier system protection in case the power distribution unit’s fuse is not functioning. 6. Verify that the power supply is operating. If connected correctly, when turned on, the LED on the PSU will light up with a Green color designating normal operation. S932‐64E/EO Hardware Installation Guide | 20 ...
AC Version 1. Ensure there is enough power to supply the system. The maximum system power consumption is 2253 watts. It is recommended to ensure that enough power is reserved from the power distribution system before installation. Also, please ensure that both PSUs have been properly installed before powering up the equipment, as the S9321‐64E/EO is designed to support 1 + 1 power redundancy. Testing criteria for maximum power are as follows: Temperature:40⁰C Optics: full populated Note Traffic: 100% load 2. Attach the power cable. Locate the AC inlet connector on the PSU and plug the AC power cable (250VAC 15A, IEC60320 C19) into the AC inlet connector. 3. Feed AC power into the system. The PSU will immediately output 12.3V & 12VSB to the system with a 200V to 240V, AC power source. The PSU has a built‐in 25 amperes, fast acting fuse based on the PSU maximum capacity, which will act as a second‐tier system protection in case the power distribution unit’s fuse is not functioning. 4. Verify that the power supply is operating. If connected correctly, when turned on, the LED on the PSU will light up with a solid Green color designating normal operation. If only a 110V AC power source is available, the S9321‐64E/EO can still be powered with both PSUs providing 1500 watts each for a total output of 3000 watts. However, in this case, if one PSU stops functioning, the power output would be inefficient to sustain the Note router’s operation. ...
10 Verifying System Operation Front Panel LED Verify basic operations by checking the system LEDs located on the front panel. When operating normally, the SYNC, SYS, FAN, PS0 and PS1 LEDs should all display green. Figure 28. LED Condition Equipment Status SYNC Off System timing/clock synchronization is disable or in free‐run mode System timing core is synchronized to PTP packet (Phase) or one of the Solid Green external timing sources (Phase) and frequency is locked. System timing is synchronized to PTP packet (Frequency) or one of the Blinking Green external timing (Frequency) sources Solid Amber System timing core is in acquiring state or holdover mode Blinking Amber System timing synchronization fail or acquiring/holdover time out SYS Off No power Solid Green Host CPU/BMC boot complete Solid Amber Power is up but Host CPU/BMC boot failed FAN ...
PS1 Off No Power Solid Green PSU1 is working normal Solid Amber PSU 1 fail (PSU1 need service) ID Off No Power Solid Blue Reserved Blinking Blue Enabled beacon feature PSU FRU LED Additional information about PSU status can be obtained by the LEDs located on the PSU i tself. LED Condition Equipment Status Input LED Green Input within range Off Input out of range FW upgrading Output LED Solid Green 12.3V Main output OK Blinking Green 12.3 Main output in standby mode. Off 12.3V main output off due to input out of range Blinking Amber ...
11 Initial System Setup Establishing a first‐time serial connection. To assign an IP address, you must have access to the command line interface (CLI). The CLI is a text‐ based interface that can be accessed through a direct serial connection to the router. Access the CLI by connecting to the console port. After you assign an IP address, you can access the system through Telnet or SSH by Putty, TeraTerm or HyperTerminal. Perform the following steps to access the router through a serial connection: 1. Connect the console cable. • The console can be connected either with the RJ45 port or the micro USB port, both labelled IOIO. If connecting with micro USB, drivers will need to be installed. • To connect the console using the RJ45 port, locate the RJ45 port labelled IOIO, then plug a serial cable into the console port and connect the other end to the computer. Cable types may vary depending on the router model. Figure 29. • To connect the console using the micro USB port, locate the port on the front panel of the router, then connect your computer using the micro USB cable provided in the packaging contents. Download the suitable driver for your operating system (OS) using the URL below: • https://www.silabs.com/products/development‐tools/software/usb‐to‐uart‐bridge‐ vcp‐drivers • https://www.silabs.com/ and search for CP210X Figure 30. S932‐64E/EO Hardware Installation Guide | 24 ...
Page 28
2. Check for serial control availability. Disable any serial communication programs running on the computer such as synchronization programs to prevent interference. 3. Launch a terminal emulator. Open a terminal emulator application such as HyperTerminal (Windows PC), Putty or TeraTerm and configure the application. The following settings are for a Windows environment (other operating systems may vary): • Baud rate: 115200 bps • Data bits: 8 • Parity: None • Stop bits: 1 • Flow control: None 4. Login to the device. After the connection is established, a prompt for the username and password displays. Enter the username and password to access the CLI. The username and password should be provided by the Network Operating System (NOS) vendor. S932‐64E/EO Hardware Installation Guide | 25 ...
12 Cable Connections Connecting the USB Extender Cable Connect the USB 3.0 A Type plug (male connector) into the USB port (female connector) located on the front panel of the router. This USB port is a maintenance port. To avoid any interoperability issue, we recommend that you run the following command lines and then restart your USB after installing the USB device. USB Reset usbreset 002/002 Restart 5V Power i2cset -y 0 0x71 0x01 i2cget -y 0 0x30 0x44 i2cset -y 0 0x30 0x44 0x5f i2cset -y 0 0x30 0x44 0xdf ...
Figure 32. Connecting the 10MHz Interface The maximum length of the 10MHz coaxial SMB cable should not be more than 3 meters. Connect an external 10MHz cable with an impedance of 50 ohms to the port labelled "10MHz”. I f the connector is not same type as SMB, please use the converter cable in the accessory list to convert to BNC type. Figure 33. Connecting the Transceiver To prevent over tightening and damaging the optic fibers, it is not recommended to use tie wraps with optical cables. S932‐64E/EO Hardware Installation Guide | 27 ...
Page 31
Read the following guidelines before connecting the transceiver: • Before installing the switch, take into consideration rack space requirements for cable management and plan accordingly. • It is recommended to use hook‐and‐loop style straps to secure and organize the cables. • For easier management, label each fiber‐optic cable and record its respective connection. • Maintain a clear line of sight to the port LEDs by routing the cables away from the LEDs. Before connecting anything (cables, transceivers, etc.) to the router, please ensure to discharge any static electricity that may have built up during handling. It is also recommended the cabling be done by a professional who is grounded, such as by wearing an ESD wrist strap. The following the steps below for connecting a transceiver. 1. Remove the new transceiver from its protective packaging. 2. Remove the protective plug from the transceiver itself. 3. Place the bail (wire handle) in the unlocked position and align the transceiver with the port. 4. Slide the transceiver into the port and gently push until it is secured in place. An audible click can be heard when the transceiver is secured in the port. S932‐64E/EO Hardware Installation Guide | 28 ...
Page 32
13 Cautions and Regulatory Compliance Statements Cautions and Regulatory Compliances Safety Notices Caution! Shock hazard! TO DISCONNECT POWER, REMOVE ALL POWER CORDS FROM UNIT. Electrical Hazard: Only qualified personnel should perform installation procedures. Risques d’électrocution: Seul un personnel qualifié doit effectuer les procedures d’installation. Warning: Network Switch power supplies do not have switches for turning the unit on and off. Before servicing, disconnect all power cords to remove power from the device. Make sure that these connections are easily accessible. Avertissement: Network Switch alimentations ne sont pas des interrupteurs pour allumer l’appareil et en dehors. Avant l’entretien, débranchez tous les cordons d’alimentation pour couper l’alimentation de l’appareil. Assurez‐vous que ces connexions sont facilement accessibles. Caution: Before mounting the device, ensure that the rack can support it without compromising stability. Otherwise, personal injury and/or equipment damage may result. Caution: This unit must be installed indoors. The unit, AC power supplies, DC power supplies, and its cables are not designed for outdoor use. Caution: Follow appropriate ESD procedures when unpacking and handling the switch. These include unpacking the switch in an ESD‐safe environment and wearing appropriate ...
Page 33
Federal Communications Commission (FCC) Notice This device complies with Part 15 of FCC rules. Operation is subject to the following two conditions: (1) this device may not cause harmful interference, and (2) this device must accept any interference received, including interference that may cause undesired operation. This equipment has been tested and found to comply with the limits for a class A digital device, pursuant to Part 15 of the FCC rules. These limits are designed to provide reasonable protection against harmful interference when the equipment is operated in a commercial environment. This equipment uses, generates, and can radiate radio frequency energy and if not installed in accordance with the operator’s manual, may cause harmful interference to radio communications. Operation of this equipment in a residential area is likely to cause interference in which case the user will be required to . correct the interference at his own expense Changes or modifications made to this device which are not expressly approved by the party responsible for compliance could void the user’s authority to operate the equipment. Industry Canada Notice CAN ICES‐003 (A)/NMB‐003(A) This digital apparatus does not exceed the class A limits for radio noise emissions from digital apparatus set out in the Radio Interference Regulations of the Canadian Department of Communications. Le présent appareil numérique n’émet pas de bruits radioélectriques dépassant les limites applicables aux appareils numériques de la class A prescrites dans le Règlement sur le brouillage radioélectrique édicté par le ministère des Communications du Canada Class A ITE Notice This equipment is compliant with Class A of CISPR 32. In a residential environment this equipment may cause radio interference. VCCI Notice This is Class A equipment. Operation of this equipment in a residential environment could ...
Page 34
Installation Location Statement The device should be installed only in a server room or computer room where access is: Restricted to qualified service personnel or users familiar with restrictions applied to the location, reasons therefore, and any precautions required. Only afforded by the use of a tool or lock and key, or other means of security, and controlled by the authority responsible for the location. Suitable for installation in Information Technology Rooms in accordance with Article 645 of the National Electrical Code and NFPA 75. Cautions and regulatory compliance statements for NEBS: • “Suitable for installation as part of the Common Bonding Network (CBN)” • “An external Surge Protection Device (SPD) must be used with AC powered equipment and that the Surge Protection Device is to be installed at the AC power service entrance.” “System can be installed in Network Telecommunications Facilities where the National • Electric Code applies” • The approximate system boot time when the AC (or DC) power source is connected is 110 secs in Ubuntu Linux system. (The boot up time would depend on different NOS system) • The approximate link time for the OOB Ethernet port when reconnected is 40 secs base on Ubuntu Linux system (The link time would depend on different NOS system) The design of the equipment is that the RTN terminal should be isolated from the chassis • or rack. (The DC input terminals is DC‐I (Isolated DC return)) • “WARNING: The intra‐building port OOB (Ethernet) of the equipment or subassembly is suitable for connection to intra‐building or unexposed wiring or cabling only. The intrabuilding port(s) of the equipment or subassembly MUST NOT be metallically connected to interfaces that connect to the OSP or its wiring for more than 6 meters ...
Need help?
Do you have a question about the S9321-64E and is the answer not in the manual?
Questions and answers