Compaq 108164-003 - ProLiant - 800 Integration Notes
Compaq 108164-003 - ProLiant - 800 Integration Notes

Compaq 108164-003 - ProLiant - 800 Integration Notes

Pci bus numbering in a microsoft windows nt environment
Hide thumbs Also See for 108164-003 - ProLiant - 800:

Advertisement

Integration Note
13UK-1200A-WWEN
Prepared by OS Integration
Engineering
Compaq Computer Corporation
Contents
Executive Overview .....................3
Terminology .................................4
PCI System Overview ..................5
Controllers..................................6
PCI BIOS ...................................8
PCI Bus Numbering ...................8
PCI BIOS Discovery...................8
Configuration Changes ............11
Numbering..................................11
Network Controllers..................11
Disk Renumbering....................12
Configuration Tools...................13
Hardware .................................13
Configuration .............................17
System .....................................18
Configuration............................18
Step-By-Step Review ...............19
ProLiant Servers........................19
ML530 ......................................20
8000 .........................................23
DL580 ......................................29
and Utilities ..............................36
Tips .............................................39
Summary ....................................40
Appendices A-D .........................41
PCI Bus Numbering in a

Microsoft Windows NT

Environment
Abstract: Computing environments change rapidly to support
business requirements. Typical network PCI-based servers contain a
large number of expansion slots on multiple buses to allow for
system growth. This means that multiple network and disk
controllers of the same type may be installed in one server, with the
intent that each installed controller supports a separate unique
function. This can make it difficult to understand the physical and
logical implications of PCI bus numbering.
This document provides information to help systems engineering
professionals understand how Microsoft Windows NT handles PCI
bus numbering when controllers are physically added, moved, or
removed from a server configuration. This document also includes
ideas and suggestions that can help systems professionals avoid
network downtime due to configuration changes.
IMPORTANT: During the development of Microsoft Windows
2000, Compaq and Microsoft worked closely together effectively
implementing Windows 2000 on Compaq hardware. Through this
partnership, device detection improved, eliminating PCI bus
numbering issues in the Windows 2000 environment. Windows 2000
checks and resets registry settings automatically, unlike its
predecessor that does not reset the registry settings after discovering
unbound devices.
The following documents were either used as references to produce
this white paper or are mentioned as recommended related reading
material:
PCI System Architecture, Third Edition, MindShare, Inc. Tom
Shanley and Don Anderson, November, 1995.
PCI Bus Balancing and Optimization on Compaq ProLiant
Servers, March, 1998 - Doc ID
Where Do I Plug the Cable? Solving the Logical-Physical Slot
Numbering Problem, December 1996 - Doc ID
Deploying PCI Hot Plug on Compaq
Windows NT
Environment, July 1997 - Doc ID
Help us improve our technical communication. Let us know what you think
about the technical information in this document. Your feedback is valuable
and will help us structure future communications. Please send your
comments to:
CompaqNT@compaq.com
ECG073/0398.
209A/1296.
Servers in a Microsoft
064A/0797.

Advertisement

Table of Contents
loading

Summary of Contents for Compaq 108164-003 - ProLiant - 800

  • Page 1: Table Of Contents

    Disk Renumbering....12 IMPORTANT: During the development of Microsoft Windows Hardware, Software, and Configuration Tools....13 2000, Compaq and Microsoft worked closely together effectively Compaq Servers and Option implementing Windows 2000 on Compaq hardware. Through this Hardware .........13 partnership, device detection improved, eliminating PCI bus Planning a PCI System numbering issues in the Windows 2000 environment.
  • Page 2: December

    Trademark Office. SoftPaq is a trademark and/or service mark of Compaq Computer Corporation. Netelligent is a trademark and/or service mark of Compaq Information Technologies Group, L.P. in the U.S. and/or other countries. Microsoft, Windows, Windows NT, and Windows 2000 are trademarks and/or registered trademarks of Microsoft Corporation.
  • Page 3: Executive Overview

    PCI architecture. The PCI Steering Committee is a group of nine companies that oversees SIG activities and reviews formal recommendations for changes to PCI Specification(s). Compaq is a member of the SIG Steering Committee and actively proposes and contributes new design functions for future revisions to the PCI Specification.
  • Page 4: Pci Bus Architecture Terminology

    PCI Bus Numbering in a Microsoft Windows NT Environment PCI Bus Architecture Terminology Table 1 lists some terms related to PCI Bus Architecture terminology. Some of the terminology defined in this table was referenced from PCI System Architecture, Third Edition, MindShare, Inc.
  • Page 5: Pci Hot Plug Terminology

    PCI Bus Numbering in a Microsoft Windows NT Environment PCI Hot Plug Terminology Table 2 lists some terms related to PCI Hot Plug Terminology; however, this is not a complete list. The terms described here are those that relate to Hot Plug capabilities experienced in this document.
  • Page 6: Pci Architecture And Bridged Controllers

    Figure 2), and Triple-Peer PCI Bus architecture (see Figure 3). The Compaq servers discussed in this white paper and used in the Integration Lab testing include these PCI architecture system designs. Refer to the “Compaq Server and Option Hardware” section of this white paper for more information.
  • Page 7 PCI bridges are not limited to the computer system; controllers can include them also. Hardware manufactures such as Compaq include PCI bridges on controllers to help with signal integrity, enabling more devices to be added per system. Data transfers from the host bus, through the primary PCI bus, through the PCI-to-PCI bridge on the controller, and finally to the PCI device.
  • Page 8: Pci Bios

    Compaq System Configuration Utility during system startup before the operating system initialization (by pressing F10). The System Configuration Utility may be installed on a server with the Compaq SmartStart and Support Software CD or from a diskette to update the server configuration.
  • Page 9 Secondary Host-to-PCI Bridge, followed by PCI controllers and bridged controllers in slots beginning at 2 and ending at 3. Highly Parallel PCI Bus – The Compaq ProLiant ML530 provides an example of highly parallel PCI architecture. This architecture uses dual memory controllers, dual-peer-PCI buses to deliver optimized multiprocessing support to deliver increased system throughput, and increased system performance when compared to traditional x86-based designs.
  • Page 10 PCI Bus Numbering in a Microsoft Windows NT Environment Triple-Peer PCI Bus – The Compaq ProLiant 8000 is an example of the triple-peer PCI architecture. The PCI BIOS begins the discovery process at the Host Bus. In a triple-peer PCI bus architecture the Primary Bus is the first bus detected and it is assigned bus 0.
  • Page 11: Configuration Changes

    However, the bus number assignments in the Windows NT registry can be updated using the appropriate network configuration tool for your controllers. The Compaq TLAN Teaming and Configuration Utility supports Compaq NetFlex-3 and Netelligent Controllers (see Appendix C for usage information),...
  • Page 12: Disk Renumbering

    Compaq and Microsoft provide several utilities you can use to reset device driver and controller bindings. As long as the System Administrator knows bus numbers are assigned in a server, the Windows NT registry can be reset with minimal effort.
  • Page 13: Hardware, Software, And Configuration Tools

    Hardware, Software, and Configuration Tools This section identifies the Compaq servers and option hardware used to create test scenarios in the Compaq Windows NT Integration Lab. All tests ran under the Windows NT 4.0 operating system. In addition to the operating system, several Compaq utilities and Windows NT administration tools were used to aid in the testing process.
  • Page 14 PCI Bus Numbering in a Microsoft Windows NT Environment ProLiant 8000 The ProLiant 8000 has 11 PCI slots: ten 64-Bit slots and one 32-Bit PCI slot (see Figure 4). Primary Bus: Slot 1 is the first PCI slot detected in this server configuration.
  • Page 15 PCI Bus Numbering in a Microsoft Windows NT Environment ProLiant ML350 ProLiant ML350 is a dual-peer bus and has 7 PCI slots: two 64-Bit 3V slots, four 32-Bit slots, and one Non-Shared ISA slot (see Figure 6). Primary Bus: Bus numbering begins on slot 1 and continues to slots 4, 5, and 6.
  • Page 16 Figure 8. Slot view of the ProLiant DL380 Option Hardware The following listing in Table 5 identifies the types of Compaq controllers that are categorized as either PCI bridged or non-bridged. Table 5. PCI bridged and no-bridged controllers...
  • Page 17: Planning A Pci System Configuration

    Note: PCI bus number assignment changes only if PCI bridge devices are added or removed from the system. Compaq recommends adding controllers to slots in the order in which the slots appear on the bus. Following this recommendation prevents the occurrence of the scenarios discussed in the “PCI Test Configurations with ProLiant Servers”...
  • Page 18: Before Modifying An Existing System

    Run Disk Administrator to verify that additional drives have received a signature from Windows NT. Verify you have the necessary Windows NT CDs and the Compaq Support Paq for Microsoft Windows NT 4.0 to update drivers, if necessary. This information will be essential should you need to return to the original configuration.
  • Page 19: Step-By-Step Review

    Load the Compaq Support Paq (CSP) for Microsoft Windows NT 4.0 to ensure the system is running with the latest driver enhancements. In addition to driver enhancements, the Compaq Support Paq installs several important support utilities.
  • Page 20: Configuration A, Proliant Ml530

    PCI Bus Numbering in a Microsoft Windows NT Environment Configuration A, ProLiant ML530 (highly parallel architecture), a two configuration scenario: This scenario walks through a simple Windows NT configuration and shows how the bus numbers change when you add a new controller to the server. Two tables with a side bar description of what the PCI BIOS does during the discovery process illustrate the configurations.
  • Page 21 PCI Bus Numbering in a Microsoft Windows NT Environment Note: Even though PCI bus numbers assign during every boot process, the number remains exactly the same as long as the configuration remains the same. Table 6. PCI BIOS bus detection in a ProLiant ML530–before adding a bridged controller Slot PCI Bridge/ Bus Number...
  • Page 22 PCI Bus Numbering in a Microsoft Windows NT Environment Configuration A – Test 2 – Adding a Device The example in Table 7 illustrates the PCI BIOS discovery and bus number assignment process in the same ProLiant ML530 server. However, the configuration changes slightly by adding a bridged PCI network controller on the Tertiary Bus.
  • Page 23: Configuration B, Proliant 8000

    6 are no longer applicable and must be manually reset for this controller to function in the configuration again. Refer to the “Compaq Network and Teaming Configuration Utility” section in this document for instructions on how to reset the bindings.
  • Page 24 PCI Bus Numbering in a Microsoft Windows NT Environment The diagrams in Figure 9 illustrate the location of the expansion slots in the rear of the ProLiant 8000. 5 6 7 8 9 10 11 Figure 9. Location of expansion slots in the ProLiant 8000 Table 8 illustrates the relationship between slot numbers, controller Bus number assignments for installation, and PCI BIOS bus assignments in Configuration B–Test 1.
  • Page 25 PCI Bus Numbering in a Microsoft Windows NT Environment Table 8. Test 1 – PCI BIOS bus detection in the ProLiant 8000 Slot PCI Bridge/ Bus Number Description of PCI BIOS Detection Number Controller Type Assignment Discovery Process Order/ - Test 1 Controller Discovery The PCI BIOS assigns 0 to...
  • Page 26 PCI Bus Numbering in a Microsoft Windows NT Environment At this point, the PCI BIOS discovery process continues to the Tertiary Bus where it increments the bus assignment to 13. The Smart Array 4250ES Controller in slot 11 is assigned bus 14 since it is a bridged device.
  • Page 27 PCI Bus Numbering in a Microsoft Windows NT Environment Table 9: Test 2 – PCI BIOS bus detection in the ProLiant 8000 Slot Number PCI Bridge/ Bus Number Description of PCI BIOS Discovery Detection Controller Assignment Process Order/ Type - Test 2 Controller Discovery The PCI BIOS assigns 0 to the Primary...
  • Page 28 PCI Bus Numbering in a Microsoft Windows NT Environment Reviewing the Test 2 Configuration – Addition of Two Controllers Configuration B Test 2, illustrated in Table 9, provides an example of how the PCI BIOS discovers new controller devices not present in the original Test 1 configuration and how it assigns bus numbers during the discovery process.
  • Page 29: Configuration C, Proliant Dl580

    PCI Bus Numbering in a Microsoft Windows NT Environment Configuration C, ProLiant DL580 Table 10 is an example of a ProLiant DL580 server set up as an original Window NT server configuration. All the controllers included in this configuration were installed in the server before Windows NT was loaded on the system.
  • Page 30 PCI Bus Numbering in a Microsoft Windows NT Environment assignment occurs. The NC3131 Fast Ethernet NIC (a bridged device), residing in slot 3, increments the bus number. The discovery process completes with the discovery of the Tertiary Bus, assigning a bus number of 7. Since slots 4 and 5 comprising the Tertiary Bus are empty, no bus number assignment occurs for these slots.
  • Page 31: Th Slot 3 Empty N/A

    PCI Bus Numbering in a Microsoft Windows NT Environment Reviewing the Test 2 Configuration Windows NT enumerates the NIC instances on the PCI bus from the highest numbered slot to the lowest numbered slot. The bindings for each instantiation of the NIC drivers are dependent upon the PCI bus number of each NIC.
  • Page 32 Determine what tools to use ahead of time for resetting the system should the need occur. Reestablishing Network Connections The following section describes how the various Compaq and Windows NT utilities can provide assistance in verifying connections and reestablishing network links. Again, this is not a complete list of tools, but the ones that our testing found the most helpful.
  • Page 33 The following section illustrates how to reconfigure a controller(s). Main Window: Each Compaq Ethernet, Fast Ethernet, or Gigabit network controller that you install as standalone must have a separate driver instance in Microsoft Windows NT. If any unbound services exist, the Compaq Network Teaming and Configuration Utility detects them when the utility starts and displays the status of each.
  • Page 34 1. Double click Start Settings Control Panel. 2. Select the Compaq Network icon to launch the Network Teaming and Configuration Utility. a. Highlight the controller that did not load (no other controllers should be selected). b. Click the Uninstall option.
  • Page 35 5. Shut down and restart the server when the network controller configuration completes. When configuration changes are made affecting other manufacturer’s controllers, the Compaq Network Teaming and configuration Utility to reestablish bindings (required when the controller receives a new bus number because of modifications).
  • Page 36: Compaq Support Software And Utilities

    It displays the physical slot number for each installed controller board and, in most cases, the bus number. You can find it on the Compaq SmartStart and Support Software CD and on the Compaq website at http://www.compaq.com/support/files/server/us/index.html.
  • Page 37 PCI Bus Numbering in a Microsoft Windows NT Environment The Compaq Array Configuration Utility is packaged as a Smart Component and as part of the Compaq Support Paq, which may be found at the following locations: Compaq SmartStart and Support Software CD (http://www.compaq.com/support/files/server/us/smartstart.html)
  • Page 38 The illustration in Figure 12 illustrates how labels can assist you to identify drives and volumes in the server. Without labels, the disk can only be identified by the drive letter. IMPORTANT: Compaq strongly recommends that you label disks and volumes with meaningful labels.
  • Page 39: Additional Troubleshooting Tips

    Slot 11 – Ter Bus In addition to this matrix, there is a PCI Bus Numbering HTML calculation tool for each server in Table 11. You can access these tools on the Internet by going to the Compaq and Microsoft 13UK-1200A-WWEN...
  • Page 40: Summary

    Frontline Partnership site http://www.compaq.com/partners/microsoft/resourcepaq/utilities/pci.html. You can use these tools to enter Compaq PCI bridged and non-bridge controllers in PCI slots for any of the servers included in Table 11. The bus numbers are immediately displayed when you select a controller and place it in a slot.
  • Page 41: Appendices A-D

    Compaq ProLiant Servers Retired Compaq ProLiant Servers The PCI bus numbering scheme of four retired Compaq ProLiant server models are detailed in this appendix. Note: The features discussed in this section are not to be considered a complete description for any of the server or option hardware.
  • Page 42 PCI Bus Numbering in a Microsoft Windows NT Environment ProLiant 6500 ProLiant 6500 is a dual-peer bus and has 8 PCI slots: 2 shared compatibility PCI/EISA slots and 6 hot plug secondary PCI slots (see Figure 14). Primary Bus: Slots 1 and 2 are shared PCI/EISA slots in this server configuration.
  • Page 43 Appendix B, PCI Test Configurations with Retired ProLiant Servers The following scenarios were tested in the Compaq Integration Lab. The scenarios demonstrate how the PCI BIOS assigns the bus numbers and then reassigns the bus numbers based on configuration modifications. The following examples demonstrate the step-by-step changes that occur: Configuration A: Test 1 –...
  • Page 44 PCI Bus Numbering in a Microsoft Windows NT Environment Configuration A: Test 1 – Initial Configuration This bus number and controller discovery test was performed on a simple Even though PCI bus numbers are configuration in a dual-peer PCI ProLiant 6500 server (see Table 13). This assigned during every boot configuration is described as simple because it contains only two non- process, the assignment is exactly...
  • Page 45 PCI Bus Numbering in a Microsoft Windows NT Environment the PCI controllers discovered on each bus. In this example, the controllers do not contain bridges. Therefore, they are assigned the same bus number as the bus on which they reside. Configuration A –...
  • Page 46 4 are no longer applicable and must be manually reset for this controller to function in the configuration once again. Refer to the “Compaq TLAN Network Teaming and Configuration” section in this document for instructions on how to reset the bindings.
  • Page 47 PCI Bus Numbering in a Microsoft Windows NT Environment The diagrams in Figure 16 illustrate the location of the expansion slots in the rear of the ProLiant 6000 and 7000 servers. Both servers share the same bus design and slot layout; however, the ProLiant 7000 server contains hot pluggable slots on the Secondary Bus as shown in Figure 16.
  • Page 48 PCI Bus Numbering in a Microsoft Windows NT Environment Table 15. Test 1 – PCI BIOS bus detection in the ProLiant 6000 and 7000 servers Slot PCI Bridge/ Description of PCI BIOS Discovery Detection Number Controller Number Process Order/ Type - Test 1 Assignment Controller Discovery...
  • Page 49 PCI Bus Numbering in a Microsoft Windows NT Environment IMPORTANT: The controllers that Compaq added to the server configuration were selected only to illustrate how bus renumbering occurs. Several different SMART Array and network controllers were included to demonstrate that they all respond to renumbering in the same manner.
  • Page 50 PCI Bus Numbering in a Microsoft Windows NT Environment Reviewing the Test 2 Configuration – Addition of Two Controllers Configuration B Test 2, illustrated in Table 15, provides an example of how the PCI BIOS discovers new controller devices that were not present in the original Test 1 configuration and how it assigns bus numbers during the discovery process.
  • Page 51 Access the applet from the Windows NT Control Panel; the icon is labeled Compaq NetFlex. This utility is installed from the Compaq Support Paq for Microsoft Windows NT 4.0, if the system contains Compaq ThunderLAN-based network controllers.
  • Page 52 PCI Bus Numbering in a Microsoft Windows NT Environment Appendix D, Order of Detection for Retired Compaq ProLiant Servers Table 18 lists the PCI bus detection order, Primary and Secondary bus locations, and slot numbers for the several retired ProLiant servers. This matrix can help you identify how the PCI BIOS assigns bus numbers in these servers.

Table of Contents