Nvidia DGX H100 Manuals

Manuals and User Guides for Nvidia DGX H100. We have 3 Nvidia DGX H100 manuals available for free PDF download: Service Manual, User Manual

Nvidia DGX H100 Service Manual

Nvidia DGX H100 Service Manual (152 pages)

Brand: Nvidia | Category: Computer Hardware | Size: 15 MB

Table of Contents

Table of Contents
3
Introduction
9
Customer-Replaceable Components
9
Recommended Tools
10
Customer Support
10
Running the Pre-Flight Test
11
Front Fan Module Replacement
13
Front Fan Module Replacement Overview
13
Identifying a Failed Fan Module
13
Replacing and Returning the Front Fan Module
17
Power Supply Replacement
19
Power Supply Replacement Overview
19
Identifying the Failed Power Supply
19
Preparing the Power Supply for Replacement
23
Replacing the Power Supply
24
Locking Power Cords
25
Motherboard Tray - Opening and Closing the IO Door
27
Preparing the Motherboard for Service
27
Release the Motherboard
28
Pull Motherboard from Chassis
29
Open the Motherboard IO Door
30
Close the Motherboard IO Door
31
Lock the Motherboard Lid
32
Insert the Motherboard
32
Finalize Motherboard Closing
34
Motherboard Tray - Removal and Installation
35
Preparing the Motherboard for Service
35
Release the Motherboard
36
Pull Motherboard from Chassis
37
Remove the Motherboard Tray Lid
38
Close the Motherboard Tray Lid
39
Insert the Motherboard Tray into the Chassis
40
Insert the Motherboard
42
Finalize Motherboard Closing
43
Nvme Cache Drive Replacement Overview
45
Identifying the Failed U.2 Nvme SSD
45
Identifying the Nvme Manufacturer and Model
46
Replacing the U.2 Nvme Drive
47
Insert the U.2 Nvme Drive
48
Next Steps
50
Nvme Cache Drive Post-Installation Tasks
51
Recreating the Cache RAID 0 Volume
51
Returning the Nvme Drive
52
Nvme Boot Drive Replacement Overview
53
Identify the Failed M.2 Nvme
54
Remove the M.2 Boot Drive Carrier
54
Remove the M.2 Drive
57
Replace the M.2 Drive
59
Install the M.2 Boot Drive Carrier and Close the System
60
Integrate the New Drive and Complete Installation
62
Boot Drive Assembly Replacement
65
Boot Drive Riser Assembly Replacement Overview
65
Preparing the System for Replacement
66
Remove the M.2 Boot Drive Carrier
66
Install the M.2 Boot Drive Carrier and Close the System
69
Re-Install the System and Complete the Procedure
71
DIMM Replacement
73
DIMM Replacement Overview
73
Identifying the Failed DIMM
74
Replacing the DIMM
74
Finalize DIMM Replacement
76
Network Interface Card Replacement
79
Network Card Replacement Overview
79
Prepare the System for Replacement
79
Remove the Non-Functional Card
80
Install the New Card and Close the Lock
81
Finalize the Network Interface Card Replacement
83
Updating the Connectx-7 Firmware
85
Connectx-7 I/O Replacement
87
Connectx-7 I/O Card Replacement Overview
87
Prepare the System for Replacement
88
Remove the I/O Card above the Connectx Card to be Replaced
88
Remove the Connectx Card
88
Remove an IPEX Cable
89
Insert an IPEX Cable
90
Install Connectx Card
91
Install the I/O Card above the Connectx Card
92
Power on the System and Confirm the Replacement
92
Front Console Board Replacement Overview
93
Motherboard Tray Battery Replacement
97
Motherboard Tray Battery Replacement Overview
97
Identify a Failed Battery
98
Prepare the System for Replacement
98
Remove the PCI Ethernet Card
98
Remove the Connectx Card
100
Remove an IPEX Cable
101
Replace the Battery
102
Insert an IPEX Cable
103
Install Connectx Card
104
Install the PCI Ethernet Card
105
Power on the System and Confirm Replacement
107
Trusted Platform Module Replacement
109
Trusted Platform Module Replacement Overview
109
Prepare the System for Replacement
110
Replace the TPM Module
110
Install OSFP Carrier Module
112
Finalize TPM Replacement
113
Removing and Attaching the Bezel
115
Bezel Removal
115
Bezel Installation
116
Rack Mount Kit Replacement
119
Rack Mount Kit Description
119
Remove Rack Mount Kit - Front Rack
120
Remove Rack Mount Kit - Rear
121
Confirm Necessary Screws and Washers
123
Install Cage Nuts Using Template
124
Install Rack Mount Kit - Front
126
Install Rack Mount Kit - Rear
127
Safety
129
Safety Information
129
Safety Warnings and Cautions
129
Intended Application Uses
130
Site Selection
130
Equipment Handling Practices
131
Electrical Precautions
131
Power and Electrical Warnings
131
Power Cord Warnings
132
System Access Warnings
132
Rack Mount Warnings
133
Electrostatic Discharge
134
Other Hazards
134
California Department of Toxic Substances Control
134
Nickel
134
Battery Replacement
134
Cooling and Airflow
135
Compliance
137
United States
137
United States/Canada
137
Canada
138
Australia and New Zealand
139
Brazil
139
Japan
139
South Korea
141
China
142
Taiwan
144
Russia/Kazakhstan/Belarus
145
Israel
146
India
146
South Africa
147
Great Britain (England, Wales, and Scotland)
147
Third-Party License Notices
149
Micron Msecli
149
Mellanox (OFED)
150
Notices
151
Notice
151
Trademarks
152

Advertisement

Nvidia DGX H100 Service Manual

Nvidia DGX H100 Service Manual (146 pages)

Brand: Nvidia | Category: Computer Hardware | Size: 14 MB

Table of Contents

Table of Contents
3
Introduction
7
Customer-Replaceable Components
7
Recommended Tools
8
Customer Support
8
Running the Pre-Flight Test
9
Front Fan Module Replacement
11
Front Fan Module Replacement Overview
11
Identifying a Failed Fan Module
11
Replacing and Returning the Front Fan Module
15
Power Supply Replacement
17
Power Supply Replacement Overview
17
Identifying the Failed Power Supply
17
Preparing the Power Supply for Replacement
21
Replacing the Power Supply
22
Locking Power Cords
23
Motherboard Tray - Opening and Closing the IO Door
25
Preparing the Motherboard for Service
25
Release the Motherboard
26
Pull Motherboard from Chassis
27
Open the Motherboard IO Door
28
Close the Motherboard IO Door
29
Lock the Motherboard Lid
30
Insert the Motherboard
30
Finalize Motherboard Closing
32
Motherboard Tray - Removal and Installation
33
Preparing the Motherboard for Service
33
Release the Motherboard
34
Pull Motherboard from Chassis
35
Remove the Motherboard Tray Lid
36
Close the Motherboard Tray Lid
37
Insert the Motherboard Tray into the Chassis
38
Insert the Motherboard
40
Finalize Motherboard Closing
41
Nvme Cache Drive Replacement Overview
43
Identifying the Failed U.2 Nvme SSD
43
Identifying the Nvme Manufacturer and Model
44
Replacing the U.2 Nvme Drive
45
Insert the U.2 Nvme Drive
47
Next Steps
48
Nvme Cache Drive Post-Installation Tasks
49
Recreating the Cache RAID 0 Volume
49
Returning the Nvme Drive
50
Nvme Boot Drive Replacement Overview
51
Identify the Failed M.2 Nvme
52
Remove the M.2 Boot Drive Carrier
52
Remove the M.2 Drive
54
Replace the M.2 Drive
56
Install the M.2 Boot Drive Carrier and Close the System
57
Integrate the New Drive and Complete Installation
59
Boot Drive Assembly Replacement
61
Boot Drive Riser Assembly Replacement Overview
61
Preparing the System for Replacement
62
Remove the M.2 Boot Drive Carrier
62
Install the M.2 Boot Drive Carrier and Close the System
64
Re-Install the System and Complete the Procedure
66
DIMM Replacement
67
DIMM Replacement Overview
67
Identifying the Failed DIMM
68
Replacing the DIMM
68
Finalize DIMM Replacement
70
Network Interface Card Replacement
73
Network Card Replacement Overview
73
Prepare the System for Replacement
73
Remove the Non-Functional Card
74
Install the New Card and Close the Lock
75
Finalize the Network Interface Card Replacement
77
Updating the Connectx-7 Firmware
79
Connectx-7 I/O Replacement
81
Connectx-7 I/O Card Replacement Overview
81
Prepare the System for Replacement
82
Remove the I/O Card above the Connectx Card to be Replaced
82
Remove the Connectx Card
82
Remove an IPEX Cable
83
Insert an IPEX Cable
84
Install Connectx Card
85
Install the I/O Card above the Connectx Card
86
Power on the System and Confirm the Replacement
86
Front Console Board Replacement Overview
87
Motherboard Tray Battery Replacement
91
Motherboard Tray Battery Replacement Overview
91
Identify a Failed Battery
92
Prepare the System for Replacement
92
Remove the PCI Ethernet Card
92
Remove the Connectx Card
94
Remove an IPEX Cable
95
Replace the Battery
96
Insert an IPEX Cable
97
Install Connectx Card
98
Install the PCI Ethernet Card
99
Power on the System and Confirm Replacement
101
Trusted Platform Module Replacement
103
Trusted Platform Module Replacement Overview
103
Prepare the System for Replacement
104
Replace the TPM Module
104
Install OSFP Carrier Module
106
Finalize TPM Replacement
107
Removing and Attaching the Bezel
109
Bezel Removal
109
Bezel Installation
110
Rack Mount Kit Replacement
113
Rack Mount Kit Description
113
Remove Rack Mount Kit - Front Rack
114
Remove Rack Mount Kit - Rear
115
Confirm Necessary Screws and Washers
117
Install Cage Nuts Using Template
118
Install Rack Mount Kit - Front
120
Install Rack Mount Kit - Rear
121
Safety
123
Safety Information
123
Safety Warnings and Cautions
123
Intended Application Uses
124
Site Selection
124
Equipment Handling Practices
125
Electrical Precautions
125
Power and Electrical Warnings
125
Power Cord Warnings
126
System Access Warnings
126
Rack Mount Warnings
127
Electrostatic Discharge
128
Other Hazards
128
California Department of Toxic Substances Control
128
Nickel
128
Battery Replacement
128
Cooling and Airflow
129
Compliance
131
United States
131
United States/Canada
131
Canada
132
Australia and New Zealand
133
Brazil
133
Japan
133
South Korea
135
China
136
Taiwan
138
Russia/Kazakhstan/Belarus
139
Israel
140
India
140
South Africa
141
Great Britain (England, Wales, and Scotland)
141
Third-Party License Notices
143
Micron Msecli
143
Mellanox (OFED)
144
Notices
145
Notice
145
Trademarks
146
Copyright
146

Nvidia DGX H100 User Manual

Nvidia DGX H100 User Manual (92 pages)

Brand: Nvidia | Category: Computer Hardware | Size: 6 MB

Table of Contents

Table of Contents
3
Introduction to the NVIDIA DGX H100 System
7
Hardware Overview
8
DGX H100 Models and Component Descriptions
8
Mechanical Specifications
9
Power Specifications
9
Support for 4+2 Redundancy
9
DGX H100 Locking Power Cord Specification
9
Using the Locking Power Cords
10
Environmental Specifications
11
Front Panel Connections and Controls
11
With a Bezel
11
With the Bezel Removed
13
Rear Panel Modules
13
Motherboard Connections and Controls
14
Motherboard Tray Components
15
GPU Tray Components
16
Network Connections, Cables, and Adaptors
17
Network Ports
17
Compute and Storage Networking
18
Network Modules
19
Supported Network Cables and Adaptors
20
DGX H100 System Topology
21
DGX os Software
21
Customer Support
22
Connecting to the DGX H100
23
Connecting to the Console
23
Direct Connection
23
Remote Connection through the BMC
25
SSH Connection to the os
27
First Boot Setup
29
System Setup
29
Post Setup Tasks
31
Obtaining Software Updates
31
Enabling the SRP Daemon
31
Quickstart and Basic Operation
33
Installation and Configuration
33
Registration
33
Obtaining an NGC Account
34
Turning DGX H100 on and off
34
Startup Considerations
34
Shutdown Considerations
34
Verifying Functionality - Quick Health Check
34
Running the Pre-Flight Test
35
Running NGC Containers with GPU Support
36
Using Native GPU Support
36
Using the NVIDIA Container Runtime for Docker
37
Managing CPU Mitigations
38
Determining the CPU Mitigation State of the DGX System
38
Disabling CPU Mitigations
39
Re-Enabling CPU Mitigations
39
SBIOS Settings
41
Accessing the SBIOS Setup
41
Configuring the Boot Order
42
Configuring the Local Terminal
44
Linux
44
Windows and Macos
44
Power on or Reboot the System
44
Using the Baseboard Management Controller (BMC)
45
Connecting to the BMC
45
Overview of BMC Controls
46
Changing the BMC Login Credentials
49
Using the Remote Console
49
Setting up Active Directory, LDAP, or E-Directory
49
Configuring Platform Event Filters
50
Uploading or Generating SSL Certificates
51
Viewing the SSL Certificate
51
Generating the SSL Certificate
52
Uploading the SSL Certificate
53
Updating the SBIOS Certificate
53
Security
57
User Security Measures
57
Securing the BMC Port
57
System Security Measures
57
Secure Flash of DGX H100 Firmware
58
Encryption
58
NVIDIA System Manager Security
58
Secure Data Deletion
58
Prerequisites
58
Procedure
59
Redfish Apis Support
61
Supported Redfish Features
61
Redfish Examples
62
BMC Manager
62
Firmware Update
63
BIOS Settings
65
Telemetry
66
Chassis
66
SEL Logs
67
Virtual Image
67
Collect BMC Debug Data
67
Safety
69
Safety Information
69
Safety Warnings and Cautions
69
Intended Application Uses
70
Site Selection
70
Equipment Handling Practices
71
Electrical Precautions
71
Power and Electrical Warnings
71
Power Cord Warnings
72
System Access Warnings
72
Rack Mount Warnings
73
Electrostatic Discharge
74
Other Hazards
74
California Department of Toxic Substances Control
74
Nickel
74
Battery Replacement
74
Cooling and Airflow
75
Compliance
77
United States
77
United States/Canada
77
Canada
78
Australia and New Zealand
79
Brazil
79
Japan
79
South Korea
81
China
82
Taiwan
84
Russia/Kazakhstan/Belarus
85
Israel
86
India
86
South Africa
87
Great Britain (England, Wales, and Scotland)
87
Third-Party License Notices
89
Micron Msecli
89
Mellanox (OFED)
90
Notices
91
Notice
91
Trademarks
92
Copyright
92

Advertisement

Advertisement

Related Products

Nvidia Categories

Video Card Computer Hardware

Switch

Switch Motherboard Adapter

More Nvidia Manuals