Page 1
Z9PH-D16 Series Z9PH-D16 Z9PH-D16/QDR Z9PH-D16/FDR...
Page 2
Product warranty or service will not be extended if: (1) the product is repaired, modified or altered, unless such repair, modification of alteration is authorized in writing by ASUS; or (2) the serial number of the product is defaced or missing.
Package contents ................. 1-3 Serial number label ..............1-4 Special features ................1-4 1.4.1 Product highlights ............1-4 1.4.2 Innovative ASUS features ..........1-6 Chapter 2: Hardware information Before you proceed ..............2-3 Motherboard overview ..............2-4 2.2.1 Placement direction ............2-4 2.2.2...
Page 4
Using the dual function power switch ......3-4 Chapter 4: BIOS setup Managing and updating your BIOS ..........4-3 4.1.1 ASUS CrashFree BIOS 3 utility ........4-3 4.1.2 ASUS EZ Flash 2 Utility ..........4-4 4.1.3 BUPDATER utility............4-5 BIOS setup program ..............4-7 4.2.1...
Page 6
Mellanox ConnectX-3 Infiniband driver installation (Z9PH-D16/QDR and Z9PH-D16/FDR only) ....... 6-34 6.9.1 Windows operating system ..........6-34 6.9.2 Red Hat ® Enterprise Linux OS ..........6-37 Appendix: Reference information A.1 Z9PH-D16 Series block diagram ............A-3 ASUS contact information ................1...
Canadian Department of Communications. This class B digital apparatus complies with Canadian ICES-003. REACH Complying with the REACH (Registration, Evaluation, Authorization, and Restriction of Chemicals) regulatory framework, we publish the chemical substances in our products at ASUS REACH website at http://csr.asus.com/english/REACH.htm.
Safety information Electrical safety • To prevent electrical shock hazard, disconnect the power cable from the electrical outlet before relocating the system. • When adding or removing devices to or from the system, ensure that the power cables for the devices are unplugged before the signal cables are connected.
Refer to the following sources for additional information and for product and software updates. ASUS websites The ASUS website provides updated information on ASUS hardware and software products. Refer to the ASUS contact information. Optional documentation Your product package may include optional documentation, such as warranty flyers, that may have been added by your dealer.
Conventions used in this guide To make sure that you perform certain tasks properly, take note of the following symbols used throughout this manual. DANGER/WARNING: Information to prevent injury to yourself when trying to complete a task. CAUTION: Information to prevent damage to the components when trying to complete a task.
(Support software RAID 0, 1 & 10) SAS Controller Optional kits(PIKE Riser card is necessary): ASUS PIKE 2008 8-port SAS 6G RAID card ASUS PIKE 2008/IMR 8-port SAS 6G RAID card ASUS PIKE 2108 8-port SAS 6G RAID card Networking - 2 x Intel ®...
Page 12
FAN RPM Environment °C °C Operating temperature: 10 – 35 °C °C Non operating temperature: -40 – 70 Non operating humidity: 20% – 90% (Non condensing) *Refer to ASUS Server AVL for latest update. **Specifications are subject to change without notice.
This chapter describes the motherboard features and the new technologies it supports. Product introduction...
Page 14
Chapter summary Welcome! ..................1-3 Package contents ................. 1-3 Serial number label ..............1-4 Special features ................1-4 ASUS Z9PH-D16 Series...
Z9PH-D16 Series motherboard! The motherboard delivers a host of new features and latest technologies, making it another standout in the long line of ASUS quality motherboards! Before you start installing the motherboard, and hardware devices on it, check the items in your package with the list below.
Before requesting support from the ASUS Technical Support team, you must take note of the motherboard's serial number containing 12 characters xxS2xxxxxxxx shown as the figure below. With the correct serial number of the product, ASUS Technical Support team members can then offer a quicker and satisfying solution to your problems.
Page 17
The motherboard implements the Universal Serial Bus (USB) 2.0 specification, dramatically increasing the connection speed from the 12 Mbps bandwidth on USB 1.1 to a fast 480 Mbps on USB 2.0. USB 2.0 is backward compatible with USB 1.1. ASUS Z9PH-D16 Series...
PIKE (Proprietary I/O Kit Expansion) PIKE is an on-demand upgrade kit for users. This ASUS unique feature enables users to choose their preferred I/O solutions. ASUS provides multiple SAS solutions for different segments and purposes and PIKE saves lots of validation efforts and hardware cost for end users.
This chapter lists the hardware setup procedures that you have to perform when installing system components. It includes description of the jumpers and connectors on the motherboard. Hardware Chapter 2: information...
Page 20
Chapter summary Before you proceed ..............2-3 Motherboard overview ..............2-4 Central Processing Unit (CPU) ........... 2-9 System memory ................. 2-15 Expansion slots ................2-18 Jumpers ..................2-21 Connectors ................. 2-24 Internal LEDs ................2-34 ASUS Z9PH-D16 Series...
ON, in sleep mode, or in soft-off mode. This is a reminder that you should shut down the system and unplug the power cable before removing or plugging in any motherboard component. The illustration below shows the location of the onboard LED. ASUS Z9PH-D16 Series...
Motherboard overview Before you install the motherboard, study the configuration of your chassis to ensure that the motherboard fits into it. Ensure to unplug the chassis power cord before installing or removing the motherboard. Failure to do so can cause you physical injury and damage motherboard components! 2.2.1 Placement direction...
LAN 1 (RJ-45) port 2-26 DM_LAN 1 (RJ-45) port 2-26 LAN 2 (RJ-45) port 2-26 Video Graphics Adapter port 2-26 Serial (COM1) port 2-26 InfiniBand (QSFP) (Z9PH-D16/FDR and Z9PH-D16/QDR only) 2-26 USB 2.0 ports 1 and 2 2-26 ASUS Z9PH-D16 Series...
Page 26
Internal connectors Page Serial ATA connectors 2-27 (7-pin SATA1-2 [Lght blue], SATA3–4 [Black]) ISAS connectors (7-pin ISAS1–4 [Gray]) 2-27 USB connector (5-1 pin USB3; A-Type USB4) 2-28 Front fan connectors 2-28 (4-pin FRNT_FAN1, FRNT_FAN2, FRNT_FAN3, FRNT_FAN4) Serial General Purpose Input/Output connector 2-29 (6-1 pin SGPIO1) Serial General Purpose Input/Output connector...
ASUS will shoulder the cost of repair only if the damage is shipment/transit-related. • Keep the cap after installing the motherboard. ASUS will process Return Merchandise Authorization (RMA) requests only if the motherboard comes with the cap on the LGA2011 socket.
Page 28
Press the left load lever with your thumb (A), then move it to the left (B) until it is released from the retention tab. Load lever To prevent damage to the socket pins, do not remove the PnP cap unless you are installing a CPU. Slightly lift the load lever in the direction of the arrow.
Page 29
The CPU fits in only one correct orientation. DO NOT force the CPU into the socket to prevent bending the connectors on the socket and damaging the CPU! Remove the PnP cap (H) from the CPU socket and close the load plate (I). ASUS Z9PH-D16 Series 2-11...
Page 30
Push down the right load lever (J), ensuring that the edge of the load plate is fixed by the lever (K). Insert the right load lever under the retention tab. 10. Push down the left load lever (L), and then insert the lever under the retention tab (M).
Page 31
If so, skip this step. The Thermal Interface Material is toxic and inedible. DO NOT eat it. If it gets into your eyes or touches your skin, wash it off immediately, and seek professional medical help. ASUS Z9PH-D16 Series 2-13...
2.3.2 Installing the CPU heatsink To install the CPU heatsink: Place the heatsink on top of the installed CPU, ensuring that the four fasteners match the holes on the motherboard. Twist each of the four screws with a Philips (cross) screwdriver just enough to attach the heatsink to the motherboard.
System memory 2.4.1 Overview The motherboard comes with sixteen (16) Double Data Rate 3 (DDR3) Dual Inline Memory Modules (DIMM) sockets. The figure illustrates the location of the DDR3 DIMM sockets: ASUS Z9PH-D16 Series 2-15...
1 DIMMs 2 DIMMs 4 DIMMs 8 DIMMs • *Refer to ASUS Server AVL for latest update. • Start installing the DIMMs from slot A1 and B1 (light blue). • Always install DIMMs with the same CAS latency. For optimum compatibility, it is recommended that you obtain memory modules from the same vendor.
Press the retaining clip outward to unlock the DIMM. Remove the DIMM from the socket. Support the DIMM lightly with your fingers when pressing the retaining clips. The DIMM might get damaged when it flips out with extra force. ASUS Z9PH-D16 Series 2-17...
Expansion slots In the future, you may need to install expansion cards. The following subsections describe the slots and the expansion cards that they support. Ensure to unplug the power cord before adding or removing expansion cards. Failure to do so may cause you physical injury and damage motherboard components.
When installing the motherboard to a 1U/2U rackmount server system, first install the expansion card using an optional PCIe x16 riser card, then install the riser card along with the expansion card to the onboard PCI Express x16 slot. ASUS Z9PH-D16 Series 2-19...
2.5.5 Installing ASMB6 management board Follow the steps below to install an optional ASMB6 management board on your motherboard. Locate the ASMB6 header on the motherboard. Orient and press the ASMB6 management card in place. 2-20 Chapter 2: Hardware information...
Removing the cap will cause system boot failure! If the steps above do not help, remove the onboard battery and move the jumper again to clear the CMOS RTC RAM data. After the CMOS clearance, reinstall the battery. ASUS Z9PH-D16 Series 2-21...
Page 40
VGA controller setting (3-pin VGA_SW1) This jumper allows you to enable or disable the onboard VGA controller. Set to pins 1–2 to activate the VGA feature. LAN controller setting (3-pin LAN_SW1, LAN_SW2) These jumpers allow you to enable or disable the onboard Intel Intel ®...
Page 41
Intel Rapid Storage Technology Enterprise Option ROM Utility. ® ME firmware force recovery setting (3-pin ME_RCVR1) This jumper allows you to quickly recover the Intel Management Engine (ME) firmware when it becomes corrupted. ASUS Z9PH-D16 Series 2-23...
DIMM thermal trip Setting (3-pin DIMMTRIP1) This jumper allows you to enable(default) or disable DIMM thermal trip. Connectors 2.7.1 Rear panel connectors LAN 2 (RJ-45) port. This port allows Gigabit connection to a Local Area Network (LAN) through a network hub. Refer to the table below for the LAN port LED indications.
Page 43
No device ORANGE GREEN Device plugged in; Ready ORANGE BLINKING GREEN Device plugged in; Data transmitting USB 2.0 ports 1 and 2. These two 4-pin Universal Serial Bus (USB) ports are available for connecting USB 2.0 devices. ASUS Z9PH-D16 Series 2-25...
2.7.2 Internal connectors Serial ATA connectors (7-pin SATA1-2 [Light blue], SATA3–4 [Black]) (SATA 6Gb/s: 7-pin SATA1-2 [Light blue]) (SATA 3Gb/s: 7-pin SATA3-4 [Black]) These connectors, controlled by Intel ® C602 chipset, are for the Serial ATA signal cables for Serial ATA hard disk drives. The actual data transfer rate depends on the speed of Serial ATA hard disks installed.
Page 45
ATA 3Gb/s hard disk drives. The actual data transfer rate depends on the speed of SATA hard disks installed. ® Rapid Storage Technology utility, please refer to Chapter For details on the Intel 6 RAID Configuration ASUS Z9PH-D16 Series 2-27...
Page 46
DO NOT forget to connect the fan cables to the fan connectors. Insufficient air flow inside the system may damage the motherboard components. • These are not jumpers! DO NOT place jumper caps on the fan connectors! • All fans feature the ASUS Smart Fan technology. 2-28 Chapter 2: Hardware information...
Page 47
Intel Matrix RAID SATA LED. Serial General Purpose Input/Output connector (8-1 pin ISGPIO1) This connector is used for the SGPIO peripherals for the LSI MegaRAID and Intel Matrix RAID SATA LED.This connector is used for SCU. ASUS Z9PH-D16 Series 2-29...
Page 48
ASMB6 header (ASMB6) The ASMB6 connector on the motherboard supports an ASUS Server ® Management Board 6 Series. Thermal sensor cable connectors (3-pin TR1, TR2) These connectors are for temperature monitoring. Connect the thermal sensor cables to these connectors and place the other ends to the devices, which you want to monitor temperature.
Page 49
This connector allows you to connect SMBus (System Management Bus) to the power supply unit to read PSU information. Devices communicate with an SMBus host and/or other SMBus devices using the SMBus interface. PSU_ALERT# BMC_SYNC 12C1SCL_PB 12C1SDA_PB ASUS Z9PH-D16 Series 2-31...
Page 50
11. Proprietary power connectors (20-pin PWR1, 20-pin PWR2, 4-pin PWR3) These connectors are for Proprietary power supply plugs. The power supply plugs are designed to fit these connectors in only one orientation. Orient the connectors and push down firmly until they completely fit. The 4-pin PWR3 is designed for hard disk drives power supply.
BIOS settings. Pressing the power switch for more than four seconds while the system is ON turns the system OFF. Reset button (2-pin RESET) This 2-pin connector is for the chassis-mounted reset button for system reboot without turning off the system power. ASUS Z9PH-D16 Series 2-33...
13. Auxiliary panel connector (20-pin AUX_PANEL1 [Black]) This connector is for additional front panel features including front panel SMB, locator LED and switch, chassis intrusion, and LAN LEDs. Front panel SMB (6-1 pin FPSMB) These leads connect the front panel SMBus cable. LAN activity LED (2-pin LAN1_LED, LAN2_LED) These leads are for Gigabit LAN activity LEDs on the front panel.
The CPU warning LEDs light up to indicate an impending failure of the corresponding CPU. The warning LEDs function only when you install the ASUS ASMB6. 2. BMC LED(BMC_LED1) The green heartbeat LED blinks per second to indicate that the ASMB6 is working normally.
Check the jumper settings and connections or call your retailer for assistance. At power on, hold down the <Del> key to enter the BIOS Setup. Follow the instructions in Chapter 4. ASUS Z9PH-D16 Series...
Powering off the computer 3.2.1 Using the OS shut down function If you are using Windows 2008 Server: ® Click the Start button, move the cursor to the triangle on the right of Log off, and then click Shut Down. From the Shutdown Event Tracker, select the option that best describes why you want to shut down the computer.
This chapter tells how to change the system settings through the BIOS Setup menus. Detailed descriptions of the BIOS parameters are also provided. BIOS setup Chapter 4:...
Page 60
Main menu .................. 4-10 Advanced menu ................. 4-11 Server Mgmt menu ..............4-36 Event Logs menu ............... 4-39 Boot menu .................. 4-41 Monitor menu ................4-43 Security menu ................4-44 4.10 Tool menu ................... 4-45 4.11 Exit menu ..................4-46 ASUS Z9PH-D16 Series...
4.1.1 ASUS CrashFree BIOS 3 utility The ASUS CrashFree BIOS 3 is an auto recovery tool that allows you to restore the BIOS file when it fails or gets corrupted during the updating process. You can update a corrupted BIOS file using a USB flash drive that contains the updated BIOS file.
4.1.2 ASUS EZ Flash 2 Utility The ASUS EZ Flash 2 Utility feature allows you to update the BIOS without having to use a DOS-based utility. Before you start using this utility, download the latest BIOS from the ASUS website at www.asus.com.
Updating the BIOS file To update the BIOS file using the BUPDATER utility: Visit the ASUS website at www.asus.com and download the latest BIOS file for the motherboard. Save the BIOS file to a bootable USB flash disk drive. Copy the BUPDATER utility (BUPDATER.exe) from the ASUS support website at support.asus.com to the bootable USB flash disk drive you created...
Page 64
The utility verifies the file, then starts updating the BIOS file. ASUSTek BIOS Update for DOS V1.06 (09/08/04) FLASH TYPE: MXIC 25L1605A Update ROM Current ROM BOARD: Z9PH-D16 BOARD: Z9PH-D16 VER: 0203 VER: 0206 DATE: 08/24/2011 DATE: 09/30/2011 PATH: WARNING! Do not turn off power during flash BIOS Note Writing BIOS: DO NOT shut down or reset the system while updating the BIOS to prevent...
The BIOS setup screens shown in this section are for reference purposes only, and may not exactly match what you see on your screen. • Visit the ASUS website (www.asus.com) to download the latest BIOS file for this motherboard. ASUS Z9PH-D16 Series...
4.2.1 BIOS menu screen Menu items Menu bar Configuration fields General help Aptio Setup Utility - Copyright (C) 2011 American Megatrends, Inc. Main Advanced Server Mgmt Event Logs Boot Monitor Security Tool Exit Set the Date, Use Tab to BIOS Information switch between Data elements.
A scroll bar appears on the right side of a menu screen when there are items that do not fit on the screen. Press the Up/Down arrow keys or <Page Up> /<Page Down> keys to display the other items on the screen. ASUS Z9PH-D16 Series...
Main menu When you enter the BIOS Setup program, the Main menu screen appears. The Main menu provides you an overview of the basic system information, and allows you to set the system date, time settings. Aptio Setup Utility - Copyright (C) 2011 American Megatrends, Inc. Main Advanced Server Mgmt...
DCU Streamer Prefetcher [Enabled] F2: Previous Values DCU IP Prefetcher [Enabled] F5: Optimized Defaults Intel Virtualization Technology [Enabled] F10: Save & Exit Local APIC Mode [Disabled] ESC: Exit Version 2.14.1219. Copyright (C) 2011 American Megatrends, Inc. ASUS Z9PH-D16 Series 4-11...
Page 70
Socket 1 CPU Information Enter to view socket soecific CPU Information. Aptio Setup Utility - Copyright (C) 2011 American Megatrends, Inc. Advanced Socket 1 CPU Information Genuine Intel(R) CPU @ 2.60GHz CPU Signature 206d5 Microcode Patch Max CPU Speed 2600 MHz Min CPU Speed 1200 MHz Processor Cores...
Recommended short duration power 1 1.2 * Long Duration Enter: Select Item Short duration power limit +/-: Change Opt. F1: General Help F2: Previous Values F5: Optimized Defaults F10: Save & Exit ESC: Exit Version 2.14.1219. Copyright (C) 2011 American Megatrends, Inc. ASUS Z9PH-D16 Series 4-13...
Page 72
Power Technology [Custom] This item allows you to enable power management features. Configuration options: [Disabled] [Energy Efficient] [Custom] EIST [Enabled] This item allows you to enable or disable Intel SpeedStep. Configuration options: [Disabled] [Enabled] Turbo Mode [Enabled] Configuration options: [Disabled] [Enabled] P-STATE Coordination [HW_ALL] This item allows you to enable or disable Intel SpeedStep.
QPI Link1 [Enabled] Isoc [Enabled] Configuration options: [Disabled] [Enabled] QPI Link Speed Mode [Fast] This item allows you to select the QPI link speed as either the fast mode or slow mode. Configuration options: [Slow] [Fast] ASUS Z9PH-D16 Series 4-15...
Allows you to enable or disable onboard SATA RAID option rom if Launch Storage Oprom is enabled. Configuration options: [Disabled] [Enabled] High Precision Event Timer Configuration High Precision Timer [Enabled] Allows you to enable or disable High Precision Event Timer. Configuration options: [Disabled] [Enabled] ASUS Z9PH-D16 Series 4-19...
PCH SATA Configuration Aptio Setup Utility - Copyright (C) 2011 American Megatrends, Inc. Advanced SATA Port1 Not Present (1)IDE Mode. (2)AHCI Mode. SATA Port2 ASUS DWR ATAPI (3)RAID Mode. SATA Port3 WDC WD800JD(80.0GB) SATA Port4 Not Present SATA Mode [AHCI Mode]...
Page 79
Staggered spin-up is a feature defined in teh Serial ATA Specifications. It enables an HBA to individually spin-up attached SATA devices to avoid maximum current charged by applying all attached SATA devices at the same time. Configuration options: [Disabled] [Enabled] ASUS Z9PH-D16 Series 4-21...
PCI Express Settings Aptio Setup Utility - Copyright (C) 2011 American Megatrends, Inc. Advanced Set the ASPM Level: Force PCI Express Link Register Settings L0s - Force all links to ASPM Support [Disabled] L0s State: AUTO - BIOS auto W A R N I N G : E n a b l i n g A S P M m a y c a u s e s o m e configure: DISABLE: Disables PCI-E device to fail ASPM.
→←: Select Screen TPM State Disabled Select Item ↑↓: Enter: Select Item +/-: Change Opt. F1: General Help F2: Previous Values F5: Optimized Defaults F10: Save & Exit ESC: Exit Version 2.14.1219. Copyright (C) 2011 American Megatrends, Inc. ASUS Z9PH-D16 Series 4-25...
4.4.8 USB Configuration Aptio Setup Utility - Copyright (C) 2011 American Megatrends, Inc. Advanced Enabled Legacy USB support. USB Configuration Auto option disables legacy support if no USB devices USB Devices: are connected. DISABLE 1Keyboard, 1 Mouse, 3 Hubs option will keep USB devices available only for EFI Legacy USB Support [Enabled]...
TPM Active Status: [Deactivated] TPM Owner Status: [UnOwned] TPM Support [Enabled] Allows you to enable or disable the TPM support. Configuration options: [Disabled] [Enabled] Pending operation [None] Configuration options: [None] [Enable Take Owership] [Disable Take Ownership] [TPM Clear] ASUS Z9PH-D16 Series 4-27...
Configuration options: [Disabled] [Enabled] Power On By RTC [Disabled] [Disabled] Disables RTC to generate a wake event. When set to [Eanbled], the items RTC Alarm Date (Days) and [Enabled] Hour/Minute/Second will become user-configurable with set values. ASUS Z9PH-D16 Series 4-29...
Extended ASCII char set Bits per second [57600] Selects serial port transmission speed. The speed must be matched on the other side. Long or noisy lines may require lower speeds. Configuration options: [9600] [19200] [38400] [57600] [115200] ASUS Z9PH-D16 Series 4-31...
Data Bits [8] Configuration options: [7] [8] Parity [None] A parity bit can be sent with the data bits to detect some transmission errors. [Mark] and [Space] parity do not allow for error detection. [None] none [Even] parity bit is 0 if the num of 1’s in the data bits is even [Odd] parity bit is 0 if num of 1’s in the data bits is odd [Mark]...
Page 91
Windows Server OS through a serial port. Configuration options: [9600] [19200] [57600] [115200] Flow Control [None] Microsoft Windows Emergency Management Services (EMS) allow for remote management of a Windows Server OS through a serial port. Configuration options: [None] [Hardware RTS/CTS] [Software Xon/Xoff] ASUS Z9PH-D16 Series 4-33...
4.4.15 ME Subsystem Aptio Setup Utility - Copyright (C) 2011 American Megatrends, Inc. Advanced ME Subsystem Help. Intel ME Subsystem Configuration ME BIOS Interface Version ME Version 0.0.0.0 ME FW Status Value : ME FW State SPS ME FW Active ME FW Operation State: M0 without UMA ME FW Error Code:...
Configuration options: [Disabled] [Enabled] The following item appears only when you set Runtime Error Logging Support to [Enabled]. PCI Error Logging Support [Disabled] Allows you to enable or disable PCI Error Logging. Configuration options: [Disabled] [Enabled]. ASUS Z9PH-D16 Series 4-35...
Server Mgmt menu The Server Mgmt menu displays the server mgmt status, and allows you to change the settings. The Server Mgmt menu appears only when you install ASMB card on the motherboard. Aptio Setup Utility - Copyright (C) 2011 American Megatrends, Inc. Main Advanced Server Mgmt...
Configuration options: [No] [Yes, On next reset] [Yes, On every reset] When SEL is Full [Do Nothing] Allows you to choose options for reactions to a full SEL. Configuration options: [Do Nothing] [Erase Immediately] Custom EFI Logging Options ASUS Z9PH-D16 Series 4-37...
4.5.2 BMC network configuration Aptio Setup Utility - Copyright (C) 2011 American Megatrends, Inc. Server Mgmt BMC network configuration Select to configure LAN channel parameters DM_LAN1 statically or dynamically(by BIOS or BMC). Unspecified DM_LAN1 IP Address in BMC: 192.168.001.001 option will not modify any DM_LAN1 Subnet Mask in BMC: 255.255.255.000 BMC network parameters...
[Disabled] [Enabled] Erasing Settings Erase Event Log [No] Choose options for erasing Smbios Event Log. Erasing is done prior to any logging activation during reset. Configuration options: [No] [Yes, Next reset] [Yes, Every reset] ASUS Z9PH-D16 Series 4-39...
When Log is Full [Do Nothing] Allows you to choose options for reactions to a full Smbios Event Log. Configuration options: [Do Nothing] [Erase Immediately] Smbios Event Log Standard Settings Log System Boot Event [Disabled] Allows you to choose options to enable or disable logging of System boot event.
Full Screen Logo [Enabled] Allows you to enable or disable the full screen logo display feature. Configuration options: [Disabled] [Enabled] Set this item to [Enabled] to use the ASUS MyLogo2™ feature. CSM16 Module Version GateA20 Active [Upon Request] [Upon Request] GA20 can be disabled using BIOS services.
Page 100
The number of device items that appears on the screen depends on the number of devices installed in the system. • To select the boot device during system startup, press <F8> when ASUS Logo appears. • To access Windows OS in Safe Mode, please press <F8> after POST.
+VTT_CPU Voltage, VCORE1/2 Voltage, +VDDQ_AB_CPU1 Voltage, +VDDQ_CD_CPU1 Voltage, +VDDQ_EF_CPU2 Voltage, +VDDQ_GH_CPU2 Voltage, +5VSB Voltage, +5V Voltage , +12V Voltage, +3.3V Voltage, VBAT Voltage, +3.3VSB Voltage The onboard hardware monitor automatically detects the voltage output through the onboard voltage regulators. ASUS Z9PH-D16 Series 4-43...
FAN Speed Control [Generic Mode] Allows you to configure the ASUS Smart Fan feature that smartly adjusts the fan speeds for more efficient system operation. Configuration options: [Generic Mode] [High Speed Mode] [Full Speed Mode] Security menu The Security menu items allow you to change the system security settings.
Be used to update BIOS ASUS EZ Flash 2 Utility ASUS EZ Flash 2 Utility Allows you to run ASUS EZ Flash BIOS ROM Utility when you press <Enter>. Check section 4.1.2 ASUS EZ Flash 2 Utility for details. ASUS Z9PH-D16 Series...
4.11 Exit menu The Exit menu items allow you to save or discard your changes to the BIOS items. Aptio Setup Utility - Copyright (C) 2011 American Megatrends, Inc. Main Advanced Server Mgmt Event Logs Boot Monitor Security Tool Exit Discard Changes &...
Page 105
Click an item to start booting from the selected device. Launch EFI Shell from filesystem device Attempts to launch EFI Shell application (shellx64.efi) from one of the available filesystem devices. ASUS Z9PH-D16 Series 4-47...
• Please refer to chapter 2 for how to select the RAID configuration utility. Move the jumper to choose between LSI MegaRAID and Intel ® Rapid RAID. ASUS Z9PH-D16 Series...
5.1.2 Installing hard disk drives The motherboard supports Serial ATA for RAID set configuration. For optimal performance, install identical drives of the same model and capacity when creating a disk array. To install the SATA hard disks for RAID configuration: Install the SATA hard disks into the drive bays following the instructions in the system user guide.
LSI Software RAID Configuration Utility Ver C.05 Sep 17, 2010 BIOS Version A.10.09231523R Management Menu Configure Initialize Objects Rebuild Check Consistency Configure VD(s) Use Cursor Keys to Navigate Between Items And Press Enter To Select An Option ASUS Z9PH-D16 Series...
Menu Description Allows you to create RAID 0, RAID 1 or RAID 10 set using the Easy Configure Configuration or the New Configuration command. This menu also allows you to view, add, or clear RAID configurations or select the boot drive Allows you to initialize the virtual drives of a created RAID set Initialize Allows you to initialize virtual drives or change the virtual drive...
Page 113
LSI Software RAID Configuration Utility Ver C.05 Sep 17, 2010 BIOS Version A.10.09231523R Easy Configuration - ARRAY SELECTION MENU Select Configurable Array(s) Management Menu PORT # Configure DNLIN A00-00 SPAN-1 Initialize Objects DNLIN A00-01 Rebuild Check Consistency Cursor Keys, SPACE-(De)Select F2-ChIdInfo F3-SlotInfo F10-Configure Esc-Quit ASUS Z9PH-D16 Series...
Page 114
Press <F10> again, the virtual drive information appears including a Virtual Drive menu that allows you to change the virtual drive parameters. LSI Software RAID Configuration Utility Ver C.05 Sep 17, 2010 BIOS Version A.10.09231523R Virtual Drive(s) Configured RAID Size #Stripes StripSz Status...
Page 115
Accept SPAN = NO Disk Write Cache Setting Of VD Use Cursor Keys To Navigate Between Items And Press Enter To Select An Option Enabling DWC can improve the performance, but with the risk of data loss. ASUS Z9PH-D16 Series...
Page 116
12. When finished setting the selected virtual drive configuration, select Accept from the menu, and then press <Enter>. LSI Software RAID Configuration Utility Ver C.05 Sep 17, 2010 BIOS Version A.10.09231523R Virtual Drive(s) Configured RAID Size #Stripes StripSz Status Easy Configuration - ARRAY SELECTION MENU Management Menu 148.580GB 64 KB...
SPAN = NO Enter VD Size: Use Cursor Keys to Navigate Between Items And Press Enter To Select An Option Follow step 10 to 14 of the previous section: Using Easy Configuration to create the RAID set. ASUS Z9PH-D16 Series 5-11...
5.2.2 Adding or viewing a RAID configuration You can add a new RAID configuration or view an existing configuration using the View/Add Configuration command. Adding a new RAID configuration To add a new RAID configuration: From the Management Menu, select Configure > View/Add Configuration, and then press <Enter>.
LSI Software RAID Configuration Utility Ver C.05 Sep 17, 2010 BIOS Version A.10.09231523R Virtual Drive(s) Configured Management Menu RAID Size #Stripes StripSz Status Configure Initialize 148.580GB 64 KB ONLINE Objects Rebuild Check Consistency Virtual Drives Virtual Drive 0 Select VD SPACE-(De)Select, F10-Initialize ASUS Z9PH-D16 Series 5-13...
Page 120
Press <F10> to start initialization. When prompted, select Yes from the Initialize? dialog box, and then press <Enter>. LSI Software RAID Configuration Utility Ver C.05 Sep 17, 2010 BIOS Version A.10.09231523R Virtual Drive(s) Configured Management Menu RAID Size #Stripes StripSz Status Configure Initialize...
Page 121
LSI Software RAID Configuration Utility Ver C.05 Sep 17, 2010 BIOS Version A.10.09231523R Vitual Drive(1) Virtual Drive 0 Objects Management Menu Adapter Configure Virtual Drive Initialize Physical Drive Objects Rebuild Check Consistency Select VD Press ENTER To Select A VD, <Del> To Delete A VD ASUS Z9PH-D16 Series 5-15...
Page 122
Select Initialize from the pop-up menu, and then press <Enter> to start initialization. LSI Software RAID Configuration Utility Ver C.05 Sep 17, 2010 BIOS Version A.10.09231523R Vitual Drive(1) Virtual Drive 0 Objects Management Menu Adapter Configure Virtual Drive Initialize Physical Drive Objects Vitual Drive(0) Rebuild...
LSI Software RAID Configuration Utility Ver C.05 Sep 17, 2010 BIOS Version A.10.09231523R REBUILD - PHYSICAL DRIVES SELECTION MENU Management Menu PORT # Configure ONLIN A00-00 Initialize Objects FAIL A00-01 Rebuild Check Consistency Port # 1 DISK 77247MB HDS728080PLA380 PF20A60A SPACE-(De)Select,F10-Start Rebuild,F2-Drive Information,F3-View Virtual Drives ASUS Z9PH-D16 Series 5-17...
Page 124
After selecting the drive to rebuild, press <F10>. When prompted, press <Y> to rebuild the drive. LSI Software RAID Configuration Utility Ver C.05 Sep 17, 2010 BIOS Version A.10.09231523R REBUILD - PHYSICAL DRIVES SELECTION MENU Management Menu PORT # Configure ONLIN A00-00 Initialize Objects...
LSI Software RAID Configuration Utility Ver C.05 Sep 17, 2010 BIOS Version A.10.09231523R Virtual Drive(s) Configured Management Menu RAID Size #Stripes StripSz Status Configure Initialize 148.580GB 64 KB ONLINE Objects Rebuild Check Consistency Virtual Drives Virtual Drive 0 Select VD SPACE-(De)Select, F10-Check Consistency ASUS Z9PH-D16 Series 5-19...
Page 126
When prompted, use the arrow keys to select Yes from the Consistency Check? dialog box, and then press <Enter>. LSI Software RAID Configuration Utility Ver C.05 Sep 17, 2010 BIOS Version A.10.09231523R Virtual Drive(s) Configured Management Menu RAID Size #Stripes StripSz Status Configure...
Page 127
Select Check Consistency from the pop-up menu, and then press <Enter>. When prompted, use the arrow keys to select Yes from the dialog box to check the drive. When checking is complete, press any key to continue. ASUS Z9PH-D16 Series 5-21...
5.2.6 Deleting a RAID configuration To delete a RAID configuration From the Management Menu, select Configure > Clear Configuration, and then press <Enter>. LSI Software RAID Configuration Utility Ver C.05 Sep 17, 2010 BIOS Version A.10.09231523R Configuration Menu Easy Configuration New Configuration Management Menu Configure...
Select Boot Drive Objects Rebuild Check Consistency Select A Boot VD Use Cursor Keys To Navigate Between Items And Press Enter To Select An Option The virtual drive is selected as boot drive. Press any key to continue. ASUS Z9PH-D16 Series 5-23...
5.2.8 Enabling WriteCache You may manually enable the RAID controller’s WriteCache option after creating a RAID set to improve the data transmission performance. When you enable WriteCache, you may lose data when a power interruption occurs while transmitting or exchanging data among the drives. The WriteCache function is recommended for RAID 1 and RAID 10 sets.
To use SCU SATA ports: Install all the hard disk drives. Turn on the system. Confirm all the SATA hard disk drives you installed are correctly displayed, then reboot system. During POST, press <Ctrl+I> to display the utility main menu. ASUS Z9PH-D16 Series 5-25...
Page 132
To enter the Intel ® Rapid Storage Technology enterprise SCU option ROM utility: Install all the Serial ATA hard disk drives. Turn on the system. During POST, press <Ctrl+I> to display the utility main menu. Intel(R) Rapid Storage Technology enterprise - SCU Option ROM - 3.0.0.1104 Copyright(C) 2003-11 Intel Corporation.
Select 2 to 6 disks to use in creating the volume. [ ↑↓ ]-Prev/Next [SPACE]-SelectDisk [ENTER]-Done Use the up/down arrow key to select a drive, and then press <Space> to select. A small triangle marks the selected drive. Press <Enter> after completing your selection. ASUS Z9PH-D16 Series 5-27...
Use the up/down arrow keys to select the stripe size for the RAID array (for RAID 0, 10 and 5 only), and then press <Enter>. The available stripe size values range from 4 KB to 128 KB. The following are typical values: RAID 0: 128KB RAID 10: 64KB RAID 5: 64KB...
Page 135
Press <Y> to create the recovery set and return to the main menu, or <N> to go back to the CREATE VOLUME menu. If a recovery set is created, you cannot add more RAID sets even when you have more non-RAID disks installed in your system. ASUS Z9PH-D16 Series 5-29...
5.3.3 Deleting a RAID set Take caution when deleting a RAID set. You will lose all data on the hard disk drives when you delete a RAID set. To delete a RAID set: From the utility main menu, select 2. Delete RAID Volume and press <Enter>.
Use the up/down arrow keys to select the RAID set drive(s) you want to reset, and then press <Space> to select. Press <Enter> to reset the RAID set drive(s). A confirmation message appears. Press <Y> to reset the drive(s) or press <N> to return to the utility main menu. ASUS Z9PH-D16 Series 5-31...
5.3.5 Exiting the Intel Rapid Storage Technology utility ® To exit the utility: From the utility main menu, select 4. Exit, and then press <Enter>. The following warning message appears. CONFIRM EXIT Are you sure you want to exit? (Y/N): Press <Y>...
SATA Port. Select a destination disk with the same size as the original hard disk. Reboot the system and then follow the steps in section Rebuilding the RAID with other non-RAID disk. ASUS Z9PH-D16 Series 5-33...
5.3.7 Setting the Boot array in the BIOS Setup Utility You can set the boot priority sequence in the BIOS for your RAID arrays when creating multi-RAID using the Intel Rapid Storage Technology. ® To set the boot array in the BIOS: Set at least one of the arrays bootable to boot from the hard disk.
Your storage system is configured for data protection, increased performance and optimal data storage capacity. You can further optimize your storage system by creating additional volumes. You can click Rescan to re-scan any attached hard disks. ASUS Z9PH-D16 Series 5-35...
5.4.1 Creating a RAID set To create a RAID set From the utility main menu, select Create Volume and select volume type. Then click Next. Enter a name for the RAID set, then select the array disks. Select Volume Size tab, you can drag the bar to decide the volume size. Then click Next.
Page 143
You still need to partition your new volume using Windows Disk Management before adding any data. When you are finished, you will see the following screen in Volumes field and you can change related items in the Volume Properties field. ASUS Z9PH-D16 Series 5-37...
5.4.2 Change Volume Type When you are finished to create a RAID set, you can view or change related items in the Volume Properties field. According to the following steps to change the type in Volume Properties: Click the SAS array items you want to change in Volumes field. From the Volume Properties field, select Type:RAID 1 Change type.
Volumes field you want to delete. Then select Delete volume in Volume Properties field. The following screen appears. Click Yes to delete the volume and return to the utility main menu, or click No to return to the main menu. ASUS Z9PH-D16 Series 5-39...
5.4.4 Preferences System Preferences Allow you set to show the notification area icon and show system information, warning, or errors here. E-Mail Preferences Allow you set to sent e-mail of the following events: Storage system information Storage system warnings Storage system errors 5-40 Chapter 5: RAID configuration...
<Enter> to enter the sub-menu. C60x INTEL RAID Driver C600 INTEL RAID Driver Windows 32 bit (AHCI / AHCI RAID) Windows 64 bit (AHCI / AHCI RAID) Windows 32 bit (SCU RAID) Windows 64 bit (SCU RAID) Back Exit ASUS Z9PH-D16 Series...
Page 150
LSI 2008 SAS2 Driver LSI 2008 SAS2 Driver Windows XP 32 bit Windows XP 64 bit Windows Server 2003 32 bit Windows Server 2003 64 bit Windows Vista 32 bit Windows Vista 64 bit Windows Server 2008 32 bit Windows Server 2008 64 bit Windows 7 32 bit Windows 7 64 bit Windows Server 2008 R2 64 bit...
Page 151
Insert a blank formatted high-density floppy disk to the USB floppy disk drive. Type dd if=XXX.img of=/dev/fd0 to decompress the file into the floppy disk from the following path in the support DVD: For LSI MegaRAID Driver \Drivers\C60x LSI RAID\Driver\makedisk\Linux Eject the floppy disk. ASUS Z9PH-D16 Series...
6.1.2 Installing the RAID controller driver During Windows Server 2008 OS installation ® To install the RAID controller driver when installing Windows Server 2008 OS ® Boot the computer using the Windows ® Server 2008 OS installation disc. Follow the screen instructions to start installing Windows Server 2008. When prompted to choose a type of installation, click Custom (advanced).
Page 153
When the system finishes loading the RAID driver, replace the motherboard Support DVD with the Windows Server installation disc. Select the drive to install Windows and click Next. Setup then proceeds with the OS installation. Follow screen instructions to continue. ASUS Z9PH-D16 Series...
Page 154
Red Hat Enterprise Linux OS 5.6 ® To install the LSI MegaRAID controller driver when installing Red Hat Enterprise ® Boot the system from the Red Hat OS installation CD. ® At the boot:, type linux dd noprobe=ata1 noprobe=ata2..., then press <Enter>.
Page 155
When the installation is completed, DO NOT click Reboot. Press <Ctrl> + <Alt> + <F2> to switch to the command-line interface from graphic user interface. Type the following commands when using a Legacy floppy. mkdir /mnt/driver mount /dev/fd0 /mnt/driver cd /mnt/driver sh replace_ahci.sh reboot ASUS Z9PH-D16 Series...
Page 156
Red Hat Enterprise Linux OS 6.1 ® To install the LSI MegaRAID controller driver when installing Red Hat Enterprise ® Boot the system from the Red Hat OS installation CD. ® Press <Tab> to edit options. Enter the following command at the boot: Linux dd blacklist=isci blacklist=ahci nodmraid, then press <ENTER>.
Page 157
You have multiple devices which could serve as source for a driver disk. Choose one you like to use and select OK, then press <Enter>. Driver Disk Source You have multiple devices which could serve as source for a driver disk. Which would you like to use? Cancel ASUS Z9PH-D16 Series 6-11...
Page 158
Insert the Red Hat Enterprise RAID driver disk to the USB floppy disk drive, ® select OK, then press <Enter>. Insert Driver Disk Insert your driver disk into /dev/sdb and press “OK” to continue. Back The drivers for the RAID card are installed to the system. When asked if you will load additional RAID controller drivers, select No, then press <Enter>.
Page 159
-o loop [image file name] image Example: mount -o loop megasr-15-15.00.0120.2012-1-sles11- ga-x86__64.img image Copy the contents of the image directory, labeled as 01, into a FAT32 USB drive. Rename the 01 folder to CD Image. ASUS Z9PH-D16 Series 6-13...
Page 160
Installing SUSE 11 Linux OS To install the LSI MegaRAID controller driver when installing SUSE Linux Enterprise Server OS: Boot the system from the SUSE OS installation CD. Use the arrow keys to select Installation from the Boot Options menu. Press <F6>, then select Yes from the menu.
Page 161
When below screen appears, select the USB floppy disk drive (sda) as the driver update medium. Select OK, then press <Enter>. Please choose the Driver Update medium. sda: USB Floppy other device Back Select Back and follow the onscreen instructions to finish the installation. ASUS Z9PH-D16 Series 6-15...
® Intel Chipset Device Software installation This section provides the instructions on how to install the Intel ® chipset device software on the system. You need to manually install the Intel chipset device software on a Windows ® operating system. To install the Intel ®...
Page 163
Select Yes to accept the terms of the License Agreement and continue the process. Read the Readme File Information and press Next to continue the installation. Toggle Yes, I want to restart the computer npw and click Finish to complete the setup process. ASUS Z9PH-D16 Series 6-17...
Intel Network Connections Software installation This section provides the instructions on how to install the Intel ® Network Connections Software on the system. You need to manually install the Intel Network Connections Software on a ® Windows ® operating system. To install the Intel ®...
Page 165
Click Next when the Intel(R) Network Connections–InstallShield Wizard window appears. Toggle I accept the terms in the license agreement and click Next to continue. Click the Intel(R) PROSet for Windows Device Manager box, and then click Next to start the installation. ASUS Z9PH-D16 Series 6-19...
Page 166
Follow the screen instructions to complete installation. When finished, press Finish to continue. 6-20 Chapter 6: Driver installation...
DVD to locate the file ASSETUP.EXE from the BIN folder. Double-click the ASSETUP.EXE to run the support DVD. Click the ASPEED AST2300 Display Driver to begin installation. When the ASPEED Graphics installation wizard appears, click Next to start the installation. ASUS Z9PH-D16 Series 6-21...
Page 168
Toggle I accept the terms in the license agreement and click Next to continue. Enter the user information and click Next to continue. Select a setup type and click Next to continue. 6-22 Chapter 6: Driver installation...
Page 169
Click Install to start driver installation. When the installation completes, click Finish to restart your computer before using the program. ASUS Z9PH-D16 Series 6-23...
® Intel C600 Series Chipset SATA RAID Drivers This section provides the instructions on how to install the Intel ® C600 Series Chipset SATA RAID Drivers on the system. You need to manually install the Intel C600 Series Chipset SATA RAID Drivers on ®...
DVD to locate the file ASSETUP.EXE from the BIN folder. Double-click the ASSETUP.EXE to run the support DVD. Click the Intel Rapid Storage Technology enterprise 3.0 to begin ® installation. When the Welcome to the Setup Program appears, click Next to start the installation. ASUS Z9PH-D16 Series 6-25...
Page 172
Read the Warning message and click Next to continue. Read the License Agreement and click Yes to continue. Read the Readme File Information and click Next to continue. 6-26 Chapter 6: Driver installation...
Page 173
After completing the installation, click Next to complete the setup process. Select Yes, I want to restart my computer now and click Finish to restart your computer before using the program. ASUS Z9PH-D16 Series 6-27...
® Intel PRO/1000 Gigabit Adapters Driver installation This section provides the instructions on how to install Intel ® PRO/1000 Gigabit Adapters Driver. To install the Intel ® PRO/1000 Gigabit Adapters Driver on a Windows ® Restart the computer, and then log on with Administrator privileges. Insert the motherboard/system support DVD to the optical drive.
Page 175
When the Intel PRO Network Connections – InstallShield Wizard window ® appears, click Next to start the installation. Click I accept the terms in the license agreement and then click Next to continue. ASUS Z9PH-D16 Series 6-29...
Page 176
Select the programs you want to install and click Next to continue. Click Install to start the installation. 6-30 Chapter 6: Driver installation...
Page 177
The programs you select are being installed. Click Finish to finish the installation. ASUS Z9PH-D16 Series 6-31...
The contents of the support DVD are subject to change at any time without notice. Visit the ASUS website (www.asus.com) for updates. 6.8.1 Running the support DVD Place the support DVD to the optical drive.
Intel RAID driver disks. 6.8.5 Contact information Click the Contact tab to display the ASUS contact information. You can also find this information on the inside front cover of this user guide. ASUS Z9PH-D16 Series 6-33...
6.9 Mellanox ConnectX-3 Infiniband driver installation (Z9PH-D16/QDR and Z9PH-D16/ FDR only) This section provides instructions on how to install the Mellanox driver. 6.9.1 Windows operating system You need to manuall install the Mellanox driver on a Windows operating system. ® To install the Mellanox driver: Restart the computer, then log on with Administrator privileges.
Page 181
Click I accept the terms in the license agreement and click Next to continue. Click Change to select your desired destination folder and click Next to continue. Check the box and click Next to continue. ASUS Z9PH-D16 Series 6-35...
Page 182
Click Install to begin the installation. Click your preferred options and click Finish to exit the wizard. 10. Click Yes to restart your system for the configuration changes made to MLNX_VPI to take effect. 6-36 Chapter 6: Driver installation...
-o ro,loop /tmp/[image file name] then mount the driver into the system. /[folder name] The driver version and the OS label may vary. Ensure that the command line matches your driver version and operating system. ASUS Z9PH-D16 Series 6-37...
Page 184
Type the following commands before you install the driver: cd /[folder name] ./mlnxofedinstall All other Mellanox, OEM, OFED, or distribution IB packages will be removed. Press <Y> to continue. The system starts uninstalling the previous version of OFED. 6-38 Chapter 6: Driver installation...
Page 185
When the installation finishes, reboot your system to complete the installation. If your system has the latest firmware, no firmware update will occur. To force the firmware update, type -- force-fw-update. ASUS Z9PH-D16 Series 6-39...
800 Corporate Way, Fremont, CA 94539, USA +1-510-608-4555 Web site http://usa.asus.com Technical Support Support fax +1-812-284-0883 General support +1-812-282-2787 Online support http://support.asus.com/techserv/techserv.aspx ASUS COMPUTER GmbH (Germany and Austria) Address Harkort Str. 21-23, D-40880 Ratingen, Germany +49-2102-959911 Web site http://www.asus.de Online contact http://www.asus.de/sales Technical Support Telephone +49-1805-010923*...