Book Image

Troubleshooting vSphere Storage

By : Mike Preston
Book Image

Troubleshooting vSphere Storage

By: Mike Preston

Overview of this book

Virtualization has created a new role within IT departments everywhere; the vSphere administrator. vSphere administrators have long been managing more than just the hypervisor, they have quickly had to adapt to become a ‘jack of all trades' in organizations. More and more tier 1 workloads are being virtualized, making the infrastructure underneath them all that more important. Due to this, along with the holistic nature of vSphere, administrators are forced to have the know-how on what to do when problems occur.This practical, easy-to-understand guide will give the vSphere administrator the knowledge and skill set they need in order to identify, troubleshoot, and solve issues that relate to storage visibility, storage performance, and storage capacity in a vSphere environment.This book will first give you the fundamental background knowledge of storage and virtualization. From there, you will explore the tools and techniques that you can use to troubleshoot common storage issues in today's data centers. You will learn the steps to take when storage seems slow, or there is limited availability of storage. The book will go over the most common storage transport such as Fibre Channel, iSCSI, and NFS, and explain what to do when you can't see your storage, where to look when your storage is experiencing performance issues, and how to react when you reach capacity. You will also learn about the tools that ESXi contains to help you with this, and how to identify key issues within the many vSphere logfiles.
Table of Contents (16 chapters)
Troubleshooting vSphere Storage
Credits
About the Author
Acknowledgment
About the Reviewers
www.PacktPub.com
Preface
Index

You cannot connect to your NFS storage


The following are some questions and tasks you can take to troubleshoot NFS connection issues.

Have all the network requirements for you NFS connection been met?

Tip

You can refer Chapter 3, Troubleshooting Storage Visibility, for more information on this topic.

You need to consider the following points when checking network requirements:

  • The ESXi host needs to have the proper networking configuration in order to attach to an NFS mount. A VMkernel port must be set up on the same subnet as your NFS storage array with the proper IP addressing and subnet mask.

  • Ensure all DNS and routing information is accurate using the following command:

    esxcfg-route -l
    
  • If you are using VLANs, be sure that proper VLAN configuration has been implemented.

  • Is it possible to ping your storage array?

    vmkping <IP OF ARRAY>
    
  • Have all the proper ports (2049/111) been opened up for NFS communication. To test port connectivity from the ESXi host to your NFS storage array, use the following command:

    nc -z <IP OF ARRAY> 2049
    
  • Are there any firewalls in between your ESXi host and your NFS array? If so, ensure that the proper ports have been opened. To check the local firewall on ESXi, use the following command:

    esxcli network firewall ruleset list | grep nfsClient
    
  • Does your network utilize Jumbo Frames? If so, ensure Jumbo Frame configuration has been enabled on all devices the NFS packet will traverse. To check that we properly have Jumbo Frames set up, using the default 9000 MTU size, run the following command on an ESXi host:

    vmkping –s 8972 –d <IP OF ARRAY>
    

Check the settings on your NFS array

Tip

You can refer Chapter 3, Troubleshooting Storage Visibility, for more information on this topic.

You need to consider the following points when checking settings on your NFS array:

  • Have all of your ESXi hosts been added properly in the NFS ACL list on your storage array?

  • Have the proper permissions been applied to your NFS exports. ESXi, at the very least, will need read/write permissions in order to write to the datastore.

  • ESXi supports only NFS Version 3. Be sure your NFS storage array also supports NFS Version 3.

Has there been any advanced settings dealing with NFS incorrectly configured?

There are a variety of advanced settings that may affect your connection to your NFS storage array:

  • NFS.MaxVolumes: By default, it is set to 8. This represents the maximum number of NFS volumes that an ESXi host can mount. You may need to change this number if this is the ninth volume on the host. This must match on all hosts. If changing, this recommendation is normally to change the TCP/IP heap settings as well. The recommended value is Varies.

  • Net.TcpIpHeapSize and Net.TcpIpHeapMax: By default, size is 0 and max is 64 MB. These represent the size and maximum memory that is allocated to TCP/IP. Storage vendors normally make recommendations as to what this value should be. The recommended value is Varies.

  • NFS.DiskFileLockUpdateFreq: By default, it is set to 10 seconds. It represents the time between updates to a disk lock file. Too high of a value will increase the time it takes to recover from stale locks. Be sure that all hosts contain the same value. The recommended value is 10

Further check the logs for NFS related errors

Tip

You can refer Chapter 3, Troubleshooting Storage Visibility, for more information on this topic.

The following items need to be considered when checking logs for NFS storage:

  • We can further view any NFS related errors in the logs by grepping the entire log folder with the following command:

    grep –r nfs /var/log/* | less
    
  • Verbose logging can be enabled for troubleshooting purposes by running the following command:

    esxcfg-advcfg –s 1 /NFS/LogNfsStat3