Troubleshooting Slow Applications

By: Chris Greer

Slow applications, who doesn’t have them from time to time? Even networks that are in tip-top shape can have issues in application performance. On many occasions when we start troubleshooting a slow application there is a push to immediately start looking in the SQL Traffic or SMB Calls or some other app traffic to determine the root cause of the issue. We find though that this approach takes us too deep, too fast. Assumptions are made about the network and the server itself that may throw us down the wrong path of troubleshooting, wasting time trying to blame the wrong component of the application.

When we start to troubleshoot a slow application, our first priority is to narrow down what bucket is causing the problem: the network, the client, or the server. Once we have identified where to place the blame, we can then get into the details to determine exactly what variable in that specific bucket is the root cause of the performance issue. Often, isolating the problem to one of these areas takes us back to the basics of the OSI model.

After we have successfully captured an example of the application running poorly (this is a VERY key part of the process – more articles on how to do this in the future…) we can use the rules of the transport layer to divide the OSI model in half, which helps us to place the blame on either the network or the server(s).


How can we do this at a packet level? We can look for two things: 1. TCP Retransmissions and 2. TCP Connection timers.

 


1. TCP Retransmissions

If these are observed in the trace file between client and server, then we can initially take the blame off the server for the cause of the performance problem. The reason we see TCP retransmissions is because the network is dropping packets somewhere along the path. This packet loss must first be tracked down and resolved then we can move forward with analyzing the server performance. With this one variable at the transport layer, we can cut the OSI model in half, leaving layers 5-7 alone, while focusing on the physical, data link, and network layers to see where traffic is being dropped.

How can we tell if there are retransmissions in the trace file? In Wireshark, use the Expert Info feature under the Analyze menu option. This window can be used to quickly see if there are TCP Retransmissions present in the trace file.


Note: Some client applications use TCP Keep-Alive packets to make sure that connections are not dropped between client and server. These may be interpreted by Wireshark as retransmissions. These are typically small packets that are repeated several times per minute. They are rarely a symptom of packet loss on the network.

 


2. TCP Connection Timers

After looking for retransmissions, we then analyze the connections between client and server to see if there is any delay at the transport layer when the handshake first happens. To do this, use the TCP Stream filter to isolate a TCP connection between client and server.

Using the delta time column during the TCP handshake at the beginning of the connection, we can look for any delays in the connection setup time. If there are delays, these may be caused by packets being held up somewhere on the network, or by the server being slow in responding to the connection request. We may choose at this time to monitor the network between client and server, looking for excessively utilized links, or we may move our analyzer to the server to get a server-side view of the TCP connection setup. If the delay between SYN and SYN-ACK is still seen, then the server is holding up the show.

 

By starting with the transport layer when troubleshooting an issue, we can quickly cut the OSI model in half. If retransmissions are observed, we should focus on layers 1-3 to see where packets are being dropped, or if TCP connections are held up, we can focus on this layer on the server. Don’t get too deep in the application before ruling out the basics.

About the Author:

 Chris Greer is a Senior Network Analyst for Network Protocol Specialists, a Seattle based Network Consulting company. Chris has 10 years of experience in analyzing and troubleshooting networks. He regularly assists companies in tracking down the source of network and application performance problems using a variety of protocol analysis and monitoring tools including Wireshark. When he isn’t hunting down problems at the packet level, he can be found teaching various analysis workshops at Interop and other industry trade shows. Chris also delivers Fluke Networks public courses and protocol analysis themed webcasts. He can be contacted at chris (at) nps-llc (dot) com

Network Analysis Tips - Analyzers - Packet Sniffer Articles & Information.

This Article is Brought to you by:

Network Analysis Tips - Analyzers - Packet Sniffer Related Articles:

Network Analyzers and Sniffers

ACE Analyst from OPnet is a transactional analysis solution, based on network packet captures. ...

By: Network Analyzers and Sniffers

Flow Monitoring

ACE Live Netflow module uses integrated web-based dashboards to provide a business-centric view of network utilization and applicat...

By: Flow Monitoring

SNMP Tools

AdventNet SNMP API can be used to build system management, application management and network management applications and applets. It includes class librarie...

By: SNMP Tools

Updated Ethernet Related News:

MRV Communications Shares Technology Expertise at MPLS & Ethernet World C...

MRV Communications, Inc. , a leading provider of optical communications network infrastructure equipment and integration and managed services, today announced that MRV?s Optical Communications Systems...


Fibrenoire Deploys Ciena for Metro Ethernet Services

Ciena® Corporation , the network specialist, today announced that Fibrenoire, a Canadian provider of fiber-optic Internet connections and private network services, ha


Ethernet SAN: At the Intersection of Enterprise Storage and Cloud Scale

by Kevin Brown Business demand for technology continually increases, but businesses have no tolerance for waste. This forces IT into a survival-of-the-fittest mode, ridding the data center of underper...


Global Ethernet Exchange Services Market 2010-2014

NEW YORK, Feb. 6, 2012 /PRNewswire/ -- Reportlinker.com announces that a new market research report is available in its catalogue: Global Ethernet Exchange Services Market 2010-2014 http://www.reportl...


e|net Selects Ciena?s Carrier Ethernet Solutions to Advance Ireland?s Network...

LINTHICUM, Md. & LIMERICK, Ireland--(BUSINESSWIRE)-- Ciena?s Carrier Ethernet advanced demarcation platforms to support sophisticated QoS and SLAs Ciena ® Corporation (NASDAQ: CIEN), the network speci...



Website Friends:


Network Analysis Tips - Analyzers - Packet Sniffer , Network Analysis , Analyzer , performance monitoring tool , Sniffer