File Handling - Its Impact on Server Backups
By: Chris Greer
Server backups. The silent source of frustration in certain data centers. Whether they are simply firing at times when production traffic is contending for server resource, or are just taking hours longer than they should, backups can cause headaches for network managers. In this article we are going to take a look at how file handling can cause a backup to run much longer than it should, and how it contributes to lower overall throughput.
In any backup process, regardless of what software or method is used, the goal is to move data from one location to another as quickly as possible. Many things can cause the backup to slow to a crawl, and oftentimes they are completely unrelated to network bandwidth. One example of a throughput killer is file handling – when individual files or directories are requested by the backup server. These requests require the source server to call the file, queue it for delivery then transmit the file. If the server delays at all in its response to these individual file requests, this can significantly reduce the overall throughput utilized by the backup, especially when several thousand files are handled in this way.
In one example, the backup software was reporting that the backup process was transferring at less than 30 Mbps, when both servers and all network connections between were connected at 1Gbps. Overall network utilization was very low, measuring at only 5%.
For some reason, the backup process was not taking advantage of these high-speed links.
Using Wireshark, a capture was taken during the slow backup. We first looked for retransmissions in the traffic between the two servers. This would indicate packet loss and would direct us to look at the switches for Ethernet errors such as FCS and Alignment Errors. The traces showed no retransmissions, only slow response times from the source server to file requests. Every file was requested individually and would incur a 20 millisecond delay on the source server. When this file handling was filtered out of the trace, backup throughput measured at almost 1Gbps, fully utilizing the available bandwidth.
The chart below shows the impact of file handling on data backups. This data was compiled assuming the total data is 100GB. When the backup begins, only a small amount of this data will be requested at once, which depends on the protocol in use. Typically, a SMB/CIFS based backup application will read blocks of data as shown below. The smaller the blocks requested, the more are required to move the total data amount. This will incur more read delays, which reduce overall throughput.
As shown above, file handling can have a tremendous impact on bandwidth used during file backups. In many cases, slow performance can be traced to slow file responses on the source server. Use of multi-threaded backup applications, monitoring on the source server for resource problems, or backup applications with less file handling overhead will improve backup performance in these cases. Performance can also be impacted by TCP Window issues as well as underlying network problems. Specific instances of these problems and their resolutions will be discussed in future articles.
About the Author:
Chris Greer is a Senior Network Analyst for Network Protocol Specialists, a Seattle based Network Consulting company. Chris has 10 years of experience in analyzing and troubleshooting networks. He regularly assists companies in tracking down the source of network and application performance problems using a variety of protocol analysis and monitoring tools including Wireshark. When he isn’t hunting down problems at the packet level, he can be found teaching various analysis workshops at Interop and other industry trade shows. Chris also delivers Fluke Networks public courses and protocol analysis themed webcasts. He can be contacted at chris (at) nps-llc (dot) com.
This Article is Brought to you by:
Article Sponsorships Available
Short description about your link.
Add your link here
Article Sponsorships Available
Short description about your link.
Add your link here
Network Analysis Tips - Analyzers - Packet Sniffer Related Articles:
Applications/Services/Systems monitoring
Advanced HostMonitor is a system management tool that continuously monitors servers' availability and performance. In the event of net...
SNMP Tools
AdventNet SNMP API can be used to build system management, application management and network management applications and applets. It includes class librarie...
By: SNMP Tools
Datacom Systems Inc. - SINGLEstream 1214LX-10G
Datacom Systems Inc. - SINGLEstream™ 1214LX-10G Aggregation The SINGLEstream™ 1214LX-10G can combine data from up to five single ...
Updated Ethernet Related News:
MRV Communications, Inc. , a leading provider of optical communications network infrastructure equipment and integration and managed services, today announced that MRV?s Optical Communications Systems...
Fibrenoire Deploys Ciena for Metro Ethernet Services
Ciena® Corporation , the network specialist, today announced that Fibrenoire, a Canadian provider of fiber-optic Internet connections and private network services, ha
Global Ethernet Exchange Services Market 2010-2014
NEW YORK, Feb. 6, 2012 /PRNewswire/ -- Reportlinker.com announces that a new market research report is available in its catalogue: Global Ethernet Exchange Services Market 2010-2014 http://www.reportl...
Ethernet SAN: At the Intersection of Enterprise Storage and Cloud Scale
by Kevin Brown Business demand for technology continually increases, but businesses have no tolerance for waste. This forces IT into a survival-of-the-fittest mode, ridding the data center of underper...
e|net Selects Ciena?s Carrier Ethernet Solutions to Advance Ireland?s Network...
LINTHICUM, Md. & LIMERICK, Ireland--(BUSINESSWIRE)-- Ciena?s Carrier Ethernet advanced demarcation platforms to support sophisticated QoS and SLAs Ciena ® Corporation (NASDAQ: CIEN), the network speci...
