This article is intended as an objective guide for anyone trying to narrow down their options in the bandwidth controller market. Organizations today have a plethora of product options to choose from. To further complicate your choices, not only are there specialized bandwidth controllers, you’ll also find that most Firewall and Router products today contain some form of bandwidth shaping and QoS features .
What follows is an all-encompassing list of questions that will help you to quickly organize your priorities with regards to choosing a bandwidth shaper.
1) What is the Cost of Increasing your Bandwidth?
Although this question may be a bit obvious, it must be asked. We assume that anybody in the market for a bandwidth controller also has the option of increasing their bandwidth. The costs of purchasing and operating a bandwidth controller should ultimately be compared with the cost of increasing bandwidth on your network.
2) How much Savings should you expect from your Bandwidth Controller?
A good bandwidth controller in many situations can increase your carrying capacity by up to 50 percent. However, beware, some technologies designed to optimize your network can create labor overhead in maintenance hours. Labor costs with some solutions can far exceed the cost of adding bandwidth.
3) Can you out-run your Organization’s Appetite for Increased Bandwidth with a One-Time Bandwidth Upgrade?
The answer is yes, it is possible to buy enough bandwidth such that all your users cannot possibly exhaust the supply. The bad news is that this solution is usually cost-prohibitive. Many organizations that come to us have previously doubled their bandwidth, sometimes more than once, only to be back to overwhelming congestion within a few months after their upgrade. The appetite for bandwidth is insatiable, and in our opinion, at some point a bandwidth control device becomes your only rational option. Outrunning your user base usually is only possible where Internet infrastructure is subsidized by a government entity, hiding the true costs. For example, a small University with 1000 students will likely not be able to consume a true 5 Gigabit pipe, but purchasing a pipe of that size would be out of reach for most US-based Universities.
4) How Valuable is Your Time? Are you a Candidate for a Freeware-type Solution?
What we have seen in the market place is that small shops with high technical expertise, or small ISPs on a budget, can often make use of a freeware do-it-yourself bandwidth control solution. If you are cash-strapped, this may be a viable solution for you. However, please go into this with your eyes open. The general pitfalls and risks are as follows:
a) Staff can easily run up 80 or more hours trying to save a few thousand dollars fiddling with an unsupported solution. And this is only for the initial installation & set-up. Over the useful life of the solution, this can continue at a high-level, due to the unsupported nature of these technologies.
b) Investors do not like to invest in businesses with homegrown technology, for many reasons, including finding personnel to sustain the solution, upgrading and adding features, as well as overall risk of keeping it in working order, unless it gives them a very large competitive advantage. You can easily shoot yourself in the foot with prospective buyers by becoming too dependent on homegrown, freeware solutions, in order to save costs. When you rely on something homegrown, it generally means an employee or two holds the keys to the operational knowledge, hence potential buyers can become uncomfortable (you would be too!).
5) Are you Looking to Enforce Bandwidth Limits as part of a Rate Plan that you Resell to Clients?
For example , let’s say that you have a good-sized backbone of bandwidth at a reasonable cost per megabit, and you just want to enforce class of service speeds to sell your bandwidth in incremental revenue chunks.
If this is truely your only requirement, and not optimization to support high contention ratios, then you should be careful not to overspend on your solution. A basic NetEqualizer or Allot system may be all that you need. You can also most likely leverage the bandwidth control features bundled into your Router or Firewall. The thing to be careful of if using your Router/Firewall is that these devices can become overwhelmed due to lack of horsepower.
6) Are you just Trying to Optimize the Bandwidth that you have, based on Well-Known Priorities?
Some context:
If you have a very static network load, with a finite well-defined set of applications running through your enterprise, there are application shaping (Layer-7 shaping) products out there such as the Blue Coat PacketShaper,which uses deep packet inspection, that can be set up once to allocate different amounts bandwidth based on application. If the PacketShaper is a bit too pricey, the Cymphonics product can also detect most common applications.
If you are trying to optimize your bandwidth on a variable, wide-open plethora of applications, then you may find yourself with extremely high maintenance costs by using a Layer-7 application shaper. A generic behavior-based product such as the NetEqualizer will do the trick.
Update 2015
Note : We are seeing quite a bit of Encryption on common applications. We strongly recommend avoiding layer 7 type devices for public Internet traffic as the accuracy is diminishing due to the fact that encrypted traffic is UN-classifieble , a heuristics based behavior based approach is advised
7) Make sure what looks elegant on the cover does not have hidden costs by doing a little research on the Internet.
Yes this is an obvious one too, but lest you forget your due diligence!
Before purchasing any traffic shaping solution you should try a simple internet search with well placed keywords to uncover objective opinions. Current testimonials supplied by the vendor are a good source of information, but only tell half the story. Current customers are always biased toward their decision sometimes in the face of ignoring a better solution.
If you are not familiar with this technology, nor have the in-house expertise to work with a traffic shaper, you may want to consider buying additional bandwidth as your solution. In order to assess if this is a viable solution for you, we recommend you think about the following: How much bandwidth do you need ? What is the appropriate amount for your ISP or organization? We actually dedicated a complete article to this question.
8) Are you a Windows Shop? Do you expect a Microsoft-based solution due to your internal expertise?
With all respect to Microsoft and the strides they have made toward reliability in their server solutions, we believe that you should avoid a Windows-based product for any network routing or bandwidth control mission.
To be effective, a bandwidth control device must be placed such that all traffic is forced to pass through the device. For this reason, all manufacturers that we are aware of develop their network devices using a derivative of Linux. Linux-based is based on Open Source, which means that an OEM can strip down the operating system to its simplest components. The simpler operating system in your network device, the less that can go wrong. However, with Windows the core OS source code is not available to third-party developers, hence an OEM may not always be able to track down serious bugs. This is not to say that bugs do not occur in Linux, they do, however the OEM can often get a patch out quickly.
For the Windows IT person trained on Windows, a well-designed networking device presents its interface via a standard web page. Hence, a technician likely needs no specific Linux background.
9) Are you a CIO (or C level Executive) Looking to Automate and Reduce Costs ?
Bandwidth controllers can become a means to do cool things with a network. Network Administrators can get caught up reading fancy reports, making daily changes, and interpreting results, which can become extremely labor-intensive. There is a price/benefit crossover point where a device can create more work (labor cost) than bandwidth saved. We have addressed this paradox in detail in a previous article.
10) Do you have any Legal or Political Requirement to Maintain Logs or Show Detailed Reports to a Third-Party (i.e. management ,oversight committee, etc.)?
For example…
A government requirement to provide data wire taps dictated by CALEA?
Or a monthly report on employee Internet behavior?
Related article how to choose the right bandwidth management solution
Links to other bandwidth control products on the market.
Packet Shaper by Blue Coat
NetEqualizer ( my favorite)
Exinda
Riverbed
Exinda Packet Shaper and Riverbed tend to focus on the enterprise WAN optimization market.
Cymphonix
Cymphonix comes from a background of detailed reporting.
Emerging Technologies
Very solid product for bandwidth shaping.
Exinda
Exinda from Australia has really made a good run in the US market offering a good alternative to the incumbants.
Netlimiter
For those of you who are wed to Windows NetLimiter is your answer
Antamediabandwidth
The Promise of Streaming Video: An Unfunded Mandate
June 1, 2010 — netequalizerBy Art Reisman, CTO, www.netequalizer.com
Art Reisman is a partner and co-founder of APconnections, a company that provides bandwidth control solutions (NetEqualizer) to ISPs, Universities, Libraries, Mining Camps, and any organization where groups of users must share their Internet resources equitably. What follows is an objective educational journey on how consumers and ISPs can live in harmony with the explosion of YouTube video.
The following is written primarily for the benefit of mid-to-small sized internet services providers (ISPs). However, home consumers may also find the details interesting. Please follow along as I break down the business cost model of the costs required to keep up with growing video demand.
In the past few weeks, two factors have come up in conversations with our customers, which has encouraged me to investigate this subject further and outline the challenges here:
1) Many of our ISP customers are struggling to offer video at competitive levels during the day, and yet are being squeezed due to high bandwidth costs. Many look to the NetEqualizer to alleviate video congestion problems. As you know, there are always trade-offs to be made in handling any congestion issue, which I will discuss at the end of this article. But back to the subject at hand. What I am seeing from customers is that there is an underlying fear that they (IT adminstrators) are behind the curve. As I have an opinion on this, I decided I need to lay out what is “normal” in terms of contention ratios for video, as well what is “practical” for video in today’s world.
2) My internet service provider, a major player that heavily advertises how fast their speed is to the home, periodically slows down standard YouTube Videos. I should be fair with my accusation, with the Internet you can actually never be quite certain who is at fault. Whether I am being throttled or not, the point is that there are an ever-growing number of video content providers , who are pushing ahead with plans that do not take into account, nor care about, a last mile provider’s ability to handle the increased load. A good analogy would be a travel agency that is booking tourists onto a cruise ship without keeping a tally of tickets sold, nor caring, for that matter. When all those tourists show up to board the ship, some form of chaos will ensue (and some will not be able to get on the ship at all).
Some ISPs are also adding to this issue, by building out infrastructure without regard to content demand, and hoping for the best. They are in a tight spot, getting caught up in a challenging balancing act between customers, profit, and their ability to actually deliver video at peak times.
The Business Cost Model of an ISP trying to accommodate video demands
Almost all ISPs rely on the fact that not all customers will pull their full allotment of bandwidth all the time. Hence, they can map out an appropriate subscriber ratio for their network, and also advertise bandwidth rates that are sufficient enough to handle video. There are four main governing factors on how fast an actual consumer circuit will be:
1) The physical speed of the medium to the customer’s front door (this is often the speed cited by the ISP)
2) The combined load of all customers sharing their local circuit and the local circuit’s capacity (subscriber ratio factors in here)
3) How much bandwidth the ISP contracts out to the Internet (from the ISP’s provider)
4) The speed at which the source of the content can be served (Youtube’s servers), we’ll assume this is not a source of contention for our examples below, but it certainly should remain a suspect in any finger pointing of a slow circuit.
The actual limit to the am0unt of bandwidth a customer gets at one time, which dictates whether they can run a live streaming video, usually depends on how oversold their ISP is (based on the “subscriber ratio” mentioned in points 1 and 2 above). If your ISP can predict the peak loads of their entire circuit correctly, and purchase enough bulk bandwidth to meet that demand (point 3 above), then customers should be able to run live streaming video without interruption.
The problem arises when providers put together a static set of assumptions that break down as consumer appetite for video grows faster than expected. The numbers below typify the trade-offs a mid-sized provider is playing with in order to make a profit, while still providing enough bandwidth to meet customer expectations.
1) In major metropolitan areas, as of 2010, bandwidth can be purchased in bulk for about $3000 per 50 megabits. Some localities less some more.
2) ISPs must cover a fixed cost per customer amortized: billing, sales staff, support staff, customer premise equipment, interest on investment , and licensing, which comes out to about $35 per month per customer.
3) We assume market competition fixes price at about $45 per month per customer for a residential Internet customer.
4) This leaves $10 per month for profit margin and bandwidth fees. We assume an even split: $5 a month per customer for profit, and $5 per month per customer to cover bandwidth fees.
With 50 megabits at $3000 and each customer contributing $5 per month, this dictates that you must share the 50 Megabit pipe amongst 600 customers to be viable as a business. This is the governing factor on how much bandwidth is available to all customers for all uses, including video.
So how many simultaneous YouTube Videos can be supported given the scenario above?
Live streaming YouTube video needs on average about 750kbs , or about 3/4 of a megabit, in order to run without breaking up.
On a 50 megabit shared link provided by an ISP, in theory you could support about 70 simultaneous YouTube sessions, assuming nothing else is running on the network. In the real world there would always be background traffic other than YouTube.
In reality, you are always going to have a minimum fixed load of internet usage from 600 customers of approximately 10-to-20 megabits. The 10-to-20 megabit load is just to support everything else, like web sufing, downloads, skype calls, etc. So realistically you can support about 40 YouTube sessions at one time. What this implies that if 10 percent of your customers (60 customers) start to watch YouTube at the same time you will need more bandwidth, either that or you are going to get some complaints. For those ISPs that desperately want to support video, they must count on no more than about 40 simultaneous videos running at one time, or a little less than 10 percent of their customers.
Based on the scenario above, if 40 customers simultaneously run YouTube, the link will be exhausted and all 600 customers will be wishing they had their dial-up back. At last check, YouTube traffic accounted for 10 percent of all Internet Traffic. If left completely unregulated, a typical rural ISP could find itself on the brink of saturation from normal YouTube usage already. With tier-1 providers in major metro areas, there is usually more bandwidth, but with that comes higher expectations of service and hence some saturation is inevitable.
This is why we believe that Video is currently an “unfunded mandate”. Based on a reasonable business cost model, as we have put forth above, an ISP cannot afford to size their network to have even 10% of their customers running real-time streaming video at the same time. Obviously, as bandwidth costs decrease, this will help the economic model somewhat.
However, if you still want to tune for video on your network, consider the options below…
NetEqualizer and Trade-offs to allow video
If you are not a current NetEqualizer user, please feel free to call our engineering team for more background. Here is my short answer on “how to allow video on your network” for current NetEqualizer users:
1) You can determine the IP address ranges for popular sites and give them priority via setting up a “priority host”.
This is not recommended for customers with 50 megs or less, as generally this may push you over into a gridlock situation.
2) You can raise your HOGMIN to 50,000 bytes per second.
This will generally let in the lower resolution video sites. However, they may still incur Penalities should they start buffering at a higher rate than 50,000. Again, we would not recommend this change for customers with pipes of 50 megabits or less.
With either of the above changes you run the risk of crowding out web surfing and other interactive uses , as we have described above. You can only balance so much Video before you run out of room. Please remember that the Default Settings on the NetEq are designed to slow video before the entire network comes to halt.
For more information, you can refer to another of Art’s articles on the subject of Video and the Internet: How much YouTube can the Internet Handle?
Other blog posts about ISPs blocking YouTube
Share this: