HOWTO: Server Cable Management

Date July 25, 2008

Introduction
Happy Friday to you, and welcome to the (semi, almost) weekly how-to. Today, by popular request, we’re talking about cable management.

Good cable management defined is making cables, cords, and wires cleanly and neatly arranged, and it facilitates easy tracing of cables and simplifies replacing bad cables. A lot of time, these are all mutually exclusive, so we concentrate on the task at hand and taylor our cable management to that end. It also promotes good air flow in the back of the machines, which should be reason enough to do it.

Cable management is, to a lot of people, something you would rather be done with than do. It’s also far easier to do when you don’t have to take down the network or power from a running system. For this reason, it’s important to keep it in mind in the beginning, when you’re figuring out how you are going to cram all those wires wherever they need to go. The job isn’t made easier by the huge number of places wires have to go, nor by the types of wires that you’re dealing with. Lets break it down a little and see what the best policies are for each.

Shelved Computers

Whether this is a scene from your work, or your basement, almost all of us have been there. Industrial shelving with tower servers everywhere. Wild tangles of cable in the back, probably inaccessible against the wall, where they attract dust bunnies and cobwebs. It’s not ideal, but it’s all a lot of us have to deal with. What do you do to make it useful?

First, if your shelves are against the wall, pull it out at least a foot, if at all possible. The amount of heat being built up in the back is immense, and with nowhere to go, you’re just baking the back of your equipment. Once you’ve got some space back there, you can go to work.

The major problem with industrial shelving is that it’s not meant to hold servers, and there-for it has no cable management. It’s easy to add your own. I have several runs of plastic cable runs that are open sided, with fingers to hold cable. Here’s an example:

They can be several feet long, and work great on industrial shelves. Just mount them to the back of each shelf layer, and run your cables through there. Since they have the fingers, you just pull the cable out of the run and into the server where-ever you need. It works great, and looks neat and tidy.

It is important to remember that long runs of power cable should not be mixed with network cable. It would be best to run your ethernet cable along the top shelf, and power across the middle shelf. That would keep them separated, so as not to create massive packet loss.

If your cable duct is like those in the picture, with a “lid” to keep the cables contained, then great! Use it! They snap on and off easily, and really improve the look and airflow. They do make cheap ones without that cover though. I know because I have several. In that case, you’re going to want to secure the cables together, so they don’t fall out of the channel. For this task, lots of admins use plastic zip ties. That was my preferred tool, as well, until I discovered that velcro ties. They’re just as easy, reusable, and you don’t have to carry wire cutters to snip that last 6 inches of extra plastic. These qualities pale in comparison to the fact that, when you need to replace a cable at 3 in the morning, you don’t need to find the wirecutters that you carry with you during the day. It’s just “rriiiipp” and you have access to your cables. I cannot recommend these highly enough for any cable runs that you foresee replacing.

Typical Server Rack
The other major form factor for servers is rackmount. If you’ve never used it before, you might want to check the introduction I wrote a while back.

Since racks ARE meant to hold servers, all but the least expensive have built-in cable management. Typically there are channels running vertically up and down the back corners with access points placed intermittently along the way. Ideally, all your servers would have power cords on one side and network cables on the other. This is pretty much never the case. Still, I have all of my ethernet on the right side (if you’re standing looking at the rack from behind it), and all my power on the left.

One note, when it comes to installing servers in the rack. Lots of servers (Dell, I know for sure. HP maybe) come with cable arms for the back of the rack. They flex and pivot, and are meant to allow you to pull the server out the front of the rack without having to unplug any of the cables. If your rack is low density, they’re only mostly irritating, but if you’ve got several machines close together, the cable arms are a menace. They block airflow, hold heat, and I can count the number of times I’ve wanted to pull a server out while it was still on at 0. They’re completely worthless to me, so I don’t install them. I’ll leave the decision to you, but my advice is that they make excellent ballast for empty garbage cans.

Cable length makes up a big part of keeping a rack clean, too. Assuming you have a typical 42u rack, the farthest apart two network ports can be is just over 6ft. Assuming you want to square off the corners and run the cable in straight lines, it’s just over 9ft. Thus, you should never have a cable on your rack longer than 10ft. If you place your switches intelligently (in this case, facing the back of the rack, and in the middle, at around 21u from the bottom), you can cut that in half, for network cables. The majority of bad cabling jobs are due to improper lengths being used. If you’re making your own cables, this is easy to remedy. If you’re ordering them, you’ll have to plan ahead. For my blade systems, I planned the rack layout ahead of time, and ordered the exact ethernet and fiber lengths I needed. Now there’s no extra cables to block air, and there’s no pile of cables at the bottom of the rack that I have to worry about.

You can crimp your own ethernet, but making power cables is a little more difficult. I’d instead recommend ordering exact lengths. You can get anywhere from 1ft to really long. Chances are very good that the right length exists for you already. If you don’t have the time to wait on the cables, the next best thing is to only unwind as much cable as you need from the twist-tied cable bundle they sent with the computer. When you get the right length out, twist-tie the bundle back together. It’s still neat, and stays out of the way.

Vertical / Horizontal Cable Runs


You won’t be running cables to servers all the time. In many cases, you’ll be wanting to get the cables to a distribution panel, between patch panels, or between a panel and a switch. In these cases, you’re going to be using vertical and/or horizontal cabling. The names “vertical” and “horizontal” come from network architecture ideas. Vertical cables are backbones that go between distribution facilities. Horizontal cables go from distribution facilities to endpoints.

For our purposes today, the differences don’t matter much. The important part is that we’re running semi-permanent cables between places. Because of this difference, where I recommended velcro before, I recommend zip ties now. Due to the number of cables that are frequently run in this way, the bundle is often too big for velcro anyway, and since the install is permanent, you won’t have to worry about taking the cables down often (at least, you hope not).

Desktops

Let us not overlook the most common type of computer in offices, the humble desktop. Pound for pound, it can create a larger mess of cables than that 6u beast in the rack. Couple this with the tendency to put desktops on the floor, right next to feet, and you’ve got a mess in the making.

The best tools for these I’ve found are the plastic tubes with slits cut in them. There are some more extreme measures, but the plastic tubes usually work pretty well. The only issue is that my peripherals come with an irritatingly short cord. Most of the time, it seems like part of the cable is being wasted going to the ground, then going all the way back up to my desk. You can remove that slack with sticky cable tie squares.

Review

As you can see, there’s no end-all be-all solution to cable management. It’s an ongoing struggle, and the number of solutions that people have provided is mind-boggling. That just goes to show that it’s a difficult problem to solve.

As an admin, there’s really no book or course that you can take (that I’ve heard of, anyway) to improve your skills. It’s very much an apprentice type knowledge, and your cable management skills are likely a reflection of who you learned from, and what you’ve managed to find on the internet. I know I’ve come by my knowledge through trying things, testing them, and using critical thinking, and I’m sure you have too. For this reason, in order to increase the general knowledge on the subject, please comment below with your own tips, techniques, and criticism of my take on it. I’m the first to admit that I’m not the best at cable management, but I’ve been doing it long enough that they’re a lot better than they used to be. Hopefully they’ll help someone earlier on the curve get better faster, and that will help us all improve.

(photos courtesy of Jonathan Auer, cableorganizer.com, madferrett, Jason Froemming, and Rob Dudley)

16 Responses to “HOWTO: Server Cable Management”

  1. Unomi said:

    Thanks. That’s a great help. I’m about the move to a new house and am planning to run some new wiring. With it, I’m thinking about running network cables etc. too.

    It’s good to have some basic thoughts at hand and some solutions to it.

    Have a nice one!

    - Unomi -

  2. Matt said:

    @Unomi

    You’re very welcome! I’m glad you liked the article. Good luck with the rewiring, and stop back by to read when you get a chance.

  3. daveg said:

    As tempting as it is to rack low density servers one on top of the other, I think you’ll find that they’ve unfortunately been designed to be mounted with atleast 1RU of space between each server (kinda defeats the purpose huh? :-( ). I’ve found that definitely helps with 1RU and 2RU servers. Servers 3RU or larger I’ve found don’t have as much of a problem with the cable arms.

  4. Kenny said:

    Where I used to work, the guy that was in charge of the NOC demanded that 1U servers have 1U of space between them. I figured the guy was just an idiot (he was, just ask Matt). Is that for cooling reasons, or is there some other reason why you’d do that?

    it just seems like a waste of space to get 1Us if they take up 2U of space.

  5. Jason said:

    Thanks for using my pic! I take pride in my work and I believe good wiring practices. Although my work was in cable tv headends, I think the same practices still apply.

    Check out the rest of the pics of my work at: http://www.flickr.com/photos/jwiz/sets/72157603673681464

  6. Dave said:

    I have installed 2376 HP servers in 2 data centers over a 33 month period.
    Models include: DL360, DL380, DL385, DL580, DL585, and C7000

    I have been told that my cabling is a work of art. I am asked why I install the patch cables so neatly. I give them 3 reasons.
    1) It facilitates better air flow. I insist on right-size cables. This keeps the amount of cable in the cable management arm to a minimum which allows hot air from the back of the server to escape better.
    2) Better operation of the cable management arm when extending the server out of the rack for service. One should be able to pull the server out 1000 times and the cabling remains neat and enacted.
    3) It looks good. There is a sense of pride when your multi-million dollar data center looks like a multi-million dollar data center.

    Currently, I am working as an Analyst teaching others how to properly cable servers and teaching them about the vision of having the neatest data center on the planet.

    Dave

  7. Matt said:

    @Dave

    WOW! That’s amazing! I would love to see some pictures of those installs. They sound great!

    Would you be interested in creating a document which outlines some vendor-neutral best practices for keeping cables neat and well documented? I’d love to read it, and there’s a lack of good documentation on that subject.

    Please drop me a line at [email protected] if you would. Thanks!

    –Matt

  8. Ken said:

    Thanks for writing this great article. It really helped giving me some ideas to organize my own cable organization. Much appreciated.

    Ken

  9. Deanna Helie said:

    great article.

    I am just beginning to work on our mess of 10 years of running cable from our servers to the switches. It is a mess. Anyone who has some idea or suggestions on equipment would be greatly appreciated.

    Deanna

  10. Elaydi said:

    Hello Matt, I read this article with great interest. We are shortly moving our data center. The cabling in our existing data center has become very untidy as we’ve been forced to squeeze hardware into every last U (management just wont pay for another rack). So I’m wondering where to position our switches. They are currently at the top of the rack and I think it’ll be better if placed midway. Shorter cable runs and just easier to access. Thanks.
    Elaydi

  11. Ash said:

    To me, the third picture in this article shows excessive cable management. It looks pretty, but it isn’t practical. You wouldn’t even be able to slide one of those systems forward if they needed maintenance without cutting the cable wraps. I also totally agree with you about cable arms. They are far more detrimental than beneficial.

  12. Steve Chisnall said:

    What about cables with angle plugs, whether right-angle or some other angle?

  13. thomas & betts said:

    from many years Biscoind supplies good electronics components like
    thomas & betts products.

  14. Kimmo said:

    This is a very nice commonsense primer on rack cabling and you raise many valuable points, including the need to separate out power and networking and right-sizing the cabling. I knew much of it but it helped clarify my thoughts on an upcoming redesign I’ll be doing of the rack at work so much appreciated.

    As for the cable arms and the need to slide servers out while running – especially as of this writing a couple of years after this was written, in the era of pervasive virtualization, the need for cable arms have gone down further if anything. A properly virtualized environment will let you migrate the stuff running on the machines to other machines so any maintenance of a specific box can be done with the box unpowered.

  15. Greg said:

    Matt, I know this is an old post, but perhaps you could give some feedback. We currently have a 12U wall mount (angle iron frame) that currently holds 2 48 port switches and 2 4 8 port patch panels. The patch panel to switch are all connected with 2 foot cables. About 76 are connected. And there is a single fiber optic going to one of the switches from another switch on the other side of the building.

    I also have a Dell Rack sitting to the left of this. In this rack we have 4 servers, the san, router, and a few other network devices. I would say we have about 24 cables going from rack to switches.

    To work on the rack I have to pull it out about 3 feet to get behind it… room not big enough to leave it out always in one position.

    I have 1 problem… when I need to add a new run to the patch panel it is a pain in the rear to try and get things punched down since the swiches are on the wall mount rack. With out the switches I could just stand up behind the patch panel in the middle of the wall mount and easily work. With the switches in place you have to either be a contortionist or have to unscrew the patch panel from wall mount to get to it.

    So my though was to move the switches to the rack (put it in the middle) and then run 76 longer patch cords (7ft) from the switches on the rack to the patch panel on the wall mount. Now this would make my life easier for adding new runs (which happens more often than you would think), BUT now I have a BUNCH more cables going from Dell rack to patch panels on the wall mount. And then when I pull the rack out to work on it I would need to enusure I have things rigged in a way that allows cable to not get pulled or have too much weight hanging from patch panel.

    I would love to get your feedback on what you would recommend. Would you say leave the switches where they are with the patch panels and deal with the struggle to add new runs and keep the cables running from Dell rack to the switches at a minimum or would you recommend moving the switches to the rack? I also have to be concerned about that optical cable. Since the rack needs to be pulled about 3 feet everytime I need to get behind it my concern would be eventual damage to the fiber optic that would be strung to the rack. If the rack could always stay fixed in place and I had plenty of room in front and back then I wouldn’t ever move it, but that isn’t the case here.

    Anyway… would love your feedback.

  16. How do you organise the cables in your racks? - Admins Goodies said:

    [...] Edit I forgot! I also did a HOWTO on this a long time ago: http://www.standalone-sysadmin.com/blog/2008/07/howto-server-cable-management/ [...]

Leave a Reply

XHTML: You can use these tags: <a href="" title=""> <abbr title=""> <acronym title=""> <b> <blockquote cite=""> <cite> <code> <del datetime=""> <em> <i> <q cite=""> <strike> <strong>

Easy AdSense by Unreal