Slashdot Mirror


Bad "Buss Duct" Causes Week-long Closure of 5,000 Employee Federal Complex

McGruber (1417641) writes In Atlanta, an electrical problem in a "Buss Duct" has caused the Sam Nunn Atlanta Federal Center to be closed for at least a week. 5,000 federal employees work at the center. While many might view this as another example of The Infrastructure Crisis in the USA, it might actually be another example of mismanagement at the complex's landlord, the General Service Administration (GSA). Probably no one wants to go to work in an Atlanta July without a working A/C.

34 of 124 comments (clear)

  1. Re:Link doesn't work by apraetor · · Score: 3, Informative

    It's not a link. Someone put an .. tag around text, there's no href component with a URL provided.

  2. Earthshaking by Frosty+Piss · · Score: 4, Insightful

    An electrical problem effects power to a signle building, this is news? This has nothing to do with "failing infrastructure" like old bridges, highway maintenance, or such. It's an electrical problem in a single building.

    --
    If you want news from today, you have to come back tomorrow.
    1. Re:Earthshaking by Z00L00K · · Score: 3, Interesting

      This is only newsworthy because it was a big building with a single point of failure.

      What we all can learn is to avoid single.points of failure in large systems.

      --
      If builders built buildings the way programmers wrote programs, then the first woodpecker would destroy civilization.
    2. Re:Earthshaking by Anonymous Coward · · Score: 5, Informative

      A large metal grid used to transmit lots of power within a building. It is a raceway for bus bars. They help dissipate more heat than using cables and can be tied onto at many points. This isn't a sign of a larger failing - it's a critical part of the building's systems that needed repair. It's not easy to repair while live.

      We had a small fire when ours (in a NYC skyscraper) was accidentally shorted. It shut our building down for a couple of days as well (as the bus carried most of the larger loads like HVAC and elevators). We did still have lights and such.

    3. Re:Earthshaking by __aaclcg7560 · · Score: 2

      Redundancy should only be necessary when and where it makes sense.

      Paperwork in triplicate is the only thing that counts in government.

    4. Re:Earthshaking by OzPeter · · Score: 2

      Redundancy should only be necessary when and where it makes sense. I don't think this is one of those cases.

      Though I am a bit surprised that it would take a week to get and install replacement parts...

      From someone posting the link below and reading TFA, there has been no indications to what the actual problem was.

      But given that it effected the whole building in order to enact a repair it might have taken a bunch of upstream switching of large capacity power systems. Co-ordinating, doing arc-flash assessment, safety plans, organizing labor and proper tools etc could easily take a couple of days in itself. Let alone performing the work, doing proper testing and then reversing all of the up stream switching.

      Performing work in large scale systems does get paperwork intensive. However that has come about as a means to combat workplace injury and/or death. So I'd rather do the paperwork.

      --
      I am Slashdot. Are you Slashdot as well?
    5. Re:Earthshaking by McGruber · · Score: 2

      It's an electrical problem in a single building.

      Actually, the complex is four separate builidings connected in a U-shape; the tallest is 24 stories. The complex has its own entry on skyscraperpage.com and is also described in this 6-page PDF by Trane, the air-conditioning company. That PDF includes this description of the buildings in the complex and how it is all designed for 24/7 operation:

      The facility, named for the former U.S. Senator from Georgia, is one the largest federal office buildings on the East Coast. It encompasses 1.87 million square feet of space. The structure straddles a busy downtown street. The building is also located atop an underground train tunnel of the Atlanta transit system, MARTA. The building units include the remodeled 1924 department store, Rich's, which was a downtown Atlanta landmark and an Atlanta institution.

      Now this renovated six-story building and its beloved clock are a visual cornerstone for the center. Other elements are a 10-story mid-rise section, an eight-story bridge, six stories over Forsyth Street and a 24-story high-rise tower. Adjacent to the building is a 10-story parking garage. Construction of the building was a joint urban redevelopment enterprise of the City of Atlanta and the Federal Government. The design architect for the facility was the California firm of Kohn, Peterson, Fox and Associates. Newcomb & Boyd, a large Atlanta firm, was chosen as the project engineer.

      Designed For 24-Hour Operation Southeastern Facility Management, Inc., is contracted by GSA to operate this facility. The system was designed for 24-hour seven days a week operation to accommodate the mission of the various agencies housed in the facility. One or more of the 1,310-ton chillers were to operate, depending on the building load, between the hours of 6:00 a.m. and 6:00 p.m. After 6:00 p.m., the 400-ton chiller was to carry all computer rooms and miscellaneous building loads. As a consequence, the facility designers and engineers needed to plan for continuous occupancy. Atlanta has significant cooling loads for much of the year and high humidity as well. The goal of the HVAC system design was to assure complete comfort in the building around the clock, year-round. To achieve this, significant emphasis was placed on humidity control with a central chilled water plant, air handlers for each area and a zone- controlled VAV air delivery system. Building designers also recognized that an important part of the office environment is acoustic performance. For this reason, rigorous sound level standards were set for occupied areas throughout the facility. The air conditioning system efficiency was extremely important due to the 24/7 operation.

    6. Re:Earthshaking by Deadstick · · Score: 2

      A misspelling of bus duct. You should be able to take it from here.

    7. Re:Earthshaking by thegarbz · · Score: 3, Informative

      Bus ducts are not off the shelf devices, they are normally custom made for the installation. Installation is also quite complex and slow but all these negatives come with really great benefit of the things being essentially maintenance free.

      Which makes me wonder how they had a fault to begin with.

    8. Re:Earthshaking by plover · · Score: 2

      When the Chicago loop flooded in 1991, the Marshall Field's State Street store was impacted. Being the headquarters for the Marshall Field's chain, they had their data and networking centers on the tenth floor. Their network topology was a hub and spoke affair, and the State Street store was the hub. The operators continued working in the building the entire duration of the flood. They had to wade through water on the ground floor to reach the stairs to climb the 10 stories to work. The electrical bus normally feeds from the lower levels, but when power was cut the computers and routers had to be kept running, so the generator on the roof was fired up. The generator was not dedicated to the computer systems, and powered the entire building. The operators said they saw the water boiling around the electrified bus.

      I don't know if all that was actually true, but I do know that throughout the entire flood and recovery, the chain experienced no network outages. The fiber optic cables carrying the data had no problems being immersed, and all the terminations and transceivers were in the data center on the tenth floor.

      --
      John
    9. Re:Earthshaking by TWX · · Score: 3, Interesting

      The fiber optic cables carrying the data had no problems being immersed

      For the immediate emergency, no, they didn't.

      Long-term, fiber is susceptible to water damage. I had a site that needed fiber replaced because the Christy vault was placed too low in the ground and got inundated with irrigation water. The fiber didn't even splice in the vault; it was just a pull-point where the conduit stubbed up into the vault and a new conduit dropped back down, but the conduits filled up and the fiber degraded fairly quickly despite being gel-filled OSP. For awhile we kept testing and moving to different strands as the ones we were on failed, but it didn't take long before it had to be replaced. Fortunately the contractor was able to eliminate that particular vault entirely, splicing the conduits together after getting the moisture out, and we haven't had a problem since.

      --
      Do not look into laser with remaining eye.
  3. Kinda of a big deal by Anonymous Coward · · Score: 2, Informative

    If you don't know, buss duct is a power distribution component. It generally carries at least 1000 amps, sometimes much more depending on size. So... Yeah. Basically no power in probably half the building.

  4. Re:Link doesn't work by Zero__Kelvin · · Score: 4, Informative

    The Infrastructure Crisis is a valid link. The rest of it is borked.

    --
    Guns don't kill people; Physics kills people! - John Lithgow as Dick Solomon on Third Rock From The Sun
  5. What? by Frosty+Piss · · Score: 3, Informative

    For those who are wondering, a "buss duct" is a duct that contains "busbars", which are generally large flat copper bars that conduct substantial current.

    From the Wikipedia...

    The cross-sectional size of the busbar determines the maximum amount of current that can be safely carried. Busbars can have a cross-sectional area of as little as 10 mm2 but electrical substations may use metal pipes of 50 mm in diameter or more as busbars. An aluminium smelter will have very large busbars used to carry tens of thousands of amperes to the electrochemical cells that produce aluminium from molten salts.

    --
    If you want news from today, you have to come back tomorrow.
  6. It's not "buss" - its bus. by Known+Nutter · · Score: 4, Informative

    A fool's drivel repeated often enough will some day end up in the lexicon, especially in the moden age of instant mass communications, but that does not make it correct.

    "Buss" is not a word, but because there was an electrical manufacturing company called "Bussman" that makes fuses, and people would often shorten it to "Buss Fuses", other illiterates have created a spurious spelling that uses "buss" instead of "bus". It's still incorrect however, in spite of the illiterates repeating it on the internet.

    This holds true within the electrical trade, as many old-timers frequently write (not type!) "buss" -- I often see it on equipment labels, one-line drawings, etc.

    --
    Beware of the Leopard.
    1. Re:It's not "buss" - its bus. by Known+Nutter · · Score: 3, Insightful

      You can be pedantic, but come on...I get it, language evolves, but a tech website like slashdot should get the tech vernacular correct, don't you think?

      After all, "bus" is not foreign term to "nerds" now, is it? For example, the same term that describes "front side bus" also describes an electrical bus duct.

      --
      Beware of the Leopard.
  7. Built in 1997 by Animats · · Score: 2

    That building complex was overhauled in 1997 by Inglett & Stubbs electrical contractors, who did $14 million of electrical work. This failure may or may not be their fault, but it's not because of neglected infrastructure.

  8. Re:Wimps. by jklovanc · · Score: 2

    Those settlers were not required to sit still inside during the hottest part of the day.

  9. Not just AC by jklovanc · · Score: 2

    Here is a link to a story about the outage.

    Therefore, the chiller plant and a large portion of the building’s electrical grid were rendered inoperable

    It is also difficult to work without lights, computers, routers, PBX, etc.

  10. 17 years ago is a long time for such a system by Bruce66423 · · Score: 2

    The question is whether appropriate maintenance was done subsequently; a failure to do so would indeed constitute a symptom of the infrastructure crisis, which is often caused by routine maintenance being cut as a 'painless' cost saving for a financially strapped government. Then it comes back and bites them...

    1. Re:17 years ago is a long time for such a system by thegarbz · · Score: 5, Interesting

      No. Bus ducts are installed because of their high current and extremely low maintenance requirements.

      Most bus duct systems I've worked on are on 10-20 year inspection regimes, and I have yet to encounter one, even some which are 50+ years old that actually needed maintenance. They are, or at least should be, sealed systems without so much as a spec of dust to cause problems.

  11. Re:Wimps. by jklovanc · · Score: 2

    Which during the hot months that did in the mornings and evenings and not a 9-5 schedule so they can coordinate with the rest of the country.

    "Only mad dogs and Englishmen go out in the noonday sun"

  12. July in Atlanta...HA! by Horshu · · Score: 2

    I worked for a company in the 2009 time frame where the AC went out regularly in the summer months in Houston. I came in after a stay in the hospital to an office that was 95 degrees. July anywhere on the Gulf Coast can be bad, but in August/September, it's even worse.

  13. The human side of the story by Registered+Coward+v2 · · Score: 3, Interesting

    Many of the effected people are not government employees, they are hourly contractors doing clerical and office work. They either have to take vacation or go without pay, and not getting paid for a week when you are making maybe $15/hour is not pleasant. Some can work from home but since the outage was unexpected they may not have their work laptop at home. How do I know this? I have a friend who works there.

    --
    I'm a consultant - I convert gibberish into cash-flow.
  14. Multiple service entrances are not allowed by Ellis+D.+Tripp · · Score: 3, Informative

    into the same structure per the National Electrical Code. Only exception is for different voltages, etc.

    Every building has some electrical switchgear that constitutes a "single point of failure", and it is mandated to do so by code. Simplifies cutting off power by first responders in an emergency, etc.

    Buss duct is generally not stocked by local distributors, and may have been custom made to order (angle/offsets/termination sections anyway) so depending on what exactly burned up, they could be a while sourcing replacement parts.

    --
    Remember "News for Nerds, Stuff that Matters"? Help make it a reality again! http://soylentnews.org
    1. Re:Multiple service entrances are not allowed by rgmoore · · Score: 2

      There are other cases when you can have multiple service entrances beyond different voltages. A building may have more than one by special permission if it has multiple tenants and no common areas where a common service could be located, or if it's too big to be practically served by a single service. And a building can always be served by multiple services if the electrical demands are larger than the utility can provide with a single service. A quick look says that multiple services are always allowed if the demand exceeds 2000 amps at 600V, which could happen pretty easily in a building large enough to hold 5000 workers.

      --

      There's no point in questioning authority if you aren't going to listen to the answers.

  15. Re:They had to cut something... by sumdumass · · Score: 2

    Actually, the ultra rich had their taxes raised recently (2012). Perhaps you mean something else? Please explain if you do.

    God bless America! indeed!

  16. Re: Well, the GSA could start firing the contracto by sjames · · Score: 3, Insightful

    It's a regular template among the privatization crowd. Government only had to accomplish X but screwed up here, here, and here. Privatize and that won't happen. Barely hidden assumptions include: private operations never screw up, private operations never cheat.

  17. Re:They had to cut something... by sumdumass · · Score: 2

    Yes, I am aware. However, I do not care what the ultra rich paid in taxes in 1960 or 1945. I do not really care about what they pay in 2014 either. But the idea that their taxes are being cut and this somehow has something to do with the problem in the article is a fabrication.

    Also, are you aware that it is a crime for a federal department head to fail to take steps to maintain and preserve federal property? At least that is what we were told during the shut down as the reasoning behind closing open air memorials off to aging vets and putting road blocks up to stop traffic from looking at Mount Rushmore or from visiting private businesses located on federal park property. So if this was because of lacking funds, someone broke a law and should have cut expenses somewhere else.

  18. Buss ducts are failing more often as they age by mbeckman · · Score: 2

    This actually is an infrastructure aging problem. And the incidence of buss duct failure has been increasing in older buildings. Many bus ducts installed in industrial and commercial facilities are immediately downstream of the transformers, but upstream of the main overcurrent device. Thus, transformer protection devices often inadequately protect the buss conductor from being fried by a short. I've seen them vaporized.

    Such shorts occur due to water infiltration, corrosion, and most importantly in the summer, overheating. All three effects accumulate over time. If money were no object, every building would have a dual-buss electrical system, just like aircraft (and data centers) do. Alas, money is an object.

  19. Re: Well, the GSA could start firing the contracto by Attila+Dimedici · · Score: 2

    No, the assumption is that when the private operator screws up he will get fired and replaced. This is unlike someone protected by the Civil Service Act, who is next to impossible to fire. The template of most in the privatization crowd (excepting those who are really just pushing to move that money to their cronies) is that the private operator will have greater incentive to avoid screwing up in order to avoid getting fired, while the "civil servant" has no such fear. Whether or not that template is accurate is another question entirely.
    Apparently you are unaware of this basic economic principle which those who push privatization take as a basic assumption.

    --
    The truth is that all men having power ought to be mistrusted. James Madison
  20. Re: Well, the GSA could start firing the contracto by Attila+Dimedici · · Score: 3, Interesting

    You ask a very good question, and it is a very good one. If the contractor screwed up, he should get fired. However, the failure to fire the private contractor is not a problem with privatization, but with government. As an example, the VA administrators who went beyond screwing up to active misconduct not only did not get fired, they received bonuses...and their bosses initially attempted to claim that those bonuses could not be withdrawn.

    --
    The truth is that all men having power ought to be mistrusted. James Madison
  21. Re: Well, the GSA could start firing the contract by Curunir_wolf · · Score: 2

    Really think about it is there some filter that puts idiots in to government employment while private industry only get the goods ones while paying a lower wage?

    Sort of. It's generally referred to as "job security". Most government agencies have both good and worthless employees. The thing is, in government, the worthless employees are almost impossible to get rid of. So those agencies can never be as efficient as a company that can hire people at-will, and can cut staff that is not contributing. Yes, it's possible to fire government employees, but it's very difficult, and it requires putting resources into all the paperwork required to make it happen and avoid lawsuits. And there are all kinds of things that go on in government that perpetuates that, such as tribute, PC issues, long-term employees with strategic relationships, etc. And so the response when more resources are needed is never to look for the lowest-level contributors, but to simply hire more people to make up for the dead weight.

    Of course this issue is not strictly limited to government, it can happen to some degree in any old, large bureaucratic organization. But since most government agencies fall into that category, and exist in perpetuity, and rarely if ever face budget cuts, it's more pervasive in government than in private industry.

    --
    "Somebody has to do something. It's just incredibly pathetic it has to be us."
    --- Jerry Garcia
  22. Re: Well, the GSA could start firing the contracto by sjames · · Score: 2

    Down at the bottom line though is that privitization can never be as cheap as optimal government services. Function X costs at least Y to perform. Even under ideal conditions, a private contractor can at best deliver it for Y+a profit. Supporters of privitization believe that the private corporation will be so much more efficient that that higher amount will still be less than it costs to do internally.

    Of course, once you add all the overhead of dealing with the many checks and balances and all the metrics and paperwork to make sure the private contractor isn't cheating, you inevitably drive those nimble and efficient private contractors away leaving NG and their ilk to win the contracts. Every last bit of that bureaucratic bloat plus a hefty profit will be added to the bill. That includes the small army of lawyers on retainer to make sure that if anything goes wrong, it will somehow be the government's fault so they can tack the overruns on to the bill. Eventually, that procedure becomes easier and more profitable than keeping costs down. That happens with or without a legislated contract.

    There is a balance to be struck. For example, while it is probably cheaper for the government to buy the toilet paper itself, it is probably not a good idea for it to actually manufacture the paper.