Slashdot Mirror


Ask Slashdot: Low Cost Way To Maximize SQL Server Uptime?

jdray writes "My wife and I own a mid-sized restaurant with a couple of Point of Sale (POS) terminals. The software, which runs on Windows and .NET, uses SQL Server on the back end. With an upgrade to the next major release of the software imminent, I'm considering upgrading the infrastructure it runs on to better ensure uptime (we're open seven days a week). We can't afford several thousand dollars' worth of server infrastructure (two cluster nodes and some shared storage, or some such), so I thought I'd ask Slashdot for some suggestions on enabling maximum uptime. I considered a single server node running VMWare with a limp-mode failover to a VMWare instance on a desktop, but I'm not sure how to set up a monitoring infrastructure to automate that, and manual failover isn't much of an option with non-tech staff. What suggestions do you have?"

24 of 284 comments (clear)

  1. What's your actual problem? by royallthefourth · · Score: 5, Insightful

    Why don't you have good uptime to begin with? I've SQL Server 2005 on a single unimpressive physical server with months of uptime. Is your restaurant open 24 hours? Is your current server flaking out? Concerns about uptime itself might be misplaced. What isn't made clear in the OP is why you think you need better uptime.

    1. Re:What's your actual problem? by Anonymous Coward · · Score: 5, Informative

      In addition to what the parent post said, recent editions of MS SQL Server have really nice mirroring capabilities in built in to the standard edition and you don't have to purchase a license for the "mirror" server. Even better, if you have enterprise edition, your .NET app can automatically fail-over to the mirror server. No shared disks, no windows clustering. It's pretty darn simple.

    2. Re:What's your actual problem? by markus_baertschi · · Score: 3, Interesting

      Good uptime is great, but unfortunately very expensive in terms of hardware, software and manpower. Questions you should ask yourself: - What is the maximum allowable downtime duration ? - How many outages can you tolerate per year ? - What is actual cost to you of a one day/evening outage ? - How many such outages did you have with your actual infrastructure ? I think the best option in your case is to have two identical servers/PCs of good quality with two mirrored harddrives each in hot-swap slots. If a harddrive fails, you can carry on for the evening and replace it the next day. If something else fails you swap the SQL server drives into the second server/PCs and fix the problem later. This is simple enough that you can instruct someone by phone to do that, when you are absent yourself.

    3. Re:What's your actual problem? by Bengie · · Score: 3, Insightful

      In his shoes, I would be put more effort into quick recovery than really high up-time features like fail-over. While similar, they're not the same, and recovery is much simpler to handle. This is how I plan to handle my own hobbyist network/servers.

      I guess I'm saying I would rather spend money/effort on cheap/free virtualization(HyperV3 is coming out this fall-ish) to allow a quick recovery boot from another machine, than spending money on redundant hardware and real-time failover.

      Probably a server and a desktop. The desktop could load the image and start his SQL image just fine. Not optimal, but would work while waiting for his server to get fixed.

    4. Re:What's your actual problem? by spongman · · Score: 4, Informative

      if you have enterprise edition, your .NET app can automatically fail-over to the mirror server.

      Actually, the Standard Edition will do this you just need to set up the connection strings to point to both servers.

      The Enterprise Edition will do asynchronous mirroring, but it's not worth paying extra for.

  2. SQL 2012 by g0es · · Score: 4, Informative

    You may want to look at what they are doing with avalibility groups. You can avoid the shared storage with avaliblity groups and could cut your hardware costs a bit. assuming you your software support SQL 2012. Link http://msdn.microsoft.com/en-us/library/ff877884.aspx

  3. Re:Not to get buzzwordy, but Azure...the Cloud! by Lennie · · Score: 4, Insightful

    Azure had multiple 24 hour outages.

    It's cloud so that seems like a great idea !

    --
    New things are always on the horizon
  4. Re:Not to get buzzwordy, but Azure...the Cloud! by raydobbs · · Score: 4, Insightful

    Sounds like an awesome idea - that way, you are TOTALLY FSCKED when your internet connection goes down. One thing if your online ordering for a business goes down - just take orders by phone. When it completed hoses your order taking system (offline and online), then your screwed.

  5. Easy enough by Stargoat · · Score: 4, Insightful

    Get a decent server, maybe an HP. Dual CPUs, Dual HDDs, Dual Power supplies. Get a UPS.

    Install Windows, SQL, and UPS controlling software. Install AV, but be certain to exclude AV scanning the SQL directory and SQL DBs and logs. You don't want AV killing your SQL server by accident. You might want to consider putting a firewall on the box and blocking all non-SQL traffic.

    Patch as needed.

    Install nothing else. No mine-sweeper, no restaurant food ordering software, no adobe. Nothing will kill a server faster than turning it into a desktop. Don't try to do anything on it. Just let it be a server running SQL and you'll be fine. Don't plug USB drives into it.

    You should be able to back up the SQL db every so often stopping SQL and then starting it. Try to do this around the monthly patch cycle. Don't patch immediately upon one becoming available, but rather wait a week. This will give Microsoft time to correct any patch issues they have. You'll be much more vulnerable to patch issues than you will from viruses if you follow the "don't turn it into a desktop" suggestion.

    --
    Hoist Number One and Number Six.
  6. Re:You are asking the wrong question by Anonymous Coward · · Score: 5, Insightful

    Man, why is every askSlashdot these days full of people who don't think anyone can do their own backend infrastructure (or anything else, for that matter) unless that's their only job? Look, this guy has obviously been running his POS system for some time, already. Just because he isn't a whiz at SQL Server failover doesn't mean he should just throw up his hands and hire a contractor.

    Have you completely given up on learning new things and exploring your options, or do you just advocate that other people do so?

  7. Re:Obvious solution by Anonymous Coward · · Score: 5, Funny

    MySQL is not web scale. He should use MondoDB. That is web scale.

  8. MySQL cluster by Animats · · Score: 3, Informative

    You can run MySQL Cluster on two machines. It's somewhat complex to set up. And your POS terminals have to be able to connect to either server. But it's available.

    If you're getting more than one crash a year, you have hardware problems. Commodity hardware may be unsuitable for a restaurant environment. You may need an industrial-grade PC, with a broad operating temperature range and resistance to dirt, dust, grease, and water. There are PCs and enclosures for restaurants, and the fast-food industry uses them extensively. Every McDonalds, Burger King, and KFC outlet uses industrial-quality POS systems.

    You wouldn't use a home-quality stove or a home-quality coffee maker in a restaurant. It wouldn't hold up. The same goes for a computer.

  9. Re:If it a'int broke... by Anonymous Coward · · Score: 3, Funny

    Roger Moore's law.

    What does James Bond have to do with this?

  10. If you can't measure it, you can't manage it by gnetwerker · · Score: 4, Interesting

    If you can't measure it, you can't manage it. You haven't taken the first and most essential step in analyzing your problem: measuring it. Is your problem caused by network failure? By power? By software failure? Hardware? If hardware, by server hardware, disks, or something else?

    If software, by OS, database, or application software? All of these have different solutions. Going to the cloud won't solve a network failure, it will make things worse. Going to the cloud may improve persistent hardware failures. but the MTBF of most decent hardware is pretty good, so are you sure you have clean power and a good (cool, clean) environment?

    If your software or system is crashing, then that's its own problem.

  11. Re:If it a'int broke... by sapgau · · Score: 4, Informative

    Agreed but. How old is the hardware?
    If it's over 5 years then you should consider monitoring the following components that are exposed to physical degradation:
    - Hard drive
    - Cooling fans
    - Power Supply
    - Network equipment if your electrical current is flaky.

    Your uptime might be more impacted by the level of maintenance you do on your equipment. I'm afraid to ask but if in any way your equipment is close to kitchen smoke then you could experience nasty greasy deposits in fans and air vents.

    Your next step is have a disaster recovery at the ready with your most recent VM image backup.

  12. Re:Not to get buzzwordy, but Azure...the Cloud! by gl4ss · · Score: 4, Insightful

    sounds like a fucking stupid idea, the entire operation is local and can run easily on computers which can be bought 200 dollars a pop. two of them, set up mirroring and go - even azures pricing sounds stupid compared to that.

    the cloud is a stupid idea because a) azure can go down and b) their link to azure can go down. in both cases they're screwed.

    what they could need/want would be a totally separate backup, if they're american then maybe square - if they're european wtf does a restaurant need a complex POS system for when you can get self contained payment terminals that take chip cards and connect wirelessly(or cache those which don't need instant verfication) on the pennies? (ok, those don't take care of your actual orders and such, if the restaurant system is really fancy)

    --
    world was created 5 seconds before this post as it is.
  13. Re:If it a'int broke... by edittard · · Score: 4, Funny

    WTF? Software isn't subject to physical wear like an engine. Do you think friction will eventually turn a 1 into a 0 somewhere in the code?

    --
    At the bottom of the /. main page it says 'Yesterday's News'. Well they got that right.
  14. Re:Not to get buzzwordy, but Azure...the Cloud! by gmuslera · · Score: 4, Funny

    I don't understand why people complain so much about that service. 9.99999% of uptime should be good.

  15. Recommendation from the source by matthollingsworth · · Score: 5, Informative

    I was the Program Manager in the SQL Server team owning all of our availability products in Redmond (created the AlwaysOn program). My recommendation is to 1) keep it simple and 2) implement a layered approach. But first I have a basic question - are you trying to protect SQL Server only or do you also need to protect that application and hardware? Because before we dive into the details, it might make sense to take an entirely different approach than the lower level availability technologies. And you also want to consider what it is you are protecting against. If you want to protect against hackers as well as power outages, disk failures, etc (and I suppose you probably will want to do that!), then I recommend that the first thing you do is perform regular backups to a cloud provider. That gives you the ability to restore to a point in time prior to a malicious attack. And it gives you defense in depth. Then, if you want to protect the app overall, maybe you should consider making it something that can also be hosted in the cloud for the next layer of redundancy. That way if you completely lose the site you can direct people to the cloud enabled app. But this also retains the ability to run it locally as the POS solution. Next, I'd consider a way to keep the data synchronized between the POS local installation and the cloud solution running in the VM. The cheapest solution is to use log shipping which performs backup and restores into the secondary (here in the cloud). This is also nice since you need the backups anyway for the first reason stated and this automates it. You should consider using database mirroring (now called AlwaysOn in the latest incarnation in SQL Server 2012) for the data synchronization. It's integrated into the SQL Server engine and provides better performance and the ability to configure it for no data loss and auto failover using the synchronous option. It comes in Standard Edition (sync only) and Enterprise Edition (async and sync). Also cover yourself for the common failures locally. Use a battery backed UPS and consider RAID for your disks on the computer. RAID 5 is probably fine for POS. If you have any other questions, feel free to email me johnmatthewhollingsworth@gmail.com. Best. Matt

  16. Why are you worrying about the POS system? by downhole · · Score: 3, Insightful

    Restaurants POS systems aren't exactly cutting-edge technology. There's gotta be a kazillion commercial systems out there and lots of pros to install and manage them who have set up and maintained hundreds of these systems. There's probably even some sort of restaurant owner's organization that can recommend systems and consultants. Why are you spending time on a tech site wondering about how to roll your own POS infrastructure when it provides no competitive advantage to your business and any screwups could cost big money? Spend your time worrying and working on stuff that will actually help your business compete with all of the other restaurants out there. Not that I know much about the restaurant biz, but I'm going to guess that getting and keeping good cooking staff, waitstaff, etc, getting quality supplies at a good price, and marketing the place and other restaurant-y things belong much higher on the owner's worry list than what hardware and software the POS systems are using.

    --
    I don't reply to ACs
  17. Here's what you want to do ... by TechnoGrl · · Score: 4, Insightful

    By this time you have realized that 98% of Slashdot posters don't know a damn thing about the issue that you need to resolve (... the cloud? .... Really ??? ) and are just flinging buzzwords (monkeys... poo ... ) or asking questions that you won;t know the answer to in hopes that this will get then off the hook in actually answering your question.
    .
    Short and sweet - you want database mirroring with automatic fallover. You can set up a second SQL server on a separate machine (cost less than $500 for the machine) to be the mirror and if your primary machine fails then you are still golden. Here is an article that tells gives you an idea as to how to do this in MS SQL '08 :

    http://www.databasejournal.com/features/mssql/article.php/3828341/Database-Mirroring-in-SQL-Server-2008.htm

    Yes, you should hire a **competent** DB consultant to do this for you. Yes it will cost you another $800 - $1000 do have a **competent** consultant do this for you (figure 8- 12 hours work at 80 bucks an hour) - you will lose far more than that the very first time your database fails and/or you attempt to do it yourself and blow away your database because you made a mistake (you do have backups , of course.... right ??? ).

    You can try to do it yourself but I do not recommend it as it's risky.

    I've been doing DB work for 25 years - feel free to send me a Slashdot message should you desire to use my services.

    --
    ----- In Your Cubicle No One Can Hear You Scream...
  18. Re:SQL Server experience by spongman · · Score: 3, Insightful

    there's no need to upgrade. you already have the SQL license (as long as it's at least v2005). you don't need replication, you don't need a cluster, you don't need shared storage. you just need two boxes, one license, mirroring setup, a backup strategy and a connection string tweak. everything else you can sell...

  19. Re:You are asking the wrong question by jacks0n · · Score: 4, Insightful

    Everybody thinks they know what restaurants do.
    This is why so many otherwise smart people get into the restaurant business and then fail.

    Forget the word restaurant.
    Instead, think highly competitive, low volume, high mix, low margin, short lead-time manufacturing.
    Think highly perishable inventory.

    Accurate inventory, accurate predictions of future demand, and data driven product design make all the difference between success and failure.

    Data collection and analysis is what really successful restaurants do. Or did you really think it was like Top Chef?

  20. Re:Obvious solution by datavirtue · · Score: 4, Informative

    Uh....if you can't afford to buy decent hardware then why are you playing with MS SQL Server? Oh, that's right, you spent the money on licenses. Anyway, if you want fail-over you need to setup the server properly using the required hardware. You can't have something for nothing. Seriously, you used a fighterjet when all you needed was a Cessna. You platform choice reaks of microsoft hammer syndrom. Whoever developed your system knew Visual Studio .NET and saddled you with this costly burden.

    If it were me I would use MySQL, automated backups, and an image or VM standing by with extra commodity hardware. Hell, just use this scenario with your current setup.

    Another thing, I hope you're using quality harware even if it isn't redundant. Or is this a wal-mart setup?

    --
    I object to power without constructive purpose. --Spock