News Filtered by : Zookeeper

Implementing Failover for Random Cronjobs with Zookeeper

blog.parse.com on 03/11/2013

Excerpt: Part of running a popular service on the internet is the never-ending search for SPOFs. Single points of failure are pretty easy to squish in the more well-understood parts of the stack; load balancers come in pairs and distribute queries to multiple web servers with health checks and so on. Inevitably, though, there are a few bits that creep in and are “unique”. One form of these special snowflakes is a job that you want to run periodically but would rather have only one copy of these jobs running at a time – every infrastructure I’ve seen winds up having a “batch host” of some sort. For example, every day we do some analysis on the previous day’s logs and create some statistics about our service to keep ourselves honest.... read the full post.
Tags: API-Evangelist, API-Stack, Zookeeper