Easy-Bake Data Center

I cleaned up my office a few weeks ago. Collected the few raspberry pi’s that are unused. The odd switch; cheap, unmanaged, but efficient. Sure, I’m still in the process of making a game, but like most humans, I’m easily distracted. This distraction got to me when a saw the switch. And of course, when you see a switch, you think about deployment pipelines.

I work at Amazon, and the way we deploy software is fairly cool. When I write software at home, they way I deploy sucks. Its fine for me, but it ‘could be’ soooo much more. So a quick search on-line turned up the Netflix deployment pipeline they open-sourced called spinnaker. Spinnaker sounded like something I wanted to try. Which, of course, means I have to run it somewhere. And no, I’d rather not run it on my development desktop. Besides, having places to run little apps at home is nice, especially since I’d rather not have to keep my desktop on all the time. Raspberry pi’s are great for these types of things.

At $35 a pop, not including SD disk drives, they make perfectly fine compute nodes for a home environment. And there is an active community creating clusters of various sizes. So I looked at my switch and said screw it, lets build a data-center the same way Hasbro said lets build an oven. Here’s the initial play-list of goodness:

  • HypriotOS for the Linux installs. Raspberry pi meets Docker.
  • Kubernetes to manage the docker installs. Following instructions on this post.
  • NFS mounted file-system with one host using 1TB hard drives (For sharing/storing data like ab initio calcs I want to start running again.)
  • Spinnaker, which started all this for me.
  • And not a lot of money, considering

That last part is the interesting part. This is more of a learning exercise then anything else. For a few bucks, I get to build and play with an easy-bake oven version of a data center using modern techniques. I get a simple place to build my software, or run my old calculations 24×7, and the cluster is easily expandable if I so desire. No monthly costs beyond electricity once it’s setup. What’s not to love?