Tensorflow on Kubernetes: Kubeflow

Google is quietly releasing increasing amounts of projects dedicated to data science. One such project that was recently pointed out to me is called Kubeflow. In its essence, it is not terribly complicated. But when considered as part of the adoption of data science (and Google’s strategy), the project is of utmost importance. Kubeflow is … Continued

Accidental Rewrite of a Microservice

This is a guest post by Robert Hensing. In this blog post, I describe my experience adapting a microservice for use with AWS’ DynamoDB. Background The Sock Shop is Weave Works’ reference microservice implementation. For their customers, they want to demonstrate that their cloud solutions for deployment, monitoring and more work well on Amazon Web … Continued

Surprise at Golang Thread Scheduling

A few days ago I had a problem with high CPU usage in one of my Go-based microservices. The microservice has evolved into two distinct components: a HTTP web-app and a batch processing service. At some point, we’ll probably split these out. But in its current guise, we were seeing HTTP request latencies of greater … Continued

Monitoring Microservices with Prometheus

We seem to say this a lot at Container Solutions, but the combination of microservice architectures and the practice of DevOps have smashed apart the assumptions made by traditional tools. None more so than in the monitoring sector, which we’ve talked about in the semantic monitoring and monitoring performance blog posts. Traditional monitoring solutions like … Continued

The Release and New Features of Mesos 1.0.0

Please join me in welcoming the first major release of Apache Mesos. However, as many of you will know, Mesos has been in use for at least five years. So this is less of a major release, since every release has major new features and fixes, and more of a confirmation of its position within … Continued

Minimesos on AWS

Whilst creating our reference microservices application for Weave, I wanted to use minimesos as a controlled Mesos environment for demos and testing. The key benefit for this use case was the static definition of the Mesos environment. The stability not only helps during integration testing, but also during user experiments. I can (almost) guarantee that … Continued

Mesos Usability – A Developer’s Perspective

We use Mesos a lot. Developing with Mesos is a full time job for a large proportion of Container Solutions. From the perspective of a production user, the abstraction of physical hardware into resources is a fantastic idea. But in this post, I want to discuss how usability can affect Mesos development. And how some ongoing issues are causing … Continued

Reasons to use Apache Mesos Frameworks

The media is full of discussions of microservices and cloud-based infrastructure and for good reason. Encapsulating tasks into higher and higher abstractions is being shown by various large companies to provide a competitive advantage in any number of domains. Take the most documented example of Netflix or more recent contributions from Spotify. Both highly disruptive … Continued

Integrating Drone CI into Apache Mesos (Part 1)

Drone is a continuous integration (CI) tool, a tool whose aim is to automate the building, testing and deploying of software. There are many CI tools available, with a lot of feature overlap. A comparison will not be provided here; an entire post could be dedicated to a comparison. Apache Mesos is a general purpose scheduling … Continued