Skip to content
DoK Community

Blog

Blog

Stories, how-tos and talk recaps from people running data on Kubernetes.

Jan 6, 2022

How to deploy Elasticsearch on Kubernetes

99.co is Singapore’s fastest-growing real estate portal. We power our listings search feature with Elasticsearch (ES), a distributed search engine that can perform complicated search queries at a fast speed. Our backend is a microservices architecture running in Google Kubernetes Engine (GKE), which includes the search service.

Dec 20, 2021

DoKC 2021 year in review

As 2021 is coming to an end, we wanted to take a step back to appreciate what the Data on Kubernetes Community achieved. Spoiler alert: a lot! The DoKC organized not one Dok Day, but two! For KubeCon EU and KubeCon NA, we learned a ton from our community. If you were not able to attend, fear not! You can access all the talks here (EU) and here (NA). Our Dok Days include music interludes, an excellent way to relax in between talks!

Dec 16, 2021

Application Level Data Operations on Kubernetes

For stateful, cloud-native applications, data operations must often be performed by tools with a semantic understanding of the data. The volume-level primitives provided by orchestrators are not sufficient to support data workflows like backup/recovery of complex, distributed databases.

Dec 13, 2021

Cloud Native Database as a Service using Kubernetes

In the recent Cloud Native Computing Foundation (CNCF) survey, managing complexity is the number one issue faced by Kubernetes architects and practitioners. Deploying stateful applications in Kubernetes further adds to the cognitive load of practitioners. MayaData and Percona have partnered together to build a unified Helm chart aimed at providing an easy onramp to a highly performant Database as a Service offering.

Dec 10, 2021

Migrating MongoDB to Kubernetes

Kubernetes needs help to create and manage stateful applications like databases. It needs a specific network configuration, persistent storage, and dedicated computing capacity. This applies to MongoDB. This talk goes over an overview of Kubernetes operators for MongoDB, why operators are needed to run MongoDB on Kubernetes. Sergey also explains how to migrate MongoDB to Kubernetes ending with a demo.

Dec 7, 2021

Postgres on Kubernetes Applied at Scale

DoKC staff Sylvain and Bart interviewed OnGres CEO Álvaro, engaging in an entertaining, technical discussion about a very real use case: running Postgres on Kubernetes, at scale, in production. We covered open-source tools to use, how to properly handle day-2 operations and why you’d be missing out by not running your database on K8s!

Dec 4, 2021

Migrating and running Elasticsearch on Kubernetes

Singapore-based property search engine startup 99.co provides renters, buyers, and agents fast and efficient property search experience. At the core of their platform used by 20 million users/month across Southeast Asia is their Elasticsearch cluster. The engineering team decided to move it to Kubernetes after being frustrated with the lack of agility of their former infrastructure causing outages. Learn about the why, how, and learning of running a production Elasticsearch cluster on Kubernetes.

Nov 30, 2021

Using stateful services to index the world of open source

Sourcegraph is a universal code search engine that allows developers to search across their entire codebases. It can be deployed on-prem or used directly from the cloud. The service currently indexes over 1 million open source repositories and provides code search across them. Sourcegraph is planning on indexing every open source repository with more than 1 star on GitHub, GitLab, and other code hosts. To achieve this scale, it relies on Kubernetes to scale several stateful services.

Nov 26, 2021

What's Coming in Kubernetes Storage

Kubernetes provides a way for containers in the pods to consume block or file storage. There’s also a COSI sub-project in SIG Storage that is trying to add object storage support in Kubernetes. In this session, Xing will talk about some features that SIG Storage is currently developing and designing, and highlight a few items that the Data Protection WG has been working on.

Nov 22, 2021

Deploying Cassandra to Multiple Kubernetes Clusters

Over the last few months, the K8ssandra team has been talking about building a new operator for K8ssandra. The first release of that work has officially arrived! We’re not at the finish line just yet, but we’ve hit the first major milestone: making it easier than ever to run Apache Cassandra® across multiple Kubernetes (K8s) clusters in multiple regions.

Nov 17, 2021

Principles for building Kubernetes Operators

The automation of data services on Kubernetes is enjoying increasing popularity. Often engineers are surprised by the complexity when writing their first operator. In this talk the distilled experience collected from years of automating several data services is presented as a collection of principles. These principles will be presented with vivid examples using PostgreSQL as an example. Learn from the PostgreSQL operator example which is being developed in conjunction with Kubernetes end-users. See how principles guide the automation while it is the end-user’s requirements leading to the prioritization of use cases to be automated next.

Nov 10, 2021

Macquarie Bank’s Journey to Running Databases on Kubernetes

Macquarie Bank migrated stateful workloads including databases to the cloud using Kubernetes. The talk goes over how they progressively matured automation while also going from self-managed Kubernetes on AWS to Google’s GKE. As early adopters of the beta version of StatefulSets, they discuss how it matured and how they added additional customizations and database awareness with kOps, Helm charts, and operators. They also discuss backup/restore, secure config management, and a roadmap for the future.