Pieter Humphrey4 articles
K8ssandra: Production-Ready Platform for Running Apache Cassandra on Kubernetes
K8ssandra aims to provide a “production-ready platform”, and this includes automation for operational tasks such as repairs, backups, and monitoring.
Best Practices for Data Pipeline Error Handling in Apache NiFi
We have tools such as Apache NiFi, which allow us to design and manage our data pipelines, reducing the amount of custom programming and increasing overall efficiency.
Yet, when it comes to creating them, a key and often neglected aspect is minimizing potential errors.
Although many factors influence a NiFi data pipeline, three important ones are: understanding the nature of your data sources and targets, minimizing maintenance, and following best practices.