Useful tools and platforms for Data Management

To be part of an assembly

• Authentik is a central authority provider.

Docker and Kubernetes installations

• Keycloak, Open Source Identity and Access Management

Docker and Kubernetes installations

• Authelia, an open-source authentication and authorization server

Docker and Kubernetes installations

• MinIO, a S3 compatible high performance object store

Containerization via PodMan, not production.

• Apache Spark, engine for large-scale analytics

A commonly used engine for storing and analysing Scientific data.

Kubernetes installations

• RDF, “The Resource Description Framework (RDF) is a general framework for representing interconnected data on the web”

As extra of a solution or an assembly

• Heimdall is a web-application that provide a dashboard on other web-applications

Docker installation

• GreyLog, centralized log management application

Docker and docker-compose installations

• Grafana, Grafana is a multi-platform open source analytics and interactive visualization web application. It can produce charts, graphs, and alerts for the web when connected to supported data sources (wikipedia)

With installation with docker, docker-compose, kubernetes and helm charts

For tutorials

Documentations systems

• JupyterLab, “web-based interactive development environment for notebooks, code, and data”

Installation of Jupyter Hub (multi-user) on Kubernetes

• Collab is a Google-hosted Jupyter Notebook service, useful for online tutorials

• WebTop, “Alpine, Ubuntu, Fedora, and Arch based containers containing full desktop environments in officially supported flavors accessible via any modern web browser.”

  • Docker and docker-compose installations

• Quarto, used for this website, “An open-source scientific and technical publishing system”

  • Available as standalone, but also as extension for text editors and github action for rendering GitHub pages