Rémy Schumm blog ingénieur

📡 Tech Radar 2024

publiziert am 01. 01. 2024 um 09:00

📡 Every Year on January 1st I open a blog post that will be updated throughout the year: this is my personal TechRadar whit Tools, Trends, Techniques and Platforms I stumble upon during the year 2023 and think are worth a look. It has no particular order, it has no rank nor is it complete. It is just a list of things I want to keep in mind. Every Januar I delete stuff that I lost interest and start over. This is the 2024 edition.

Topics

📡 General Radars

https://www.oreilly.com/radar/topics/radar-trends/ - Der Klassiker von O’Reilly

https://roadmap.sh - Roadmap.sh is a community effort to create roadmaps, guides and other educational content to help guide developers through their career.

💻 App

CLI

https://cobra.dev - Go - CLI Framework in Go

https://click.palletsprojects.com/en/8.1.x/ - Phython - Click - von Martin

https://picocli.info - Java - Picocli is a modern framework for building powerful, user-friendly, GraalVM-enabled command line apps with ease.

https://www.jbang.dev/documentation/guide/latest/index.html - Java - JBang is a Java-based scripting tool that makes it easy to run Java code as a script or a single file.

GUI

https://htmx.org - the sucessor of https://intercoolerjs.org

https://github.com/apache/freemarker - classic

https://quarkus.io/guides/qute

https://vuejs.org/ - Vue3
https://tailwindcss.com/ - Tailwind CSS commercial

https://de.wikipedia.org/wiki/Lightweight_Java_Game_Library - LWJGL - Lightweight Java Game Library - Basis von Minecraft

Static Site Generators

https://gohugo.io/ used for Sobrado Panoramix with the template https://themes.gohugo.io/themes/hugo-book/ - Hugo is one of the most popular open-source static site generators. With its amazing speed and flexibility, Hugo makes building websites fun again.

https://jekyllrb.com - used for this site - Jekyll is a simple, blog-aware, static site generator perfect for personal, project, or organization sites. Think of it like a file-based CMS, without all the complexity. - Github Pages

https://docs.antora.org/antora/2.3/ - Antora is a modular static site generator designed for creating documentation sites from AsciiDoc content.

https://squidfunk.github.io/mkdocs-material/setup/setting-up-site-search/ - MkDocs

Output / Rendering:

https://flourish.studio/ - Flourish is a powerful platform for data visualisation and storytelling. (commercial, eawag)

https://www.babylonjs.com - Babylon.js is one of the world’s leading WebGL-based graphics engines. From a new visual scene inspector, best-in-class physically-based rendering, countless performance optimizations, and much more, Babylon.js brings powerful, beautiful, simple, and open 3D to everyone on the web.

https://d3js.org - der Standart, aber schwierig.

https://threejs.org/manual/#en/fundamentals - 3D Web

https://www.jfree.org/jfreechart/ - JFreeChart is a free 100% Java chart library that makes it easy for developers to display professional quality charts in their applications.

https://github.com/apache/pdfbox - Apache PDFBox is an open-source Java tool for working with PDF documents. This project allows creation of new PDF documents, manipulation of existing documents and the ability to extract content from documents. Apache PDFBox also includes several command-line utilities. Apache PDFBox is published under the Apache License v2.0.

https://knowm.org/open-source/xchart/ - XChart is a light-weight and convenient library for plotting data designed to go from data to chart in the least amount of time possible and to take the guess-work out of customizing the chart style.

https://xmlgraphics.apache.org/fop/ - Apache FOP (Formatting Objects Processor) is a print formatter driven by XSL formatting objects (XSL-FO) and an output independent formatter. It is a Java application that reads a formatting object (FO) tree and renders the resulting pages to a specified output. - Good old Friend.

https://doppio.sh - HTML to PDF

https://superset.apache.org - Apache Superset is a modern, enterprise-ready business intelligence web application.

Document generation

https://pandoc.org/ - My favorite tool for document generation.

https://weasyprint.org - recommended by the makers of wkhtmltopdf - WeasyPrint is a visual rendering engine for HTML and CSS that can export to PDF. It aims to support web standards for printing. WeasyPrint is free software made available under a BSD license. - Python

https://itextpdf.com - iText 7 is a powerful, flexible, and developer-friendly PDF library for Java, .NET, and Android.

https://poi.apache.org/ - Apache POI - the Java API for Microsoft Documents

Business Process

https://airflow.apache.org - Apache Airflow is a platform to programmatically author, schedule and monitor workflows. Use airflow to author workflows as directed acyclic graphs (DAGs) of tasks. The airflow scheduler executes your tasks on an array of workers while following the specified dependencies. Rich command line utilities make performing complex surgeries on DAGs a snap. The rich user interface makes it easy to visualize pipelines running in production, monitor progress, and troubleshoot issues when needed. When workflows are defined as code, they become more maintainable, versionable, testable, and collaborative.

https://flowable.com - Flowable is a light-weight business process engine written in Java. The Flowable project provides a core set of open source business process engines that are compact and highly efficient. They provide a workflow and Business Process Management (BPM) solution that is easily integrated into corporate applications.

KIE Tools - Red Hat

https://blog.kie.org/2021/09/developing-business-processes-more-efficiently-with-runtime-tools-quarkus-extension-part-1.html - KIE Business Intelligence with Quarkus: 

https://blog.kie.org/2021/04/dashbuilder-an-apache-licensed-business-reporting-and-monitoring-tool.html - Dashboard Builder for Business Reporting and Monitoring

Constraint and Simulation

https://www.simul8.com (pero) - SIMUL8 is a powerful, visual process simulation tool for modeling business improvement ideas and testing them in a risk free environment.

https://www.optaplanner.org - OptaPlanner is an AI constraint solver. It optimizes business resource usage. OptaPlanner optimizes such planning problems to do more business with less resources. Use cases include Vehicle Routing, Employee Rostering, Job Scheduling, Bin Packing and many more.

📈 DB

https://debezium.io - Change Data Capture for Databases

https://ongres.com/ - PostgreSQL Distro used by vshn

https://www.arangodb.com - Multi-Model Database

https://duckdb.org - DuckDB is an embeddable SQL OLAP Database Management System.

https://jmespath.org/ - JMESPath is a query language for JSON. JMESPath allows you to transform, filter, and extract data from JSON documents.

https://www.mysql.com/de/products/workbench/

https://dbgate.org/ - DBGate is a modern database management tool for Windows, Linux and Mac OS X.

https://www.cockroachlabs.com/product/ - Küchenschabe - kriegt man nicht weg. PostgreSQL Treiber

https://www.doctrine-project.org/index.html - ORM PHP

http://couchdb.apache.org/ - CouchDB is a database that uses JSON for documents, JavaScript for MapReduce indexes, and regular HTTP for its API.

https://www.couchbase.com/ - Couchbase Server is an open source, distributed, NoSQL document-oriented engagement database. It exposes a fast key-value store with managed cache for submillisecond data operations, purpose-built indexers for fast queries and a query engine for executing SQL queries.

https://www.postgresql.org/docs/13/datatype-json.html - jsonb with index capabilities

CRDTs (conflict-free replicated data types) are a data structure that is designed for resolving concurrent changes in collaborative applications (like Google Docs). Here’s a good interactive tutorial and a project: building a collaborative pixel editor.

Data Analysis and BI, Lake, Warehouse

https://jupyter.org - der Klassiker

https://spark.apache.org/ - Apache Spark is a unified analytics engine for large-scale data processing.

https://nifi.apache.org/ - (Martin) Apache NiFi is a powerful, easy to use, and reliable system to process and distribute data.

https://superset.apache.org - Apache Superset is a modern, enterprise-ready business intelligence web application.

https://zeppelin.apache.org - (Martin) Apache Zeppelin is a web-based notebook that enables data-driven, interactive data analytics and collaborative documents with SQL, Scala and more.

https://airflow.apache.org - (Martin) Apache Airflow is a platform to programmatically author, schedule and monitor workflows.

https://www.databricks.com/product/data-lakehouse - Data Lakehouse

Graph DB

https://neo4j.com/ - Neo4j is a graph database management system developed by Neo4j, Inc. Described by its developers as an ACID-compliant transactional database with native graph storage and processing.

Object Storage

https://wiki.openstack.org/wiki/Swift

https://docs.ceph.com/en/latest/radosgw/s3/ - Ceph Object Storage

https://min.io/

🌍 GIS

https://postgis.net - PostGIS 🥰

https://leafletjs.com - used for https://schumm.ch/find - Leaflet is the leading open-source JavaScript library for mobile-friendly interactive maps.

https://www.qgis.org/de/site/about/index.html - QGIS is a user-friendly open-source Geographic Information System (GIS) licensed under the GNU General Public License. QGIS is an official project of the Open Source Geospatial Foundation (OSGeo).

🤖 Artifical Intelligence

LLM

https://huggingface.co/ - Models as in Hugging Face – The AI community building the future.

https://huggingface.co/transformers/ - Hugging Face is an AI research organization that provides state-of-the-art NLP technologies.

https://lmstudio.ai/ - 👾 LM Studio - Discover and run LLMs locally

https://python.langchain.com/docs/get_started/introduction - Introduction 🦜️🔗 Langchain LangChain is a framework for developing applications powered by language models.

https://python.langchain.com/docs/templates - Templates 🦜️🔗 Langchain , Quickstart 🦜️🔗 Langchain , Introduction 🦜️🔗 Langchain

https://github.com/langchain4j/langchain4j?tab=readme-ov-file - Langchain4j 🦜️🔗 Langchain for Java

https://langstream.ai/ - LangStream: an Event-Driven Developer Platform for LLM Apps Create pipelines that automatically create and update embeddings in your vector database for unstructured data (PDFs, Word documents, HTML) using proprietary and open-source embeddings models.

https://unstructured.io - We get your data LLM-ready

https://www.pinecone.io/ - The vector database to build knowledgeable AI Pinecone

https://cassandra.apache.org/_/index.html - Apache Cassandra Apache Cassandra Documentation

https://microsoft.github.io/autogen/ - AutoGen AutoGen Multi-Agent conversation framework

btw:

https://github.com/AugustDev/enchanted - iOS App

Linguistics for Knowledge Library

https://www.thoughtspot.com/ - ThoughtSpot is a search and AI-driven analytics platform that enables anyone to get answers from their company data in seconds.

Neuronal Search

https://github.com/jina-ai/jina

https://jina.ai - Jina is an open-source neural search framework that empowers anyone to build SOTA and scalable deep learning search applications.

https://tika.apache.org Content Analytics

🌤️ Cloud

🗺️ https://landscape.cncf.io/ - Cloud Native Computing Foundation

📦 Docker etc.

https://podman-desktop.io/ - (Martin) Podman / RedHat

https://rancherdesktop.io - inkl. k3s, SuSE

https://cri-o.io - CRI-O is an implementation of the Kubernetes CRI (Container Runtime Interface) to enable using OCI (Open Container Initiative) compatible runtimes.

⚓️ Kubernetes, Docker etc. etc.

https://k9scli.io/ - Kubernetes CLI To Manage Your Clusters In Style!

https://k3s.io/ - Lightweight Kubernetes for Raspberry Pi and pm4 by Rancher

https://minikube.sigs.k8s.io/docs/ - Minikube is a tool that makes it easy to run Kubernetes locally. Minikube runs a single-node Kubernetes cluster inside a VM on your laptop for users looking to try out Kubernetes or develop with it day-to-day.

https://www.openshift.com/blog/whats-inside-openshift-4

https://www.okd.io

https://operatorhub.io/operator/cert-manager

https://free-for.dev/#/

https://www.systeminit.com - SystemInit is a Kubernetes-native CI/CD platform that automates the deployment of your applications to your Kubernetes clusters.

https://www.heise.de/news/Service-Mesh-Kong-Mesh-rotiert-den-Zugriff-auf-Zertifizierungsstellen-6175959.html

https://www.vcluster.com/ - vcluster is a Kubernetes Virtual Cluster for local development. It allows you to create a virtual cluster with a single command and use it like a real cluster. vcluster runs inside a container and does not require root privileges. It is built on top of k3s and k3c. Virtual clusters have their own API server which makes them much more powerful and better isolated than namespaces, but they are also much cheaper than creating separate “real” Kubernetes clusters.

🏗️ Build and Deploy, DevOps, GitOps

https://argoproj.github.io/cd/ - (Stud Raiffeisen, VSHN) - Argo CD is a declarative, GitOps continuous delivery tool for Kubernetes.

https://github.com/GoogleContainerTools/jib - Jib builds optimized Docker and OCI images for your Java applications without a Docker daemon - and without deep mastery of Docker best-practices.

https://fleet.rancher.io - Fleet is a GitOps engine for Kubernetes. It allows you to declare your desired state in a Git repository and automatically applies changes to your Kubernetes clusters. - Standart in pm4

https://helm.sh - Helm Kubernetes Package Manager

https://tekton.dev/ - Tekton is a powerful yet flexible Kubernetes-native open-source framework for creating continuous integration and delivery (CI/CD) systems.

https://www.harpoon.io - Harpoon is a Kubernetes-native CI/CD platform that automates the deployment of your applications to your Kubernetes clusters.

🔧 Configuration, Infra Deployment

https://www.pulumi.com - mach - Pulumi is an open source infrastructure as code tool that allows you to create, deploy, and manage cloud infrastructure using your favorite language.

https://nixos.org/ - Declarative builds and deployments

https://www.ansible.com/ - Ansible - Classic

https://pkl-lang.org/index.html - 🥒 PKL is a configuration language for Kubernetes and other cloud native platforms. Apple.

🔭 Observation

https://opentelemetry.io/ - OpenTelemetry provides a single set of APIs, libraries, agents, and collector services to capture distributed traces and metrics from your application.

https://micrometer.io/ - Micrometer is a dimensional-first metrics collection facade whose aim is to allow you to time, count, and gauge your code with a vendor neutral API.

https://adambien.blog/roller/abien/entry/microprofile_metrics_micrometer_and_quarkus

https://prometheus.io/

https://grafana.com/oss/tempo/

https://micrometer.io - Micrometer is a dimensional-first metrics collection facade whose aim is to allow you to time, count, and gauge your code with a vendor neutral API.

https://github.com/kubeshark/kubeshark - Kubeshark is a Kubernetes-native observability tool that provides real-time visibility into the performance of your applications.

Datamesh, Tracing etc.

https://istio.io/latest/blog/2022/introducing-ambient-mesh/ - Ambient Mesh - lightweight Istio

https://kiali.io - Kiali is a management console for Istio-based service mesh.

https://www.jaegertracing.io - Jaeger, a Distributed Tracing System

https://ebpf.io - Dynamically program the kernel for efficient networking, observability, tracing, and security

https://cilium.io/ - eBPF-based Networking, Observability, Security

https://www.dynatrace.de/ - Dynatrace (commercial)

https://linkerd.io/ - Linkerd is a service mesh for Kubernetes and other frameworks, giving you observability, reliability, and security without requiring any changes to your code.

Uptime Monitors

https://upptime.js.org/docs/faq Funny Monitor operated by GithubActions and Issues

https://www.statuspal.io/pricing commercial, expensive, used by vshn

Log Agents and Frontends

https://docs.fluentbit.io/manual/installation/kubernetes

https://vector.dev/docs/setup/deployment/topologies/ - Vector is a high-performance observability data router that you can deploy in your infrastructure to collect, transform, and route logs, metrics, and traces.

https://logz.io/ - Logz.io is a cloud-native observability platform that enables engineers to use the best open source tools in the market without the complexity of operating, managing, and scaling them.

https://www.parseable.com - Kleines Projekt mit persönlichem Kontakt

https://grafana.com/oss/loki/ - Loki is a horizontally-scalable, highly-available, multi-tenant log aggregation system inspired by Prometheus.

🪙 FinOps

https://blog.kubecost.com/blog/introducing-kubecost-2.0/ - Kubecost is a Kubernetes cost allocation, chargeback, and capacity management tool.

https://www.kubecost.com/ - Kubecost is a Kubernetes cost allocation, chargeback, and capacity management tool.

https://www.opencost.io/ - OpenCost is a Kubernetes cost allocation, chargeback, and capacity management tool.

🚦 ⌥ Reverse Proxy, Gateway and other Patterns

https://www.krakend.io/ - KrakenD is a stateless, distributed, high-performance API Gateway that helps you effortlessly adopt microservices. For tranform, mapping, protocol translation, authehtication, rate limiting etc.

https://traefik.io/traefik/ - Traefik is a modern HTTP reverse proxy and load balancer that makes deploying microservices easy. - Standart in k3s

https://doc.traefik.io/traefik/https/acme/ - Traefik ACME - Let’s Encrypt

https://www.haproxy.org/ - default in OpenShift

👮‍♂️ Tools Security

General:

https://attack.mitre.org/ - main attack overview

Blogs:

https://ahead.feedly.com/posts/introduction-to-mitre-attack-featuring-version-12-2022

https://falco.org/ - Threat detection blog: https://www.ti8m.com/blog/Falco.html - von Marc Merzinger

https://www.tigera.io/project-calico/ - Calico is an open-source networking and network security solution for containers, virtual machines, and native host-based workloads.
https://docs.tigera.io/calico/latest/about

https://www.splunk.com/

BOM Analysis:

https://github.com/openclarity/kubeclarity?tab=readme-ov-file - (bamc) Kubeclarity - Kubernetes Security Scanner

https://docs.dependencytrack.org

📐 Architecture

Patterns

https://martinfowler.com - Antwort auf alles. - Martin Fowler’s Blog

https://learn.microsoft.com/en-us/azure/architecture/patterns/ - wonderful overview of patterns by Microsoft

https://microservices.io/tags/pattern - Microservices.io is a community site that publishes patterns and practices for microservices architecture. - Алексей

Espeically interesting:

https://resilience4j.readme.io - Resilience4j is a lightweight fault tolerance library inspired by Netflix Hystrix, but designed for functional programming.

https://raft.github.io - Raft is a consensus algorithm

Documentation Methology

https://www.arc42.de - in allen von mir gecoachten Projekten benutzt - arc42 is a template for architecture documentation. It’s based on experience and best practices and provides a structure for capturing all the important decisions and aspects of software architecture.

https://c4model.com/#Modelling - C4 model - Context, Container, Component, Code

Canvas:

https://canvas.arc42.org - arc42 Canvas
https://techstackcanvas.io - Tech Stack Canvas

cf:
https://www.workingsoftware.dev/software-architecture-canvas/ - Software Architecture Canvas Blog
https://www.innoq.com/de/blog/2023/07/architecture-communication-canvas/

Model-Generation tools:

https://structurizr.com/

https://icepanel.io/learn

Demo: 

https://s.icepanel.io/vmHvBHr4BeMEOa/-/landscape/diagrams/viewer?diagram=TIG0mDLo38&model=a2rsbe4rj&tab=diagram&x1=-1632.5&y1=-317.1&x2=3153.3&y2=1687&object_tab=description

🔐 IAM, Secrets and other secret stuff

https://www.keycloak.org/ - Standart für OpenID Connect und OAuth 2.0 etc.

OpenFGA is an open-source authorization solution that allows developers to build granular access control using an easy-to-read modeling language and friendly APIs. RBAC etc OpenFGA takes the best ideas from Google’s Zanzibar paper for Relationship-Based Access Control, and also solves problems for Role-based Access Control and Attribute-Based Access Control use cases.
https://openfga.dev/docs/modeling - Modeling
https://auth0.com/blog/openfga-v10-a-new-milestone-in-cloud-native-authorization-systems/

https://zitadel.com/opensource

https://www.airlock.com/ von Ergon

https://www.futurae.com/ Gaetano Bude

https://www.simplecloud.info/ - Simple Cloud - Security and Compliance - System for Cross-domain Identity Management

https://docs.fortinet.com/product/fortiauthenticator/6.2 - FortiAuthenticator

Secrets

https://www.vaultproject.io - Vault is a tool for securely accessing secrets.

https://github.com/mozilla/sops - SOPS is an editor of encrypted files that supports YAML, JSON, ENV, INI and BINARY formats and encrypts with AWS KMS, GCP KMS, Azure Key Vault and PGP.

📆 Agile / Scrum Stuff

https://www.agilealliance.org/

https://scrumguides.org/scrum-guide.html#purpose-of-the-scrum-guide - The Scrum Stuff

👨‍👩‍👦‍👦 Tools for Collaboration

https://www.taiga.io

Taiga Seed Estimation - an approach for estimation based on past experience. Video: https://www.youtube.com/watch?v=HLzp0dpbnH4

https://ifuckinghatejira.com/43/ - why not Jira

https://www.pivotaltracker.com (pero)

https://www.tuleap.org

https://airfocus.com/

https://www.figma.com - GUI Prototyping

https://www.targetprocess.com/ - (von Исаёнок)

Retro:

https://github.com/josephearl/awesome-retrospectives

https://ideaboardz.com/

https://rapport.leanloop.co.uk/

https://pivotal.github.io/postfacto/

Strategy:

https://airfocus.com/

📒 PKM

https://www.notion.so/ -

https://logseq.com and https://obsidian.md - Personal Knowledge Management (PKM) Tools based on Graph Database

https://asana.com - the gool old one.

🕵️‍♂️ Tools Test and Code Forensics

https://testcontainers.com - Unit tests with real dependencies

https://softvis3d.com - (von bamc) SoftVis3D is a tool for visualizing software systems. It is a web-based 3D software visualization tool that visualizes the structure of a software system in a 3D environment. It is based on the concept of Software Cities, which visualizes the structure of a software system as a city.

Tornhil: Your Code as a Crime Scene https://pragprog.com/titles/atcrime/your-code-as-a-crime-scene/

https://www.adamtornhill.com/

https://codescene.com/

https://next.github.com/projects/repo-visualization

https://holub.com/heuristics/

https://www.jug.ch/html/events/2021/tame_legacy_codebase.html - Jug Vortrag 7 Tipps

🖥️ Tools Unix

https://github.com/ibraheemdev/modern-unix

https://jvns.ca/blog/2022/04/12/a-list-of-new-ish--command-line-tools/

⚖️ Legal

https://en.wikipedia.org/wiki/Source_code_escrow

🔌 API

https://stoplight.io/ - API Design and Documentation

https://www.apicur.io - API Design and Documentation

Tools Infra

https://www.zerotier.com/ - ZeroTier is a smart Ethernet switch from fame.

Tools Backup

https://restic.readthedocs.io/en/stable/030_preparing_a_new_repo.html - Restic is a modern backup program that can back up your files:

…is the base of

vshn’s https://github.com/k8up-io/k8up

Hinweis: dieser Blog wiederspiegelt meine persönliche Meinung und hat nichts mit meiner Anstellung als Dozent der zhaw noch mit anderen Anstellungen zu tun.


zurück zum Seitenanfang