Rémy Schumm blog ingénieur

📡 Tech Radar 2024

publiziert am 01. 01. 2024 um 09:00

CLI

https://cobra.dev - Go - CLI Framework in Go

https://picocli.info - Java - Picocli is a modern framework for building powerful, user-friendly, GraalVM-enabled command line apps with ease.

https://www.jbang.dev/documentation/guide/latest/index.html - Java - JBang is a Java-based scripting tool that makes it easy to run Java code as a script or a single file.

Java Backend

https://quarkus.io - Quarkus is a Kubernetes Native Java stack tailored for OpenJDK HotSpot and GraalVM, crafted from the best of breed Java libraries and standards. It is a perfect fit for microservices architecture and cloud-native applications.

https://sparkjava.com - Spark - A micro framework for creating web applications in Java 8 with minimal effort. - Minimal, Blueprints for Schumm Find etc.

- Javalin is a simple web framework for Java and Kotlin - probably the successor of SparkJava. <https://micronaut.io> - Micronaut is a modern, JVM-based, full-stack framework for building modular, easily testable microservice and serverless applications. <https://helidon.io> - Helidon is a collection of Java libraries for writing microservices that run on a fast web core powered by Netty. (Oracle) ## GUI <https://htmx.org> - the sucessor of <https://intercoolerjs.org> - Build stuff directly in HTML, using attributes, so you can build modern web applications with no JavaScript. My favorite blueprint, used for Schumm Find. <https://github.com/apache/freemarker> - classic <https://quarkus.io/guides/qute> <https://vuejs.org/> - Vue3 <https://tailwindcss.com/> - Tailwind CSS commercial <https://de.wikipedia.org/wiki/Lightweight_Java_Game_Library> - LWJGL - Lightweight Java Game Library - Basis von Minecraft ## Static Site Generators <https://gohugo.io/> used for [Sobrado Panoramix](https://panoramix.sobrado.ch/docs/datenschutz/datenschutzerklarung/) with the template <https://themes.gohugo.io/themes/hugo-book/> - Hugo is one of the most popular open-source static site generators. With its amazing speed and flexibility, Hugo makes building websites fun again. <https://jekyllrb.com> - used for this site - Jekyll is a simple, blog-aware, static site generator perfect for personal, project, or organization sites. Think of it like a file-based CMS, without all the complexity. - Github Pages <https://docs.antora.org/antora/2.3/> - Antora is a modular static site generator designed for creating documentation sites from AsciiDoc content. <https://squidfunk.github.io/mkdocs-material/setup/setting-up-site-search/> - MkDocs ## Output / Rendering: <https://flourish.studio/> - Flourish is a powerful platform for data visualisation and storytelling. (commercial, eawag) <https://www.babylonjs.com> - Babylon.js is one of the world's leading WebGL-based graphics engines. From a new visual scene inspector, best-in-class physically-based rendering, countless performance optimizations, and much more, Babylon.js brings powerful, beautiful, simple, and open 3D to everyone on the web. <https://d3js.org> - der Standart, aber schwierig. <https://threejs.org/manual/#en/fundamentals> - 3D Web <https://www.jfree.org/jfreechart/> - JFreeChart is a free 100% Java chart library that makes it easy for developers to display professional quality charts in their applications. <https://github.com/apache/pdfbox> - Apache PDFBox is an open-source Java tool for working with PDF documents. This project allows creation of new PDF documents, manipulation of existing documents and the ability to extract content from documents. Apache PDFBox also includes several command-line utilities. Apache PDFBox is published under the Apache License v2.0. <https://knowm.org/open-source/xchart/> - XChart is a light-weight and convenient library for plotting data designed to go from data to chart in the least amount of time possible and to take the guess-work out of customizing the chart style. <https://xmlgraphics.apache.org/fop/> - Apache FOP (Formatting Objects Processor) is a print formatter driven by XSL formatting objects (XSL-FO) and an output independent formatter. It is a Java application that reads a formatting object (FO) tree and renders the resulting pages to a specified output. - Good old Friend. <https://doppio.sh> - HTML to PDF <https://superset.apache.org> - Apache Superset is a modern, enterprise-ready business intelligence web application. ### Document generation <https://pandoc.org/> - My favorite tool for document generation. <https://weasyprint.org> - recommended by the makers of wkhtmltopdf - WeasyPrint is a visual rendering engine for HTML and CSS that can export to PDF. It aims to support web standards for printing. WeasyPrint is free software made available under a BSD license. - Python <https://itextpdf.com> - iText 7 is a powerful, flexible, and developer-friendly PDF library for Java, .NET, and Android. <https://poi.apache.org/> - Apache POI - the Java API for Microsoft Documents ## Business Process <https://airflow.apache.org> - Apache Airflow is a platform to programmatically author, schedule and monitor workflows. Use airflow to author workflows as directed acyclic graphs (DAGs) of tasks. The airflow scheduler executes your tasks on an array of workers while following the specified dependencies. Rich command line utilities make performing complex surgeries on DAGs a snap. The rich user interface makes it easy to visualize pipelines running in production, monitor progress, and troubleshoot issues when needed. When workflows are defined as code, they become more maintainable, versionable, testable, and collaborative. <https://flowable.com> - Flowable is a light-weight business process engine written in Java. The Flowable project provides a core set of open source business process engines that are compact and highly efficient. They provide a workflow and Business Process Management (BPM) solution that is easily integrated into corporate applications. KIE Tools - Red Hat - [Drools rule engine](https://www.drools.org/) - [OptaPlanner constraint solver](https://www.optaplanner.org/) <https://www.optaplanner.org/> - [jBPM workflow engine](https://www.jbpm.org/) - <https://kogito.kie.org/> <https://blog.kie.org/2021/09/developing-business-processes-more-efficiently-with-runtime-tools-quarkus-extension-part-1.html> - KIE Business Intelligence with Quarkus: <https://blog.kie.org/2021/04/dashbuilder-an-apache-licensed-business-reporting-and-monitoring-tool.html> - Dashboard Builder for Business Reporting and Monitoring ## Constraint and Simulation <https://www.simul8.com> (pero) - SIMUL8 is a powerful, visual process simulation tool for modeling business improvement ideas and testing them in a risk free environment. <https://www.optaplanner.org> - OptaPlanner is an AI constraint solver. It optimizes business resource usage. OptaPlanner optimizes such planning problems to do more business with less resources. Use cases include Vehicle Routing, Employee Rostering, Job Scheduling, Bin Packing and many more. # 📈 DB <https://debezium.io> - Change Data Capture for Databases <https://ongres.com/> - PostgreSQL Distro used by vshn <https://www.arangodb.com> - Multi-Model Database <https://duckdb.org> - DuckDB is an embeddable SQL OLAP Database Management System. <https://jmespath.org/> - JMESPath is a query language for JSON. JMESPath allows you to transform, filter, and extract data from JSON documents. <https://www.mysql.com/de/products/workbench/> <https://dbgate.org/> - DBGate is a modern database management tool for Windows, Linux and Mac OS X. <https://www.cockroachlabs.com/product/> - Küchenschabe - kriegt man nicht weg. PostgreSQL Treiber <https://www.doctrine-project.org/index.html> - ORM PHP <http://couchdb.apache.org/> - CouchDB is a database that uses JSON for documents, JavaScript for MapReduce indexes, and regular HTTP for its API. <https://www.couchbase.com/> - Couchbase Server is an open source, distributed, NoSQL document-oriented engagement database. It exposes a fast key-value store with managed cache for submillisecond data operations, purpose-built indexers for fast queries and a query engine for executing SQL queries. <https://www.postgresql.org/docs/13/datatype-json.html> - jsonb with index capabilities CRDTs (conflict-free replicated data types) are a data structure that is designed for resolving concurrent changes in collaborative applications (like Google Docs). Here's a good interactive [tutorial](https://jakelazaroff.com/words/an-interactive-intro-to-crdts/) and a [project](https://jakelazaroff.com/words/building-a-collaborative-pixel-art-editor-with-crdts/): building a collaborative pixel editor. ## Data Analysis and BI, Lake, Warehouse <https://jupyter.org> - der Klassiker <https://spark.apache.org/> - Apache Spark is a unified analytics engine for large-scale data processing. - Apache Spark Hallo Welt - Motivation: <https://www.golem.de/news/anzeige-einstieg-ins-data-engineering-mit-apache-spark-2109-159765.html> - Artikel: <https://www.informatik-aktuell.de/entwicklung/methoden/einfuehrung-in-spark-ein-text-mining-projekt.html> <https://nifi.apache.org/> - (Martin) Apache NiFi is a powerful, easy to use, and reliable system to process and distribute data. <https://superset.apache.org> - Apache Superset is a modern, enterprise-ready business intelligence web application. <https://zeppelin.apache.org> - (Martin) Apache Zeppelin is a web-based notebook that enables data-driven, interactive data analytics and collaborative documents with SQL, Scala and more. <https://airflow.apache.org> - (Martin) Apache Airflow is a platform to programmatically author, schedule and monitor workflows. <https://www.databricks.com/product/data-lakehouse> - Data Lakehouse ## Graph DB <https://neo4j.com/> - Neo4j is a graph database management system developed by Neo4j, Inc. Described by its developers as an ACID-compliant transactional database with native graph storage and processing. ## Object Storage <https://wiki.openstack.org/wiki/Swift> <https://docs.ceph.com/en/latest/radosgw/s3/> - Ceph Object Storage <https://min.io/> # 🌍 GIS <https://postgis.net> - PostGIS 🥰 <https://leafletjs.com> - used for <https://schumm.ch/find> - Leaflet is the leading open-source JavaScript library for mobile-friendly interactive maps. <https://www.qgis.org/de/site/about/index.html> - QGIS is a user-friendly open-source Geographic Information System (GIS) licensed under the GNU General Public License. QGIS is an official project of the Open Source Geospatial Foundation (OSGeo). # 🤖 Artifical Intelligence ## LLM <https://huggingface.co/> - Models as in Hugging Face – The AI community building the future. <https://huggingface.co/transformers/> - Hugging Face is an AI research organization that provides state-of-the-art NLP technologies. <https://lmstudio.ai/> - 👾 LM Studio - Discover and run LLMs locally <https://python.langchain.com/docs/get_started/introduction> - Introduction 🦜️🔗 Langchain LangChain is a framework for developing applications powered by language models. <https://python.langchain.com/docs/templates> - Templates 🦜️🔗 Langchain , Quickstart 🦜️🔗 Langchain , Introduction 🦜️🔗 Langchain <https://github.com/langchain4j/langchain4j?tab=readme-ov-file> - Langchain4j 🦜️🔗 Langchain for Java <https://langstream.ai/> - LangStream: an Event-Driven Developer Platform for LLM Apps Create pipelines that automatically create and update embeddings in your vector database for unstructured data (PDFs, Word documents, HTML) using proprietary and open-source embeddings models. <https://unstructured.io> - We get your data LLM-ready <https://www.pinecone.io/> - The vector database to build knowledgeable AI Pinecone <https://cassandra.apache.org/_/index.html> - Apache Cassandra Apache Cassandra Documentation <https://microsoft.github.io/autogen/> - AutoGen AutoGen Multi-Agent conversation framework btw: <https://github.com/AugustDev/enchanted> - iOS App ## Linguistics for Knowledge Library <https://www.thoughtspot.com/> - ThoughtSpot is a search and AI-driven analytics platform that enables anyone to get answers from their company data in seconds. Neuronal Search <https://github.com/jina-ai/jina> <https://jina.ai> - Jina is an open-source neural search framework that empowers anyone to build SOTA and scalable deep learning search applications. <https://tika.apache.org> Content Analytics # 🌤️ Cloud 🗺️ <https://landscape.cncf.io/> - Cloud Native Computing Foundation ## 📦 Docker etc. <https://podman-desktop.io/> - (Martin) Podman / RedHat <https://rancherdesktop.io> - inkl. k3s, SuSE <https://cri-o.io> - CRI-O is an implementation of the Kubernetes CRI (Container Runtime Interface) to enable using OCI (Open Container Initiative) compatible runtimes. ## ⚓️ Kubernetes, Docker etc. etc. <https://k9scli.io/> - Kubernetes CLI To Manage Your Clusters In Style! <https://k3s.io/> - Lightweight Kubernetes for Raspberry Pi and pm4 by [Rancher](https://rancher.com/) <https://minikube.sigs.k8s.io/docs/> - Minikube is a tool that makes it easy to run Kubernetes locally. Minikube runs a single-node Kubernetes cluster inside a VM on your laptop for users looking to try out Kubernetes or develop with it day-to-day. <https://www.openshift.com/blog/whats-inside-openshift-4> <https://www.okd.io> <https://operatorhub.io/operator/cert-manager> <https://free-for.dev/#/> <https://www.systeminit.com> - SystemInit is a Kubernetes-native CI/CD platform that automates the deployment of your applications to your Kubernetes clusters. <https://www.heise.de/news/Service-Mesh-Kong-Mesh-rotiert-den-Zugriff-auf-Zertifizierungsstellen-6175959.html> <https://www.vcluster.com/> - vcluster is a Kubernetes Virtual Cluster for local development. It allows you to create a virtual cluster with a single command and use it like a real cluster. vcluster runs inside a container and does not require root privileges. It is built on top of k3s and k3c. Virtual clusters have their own API server which makes them much more powerful and better isolated than namespaces, but they are also much cheaper than creating separate "real" Kubernetes clusters. ## 🏗️ Build and Deploy, DevOps, GitOps <https://argoproj.github.io/cd/> - (Stud Raiffeisen, VSHN) - Argo CD is a declarative, GitOps continuous delivery tool for Kubernetes. <https://github.com/GoogleContainerTools/jib> - Jib builds optimized Docker and OCI images for your Java applications without a Docker daemon - and without deep mastery of Docker best-practices. <https://fleet.rancher.io> - Fleet is a GitOps engine for Kubernetes. It allows you to declare your desired state in a Git repository and automatically applies changes to your Kubernetes clusters. - Standart in pm4 <https://helm.sh> - Helm Kubernetes Package Manager <https://tekton.dev/> - Tekton is a powerful yet flexible Kubernetes-native open-source framework for creating continuous integration and delivery (CI/CD) systems. <https://www.harpoon.io> - Harpoon is a Kubernetes-native CI/CD platform that automates the deployment of your applications to your Kubernetes clusters. ## 🔧 Configuration, Infra Deployment <https://www.pulumi.com> - mach - Pulumi is an open source infrastructure as code tool that allows you to create, deploy, and manage cloud infrastructure using your favorite language. <https://nixos.org/> - Declarative builds and deployments <https://www.ansible.com/> - Ansible - Classic <https://pkl-lang.org/index.html> - 🥒 PKL is a configuration language for Kubernetes and other cloud native platforms. Apple. ## 🔭 Observation <https://opentelemetry.io/> - OpenTelemetry provides a single set of APIs, libraries, agents, and collector services to capture distributed traces and metrics from your application. <https://micrometer.io/> - Micrometer is a dimensional-first metrics collection facade whose aim is to allow you to time, count, and gauge your code with a vendor neutral API. <https://adambien.blog/roller/abien/entry/microprofile_metrics_micrometer_and_quarkus> <https://prometheus.io/> <https://grafana.com/oss/tempo/> <https://micrometer.io> - Micrometer is a dimensional-first metrics collection facade whose aim is to allow you to time, count, and gauge your code with a vendor neutral API. <https://github.com/kubeshark/kubeshark> - Kubeshark is a Kubernetes-native observability tool that provides real-time visibility into the performance of your applications. ### Datamesh, Tracing etc. <https://istio.io/latest/blog/2022/introducing-ambient-mesh/> - Ambient Mesh - lightweight Istio <https://kiali.io> - Kiali is a management console for Istio-based service mesh. <https://www.jaegertracing.io> - Jaeger, a Distributed Tracing System <https://ebpf.io> - Dynamically program the kernel for efficient networking, observability, tracing, and security <https://cilium.io/> - eBPF-based Networking, Observability, Security <https://www.dynatrace.de/> - Dynatrace (commercial) <https://linkerd.io/> - Linkerd is a service mesh for Kubernetes and other frameworks, giving you observability, reliability, and security without requiring any changes to your code. ### Uptime Monitors <https://upptime.js.org/docs/faq> Funny Monitor operated by GithubActions and Issues <https://www.statuspal.io/pricing> commercial, expensive, used by vshn ### Log Agents and Frontends <https://docs.fluentbit.io/manual/installation/kubernetes> <https://vector.dev/docs/setup/deployment/topologies/> - Vector is a high-performance observability data router that you can deploy in your infrastructure to collect, transform, and route logs, metrics, and traces. <https://logz.io/> - Logz.io is a cloud-native observability platform that enables engineers to use the best open source tools in the market without the complexity of operating, managing, and scaling them. <https://www.parseable.com> - Kleines Projekt mit persönlichem Kontakt <https://grafana.com/oss/loki/> - Loki is a horizontally-scalable, highly-available, multi-tenant log aggregation system inspired by Prometheus. ## 🪙 FinOps <https://blog.kubecost.com/blog/introducing-kubecost-2.0/> - Kubecost is a Kubernetes cost allocation, chargeback, and capacity management tool. <https://www.kubecost.com/> - Kubecost is a Kubernetes cost allocation, chargeback, and capacity management tool. <https://www.opencost.io/> - OpenCost is a Kubernetes cost allocation, chargeback, and capacity management tool. ## 🚦 ⌥ Reverse Proxy, Gateway and other Patterns <https://www.krakend.io/> - KrakenD is a stateless, distributed, high-performance API Gateway that helps you effortlessly adopt microservices. For tranform, mapping, protocol translation, authehtication, rate limiting etc. <https://traefik.io/traefik/> - Traefik is a modern HTTP reverse proxy and load balancer that makes deploying microservices easy. - Standart in k3s <https://doc.traefik.io/traefik/https/acme/> - Traefik ACME - Let's Encrypt <https://www.haproxy.org/> - default in OpenShift # 👮‍♂️ Tools Security General: <https://attack.mitre.org/> - main attack overview Blogs: <https://ahead.feedly.com/posts/introduction-to-mitre-attack-featuring-version-12-2022> <https://falco.org/> - Threat detection blog: <https://www.ti8m.com/blog/Falco.html> - von Marc Merzinger <https://www.tigera.io/project-calico/> - Calico is an open-source networking and network security solution for containers, virtual machines, and native host-based workloads. <https://docs.tigera.io/calico/latest/about> <https://www.splunk.com/> ## BOM Analysis: <https://github.com/openclarity/kubeclarity?tab=readme-ov-file> - (bamc) Kubeclarity - Kubernetes Security Scanner <https://docs.dependencytrack.org> # 📐 Architecture ## Patterns <https://martinfowler.com> - Antwort auf alles. - Martin Fowler's Blog <https://learn.microsoft.com/en-us/azure/architecture/patterns/> - wonderful overview of patterns by Microsoft <https://microservices.io/tags/pattern> - Microservices.io is a community site that publishes patterns and practices for microservices architecture. - Алексей Espeically interesting: - [Strangler Fig](https://martinfowler.com/bliki/StranglerFigApplication.html) - Strangler Fig Application - [Saga Data Integration](https://microservices.io/patterns/data/saga.html) - Saga Data Integration - [Shared Database](https://microservices.io/patterns/data/shared-database.html) - Shared Database - [Follower Reads](https://martinfowler.com/articles/patterns-of-distributed-systems/follower-reads.html) - Follower Reads <https://resilience4j.readme.io> - Resilience4j is a lightweight fault tolerance library inspired by Netflix Hystrix, but designed for functional programming. <https://raft.github.io> - Raft is a consensus algorithm ## Documentation Methology <https://www.arc42.de> - in allen von mir gecoachten Projekten benutzt - arc42 is a template for architecture documentation. It's based on experience and best practices and provides a structure for capturing all the important decisions and aspects of software architecture. <https://c4model.com/#Modelling> - C4 model - Context, Container, Component, Code Canvas: <https://canvas.arc42.org> - arc42 Canvas <https://techstackcanvas.io> - Tech Stack Canvas cf: <https://www.workingsoftware.dev/software-architecture-canvas/> - Software Architecture Canvas Blog <https://www.innoq.com/de/blog/2023/07/architecture-communication-canvas/> ## Model-Generation tools: <https://structurizr.com/> <https://icepanel.io/learn> Demo: <https://s.icepanel.io/vmHvBHr4BeMEOa/-/landscape/diagrams/viewer?diagram=TIG0mDLo38&model=a2rsbe4rj&tab=diagram&x1=-1632.5&y1=-317.1&x2=3153.3&y2=1687&object_tab=description> # 🔐 IAM, Secrets and other secret stuff <https://www.keycloak.org/> - Standart für OpenID Connect und OAuth 2.0 etc. [OpenFGA](https://openfga.dev) is an open-source authorization solution that allows developers to build granular access control using an easy-to-read modeling language and friendly APIs. RBAC etc OpenFGA takes the best ideas from Google's Zanzibar paper for Relationship-Based Access Control, and also solves problems for Role-based Access Control and Attribute-Based Access Control use cases. <https://openfga.dev/docs/modeling> - Modeling <https://auth0.com/blog/openfga-v10-a-new-milestone-in-cloud-native-authorization-systems/> <https://zitadel.com/opensource> <https://www.airlock.com/> von Ergon <https://www.futurae.com/> Gaetano Bude <https://www.simplecloud.info/> - Simple Cloud - Security and Compliance - System for Cross-domain Identity Management <https://docs.fortinet.com/product/fortiauthenticator/6.2> - FortiAuthenticator ## Secrets <https://www.vaultproject.io> - Vault is a tool for securely accessing secrets. <https://github.com/mozilla/sops> - SOPS is an editor of encrypted files that supports YAML, JSON, ENV, INI and BINARY formats and encrypts with AWS KMS, GCP KMS, Azure Key Vault and PGP. # 📆 Agile / Scrum Stuff <https://www.agilealliance.org/> <https://scrumguides.org/scrum-guide.html#purpose-of-the-scrum-guide> - The Scrum Stuff ## 👨‍👩‍👦‍👦 Tools for Collaboration <https://www.taiga.io> [Taiga Seed Estimation](https://community.taiga.io/t/5-different-methods-to-estimate-in-agile-part-ii/1129) - an approach for estimation based on past experience. Video: <https://www.youtube.com/watch?v=HLzp0dpbnH4> <https://ifuckinghatejira.com/43/> - why not Jira <https://www.pivotaltracker.com> (pero) <https://www.tuleap.org> <https://airfocus.com/> <https://www.figma.com> - GUI Prototyping <https://www.targetprocess.com/> - (von Исаёнок) Retro: <https://github.com/josephearl/awesome-retrospectives> <https://ideaboardz.com/> <https://rapport.leanloop.co.uk/> <https://pivotal.github.io/postfacto/> Strategy: <https://airfocus.com/> ## 📒 PKM <https://www.notion.so/> - <https://logseq.com> and <https://obsidian.md> - Personal Knowledge Management (PKM) Tools based on Graph Database <https://asana.com> - the gool old one. # 🕵️‍♂️ Tools Test and Code Forensics <https://testcontainers.com> - Unit tests with real dependencies <https://softvis3d.com> - (von bamc) SoftVis3D is a tool for visualizing software systems. It is a web-based 3D software visualization tool that visualizes the structure of a software system in a 3D environment. It is based on the concept of Software Cities, which visualizes the structure of a software system as a city. Tornhil: Your Code as a Crime Scene <https://pragprog.com/titles/atcrime/your-code-as-a-crime-scene/> <https://www.adamtornhill.com/> <https://codescene.com/> <https://next.github.com/projects/repo-visualization> <https://holub.com/heuristics/> <https://www.jug.ch/html/events/2021/tame_legacy_codebase.html> - Jug Vortrag 7 Tipps # 🖥️ Tools Unix <https://github.com/ibraheemdev/modern-unix> <https://jvns.ca/blog/2022/04/12/a-list-of-new-ish--command-line-tools/> # ⚖️ Legal <https://en.wikipedia.org/wiki/Source_code_escrow> # 🔌 API <https://stoplight.io/> - API Design and Documentation <https://www.apicur.io> - API Design and Documentation # Tools Infra <https://www.zerotier.com/> - ZeroTier is a smart Ethernet switch from fame. # Tools Backup <https://restic.readthedocs.io/en/stable/030_preparing_a_new_repo.html> - Restic is a modern backup program that can back up your files: ...is the base of vshn's <https://github.com/k8up-io/k8up>

Hinweis: dieser Blog wiederspiegelt meine persönliche Meinung und hat nichts mit meiner Anstellung als Dozent der zhaw noch mit anderen Anstellungen zu tun.

Rémy Schumm blog ingénieur

📡 Tech Radar 2024

Topics

📡 General Radars

💻 App

CLI

Java Backend