Posts for: #self-hosted

Netdata Unveils Version v1.44.0 of Monitoring System

Netdata, a popular monitoring system, has released version v1.44.0 with several exciting new features and improvements. This release further solidifies Netdata’s position as a leading monitoring solution for servers, Linux, DevOps, and home labs.

One of the major highlights of this release is the significant improvement in performance, surpassing even Prometheus, a well-known monitoring system. Netdata now includes a new streaming protocol called SLOTS, which allows for more efficient metric streaming between children and parents. This reduces overhead on parents by about 30% without impacting the children. Additionally, Netdata now supports multiple compression algorithms, including ZSTD, GZIP, and BROTLI, with ZSTD being the default choice for its balance between compression ratio and CPU consumption.

Another major addition is the introduction of Gorilla compression, a time series data compression technique developed by Facebook for their time series database. When enabled, Gorilla compression provides a 30% reduction in memory usage for Netdata, making it even more efficient compared to Prometheus.

Netdata now also has improved support for handling large systemd-journal databases, making it more capable of dealing with huge log volumes. The systemd-journal.plugin has been optimized for performance in such environments, providing prompt responses to queries. Netdata’s logs have also been rewritten to log to the systemd-journal, allowing for easy monitoring and analysis using Netdata’s systemd-journal.plugin user interface.

A new utility called log2journal has been introduced in beta, allowing the conversion of log files into structured systemd-journal log entries. This powerful tool supports processing various log formats, including JSON and logfmt logs, and can be used to extract, convert, transform, and send logs to systemd-journal.

Netdata has also expanded its range of functions, offering new ways to visualize and troubleshoot system metrics. These functions leverage the wide range of collectors and metrics available in Netdata, providing insights into disk I/O activity, resource utilization of containers and virtual machines, IPMI sensor readings, disk usage for mount points, network traffic, process resource usage, and more.

In addition to these feature enhancements, Netdata has added new alert notification integrations to Netdata Cloud, including Amazon Simple Notification Service (Amazon SNS) and Telegram. These integrations provide users with more options for receiving alert notifications from Netdata.

It’s worth noting that some changes have been made in this release, including the removal of the charts.d/nut collector, which has been replaced by go.d/upsd. Netdata’s internal metrics are now disabled by default to reduce data volume, and Gorilla compression will be enabled by default in the next release. Some exporters, such as Google Cloud Pub Sub and AWS Kinesis, will be removed in the next release, and database modes map and save will also be eliminated. Furthermore, per-core CPU metrics will be disabled by default to improve performance, and several eBPF.plugin modules have been disabled to optimize system performance.

Overall, Netdata’s v1.44.0 release brings significant improvements in performance, log handling, compression, and functionality, making it an even more powerful and efficient monitoring system for servers, Linux, DevOps, and home labs.

For more details and to download the latest release, visit the Netdata GitHub page.

AdGuard Home v0.108.0-b.51 Released, Addressing Go Security Vulnerabilities

AdGuard Home v0.108.0-b.51 Released, Addressing Go Security Vulnerabilities

AdGuard Home, the popular ad-blocker, has released its latest version, v0.108.0-b.51. This update brings several improvements and fixes compared to the previous beta, v0.108.0-b.50.

In terms of security, the Go version has been updated to address potential vulnerabilities. This update specifically prevents the exploitation of the CVE-2023-39326, CVE-2023-45283, and CVE-2023-45285 Go vulnerabilities. These vulnerabilities have been fixed in Go 1.20.12, ensuring a more secure experience for users.

One notable addition in this release is the ability to set a client’s custom DNS cache. This feature, requested by users, allows for more personalized DNS caching, enhancing the overall performance and customization options of AdGuard Home.

Furthermore, this update also addresses a memory leak issue when using parallel queries. The fix for this problem, identified as issue #6438, ensures better memory management and stability.

For a complete list of changes and updates in AdGuard Home v0.108.0-b.51, please refer to the CHANGELOG.md file.

PhotoPrism Releases Version ‘November 28, 2023’ of Photos App

PhotoPrism has recently released a new version of its AI-powered photos app. This app is designed for the decentralized web and utilizes advanced technologies to automatically tag and organize pictures. Whether you run it on your home server or in the cloud, PhotoPrism aims to provide a seamless experience for managing your photos.

The latest release of PhotoPrism includes updated dependencies and fixes for recently discovered issues. It also introduces official installation packages with binaries for Linux, which are now available as an alternative to using Docker images. However, it’s worth noting that this installation method is recommended for experienced users only, as it requires manual setup and does not include all dependencies.

Here are some of the new features and improvements included in this release:

  • Search: Improved camera and lens information in the cards view details.
  • Search: Fixed cards view rendering when a lens has no model description.
  • Search: Added filter to find pictures by resolution range in Megapixels (MP).
  • PWA: Fixed list of available icon sizes in the app manifest file.
  • JPEG: Fixed regression when handling image files with EOF error.
  • JPEG: Fixed indexing of image files with invalid color metadata.
  • JPEG/PNG: Added panic handler for unexpected thumbnail save errors.
  • HEIC: Upgraded Libheif from version 1.13.0 to 1.17.1.
  • RAW: Upgraded Darktable from version 4.2.1 to 4.4.2.
  • Videos: Improved performance when extracting still images for creating thumbnails.
  • Vectors: Improved SVG conversion using RSVG instead of ImageMagick.
  • Docker: Upgraded base image from Ubuntu 23.04 to 23.10 (Mantic Minotaur).
  • Setup: Added tar.gz, deb, and rpm packages for installation without Docker.
  • Security: Updated Go to the latest stable release v1.21.4.

These updates and enhancements aim to provide users with a more seamless and efficient experience when organizing and managing their photo collections. Whether you are a photography enthusiast or simply looking for a robust self-hosted solution, PhotoPrism offers a comprehensive set of features to meet your needs.

To learn more about the latest release and to download the installation packages, visit the PhotoPrism GitHub page.

Self-hosted Monthly Update November 2023

Here are the new additions to the awesome-selfhosted repository during the month of November 2023:

  • ZOT OCI Registry - A production-ready vendor-neutral OCI-native container image registry. (Demo, Source Code) Apache-2.0 Go/Docker
  • mikochi - Browse remote folders, upload files, delete, rename, download and stream files to VLC/mpv. MIT Go/Docker/K8S
  • Digimindmap - Create simple mindmaps (documentation in French). (Demo, Source Code) AGPL-3.0 Nodejs/PHP
  • Piler - Feature-rich email archiving solution. (Source Code) GPL-3.0 C
  • OpenTrashmail - Complete trashmail solution that exposes an SMTP server and has a web interface to manage received emails. Works with multiple and wildcard domains and is fully file based (no database needed). Includes RSS feeds and JSON API. Apache-2.0 Python/PHP/Docker
  • Digiwall - Create multimedia collaborative walls for in-person or remote work (documentation in French). (Source Code) AGPL-3.0 Nodejs
  • Digibunch - Create bunches of links to share with your learners or colleagues. (Demo, Source Code) AGPL-3.0 Nodejs/PHP
  • Digiview - View YouTube videos in a distraction-free interface (documentation in French). (Demo, Source Code) AGPL-3.0 Nodejs/PHP
  • Slash - An open source, self-hosted bookmarks and link sharing platform. GPL-3.0 Docker
  • Docuseal - Create, fill, and sign digital documents (alternative to DocuSign). (Demo, Source Code) AGPL-3.0 Docker
  • Librum - A modern e-book reader and library manager that supports most major book formats, runs on all devices and offers great tools to boost productivity. (Source Code) GPL-3.0 C++
  • Suroi - An open-source 2D battle royale game inspired by surviv.io. (Demo, Source Code) GPL-3.0 Nodejs
  • Homebox Inventory - An inventory and organization system built for the home user with a focus on simplicity and ease of use. (Demo, Source Code) AGPL-3.0 Docker
  • ESMira - Run longitudinal studies (ESM, AA, EMA) with data collection and communication with participants being completely anonymous. (Demo, Source Code) AGPL-3.0 PHP
  • LanguageTool - Proofread more than 20 languages. It finds many errors that a simple spell checker cannot detect. (Source Code, Clients) LGPL-2.1 Java/Docker
  • Kestra - Event-driven, language-agnostic platform to create, schedule, and monitor workflows. In code. Coordinate data pipelines and tasks such as ETL and ELT. (Source Code) Apache-2.0 Docker
  • Digitools - A set of simple tools to accompany the animation of courses in person or remotely. (documentation in French). (Demo, Source Code) AGPL-3.0 PHP
  • SentryShot - Video surveillance management system. GPL-2.0 Docker/Rust
  • Otter Wiki - Simple, easy to use wiki software using markdown. MIT Docker
  • Digiscreen - Interactive whiteboard/wallpaper for the classroom, in person or remotely (documentation in French). (Demo, Source Code) AGPL-3.0 Nodejs/PHP
  • StartOS - Browser-based, graphical Operating System (OS) that makes running a personal server as easy as running a personal computer. (Source Code) MIT Rust
  • DocKing - Document management service/microservice that handles templates and renders them in PDF format, all in one place. (Demo, Source Code) MIT PHP/Nodejs/Docker
  • Flyimg - Resize and crop images on the fly. Get optimised images with MozJPEG, WebP or PNG using ImageMagick, with an efficient caching system. (Demo, Source Code) MIT Docker

awesome-selfhosted is a repository on GitHub, which contains ton of software for you to self-host. The repository describes itself as “a list of Free Software network services and web applications which can be hosted on your own servers.”

If you need a server on which to host your own applications, consider a Raspberry Pi or a mini PC.

PhotoPrism Releases Updated Version of Photos App: November 28, 2023

PhotoPrism, an AI-powered photos app for the decentralized web, has recently released its latest version, November 28, 2023. This app utilizes cutting-edge technologies to automatically tag and find pictures without causing any disruptions to the user. It provides the flexibility to run on a home server or in the cloud.

The service release includes various updates and fixes for recently identified issues. In addition to the existing Docker images, PhotoPrism now offers installation packages with binaries specifically designed for Linux. It is important to note that these installations require manual setup, so it is recommended for experienced users.

Here are the key improvements and updates in this release:

  • Search: Enhancements to camera and lens information in the cards view details.
  • Search: Fixes for rendering issues in the cards view when a lens has no model description.
  • Search: Addition of a filter to find pictures based on resolution range in Megapixels (MP).
  • PWA: Rectification of the list of available icon sizes in the app manifest file.
  • JPEG: Addressed a regression in handling image files with EOF error.
  • JPEG: Fixed indexing problems of image files with invalid color metadata.
  • JPEG/PNG: Implemented a panic handler for unexpected thumbnail save errors.
  • HEIC: Upgraded libheif from version 1.13.0 to 1.17.1.
  • RAW: Upgraded Darktable from version 4.2.1 to 4.4.2.
  • Videos: Improved performance in extracting still images for creating thumbnails.
  • Vectors: Enhanced SVG conversion using RSVG instead of ImageMagick.
  • Docker: Upgraded base image from Ubuntu 23.04 to 23.10 (Mantic Minotaur).
  • Setup: Added installation packages in tar.gz, deb, and rpm formats.
  • Security: Updated Go to the latest stable release, v1.21.4.

Uptime Kuma Releases Version 1.23.7

Uptime Kuma has recently released version 1.23.7, bringing a range of improvements, bug fixes, and security fixes to the popular server monitoring tool.

In terms of improvements, version 1.23.7 includes the ability to show the original timeout message and adds an additional 10 seconds for the abort signal. This enhancement allows users to better understand and manage timeout issues. Additionally, the error message on abort signal timeout has been improved, thanks to the contribution of @chakflying.

In the bug fixes category, Uptime Kuma has addressed a memory leak issue by ensuring the client postgresql connection is closed after rejection. This fix was made possible by the contribution of @mvaled. Furthermore, the team has decided to revert the “Restart running monitors if no heartbeat” feature, as it was causing issues from version 1.23.4 to 1.23.6.

In terms of security fixes, Uptime Kuma has taken steps to address multiple vulnerabilities. First, an XSS issue in the “Google Analytics ID” text field has been resolved, thanks to the report by @gtg2619. More details about this fix can be found in the advisory GHSA-v4v2-8h88-65qj. Additionally, the Tailscale ping has been rewritten using spawnSync, addressing a security vulnerability reported by @vaadata-pascala. Further information on this issue can be found in the advisory GHSA-hfxh-rjv7-2369. Lastly, Uptime Kuma has made certain functions, such as getGameList and testChrome, only accessible with login, improving overall system security.

Aside from these significant updates, version 1.23.7 also includes various small changes, code refactoring, and comment/documentation updates to enhance the overall user experience.