@edzob Self-hosted, using Docker on a pi4. I've spun up #NextCloud, #Collabora and #ElasticSearch in #Docker, running behind #Traefik. I'm currently looking at SSO options like Authelia and Authentik, as I have a few other services I'd like to expose (a few Nginx sites, either Gitlab or Forgejo, Immich, etc)
One for the #Elastic / #Elasticsearch folks out there. Elastic are offering their on-demand training for free at the moment which I've just discovered also includes access to their labs. The training is pretty solid (I've done a few paid ones in the past) but the lab access makes it super valuable. I am working through one of the certs now (I need to complete a cert to renew two of my current ones) but it might be useful for other #tech folks out there
Elasticsearch Engineer - https://www.elastic.co/training/elasticsearch-engineer
Data Analysis with Kibana - https://www.elastic.co/training/data-analysis-with-kibana
Elastic Observability Engineer - https://www.elastic.co/training/elastic-observability-engineer
Elastic Security for SIEM - https://www.elastic.co/training/elastic-security-for-siem
OpenSearch 3.0 ist da und bringt mehr Leistung und Skalierbarkeit
Während der OpenSearchCon Europe wurde Version 3.0 des Such-Frameworks veröffentlicht. OpenSearch indexiert schneller und geht sparsamer mit Daten um.
Die Suchfunktion via Elasticsearch wurde soeben auf der Instanz https://bayerwald.social nachinstalliert und sollte wie gewohnt funktionieren.
Man, ElasticSearch code can get very complex very quickly. I’ve a search query, that also returns filter facets, and on top of that values that are valid for each facet, as aggregations. I’m now trying to re-use just the aggregations part and with all the post processing we apply to tweak the display order of face values… eek.
EspritsCollaboratifs, la boite où je bosse, recrute une ou un adminSys en CDI, à Fontenay-sous-Bois dans l'est parisien, ou en télétravail : https://www.curebot.fr/recrutements/#jobs
Which #logging system do you prefer for managing logs in #Kubernetes?
Reading @joannastern article about giving up google for a chat bot, i have pretty much done exactly this.
I use google when I need to get an overview of something specific that I know nothing about (what exactly does #ElasticSearch do?).
When i already know what the answer looks like (how do you add a relationship in #Neofj using #ython?) I always use a chatbot.
When i get a giant stack trace, i drop that right into a chatbot.
https://www.wsj.com/tech/personal-tech/google-search-chatgpt-perplexity-gemini-6ac749d9
I'm setting up #ElasticSearch
`docker stats` says it uses 8 GB of memory just to boot up
I asked ChatGPT how I can make it index some text files and it says I need to add _another service_ to do that
Is this a joke?
Each time a new major #Elasticsearch version is released, someone asks if it works with #syslog_ng. So I gave it a quick test and based on that, Elasticsearch 9.0.0 beta1 works fine with syslog-ng. But of course, some terms and conditions apply… :-) https://www.syslog-ng.com/community/b/blog/posts/testing-elasticsearch-9-0-0-beta1-with-syslog-ng
#getFedihired - Know #MongoDB and/or #ElasticSearch and/or GNU/Linux #sysadm ? Expecially if you know #Ansible and/or #python and #shell scripting
A couple US or India #WFH positions opening up for 24/7 support ( includes #weekend and #holiday shifts )
US roles are US daytimes, India roles are the other 16 hours of day
DM me if you're interested ( job listings coming soon )
We should also have some SRE and dev positions and a MongoDB DBA position soon
Also, doesn't help that I'm getting fairly quickly productive with its #logsQL. I more than familiar with #Loki and #ElasticSearch for these things, but #victorialogs really does feel a bit easy to understand how to query and filter.
Though once I have like a month with it, I will likely find the short cases that breaks this love and question why not use SQL. 
I been messing around trying self hosted options for logs. Mostly to scratch an itch, but also to know what is available in the market.
#openObserve is nice, but feels pretty clunky for what I want. Found this thing called #seq, which is kind of brilliant. But right now, I've settled with #victorialogs from #victoriametrics.
It can ingest #elasticsearch formatted logs. But you get the ease that #loki was trying to do. I have to say, I'm impressed. 
It turns out that the issue wasn’t ES using excessive RAM, but rather the off heap memory growing from other processes. When the total RAM exceeded that available on the VPS, ES was killed.
Setting -Xmx2048m seems to result in a stable configuration with ES happily humming away.
• Set ES_HOST=https://localhost in .env.production
• Set ES_CA_FILE=/path/to/selfsigned/cert
(b) I had to carefully set the maximum Java heap size, even though I thought I had plenty of RAM.
This last point confused me for sometime. I am running ES on the same VPS as my mastodon instance, which has 8GB RAM. So I I initial set -Xmx3g, but ES kept failing with exit code 137 (excessive memory consumption). I successively increased -Xmx to 4g, 5g, 6g, but with no luck.
After checking the logs, the heap size was not growing and the cap was being enforced properly.
For those interested, setting up #ElasticSearch was fairly straightforward. I mostly followed the official instructions at https://docs.joinmastodon.org/admin/elasticsearch/, with two minor modifications:
1. I installed OpenJDK 21 (latest version in the Ubuntu repository)
2. I installed ElasticSearch 8.
Two things tripped me up:
(a) ES v8 requires TLS by default, even when binding only to localhost. This means that:
• When using curl, you have to use --cacert to specify the path to the self-signed certificate generated by ES & prepend localhost with https://
Curiosity got the better of me and I ended up rescaling* my server and installing ElasticSearch. Let’s see how much I use it.
—
* FYI 2 vCPU & 4GB isn’t anywhere near enough for a #SingleUserInstance of #mastodon + #ElasticSearch.
https://colquitt.xyz/@daniel/113975100843242921
[Friday evening Nick]: "It's been a while since I tried Elasticsearch, I should set it up on my homelab..."
[Saturday evening Nick]: "What have I done."
Harness is hiring Staff Software Engineer - Software Engineering Insights
#java #aws #azure #cicd #docker #elasticsearch #gcp #mysql #postgresql #sql
Mountain View, California
Full-time
Harness
Job details https://jobsfordevelopers.com/jobs/staff-software-engineer-software-engineering-insights-at-harness-io-oct-15-2024-18620e?utm_source=mastodon.world&utm_medium=social&utm_campaign=posting
#jobalert #jobsearch #hiring
