Wow. #databricks is buying #neon. I wonder how this will impact the db market. databricks isn't small. But they also haven't focused on this type of product. Especially something like this. I wonder if they plan to expand to all other databases somehow.

https://neon.tech/blog/neon-and-databricks

#LargeLanguageModel * #Databricks #Snowflake GPT-4o Tells Jokes about AI https://www.artificial-intelligence.blog/ai-news/gpt-4o-tells-jokes-about-ai?utm_source=dlvr.it&utm_medium=mastodon

Nachdem ich nun Testdaten in meinen #Databricks Server eingespielt habe und dann wieder herausgeholt habe, mache ich #Feierabend.

Work and life have been so extremely busy that I’ve had almost no time to work on my #marchintosh project. What I have in mind probably couldn’t have hit releasable form this month, but I’m still going to hack away on it.

I have a long flight to Vegas Monday night for a conference so hoping to get some coding in on the plane ride there and back.

If you’re attending #HIMSS this year, I’ll be around and speaking in the #databricks theater on Tuesday afternoon if you want to meet up!

Databricks, the data analytics platform, has raised $10 billion that values the company at $62 billion — one of the largest venture rounds in history. Read it at @Techcrunch. #Databricks #IPO #VentureCapital #Tech #Technology https://flip.it/HGRRWz

Shutterstock Hoping to Become What Apple Was to Napster in the AI Image Space https://petapixel.com/2024/06/13/shutterstock-hoping-to-become-what-apple-was-to-napster-in-the-ai-image-space-imageai-databricks/ #generativeai #shutterstock #Technology #databricks #aiimage #imageai #News #Law

Faszinierend, wie schnell die freien Modelle aufschließen:

#Databricks says its new AI model performs better than #Llama 2, #Grok, and #Mixtral

https://www.theverge.com/2024/3/27/24113771/databricks-says-its-new-ai-model-performs-better-than-llama-2-grok-and-mixtral

»Databricks says it also wants to open up about the work involved in creating its open source model, something that Meta has not done for some key details about the creation of its Llama 2 model.«

https://www.wired.com/story/dbrx-inside-the-creation-of-the-worlds-most-powerful-open-source-ai-model/

I still have concerns about the I/O overhead caused by having the full state of an OS regularly persisted to disk rather than memory. But the idea is intriguing.

#Databricks is working on the development of a database-based operating system (DBOS). Imagine having an OS where:

• You can easily resume an application from a previous state, without having to restart it and replicate it, because that state was persisted through ACID transactions.

• The “it works on my machine”/“it doesn’t replicate” problems can be removed by design. If a process ended up in an unpredictable state, we have a relational db under the hood to query exactly which was that state.

• Backing up an OS and its current state becomes as easy as exporting a database dump.

• You have a native “time machine” mechanism - if you want to try some potentially breaking changes you don’t have to make a backup first, you just do what you have to do and if something goes wrong you rollback all the transactions back to a certain state.

• The process of copy-on-write/image layering becomes easier to understand and manage - instead of storing whole images that need to be merged on top of your OS to replicate the state, you just run a bunch of statements on a db.

https://developers.slashdot.org/story/24/03/18/0038232/database-based-operating-system-dbos-does-things-linux-cant

Figured I should do an #introduction! I'm Peter, a queer dude living in Vienna. Daytime I work for the Austrian Railways #oebb as data engineer, ETL, #devops, #databricks. Love #Python, learning #rust. I'm an avid "Alltagsradler" (sb. who runs daily errands by bicycle) and proponent of making our cities more #walkable and safe for everyone. Recently, I started a blog over at https://pyter.at. Nice to be here!

Sure is a nice set of documents you got there. It'd be a shame if someone were to misconfigure SSL and prevent you from reading it https://docs.azuredatabricks.net/api/latest/clusters.html#clusterclusterservicelistsparkversions #Databricks

I like that with #databricks I can define cluster timeout periods so that when I space off and leave it running, it shuts the cluster down so I don't burn through resources too quickly.

*starts cluster*
Looks away. Pets the dog, gets a glass of water, checks the garden, etc, sits back down to see my the cluster terminating due to idle settings.

Ha, I'm such a dumb bitch. Let's try this again.

*starts cluster*
Oh, out of water....

i've got mixed experiences with #databricks. i love the product, but their customer support is almost antagonistic

New episode of The Changelog!

This week we’re taking you to the hallway track of The #Linux Foundation’s #OSSummit North America 2023 in Vancouver, Canada

This episode features three conversations about #opensource #AI:

Beyang Liu (Co-founder and CTO at #Sourcegraph)
@dennyglee (Developer Advocate at #Databricks)
Stella Biderman (Head of Research at #EleutherAI)

https://changelog.fm/541

Ever wanted to write #ETL pipelines in bare code - with little thought ?

With #DeltaLiveTables, the latest ETL framework from #Databricks, you can leverage the power of code to create reliable, scalable, and easy-to-maintain #DataPipelines . Join me as I explore the framework and share my experiences with it.

https://www.fabianstadler.com/2023/04/data-pipelines-as-code-with-delta-live-tables.html

"If we went back to 2018 and Databricks Workflows was available, we would never have considered building out a custom #ApacheAirflow setup. We would just use Workflows. #Databricks Workflows is an incredibly reliable #orchestration service given the thousands of tasks and job clusters we launch daily."
→ Hillevi Crognale of YipitData
https://www.databricks.com/blog/2022/12/07/why-we-migrated-apache-airflow-databricks-workflows-yipitdata.html

Hi #hachyderm! My #introduction:

I'm a data engineer in #Austin #Texas, where I live with my partner and her cat.

I work mostly with #azure, #python, #databricks, and #sql. Learning more about #machinelearning and #dataviz.

A couple of things that are interesting to me now:

* What kind of drift/movement exists in ESG scores over time?
* What kind of variations in financial portfolio composition exist in different parts of the USA?

Other interests: nature, travel, family, and friends