Hi All,

Is anyone out there doing self hosted LLM Artificial Intelligence for infrastucture use?

What about cloud based AI LLM tools for infrastructure build out.

Like building and configuring systems.
Setting up virtual machines, lxd's, and virtual networks.

I've just spoke with a friend who is a software engineer, and he is saying its eat or be eaten in the software development world. The company he works for CEO is working with only 1/3 the current dev staff, and still making significant progress using AI LLM tools.

I work in infrastructure, and don't hear much about AI in that space yet.

---
þ Synchronet þ Lunar Outpost BBS

Re: AI LLM Artificial intelligence infrastructure
By: bbsing to All on Sun Mar 08 2026 09:47 pm

Hi All,

Is anyone out there doing self hosted LLM Artificial Intelligence
for infrastucture use?

i dont have much experience at that stuff but i have a friend who
is being pressured to come up with something like that.

he's the head of IT at a large staffing company.
the people pressuring him dont know much about it either. they are hoping to have AI handle almost everything.

What about cloud based AI LLM tools for infrastructure build out.

Like building and configuring systems. Setting up virtual machines,
lxd's, and virtual networks.

yeah my buddy did mention that. they want him to come up with intergration
for all that.

I've just spoke with a friend who is a software engineer, and he is
saying its eat or be eaten in the software development world. The
company he works for CEO is working with only 1/3 the current

dude they are using ai for everything. people are using it for writing emails and doing posts on linkedin and everything.


--
"Before using Wildcat....This Company did not have a convenient way of
looking after some of the richest clients in the world...Now we do!"
---
þ Synchronet þ ::: BBSES.info - free BBS services :::

Re: AI LLM Artificial intelligence infrastructure
By: MRO to bbsing on Mon Mar 09 2026 04:18:59

i dont have much experience at that stuff but i have a friend who
is being pressured to come up with something like that.

he's the head of IT at a large staffing company.
the people pressuring him dont know much about it either. they are hoping to have AI handle almost everything.

yeah my buddy did mention that. they want him to come up with intergration for all that.

I'm in infrastructure and I'm wanting to figure some of this stuff out. It looks like LLM systems are not going away, so using, creating, maintianing these type of systems might take me through the next 16 years of my working life.

Trying to get a system capable of running LLM models equals lots of cash, and I'm on the fence if I should get into it, so I'm wondering if anyone out here is doing any stuff on the self hosting side.

dude they are using ai for everything. people are using it for writing emails and doing posts on linkedin and everything.

email is so silly. AI (LLM) systems communicating with each other on behalf of people is lame. People already are having problems communicating with each other the more assistance, will only attrify that ability. I think the point of email was for people to communicate, not for systems to communicate. There are lots of protocols for systems to communicate.

---
þ Synchronet þ Lunar Outpost BBS

On 19/03/2026 22:51, bbsing wrote:

I've just spoke with a friend who is a software engineer, and he is saying its eat or be eaten in the software development world. The company he works for CEO is working with only 1/3 the current dev staff, and still making significant progress using AI LLM tools.

It's mostly hype and a lot of failed businesses (those keen on letting developers go) are going to be realised sooner than later.

AI is a toolset in a developer's toolbox. LLMs are one of those tools. In that way, they are no more or less than a compiler, debugger, or IDE. Should we shun those things and go back to punchcards?

People need carpenters to build a wooden chair from scratch with quality craftsmanship; they'll still need software developers in the future to ensure software is built with the same concept of quality craftsmanship.

The other thing to bear in mind: no one wants or needs yet another Photoshop, there's plenty of alternatives. The idea that "anyone can make their own" is not only false, but would also be a productivity failure for a company to engage in, not a productivity boost. They should have focused on their business, not reinventing someone else's (unless they're genuinely going to compete.)

Then there's the liability issue. Say a company relies on Excel, but they decide to vibe their own - now if it gets math wrong, who is liable? The Post Office Horizon scandal in the UK is a pre-AI example of this kind of ownership of responsibility meets liability issue.
---
þ Synchronet þ Diamond Mine Online BBS - bbs.dmine.net:24 - Fredericksburg, VA USA