There have been multiple accounts created with the sole purpose of posting advertisement posts or replies containing unsolicited advertising.

Accounts which solely post advertisements, or persistently post them may be terminated.

Major IT outage affecting banks, airlines, media outlets across the world

All our servers and company laptops went down at pretty much the same time. Laptops have been bootlooping to blue screen of death. It’s all very exciting, personally, as someone not responsible for fixing it.

Apparently caused by a bad CrowdStrike update.

Edit: now being told we (who almost all generally work from home) need to come into the office Monday as they can only apply the fix in-person. We’ll see if that changes over the weekend…

retrospectology ,
@retrospectology@lemmy.world avatar

This is why you create restore points if using windows.

thearch ,

Irrelevant but I keep reading “crowd strike” as “counter strike” and it’s really messing with me

dhork ,

I picked the right week to be on PTO hahaha

CanadaPlus ,

Yep, this is the stupid timeline. Y2K happening to to the nuances of calendar systems might have sounded dumb at the time, but it doesn’t now. Y2K happening because of some unknown contractor’s YOLO Friday update definitely is.

Spaceinv8er ,

So that’s why my work laptop is down for the count today. I’m even getting that same error as the thumbnail picture

ytg ,

>Make a kernel-level antivirus
>Make it proprietary
>Don’t test updates… for some reason??

CircuitSpells ,

I mean I know it’s easy to be critical but this was my exact thought, how the hell didn’t they catch this in testing?

grabyourmotherskeys ,

I have had numerous managers tell me there was no time for QA in my storied career. Or documentation. Or backups. Or redundancy. And so on.

kandoh ,

Move fast and break things! We need things NOW NOW NOW!

StaySquared ,

Been at work since 5AM… finally finished deleting the C-00000291*.sys file in CrowdStrike directory.

182 machines total. Thankfully the process in of itself takes about 2-3 minutes. For virtual machines, it’s a bit of a pain, at least in this org.

lmao I feel kinda bad for those companies that have 10k+ endpoints to do this to. Eff… that. Lot’s of immediate short term contract hires for that, I imagine.

boaratio ,

CrowdStrike: It’s Friday, let’s throw it over the wall to production. See you all on Monday!

jayandp ,

https://sh.itjust.works/pictrs/image/ce10cdca-116b-4061-b6c3-3f49780c0551.jpeg

^^so ^^hard ^^picking ^^which ^^meme ^^to ^^use

frezik ,

When your push to prod on Friday causes a small but measurable drop in global GDP.

lagomorphlecture ,

Definitely not small, our website is down so we can’t do any business and we’re a huge company. Multiply that by all the companies that are down, lost time on projects, time to get caught up once it’s fixed, it’ll be a huge number in the end.

lightnsfw ,

We did it guys! We moved fast AND broke things!

rottingleaf ,

Servers on Windows? Even domain controllers can be Linux-based.

OsrsNeedsF2P ,

Old servers. Also Crowdstrike took down Linux servers a few years ago.

AllOutOfBubbleGum ,

I’m a long-time Samba fan, but even I wouldn’t run them as DCs in a production environment.

rottingleaf ,

I meant sssd, that I’ve seen working as a DC, if my memory serves me right. But I’ve never been the person setting up a domain controller, so.

EDIT: No, it doesn’t serve me right, from quick googling sssd can’t into DC’s. Kurwa.

catch22 , (edited )
@catch22@programming.dev avatar

deleted_by_author

    •
    IndustryStandard ,

    The internet is just a way to communicate data. The only people affected by this bug are customers of a Windows based “cybersecurity” company.

    Baggie ,

    I legit have never been more happy to be unemployed.

    foremanguy92_ ,

    Bahaha 😂😂 continue using proprietary software, that’s all you are going to get in addition to privacy issues… Switch to Linux.

    art ,
    @art@lemmy.world avatar

    Not easy to switch a secured 4,000+ workstation business. Plus, a lot of companies get their support, license, and managed email from one vendor. It’s bundled in such a way that it would cost MORE to deploy Linux. (And that very much on purpose)

    silkroadtraveler ,

    It’s entertaining to me that our brand of monopolistic / oligarchic capitalism itself disincentivizes one-time costs that are greatly outweighed by the risk of future occurrences. Even when those one-time costs would result in greater stability and lower prices…and not even on that big of a time horizon. There is an army of developers that would be so motivated to work on a migration project like this. But then I guess execs couldn’t jet set around the world to hang out at the Crowdstrike F1 hospitality tent every weekend.

    Cornelius_Wangenheim , (edited )

    deleted_by_author

    •
    OsrsNeedsF2P ,

    Apparently the slow rollout was skipped (on Crowdstrike’s end) for this

    RaoulDook ,

    That’s true about the test group deployments, but it turned out this one was not an agent update under that control system. It’s a Channel File update that goes out to all endpoints automatically.

    invisiblegorilla ,

    Ironic. They did what they are there to protect against. Fucking up everyone’s shit

    Telorand ,

    Maybe centralizing everything onto one company’s shoulders wasn’t such a great idea after all…

    Excrubulent ,
    @Excrubulent@slrpnk.net avatar

    Wait, monopolies are bad? This is the first I’ve ever heard of this concept. So much so that I actually coined the term “monopoly” just now to describe it.

    joostjakob ,

    Someone should invent a game, that while playing demonstrates how much monopolies suck for everyone involved (except the monopolist)

    KingJalopy ,

    And make it so you lose friends and family over the course of the 4+ hour game. Also make a thimble to fight over, that would be dope.

    Telorand ,

    I mean, I’m sure those companies that have them don’t think so—when they aren’t the cause of muti-industry collapses.

    jaybone ,

    Yes, it’s almost as if there should be laws to prevent that sort of thing. Hmm

    jaybone ,

    The too big to fail philosophy at its finest.

    StaySquared ,

    CrowdStrike has a new meaning… literally Crowd Strike.

    nintendiator ,

    Since when has any antivirus ever had the intent of actually protecting against viruses? The entire antivirus market is a scam.

    TheReturnOfPEB ,

    This is a a ruse to make Work From Home end.

    exanime ,

    ???

    How would this have been prevented by working on site?

    sudo ,

    A crowd strike, you could call it

    Weax ,

    This is just blatantly incorrect - 99% of these outages are going to be fixed remotely.

    boaratio ,

    Not at my company. We’re all stuck in BSOD boot loops thanks to BitLocker, and our BIOS is password protected by IT. This is going to take weeks for them to manually update, on site, all the computers one by one.

    verity_kindle ,

    “Never attribute to malice that which can be adequately explained by stupidity.”

  • All
  • Subscribed
  • Moderated
  • Favorites
  • •
  • [email protected]
  • random
  • lifeLocal
  • goranko
  • All magazines
    •