Outages this AM

[regor]

Whoooooooops..................

https://twitter.com/i/web/status/1814368602201395679

 

[wash11]

Buddy drove to town for fasting blood work at Labcorp, systems down. 80 mile round trip being hangry, domino effect of not having results in time for scheduled doctor appointments, reschedule that and so on and so forth. For some folks, that could push medical care out by months!
Anything being shipped to us via Amazon or Fed-ex now shows delayed.
Customer had to reschedule a big beef pickup as they couldn't pull cash out this morning.
This is just the tip of goofy stuff in our little bubble- I know the list of affected is much longer.

What was this, a 4-hour hiccup? Can you imagine what an actual attack might look like?

For the tech savvy industry people here- how vulnerable are we?
Any chance this could happen to communications, VERIZON or ATT?

 

[OLDRAAT]

In these times, everything is susceptible to to electronic targeting IMO. The internet has altered our lives and and for all in the future....an unknown world exists for old guy's like me.
Fraging, shunting or bombing, etc of the power grid including the local substations gives me frequent concern. That opinion is based on my son telling me about the B52's and others with the ability to provide high energy focused pulse with underwing jamming pods and disable localized grids (3 million watts was mentioned) was years ago.

 

[rivrrts429]

Girlfriend finally landed at Orange County after four different airplanes lol

Now she’s sitting in the 91fwy gridlock lol

My Co Worker was stuck in Salt Lake. He jumped in a rental car and drove back to Vegas.

The one week I didn’t need to travel for work turns out to be a blessing. What a mess this turned out to be for a lot of people.

 

[Sandlord]

Whoooooooops..................

https://twitter.com/i/web/status/1814368602201395679

The fuckery of the AZ elections starts early

 

[was thatguy]

 

[Flyinbowtie]

When I was in high school in the dark ages I worked at a gas station for a couple years. I remember sliding credit cards through the embossing plate to get a carbon copy of it then after closing I would balance and drop the recpts in the floor safe. Gas was 50 cts a gallon
People charged 2 bucks.
No cash.
If we ever get hit hard and the system goes down plastic is gonna be worthless. Those stations that have back up power to pump the gas up outta the ground are gonna be after cash..or something else of serious value. People that run around with zero cash are taking an unnecessary risk IMHO.
Something to think about anyway.

 

[DarkHorseRacing]

Buddy drove to town for fasting blood work at Labcorp, systems down. 80 mile round trip being hangry, domino effect of not having results in time for scheduled doctor appointments, reschedule that and so on and so forth. For some folks, that could push medical care out by months!
Anything being shipped to us via Amazon or Fed-ex now shows delayed.
Customer had to reschedule a big beef pickup as they couldn't pull cash out this morning.
This is just the tip of goofy stuff in our little bubble- I know the list of affected is much longer.

What was this, a 4-hour hiccup? Can you imagine what an actual attack might look like?

For the tech savvy industry people here- how vulnerable are we?
Any chance this could happen to communications, VERIZON or ATT?

The important takeaway in all this is if it’s mission critical, it shouldn’t be running windows.

This had no effect on Apple and Linux despite the fact that Crowdstrike has clients for both.

So no this isn’t the end of the world, or the start of some new world order. It’s just another reason for people to get important stuff off windows.

We learned a lot from our ransomware incident and that was to get everything off windows as much as possible. As a result, our infrastructure was unaffected other than a handful of windows servers and some PCs.

Everyone else should be doing the same. Windows should be test/dev only. It’s such a nightmare to support.

I’ll only change that recommendation if MS gets their head out of their ass and writes a completely new windows code base that supports nothing but the next gen platform hardware and forces a clean break with anything prior.

Apple has done that twice now (Power PC to Intel, and Intel to Arm) and both times they gave folks a chance to rewrite their programs for native running. Microsoft needs to do it once if it wants a future in a zero day exploit world.

 

[DILLIGAF]

What Is CrowdStrike And How Are They Connected To Ukraine? - The Lid

On his call with the Ukraine president, President Trump was trying to get Zelensky's help investigating the tech company, Crowdstrike.

lidblog.com

 

[boatnam2]

Maybe having the vid and laying around in bed and missing all this wasnt all that bad.

 

[Not So Fast]

All forms of transportation full on gas and firearms at the ready, hopefully never to be used but just in case

 

[gqchris]

This will stop folks from auto-updates, which could start other issues.

There was no choice on receiving this as it was a channel update. It was pushed to everyone. No matter what your config was.

Why didnt Crowdstrike run this to a region or two first? Thats where they screwed the pooch.

 

[Sandlord]

Microsoft has been nagging Southwest Airlines to update its version of Windows since 1992. As a result, the Dallas-based airline was not impacted by the global CrowdStrike outage.

 

[gqchris]

All good here.

View attachment 1404815

Playing as a single with 3 IT guys. They don’t seem too worried about what’s going

Buddy drove to town for fasting blood work at Labcorp, systems down. 80 mile round trip being hangry, domino effect of not having results in time for scheduled doctor appointments, reschedule that and so on and so forth. For some folks, that could push medical care out by months!
Anything being shipped to us via Amazon or Fed-ex now shows delayed.
Customer had to reschedule a big beef pickup as they couldn't pull cash out this morning.
This is just the tip of goofy stuff in our little bubble- I know the list of affected is much longer.

What was this, a 4-hour hiccup? Can you imagine what an actual attack might look like?

For the tech savvy industry people here- how vulnerable are we?
Any chance this could happen to communications, VERIZON or ATT?

We are VERY vulnerable. This is just a taste of what could happen.

This shows how we are literally at the will or vendors and providers. Being every company wanted the big CLOUD push, this is what happens.

My CIO wanted us to move EVERYTHING to cloud. Well guess what, we were down 3 days last week with the seperate AZURE outage.

We just smiled and thought to ourselves “We told you so!

By the way, our Microsoft bill is almost 90k a month and we could barely get an english speaking engineer on the phone. Took 6 escalations.

 

[DarkHorseRacing]

There was no choice on receiving this as it was a channel update. It was pushed to everyone. No matter what your config was.

Why didnt Crowdstrike run this to a region or two first? Thats where they screwed the pooch.

Well interestingly enough, we had an employee on vacation in the Phillipines. He heard about it first, and woke up our security manager here at like 1am on Friday morning and they tried to mitigate it then.

About all that accomplished was lead time on repairs because the damage had been done. But they had fixed a bunch of stuff before everyone got in at 7am and already had the fix documentation to hand out.

 

[attitude]

So how long until this gets figured out? I need a certified check by Wednesday morning and the banks are screwed.

 

[jetboatperformance]

When I was in high school in the dark ages I worked at a gas station for a couple years. I remember sliding credit cards through the embossing plate to get a carbon copy of it then after closing I would balance and drop the recpts in the floor safe. Gas was 50 cts a gallon
People charged 2 bucks.
No cash.
If we ever get hit hard and the system goes down plastic is gonna be worthless. Those stations that have back up power to pump the gas up outta the ground are gonna be after cash..or something else of serious value. People that run around with zero cash are taking an unnecessary risk IMHO.
Something to think about anyway.

When I worked at Chevron (70s) we had those knuckle buster imprinters and even when I started JBP in the early 90s they were still around , anyhow a customer at Chevron drove in for a "fill up" one night stuck his card part way up between the door felt and window then bumped the window switch and down into the door the card went . FWIW as you might remember we washed front and back glass and checked under the hood and even air in tire (if asked)

 

[liquid addiction]

I finally got the flight from Phoenix to Reno at 5 am this morning. What originally started at 6am est Friday and ended at 7am pst today. Newark to Reno

 

[DarkHorseRacing]

So how long until this gets figured out? I need a certified check by Wednesday morning and the banks are screwed.

The fix was identified and deployed fairly quickly, the problem was the prior update caused a BSOD preventing those systems from receiving the fixed update. Sometimes a reload would just clear it, sometimes you needed to get into safe mode and delete CS file and reboot into normal operation.

I’m sure most orgs are back up and running but just dealing with the issues caused by the systems outage time lost and it’s getting better daily as orgs play catch up.

 

[jetboatperformance]

Fwiw We’ve been “prepping” for 30 years not trying to be one up just sayin