Follow Slashdot blog updates by subscribing to our blog RSS feed

 



Forgot your password?
typodupeerror
×
Microsoft Windows IT

Controversial Windows Recall AI Search Tool Returns (securityweek.com) 68

wiredmikey writes: Three months after pulling previews of the controversial Windows Recall feature due to public backlash, Microsoft says it has completely overhauled the security architecture with proof-of-presence encryption, anti-tampering and DLP checks, and screenshot data managed in secure enclaves outside the main operating system.

In an interview with SecurityWeek, Microsoft vice president David Weston said the company's engineers rewrote the security model of Windows Recall to reduce attack surface on Copilot+ PCs and minimize the risk of malware attackers targeting the screenshot data store.

This discussion has been archived. No new comments can be posted.

Controversial Windows Recall AI Search Tool Returns

Comments Filter:
  • by gweihir ( 88907 ) on Friday September 27, 2024 @12:30PM (#64822087)

    This is essentially the Panopticon. Sad times when the OS supplier has to be regarded as an enemy of all users.

    Sure, they _pretend_ this is secure, but do you really think the usual authoritarian assholes in law enforcement and the TLAs can really restrain themselves? They have to think the Holy Grail of surveillance has been found!

    • by Brain-Fu ( 1274756 ) on Friday September 27, 2024 @01:04PM (#64822207) Homepage Journal

      Most users don't care. And we can't make them care. So, for the most part, Microsoft is right in their beliefs.

      They have the means, motive, and opportunity to spy on their users for their own profit. So, they will.

      I only use windows for work. And I don't do anything relating to my personal life on my work computer. So, this is my employer's problem, not mine.

      • Most users don't care. And we can't make them care.

        Nah, we can make them care but too many people start screeching about human rights, that I'm evil incarnate, and other non-sense whenever I start the process. Seriously, people are too sensitive about keeping their eyelids attached and children alive because they are quitters.

    • by Sloppy ( 14984 )

      Sad times when the OS supplier has to be regarded as an enemy of all users.

      People have had decades to accept that they run software which is intended to serve other parties' interests above their own. And still to this day, we argue over the definition of "malware."

    • "... authoritarian assholes in law enforcement and the TLAs..." that's the problem with our elected officials, they hear the " authoritarian assholes in law enforcement and the TLAs" say that 'they can't do their job' without this level of surveillance, and some variant of 'think of the children' then the all vote to give ' authoritarian assholes in law enforcement and the TLAs' the powers they ask for.

      The thing is, that no matter how much power you give the ' authoritarian assholes in law enforcement and

      • Who's the more stupid, the elected officials that do this or the voters who keep re-electing them?

        • by gweihir ( 88907 )

          Assholes always need plenty of useful idiots to give them power. And the human race provides.

        • Once, about two decades ago, I made a youtube video of where you could go online to get voting records of your elected assholes. Youtube took it down claiming DMCA violations. Literally all it had was my voice on it and the address of the government website where you could find these records.

          So... I imagine this pissed off some politician who had his/her staff DMCA me. Youtube was not willing to listen to me one bit.

    • Are they an enemy of the user though, or do you just think so due to lack of information? One of the key things from the announcement not mentioned in this article, but covered in others is that Recall is fully optional and Microsoft will allow the user to completely uninstall it.

      https://www.theverge.com/2024/... [theverge.com]

      Sure, they _pretend_ this is secure

      Literally every attack on the preview has required elevated system privileges. When an attacker has that already you are no longer using your own machine, you're using theirs. Windows recall isn't

      • Many users have experienced updates silently re-enabling features that the users previously disabled. Besides is it *really* off or just hidden?
      • by gweihir ( 88907 )

        And, as usual, you do not understand what you are talking about.

        1. When somebody gets admin access on your computer and starts surveillance then, that is essentially the first point they get data. With recall, they can get months, maybe years before. This means it becomes very worthwhile targeting users that you know may have something in their recall DB.

        2. "Literally every attack on the preview has required elevated system privileges." means exactly nothing. Attacks only ever get better and require less, t

      • Having admin access on a target machine is the holy grail of surveillance. It doesn't matter if Recall is installed, or if the system is even a Windows OS.

        I disagree, an attacker can now benefit from recall as a persistent threat without having required the attacker to have previously compromised the system.

      • More on brand bullshit from TheGarberator.
        You're worse than naive, you're the target market for this.

        Could've modded down, but poking my thumb in your eye just feels more satisfying.
        Thanks for the larfs.
    • You really don't think they haven't had a form of this available in the wild for - I'd guess - over a decade? Either in their closed insider builds, or telemetry data that basically is the same thing. *sigh*.
  • I'll reduce the surface area by shutting it off and disabling the feature, thank you very much.

  • by TheStatsMan ( 1763322 ) on Friday September 27, 2024 @12:43PM (#64822153)

    and using that to train your AI without my consent. Mr. Weston, YOU are the attacker.

  • This is even worse (Score:3, Interesting)

    by ebunga ( 95613 ) on Friday September 27, 2024 @12:44PM (#64822155)

    Now it provides cryptographically secure proof of whatever your abusive spouse thinks it says. Sorry women, a whole lot of you are going to die horrible deaths because of Microsoft.

    • by Kokuyo ( 549451 )

      I'm sorry, I don't follow.

    • I'm happy you raised this. Having to make a leap of faith to the "think of the abused women" destination means that all other problems with Recall have been addressed right?

      • by narcc ( 412956 )

        Do you really not understand the problem?

        What this means is that an abused spouse can't clandestinely access resources designed to help them. The evidence is always there, just waiting for their abuser to check. Yes, this can get them killed.

        There's a reason that it's recommended that mobile apps and websites have a "boss button" or some other way to immediately hide what the user is looking at. For example [thehotline.org].

        Why are you so hot to defend this shit anyway?

      • by ebunga ( 95613 )

        On far too many occasions I've had to make a very long road trip to help a friend or family member escape a DV situation. Abusers exploit every single piece of technology to exert control over their victims. I would much rather face a hostile intelligence service than someone that wants to murder their spouse.

  • by guygo ( 894298 ) on Friday September 27, 2024 @12:45PM (#64822159)

    I don need no steenkin' CoPilot, I don need no steenkin' Recall, I don need your untested buggy security.
    Period.

  • A consultant may be granted temporary access to proprietary data and PII that they are required by contract and possibly by law to be deleted when the contract ends. How do they do this? Its not clear that physically destroying the computer is sufficient because a lot of Microsoft data is shared between computers on the same account.

    That is separate from the insane security risk that now all passwords that are used on the computer will be visible in the screen shots.

    I don't know if this is pushed by
    • by gweihir ( 88907 )

      I think it is desperation. MS has sunk tons of money into AI and applications or profits are not materializing. Hence crap like this. Obviously, it is going to be abused and obviously, attackers are going to get in.

      My one hope at the moment is that this is likely turning out to be completely illegal in the EU and even the possibility may be illegal already.

    • The same thing that happens when that stuff doesn't get deleted off SSDs because overwrites don't go to the same place all the time or left in the various caches and memory dump files your computer and the software you use produces?
      • This is much more compete information than that because it includes sessions where you are logged in to remote computers through secure links. There are also tools like cipher that claim to overwrite delete space.
  • Who need the govt to spy on you when the corporations can do it for fun, profit? The profit, of course, being when they sell the spying data to the govt.
  • Assuming security works like described, why was there a rush to get this feature out the door way before it was secured. Remember Recall was advertised as "encrypted" previously but that meant if the drive had Bit-Locker turned on, then the files were encrypted.
    • by gweihir ( 88907 )

      MS has poured billions into AI and applications or profits are not materializing. They are desperate.

    • by zlives ( 2009072 )

      because AI, blockchain, cloud

    • by kmoser ( 1469707 )
      Exactly. All this from a company who, every few years when they've been hacked or their software has been shown to be insecure, declares a new security initiative. As a company that literally started life building OSes, shouldn't security have been paramount from DAY ONE?
  • You don't get a second chance to make a first impression. They put so very very little thought into the first iteration, that the second one is DOA. Its like trying to sell a fire safe made out of FlashPaper. Yes thats a bad idea, and no I won't be interested in their follow up now that they admit they have no brains.
    • You don't get a second chance to make a first impression.

      You would think MS learned that after the Xbox One launch, but no.

  • by necro81 ( 917438 ) on Friday September 27, 2024 @01:42PM (#64822307) Journal

    Microsoft says it has completely overhauled the security architecture with proof-of-presence encryption, anti-tampering and DLP checks, and screenshot data managed in secure enclaves outside the main operating system

    That's nice, but have they bothered to overhaul their answer the following question: why the hell would anybody want or need this?

    • by Sloppy ( 14984 )

      That's easy. Their customers asked for it.

      Their customers. You know, advertisers. They're all asking "How do I choose which users' eyes are worth paying for?"

  • From TFA:

    Recall will now be an “opt-in experience” during setup. “If a user doesn’t proactively choose to turn it on, it will be off, and snapshots will not be taken or saved,” he explained, noting that Windows users can remove the feature entirely.

    “You can remove it completely, never be turned on in future,” Weston said.

    Also:

    Under the hood, the Microsoft VP said snapshots and any associated information in the vector database are always encrypted with keys that are protected by the TPM (Trusted Platform Module), tied to a user’s Windows Hello Enhanced-Sign-in Security identity.

    “You have to have proof-of-presence to turn it on,” Weston said.

  • by Tyr07 ( 8900565 ) on Friday September 27, 2024 @02:32PM (#64822409)

    Normally I'd like to avoid cursing and put well thought out words into the world but are you fucking kidding me? No one fucking wants it, no one, no one fucking wants it.

    Ohhhh we made it more secure to add...you missed the part where no one fucking asked for it, and no one fucking wants it. The only person who wants it, is fucking microsoft to collect more data.

    I don't care how secure and proof of security for a feature NO ONE FUCKING WANTS is. It shows your clear deception to gather data WE DO NOT WANT TO FUCKING GIVE YOU.

    Maybe it'll be mega quantum forever secure! Great NO ONE FUCKING WANTS IT STILL. The miscommunication, is we don't fucking want it.
    Address that concern by fucking off.

    • Time will tell. Microsoft is giving the users the ability to uninstall it, completely. https://www.theverge.com/2024/... [theverge.com] let's see after release if you're right, or if (as I suspect) only a few vocal minority of people don't want it / give a shit enough to care about it.

      By the way I remember the iPhone announcement here like it was yesterday. I'm sure someone said NO ONE FUCKING WANTS IT in all caps when they were shown a phone without a keypad as well. More power to you as an individual but I suspect you a

      • by narcc ( 412956 )

        Yes, odds are good that users won't know about it or understand it. That doesn't make it okay. That makes it far more nefarious.

        There's a reason that this is "opt-out" and not "opt-in". They're trying to force it on as many people as possible, most of whom don't understand what it does or what danger it presents. Do you honestly think this is a good thing? Do you not understand the problem?

        Also, Microsoft has developed a habit of changing user preferences after normal updates. They also make it difficu

        • That's why in our organization Windows Update is considered harmful. We block it actively using both the perimeter firewall, group policies and third-party utilities. Windows machines don't face the Internet directly, plus their built-in update-needing Internet client crap like Edge, Onedrive, Defender etc. is disabled, so we're not really in danger. Once a year or so, we allow Update to run, review the crap it has brought, and disable it again. YMMV, but for us this works very well

    • This was never going to go away. Microsoft has bet the farm on AI. An AI needs context (that's the prompt text you type into ChatGPT).

      A recall feature collects your screenshots and words you type in a textbox and the sequence of icons and menu items you click on for context, so the AI can complete your actions instantly.

      No recall == No AI == No Microsoft.

      BTW, this is not just a Microsoft thing, all the other AI personal assistant peddling companies are looking for ways to use or implement a recall sy

    • by jmccue ( 834797 )

      No one fucking wants it

      Correct, but you and every one here knows exactly how to avoid Copilot and Recall. But do not make the jump to a Free OS for 100% usage. So you get what you get and you have no one to blame :)

      If enough tech people refuse to use Windows at home and at work, an then they tell their friends and family to avoid windows at all costs, Microsoft may just change. But more then likely people will realize they were being abused by M/S for decades and be quite happy with their new environment.

      • by Tyr07 ( 8900565 )

        Correct, but you and every one here knows exactly how to avoid Copilot and Recall. But do not make the jump to a Free OS for 100% usage.

        Yes and no. For work I'm stuck with Windows, for my personal PC, oh do I love me my linux, okay, sure I stick to ubuntu for my daily driver as I don't want to get all bashfu on a daily basis, but I agree with you though, that's exactly the problem.

  • by sjames ( 1099 ) on Friday September 27, 2024 @03:10PM (#64822519) Homepage Journal

    The risks of screenshot data being targeted is ZERO if there is no screenshot data. Anything above that is not an example of minimized risk.

    They mean they THINK they made the risk smaller but if the customer doesn't even want the feature, the risk/reward ratio is still infinity.

  • The data we generate on our computers is worth trillions to a AI trainer and Microsoft is going to get that data whether we like it or not. The time to stop this was back in 2004 during the Bush v Gore election. It was one of the smaller issues that folks didn't pay attention to.

    Gore was in favor of continuing the antitrust fight and Bush had made it very clear he had no intentions of doing so. George Bush won and so Microsoft was never broken up and so we have no significant competition in the PC marke
  • What's this process called ThirdEye.exe that shows up in Task Manager?

  • Interesting sentence in the title. It could be read to mean that some windows are controversial, and they recall the returns from a certain AI search tool.
  • A feature no one wants and everyone hates yet they are dead set on forcing it on everyone. This is just such a weird combination. Have we really reached the point at which hated features that no one wants are forced on users? Why?
  • Proof of presence is not some crypto function, it requires some kind of hardware to detect the person or for the person to enter some code/key. If the person does not enter the code, there is no proof of presence. If there is no hardware that can detect an actual person, then it could be a robot or software attack. Is this tied to biometrics? That would be stupid based on the research into the flaws in biometrics.
  • A store tries to sell you a phone that "records all your conversations for your own good, lest you forget something", and sends them to the cloud under escrow. The cloud is super-duper secure, and only you can access the recorded data (or the authorities, of course, but only with a court order). Will you buy this? Think carefully.

    I personally, would tell the seller to shove it up his azz. How about you?

  • Check out this recent revelation about Google from noted mobile expert Cindy Krum. It details how your chrome is being used by google to render pages and send them back to Google They have found private urls behind steep firewalls in Google, and the only way they could have got them was via chrome. https://youtu.be/txNT1S28U3M [youtu.be]

This is now. Later is later.

Working...