cross-posted from: https://lemmy.world/post/16391311

Andrej Karpathy endorses Apple Intelligence

Actually, really liked the Apple Intelligence announcement. It must be a very exciting time at Apple as they layer AI on top of the entire OS. A few of the major themes.

Step 1 Multimodal I/O. Enable text/audio/image/video capability, both read and write. These are the native human APIs, so to speak.

Step 2 Agentic. Allow all parts of the OS and apps to inter-operate via “function calling”; kernel process LLM that can schedule and coordinate work across them given user queries.

Step 3 Frictionless. Fully integrate these features in a highly frictionless, fast, “always on”, and contextual way. No going around copy pasting information, prompt engineering, or etc. Adapt the UI accordingly.

Step 4 Initiative. Don’t perform a task given a prompt, anticipate the prompt, suggest, initiate.

Step 5 Delegation hierarchy. Move as much intelligence as you can on device (Apple Silicon very helpful and well-suited), but allow optional dispatch of work to cloud.

Step 6 Modularity. Allow the OS to access and support an entire and growing ecosystem of LLMs (e.g. ChatGPT announcement).

Step 7 Privacy. <3

We’re quickly heading into a world where you can open up your phone and just say stuff. It talks back and it knows you. And it just works. Super exciting and as a user, quite looking forward to it.

https://x.com/karpathy/status/1800242310116262150?s=46

    • iltg@sh.itjust.works
      51·
      6 months ago

      comparing with mullvad is ridiculous and just shows how much you drank the apple juice without questioning

      • mullvad doesn’t hold your contact info, like apple right?
      • mullvad is open source so you can independently verified which data is being sent, just like apple right?
      • mullvad claims to not log anything, like apple and their csam thing on icloud right?

      “leave alone the multi billion dollar corporation” energy

        • Synapse@lemmy.worldEnglish
          31·
          6 months ago

          Apple doesn’t send your contact info or other details into the cloud, all that shit is anonymized.

          Are you sure about that ? It is written in their Legal Privacy Policy in the chapter “Personal Data Apple Collects from You”:

          Contact Information. Data such as name, email address, physical address, phone number, or other contact information

          Doesn’t seems so anonymized to me…

    • Synapse@lemmy.world
      86·
      6 months ago

      No source-code, no trust. How good is my data on their super secure servers if they have the encryption keys.

      How good is a 3rd party scrutiny if those are mandated and paid by Apple to make the audits?

      • Ptsf@lemmy.world
        1·
        6 months ago

        You almost certainly run all of your software on code you lack access to the source for. Firmware and etc has been completely proprietary for ages. There’s even a tiny proprietary os embedded in almost every processor on the planet. Your statement lacks context of computing and shows a misplacement of trust.

        https://www.zdnet.com/article/minix-intels-hidden-in-chip-operating-system/

        https://en.m.wikipedia.org/wiki/AMD_Platform_Security_Processor

        • Synapse@lemmy.world
          12·
          6 months ago

          Intel and AMD security platforms are shit, I know they exist, I don’t trust them either, but the threat model is very different from this AI application. They don’t upload my photos to a server out of my control.

          • Ptsf@lemmy.world
            1·
            6 months ago

            They’re not just security platforms. They’re low level computer systems with entire bespoke operating systems and better-than-kernel level access to the system (networking, etc). You have no idea what you’re talking about. Please inform yourself.

            • Synapse@lemmy.world
              1·
              6 months ago

              I may not be very well informed about it, I admit. Would you have documents to share ? All I seem to find about Intel security engine is about how closed it is and how it has been exploited by bad actors in the past to gain elevated privileges in targeted hacks. It sucks, that’s for sure. But it doesn’t have much to do with the mass data collection employed by Google, Apple, Open AI, etc.

              • Ptsf@lemmy.world
                21·
                6 months ago

                I unfortunately don’t have much to share beyond a decent understanding of compute systems at an enterprise scale (where we utilize these low level subprocessors to do various things such as gather asset data or deploy operating system configurations, see: https://en.m.wikipedia.org/wiki/Intel_Active_Management_Technology). The point I’m trying to make though is that current operating models don’t allow for system trust. If you can’t trust apple with high level data like that needed for llm models on-device (which is how they’ve configured it, requiring a specific user approval and interaction before forwarding minimal data to private process servers) then you shouldn’t trust any device that lacks a complete open boot/firmware/ and OS stack because if these companies were going to exploit your data that egregiously, they already have the lowest level (best) access possible to a system that can transparently (without your knowledge) access encryption enclaves, networking, and storage. Truly open alternatives do exist by the way (see Coreboot, etc) but you’re going to be looking at devices 10-20 years old since almost the entire industry runs proprietary at that level and it takes time for the less heavily funded community players to get up to speed.