Apple's Ambitious Plan for No-Code Apps Using Siri: Hype or Hope?

Apps are as diverse as the tasks they help us accomplish. A to-do list app is a world apart from a first-person shooter game, just as an app for hailing a taxi or booking a hotel room differs vastly from one that allows you to craft 3D objects. These differences highlight the complexity and multidisciplinary nature of app development, especially for larger projects.

Take Instacart, for instance. It's more than just a sleek interface. Yes, it boasts a comprehensive product database, an e-commerce system for handling transactions, and a messaging platform for customer-shopper communication. But dig deeper, and you'll find a robust infrastructure of partnerships with food outlets, enabling real-time inventory updates and allowing shoppers to navigate store aisles efficiently. It also features sophisticated mapping and route optimization tools to streamline the shopping experience.

The Apple Vision

This brings us to the intriguing concept of "vibe coding" apps with Siri, a topic recently covered by 9to5Mac. The article discussed Apple's exploration of a feature where users could instruct Siri, via voice commands, to create AR apps for the Vision Pro headset, which could then be shared on the App Store. While this idea was discussed among Apple executives, it hasn't been implemented yet.

At first glance, the notion might seem far-fetched. After all, Siri often struggles with simple tasks like accurately transcribing text messages. The idea that it could handle something as intricate as app development seems a stretch. However, if we consider the potential advancements in Apple's AI capabilities, akin to those of ChatGPT or Google Gemini, the concept becomes more plausible.

I've seen firsthand how AI can excel at coding tasks. In recent tests, both ChatGPT and Gemini Pro 2.5 demonstrated impressive capabilities. So, it's not entirely unrealistic to think that Apple could develop a Siri with comparable prowess.

To make vibe coding a reality, we need to consider three key factors: technology, Apple's approach to coding, and managing expectations.

The Technology is Here

The idea of creating an app from a simple description isn't new. I recently showcased how GitHub Spark could build a code analysis tool from a single sentence. While the interface wasn't perfect, the AI successfully created a functional app. Similarly, when ChatGPT first gained popularity, I asked it to develop a full WordPress plugin, complete with a user interface, and it delivered. The technology is already here; it just needs refinement.

Apple's History with Empowering Citizen Developers

Apple has a long history of supporting developers, yet it sometimes misunderstands the essence of development. I remember the excitement around the Apple II, which came with BASIC, making programming accessible to beginners. When the Mac was introduced, Apple provided detailed guidelines to help third-party developers create apps that felt native to the platform.

Apple's first major low-code offering was HyperCard, which allowed users to create applications with minimal coding. I started a company that supported HyperCard developers and even ran a project for Apple. However, there was a disconnect within Apple. I recall a conversation with HyperCard's product manager, who believed that users didn't want custom applications. Yet, I spoke daily with people from various professions who were eager to build apps to streamline their work.

Apple has since introduced other low-code tools like Automator, Shortcuts, Playgrounds (part of Swift), and Xcode Interface Builder. They also experimented with AR creation tools like Reality Composer, which enabled drag-and-drop 3D asset placement and basic interactions without coding. These tools empower "citizen developers"—individuals willing to learn coding to achieve specific goals.

Managing Expectations

The challenge with AI coding for the masses lies in managing expectations. The dream of creating a billion-dollar app with a single command is unrealistic. However, AI tools can certainly assist in maintaining and improving existing code.

Vibe coding is possible, as demonstrated by GitHub Spark and the WordPress plugin example. Drag-and-drop interfaces can also facilitate interactive experiences, as seen with Reality Composer. The crucial question is: What kind of app can an AI realistically build? How much effort are you willing to invest? And how well does the AI handle iterative improvements?

AI struggles with incremental changes, often altering fundamental aspects between iterations. While it's feasible for non-coders to build AR and VR environments, complex applications like those used in spinal surgery require experienced teams.

Vibe coding works well for certain applications, particularly forms-based apps, but not for large, complex projects that drive major businesses.

Painting the Vista

In marketing, "painting the vista" involves creating a vivid image that captures the essence of a product and ignites the imagination of potential users. The idea of vibe coding Vision Pro apps with Siri is a bold vision, especially given the device's sales struggles. Enabling users to create their own applications could be a game-changer, particularly if the device hasn't sold enough to attract commercial developers.

However, Siri still has a long way to go before it can be trusted with even basic tasks like sending texts. Yet, the concept of low-code, AI-supported app development for AR and VR isn't out of reach. The technology exists; it's just a matter of refining it and setting realistic expectations.

Bottom Line

While the idea of vibe coding a Vision Pro app with Siri isn't far-fetched, it requires further development. It's important to understand the capabilities and limitations of these tools. While Apple might not approve a flood of amateur-coded AR and VR apps for the App Store, there's potential for remarkable creations by non-professional coders.

So, could you see yourself building an app by simply describing it to Siri? Have you experimented with low-code or no-code tools like HyperCard, Shortcuts, or Reality Composer? Do you think Apple's vision is on the right track, or are we painting the vista a bit too vividly? Share your thoughts below.

You can follow my day-to-day project updates on social media. Be sure to subscribe to my weekly update newsletter, and follow me on Twitter/X at @DavidGewirtz, on Facebook at Facebook.com/DavidGewirtz, on Instagram at Instagram.com/DavidGewirtz, on Bluesky at @DavidGewirtz.com, and on YouTube at YouTube.com/DavidGewirtzTV.

Get the biggest stories in tech every Friday with ZDNET's Week in Review newsletter.