Siri On The Mac

It may not seem like it, but Siri was introduced almost five years ago with the iPhone 4s and iOS 5. Since that time it has been made available across all of Apple's iOS devices, as well as watchOS and tvOS, but it never made its way to what was then called OS X despite the yearly rumor that it would do so. With the introduction of macOS Sierra, Siri has finally been introduced for Apple's desktops and laptops, which means that it's now available across Apple's entire product line.

Why Siri took so long to come to the Mac is a question that probably doesn't have a single simple answer. I believe that part of it simply has to due with Apple's increasing focus on iOS leaving the Mac as a lower priority platform for improvements. However, it's also reasonable to assume that making Siri truly useful within the macOS environment required additional work on top of simply bringing it over from iOS. With an operating system like macOS there's a greater opportunity to use Siri for finding files and performing actions that don't really have a counterpart on iOS, which means that Siri's implementation becomes much more complex and requires the ability to respond to a much wider variety of situations and commands than what can be done on an iPhone.

Like Siri on iOS, you can make queries that pull information from the net or from local content like your calendar. Above you can see the often used example of an image query from the web as well as a calendar query to see what my meeting schedule looked like the next day. I've found this to be somewhat hit and miss depending on what you search for. For example, Apple was able to correctly pull an upcoming flight from my emails and automatically add it to my calendar, yet when I asked Siri when my upcoming flight to Toronto was she just responded by searching the web for flights to Toronto.

Web content pulled in through Siri is interesting on the Mac because you can actually interact with it and move things from Siri's results into other applications. For example, if you make a query where the result is a group of images you can actually copy and paste or save those images without having to first open them in a web browser.

In my experience Siri has problems understanding context and semantics. For example, you can see that my test laptop was configured for the US region so it's using some sort of incomprehensible values for the temperature. When I asked Siri to "get" me the results in celsius, the query failed because Siri didn't understand what I meant. When I asked Siri to "give" me the results in celsius, the query was understood. The problem here is that as a user, I'm not really distinguishing between Siri getting me something, and Siri giving me something. Within this context, the meanings were basically the same, but Siri was unable to properly comprehend this. As far as information retrieval goes, until you can truly speak to Siri in natural language without having to mind what phrasing you use it's always going to have more friction than simply asking a search engine for the same information.

One of the features that distinguishes Siri on macOS from the iOS version is the integration with the file system. You can use Siri to query files no matter where you've stored them, while on iOS there's not really an accessible file system and you can't use Siri to search for documents. Above you can see how I looked for a note that I created a couple of days prior.

In situations like the one above you may want to keep track of the information Siri gave you for referencing at a later date. To do this Apple provides the plus button on the top right corner of each bubble of information that Siri presents, which allows you to pin the result right into the Today View. I can see situations where this would be useful, but since this test laptop isn't something I use for development I haven't yet come across that sort of situation in the real world.

When Apple demonstrated Siri for macOS at WWDC they showed how it can be used to search for files, and how Siri understands additional commands based on the context of previous ones. There was an example of Siri searching for files, and then narrowing it down based on a very specific query involving when the files were last edited, what their content was about, who they were sent by, and how they were tagged. If Siri could reliably perform such actions it would definitely be helpful in finding specific files without having to look through your disk with Finder. Unfortunately, I haven't had near as much luck with complex commands as Apple did in their demo. Above you can see me searching for the files that I modified on a given day, and Siri is not successful in narrowing it down to only the Swift files. If Siri can actually query a file based on a complex list of requirements relating to its metadata, it should be able to do something as basic as narrow down results based on the file type.

You can also see in the left image above that Siri for macOS can mangle the voice transcription pretty badly. This has been a recurring issue for me on the 13" MacBook Pro that I've been testing on, and I never have this many problems with Siri on Apple's mobile devices. I'm hoping that this isn't due to the fact that the microphones on Macs haven't been designed and positioned with Siri in mind, but I can't rule that out as a possibility either so I'll have to see if things improve as macOS moves closer to release.

Right now Siri feels very beta on macOS, but given that macOS is a beta in itself that's not really unexpected. I think Apple has some work to do with the system integration, and it's actually not clear to me how much happens on the back end and front end respectively so it's hard to say whether Siri is in a good position to be properly functioning by the time macOS Sierra goes live in the fall. It is clear that Apple is adding features as the beta progresses, with an example being the addition of Siri Search for the Photos app in the second developer beta. Right now I can say that Siri is here, and Apple appears to be on their way to making it work as advertised, but I'll reserve any final judgements for when Sierra sees its stable release.

Introduction Window Management: Tabs And Picture In Picture
POST A COMMENT

81 Comments

View All Comments

  • WaitingForNehalem - Wednesday, July 13, 2016 - link

    It would have been nice to cover improvements to the kernel and the new file system...you know the important parts of an operating system. Reply
  • Brandon Chester - Wednesday, July 13, 2016 - link

    APFS isnt even shipping until 2017, it's not a Sierra feature. Reply
  • damianrobertjones - Wednesday, July 13, 2016 - link

    Whatever you do Apple... DO NOT give this update away for free as the entire internet, or a selection of loud mouthed people, will slam it and refuse to update. /s (Windows 10 anyone?) Reply
  • theduckofdeath - Thursday, July 14, 2016 - link

    Yup, with a rate outpacing the previous fastest ever adopted operating system-release by around 145% is a massive failure, amirite?!...
    I know a small but loud group wanted to create the impression that no one updated to Windows 10, but that attempt failed miserably, like most internet trolling attempts tends to do.
    Reply
  • Ascaris - Sunday, July 17, 2016 - link

    145% for one month, when no other version of Windows has been a free upgrade before, so all of the early adopters that might have had to wait to afford it don't have to wait-- yeah, that's quite an accomplishment. What about the heaps of people who resent MS for what they've done, and are more likely than ever before to jump ship to Apple or Linux? I remember the browser wars, the introduction of WGA, Windows Vista, Windows 8... but I don't remember there ever being this level of contempt for MS and the product in question than there is now. Is alienating all of their customers part of some kind of grand plan? If I were a MS competitor secretly plotting to destroy them, I don't think I would do anything different than MS has.

    But yeah, plenty of people upgraded to Windows 10-- though their target of a billion devices by ($date) won't happen, as they've admitted, but there have been a bunch. Many of them are people who were not tech-savvy enough to know how to block 10, and they're not happy about it. So much for people using Windows because they want to and not because they have to!

    There's a difference between giving something away and essentially forcing people to take it even as they tell you they don't want it. I've never liked Apple, but they've never stooped to using malware techniques and dark pattern trickery to get people to upgrade to something free. They stick to that old-fashioned method of trying to produce products people want so that they'll buy them. Microsoft has a different idea-- make something no one wants, then force them to upgrade with dirty tricks.

    Oh, and the growth rate of Linux last month (as reported by Netmarketshare.com) was 30% higher than that of Windows 10. Another Microsoft achievement!
    Reply
  • Commodus - Tuesday, July 19, 2016 - link

    You're being a bit hyperbolic. It's not that no one wanted to upgrade to Windows 10, it's that there's a significant minority that doesn't... and isn't happy that Microsoft used underhanded tactics to upgrade some people without their explicit consent.

    There are very real stories of people who didn't realize that Windows was set to auto-upgrade and came back to see their PC running Windows 10. I'm sorry, but that's just not cool -- even Apple with its relatively aggressive upgrade strategy won't automatically install the latest version of macOS.

    It's a classic example of letting business goals override what the user wants.
    Reply
  • ex2bot - Friday, July 15, 2016 - link

    Mac OS updates have been free for years now. And there is a vocal minority who refuses to update past 10.6. Reply
  • Hyper72 - Monday, July 18, 2016 - link

    Not that it have much relevance; but the app store always suggests me to install latest free version of OS X. It's too bad it immediately fails as my 2006 MacBook Pro C2D doesn't run anything more recent than Lion. That means I can't run latest X Code, so only way I can try out Swift is in a Linux VM which doesn't target iOS or macOS - sigh. Reply
  • Meteor2 - Wednesday, July 27, 2016 - link

    It might be time to replace your ten year old computer. Reply
  • wsjudd - Wednesday, July 13, 2016 - link

    For anyone curious what the YouTube link spotted in the Messages screenshot was: https://www.youtube.com/watch?v=ETfiUYij5UE Reply

Log in

Don't have an account? Sign up now