ChatGPT in an iOS Shortcut — Worlds Smartest HomeKit Voice Assistant

Everything else, including Siri, Alexa, Google Home, and all other “smart” assistants, feels horribly stupid and worthless to me now that I’ve used ChatGPT and GPT-3.

The shocking part is that you can construct one yourself in just an hour!
I thought it would be fantastic if I could replace Siri with GPT-3 because I have a fully developed HomeKit smart home with dozens of lights, thermostats, underfloor heating, ventilation units, cameras, and much more.
The Home Assistant GPT-3, and especially ChatGPT, were “programmed” using language models that were trained on conversational data, making them very adept at comprehending and complying with human commands.

If you’ve used any of these chatbots, you’re aware of how simple it is to ask questions and receive answers in a variety of ways.

different forms of requests
Let’s examine the four request kinds in more detail, using a few examples from the video to illustrate how we will respond to each.

Commanding behaviour
GPT-3 will respond with the action category “command” if it determines that you want to control any component of the smart home.

Also note that the comment sent back is always different and is always personalised to your request!

With this information, we now know exactly what we need to do and we will handle that later in the Siri Shortcut.

You also probably noticed how we have an empty scheduleTimeStamp . This means the action needs to happen immediately, but it is possible to get a response back with this pre-filled with a future date and time if the command needs to happen later.

:: Query action

When GPT-3 detects that you intend to read the state of a device in the smart home, it will respond with an action category of “query”.

Answer action

When GPT-3 detects that your request has nothing to do with the smart home and it’s just a general question, it will respond with an action category of “answer”.

Clarify action

Finally, if GPT-3 was unable to detect any of the three actions, it will ask you to repeat or rephrase your question.

Conclusion

How cool is this?? Being able to create your own smart assistants by simply defining it in plain English is simply mind blowing.

But this is just one example. Imagine all the different prompts you could send to GPT-3 and then all the different actions you could perform in Siri Shortcuts.

I’m almost certain you already have a few ideas around this so please let me know as I’m really interested!

Source: matemarschalko.medium.com

 

Related Articles

Leave a Reply

Your email address will not be published. Required fields are marked *