Create the Next Generation of User Experiences with Text Generation @ Let's visionOS 2024 (ENG sub)

This is my talk at the Let's visionOS 2024 Creators Conference. In this video, I introduce how to get started with LLMs and demonstrate a practical way to integrate text generation into your app. I hope to inspire you with different ways of using LLMs 😊
This is my first talk, and I was super nervous, so I feel like I didn't explain some ideas well. Therefore, I made some improvements in the subtitles. Please use the subtitles as the source of truth! 😅🫣
✨ Timestamps
00:00 Inspiration for this talk
04:15 App Demo
05:40 Technical overview of the implementation
07:58 Understanding LLMs and recommended models for beginners
10:54 Why I chose Qwen 1.5
12:38 Meet the parameters of text generation
14:14 The value of a good prompt
19:02 Formatting prompts correctly and using ChatML
22:44 Prompt Engineering: Getting JSON responses
25:26 Prompt Engineering: Fixing incorrect dates
27:44 Introduction to function calling
30:26 Other Prompt Engineering tips
31:15 Is text generation production ready?
32:13 Creating a convenient user experience
33:06 Summary
#LetsvisionOS #LLM #AppIntents

[@ChaoCode]

既緊張又興奮地跟大家分享我的第一個 talk 🤩這個 talk 我真的是花了超級多時間準備，直到上台前一刻都在改⋯⋯某種意義上非常痛苦的經驗😂 但還是很謝謝主辦人思琦給我這個機會，讓我學了 visionOS 開發，也長了很多膽量 😳
老實說有很多地方聽了好講剪掉重錄，但我想還是要維持實際的樣子才可以鼓勵大家也站上去分享 🫣 然後裡面分享的 AI 模型部分，雖然才過一個月但我覺得現在已經又有新的一批更優秀的了，只能說這領域進展太快，大家可以到 HuggingChat 來看現在熱門的開源模型～然後 LLM & Prompt Engineering 的知識是一直都可以套用的 😊
希望這個 talk 分享對大家有幫助！

[@user-qd5nd9iz2y]

每个视频都能让我学习，太优秀了

[@wsoundfancier2914]

超讚的:)

[@VinaMelody]

Wonderful 👏🏼👏🏼! A talk becomes practical when you share struggles and challenges to achieve goals. That way, others learn from those pitfalls you went through.
I can totally related to your thoughts process on why Qwen, why Intents, why not Siri.
Well researched about tokens and computing power thing! I started to get lost when you start talking about JSON prompt haha because I haven't really play around with those areas. Way to go, Jane!

[@sherry12010114]

講的超級棒的❤

[@lfan_tv]

哇 Jane 太酷啦❤ 谢谢分享

[@birdmichael126]

终于出了~

[@user-rr2xq2fs9o]

认真学习，讲的很棒

[@jyman]

Jane讲得好棒啊 👍 AI的应用给App带来了很多的可能性。很有启发意义。谢谢分享！

[@funclosure]

嘎嘎嘎🦆 😂👍

[@kuo2322]

這想法很讚，沒有想過可以這樣串接，覺得受益良多，受我一拜 🙇‍♂
我也有嘗試實作這個 pattern，想請教一些細節
我目前理解是 speech recognizer -> LLM -> App Intent，不太知道 SiriKit 可以放在哪邊，想問看看這塊可以怎麼串接呢？

[@ChaoCode]

我沒有用 SiriKit 哦，假如你的版本支援 AppIntents 的所有功能的話，可以考慮 migrate 成 AppIntent～用 AppIntent 要搭配 Siri，主要是要搭配好 AppShortcutsProvider，設計好句子、參數和 App 別名

[@kuo2322]

@@ChaoCode 了解，感謝即時解惑

[@gowild4955]

有鋼鐵心的味道了
Vision pro上市會弄一臺
來拍教學嗎？
那真的是未來

[@ChaoCode]

會拍教學 但這個價錢買不下去😂😂

[@user-ex4fs7kt8q]

你比我想像中的還要優秀！嘎嘎嘎😄

[@user-nh5dn1he8z]

小妹好利害❤

[@qianqian888]

[@GoogleZF]

在大家面前使用Vision Pro的感覺好羞恥

[@ChaoCode]

當大家都這麼做就不奇怪了😂😂 還有參會的人全程都戴著😎