Drive better gameplay experiences on user devices with AI | GDC 2024

EDIT: Missing in the video at [02:08]: example use case for context here is “Speech-to-text”.
In this session, we show how Sentis brings new game features to life with simple AI model integration, as well as some exciting integrations with Hugging Face, the largest hub for AI models. Three demonstrations along with detailed technical explanations include an indie developer using hand gesture detection, a new way to build training board game opponents, and a cute story generated with language and text-to-speech models in real-time. The presenters also share the latest innovations from the team to make Sentis a performant and easy-to-use inference tool in Unity 6.
Learn more about Unity Sentis: unity.com/sentis
Speakers:
Bill Cullen, Principal Product Manager AI (Unity)
Alexandre Ribard, Lead Staff Engineer AI (Unity)
#unity #gamedev #madewithunity #ai #unity6

[@infiniteland.1442]

What percentage of Unity users do you estimate will adopt this technology? Is it worthwhile for the team to invest their time in this particular model of work, especially when it lacks substantial feedback from the community? It seems more beneficial to prioritize improving existing tools or developing new ones that address pressing needs. Many of Unity's current tools require enhancements to become more user-friendly and ultimately contribute to creating visually stunning games.

[@natsunwtk]

To think this channel have so many supposed to be useful but not as good as it supposed to. And also have potential to stimulate many potential games by making courses for various of full game making and let people learned for free then let them use the engine to create many good games later (because you just teach them the useable skills but their are more advanced by other people who making courses) then your engine would be more popular and successful. Instead of wasting it like all these years.

[@cepreupupkin2218]

Пересказ нейросетью YandexGPT:

[@Hypersniper05]

Now I remember why I moved away from onnx, no support for 4bit quants. I would rather run a bigger model at 2 or 4bit with a hit on precision but double the parameter count

[@JamesGretz]

Loads of new features, but the day Unity will focus more on graphics, or to be more specific, Real-time lighting and shaders especially in URP as well, it will be a breakthrough. Just imagine there has been no proper Subsurface scattering shader yet in URP and not everyone wants to switch to HDRP just for a few features that are very possible but lacking in URP, for example why not just implement realtime-raytracing in URP once if an equivalent to Unreal's Lumen is not yet possible. The slow development of URP on basic features is a stumbling block. Another big breakthrough would be to have an in-engine modeling tool. Almost every game dev knows the time consumption of having to iterate between 3D applications, and keep exporting 3D models whenever changes are made. Just not Pro Builder but a proper mesh editor in development for faster level design. Pro Builder has shown that it's possible and Unity has a lot of potential.

[@superstarsonder]

great

[@Reafuse111]

cool demo

[@oo--7714]

Only good for ai anime waifus

[@lucas_skateboarding]

Please help! I 4 errors in Unity 3D

[@GET_YOUTUBE_VIEWS_m054]

"I am really enjoying this song 🎧 🔥🔥🔥🔥🔥🔥🔥🔥🔥🔥🔥