Introduction to Dream Machine from Luma AI
Vložit
- čas přidán 5. 09. 2024
- Website: lumalabs.ai/dr...
Blog Post: blog.lumalabs....
Dream Machine is an AI model that makes high quality, realistic videos fast from text and images. It is a highly scalable and efficient transformer model trained directly on videos making it capable of generating physically accurate, consistent and eventful shots. Dream Machine is our first step towards building a universal imagination engine and it is available to everyone now!
We are hiring! Join our team: lumalabs.ai/join
please remove the video from website background, its slow down all . its also heavy load for your website. no need that video
True
agree
By YouSum Live
00:00:08 Introduction of Dream Machine model
00:00:34 High-quality text-to-video generations
00:00:47 Emphasis on reasonable generation times
00:01:09 Dynamic and coherent motion generation
00:01:15 Consistent characters and physics understanding
00:01:31 Innovative camera motions beyond static angles
00:01:50 Image to video capabilities enhance creativity
00:02:30 Excitement for user creativity and future developments
By YouSum Live
This is beyond amazing. WOW!
I really like Dream Machine so far, It's had some untestable issues with traffic and queue. My big complaint there should be a daily allowance of free credits and not monthly, it could be as low as one or two day that build over time and caps out at like 30 or something. This would give Dream Machine a bit more like a Suno model to generation.
This shouldn’t be paid at all. This is what turns people away from such technological feats
Can't wait for prompt guides, deep dives, and UI features!
How can I delete the generated videos? Is there no such function?
I found you couple days ago. Your works are incredible. I wish I could be part of your team
I just received this email message from Luma, I
thought I should share it: At this time, it is not
possible to delete Dream Machine generations.However, we are actively working on adding this feature. A Ul update that will introduce the ability for creators to delete their generations is currently in development.
Rest assured, your creations remain private and
cannot be viewed by others unless you choose to
share them.
Stay well,
Navi
Oh thank god, I've asked them for help via email and still got no respons. it's a relief to know that. Thanks for sharing 🙏
It has mastered physics, but not biological movement. I think you're going to need RLHF, to provide the biological feedback. You have a facility where it can generate videos frame-to-frame. It's basically gonna have to use Q-learning to estimate the score it gets from human estimation of the quality of the generated video (you're basically gonna have to find social media type photos which are relatively easy for the algorithm to transition between, which don't have any actual video frames for a diffusion model to learn. You use a "many heads" human feedback mechanism to get an estimate on the quality of the generated video (above 9 is perfect, indistinguishable from real life), then you use q-learning to have the model estimate the score. Over time it learns to estimate the score it's videos will get, and learn to produce videos indistinguishable from real life. Then you have to reduce the temporal resolution, increase the temporal length, train the traditional diffusion model (to predict the same frame at time step t as the RLHF original model, but lower temporal resolution, higher temporal length), then when it's trained, you repeat the RLHF process in the same way, q-learning to get it to understand biological movement. Then the same again, etc, etc. until you hit the model's limit in temporal resolution/temporal length frame prediction. With this process, I believe you will get around the problem the model has with biological movement.
Oh yes, and you also have to train it to predict the reverse frame movement, as well as the forward direction.
I'd like to add, there are also some libraries like deepface (old school machine learning, as well as newer techniques), which can detect consistency between faces. Could disassemble frame-to-frame from a generation, and calculate consistency metric between faces. This metric is being calculated by a Neural Network anyway (like VGG), it can also potentially be learned and added to the token list, to ensure more consistent faces between frames.
Wow some of those generations look amazing!
I appreciate and am pleased with the success of your Dream Machine in recent days. A great success.
If possible, try to expand the processing spectrum somehow, the creations take a long time to wait, plus they are now limited to only five for free accounts.
I recommend adding options such as negative prompts and giving the AI the possibility to identify "eyes, mouth, nose, legs and arms, cars, trees, etc", also an option to "stay true to the shape" of a given object or character face so that it varies as little as possible.
This could help AI, not only to improve results but also to perceive better when composing something.
It is true that the more one uses it (a lot in the last days) the more it learns and the better things it does.
But I think these additional options would give it an interesting boost.
Keep it up. This is very promising.
Add delete the videos, not because you create these tools that don't let you delete things, if I don't like the work it should be deleted and not registered
yes,i havev same question,they don't allow delete all videos what you create,it's unfair and also private videos,it's terrible
Hello one, if I order you for a month, how many minutes can I make a video?
@@zhangzhang9112yeah i also want to delete a video. I've asked them for help via e mail, still got no respons. Please add the delete button Luma
I've been waiting for a whole day and still haven't received the generated results. ... please think for people who does not have money yet.
I've been waiting for 2days now 😢😢
@lumaAI, Team, I want to make an observation about frame drops in Release 1.5. The videos become laggy and have severe frame drops in all motions. I could not find a support link to report the issue.
I am telling you that if these non-free plans were removed and the waiting list was also removed.. it would be better for all users of your site and specifically your dream machine.. so that your website would be 100% free :)
Thank you for releasing this just weeks before the presidential debates 😃😃😃
Can’t wait to see this model evolve
I honestly didn’t see a single normal prompt so far. It’s not bad but defo not what the ad shows.
Xmas came early this year thanx
?
@@Onion224 Free stuff. I used the links and without to much effort created first vid.
I did a text to video. It was a simple bird in a clear blue sky, slowly flapping its wings. It has been in the queue now for 15 min. Have I done something wrong or is this a typical time frame?
first, great job y'all.
second, would love to know what it looks like on the backend meaning super curious to see how your spikes in traffic have affected times + generations etc
Hello, please help me. I made pictures on this site and I cannot remove those pictures. Please remove the pictures because they will cause me many problems😢😢
Thank you! This is so much fun!
I am having issues with Dream Machine's understanding of physics, and gravity, for instance, dozens of generations of fishes plunging from a basket failed, and fishes are glued, or morphed, or distorted, but they just do not drop from the basket.
Amazing
Amazing 🎉
is there an altarnative to use luma free plan for monitization
This is so, i cant even put words because this is just that damn amazing. Though im wondering, is there any research papers i can find and read?
Luma no me deja entrar dice que debo suscribirme que paso con la versión gratis?
This is great
I love Luma
How do you delete the videos after you are done with them?
I just received this email message from Luma, I
thought I should share it: At this time, it is not
possible to delete Dream Machine generations.However, we are actively working on adding this feature. A Ul update that will introduce the ability for creators to delete their generations is currently in development.
Rest assured, your creations remain private and
cannot be viewed by others unless you choose to
share them.
Stay well,
Navi
Why does the watermark remain for videos created on the paid plans? Your own terms of service states "Customer owns and retains all right, title, and interest in and to the Output and Luma hereby assigns to Customer all of Luma’s right, title, and interest in and to the Output." But no mention of the watermark in your terms of service. It would have been good to make an informed decision before signing up. I did not want to spend money to add a companies logo to my work. I'm trying to get a refund. It's now day 7 without a reply.
You can’t copyright ai work, and also ai videos that aren’t labeled as such might be mistaken for real videos, and there’s an obvious problem in that.
@@DeaconBlu35 Luma have now removed the watermark. The problem is solved as far as I'm concerned. I just want it for my own "original" work. There are Meta data alternatives for tracking, as per C2PA provenance standards. As for copyright that's will be handled differently in every country. It's going to be a mess.
@@brucemarjoribanksYou who already use the platform know how to answer me if I pay for a month and decide to cancel Luma AI, can I still use it commercially? Or I lose the rights?
Hello, I used Luma AI for 2 months, I wanted to spend my credits yesterday because the money was too much and then I canceled the subscription. When I download the videos I created to finish my credits, I see a watermark. But I paid you 39 dollars to make a video without seeing a watermark. Now I'm downloading with a watermark. Can you explain the reason for this?
it's been more than one hour that I m trying to get my prompt and nothing happened
it's truly amazing but the issue is I've been sitting in the queue waiting for a generation for hours now. Literally hours. I'm a subscriber and I thought that might help move things along vs. the free tier but hours have passed and still waiting on that single generation. It was fantastic yesterday but I'm wondering if you'll be able to keep up with demand. For this type of thing to be viable in the real world, I need to be able to iterate multiple generations quickly, like I can on Runway. Any plans to add compute to keep up with demand? Hope so, the few clips I was able to generate yesterday were next level and I'm ready to give you money if you can fix the wait times.
God to hear that paying hasnt helped much. The hype is outrageous for this product. Maybe Microsoft will step in again like they did with OpenAI
@@WillyCash69 my wait time has improved since so maybe it will continue to improve. It is pretty awesome what it will create from a still image.
@@MarkHalski okay, thank you for the update buddy
@@MarkHalskiYou who already use the platform know how to answer me if I pay for a month and decide to cancel Luma AI, can I still use it commercially? Or I lose the rights
@@THX1138-ne6we I believe anything you generated during the month you had the subscription can continue to be used commercially, assuming the subscription tier provides commerical use.
Please help it's showing waitlist
can u add when u want to make the image prompt to be in last frame or middle not just first
Bruh when i made a new account it took me to a Page where i need to subscribe so that i skip waitlist but when i clicked on subscribe it took me to a Page but i clicked on free and nothing happend so do i have to pay to use this ai? Also even i click on create it Takes me to the waitlist😊
good
w bro
🔥🔥🔥🔥
thank you for the free
Can we use our own clips taken on iPhone or Android or pictures. Thank you. 😀
you can upload images taken with your iPhone or Android. Videos are not a feature
So... do I have to pay extra for all of these features, or does it just not actually work that well?
It doesn’t work actually, lit queues are like 2 days long
Very useful
Why can't I create clips quickly?
I tried creating a video two days ago and it's still queuing for two days now, I don't understand
Can’t wait to see video evidence of me committing a crime I didn’t do by next year. real exciting stuff for people who don’t wanna be bothered with actually learning a trade to create something that matters and just want the dopamine of seeing a finished product without touching the process.
All these videos cherry pick out the good examples, but when you actually use it, you realize it's still just as bad as the other video generators... maybe 5% or less of what you get for results are usable for anything at all.
Hello, je voudrais savoir une chose. j'ai payer un abonnement à partir d'un mail et je souhaiterais rentrer dans les paramètre du compte pour changer d'adresse mail. comment je faire ?
@lumalabsai how can I get a one month subscription?
It is hard for me to trust a company that has no customer support. I have two prompts that have been in the queue for two days. It seems to me that they want you to give them your money first to see how well it works. It may be very good, but I need to see for myself before I give my hard eared money to them. I cannot count on a third party that is paid to promote the company to tell me that it is the greatest on the market.
Since a few days ago my videos went from being a few minutes in queue, and now it takes between 5 to 10 hours all of a sudden for a single creation. Who has time for that lol.
Mine has taken 2days in queue 😢😢
hello sir do you have luma ai affiliate cause I want to promote luma Ai in my youtube channel
Pls make it 10 second
He is actually AI
How to delete videos generated by Dream Machine
i can't deleted what i created videos!!!!why???it's terrible,pl answer me
Is this based on Sora ?
*If you guys implement Lip syncing then it's game over*
Can’t wait to recreate will smith eating spaghetti with this AI
can you fix the issue in luma i can only make 5 vid slots but i have still 26 more to go fix ur issue in luma PLEASE RESPOND FIX THE ISSUE
too bad the website never loads smh
Waiting list skip
Guys y does it take for 1 prompt to load 40 Minutes ???????????
😭😭 mine has been loading for 2days now
I've been experimenting with luma image to video on some music videos. Check them out! So far I've found it great for camera moves, but hard to direct any specific character movement. So I've leant into it's weird dreamy qualities.
My face aren't consistent..
I'm just expeting a video of this kind where they end up saying that he is not even real and the whole video was generated by AI
I love you all..
W RIZZ
Damn.
Omg please marry me❤️
luma are you making generations worse on purpose? or am i just getting bad at prompting?
Repair your program!!!!!!!!!! He hasn't been able to upload a video for 3 days!, what a joke!!!!!!!!!!!!!!!!!!!
Yea is the best Model. But 500$ for like Unlimited use? Wtf Pika and Runaway 3.0 ect 100 bdiesonfor 30 40$ and Unlimited for 1 Month like 80-95$ wyhhhhh 500 broooo😢 and free yea 30 per month but wyh to the hell gose Crazy Wait time i wait 8-20 Houers