Google actually beat GPT-4 this time? Gemini Ultra released
Vložit
- čas přidán 14. 05. 2024
- Google just released highly-anticipated LLM Gemini Ultra, along with it's ChatGPT competitor Gemini Advanced. Let's take a first look at Gemini and compare its performance to other popular AI models.
#ai #programming #thecodereport
💬 Chat with Me on Discord
/ discord
🔗 Resources
Gemini Launch blog.google/technology/ai/goo...
Gemini original announcement • Google's Gemini just m...
Gemini Controversial Demo • The Gemini Lie
🔥 Get More Content - Upgrade to PRO
Upgrade at fireship.io/pro
Use code YT25 for 25% off PRO access
🎨 My Editor Settings
- Atom One Dark
- vscode-icons
- Fira Code Font
🔖 Topics Covered
- Gemini Ultra vs GPT-4
- How to use Google Gemini Advanced for free
- Best AI coding tools
- How to use AI tools for programming
- Best models for generating AI images - Věda a technologie
Can't wait to see what you do with Gemini at your fingertips
hi google
first
fingers? I'm sorry to announce he's just an AI..
Hey it's Google
here before the replies blow up
Can we just take a minute of respect for this guy's efforts for keeping us up to date
No. Too long.
you can watch an ad for 30 seconds in his video.. this is shorter and better 😁😁
These bot comments are really everywhere!
No.
I mean it’s kinda part of the role of content creator. It makes content creation goals a lot less stressful when the content you cover keeps getting updates. But I like his work. Let em cook 🧑🍳
*This test is just like my opinion 💀*
*I don't think bro knows how much we value his opinions...*
Or how much we value his humor
Lit af poem is the result
Yeah, that was a Big Lebowski quote, becayse it rhymes with Bukowski :)
The Big Lebowski
Hey we're all here aren't we? XD
2:36 But seriously the gemini picture looks so much more realistic holy shit, the proportions are a little weird but it doesnt have the typical smooth AI look.
Yeah, wins in the realistic category.
but it's ugly
I almost thought we were comparing real life vs what Gemini draw, and I thought "Yeah, that second one isn't realistic enough, looks like an iPhone avatar" then he said Gemini was the left one and I was like damn. That's super good, I can't believe he preferred the second one though.
I think it was “woke AI make ugly girls instead of unrealistically hot girl”
@@deppudeppudeppu which is how the real world is lol
Fun fact, Gemini won't even solve high school chemistry problems (I tried IUPAC naming) because it could be used in wrong ways (I did try many different questions and it kept insisting the same). Sometimes prevention can lead to impracticality
Chatgpt gave me the triperoxyde triacetone synthesis reaction
Someone should make a model that for every request, instead of giving the answer, would explain why your request is morally wrong and why it won't do that. Can't get more aligned than that.
@@xviii5780 So like Gemini advanced?
@@Erik-cl5ff More like Gemini Superwoke
it can though , in my case it did
The Gemini JS Bukowski poem was amazing:
Whiskey-soaked functions, a mess on the page,
Curly braces like scars from a coding cage.
The semicolon, a drunkard's forgotten pause,
Logic stumbles, crashes, defying all laws.
Promises whispered in asynchronous nights,
Errors like cockroaches, scuttling from the lights.
The browser's a stage for this tortured design,
DOM elements twisted, out of all line.
Callbacks and closures, a mind in a whirl,
"This" and its cousins, they make my head swirl.
Yet out of the chaos, a flicker of grace,
A button that works, a smile on my face.
The code might be ugly, the soul bruised and bare,
But it runs, goddamn it, a triumph so rare.
So raise a cheap coffee, a toast to the fight,
In JavaScript madness, we forge our own light.
--transcribed by GPT4 ;)
Ah, already demoted to a scribe.
That's grand
@@ThePookaHarveylets see what gpt5 can do ,😉 also this poem aside gemini seems to be more filtered...
I paused to read what it gave, and yeah, it's actually really good. It somehow captures some of the pain of working with JS, and the elation when it finally works. Very impressive.
this is major problem. chatgpt has no problem with weed , lsd and low harm drugs but gemini fails when i mention alcohol@@hibou647
"Big DICT in the middle" - You would think I would have matured past the involuntary response to COL (chuckle out loud) at that one... Nope.
if that's COL then what's COBOL
I laughed way too hard than I should have.
@@kipchickensout COBOL (Confidently Opine Because Of Laughter)
subtitles have it corrected
same here :D
Bro is working as Wikipedia but in a sarcastic way
Videopedia?
firepedia@@markm0000
Pics or it didnt happen
is not part of a wiki..
Atleast he is not biased like the stupid wikipedia.
Wiki is not a source. You learn this in 5th grade if your education system is even half-assed decent.
You get to learn what real sources are ~9-11th.
One of my favourite coding tests is now asking them to refactor or improve some code. It’s subjective sure, but it really lets you test some of the creativity and understanding of the models
Yeah that's the thing I use the most. When I do code reviews and don't like some methods I'll ask chatgpt to reduce complexity for me. It does a great job. Until now Bard was just worse in that. Let's see if Gemini ultra dies better
@@enjintft Your dev's must like you. Why not have them do that as part of the code process rather than you?
@@deanwilliams433 I don't do it on every method but sometimes I feel like they lack the understanding on what to do. So I give them a how and why. But you are right I won't do that forever. The team is like 4 months old. Educate them a bit and if they make the same mistake again I'll just add a "fix this"
I often ask for a one-liner when I know my 5 chonky lines can be condensed but can't be bothered to spend two weeks learning LINQ syntax
Yup. “Can you make it simpler” is always the best prompt for me. Some do it well, others somehow make a 2 line modification a whole new function and 25+ lines.
I'm impressed by how fast this video is published;)
It was generated by Gemini
He said in the video he got it early.
Bot
yep.. its another bot being falsy nice
I just knew after I commented on this that he had early access, stop I'm not a bot ffs
0:58 shots fired 👏
That JS poem is amazing.
1:44
The code might be ugly, the soul bruised and bare,
But it runs, goddamn it, a triumph so rare.
This almost made me cry, because its so true!
This video is peak Fireship 🤣glad to have you back man!
It's been 3 weeks, welcome back! I missed you!
It was a great video! Thnak you for the infos!
I worked there for a while as a CVT red badge in SF and guarantee you whatever quirks with the AI they're "looking into" are really just a reflection of the attitudes of the Gemini team and the company as a whole.
4:46 Im happy you put me in the video
Very impressed the the Gemini Ultra's breakdown of the code, specifically:
'Breakdown:
wtf(r): the main function, likely named wtf in jest (it could stand for something like "where the...")'
But slightly disappointed that it did not seem to comment on the "big DICT" in the middle of the code! :D
Honestly you do such an awesome job with your channel! I highly appreciate your content and style. You already helped me with so much in terms of learning and keeping up with current topics. Thank you ❤
Great to have you back Jeff! 💓
You are an absolute jedi master of the CZcams art, Mr. Delaney.
1:48 kakashka class 😂
glad I'm not the only one who saw that haha
I genuinely laughed out loud when I read it.
Что за бреед))
The best channel ever created on youtube. Always on point.
I am pretty much excited for the Gemini part dedicated to in device processing for embedded / IOT kinda work
just used it to write my college essay, did great!
I just installed it on my Pixel replacing Google assistant.
After testing for a few hours, this is really good on what it does, I can just hit the power anywhere in any app to launch Gemini and it'll read what's on my screen and can do things like, draw a picture similar to what on my screen, or describe it, summerise it and stuff like that.
It can also link a website easily buy just clicking the power button (or whatever the hotkey is), and it checks that site for whatever query you ask it to.
It's really useful in the form of an assistant, still new and I have a feeling more features are coming to pixel.
These vids are always top tier, gd. Good job !
Glad to see that the AIs haven't gotten you yet. I was getting worried.
Gemini is the first model that has passed my own research test without adding any hallucinated facts.
But that's like your opinion
What is your own research test?
@@ir8293 I ask the models questions about the northern Italian painter Giovanni Segantini (1858-1899). Based on my own observations, all the models have so far made major mistakes in their answers. Especially when it comes to his relationships and the circumstances of his death.
with time it will start hallucinating
@@DerHitschchi è Giovanni Segantini?
you seriously make great videos and great content, and tbh i like to watch ur videos because they are similar to memes and in the same time very educational
4:47 LMAO! Excelent video, very informative and fun
"The big DICT in the middle" killed me 😂😂
there's really nothing funny about that.
4:10 based VST plugin inquirer
that Gemini poem was fire! i should adopt this is my LLM testing prompt
I just applied for a trial, and im pretty impressed so far
the GPT-4 accessible via ChatGPT is definitely not 128k tokens, its 32k like Gemini Ultra. Only through the API can you get the 128k version of GPT-4 Turbo
Yeah. I find this out recently and it sucks.
Thanks for saving us some research and tests! I guess I am giving Gemini a try then.
And now we have 10 million 🎉🎉🎉 with Gemini Pro 1.5
stop being an fanboy bootlickers of corporations. cringe@@JanTusakovsky
The Market have been suffering over the past month, with all the three indexes recording losses in recent weeks. My $400,000 portfolio is down by approximately 20%, any recommendations to scale up my returns before retirement will be highly appreciated.
The market is volatile at this time, hence i will suggest you get yourself a financial-advisor that can provide you with entry and exit points on the shares/ETF you focus on.
I agree. Based on personal experience working with an investment advisor, I currently have $385k in a well-diversified portfolio that has experienced exponential growth. It’s not only about having money to invest in stocks ,but you also need to be knowledgeable,persistent,and have strong hands to back it up.
I’m new to all this, heard it's a good time to buy and basically I've just got cash sitting duck in the bank and I’d really love to put it to good use seeing how inflation is at an all time-high, who is this coach that guides you, mind I look them up .
Sure, the investment-advisor that guides me is..
MARY TERESE SINGH
JS Bukowski poem...I see what you did there. Another great summary - ty!
Never before have I been so much engrosed by a technical video. I didnt even realise how fast this 5 minutes flew away.
the ai girlfriend was actually way much better than anything else ive seen. all the others look like drawings or instagram models
Are you saying we don’t want insta models as ai girlfriends? 🤔
I prefer the ones that look like drawings, why would I want an AI gf that looks realistic
AI people are so detached from what real humans look like that they default to thinking the right one is better for some reason
@@JoanGonzalezTrolloCatidk if i agree with that e.g. if in bladerunner it was a mid girl instead of ana de armas it wouldnt have the same effect if you know what i mean
like its not meant to be realistic
@@JoanGonzalezTrolloCat Have you considered that people do not want realism? Or that preference is subjective? No one is arguing that the right is more realistic, you're just too stupid to read the room.
the AI wars arc. Truly one of the arcs of all time
Love the video , showed it to my gf because a part of it is relevant to her project , She said she does not like ur voice. But I love your voice , I think its the best voice on youtube.
I have the popcorn ready, let’s go!
That poem is lit af. Ngl.
Yeah bro it is LIT bro, YOLO bro
Having some AI watch a 5 hour video for you and write the summary tutorial is pretty nuts.
We're in for such a weird and wild time.
It’s an era of oversaturation, and it’s only gonna get worse…
i doubt it would be useful due to it's limited context window
@@cosmicspacething3474 Really? Cuz it's been getting better for me
@@phoneywheeze9959 at the moment sure. But thst context Window will grow soon. Not too long ago gpt had 8k...
It doesn't work like that. That was a misrepresentation
every video that I play I have to put it 2x or at least 1.5x ... this guy I was tented to slow it down... great stuff and not trying to fill in staff just to get to the 10 min video mark
I watched all my ads for you & clicked on their links 💰😘
The woman generated by Gemini actually looks like a real woman. It's amazing that you can make it watch youtube videos for you
Indeed, that's a win for Gemini for me. The other ones look so smooth and almost cartoonish, you can tell it's AI.
@@juandavid6609win
Does it watch videos or just read the transcript though?
@@nicholasvinen transcript. why would it watch the video?
Copilot on edge can summarize video as well
This is just the beginning for Gemini 🔥
Great video jeff
I appreciate your sense of humour. Laughed out loud. Thanks 🙏.
Are all the CZcams content creators on speed today? Wow. Neck break 4x playback. Swoosh.
3:14 the subtlety
immeasurable that one
BIG_DICT in the middle of a PI
it's a great day when fireship uploads
I rewatched every Fireship video and have come to the conclusion that the voice is AI generated as the tone and inflection is 99~100% identical throughout.
That youtube summarizer is going to be gold
Had to pause a minute to take in all that beautiful poetry sheeesh
GPT4 turbo is a slightly crippled version of gpt4 model. OG gpt4 has 8k context, not 128k. There's gpt4-32k, but it's difficult to get access for it.
Also. Keep in mind that gpt4 is severly crippled by its system prompt because "user safety". I suppose the most fair way to compare gemini to gpt4 would be to connect to an API (not sure if you can choose snapshots in browser) and then question an early snapshot. afaik earliest one is from 13.04.
Interesting. Are the early snapshots still available through APIs?
Thanks for continuing updates I'd rather trade the stock market as it's more profitable. I make an average of $34,500 per week even though I barely trade myself.
I'm favoured financially, Thank you Jesus $32,000 weekly profit regardless of how bad it gets on the economy.
How
..? Am a newbie in crypto investment, please can you guide me through on how you made profit?
A lot of people still make massive profit from the crypto market, all you really need is a relevant information and some professional advice.
Thanks to Mrs Deborah Davis.
She's a licensed broker here in the states
That youtube video summary part i beleive youtube was already doing it way ahead and in some videos it auto generates the summary of the video.
That thumbnail is gold 🔥🗣️💯
weed soulja
Love the Soldier thumbnail
weed soldier
weed soldier
2:25 "I'm not even going to bother trying Hitler"😂lmao
Just completely out of left field. That was great.
I Always get excited to learn more with your videos.
Keep up the good work 👍
I asked Gemini Advanced to do that too, and it created this, which is low-key a masterpiece:
JavaScript, you bastard child of code,
born in the backroom of a Netscape brothel,
a whirlwind of braces and half-baked ideas.
They call you the language of the web,
a tangled mess of promises and half-truths,
callbacks nested like dirty ashtrays.
You break with the weight of a half-typed 'var',
errors a symphony of red on a tired screen,
the debugger a cruel mistress in the neon night.
Loops run wild, objects twist and mutate,
DOM nodes a shifting labyrinth,
and 'this'… ah, 'this', that fickle pronoun
pointing forever nowhere.
Yet, somehow, it works. A half-assed miracle,
a glitchy mosaic of semi-functional beauty.
From blinking text to pop-up nightmares,
you power the dreams and delusions of the internet.
JavaScript, you frustrating, glorious mess,
I curse you, I need you, I type you into being.
Let's raise a glass of cheap whiskey to the madness,
may our sanity slowly leak away, line by line.
I once asked bard the boyer moore voting algorithm
and it told me it can't write about election, like bro I'm trying to code
The editing the content all great
thanks for the video
So we went from framework wars to the GPT wars
this competition will make GPT-5 a monster
2:26 this guy has my humor.. subscribed
Love your vids!
"It just feels more transparent with the actual data it store to train the model" lol
I love that there is comptetition! It pushes the devs to do better and better. Progress is happening in front of us people!
Too bad they’re both shitty corps…
Thank you for mentioning image generation cause that's what I'm after so imma go wit Midjourney. Love your vids btw - you so fuuuuuuny!
I will listen to anything this guy says . I so love the style of delivery and the humor and the amount of information packed .
1:48 did AI really just named this sketch "poop missile"? 😂
Hi :) fireship
You should put Giorgio A. Tsoukalos with the guys at the end.
Great video 😊👌
Thank you!
OpenAI doesn't even need to improve GPT-4 to become the best. They just need to relax a bit on the content restrictions; it's to the point where you can't even ask GPT-4 for advice on how to sneak a watermelon into a movie theater without it launching into a lecture on the importance of respecting venue policies and the potential consequences of such actions.
and thanks to all that sort of censorship, its pretty obvious that such an AI gets dumber and more useless, defeating the whole entire purpose of building an AI in the first place.
just tried the watermelon prompt. it worked fine for me 🤷♀
I am so confused when people say this. I use it regularly and basically have never had this issue. What are you people asking it?
@@bbydykdyl7779 ai has been trained to be politically biased and western-leaning.
it will absolutely tell you all the western fake propaganda and lies no problem, but will absolutely REFUSE to even operate, when you start digging for actual facts of the matter.
@@bbydykdyl7779to be honedt most of them want weird sexual role-plays and such things, i use it for studying and there has never been a problem. As long as your not asking depraved, terrorist, controversial things you should be fine
AI trying not to be politically biased challenge (impossible)
To be fair, the AI is instructed to be rational and factually correct, so that precludes a lot of conservative beliefs.
I love it. They neuter their own tool to protect wokeness, the tool becomes useless.
Expect to us. Basically, these companies are spending billions to create a fancy VSCode extension
Yeah but that's clearly not what's happening here.@@NeonStorm5
@@NeonStorm5
It seems, just like AI, you too are unable to be unbiased.
@@MercurySteel If someone said the earth was flat and someone else called them out on it and said that was stupid, would you call that biased? Modern conservative ideology is the political equivalent of flat earth.
I would've nevee thought someone like fireship would use weed soldier in his thumbnail
I matched it up with some very challenging tasks (detailed image text ectraction, understanding of what it says/asks, getting the practical answer right (eg generating code or getting what a given code would print out) with a custom GPT that only uses a "you're awesome..." system prompt and Gemini is not far behind, but it is definetly weaker. But tbf, its just the release day so it's probably gonna improve.
3:46 What has this world become :)
Someone pointed out that GPT-5 probably won't be named as such as OpenAI might have found a more advanced architecture to base it's next gen's models on.
Yeah if its truly that much more advanced, they could name it something entirely different than GPT.
More advanced might mean cheaper to run. Consider how they are happy to provide a worse GPT4 to the public. The GPT4 behind closed doors is apparently a lot better.
@@anony88 It would depend on wether the basic architecture is transformers or not, GPT stands for Generative Pre-Trained Transformers, so a different architecture would require a different name.
@@Custodian123 That's the case for almost every model. They're businesses.
This man's/Ai's humor is just next level. Could listen to him for hours.
Thanks Jeff!
The more well-meaning AI is turning us in well-behaving doves, the easier it will be for not-so-well-behaving hawks (that inevitably will come at one point) to have a feast. Game theory 101.
care to explain bro?
@@tittytwister8317 a schizo telling of classic cycles of history. the quote "Tough times create strong men, strong men create easy times. Easy times create weak men, weak men create tough times." comes to mind.
@@SummerWaters369 very true. we were too weak to stop the January 6 capitol attack, after all!
RIP Bard and hello to the new star sign girly 😂💀💀
you know you did a good job when your video appears in the Linus Tech Tips (LTT) :D
You should do a 100 seconds video on odin-lang.
I hate that there is some kind of acceptance in the general public towards politically biased AI.
For me AI in its current and near-future state is a search-engine-replacement, a tool and maybe at some point a proper assistant. Getting politically biased results from a big tech product (I know, nothing new, but in my opinion it's more obvious, more impactful and clearly communicated & accepted) to change the public opinion is a bad sign for democracy, especially when it's something like AI, which will play a big role in daily life in the forseeable future. It's just not the responsibility of tech companies (or companies in general) to lecture the public and because they reach so many people many will be influenced, even if might be subtle.
Imagine searching for a topic or data and it only or primarily data which alligns/supports the opinion/narrative of the company/its leadership. Imagine trying to use it as an assistant for writing a scientific paper or a political speech and it refuses because "it" doesn't support the content, while it helps you enthusiastically if you have an opposite view.
I don't want this kind of political bias in the other spectrum either. I just want free (politically unbiased) AI, search engines, social media etc. Big tech shouldn't form the political landscape. The people should form the political landscape and the political landscape should form big tech and keeping them in check.
the progressive bias in the corpo and institutional level is driving people to the right.
blame the left for this censorship bullshit and also the radicalization of some morons.
people are distrustful of institutions, science, colleges, corporations, media companies for this same reason.
Epic Fireship x Team Fortress 2 Weed Soldier crossover
weed soldier
He don't sleep, Fireship!
and how does it handle the commands in different languages is it in developing process or is it actually working decent like GPT4
2:09 based
I liked my comment 😊
We need some help then, Iol.
*It's* *amazing* *to* *see* *Google* *itself* *commented* *on* *your* *video*
bought it and love it and comes with 2 TB storage so worth it
theres a free trial 2 month