Oh my, what the heck? What sort of square is this? Sick. >> [laughter] >> Even from here, like from this view as well, camera angles that we could
see. Oh, Anthropic has released Claude Opus 4.8, which is quite exciting because this is a new frontier state-of-the-art model, which always is
exciting, I guess could be said. Now, before we get into this, please do feel free to subscribe as I do want
that six-figure YouTube plaque, but we're going to take a quick look at this truthfully relatively short introductory post, which I am okay with
because then we can just jump straight into testing the model. Though I do have to say there's some pretty interesting things contained in this short
blog post that I do want to touch upon because some of them talk about future potential models that would
actually sit a class above the Opus family, which is still the highest-end publicly available Anthropic model. So, with that, let's take a look at
this benchmark JPEG, where we see right here that it is beating out its predecessor in every specific category right here. The only model in this
chart that it is not beating in one specific area is GPT-5.5, and Gemini 3.1 Pro is pretty old at this
point and will be replaced this month with Gemini 3.5 Pro. So, it'll be interesting to see how these scores change over time. Now, I don't pay too
much mind to these benchmark JPEGs, really, and there has been a new benchmark released where apparently it was a private one that tested these
encoding specific things, and the scores changed drastically. A lot of models were performing significantly
worse than they were on some other public, like, well-known benchmarks. I think 5.5 was ahead. That's something that there's probably a lot of talk
about uh if you're interested in such a thing. Now, something else that's kind of I won't say concerning, but it was like, "Oh, okay." So, they talk
about the model as reaching new heights on our measures of prosocial traits, like supporting user
autonomy, and then this one, acting in the user's best interest. That lingo kind of concerns me, and that may be a result of seeing the movie I,
Robot, where spoiler alert, but you've had like 20 years to watch it. Um, like the big AI that's controlling everything thinks it needs to protect all
humans against like what they would want, but in their best interest. We also do have a benchmark right
here for misaligned behavior, which does include the Mythos preview, which is kind of exciting. Following that, there are some additional things
launching today, and I know I don't like to verbosely read through these, but some of this is actually interesting because the dynamic workflows
portion right here is essentially in like allowing Claude code to embark on long-running tasks. It talks about
parallel sub-agents. It seems pretty cool, but I would also be concerned about how much usage allotment this would drain and if using this just
through the API, this could probably get expensive rather quickly. Additionally to that, they do have some prominent mentions of effort control to the
point where if we scroll down a bit more, we actually see a pretty big note on effort. Now, when 4.7 came
out, Opus 4.7, they introduced the adaptive thinking. I did not have that enabled when testing that model in the video that I did, and I found my
experience with that model seemed to be totally different than what I saw a lot of folks reporting online. It was fantastic. It did the best Subway
FPS. I know that's only one like tiny measure of a model's capability, but I found that a lot of people
saying like this model's terrible had adaptive thinking enabled. So, I didn't have it enabled and it did like really well. So, I think this is kind of
a response to a lot of folks who were seemingly upset and experienced perceived or actual degraded performance with the adaptive thinking. Then, this
is probably one of the more exciting parts. Well, first and foremost, we see users will find Opus
4.8 to be a modest but tangible improvement. That's like some pretty unexciting lingo to have in a new model announcement, I would say. Even if that's
the case, I mean, I don't know. They're They're doing well. They're confident, so I guess it's It shows some level of confidence to say that. But, the
exciting part of this is not only that, but we plan to release a new class of model with even
higher intelligence than Opus. So, for now, Opus is the state-of-the-art publicly available Anthropic model, but they talk about Project Glass Wing,
Claude Mythos preview, and basically working to ensure that it has proper safeguards to be available to all customers in the coming weeks. So, this
sentence right here is actually pretty exciting, and I would imagine a lot of folks will be talking
about this. Finally, the thing we have down here is just talking about pricing, where it is the same price as Opus 4.7, $5 per million input tokens
and 25 per million output tokens. For fast mode, it is $10 per million in and $50 per million out. So, to begin, we're going to start with the
tried-and-true browser OS test, which of course needs to make a browser OS with two functional 3D games, one
of which is a GTA clone, the ability to change wallpaper, and a special feature it decides on and implements on its own. So, it did try to open it in
the artifact window. Fortunately, I caught it in time, so there were no spoilers. 910 lines of code. All right, that's not a lot. I thought there was
going to be more, but it does give us this handy opening Google Chrome button. So, let's take a look
at our Opus 4.8 browser OS.
All right, so I love synthwave style and like OutRun, and this has totally buttered me up to the point where like we don't even need to go through
this. It's the best one ever. Let's move on to the next test. No. All right, so this is this is awesome, first and foremost, so far. Does it have a
right click? Doesn't have a Doesn't have the right click, but that's okay. We do have the clock in the
correct time in my locale as in terms of what this laptop thinks the time is up on the top right, which is good. Neon OS, it's pretty prominently
talking about this press command K for spotlight. Oh, no. Awful. I mean, it's cool, it's good. I just I hate that feature on Mac. So, it's included
some of my least favorite features. We can change the wallp Starfield. Sick. Okay, let's go back. Command
K. I mean, obviously the outrun one, the synthwave is going to be Okay, that's cool. A blue matrix. Or plasma. Uh, it's like disgusting lava lamp. I
like lava lamps, but that color scheme was just nasty. All right, let's check Let's just all start with our GTA game. Drop into the city. Can I expand
this or resize it? No, I can't. Okay. I'm not even a continued testing yet. We're going to have it
fixed the issue that is causing the GTA clone not to work, and then we'll move on and proceed with the test. That was significantly less time and like
everything than I thought. Okay. Let's check Auto City now. Oh, sick. All right. Oh, wow. It genuinely kept the Okay, F to enter exit car. Oh, yeah,
look at that. Oh, the big problem here is it spawned the car inside the building, so we were stuck
there. But, these car models are actually pretty good. We have people models. Can I do anything like malicious? All right, let's let's see if we can
borrow this vehicle. Good. Uh, floor it. Oh, yep. All right. Hit and run, plus 25. There are collision um there are mesh colliders with the police.
Let's just get out on foot. They can't get us there. Exactly. Later. Can we steal the police car? Ah.
Okay. That's not something I've seen so far. All right, let's just get back into this car. Really, what's letting this down is the inability to
actually full screen this, so it's so tiny in terms of the like Maybe I could just zoom in on it in editing. This has one of the better car models
I've seen, and the people are a little capsule. So, okay. I have to remind myself continuously to not spend
too much time in the GTA result. In the browser result, moving on we have orbital which is a additional 3D game. Okay, it's like one of these space
shooter ones. Which like every model includes as the second 3D game. I think once I've seen a non space shooter second game included and I've done
this test quite a while now. Can we destroy any of these things? All right, well I didn't see any
asteroids get smoked but that's okay. Next up, I don't want to go into settings I'd rather go into paint. Good and we do have a save PNG option. Even
the color palette it's chosen to use here is like synthwave-ish. Beautiful. Oh. Okay. [laughter] Save PNG. Let's see if it saves it with a transparent
background. It it did in some ways but then the um that was left over so interesting. All right, uh
calculator. Good. This thing the adherence to synthwave style which again is not at all anywhere in that prompt is curious because the Google model
that came out was like that too. What is this 435? Gemini 3.5 flash was like that as well. Very odd behavior. Notepad, okay. Auto saves to this
browser. Nothing special here but we do have a word and character count so that's good. Let's make sure the
word count works. Okay, good. All right, and we have our special live wallpaper so those are inevitably the special feature which I would be quite
satisfied with as the synthwave rolling one is pretty awesome. Accent color and it does work and it is like synthwave style color. So we can even
choose a solid color background. That's cool and then upload image. Let's try it. Oh, I don't think this
system doesn't have any like fun stuff on it. Cool. This is a little device that I'm working on building. Uh don't worry about it. But, it does look
good as a background, which bodes well for how it would look just in general. All right. And then we have about I'm going to go back to the synthwave.
And about, I think, was what was opened when we actually had this thing. Okay. Overall, I mean, I
like it a lot. I love the synthwave. I was a little disappointed that one, we can't actually resize the windows and there's no button to full screen
them. And two, there were just like there was one issue where GTA didn't work off the bat immediately. But, you know, it is what it is. But, there's
no right click. So, not bad. And I love the synthwave style, which I did not at all ask for, but it
totally leaned into it and like full on. Next up, I've swapped into the co-work portion of the Claude desktop application. And this is going to be
called the mid-roll ad test. So, we have given it a bunch of assets as well as a prompt containing a 60-second voice script. And the task here is to
create an animated SVG for a little presentation with the script as well for the sponsor of today's
video, Oxylabs.io. So, we'll see what happens here. And then, this will also give us a look into its ability to create some video animation just with
SVG and some bundled included assets. And as it says here as well, this is a complex 60-second animation. And something I do believe these models have
not yet really been properly utilized for is their ability to actually create some pretty detailed
SVG animated videos. Something that like these can actually make marketing assets and things like this for Instagram or Google Ads or something like
that. And it's actually kind of cool watching some of the ways models go about doing that. Ooh, all right. All right. All right. Hold on. Spoiler
alert. All right, we have our results, so we can now open it in Google Chrome and see how it did. If
you're building AI agents, getting real-time data from e-commerce, real estate, or search is a massive bottleneck. That's where the Oxylabs web
scraper API comes in. It gets real-time data at scale from almost any public website using over 175 million residential proxies across 195 countries.
I drop it straight into my N8N workflows. It handles JavaScript heavy sites and scales instantly in the
cloud. Oxylabs just also launched a headless browser for AI agents plus a fast search API that feeds organic search results into your AI pipelines. I
did do something with N8N with Oxylabs. It was really cool. It was like a drop shipping detector. Go to oxylabs.io/bejohn for a free trial up to 2,000
web scraping results free. No credit card required. Use code Bejohn in all caps for 20% off all
Oxylabs plans. Okay. I would say this did a decent job. Some things I liked were the animations were very smooth. And again, this goes back to what
I've may have mentioned previously where these models can actually be used to make animations like this with SVGs. They're very good at throwing edits
together and things like this. Stuff like this can actually be used then for like marketing purposes
as we see right here. But beyond that like for someone who is running a Google ad campaign and needed assets or video animation, the models are
actually quite apt at doing that with just SVGs. So it's pretty cool to see. And we see like the animations and movement and everything looks pretty
good. So I was happy with this. It was very smooth. The graphics looked nice. It did use the color scheme
as properly denoted in the prompt. And overall this was pretty smooth and acceptable result from Claude. Next up is going to be the beautiful static
subway scene test. But this is now intertwined with the subway FPS game result as well. So basically it will create a pretty static subway scene and
then it will immediately use that beautiful scene to turn it into an FPS with some humanoid/zombioid
enemies. Also, I know zombioid isn't a word. I just always use that in this prompt. I don't know why, but I like to. All right, let's check out our
subway FPS/beautiful subway station result. Line six. A derelict subway station lit by falling fluorescence in the amber glow of service lamps.
Something is moving in the tunnels. Survive the platform. All right? Oh, yep. Yep. Claude's always good at
these subway games. Does it have It doesn't show the gun the gun bullet. It doesn't show the bullet effect in the wall, which is so frustrating
because Opus 4.7 did, I think, and it was like the best result. Actually though, look at this. This is a flickering fluorescent lighting. Park view.
Oh, look at the close-up there of like the on the rivets actually in the metal. That's not something I
normally see in terms of the detail. I Oh, okay. Oh, oh, look at the glowing eyes there. Oh, okay. Well. Oh. Muzzle flash looks good. I'm still so
frustrated though that the ammo doesn't actually affect the environment, which is like a That's almost like a downgrade from what I previously seen,
but this is still I mean, this is very, very, very good. It runs smooth. It's [music] like Space is to
jump. Very good. Shift is to sprint. Oh, yeah, it is. Jump sprint. Okay. You died. Try again. Something I want to note that I actually find
interesting is it has a toggle for flickering lighting as sometimes that may not be good for someone. You might have like a medical issue or something
that prevents you from being able to play games with that. So, that's interesting attention to detail there.
Now, one of the biggest issues I'm noticing Never mind. The brightness slider is accessible if we just press escape. The cursor goes back. So, now we
can just quickly explore the actual environment. Again, the actual metal rivets shown here in these poles. I don't ever think I've seen details such
as that, but something that is a bit frustrating is again, probably for the sixth time, the ammo
doesn't actually take effect in the environment, which is a little frustrating, but this is still like This is This is very good. We even have a bit
of camera shake like actually when we're firing the weapon model looks pretty good. Let's just make sure the flicker toggle works. Yeah, it does.
Cool. So, I've swapped into the claw code portion of the desktop app. I have dropped the effort down from
max just to extra in here and we're giving this the self-contained C++ skateboarding test with the late '90s California boardwalk aesthetic. All
right, I have to say this is frustrating because it's just like showing me this like jumping icon here and it just says almost done thinking, but it
gives me no indication that it's actually doing something versus having encountered some form of issue.
So, I would say this is rather frustrating. Extremely so. Like, what are you doing? Oh, okay. So, it thought for 5 minutes with like genuinely no
indication that it was actually doing something versus like frozen. You know what? It's fine. It's It's going now. I even had sent this follow-up, is
something happening? Cuz it was just showing me this weird orange jumping thing and saying almost done
thinking, like and doing nothing. But now it's doing something, so that's good. All right, the game has now been completed. It's going to compile it
to verify that there are no compilation errors and then hopefully soon we'll be able to play with it. This has taken a little bit of time, as we can
see in the total clock right here. It's been right around 10 minutes. All right, and it gives us the
specific command in order to actually play this. 22 simple figures for NPCs skate game. See, this is good. Look at the walking on the in the NPCs is
the word I was looking for here. This is very boardwalk-like. Okay, cool. The water looks good. We have nice palm trees. We have storefronts. I'll say
this is probably one of the more organized results I've seen just in terms of everything kind of
being laid out in that boardwalk style. Good. Tricks look good. Oh, that was a sick trick, too. There are no mesh colliders on the NP No, I I wouldn't
want there to be cuz that would just be like too unplayable, maybe. Yep. All right, now let's do like a sick flip off of this. Oh, back onto the rail.
Right? I thought the board landed up No, no, it's fine. All right. And our skater has a hat on as
well. Okay, it's not infinite, but it's fairly lengthy. Oh, what was that over there? I almost Did it draw the stores backwards? Cuz I swear I saw an
awning like in the corner look, but I can't get over there to check because it has boundaries that we can't cross, so. Still though, it's quite put
together. It may not be super visually exciting, but I will say this is one of the more just like
non-glitchy results I've seen, I guess could be said. And this is a more difficult test. This is a test that very much separates models' capabilities.
Um when sometimes like it may be a little harder or more vague to test just based like a browser OS, cuz a lot of models can do a good job on that
now. Not so much with this test, so. I do wonder though if the stores are inverted, cuz it looks like
there's an awning over there, so I think these are oriented in the wrong direction, but unfortunately, we can't really see. Um but aside from that, I
would say this is this is indeed satisfactory. For this next test, I'm going to go to ultimateplay.com, which is my own website where you can upload
and play single file HTML generated games, and I want to find a game that was made with GPT-55
because this will be a pretty good test. So, this was the GPT-55 result, this little beat 'em up game for Jerry's apartment in Seinfeld, but this
started with two prompts. So, the first prompt was just to create an accurate model of Jerry's apartment from Seinfeld. So, I'm going to copy this
first prompt right here, and we'll try to do a side-by-side basically replication test of this, but with
Opus 4.8 to see how they stack up. And I do have it still on max. To be honest with you, if I run out of like um thinking tokens or whatever
allotment, I'll just up the subscription for testing purposes. Subscribe. It's properly searching and trying to find specific information. All right,
so here is our Jerry's apartment result. Okay, click to enter. This is fine because it >> [laughter] [gasps]
[sighs] >> It's frustrating because this looks nothing like the layout of his apartment. Were this to be judged individually, it would be an
acceptable result just based off of like a 3js room being drawn, but I'm not I'll say the bike layout on the wall is probably one of the more
bicycle-like shapes I've seen in doing this test. Make of that what you will. But overall, we have the Mac, we have
these things, but this is not I expected better to be completely transparent. Rolling Stone, okay, that's good. The elements when looked at
individually are acceptable, but if we're doing a side-by-side test with the 55 result here, I think I don't necessarily need to say much based off of
what we saw online there. Regardless though, because the follow-up for this specific test is to have it
create Okay, C is space up and down. I just want to make sure like I Okay, so that's actually cool. It allows us to change the viewing angle that we
actually have, which is not something I've seen before, but the next portion of this when based off of this is to now turn this into a low-poly beat
'em up game with fun arcade effects and animations. So, we'll see what happens now, keeping in mind
that the apartment is not necessarily as adhering to the real-life one as I would have hoped it would be. I do also want to check on usage. Okay, so
30% used in the current session. So, gone up from 18 for these specific things we've done since I first looked at this. So far, I like what I see
better. Uninvited guests keep banging Uninvited guests keep barging into Jerry's apartment, close
talkers, low talkers, soup cooks, and mail carriers. Funny and lore associated with the show. WASD, J, and K, and L. All right. So, L. Oh, okay. This
is good. It's so frustrating because the actual like animations humanoid-wise here. Okay, that's cool. That guy just got Serenity now super. Okay, it
lags a little bit and like we see a very pretty city effect outside the window, which is glitching a
bit, but that roll effect is This is a This is a good beat 'em up game, I will say. It's not It's tough to judge, but I do like it. It's fun. And
again, this was more of like almost like a versus GPT-55 test. The movement is cool. I would kind of like to have different camera angles that we
could see. Oh. Oh, that was just That like freeze frame there when we got KO'd. Looks painful. It's tough to
I mean, this was done through Codex as well, which is more natively like a coding {slash} front-end thing. But I do think some of the fighting logic
was perhaps more fun in the Opus one, but I don't know. That's definitely going to be an ask the audience one. The movement though is actually They're
bending knees, which is interesting to see in the It's tough to It's tough to say. Next up, we're
going to be doing a classic test in the form of the 3D flight combat simulator game. It's always fun to play the results of these and see how well
they do with the plane models. So, it's written the file, but it seemingly like just frozen up again. So, I did copy the contents of the specific
file, but sometimes it writes it and then it's like, "Oh, I found one thing that I'd like to fix." Though,
I do have half a mind to just manually paste those into an HTML file right now because I'm not quite sure what's going on, but we have something, so
So, here's the early plane result. Ace Dominion. All right. These models look good, too. It's hard to fly. Sometimes that happens when they actually
have the cursor control the plane, but this is overall again, it's it's well done, especially because
of the plane models. Now, obviously one of the big issues we're noticing right here is this frame rate is abysmal. Oh, when the ammunition hits the
ground, we actually get effects, I think. It's actually putting a like a box around the enemy. All right, this is it's frustrating because I got to be
honest with you. I keep waiting for this model to like wow me, and it's not happened yet, and I'm a
little upset. Like we're seeing hints of it, like the way the ammo tracers actually hit the ground and stuff like that. I think that may be
attributing to the large amount of lag we're noticing, but that was really impressive. Let me go back into the Claude app right here to see if it has
done anything now, and it's just frozen up right here, which is couldn't finish the response. Try again in a
moment. And then if I Yeah, now it's going to rewrite the whole thing again, which is going to smoke my usage limits. I'm honestly going to try
turning on the adaptive thinking right here. I'm keeping it on max, but I'm almost wondering if something's wrong with that. I'm going to put it on
the default effort and have adaptive thinking on for this next test, and we're going to be giving it a front
end design test for the Ravioli Rosso. This is the Ravioli brand front end test that I have been playing with lately. All right, let's take a look at
our Ravioli Rosso website. Okay, very good. We do have the SVG raviolis floating around. This is a very detailed prompt, which basically means that
every model I test this with that's at least somewhat competent produces very similar looking results.
And when we click in the background, we do spawn a bunch of ravioli and related ravioli things. Let's check our simmer richness. Slow simmer tomatoes.
Okay, and we have some movement on these card effects. Now the big test is obviously the jar being drawn with SVG. Okay, three things we refuse to
rush, the long simmer roasted garlic gold garden basil eight. Where is the jar? Very eh I've seen
better. It's there. It's floating, but I have seen better. Your pasta has been waiting. Taste the sauce. And we have a little tiny photo shipped in
glass. I've seen I mean in this hasn't been run very much, but all of the models produce very similar things. So, this is in line with what is
normally seen with this result. So, I've put it back to max effort, but I do have adaptive thinking still
enabled now, and we're going to test the 3D printer simulation test. So, the response froze when I had it on maximum effort, and it was thinking for
quite a long time as we saw, and then it stopped working, and then I got some connection errors thinking enabled, and we're running the 3D printer sim
again in the hopes that we get something before it glitches out or freezes up. So, I'm not I'm not
enjoying this right now to be completely honest with you. I'm I'm not happy with this model. I'm I'm actually watching my Opus 4.7 video back here
just to make sure I'm not the one hallucinating, and every result I've tested with this that I tested with 4.7, the 4.7 results so far has been more
impressive. All right, let's check out our 3D printer simulation result. This was on high thinking mode
with adaptive thinking on. All right, so hypothetically we now have our fixed version. Good. This is very good, and this is kind of what I was hoping
to see more of with this model. Keep in mind this was done on high mode with adaptive thinking enabled. I did try it on like max thinking, but we
encountered an issue after many minutes of thinking. So, we do have a spool connected to the nozzle. The
nozzle looks good. We have an LCD screen. This is a core XY style printer. Let's just go ahead and take a look at the print. Oh my. What the heck? >>
[laughter] >> What sort of square is this? I will say it's >> [laughter] >> artistic. This is So, 3D printers are very fickle creatures. And if you
have had the displeasure of having to tune them and play with them, you may notice that this is
actually a fairly realistic result of what a very, very misconfigured 3D printer would produce when trying to print a square. Now, I find this
hilarious, but like the actual printing is going line by line, and the infill is more or less like um proper. Is the spool at all spinning? It is.
Good. You can see that. Good. And the gantry, the movement is smooth and everything like that. Um it's just
quite perplexing, this square. I'm going to maybe just uh Okay, we're 80%. Let's just make sure we get to 100. Okay. Uh let's try the circle. I will
slow the time scale down. Okay, good. So, the circle is a proper circle. Um the square was also somewhat of a partial circle. >> [laughter] >> So,
okay. Did we just change filament color midway? No. It's showing us a different color for the current
layer it's on. All right, and this is a speedy printer. Let's just Let's just put it to max speed. All right. Not bad. And then finally, we'll try a
triangle. We'll see if this is Nope, it's Looks like a Hershey's Kiss. >> [laughter] >> Very, very interesting. Although, check this out. The spool
color is actually changing depending on the shape we're we're printing. So, it changes depending on
See, so it was blue for the circle, yellow for the square-cle, >> [laughter] >> and blue for the All right. Um interesting. You know, properly done,
more or less. The shape was good. The nozzle material looked good. The actual drawing there, the spool spun. The movement was good. Very, very
interesting. >> [laughter] >> I'm going back to this flight combat simulator thing because it was just like
fix this 3 FPS looking trash now. All right, we see a preview here and that actually happened fairly quickly. So, the plane models do look much
better. Let's just try the Falcon X. Okay, it's it's like a first-person view and we're going backwards. Okay, some Oh, no, this is this is not okay.
This is not okay. All right, there's supposed to be a 2-second black screen when we crash, not a infinite
one. Let's check the Warhawk. At minimum, we can see the actual plane models there at least in the thing and it did try to simplify it to its benefit.
So, it was focusing on performance, which is why it would have detracted from the actual graphics or aesthetics here. At least the plane models look
better and it runs quickly. All right, let's check my usage right now. 63% used and I'm worried I
may tap my usage limit and if I do, I will just buy the more expensive plan because I want to give this thing a chance to really properly redeem
itself. So, I've prepared a difficult test. All right, so I've genuinely been disappointed with this so far, especially after looking side by side at
the Opus 4.7 results with what I've seen so far in this test. Everything here has been worse than what
was experienced with Opus 4.7. I want to give this thing a really difficult test and I have put it on fast mode Opus 4.8 Max and we are using the code
version or code window of this desktop app. I will inevitably hit some usage limit here and I'll either just make it use API credits or something
else, but this task is going to be difficult. I've given it this photo of this arcade machine and told
it needs to make a website with an accurate 3D model of that using something like 3.js. We can close that. Additionally to that, I've given it this
sprite sheet that was generated with GPT image 2 of 10 different cars. So, it's instructed to turn this arcade machine into a cool 3D website and then
make a game using these sprites, put it on this digital screen on this website, and then have the
user be able to play this using the WASD keys. So, it has access to these assets and it is going to work here in fast mode just to give this thing a
proper chance to showcase its capability because truthfully I've been really quite let down so far. So, I'm more than happy to spend a lot longer
testing it to give it like proper chances to shine, I guess could be said.
Now, what it's doing right here is interesting because it's just working around trying to pull the black cars from the image without the background
also being in there. So, that's what it's talking about separable with threshold 12. And part of the reason this is a difficult task is because the
models will try to lean on knowledge of like dealing with sprite sheets that they may have and then that
will fall apart quickly when they try it on this AI-generated non-traditional sprite sheet. So, then they have to figure out how to work around that
to actually still get these as sprites. So, it just makes for a more complicated task of having to do this. And don't forget the whole part of this is
to then create a 3JS 3D model of the arcade cabinet, build this game using these sprites, and then
place it on that and put it in a website to make it look good. So, this is a proper intricate test that I do want to give this model because so far it's been so frustrating to deal with.
Okay. So, that's acceptable. We see the sprites work well in things like this. Now, keep in mind this is just a test of the game. Good, the sprite
movement does If we hit cars, we do get like um we slow down and this is okay. Now, if you recall I had told it I want full 3D not pseudo 3D and it's
also supposed to actually build the arcade cabinet in 3D and then render this on the screen of that.
So, this is just one piece of the puzzle still not fully 100% there yet, but we'll see what happens. All right, we should That is kind of sick. It
doesn't 100% look one-to-one how the machine looks, but that's a that's a pretty sick like UI preview and things. The steering wheel is going through
the desk. I would really hope that it will be able to pull that out of the screenshot that it takes
here to look. And then remember, the whole goal of this is to actually transpose the game onto the arcade cabinet right here. The light reflecting off
the scene and things like that, this is good and this is more in line with what I'd hoped to see. Please tell me that you understand the cabinet's
form and detail are lost in black and I want to check the layout against the reference. Interesting
because the cabinet doesn't necessarily look like this in real life. Um based off the picture and what we saw, it like this is attached to it and it
actually comes out from the side here and all this looks more or less correct. Just in this like specific steering wheel area. Okay. It changed it a
bit. Uh the joystick became a different shape um from what we had there, which was probably a bit more
in line with what I would have wanted. The steering wheel is higher and no longer actually hits the ground, which is good to see. And if we actually
zoom in here a bit, we should be able to see some layer lines for 3D printing. Yeah, there I think they're there. I don't know, to be honest with you,
I can't tell, but it does have visible bolts and things like that. The steering wheel is um you
know, let me check a near head-on angle matching reference to judge proportion. Okay, this is taking forever. I just >> [sighs] >> I did this to
myself though because I want to see this model like try cuz so far I've not been wowed. All right, this thing's like going crazy about like
fine-tuning the arcade cabinet. I'm stopping it and saying the arcade cabinet is fine. All right, so I've given it
this follow-up here and we'll see what happens.
All right, so it seems like the 3D edit for this game is going to be visible to us soon. Okay, Omni Racer, press W. Fantastic, good. That is good.
This is what I wanted. This is very good. It utilized the sprites properly to make it 3D more or less. Um the road has some oddities and things like
this, but it should properly photo Photoshop. Should take a screenshot of this and then understand that
it has a few things it needs to fix. Very good. And this is so far probably taking an hour for this specific test. I don't necessarily spend this much
time on one test when a frontier model drops and I want to test it. But because I was in am disappointed with how this model has performed so far, I
really wanted to do something like This is genuinely 3D now. Yes, it is. I wanted to do something
very intricate and see what we get. It's going to like maybe move the camera here cuz Okay, see now this See it actually is functional, too. This is
absolutely very cool. That weird like glow of the light reflecting on the screen is kind of detracting from the gameplay, but the fact that I mean
this is just really kind of neat. Does the joystick actually properly respond to forward backward
movement? Yep, it does. And the steering wheel moves as well. And the thing we want to do is just test it actually in Chrome. What did it call it?
Omni Racer. Okay, so this is deeply impressive. And this is exactly what I wanted. So the whole thing of this test was it had to create the 3D model
of this arcade cabinet off of a reference photo. It wasn't fully one to one, but that's okay. Then the
entire other thing was to take the unstandardized sprite sheet that we gave it and then have it create a 3D racing game using the assets from that. It
is difficult to take these sprites and make something that looks 3D. And then the whole thing was to place it on this arcade cabinet so the user could
actually play it just using WASD. And that is exactly what has occurred right here. This was a
very difficult test. It probably took about an hour and a half for this to finish end to end. But the whole thing was I wanted to try something else
because I had been rather disappointed up to this point with some of the previous things we had seen as a result from this model. So, this is
promising. And I mean like look at that. That's like sick. Even from here, like from this view as well. So,
if anyone is interested in actually seeing this, if you go to ultimateplay.com, which is my website where you can upload, play, and upload
AI-generated games, I will post this on here for anyone interested to actually be able to play. For the final test, I'm going to be doing a drum kit
simulation test, which includes the autoplay feature. So, it will have four distinct tracks that we will be able
to autoplay. It's It's just using the Claude AI web chat because I wanted to just run this at the same time that we were doing the arcade simulation,
which was very, very impressive. This is on max, and if we go into effort, we see is adaptive thinking on. Okay, it is, but I just have it on max as
well. So, we'll get this and then we'll summarize. All right. So, it reached its max length for this
message for the drum kit sim while it was just still thinking. You've used 90% of your session limit. Yeah, that's fine. This is the last test I'll be
doing with this model. >> [snorts] >> Here's our drum kit simulation. So far, this looks like it may be very good. And it does seem very good. Okay,
good. Well, everything is laid out more or less correctly. Actually, really the only slight issue I
see here is like this should be pointed the other way, but that's actually well done. I'm just testing it here. See, those animations are very, very
good. Look at the actual curvature to the symbols. I don't know that I've ever really seen that before. So, that's good attention to detail that's
well done. Phil Collins test is good. Not bad. >> [music] >> Let's check the auto play feature. So,
first and foremost, we have rock. >> [music] >> That slaps. Good. The sequencer's good. Or the sequence. >> [music]
And we can change the tempo. Wait for it. >> [music] >> That's good. All right. Let's try funk.
[music] >> All right. Let's try hip-hop. 86 bpm. That's very slow.
Yeah. Oh. Testing this model for 5 hours makes me sad and sour. All right. That's not just That's just too slow. >> [music]
[music]
[music]
[music] >> All right. And then jazz.
[music] >> Uh yeah, all right. So, that brings us to the conclusion here. And truthfully, I'm very, very, very I can't think of the word.
Conflicted. Because this result was nice. The Omni Racer result here was absolutely sick. And as a matter of fact, this did actually have sound to it.
I just had neglected to
pick up on that earlier when we tested it. So, this result and the drum kit result were fantastic. The problem is when we go to the other things, I
really found myself rather not impressed comparatively to the previous Opus 4.7. So, for example, here is the specific GTA result from within the
browser OS test. We can go, we can enter cars, and you can knock over pedestrians and things like this.
This was in the style of like the synthwave that it made the browser OS for some reason, which was interesting, but you know, it did work. And the
pedestrian just disappears there when you hit them. So, if we compare that to the Opus 4.7 result of the same exact test, the pedestrians actually
fell down and stayed down when you hit them. There was moving traffic autonomously around the map, and
this overall was just a better result. Not even mentioning the fact that the Opus 4.8 result actually had a specific error prior to this working in
the first try. So, this is Opus 4.7 for that same result we just looked at, which is like one thing that made me a little like oh, okay, I'm not 100%
impressed right now. Next up, we had the subway station zombie test, which was pretty good. The muzzle
flash effect and everything like that was impressive. However, this is another one of those that although this was good, the Opus 4.7 result that I
was testing or had tested when that came out was arguably better, and I'm going to once again do a side-by-side to showcase that. So, this is the Opus
4.7 subway station result. Yes, it is a little darker, but there's a train there. It has a smaller,
less emphasized muzzle flash, but the one thing here that was really quite impressive was when we actually shoot the environment, the bullet holes
actually appear right there. And you can see from my face in that video, or maybe you can't cuz my face will be in the same location that face is
there. I was very impressed with this. Now, the argument could be made that this was a two-part test where
first and foremost we just had it create the static subway station and then in a follow-up prompt in that same conversational thread we then had it
turn it into an FPS as opposed to just combining those two prompts for the Opus 4.8 result, but this was just such a significantly improved result
that this was the second thing that kind of made me like uh I'm not really impressed right now. So, here
was the Opus 4.8 Jerry's apartment result where okay, everything looks all right. It looks nothing like Jerry's apartment from Seinfeld, but it's you
know, it's there. It's like somewhat together. Now again, if we go and actually look at Opus 4.7 to see the test result in Jerry's apartment, we can
see right here. I think that this is a better result than what we received from 4.8 in terms of the
apartment model. It's more properly laid out in the style I guess of what Jerry's apartment would actually look like. The kitchen's more in that area.
I honestly think there's more finite detail in here as well as opposed to oh, but I had given it a photo reference there. Okay, so that is perhaps a
knock of Bijan. I will say that versus just giving it the prompt here. So, I'm glad I caught myself
on that one. So, that changes things a bit. We also had the C++ skateboard game. Now, this one was not bad. It was pretty good. Everything was clean.
It was properly boardwalk style. The tricks looked good. The water looked good, but again, if we now go back to the Opus 4.7 test video, we're going
to see that the result that made at the like end one was significantly more impressive than what we
received with Opus 4.8. So, if this ever loads, this is a more impressive result just the way the water's drawn, the storefronts are detailed, the
actual effects and everything like that was just way better than what we got with Opus 4.8. Now, the one caveat to this is that it did initially do a
C++ test and it actually just made it in 2D. This is the Opus 4.7 test video. So, this was a later
follow-up test where I took the result that it had created in 2D and said make it 3D versus just giving it the one prompt saying 3D already in the
prompt for what 4.8 gave, but still this was like better in a lot of ways. Although the people moving around I guess would not be they were better
with Opus 4.8. So I just wanted to give some level of actual side-by-side showcase because I was not
really blown away with this model to the point where I actually made a post on X saying that and I never really say negative things about the models,
but this one just out the gate did not really impress me very much and later it may have kind of fixed itself. Oh wow, this is actually running
quickly now. Our Sky Dominion game and the ammo tracers hitting the ground actually showing visible
explosions in this were sick. Look at that. I've not seen that with any of the results before. The Ravioli Rosso website was the bottle was
disappointing. I saw better bottle from Quen 3.7 Max review as well as Gemini 2.5 flash. The 3D printer sim was not working well on first try and then
later on the square was just bread like. Omni racer, this one right here is hands down the more most
impressive result in this test and perhaps one of the more impressive results I've shown in a YouTube video, but this took a long time in the code
mode with the fast mode enabled and our drum kit designer was pretty good as well. So overall it's very hard for me to judge this, but I was not
initially blown away with it as I would have perhaps expected to be and I'm very interested to see what
folks think of this model as they themselves use it beyond just watching this video and seeing my experience with it, but this video's probably going
to have been significantly longer than normal and I wanted to really test it with something more intricate because I was initially kind of like and I
want to back that stuff up. So basically that's what leads us here and this is where we'll close
out. I will put this on ultimateplay.com, so anyone interested can go and play this themselves, because this is a sick result. So, that's going to
conclude our first look and test of Opus 4.8. I will be very excited to see the Mythos-style level models that will be released in the coming weeks,
as well as perhaps GPT-56 and Gemini 3.5 Pro, as well as MiniMax M3 and stuff like that. So, with that,
thank you for watching. If you have any questions, please feel free to leave them in the comments.