Episode 9: AI Infrastructure addicts

Published: Tuesday, Dec 2, 2025 • Duration: 38 minutes • Season 1

AI Infrastructure addicts

Download MP3 | Watch on YouTube

https://github.com/addyosmani/gemini-cli-tips

Watch on YouTube

summarize "https://youtu.be/I4pmTz8EKag" --timestamps --slides

Two developers discuss the evolving landscape of AI-assisted engineering, focusing on the practicalities of managing multiple high-cost subscriptions and the technical shifts in model behavior. They explore the transition from simple code completion to complex agentic workflows, debating whether the current reliance on these tools constitutes an addiction or a necessary evolution in productivity. The conversation provides a deep dive into infrastructure troubleshooting, the nuances of different model architectures like Opus and Sonnet, and the emerging Model Context Protocol (MCP) ecosystem.

Slide 1

The rising cost of AI infrastructure

The financial burden of maintaining a modern AI development stack is becoming a significant consideration for individual engineers. One speaker notes that their monthly spend on the Claude API alone reached $80, a figure that surprised them given they were also paying for other services. When aggregating various subscriptions—including Anthropic, ChatGPT Plus, and Gemini—the total monthly “AI tax” can easily exceed $100. This is compared to traditional cloud infrastructure costs, such as a personal AWS account which might run around $30 a month for learning and hosting small projects. There is a growing concern about whether these costs should be absorbed by the individual worker or the employer, especially as the tools become indispensable for daily tasks. Despite the high price point, the speakers agree that the boost in motivation and the ability to plan complex projects makes the investment feel worthwhile. “I do feel energized and motivated to get things done with the help of AI… it really really helps at least me.”

Slide 2

Troubleshooting complex cloud deployments

AI has moved beyond simple syntax suggestions to helping solve deep infrastructure issues, such as debugging slow package installations in specific AWS regions. One developer recounts a scenario where a Postgres installation on an EC2 instance in Singapore appeared to hang for ten minutes during a Packer build. By using AI to generate debug SSH keys and monitor the process, they identified that the delay was caused by slow transfers from universal Debian packages. The AI suggested using local mirrors but cautioned that not all mirrors support ARM packages. This led to the creation of a custom latency checker and validation script to find the most efficient, compatible mirrors. This process highlights how AI acts as a force multiplier, allowing developers to build specialized tools on the fly to solve transient environment problems that would otherwise take hours to manually investigate.

Slide 3

The decline of manual plan mode

There is a notable shift away from using the built-in “Plan Mode” in certain AI tools due to concerns over accuracy and model behavior. While planning was once a core part of the workflow—creating detailed multi-phase to-do lists before editing files—some developers now find it detrimental. The primary complaint is that models sometimes deviate from the established plan or change logic mid-stream, leading to inconsistencies in the overall design. Furthermore, discussions on developer forums suggest that newer model iterations may be using sub-agents to explore codebases and generate summaries to save on token costs. This orchestration approach can result in less accurate plans compared to a model that reads the entire context directly. As a result, some power users are moving toward more direct, file-specific instructions or using specialized kits that boil down changes to individual files without the overhead of a separate planning phase.

Slide 4

The current AI ecosystem for developers is a complex “maze” of VS Code extensions, CLI tools, and varying subscription tiers. Engineers often find themselves juggling multiple plugins to access specific model features, such as the ability to paste screenshots or refer to local files more effectively. A key technical distinction discussed is the difference in context windows; for instance, some VS Code integrations may only offer a 65k token context, whereas using the same model through a dedicated cloud API or CLI might provide up to 200k tokens. This discrepancy forces developers to choose their interface based on the complexity of the task. Additionally, there is the challenge of managing personal versus corporate accounts, as using a personal subscription on company source code can raise security and compliance issues. Developers must constantly evaluate which tool provides the best reasoning capabilities for a given task while staying within their usage limits.

Slide 5

Agentic workflows and text-based triggers

The evolution of AI tools is moving toward “agentic” behavior, where the model can autonomously spawn sub-processes to complete tasks like exploring a codebase or merging pull requests across hundreds of repositories. One speaker emphasizes a preference for text-triggered agents over traditional UI buttons and menus. In this workflow, a simple prompt can trigger an “explore agent” to find applicable code patterns without the user needing to click through a specialized interface. This shift requires a process of “learning and unlearning,” as developers must adapt to the non-deterministic nature of these tools. Improvements in tools like the “ask user input” feature allow for more seamless interactions, where the model can automatically submit single-select questions to keep the workflow moving. The ability to use agents for bulk tasks, such as managing dependencies across 300 repos, demonstrates the massive scale at which these tools can now operate. “It’s about upskilling myself, building something real, not just like a toy project.”

Slide 6

Optimizing token efficiency with MCP

The Model Context Protocol (MCP) is a central topic of discussion, particularly regarding its implementation in tools like Playwright for browser-based testing. There is a critique of current MCP designs that send the entire conversation history back and forth for every individual browser action, which quickly exhausts token limits and leads to “horrible compacting” phases. A more efficient approach involves using models that can chain multiple tool calls into a single execution script. This allows the model to run a full trace, capture screenshots, and analyze the DOM tree (represented in YAML) in one go, rather than step-by-step. By generating a script to execute the entire flow and returning only the final result or error trace, developers can significantly reduce token usage. This method is seen as a major innovation in newer model releases, making them more cost-effective for complex integration testing and live troubleshooting of web applications.

Model: google/gemini-3-flash-preview

Transcript (auto-generated from YouTube captions)
I was going to I was going to show you
something here.
>> Yeah.
>> I got a I I contacted my employer saying
like
I can't see how much I'm spending. It
says you're on the you're seeing the
free plan because I'm using the cloud
API.
So if I go to settings usage.
Okay. No, I guess. So yeah, long story
short, I'm I've used $80 this month.
>> 80?
>> Yeah. Is that good?
>> That's a lot more than me, bro. You
always keep saying, "How can I use so
much AI credits?" And now you're using a
lot more. [laughter]
>> So if I But I I'm pretty sure that I
looked at Claude yesterday. You talked
about trust and um about trusting the
code. Now you have seven, but that's
your VS Code spend. That's different,
right? That's not your cloud.
That's GitHub. Yeah.
But how much?
>> You have no budget.
>> But still, it makes it look like I've
got 75% premium requests used.
>> I I just don't understand it. I mean,
how if I can't understand
how I'm spending money
on
AI? Yeah. So, it basically kind of
shocked me because if I'm like, if you
had to How much are you spending on AI
right now? Then
I pay Well, I'm always confused between
Singapore dollars and US dollars. I
think what I'm seeing is Singapore
dollars 30 for an entropic monthly
subscription. and I added another 30 in
my wallet with a $20 monthly cap. So in
total if I I spend everything I I I'd
hit 50 if it's in dollars 50 and then
and just just to
>> screen froze.
>> Yeah, it's frozen for me too. Hold on.
Let me see if I can just switch to my
>> You're in a
>> FaceTime camera.
>> Funny pose.
I I like to use the my my uh my phone
because the quality is so much better.
>> Okay. That was 50 on Antropic, right? Um
when you
>> Yeah. So, sorry when I said you spend 80
is more than me. I did not take into
account Chad GPT and uh Gemini U
subscriptions.
>> So, you're spending you're spending like
100. The the scary thing is is like I'm
like if if my employer said, "Oh, Kai,
you're spending too much on Claude.
We're not going to finance your $80." I
feel like it's the same thing with AWS
because I have my own AWS account just
for like learning and doing things.
And that cost me like 30 bucks a month
because I can't get it lower than that
because I've loaded up with some S3. So,
I'm just I'm I'm a little bit worried
that as a as a worker that I have to
take on these costs and like my wife
like bemonones me about our Netflix and
all these other subscriptions if if we
all if if I have to maintain an AI
subscription of 100 bucks a month. I
mean, is that is it's a bit annoying,
but I guess it's worth it. But,
>> bucks is Yeah,
>> 100 bucks is something but like it's
worth it. I mean I do feel I do feel
energized and
>> and motivated to get things done with
with the help of AI you know never mind
it like completing my code like the
planning everything it really really
helps at least me
>> never mind it also taking on a funny
thing right I was installing posgress on
an EC2 instance in the Singapore AWS
region and it was taking a very long
time it looked like it was hanging I was
using a packer build script right
supposedly completely finishes in 15
minutes but just adding Postgress now it
was like hanging for 10 minutes before
it even like finished the Postgress
installation which I put early in the
installation process [gasps] and after
troubleshooting it with AI for a while
it just said well you know we looked we
we signed in we had package generate a
separate uh debug SSH key so I could log
in to see to monitor the progress and we
we concluded that the the transfer was
just slow because we're downloading from
like universal DBN packages and Um, and
so it suggested a couple of mirrors, but
then we had to validate because the
machine was ARM and not all mirrors
support ARM packages.
>> And so it did some latency like we ended
up writing a latency checker for the
several um Singapore
>> mirrors available for like DBN ports or
whatever. And I ended up with like um
and and then there was a an edge case
where one of the mirrors maintenance
page show that they were no longer
supported but according to the benchmark
results had like a sub millisecond
latency which turned out to be a treat a
redirect to an error page and so it
didn't validate the the actual binary
contents of of the package that was
supposed to be there. Right. So it just
Yeah. So it it responded 200. Okay. But
the actual contents of the index was an
error page.
>> Yeah. So, so then we ended up with like
a whole a whole script to validate
mirrors for Ubuntu package for DBN
packages that are ARM compatible. Uh
well, any compatible because it checked
the architecture of the of the u of the
the kernel, right? So, so just to say
like yes, AI is so exciting, but as part
of my process, I ended up writing a
benchmark script for [laughter] the
Singapore.
>> Yeah, you get nice little surprises and
bonuses and and all sorts of artifacts
out of it.
Oh my gosh. So,
>> finished.
>> I want you to pick up on with on you on
the um
Sorry, I lost my train of thought. I'm
just I'm just I'm just kind of like I
don't know. I'm just like [snorts]
>> It's too early.
>> Yeah, it is a bit early. Yeah. I'm just
thinking that like how how much is AI
worth to me? It's like it's now just
it's now undeniable. I cannot live
without it. I'm just a little bit sad
about it.
>> It's funny because originally I had like
these these talks and panel discussions
and everyone agreed like we we we do a a
Friday, no AI Friday to make sure that
our muscles are still being exercised. I
haven't even thought about that in the
last four months to consider no AI
Friday cuz [sighs]
>> are we are we addicts? Are we I mean you
talk about your supply all the time. I'm
talking how I can't live without it. Are
we
addicted to AI?
Sad is it? I don't think it's sad. I
think the amount of output and I don't
think it's illusionary output as well. I
think it's real output. there's a 100%
sure that I couldn't do what I've built
today without the assistance
uh and also the motivation that it gives
you you know because no matter what you
come up with it will come up with like
something that looks plausible and once
and then some cause fallacy once you're
down the the road you just persist until
it's there and then you need AI to get
you out
um yeah but but when I was saying costs
for AI and I think like entertainment
subscription is similar Right. Actually,
like my chip is the good thing about
OpenAI is it's completely shared with my
family. Maybe it's not good that my son
is using it all the time because he's
literally giving like verbatim
assignments like here's a story analyzed
for literature like
>> yeah I got I got my wife using Claude
>> and she
the interesting thing she said yesterday
in the car [clears throat] was that she
wanted to cancel it but then she said to
me because I think Gemini does the same
thing but then I asked Gemini a question
and it completely messed it
and Gemini got it really right. Um, and
Claude got it right. So now I'm thinking
I shouldn't cancel the subscription. I
was going, "Yeah, maybe you should keep
Claude."
>> I subscribed Gemini last month when I I
was I think it was a bug with OpenAI
when they did the release. That's it
showed like that you had used all your
budget at some point. It displayed that
all the time. So, I was out of codeex
and cloud and I was like, well, I really
want to like continue and I was hoping
betting on Gemini 3 coming out anyway.
So, I was like, I might as well, you
know, subscribe to that while I'm at it
with the intention to cancel it if it
wasn't worth it. And I think I should
cancel it
>> Yeah. But it's the same thing like I
have Netflix, Disney Plus, and Amazon
Prime. I mean, honestly, Amazon Prime is
very small amount.
>> Mhm. Um, and and
>> yeah, yeah, Amazon Prime is the
cheapest.
>> Yeah.
>> Yeah. And yeah,
>> Disney Plus, I think I want to cancel it
because the most expensive and honestly
the output is so bad.
>> What What about cloud services like like
AWS? I mean, you must have like a $30 a
month type thing that I do.
>> Oh, yeah. I um I do have an AWS account.
I think it's something around that. I
have a CDM for the project which is
backed by static S3. I have no like it's
all serverless. I don't even use
lambdas. It's all static basically. Um
just the route 53 uh the TLS like the
certificates.
Um but the TLS is free, right? But it's
also the
uh what's it? Well, the CloudFront
distribution itself. Uh what else? uh
the the the route 53 like domain
registration because I do have some
domains via namecheep but I think it's
so much easier to just go through AWS
and like the cost difference make it
like
building
>> account I guess the $30 a month I mean
I'm aggregating it but it's because I
maintain
you know eight domains that I've never
really used in my life but I still pay
for them because I'm an idiot. So this
this this topic will be like how to like
all of the useless stuff we pay for.
[laughter]
>> Yeah, something like that.
Um, sorry, I'm still trying to gather my
thoughts. There was something I wanted
to chat to you about. Um
yeah, you you mentioned that like
switching to plan you you don't use plan
mode anymore like I I
>> so so because planning is like under the
spec kit where it creates a detailed
multihase and then boils it down to each
individual file exactly what needs to
change.
>> Oh this is because you spec it right?
You don't need plan what you're saying.
So now if I like initially when I did
that I went into cloud and as usual fire
up plan mode to create like a bunch of
to-do items and then read the spec but
what I found is that cloud sometimes
just changes the plan like even though
the task description are clear this is
what you need to do in this file and it
just goes and does something slightly
different and then in the overall design
things don't work anymore. I I've seen
cloud do that. So I'm actually now cloud
code plan mode is detrimental to my
>> that doesn't sound good at all.
I'm I'm plan mode. I'm plan mode all the
way, man.
>> That's why you start, right? But I've
also the reason why I sent you that
message is because I saw two or three
threads on Reddit uh yesterday because
with the new Opus 4.5 release, they also
revised the way plan works and they said
for Opus even it's worse because now OPU
spends up spins up sub agents and then
works off summary results and as a
result doesn't get like as good a um a
plan anymore. So people are complaining
that
>> is like a a better planning model, isn't
it?
>> Yes. But it spins up sub aents to
explore the codebase and then works off
those results which are inaccurate.
So if if you were to use Opus, which is
a more expensive per token cost,
>> you get more you get other things you
don't want with it. Is that is that what
you're saying?
>> No. No. If you were to use Opus, which
is like very more expensive per token,
uh it would itself read and understand
everything and then make a make a plan
out of it, right? But because they're
trying to save cost, they are like
having Opus more as the orchestrator
spinning up sub agents that go and read
things then create summaries and then
feeds that back to Opus. As a result,
those summaries are not as accurate and
Opus makes incorrect plans. That's the
complaints that I read on Reddit um
today and and I was like actually it's
not a problem for me because I'm not
even using plan mode anymore. Even
before the update, I already noticed
that there was something wrong with it.
>> In in your screencast you you shared
with me there's something else that I
didn't quite understand or I haven't
seen before. You using anti-gravity, I
guess, right?
>> I'm using what? Sorry.
>> You were using anti-gravity.
>> Anti-gravity. Yeah. Yeah, there was this
workflow thing that I had.
>> Yeah, but like you were choosing there
was an option down by the model where
you were choosing if it was like
>> Oh, that's high, medium, or low
reasoning or something.
>> Oh, that's a that's a codeex plugin. No.
>> Oh, can you just show that? Like what?
Why? Why would you
>> twiggle that toggle?
>> Uh, which one is it? This one.
>> Yeah. Can you just zoom in down there?
So to see your
>> how would I zoom in? I can do this. Is
that zooming in?
>> Um Oh, I thought you might use the the
Apple zoom which is like I don't know
what I think you have to enable
>> but you can read it, right?
>> Yeah. Yeah, it's good. But
>> the setup is to put on your VS code your
chat window on the right on this right
sidebar.
>> Yeah.
>> And by default you will get your co your
Visual Studio Code
>> um here. Right. And you can choose
codeex. Yeah,
>> those are the ones that you get with
your your co-pilot subscription.
>> Yeah, and I'm locked into 4.5, that's
for sure.
>> I mean, um,
>> and then
>> I have installed another plugin here
which is called Codeex.
So, I have the the Claude Code plugin,
but I also have the codeex plugin, the
OpenAI codeex. Where is it?
>> Yeah, it was up the top there. I think
it was at the top. Uh,
>> this one.
>> Yeah. So when I I started using codeex
through this CLI um it was horrible
because you couldn't paste screenshots.
It was really bad compared to Claude Code
right. So I installed this plugin and
here you can put images you can easily
refer to files things that the CLI don't
really has properly and down here when
you select the model that's where then
you can now access with your I have chv
plus right $20 a month I can access now
in my VS code through that subscription
GPT 5.1 codeex with high reasoning I
think it's a promotion they're trying to
see how well the model does
>> I don't understand why why couldn't the
the co-pilot chat expose 5.1 C codeex
max. So this is something also I just
read on on uh on Reddit the other day
was people asking like what's the
difference between running Sun 4.5 here
and running Claude Code son here in the
in the terminal I can run them both
right and one of the comments and I
don't know if this is verified said that
the context that VS codeense is much
smaller 65k tokens instead of like the
200,000 tokens that you get um in in
Claude Code so so that's why they are
able to offer for these at like 1x
within your VS code copilot subscription
because they're not as effective.
>> Yeah, but we I'm more I'm more u
concerned about your codeex one, not
clawed. Why why why can't you use codeex
max in your copilot chat? Why do you
have to install the codeex uh
>> because it's a different subscription?
>> But isn't Codex OpenAI
and isn't and that's owned by Microsoft
pretty much. But I'm paying it's
different if you pay Microsoft vs code
and OpenAI is still its own its own
entity, right? They have a partnership
and an investment.
>> Oh, I see. I thought I thought there was
I I assumed there there'd be some really
tight integration
>> because
>> you know Microsoft is a customer of
OpenAI like a partner and they get
access to some models
>> because because it is a bit of a like a
maze to I mean you must spend half your
day working out which extension, which
optimization,
which thing to to use to get the best
out of your subscription. It's a
nightmare if you're like a if you're in
like a corporate environment, you know,
I'm not I'm not even allowed to install
the extension. I think uh
>> uh corporate environments I'm not
talking about and I'm on a corporate
laptop actually, but luckily they have
not locked that down. Um and this VS
Code subscription is through the GitHub
organization. I I I used to have my own,
but I canceled it. Uh and then the
company has seats, right? Um so this one
is controlled by the company and okay
and it can see how much each of us is
using. This one is my personal codeex
which of obviously if I work on company
um source code that would probably not
be acceptable that I am using my
personal codeex with like the open eye
uh plus subscription versus the VS code
agreed
um like you know part of the GitHub
organizations we discussed.
>> Yeah. Um,
>> I'm just using the chat. Um, but also
then you have you need to learn how to
set up your workflow. I installed this
codeex plugin the moment they announced
it. Like, hey, we have a codeex plugin
and that's it. Like, I added that in. I
saw that I could paste screenshots and I
was like, hey, let's, you know, I like
that more. And I go between the codec
cli and the plug-in however I feel like.
And like I said, most of my workflow is
Claude Code. Um, but then sometimes
because I look at my usage here and I
say, "Oops, I'm close to my weekly or
whatever." Then I start like, "Can I not
do some of these task with Colex
instead?"
>> Yeah,
>> I think maybe it was maybe it was like
some sort of FUD, but I saw I saw a news
article or tweet that that evidently
Open AI is giving
free AI open AI to to India or something
crazy. Did you read that or am I just am
I just racist? [laughter]
>> Pl the sixth on both or is it the fifth?
[laughter]
Uh no, but um that would mean that if I
re answer it, incriminate myself. That's
not what I meant. But anyway, [laughter]
oh yeah, I found it. I found it. Um, I
mean it's not being I guess I I mean I
think it's a little bit unfair to offer
a whole country something that we
ordinarily have to pay for.
>> Well, how much of you how is your salary
compared to I don't think it's unfair.
>> Oh, for Christ sake. You're going to
Okay. So, whole India gets open AI.
>> Why not? [snorts]
>> Um,
okay. As long as it's confirmed that
they're in India. [laughter]
You have to cut that out.
>> What do you mean? As long as it's
confirmed.
>> No, no, never mind. I didn't say
anything.
>> I mean, you should move. I mean, I'm
just thinking that like in in the in a
dystopian future that that Vincent moves
to India just because he's addicted to
his uh codec subscription and this is
the only way it can be sustainable.
I don't see it as an addiction. It's
more like an ambition. An ambition of
Yeah. It's about upskilling myself,
building something real, not just like a
toy project. And and honestly, I often
ask myself, why do I spend time on doing
this when I could just, you know, do my
work and then go to the beach in Vietnam
and kite surf, you know? So, so it's
more our ambition because how much like
how much time do we have left to um to
realize? Yeah. Yeah. Yeah. That's one
thing. I mean, moving to England two
years ago has been a huge culture shock
to me because there's a lot of people in
England and probably Europe who work
like 4 days a week. I'm like, dude,
you're in your you're in your freaking
prime. It's your it's your obligation to
your family and to you to work as hard
as possible to maximize everything so
that you can you know retire early if
anything and then
>> retire with a broken back and inability
to walk properly anymore and not enjoy
the time with your kids. I mean there's
a there's a there's a good reason why I
I I really like um Scandinavian
countries when I work there because
>> Oh no. So you're going to tell me no. we
actually should be working four days a
week and that's why we use AI.
>> Uh
I mean I'm saying that right. It's a
flip coin because when COVID finished I
know so many of my friends from
Singapore who were cooked up in you know
at home decided like that's it you know
I'm I'm not spending my life working.
I'm going to go travel for the first
year. Some of them took a sabbatical and
then all the tech layoff happened and
then half of them couldn't find a job
because the market was saturated.
>> So what are they doing now?
>> Your friends
>> panhandling in Bali.
>> So So the So on one side I I'm saying
you should spend your youth with your
children. You should you know you have
to balance it like work life balance
even though it's your prime. But I'm
saying that and I'm doing the opposite,
[laughter] right? I'm up in my bed on
on, you know, doing system design
specifications from my phone uh or while
I'm having a coffee outside. Um and I'm
not spending enough time, you know,
doing the things that I can enjoy right
now. Um so yeah, I'm not consistent.
>> Yeah, it's a difficult topic. the um
there's a guy that I've been following
for years uh Eddie Osmani. He's he's big
in the web world and I used to be big in
the world. I don't know if I used to do
stuff for the W3C and and browser
engines in the beginning of my career
and I think I'm come across Eddie Osmani
then
and he's still around.
He's he's like a a lead at Google and he
wrote an open he wrote an AI book or
something.
>> I think I saw I follow several Gemini
CLI like core team members to find out
if they are doing some improvements to
the product and I think I saw somebody
share this like uh Gemini CLI things as
well which I was like I'm going to have
to look at it but then
I mean most of these are like oh this is
>> yeah I know about that. you know about
that. This is like use Claude
>> create custom commands. I mean this
>> create custom commands. Okay. Yeah. Yep.
We know about that. I I to be honest I'm
not as I pointed out yesterday I don't
like things polluting my command space.
I'd rather use um
the way that Claude the way that you
trigger an agent or a skill in Claude is
just by text
but via the prompt and it works
reliably. I I I never get the feeling
that oh no it's not triggering the right
MCP or
>> that's the weird thing about using these
tools is that we are used to find menus
and buttons to click on
>> whereas right now in words we say
something and that kind of triggers the
LLM to more like oh
>> and you can see that it triggered it.
>> Yeah. Yeah, but the thing is like they
have this thing of agents, right? But
you don't really know like, oh great,
there's agents. And sometimes it's like
decides to use it. But you can actually
just say like, oh, by the way, you know,
send off uh an explore agent to go
through the codebase and find wherever
this might be applicable and it just
spawns an agent and does that like
there's no button to click,
>> right?
>> Yeah. Yeah.
>> What's the words that I use to trigger
>> me? At one time I I used agents to
depend a bot merge everything in my in
my 300 repos. It worked really well.
Um, but I I want to kind of tie it into
that because I shared with you something
that I saw in the change log of cloud
code and they said they improved the ask
user input tool and I was like oh so
that's the thing it's called it's like
ask user question tool to autosubmit
single select questions on the last
question and so
>> right so so when I saw the name of the
tool now I suddenly like have maybe like
son will know that if if the user
says something or ask me a question
about this, it will automatically change
>> so you know how to use it. Yeah. Just
>> there's a lot of learning here like just
to know when an agent is spinning
knowing that you're you you can you're
in plan mode so you can get the prompts
knowing the dialogue for an MCP call.
>> There's a lot of learning and
unlearning.
>> Okay. because I saw somebody on Reddit
complain like the latest update on the
plan mode behavior has broken my
workflow. And I'm like, yeah, who cares?
I mean, that's part of of of of your
job, not only to know how to phrase
things to trigger the behavior that you
want to see in the model, but also
realize that that behavior is no longer
the most efficient and change the way
that you prompt a model.
>> Yeah.
>> So, learning and unlearning, which is
why it constantly changes. [snorts] You
know, I can see some people struggling
with this. I mean, I can see some
Anyway, so tip three, use your MCP. We
all know about that stuff.
>> I think struggling because of the
non-determinism, right? Because
supposedly everything is perfect and
when you say something, it's going to
act the way you expect it to work. Yeah.
The problem is like what I just noticed
here. It's triggering on the tabs being
in in the Golang file as an indentation
and then it's it's update tool not
working and then it's it sometimes goes
to our I'm going to do an here do with a
cat or I'm going to use Python to update
the file. Like what? Stop stop.
>> Yeah, I I mean I can see some people
struggling. Maybe I'm just belittling my
some of the people I've come in contact
with, but uh but I can see [laughter]
>> be very specific.
>> I can see some people struggling, but
maybe maybe it's a skill we can all
learn. Okay, tip four. I think that I
think leverage memory addition. So I
think I'm I'm when when someone says
memory, I'm thinking beads already.
Do you use do you use slashmemory
>> and used to be with a hashtag to just
update the cloud MD file I think but
they might have changed that. So the
thing about beats is exactly the thing
like before right at some point if cloud
code shell is so much better than beats
I must be able to get rid of it quickly.
So if if if it's tricking up my LLM more
than it's helping I need to be able to
remove it right.
And regarding memory, I mean I remember
when a long time ago you would say
something like uh please remember to do
this always. Then it it would
automatically pick that up and feedback
like hey if you put the hashtag it will
automatically write it to the cloud MD
file and then the slashmemory was
supposed to be something similar but
maybe they've updated it, right? I don't
know that.
>> Yeah.
>> And and this is for Gemini, right? This
is not for Claude Code.
>> Check restore as an undo button. Um,
>> that's also again is just a double
escape.
>> Oh, yeah. Yeah. Then you get the menu
and you can choose. Yeah.
>> I use it a few times actually. It's I
love it.
>> This applies to Claude. Uh, well, tip
six it read Google Docs.
Um, I think Claude Claude Claude desktop
could do this. I noticed that it
integrates quite well in my
>> actually Opus 4.5 has been significantly
improved around um doing those
multiflows where it goes across
documents. I never do that because I do
coding task and I don't have to deal
with Google Docs but a lot of the
entropic examples on their blog post
related to Opus 4.5 is the token you the
token usage effectiveness of Opus 4.5
when doing these tasks. Um, and
>> the whole MCP drama that is now because
Entropic created it and now they're
saying, "Well, we don't do MCPS like
that anymore." You can actually hint on
your tools um with information about how
to use the tool in a script so that Opus
will write a script to use the tools to
then execute everything in one go.
That's one of the things like I I joked
about yesterday with like on Facebook
was like everybody wrote these MTPs with
all these tools. Now you have to go and
update them all because now you have to
go and indicate how to use that tool in
a script for
>> open. Yeah, I saw your I saw your
LinkedIn thing.
>> Yeah, the the we talked about playright
before, but every time I use playright
at work, the the token limit gets gets
exceeded and then it does that horrible
compacting uh phase which I've now
turned off. So I don't know what's going
to happen now that I've turned it off
thanks to you. Does it just stop?
The thing about MC about playright right
I think this MCP server is is is wrong.
It's not good design because
>> it's like one of the one of the what do
you call it flagship MCPS but carry on.
Well, to me
after after adding playright scripts to
my my you know my API with a with a web
app to go through the flows user flows
you know login get redirected to
keycloak um sign in get back to the app
then validate that you can do this but
not that if depending on your group
membership and things like that these
type of user flows very hard to test
with uh integration testing golang or
something like that right because you
need to parse the respon from keycloak
to find the the the session token or the
whatever it's complicated. So um after
building those playrights flows I was
really impressed with pay playright
because what you get is a full trace of
screenshots context like this is what
what the it has like this YAML
representation of a web page of the tree
of the like the DOM the document object
model of what are the different elements
and how they're nested and what their ID
>> how do you see this YAML does it spit it
out
>> you see it also if you if you use the
dev tools Chrome MCP when you're doing
like you wanted to investigate some
problem in your web app, it can launch
Chrome, which is way lighter than the
than than the than Playright itself
because Playright requires a plug-in,
but Chrome can run on its own with the
Chrome MCP. So, I like that one. And it
can launch it and then the LLM will say,
okay, I take a snapshot and it shows you
like a YAML document tree. And then when
you uh when it sees like let me check
the response from the API server. It
goes to the JavaScript console in the
browser and runs a small script that
uses the React app state and um does a
query like hey I have this session token
and everything and then boom it it does
the query from within the console which
is way more powerful than what you can
do just within the terminal right so so
this type of actions amazing for like
live troubleshoot yes it's going to eat
your tokens and I think they [snorts]
made some as well
>> I use playright with a a brow an
existing browser so that has all my
tokens and all that stuff I But then
what I what I think the mistake is of
this MCP a playright MCP server to drive
a browser which is like send the message
uh to the browser get the response then
send the whole conversation to the API
to then generate the next step which is
your context window then send a message
to the browser get the response append
it then send the whole thing
>> I agree it's a it's a nightmare it's a
nightmare
>> right so what I think makes the most
sense is like the execution logic of
opus which is you have a stra a trace
you kick off the playright flow and and
actually within the playright browser
window you get that next to the error
where it happens like hey I'm supposed
to see this button but it's never
visible and I time out then it gives you
like this error and you can click uh
copy prompt and you can paste it into
into your model and it says like you are
working on this problem this is the
playright test this is source file this
is the this is the snapshot of the
browser context and this is the error
message that that that we're stuck on
and then the whole context is there.
That's like much better than like do
this then do this, then do this, then do
this, do this, and send the conversation
over the whole time. You get the whole
flow and you know, you run through it.
That's exactly the idea of Opus, right?
You run through a process. You put the
>> So, so wait a minute. Is this a solved I
don't really understand. Is this a
solved problem with with Opus or is this
>> Yeah, the the big innovator of Opus is
that it identifies like how to chain
several tool calls and then run them and
then get like send
>> I need to I need to try this. I'm
struggling.
>> So that's why they say Opus is way more
token efficient. Opus 4.5 is way more
token efficient and bottom line cheaper
than Sun 4.5. So if you can if the model
can really be efficient with its tokens,
but it has to fit the use case. I think
>> I thought we started the conversation
saying that the playright MCP sucks. So
it the playright MCP can just stay as it
is and Opus can basically compensate.
>> The playright MCP is the wrong tool
because it's going to send your
conversation across every time the whole
context window, right? It's going to do
an X tool execution, get a little bit
more appended to the context, send
everything over and then send back uh
response tokens appended.
>> But how do I set up?
>> So MCP server is bad. The actual ability
to run traces and capture the trace is
good because that's the concept of a
full execution and get the result of
that execution, not do every individual
call and send the conversation over
every time. You see the difference,
right?
>> Yeah. But what are what are my practical
steps to get my playright flows more
efficient then use opus?
Uh
well so what you said earlier was kind
of correct because you said like opus
will fix it because it should be able to
change the chain those MCP tool calls uh
and then do the whole flow and get the
output. I have I don't know that. But
what I do know
>> is I got to have a play
>> the playright uh tracing capability and
using the MCP with current model doesn't
doesn't work that way for me. Okay.
>> But it would be interesting to know if
if OPUS is therefore like what you said.
So Opus solved that. Right. Maybe it is
right.
>> Let's let's let's carry on looking
through this thing. Do I I to be honest
I don't use the ad symbol anymore
because every time I press it it
launches UI. I just I just paste the
relative path.
>> Is this for Gemini?
>> Yeah. But I think the same works this
works in Claude I think.
>> Yeah. Yeah. Yeah. But in cloud it just
like drops down the file list and then
you just tap complete the file and then
it kind of like sends the
>> I'm used to like copying relative path
from VS Code and just pasting it in. So
for a while and I'm not sure who I think
it's Gemini doing this when you relative
copy relative path when you paste in
Gemini it adds the add some symbol on
its own.
>> Oh really?
>> In the in the Gemini CLI. Yes. So if you
copy a relative file it actually like
creates it as include this file in in
the in the in the query because you're
going to need it anyway which I don't
fully agree with. Sometimes I I remove
the ad sign and I say and go through
this file bit by bit if you need it like
search for these strings and then go
through it. I don't want to send the
whole file, right?
>> Uh
cuz I have a feeling you're I mean this
to me here is an anti pattern because
like
>> the minute I do something like this I
feel AI is just going to do some really
crazy answer. Like I feel like some
people,
okay, I'm not I'm not trying to I'm not
trying to I'm not trying to like
identify my my colleagues, but some
people don't know about diff
>> and it's kind of scary
>> and like they should be using diff to
see the changes. They should not be
doing something like this.
>> I I was going to say the biggest problem
there is the extension. It's it's a
Python file. [laughter]
>> Okay, next. On the-fly tool creation.
What the hell is that?
Um,
>> don't know. I don't know what that Do.
You know what that is? Sorry, my
mother's up. It can use its coding
abilities to fabricate new ones as
needed.
>> Oh, I think I think I think it's like
creating
Oh, yeah. Like in in
>> write a Python script to parse it. Yeah,
like Claude skills has this has this uh
>> directory where you dump in scripts
which can help it do its thing. I think
it's it's alluding to that.
>> Yeah. And which is I think very valid.
Um which which is kind of like related
to the blog post again, right? Where
where they can they can create the
scripts to do the work and then you know
just put the pass in the input and then
see the output without having to you
know pass the full context across each
time. And so you save tokens that way.
Yeah.
>> Use Gemini CLI. Okay. It's just like
using YOLO mode. Okay. This is all
boring stuff.
I I never do things like this. I don't
>> I haven't but like
>> I know about it.
>> Speckit. I thought speckit had some
scenarios where it told inside the
prompt to say give me sub agent prompt.
Charlie.
>> Okay,
hold on. Oh god. Unfortunately, this is
the time I need to help my kids get to
school.
>> Yeah. Anyway, I thought thought it was a
good chat. Maybe I can merge the two
that we had and
>> Yeah, make it entertaining on some some
things.
>> All right. See you.
>> See you.