Why ChatGPT Cannot Replace Travel Agents — Notes from Building the Backend

Every few months a tech publication runs some variant of “ChatGPT will replace travel agents.” The argument sounds airtight: travel planning is mostly research, LLMs are great at research, therefore the job is done.
I work as a backend developer at MindDMC, an AI itinerary platform built for travel agents and DMCs. When the team started, we tried to build the entire product on top of GPT-4. That approach failed — not because the model was not smart enough, but because we were trying to solve a transactional B2B problem with a generative consumer tool.
The architectural mismatch was the lesson. I think it is worth sharing because the same pattern shows up in healthcare, legal tech, financial services, and any other domain where AI gets pitched as a replacement for human professionals.
This is a technical post about why the architecture of consumer LLMs makes them structurally incapable of doing what a travel agent does — and what a system that can do that job actually needs to look like.

The demo trap
If you have used ChatGPT to plan a vacation, you have probably had the same experience I had the first time: it feels like magic.
You type “plan me a 10-day trip through Italy in October, mid-range budget, mix of cities and countryside.” Out comes a beautifully structured day-by-day itinerary. Florence on day 1, Tuscany on day 3, the Amalfi Coast on day 7. Suggested hotels. Restaurant picks. Even a packing list.
This is the demo that has launched a hundred “AI will disrupt travel” think pieces.
The problem is what happens next.
Now imagine you are a travel agent and a client just paid you a USD 200 consultation fee. You need to turn that ChatGPT output into a bookable, contractable, deliverable trip in the next 48 hours. You need:

  • Real availability for those hotels on those exact dates
  • Actual pricing, not 2023 estimates pulled from training data
  • A confirmed transfer service between Florence and Tuscany
  • A proposal document with the agency’s branding
  • The ability to swap any component without rewriting the whole itinerary
  • A version the client can approve, after which the booking goes through

ChatGPT cannot do any of those things. Not because it is poorly designed for its job — it is excellent at being a generative writing tool — but because none of those things are what a generative writing tool is built to do.
The failures are architectural. Let me walk through them.

Problem 1: The stateless generation problem

LLMs are stateless text-completion machines. You send tokens in, you get tokens out. There is no persistent state, no transactional layer, no external system being modified.
A travel agent’s actual workflow is the opposite. Almost every step modifies external state:

  • Querying live hotel inventory in a Global Distribution System
  • Holding a room for 24 hours pending client approval
  • Confirming a rail seat with Eurostar
  • Issuing a booking through a wholesaler API
  • Generating a PNR

None of this exists inside the LLM. The LLM can describe a hotel beautifully, but it has no idea if room 412 at the Hotel Cipriani is available on October 14, and it has no mechanism to find out.

You can bolt on tool use (OpenAI function calling, MCP, agentic frameworks), and I will get to that. But the moment you do, you are no longer building “an LLM solution.” You are building a traditional integration architecture where the LLM is one component among many — and the engineering complexity lives in the components the LLM does not provide.

Problem 2: The pricing hallucination problem

This is the one that killed our first prototype.

We asked GPT-4 to generate a 7-day Switzerland itinerary with hotel pricing. It produced gorgeous output — and quoted CHF 380 per night for the Hotel Schweizerhof in Lucerne.

The actual price that week was CHF 740.

That is not a model defect. The training data has a cutoff. Hotel pricing fluctuates daily based on occupancy, season, events, and yield management algorithms run by the hotel chain. Even if the model had been trained on Hotel Schweizerhof’s rate card from last year, it would still be wrong today.

For a consumer asking “roughly how much does a week in Switzerland cost?”, the hallucinated number is fine — they will check Booking.com anyway. For a travel agent quoting a client, a 50 percent pricing error is catastrophic. It means either you lose the booking when reality catches up, or you eat the difference.

The only fix is to ground every price in a live API call to actual inventory — HotelBeds, WebBeds, Stuba, or whichever wholesaler serves that region. The LLM’s job becomes describing what the API returns, not generating the price itself.

This is RAG (Retrieval-Augmented Generation), but with one critical difference: in most RAG use cases the retrieved data is static documents. In travel, the retrieved data is a real-time pricing API response that expires in minutes.

Problem 3: The context window problem at scale

GPT-4 Turbo has a 128k context window. Claude has 200k. These sound enormous until you try to fit a real itinerary into one.

A single bookable 10-day itinerary, fully specified, looks like this:

  • 10 hotel options per night with full details, amenities, cancellation policy, pricing tiers → roughly 80k tokens
  • Inter-city transfer options (train, car, regional flight) with timetables → 15k tokens
  • Daily activity options with operating hours, group sizes, weather contingencies → 25k tokens
  • Restaurant suggestions per location, dietary filters, reservation requirements → 12k tokens
  • Client preferences, travel history, past bookings → 8k tokens
  • Agency branding rules, output formatting, compliance disclaimers → 5k tokens

That is 145k tokens before the LLM has done any reasoning. You have already blown through every consumer model’s context window.

You can compress, summarize, or use retrieval to load only what is needed for each generation step. But now you are building a multi-stage pipeline with a retrieval system, a state manager, and a planning layer above the LLM. The LLM is one node in a graph, not the product.

Problem 4: The transactional integrity problem

This one is subtle and it is what most “AI travel” startups underestimate.
When a travel agent confirms a booking, three things must happen atomically:

  1. The supplier confirms the room is held
  2. The client’s payment authorization is captured
  3. The agent’s commission tracking is updated

In database terms, this is a distributed transaction. If step 2 fails after step 1 succeeds, you have a held room with no payment. If step 3 fails after step 2 succeeds, the agent does not get paid for work they delivered.

LLMs do not do transactions. They generate text. To get transactional integrity you need an orchestration layer with rollback semantics, idempotency keys, and reconciliation logic. None of this is something you “prompt your way to.”

This is why every serious AI travel platform — including ours — ends up looking architecturally a lot like a traditional B2B SaaS product, with an LLM acting as the natural-language interface to a deterministic backend. The LLM is the steering wheel. The transaction engine is the rest of the car.

Problem 5: The workflow problem

The final issue is the most boring and the most fatal.

A travel agent’s deliverable is not a chatbot conversation. It is:

  • A branded PDF proposal with the agency’s logo
  • A client portal where the customer can approve, modify, or reject the itinerary
  • An invoicing system tied to the agency’s accounting
  • A reminder system for visa deadlines and check-in dates
  • A handoff to operations staff if the booking is complex
  • Post-trip feedback collection

Every one of these is a product surface. ChatGPT does not have any of them. It has a chat window.

You can ask ChatGPT to “format this as a proposal” and it will give you Markdown. That is not a deliverable. A real proposal needs typography, page breaks, image placement, the agency’s brand kit, and a downloadable file the client can sign.

A travel agent uses an AI tool the way an architect uses Revit. The tool exists to accelerate a specific workflow, with specific outputs, in a specific business process. A general-purpose chatbot is not that tool.

What B2B travel AI actually needs

After we burned the GPT-4-only prototype, the team redesigned around what we now call the LLM + Travel API hybrid pattern:

  1. An LLM layer for natural-language input parsing and prose generation. This is what GPT-4 and Claude are good at, and we use them for exactly that. Nothing more.
  2. A real-time inventory layer with integrations into wholesale APIs — HotelBeds, RailEurope, WebBeds, Stuba, and regional DMC partners. Every price, every availability check, every booking confirmation goes through here. The LLM never invents these.
  3. An orchestration layer that handles the pipeline: parse user intent, fetch live options, rank them against client preferences, generate the prose description, format the output, and prepare the deliverable.
  4. A workflow layer that handles agency-specific concerns: white-label branding, proposal templates, client approval flow, payment handoff, post-booking operations.

The LLM, in the final architecture, is maybe 15 percent of the system. The other 85 percent is the boring transactional infrastructure that lets the LLM be useful in a business context.

That ratio surprises engineers who come into travel tech thinking the LLM is the product. It is not. The integration plumbing is the product. The LLM is the user interface.

The general pattern

This is not a travel-specific lesson. It is the same architectural pattern that shows up everywhere a generative tool meets a transactional reality:

  1. Legal AI — drafting a contract is generative; making it valid in a jurisdiction is transactional
  2. Medical AI — describing a treatment plan is generative; integrating it with the EHR and prescribing system is transactional
  3. Financial AI — analyzing a portfolio is generative; rebalancing it through brokerage APIs is transactional
  4. HR AI — writing a job description is generative; running it through compliance, ATS, and payroll is transactional

In every one of these domains, the “AI will replace humans” narrative collapses at the same architectural seam: the moment you need to modify the state of the real world, you need an integration layer the LLM cannot provide.

The professionals are not safe because AI is dumb. They are safe because the AI is solving the easiest 15 percent of the job, and the other 85 percent still requires the system around the AI.

What this means if you are building in this space

A few practical takeaways from working on this kind of backend:

Pick the integration first, the model second. The hardest engineering problems in this category are not LLM problems. They are the deterministic boring infrastructure problems. Get those right and the LLM choice becomes interchangeable.

Treat the LLM as a renderer, not a brain. Use it for natural-language input parsing and natural-language output formatting. Do not use it for reasoning over state, computing prices, or making decisions that need to be deterministic.

Ground every claim in a real source. If your LLM is generating a number, an address, a phone, a price, or a date — it needs to be retrieved from an authoritative source, not generated. Hallucinated facts will eventually cost you a customer.

Build for the workflow, not the demo. The demo is the easy part. The work is in the seventeen tiny features that turn a generated text into a deliverable inside a real business process.

We are still early in figuring this out. The B2B AI patterns that will win in the next five years are not going to look like ChatGPT. They are going to look like ChatGPT plus a giant pile of integration code — and the integration code is where the moat is.

If you are working on similar problems in B2B travel or any other domain where LLMs need to meet transactional systems, happy to compare notes. You can find me through minddmc.ai or in the comments below.

Parveen Asnora is a Backend Developer at MindDMC, an AI itinerary platform for travel agents, tour operators, and destination management companies. He works on the integration layer between LLMs and travel inventory APIs.

Platform Lockdowns Will Doom Your Business

The Problem We Were Actually Solving

At first glance, it seemed simple: we wanted to add PayPal as a payment option to our e-commerce platform. Our users loved it, and we thought it was a no-brainer. But as we dug deeper, we realized that PayPal’s global availability was a major issue. In some countries, they simply didn’t have a presence, while in others, they were blocked by local regulations. Meanwhile, Stripe and other popular payment gateways couldn’t be enabled due to restrictions on debit/credit card processing.

What We Tried First (And Why It Failed)

The first solution we employed was to use a third-party payment processor like Gumroad or Payhip. We thought it would be a quick fix to bypass the PayPal issue, but it turned out to be a slippery slope. These services were great for small transactions, but as our user base grew, so did the fees – and the complexity of our payment system. We soon found ourselves juggling multiple payment processors, each with their own security and compliance challenges.

The Architecture Decision

One day, while researching a bug report from a customer in Nigeria, it struck me: we were trying to force a square peg into a round hole. Instead of attempting to shoehorn a global payment system into our application, we should focus on building a system that could seamlessly integrate with local payment options. This meant using APIs from regional payment service providers (PSPs) – but it also meant giving up on the convenience of having a single payment gateway.

What The Numbers Said After

When we made the switch, our payment processing costs decreased by 60%. More importantly, our user satisfaction ratings skyrocketed – our customers could now pay with their preferred method, without the hassle of navigating international payment systems. And as a nice side effect, we reduced our exposure to regulatory risks, since we were now working directly with local PSPs.

What I Would Do Differently

Looking back, I’d advise anyone building an e-commerce platform to prioritize platform-agnostic payment processing from the outset. This requires more upfront research and planning, but the payoff is worth it. A flexible payment system is not just a technical requirement – it’s a business necessity in the age of globalization. As security engineers, we often focus on the dark arts of encryption and threat modeling, but sometimes, the simplest solution is to ask: what’s the least painful way to let our users pay us?

AI Is Breaking the Traditional Software Pricing Model

AI Is Breaking the Traditional Software Pricing Model

For decades, software pricing was built around one core assumption:

More time and more developers means higher value.

That made sense when software development was mostly manual effort. Companies estimated projects based on:

  • developer count,
  • hours worked,
  • sprint velocity,
  • and delivery timelines.

But AI is fundamentally changing that model.

Today, a strong engineer using AI can build in weeks what previously required months of effort from an entire team. Boilerplate code, documentation, testing support, UI scaffolding, and even architecture suggestions can now be generated rapidly.

This creates an important question for the software industry:

If software can be built faster, how should companies price their work?

The answer is that software itself is not becoming “cheap.” What is becoming cheaper is repetitive implementation.

Clients were never truly paying for typing speed or raw code generation.

They were paying for:

  • solving business problems,
  • making the right technical decisions,
  • building scalable systems,
  • reducing operational risk,
  • and delivering reliable outcomes.

AI commoditizes code generation.
It does not commoditize judgment, ownership, or execution quality.

This is why the traditional hourly billing model is starting to break down.

Imagine two companies:

  • one takes 6 months to deliver a platform manually,
  • another uses AI-assisted workflows and delivers the same business value in 6 weeks.

Should the faster company earn less because they are more efficient?

That logic no longer works in the AI era.

The software industry is gradually shifting from:

selling labor

to:

selling leverage and outcomes.

This changes how modern software companies need to think about pricing.

The future is likely a hybrid model that combines:

  • strategic consulting,
  • milestone-based implementation,
  • AI infrastructure costs,
  • recurring optimization,
  • and outcome-driven pricing.

The companies that succeed will not necessarily be the ones with the largest engineering teams.

They will be the ones with:

  • better systems,
  • clearer specifications,
  • stronger execution workflows,
  • reusable architecture,
  • and faster delivery cycles.

This is also why specification-first approaches like Spec-Driven Development (SDD) become increasingly important in the AI era.

As AI accelerates implementation, ambiguity becomes more expensive.

Without clear specifications:

  • AI-generated systems become inconsistent,
  • technical debt increases rapidly,
  • and teams lose alignment.

The bottleneck is no longer simply writing code.

The real bottleneck becomes:

  • clarity,
  • coordination,
  • decision making,
  • and execution quality.

In many ways, AI is not reducing the importance of software engineering discipline.

It is increasing it.

The future of software delivery is not just AI-assisted coding.

It is AI-assisted execution built on strong specifications, structured workflows, and reliable engineering systems.

Stop Using Raw Vector Search: Implement GraphRAG with Spring AI and Neo4j

Stop Using Raw Vector Search: Implement GraphRAG with Spring AI and Neo4j

If your enterprise AI pipeline is still relying on basic cosine similarity over flat chunked vectors, you are serving hallucination-prone garbage to your users. In 2026, production-grade RAG demands GraphRAG to bridge the gap between raw semantic search and deep, interconnected relational context.

Shameless plug: javalld.com has full LLD implementations with step-by-step execution traces — free to use while prepping.

Why Most Developers Get This Wrong

  • Siloing data: Treating knowledge graphs and vector databases as separate infrastructure, which introduces massive double-query latency.
  • Blind Cypher generation: Relying on LLMs to write raw Cypher queries without schema constraints, leading to frequent syntax failures in production.
  • Ignoring graph depth: Using vector search to retrieve isolated text chunks while ignoring the rich 2-hop or 3-hop relationships that actually define enterprise data.

The Right Way

Implement a hybrid retrieval pipeline where Neo4j acts as both your vector index and graph database, orchestrated by Spring AI’s fluent APIs.

  • Seed with Vectors: Use Neo4jVectorStore to find the initial “anchor” nodes based on semantic similarity.
  • Structured Cypher Generation: Leverage Spring AI’s ChatClient with structured output specs to dynamically generate deterministic Cypher path queries based on your schema.
  • Contextual Traversal: Query the graph 2-3 hops deep from those anchors to pull highly relevant relational context (e.g., Service -> Depends On -> Database).
  • Hybrid Ranking: Merge vector similarity scores with graph centrality metrics to prioritize the final LLM prompt context.

Show Me The Code

Here is how you build a hybrid GraphRAG retrieval pipeline using Spring AI’s fluent ChatClient and Neo4jVectorStore:

@Service
public class GraphRagService {
    private final Neo4jVectorStore vectorStore;
    private final ChatClient chatClient;

    public List<String> retrieveContext(String query) {
        // 1. Vector search for anchor nodes
        var anchors = vectorStore.similaritySearch(SearchRequest.query(query).withTopK(3));
        var anchorIds = anchors.stream().map(Document::getId).toList();

        // 2. Spring AI ChatClient generates constrained Cypher query
        String cypher = chatClient.prompt()
            .user("Generate Cypher path retrieval for node IDs: " + anchorIds)
            .call().entity(String.class);

        return executeCypher(cypher); // Returns deep relational context
    }
}

Key Takeaways

  • Flat vectors lose relationships; GraphRAG preserves enterprise domain semantics.
  • Spring AI’s ChatClient simplifies Cypher generation when combined with strict schema prompts.
  • Neo4j’s native vector index allows you to perform both vector and graph operations in a single database round-trip.

Is Grep All You Need? Grep vs Vector Retrieval for Agentic Search

What: The “Is Grep All You Need?” study wires both a literal grep tool and a vector-search tool into the same agents and runs 116 LongMemEval questions across them — measuring how each retrieval style holds up as irrelevant context is progressively added to the prompt.

Why: Vector retrieval has been the default for agentic search for years, but it pays for an embedding pass, a vector store, and an ANN index — costs that only buy something if the semantic match is doing real work. If grep is close to as accurate and more robust to noise, a whole layer of infrastructure becomes optional.

vs prior: Earlier RAG benchmarks compared retrieval algorithms on standalone retrieval quality (recall@k against a labelled gold set); this paper measures them inside an agent loop, where tool-calling style and harness design turn out to matter more than the algorithm itself.

Think of it as

Looking up a quote — Ctrl-F in the PDF vs asking a librarian to find books that “feel similar”.

                       THE QUERY
                           │
             ┌─────────────┴─────────────┐
             │                           │
     ┌───────▼────────┐         ┌────────▼───────┐
     │    Ctrl-F      │         │   Librarian    │
     │    (grep)      │         │    (vector)    │
     └───────┬────────┘         └────────┬───────┘
             │                           │
   types literal phrase           embeds query, finds
   scans every line               top-k "feels close"
             │                           │
             ▼                           ▼
        ✓ stable as              ✗ accuracy drops as
          noise grows               noise grows
        (matches are local)      (distance shifts)
  • the document store = the PDF or the library shelf
  • grep tool = Ctrl-F — the model types a literal phrase and gets exact matches
  • vector retrieval tool = the librarian — the model hands over a vector that “feels like” the question, gets the k nearest books
  • irrelevant context (noise) = unrelated chapters added to the PDF, or random books shoved onto the shelf
  • the agent harness = how the model decides which tool to call, when to stop, and what to do with the chunks

Quick glossary

Agentic search — A retrieval pattern where the LLM iteratively calls a search tool instead of being handed retrieved chunks in a single shot. The model decides what to search for, when to search again, and when to stop.

Vector retrieval — Embed every document chunk into a fixed-dimension vector, embed the query the same way, return the top-k nearest chunks by cosine or dot-product similarity. The default for “RAG” since 2023.

Grep — The classic Unix tool — finds literal substrings or regex patterns in text files. Inside an agent harness it’s exposed as a tool the model calls with a string argument.

LongMemEval — A 116-question benchmark designed to stress agentic memory and retrieval — questions reference earlier turns, require multi-hop search, or hinge on small details easily drowned by noise.

ANN — Approximate Nearest Neighbour — the family of indexes (HNSW, IVF, FAISS) that make vector retrieval fast at the cost of recall vs latency trade-offs.

Tool-calling style — How the harness exposes a tool to the model — single shot vs iterative, parallel vs serial, structured-JSON vs free-form. The paper finds this matters more than which retrieval algorithm sits behind the tool.

The news

On May 14, 2026, the “Is Grep All You Need?” paper (arXiv:2605.15184) ran two empirical experiments on agentic search. The first wired both a literal grep tool and a vector-retrieval tool into the same agents across multiple platforms and ran 116 LongMemEval questions through each; across the conditions tested, grep generally yielded higher accuracy than vector retrieval. The second progressively injected irrelevant context to probe robustness. The authors’ headline framing: overall performance is dominated by the agent harness and tool-calling style, not by the retrieval algorithm alone.

Picture the Ctrl-F vs librarian split again. When the user asks “What did the report say about the Paris office in Q3?” the Ctrl-F path is brutally literal — type the string Paris, get every line that contains it, scan the surrounding sentences. The librarian path is semantic — describe the question, the librarian walks the shelves and hands you the three books that “feel close.” When the shelf is clean and the question is fuzzy (“anything about European expansion”), the librarian wins. When the shelf has been padded with unrelated chapters and the question hinges on a literal token, Ctrl-F just works.

The animation above runs both tools against the same 32-chunk document store. At low noise, vector retrieval pulls the right 3 chunks — the embeddings line up. As irrelevant context grows (the noise dial on the left fills up), distractor chunks start clustering near the query in vector space, and the top-k starts mixing in chunks marked pink — the wrong ones. Grep keeps emitting the same 3 literal matches regardless of how much unrelated text was added, because literal substring matching is immune to the kind of distributional drift that nudges nearest neighbours around.

The paper’s more interesting claim sits underneath the headline. When the authors swap the agent harness — different platforms, different tool-call shapes, different stop conditions — accuracy moves more than when they swap retrieval algorithms. A well-designed harness running vector retrieval can beat a poorly-designed harness running grep. The retrieval algorithm is one knob among many, and it’s usually not the dominant one. That’s the line worth highlighting: this is not “embeddings are dead,” it’s “your harness design and tool-loading strategy deserve more attention than your vector DB does.”

Why irrelevant context hurts vector retrieval more

Vector retrieval works by distance in embedding space. Add irrelevant text, and three things happen at once. The query embedding drifts — the model is embedding a longer prompt that now mentions topics the user didn’t ask about. The document distribution shifts — distractor chunks crowd the latent space near the relevant ones. And the top-k cutoff stays fixed at, say, k = 5; if two distractors now sit closer than two relevant chunks, the relevant ones get evicted. The paper’s noise sweep makes this concrete: as noise rises, vector accuracy in the animation drops from roughly 71% to 35% (illustrative) while grep stays flat near 74%. Grep simply doesn’t care how much surrounding text exists; it matches what was typed and returns exactly those spans. The fragility isn’t in embeddings as a technology — it’s in the failure mode where the algorithm assumes a clean shelf and the harness keeps shoving random books onto it.

How the two tools compare inside an agent

Property Grep tool Vector retrieval tool
Index built upfront none (or a trie / inverted index) embedding pass + ANN index
Query cost O(N) linear scan, fast for <100MB embed + nearest-neighbour lookup
Strength literal tokens, code, identifiers, dates, names paraphrase, synonyms, fuzzy topical match
Failure mode misses synonyms / rephrasing top-k crowded out by distractors under noise
Robust to irrelevant context yes — match is local no — distance shifts as embeddings move
Agentic fit cheap to call iteratively, easy to chain with head / tail one call returns a fixed top-k bundle

The grid above is not the paper’s tagline. The tagline is: once you put either tool inside an agent loop, the harness eats the difference. A harness that lets the model call the tool again with a refined query, look at a snippet, and decide whether to keep going outperforms a harness that calls the tool once and dumps top-k into context — regardless of which tool sits behind the call.

What this changes for an agent designer

The practical reading is two-sided. Don’t reach for an embedding-index-and-vector-store the moment a project needs “search” — especially if the corpus is under a few hundred megabytes, the queries are literal-token-heavy (code, logs, identifiers, dates), and the agent will call the tool iteratively rather than once. Do still reach for vector retrieval when the corpus is large enough that a linear scan is slow, the queries are genuinely topical or paraphrased, or the agent has a single shot to retrieve. And independently of either choice, spend the design budget on the harness — on how the agent decides to call the tool, when it backs off, and how it threads results back into context. The paper is telling agent designers where the leverage actually lives.

Related explainers

FAQ

What does “Is Grep All You Need?” actually claim?

The paper runs two empirical experiments. First, it wires both a literal grep tool and a vector-retrieval tool into the same agents across multiple platforms and runs 116 LongMemEval questions through each — grep generally yields higher accuracy than vector retrieval across the conditions tested. Second, it progressively injects irrelevant context and shows that vector retrieval degrades while grep stays roughly flat. The authors’ framing is more nuanced than “grep wins”: overall performance is dominated by the agent harness and tool-calling style, not by the retrieval algorithm itself.

Does this mean vector embeddings are obsolete?

No. Vector retrieval still wins when the corpus is large enough that a linear grep scan is slow, when the queries are genuinely paraphrased or topical, or when the agent gets a single shot at retrieval and can’t iterate. What changes is the default: an agent designer should no longer reach for an embedding-index-and-vector-store the moment a project needs “search.” For literal-token-heavy queries over a small-to-medium corpus inside an iterative agent loop, grep is often the better starting point.

Why does irrelevant context hurt vector retrieval more than grep?

Vector retrieval ranks by distance in embedding space. When irrelevant text is added to the corpus or the query, three things shift at once: the query embedding drifts, distractor chunks crowd the latent space near the relevant ones, and the fixed top-k cutoff can evict relevant chunks in favour of newly-near distractors. Grep matches literal substrings and is immune to any of that — the matches are local to the chunk, not relative to the rest of the shelf.

Originally posted on Learn AI Visually.

The Test Manager’s Guide: From Chaos to Structure — Part 5: Economic Impact — The Cost of Non-Structure

QA professionals in a corporate workspace dealing with fragmented tools, interruptions, and operational friction.

This series examines software quality not as a testing activity, but as a structural capability.

Earlier parts focused on diagnosing chaos, introducing stabilizing constraints, measuring structural health, and building stakeholder alignment.

This final part addresses the question that eventually reaches every leadership discussion:

What does non-structure actually cost?

Predictability as a Financial Asset

Every organization tracks its testing budget.
Few track what they spend on the absence of structure.
That second number is usually larger.

It appears as volatility.

And volatility has a cost.

Volatility is the cost of unpredictability itself — before any visible failure occurs.

From Testing Cost to Volatility Cost

The conversation must shift.

Not from manual to automated.
Not from QA to quality engineering.

From cost of testing
to
cost of unpredictability.

When outcomes are unstable, organizations quietly pay a volatility tax:

  • Extra buffer capacity
  • Additional management oversight
  • Increased work-in-progress
  • Firefighting reserves
  • Missed market windows

None of this appears as “defect cost”.
But it drains capital all the same.

The Three Economic Mechanisms of Non-Structure

Non-structure does not merely increase cost.
It destabilizes economics through three mechanisms.

Mechanism 1 — Friction (Context Switching)

Ambiguity consumes energy.
Unclear ownership forces repetition.
Interruptions fracture flow.

Time is spent clarifying instead of producing.

Post 3 KPI: Unplanned Work Ratio
Economic Translation: Paid labor producing no forward motion
Implication: Throughput is lower than reported capacity suggests.

If 20% of time is unplanned,
capacity is already overstated by 20%.

No failure required. Just friction.

QA professionals in a corporate workspace dealing with fragmented tools, interruptions, and operational friction.Friction rarely appears on budgets. It appears in interrupted attention. (Gemini generated image)

Mechanism 2 — Latency (Decision Delay)

Decisions wait.
Approvals stall.
Feedback cycles stretch.

Work-in-progress accumulates.
Capital sits idle.

Post 3 KPI: Feedback Latency
Economic Translation: Idle capital generating no return
Implication: Forecast buffers expand. Predictability declines.

Every day a decision waits, capital sits motionless.
Motionless capital generates no return.

Latency rarely looks dramatic.
It simply stretches everything quietly.

Software delivery meeting stalled by unresolved approvals and delayed workflow decisions.Every delayed decision keeps work - and capital - waiting. (Gemini generated image)

Mechanism 3 — Multiplication (Late Discovery)

Defects found late do not just cost more.
They multiply coordination.

More teams involved.
More context transfers.
More scheduling overhead.

Post 3 KPI: Escape Rate Trend
Economic Translation: Paying for the same work multiple times
Implication: Variance increases — not just expense.

Cost becomes unstable.

Multiple enterprise teams coordinating around a production defect incident.Late discovery multiplies coordination before it multiplies cost. (Gemini generated image)

Mapping Structure to Economic Stability

Structural KPI Economic Effect
Lower unplanned work Higher effective capacity from same headcount
Shorter latency Less capital trapped in idle work
Fewer escapes Reduced coordination cost and lower variance

These are not quality improvements.
They are volatility reductions.

Move the KPI, and the economic behavior changes.

Estimating Without Illusion

Precision is seductive.
It is also unnecessary.

A practical approach:

  1. Sample one team for two weeks.
  2. Track friction, latency, and rework time.
  3. Apply conservative assumptions:
  • Assume only 50% is recoverable.
  • Assume only 50% of teams experience similar conditions.
  1. Present the result as a range.

Example:

“Our conservative estimate: $200–400k annually in avoidable friction.
Realistic estimate: likely higher.”

Executives trust directional clarity.
They distrust artificial precision.

The Invisible Multipliers

Some costs resist measurement but shape economic reality:

  • Attrition
  • Innovation suppression
  • Reputation erosion
  • Management overhead

These cannot be modeled cleanly.
They still compound.

Naming them builds credibility.

QA and engineering professionals working late in a fatigued enterprise environment.Not every operational cost appears in a spreadsheet. (Gemini generated image)

The Investment Reframe

Structure is not an expense category.
It is a cessation of economic leakage.

The question is not:

Can we afford structure?

The question is:

Can we afford ongoing volatility?

The moment the frame shifts,
the budget conversation changes.

When the Numbers Don’t Move the Organization

Economics do not always trigger action.

Sometimes action follows shock.

When that happens:

  • Protect your team.
  • Preserve your data.
  • Continue structural improvements within your span of control.

Volatility eventually reveals itself.
Preparation determines who absorbs it.

Closing — Elevation Without Drama

Structure is not about testing maturity.
It is about economic stability.

Predictability is not a metric.
It is a financial asset.

The mechanics are visible now.

The question is no longer how.
It is whether volatility is still acceptable.

Stable enterprise QA environment with calm collaboration and predictable delivery workflows.Predictability is not a quality metric. It is an operational asset. (Gemini generated image)

Acknowledgment

If you’ve followed this series through to here,
you’re not optimizing testing.
You’re thinking structurally.

That distinction matters.

Thank you for engaging with the work.

📚 Series Navigator: From Chaos to Structure — Series Overview

1️⃣ Diagnosing Chaos & Defining the Target Model
Understand the invisible disorder. See what’s broken before you fix it.

2️⃣ MVP Test Strategy: First 30 Days
Small, immediate actions to start taming chaos — without waiting for perfect conditions.

3️⃣ Transition KPIs: Measuring Structural Health
How to know if the new test structure is actually working — before a major defect appears.

4️⃣ Stakeholder Alignment & Feasibility
Building buy-in and negotiating constraints with the team and leadership.

5️⃣ Economic Impact: Cost of Non-Structure
Translate structured testing into predictable outcomes and business value.

✨ If you see these patterns in your projects, share your experience below — or connect with me to discuss ways to bring structure and predictability to software quality.

© 2026 Abdul Osman. All rights reserved. You are welcome to share the link to this article on social media or other platforms. However, reproducing the full text or republishing it elsewhere without permission is prohibited

PCB Shortage Warning: Iran-Saudi Conflict Drives 40% Price Increase — What Hardware Engineers Need to Know

Gulf Conflict Triggers New PCB Supply Chain Crisis

A convergence of geopolitical disruption and commodity price surges is creating the PCB industry’s most severe supply constraint since the COVID-19 pandemic. Reuters reported on April 27 that raids on Saudi petrochemical plants during the Iran-Saudi conflict are directly threatening PCB production in China, with board prices surging 40% in April alone.

Hackaday’s coverage on May 6 highlighted the cascading impact: Saudi Arabia’s collocated petrochemical refineries produce the polymer resin critical for PCB laminate manufacturing. When these facilities face supply disruptions, the impact propagates directly to copper-clad laminate (CCL) producers thousands of miles away in China.

The Numbers Are Stark

Material Price Change (YTD 2026) Lead Time
Copper foil (ED) +30% 8–12 weeks
Epoxy resin (DGEBA) +35–45% 12–15 weeks
Glass fiber fabric +20–25% 10–14 weeks
Copper (LME) $13,300+/tonne N/A
Standard 4-layer PCB (China) +40% since Jan +2–3 weeks

Why This Shortage Is Different

Unlike the COVID-era chip shortage which was demand-driven, the current PCB shortage is supply-driven and affects the most fundamental materials in the manufacturing chain:

  • Petrochemical resin: Base polymer for FR-4 originates substantially from Gulf operations. SABIC (Saudi Aramco subsidiary) is a major supplier.
  • Copper: Elevated from AI data center demand, reached $13,500/tonne in January 2026 and remains above $13,000.
  • Glass fiber: Tightening from quotas and energy-intensive manufacturing costs.

What Hardware Engineers Should Do Now

  1. Order early: Add 3–4 weeks to standard lead time estimates.
  2. Lock material pricing: For production runs >1000 boards, negotiate fixed-price contracts.
  3. Accept wider tolerances: Some fabricators are substituting equivalent-spec laminates.
  4. Consider design changes: Reducing layer count by 2 layers through denser routing reduces material exposure.
  5. Dual-source: Qualify a second fabricator in a different region.

Industry Projections

The global PCB industry is projected to grow 12.5% to reach $95.8 billion in 2026 (Prismark), but growth is increasingly constrained by materials rather than demand. Price normalization not expected before Q1 2027.

Historical Perspective

As Hackaday notes, this isn’t the electronics industry’s first supply crisis. The 1990s IC encapsulation resin shortage (also driven by Asian petrochemical disruption) eventually resolved as global industry adapted. But in the short term, the impact is real.

Sources: Reuters (April 2026); Hackaday (May 2026); The Silicon Review; HilElectronic

🔗 Full article: AtlasPCB News

🔗 Need reliable PCB supply during the shortage? Get a quote from AtlasPCB

AI-Powered EDA Tools See 20th Consecutive Quarter of Growth: $4.2B Market in Q1 2026

EDA Market Hits $4.2 Billion as AI Integration Accelerates

The electronic design automation (EDA) market for PCB design reached $4.2 billion in Q1 2026 revenue, marking 20 consecutive quarters of growth. The growth is driven predominantly by AI integration: machine learning-powered features now command premium pricing across all major EDA platforms.

The landscape is splitting between established players adding AI features to traditional tools and AI-native startups building entirely new design paradigms from the ground up.

AI-Native Platforms Lead Innovation

Quilter: Fully Autonomous PCB Layout

Quilter continues to push the boundaries of autonomous design, claiming 10× faster time-to-layout compared to manual routing for qualifying designs. Following their Project Speedrun success where an AI-designed computer booted successfully, the company is expanding into more complex multi-board systems.

Key capabilities:

  • Physics-driven routing that simultaneously optimizes impedance, crosstalk, and thermal performance
  • Automated DFM compliance checking against specific fabricator capabilities
  • Direct manufacturing output without traditional Gerber translation

Flux.ai: Collaborative AI-Assisted Design

Flux.ai focuses on collaborative, browser-based PCB design with AI assistance:

  • AI-powered component suggestion based on design intent
  • Automated constraint propagation from schematic to layout
  • Real-time DRC with ML-trained rule sets

Siemens Fuse: AI Agent Orchestration

Siemens recently launched Fuse, an AI agent that orchestrates workflows across their entire EDA suite (Xpedition, Calibre, HyperLynx). Rather than replacing the engineer, Fuse acts as an intelligent assistant that automates routine tasks while flagging decisions requiring human judgment.

Traditional Leaders Add ML Features

Cadence Allegro

Cadence’s 2026 updates include:

  • ML-based via placement optimization for signal integrity
  • Automated power delivery network (PDN) analysis with AI-recommended decoupling
  • Predictive DFM scoring that estimates fabrication yield before design completion

Altium Designer

Altium’s AI integration focuses on accessibility for smaller engineering teams:

  • AI-assisted component selection from parametric specifications
  • Intelligent autorouter trained on millions of production-verified designs
  • Natural-language design rule entry

KiCad + Open-Source AI

The open-source community is also advancing AI capabilities:

  • KiCad’s plugin ecosystem now includes ML-based placement optimization
  • Community-trained models for component footprint recognition
  • Open-source routing algorithms approaching commercial autorouter quality

What This Means for PCB Manufacturing

The rise of AI-designed boards creates both opportunities and challenges for fabricators:

Opportunities:

  • AI tools optimize for manufacturability from the start, potentially reducing DFM iteration cycles
  • Standardized output formats reduce translation errors
  • Better designs mean fewer fabrication defects and higher first-pass yield

Challenges:

  • AI tools may generate designs that push fabrication limits more aggressively
  • Reduced human oversight means potential blind spots in unusual geometries
  • Fabricators must update DFM databases more frequently as AI tools evolve

Industry Perspective

As EDN’s coverage of DATE 2026 noted, the research community is developing methods for AI-enabled, verification-aware design that addresses trust and reliability concerns. The convergence of AI capabilities with formal verification is expected to accelerate adoption in safety-critical applications (automotive, medical, aerospace) that have been cautious about AI-generated designs.

Sources: Quilter AI, EDN, Flux.ai, Promwad

🔗 Read the full article with additional detail: AtlasPCB Blog

🔗 Need AI-ready PCB manufacturing? Get a quote from AtlasPCB

How AI is Changing the Way Startups Are Built in 2026

Building a startup in 2026 looks nothing like it did five years ago. AI is no longer a feature you bolt onto a product. It is the foundation everything is built on.

Here is what is actually shifting right now.

1. The Money Is Flowing Like Never Before

The numbers are staggering.

Global startup funding hit $297 billion in Q1 2026 alone, breaking all records — a massive 2.5x increase over the previous quarter.

And AI is eating the lion’s share.

AI companies captured 89% of total capital deployed in February 2026, pulling in $55.37 billion across just 189 deals.

2. Founders Are Shipping Faster Than Ever

AI is compressing timelines in ways that change what is possible for small teams. 78% of founders report that AI tools have already reduced their operational costs, and AI-related job postings at startups have risen 89% year-over-year. Lean teams can now compete with well-funded ones earlier than before.

A solo founder today can build, test, and iterate on a product faster than a ten-person team could in 2021. The MVP game has completely changed.

3. The Build Stack Has Changed

The typical early-stage startup stack in 2026 now looks like this:

  • An AI code assistant for development (Cursor, Copilot, Devin)
  • An AI agent for customer support and operations
  • An AI marketing tool for content and outreach automation
  • A no-code or low-code layer for non-technical co-founders

New companies are adopting agent-based systems for their internal operations to improve efficiency and productivity. As orchestration frameworks become more advanced, intelligent agents work together across CRM systems, analytics dashboards, and cloud services.

4. The Hottest Categories Right Now

The hottest AI startups of 2026 are building autonomous agents and vertical AI platforms, with OpenAI, xAI, Anthropic, and Databricks dominating, while fastest-growing startups like Anysphere, Cognition AI, and Harvey are scaling from zero to unicorn status.

Here is where momentum is concentrating:

  • Agentic AI: Moving beyond chatbots to action-taking systems, at a 41% CAGR, commanding 40%+ of enterprise budgets.

  • Vertical AI: “Even vertical AI providers have to be deeply embedded into industry workflows to differentiate themselves from a foundation model doing more of the repetitive work.”

  • Fintech: One of the startup sectors that experienced a particularly healthy bounce, with funding jumping 27% year-over-year to $51.8 billion.

  • Physical AI: AI that powers robots, vehicles, and autonomous machines raised a record $78 billion in 2025.

5. The Reality Check

AI startup trends in May 2026 point to a market that is getting richer, harsher, and far less forgiving at the same time. Money is still flowing, founders are still launching, and big labs are still setting the pace — but the easy hype phase looks over.

By 2026, the strongest AI startups are not just building models, they are owning distribution, embedding into workflows, and turning narrow technical advantages into durable businesses.

The Bottom Line

“Build where people already feel pain. Build where trust matters. Build where domain depth beats generic intelligence.” — MEAN

AI has not made building a startup easier in the sense that hard decisions have disappeared. It has made the execution layer faster and more accessible. The founders who win in 2026 will be the ones who think clearly about the problem — not just the ones who code the fastest.

What sector are you building in? Drop it in the comments.

DevWorld 2026: My first time in Amsterdam, and what two days of real engineering conversations taught me

About two weeks ago, I landed in Amsterdam for the first time. Not just to visit, though the city deserved every extra day I gave it, but to attend DevWorld Conference 2026. Two full days of talks, hallway conversations, and the kind of energy you only get when you put a few hundred developers who genuinely care about their craft in the same space.

This is my honest recap.

First impressions

I had followed DevWorld online for a while. Watching talks on YouTube, seeing posts from attendees, always telling myself “next year.” This time I actually went.

The first thing I noticed was the atmosphere. It wasn’t overwhelming or corporate. It felt like a place where people came to actually talk about engineering.

The one thing that became clear across two days

AI is no longer experimental. It’s becoming foundational to how software gets built.

That thread ran through almost every session, whether the speaker addressed it directly or not. Engineers on stage were showing working systems, real architectural decisions, actual failure modes, not slides about what AI might do someday.

The sessions worth talking about

Two days, a lot of talks. Here’s what stayed with me.

On the security side, the clearest message was that “find and fix later” doesn’t scale when code is being generated at machine speed. AI-accelerated development needs security built in from the start, not the same old model applied faster. That same theme extended to authorization, one talk made the case that fragmented auth logic spread across services, gateways, and AI agents doesn’t just create security gaps, it creates cascading failures that look like unexplainable bugs. That reframe stuck with me.

On architecture and tooling, there were good sessions on avoiding rewrites, fighting framework lock-in, and managing long-lived codebases without burning everything down. One talk asked the questions most people are still avoiding: how do you debug non-deterministic code? What is the developer’s actual role when part of the system is AI-generated?

The frontend track was honest in a way I appreciated. One session traced the full history of signals from KnockoutJS to SolidJS to the TC39 proposal, as someone who works with Angular signals daily, the historical context of why this primitive keeps being reinvented was genuinely clarifying. Another looked at what AI-written frontends actually look like after six months: flawless boilerplate, solid tests, and a shaky architecture nobody fully understands. The conclusion wasn’t “AI is bad.” It was that humans need to guard architecture, state management, and design system coherence while AI handles the repetitive parts. A practical and honest division of labor.

There were also sessions on multi-agent patterns (a live D&D campaign built on stage with coordinated agents, chaotic in the best way), documentation as a living product, zero-trust security from browser policies down to distroless containers, and deep dives into loading performance and HTTP client internals.

But honestly, it was the people

The sessions were great. But what I’ll carry with me longest is the conversations that happened outside of them.

There’s something special about meeting developers who genuinely love what they do. The kind of people you can talk architecture, performance, protocols, or frontend reactivity with for minutes straight in a hallway without either of you checking your phone. In a time where AI tools are everywhere and vibe coding is becoming normal, that kind of conversation is worth traveling for.

I met people building interesting things. I saw startups solving real problems. I exchanged ideas with engineers from very different backgrounds, and came away with a clearer sense of where things are heading.

What I’m bringing home

Three things cut across everything I heard and discussed.

AI has moved from feature to infrastructure. The best builders are treating it that way, not as a shortcut, but as something that changes architecture decisions, security models, and what it means to write software professionally.

Final thought

My first DevWorld. Not my last.

If you’re debating whether to go to a conference when everything is available online, go. The content you can get later. The conversations you can’t.

Thank you Amsterdam 💖. Already thinking about next year.