Why We Built Our Own Market Intelligence System

Most SEO agencies subscribe to the same two or three third-party database tools. They generate reports from global data, apply a standard keyword playbook, and advise clients based on information that was collected somewhere, at some point, for some market that may or may not resemble Durban.

We took a different approach.

What we built and why

The TVS Market Intelligence system is a purpose-built data collection platform that runs continuously on a dedicated server. Every day, it queries Google for the specific search terms that matter to our clients — “bathroom renovations Umhlanga”, “Crestron installer Durban North”, “solar installation Ballito” — and records exactly who is ranking, where, and how their position changes over time.

It is not scraping Google blindly. The system queries the SerpAPI infrastructure, which returns structured data including organic rankings, local pack positions, review counts, star ratings, and phone numbers. That data is stored, deduplicated, and analysed.

On top of the ranking data, we run two enrichment pipelines.

The first fetches each competitor’s homepage and sitemap, analyses their technical SEO signals — schema markup, page structure, heading hierarchy, HTTPS configuration, sitemap quality, and mobile performance via the PageSpeed API — and produces a scored technical profile for every domain we track.

The second uses Claude AI to read each competitor’s blog content, assess their publishing frequency, content depth, and whether they are writing about the specific locations and services that matter in this market, then summarises what their content strategy actually looks like versus what it appears to be.

Every competitor we track has a profile. Every profile is scored against the same framework — our True View Score — which weights review authority, content relevance, and technical quality into a single comparable number.

Why programming knowledge changes what is possible

A tool that a non-technical person can subscribe to is, by definition, a tool that every non-technical person can also subscribe to. The insight it provides is available to anyone who pays the monthly fee. That is not a competitive advantage. It is a commodity.

Building our own system means we can measure exactly what we decide to measure. We track the eighteen industries our South African clients operate in. We monitor the specific suburbs and coastal towns where their customers actually search. We write the logic that decides how content depth is scored, how technical signals are weighted, how the competitive picture is assembled.

When a client asks us whether their market is content-competitive — whether the businesses ranking above them are publishing real content or just holding positions through historical domain authority — we do not estimate. We know. The data is on our server, updated this morning.

That precision is only possible if the person making the strategic decisions is also capable of building the system that generates the data. Most SEO agencies are not in that position.

What the data enables

Before we recommend a content strategy to a client, we look at what their competitors are actually producing. Before we prioritise a technical fix, we know how their technical score compares to the field average. Before we assess how hard it will be to rank for a query, we have the ranking history — not estimated difficulty from a generic keyword tool, but the actual businesses sitting at the top of the results and what we know about each of them.

This is why DG Technologies reached national number one for their primary Crestron search terms in under six weeks. Not because we guessed that the niche had low content competition. Because we measured it, saw the gap, and filled it with the right content before any competitor could respond.

The system exists because we believe that the quality of an answer depends on the quality of the question you are able to ask. Generic tools give generic answers. A system built for this specific market, measuring the signals that matter here, gives answers that are precise enough to act on.

---

The full set of systems TVS built — including the market intelligence infrastructure — is documented at The Systems We Built So We Could Do This Properly. Why the current search environment makes this infrastructure necessary is at Why the Window for Fixing This Is Closing. Contact us if you want to understand what your competitive position in local search actually looks like — not estimated, measured.