Key facts

  • 444 journalism students rated ChatGPT-written news articles as higher quality than journalist-written ones, a peer-reviewed Nature study found.
  • ChatGPT summaries scored a BERTScore F1 above 0.87 for similarity to professional human writing, research shows.
  • When asked to name Ghanaian data science experts, ChatGPT produced names that didn't exist when checked.
  • ChatGPT won't admit ignorance — it simply makes up an answer, journalism researchers documented.
  • Some experts predict 90% of online content could be machine-generated by 2026, Oxford's Reuters Institute reports.
  • LSE's Professor Charlie Beckett says AI is about augmentation, not total automation of content production from start to finish.
  • No research source directly tests whether ChatGPT can build, host, or maintain a complete website — only write its words.

WANT RESULTS LIKE THIS?

Imagine a system doing all of this for your local business — every day, without you.

We build local businesses a custom website with a team of AI behind it: every lead captured and followed up, new content published monthly,customers finding you on Google — live in 7 days.

  • 85+ pages at launch
  • Every lead followed up, automatically
  • Your whole business on one screen

The DIY Temptation: Why Business Owners Ask If ChatGPT Can Build Their Website

It's 9 p.m., you've just finished invoicing a customer, and the thought hits you: you still don't have a proper website. A friend mentions ChatGPT can write anything — maybe it can build the site too. Free, fast, no developers. The temptation is real.

And to be fair, ChatGPT is genuinely impressive at writing. A peer-reviewed study of 444 journalism students found they generally rated ChatGPT-generated news articles as higher quality than journalist-written ones, scoring it well on readability, informativeness, and style. Another study measured ChatGPT summaries at a BERTScore F1 above 0.87 for similarity to human-written text — roughly professional-journalist quality. So yes, ChatGPT can write the words for your website.

But a website isn't just words. It's a system: pages, hosting, design, schema markup, internal linking, lead capture, follow-up, and ongoing maintenance. None of the research on ChatGPT's capabilities actually tests whether it can handle any of that. What the research does show should give a business owner pause:

  • ChatGPT has cited references that don't exist and invented expert names that checked out as fabricated.
  • It won't say "I don't know" — it will simply make up an answer rather than admit uncertainty.
  • It struggles with exact calculations and current, real-time information.

On a website, those weaknesses have real consequences. A fabricated price, a wrong service description, or an invented credential on a live business page can cost you customers and credibility. That's why every expert in the research — from Oxford's Reuters Institute to the International Center for Journalists — lands on the same conclusion: AI works as an augmentation tool with a human by its side, not as an end-to-end solution. As one AI editor at the Financial Times put it, ChatGPT is fundamentally a "predictive technology" — powerful, but not original, and lacking analytic capability.

Here's the harder question underneath: even if ChatGPT writes your pages, who builds the car? Someone still has to host it, connect it to your forms and phone and CRM, keep it running, and verify every claim before it goes live. That's a technical project, not a Tuesday — and for a busy owner, free is only free if your time is.

The trend line matters too. Some experts predict that by 2026, 90% of online content could be machine-generated. If everyone can generate content, the advantage shifts to whoever verifies it, structures it for search, and actually turns visitors into leads. That's the difference between a chatbot's raw output and a managed system — and it's why at AI Business Sites we treat generation as just one step in a pipeline that includes research, fact-checking, and human oversight, rather than the whole job.

So the honest answer to "can ChatGPT build my website?" is: it can help write it, but it can't run it — and running it is the part that wins customers.

What ChatGPT Can Do: Write Impressive Content From Almost Nothing

Here's the uncomfortable truth for anyone who has spent years writing for a living: when ChatGPT writes, the results can be genuinely good. Not "good for a machine" — measurably competitive with professional work.

The most striking evidence comes from a peer-reviewed study published in Nature's Humanities and Social Sciences Communications. Researchers gave ChatGPT simple six-keyword prompts and had it produce complete news articles. Then 444 journalism students in Portugal and Spain compared those articles against journalist-written pieces — and generally rated the ChatGPT versions as higher quality, particularly on readability, informativeness, and style.

A separate analysis reinforces the finding. Researchers measuring how closely ChatGPT-generated summaries matched professionally written ones recorded a BERTScore F1 above 0.87 — a semantic similarity score that puts its output in the same neighborhood as trained journalists' work. The same study concluded ChatGPT can produce content that is "contextually accurate and aligned with content moderation standards."

So what does this mean for your website? It means the words are solved. ChatGPT can draft, from almost nothing:

  • Homepage copy that explains what you do and why it matters
  • Service and location pages targeted at what customers actually search for
  • FAQs that answer objections before they become lost leads
  • Blog posts that keep your site fresh for search engines

This is why content is not the bottleneck in building a business website. A service like AI Business Sites can put dozens of keyword-targeted pages live quickly precisely because drafting at that scale is now trivial for AI — the generation itself is the easy part.

The honest caveat: quality text isn't the same as a quality website. The study measured how readers perceived the writing, not whether ChatGPT could structure a site, connect it to booking and payments, or keep it maintained. Experts at Oxford's Reuters Institute consistently note that AI works best as augmentation — a tool that needs a system and a human around it, not a replacement for one.

In short: if you've been putting off a website because writing everything felt impossible, that excuse is gone. The words were never really the hard part — and now they're the easiest part.

What ChatGPT Can't Do: The Fabrication Problem and the Missing Human Check

ChatGPT writes fluent copy, but fluency is exactly what makes its failures dangerous. The model doesn't know when it's wrong — and as journalists testing the tool discovered, it "will not answer a question by saying it does not know the answer; instead... it will simply make one up."

The documented incidents are sobering. Francesco Marconi, former WSJ R&D chief, reported that ChatGPT has pointed readers to references that don't exist. When one newsroom asked it to name real Ghanaian data science experts, none of the names it produced actually existed when checked. The model predicts plausible-sounding answers rather than retrieving verified facts.

On a live business website, that behaviour stops being a curiosity and starts costing money. A fabricated price, an invented service claim, a wrong phone number — each one erodes trust the moment a customer notices. And the DIY website path has no built-in check: nobody is standing between the chatbot's output and your homepage.

The expert consensus is unambiguous. Professor Charlie Beckett, head of JournalismAI at LSE, puts it plainly: "AI is not about the total automation of content production from start to finish: it is about augmentation" — giving professionals tools to work faster, not replacing their judgment. Jenna Burrell, director of research at Data & Society, recommends using ChatGPT only "with a human by its side," double-checking every output for accuracy and sources.

What that verification layer actually covers:

  • Every factual claim — prices, service areas, credentials — checked against reality before it publishes
  • Every cited statistic or reference confirmed to exist, not just sound plausible
  • Every customer-facing detail — phone numbers, addresses, hours — validated against the actual business

There's proof this works in practice. The Newsroom app publishes AI-generated summaries that are manually reviewed by humans, and its founders credit that manual review for the absence of hallucinations in their output. The pattern holds everywhere AI meets the public: generation is cheap; verification is the work.

This is why a managed approach like AI Business Sites separates the engine from the output — human review sits between what the model produces and what goes live on a client's site. The DIY path asks a busy business owner to become that reviewer, every time, forever. The model never admits ignorance; someone has to catch it.

Local business: doing this the old way?

One system replaces the whole pile.

Website designer$1,500 – $10,000
SEO agency$500 – $2,000/mo
Answering service$200 – $800/mo
Marketing tools & CRM$200 – $800/mo
Your eveningsGone

All of it — the website, the follow-up, the content, the leads — built and run for you for $1,497 + $497/mo. Month-to-month, and you own everything.

See what your build includes

What 'Building a Website' Actually Involves Beyond the Chat Window

Say you get ChatGPT to produce a beautiful homepage draft in twenty minutes. Congratulations — you now own a text file. A website that actually works for a business is a running system, and the chat window stops at the edge of the text.

The research on ChatGPT's capabilities points to exactly this gap. A peer-reviewed study found it can generate complete, coherent long-form content from a six-keyword prompt — students even rated its articles above journalist-written ones. But no source in the research addresses design, hosting, or functionality, because that's not what a language model does.

What's waiting for you beyond the chat window:

  • Hosting and maintenance — the code has to live somewhere, stay patched, and load fast on mobile.
  • Design, schema markup, and internal linking — the structural work Google rewards, not just pretty words.
  • Google Search Console, sitemaps, and a Business Profile, all verified and connected.
  • Lead capture and follow-up — forms, instant responses, and a place for every contact to land.
  • Fresh content every month, because a site that stops publishing stops ranking.

There's also a verification problem. ChatGPT has fabricated names and references rather than admitting ignorance, and experts consistently recommend using it only "with a human by its side." On a business website, an invented price or a wrong service area isn't a typo — it's a lost customer.

This is why every expert source lands on the same conclusion: AI is augmentation, not end-to-end production. As one LSE researcher put it, "AI is not about the total automation of content production from start to finish." Someone still has to assemble, check, connect, and maintain the machine.

The honest framing is this: the AI engines are free, but free is only free if your time is. You can absolutely build it all yourself — host it, wire up the CRM, chase the schema markup, write fourteen posts a month. That's a technical project, not a Tuesday. This is the gap AI Business Sites exists to fill: we build the car, connect it to your business, and keep it running, so the AI answers customers instead of just answering prompts.

The Smarter Path: AI Power With a Managed System Behind It

So which path do you actually take — raw ChatGPT on one side, a months-long technical project on the other? Neither, it turns out. The middle path is AI power wrapped in a managed system, where the technology does the heavy lifting and humans handle the judgment.

The research explains why this matters. Experts consistently describe ChatGPT as a powerful predictive tool that will fabricate rather than admit ignorance — it has cited nonexistent references and invented expert names that didn't exist when checked, according to journalism researchers. A Financial Times AI editor calls it "a very powerful sort of predictive technology" without analytic capability. On a live business website, that gap between plausible and true has real consequences.

This is why a single chatbot guessing isn't the same as a production pipeline. At AI Business Sites, content runs through 12 specialized agents — one researches, one finds statistics, one writes, and others verify claims and check citations before anything publishes. Every customer-facing output passes human governance. The research backs this structure: Professor Charlie Beckett of LSE concludes AI is about augmentation, not total automation, and real-world deployments that avoid hallucinations credit mandatory human review.

The done-for-you model looks like this:

  • A custom website with 85+ pages live within 7 days — 25-30 hand-built core pages plus 60 SEO pages
  • 14+ new content pieces every month, each grounded in web research and verified before publishing
  • Hosting, maintenance, lead capture, CRM, and follow-up handled for you
  • One monthly price with no tiers, no per-seat fees, no feature gates
  • Full ownership — you keep the code, content, data, and domain, with no long-term contract

The timing fits the market. Some experts predict that by 2026, 90% of online content could be machine-generated — which means generation itself stops being the differentiator. Verification and management become the edge.

And notably, the technology works. A peer-reviewed study of 444 journalism students found readers often rated AI-written articles as higher quality than human-written ones. The writing isn't the problem. The system around the writing is.

If you want to talk through what your business actually needs — no pitch, no obligation — book a free 30-minute strategy call and we'll figure it out together.

The Verdict: Great Words, But Someone Still Has to Build the Car

So, can ChatGPT create a website? It can write one — and impressively. Peer-reviewed research shows readers often rate its output above professional work. What it can't do is verify its own claims, admit when it doesn't know, host the site, connect your forms and CRM, or keep everything running month after month. That's the gap between a text file and a business asset, and it's exactly where DIY projects stall. The real question isn't whether AI can generate your content — with experts predicting 90% of online content could be machine-generated by 2026, generation is becoming table stakes. The advantage belongs to whoever verifies, structures, and manages it. If you want that system without becoming its engineer, that's what AI Business Sites does: 85+ pages live in 7 days, verified content every month, and everything managed for you. Or start simpler — book a free 30-minute strategy call and talk through what your business actually needs. No pitch, no obligation.

FOR local businesss — BUILT AND RUN BY US

Your website. Your content. Your leads. Your data.

$500 starts your build. Seven days later it's live — chat, booking, follow-up, and your Google presence all set up. Then we run it, every month. You do the work you actually get paid for.