Skip to content
AI Superpower
← AI in practice / October–November 2026

Field tests

We checked GitHub, Railway and Supabase in one publishing workflow

An observed, read-only MCP field report: what three connected tools returned, how the results agreed, and what the checks cannot prove.

AI Superpower · Published · 4 min read

GitHub: read current source; Railway: match deployed revision; Supabase: read publishing state; Public page: verify separately
Original workflow diagram. Examples are illustrative, not product screenshots.
In this guide
  1. The useful starting point
  2. What we checked and what came back
  3. Why the comparison matters
  4. Repeat the test on your own work
  5. A field log you can copy
  6. Interpret a failure carefully
  7. Sources and further reading

The useful starting point

Three read-only checks returned usable evidence: GitHub exposed the current content source, Railway reported a successful deployment for the same commit, and Supabase returned the published Agency article. That establishes useful retrieval in this session, not universal reliability or write safety.

The useful question about a connection is whether it helps finish a real task. During our October 20, 2026 publishing review, we used the connected GitHub, Railway and Supabase tools to answer three bounded questions about our own sites.

Method: one ChatGPT Work session, existing authenticated connections, read-only requests, and live project records. We did not time installation, compare hosts, measure latency or test every capability. These observations describe this run, not a benchmark ranking.

What we checked and what came back

ConnectionRequestObserved resultLimit
GitHubRead the AI Teachers main-branch reference and editorial posts file.The branch returned a commit and the file contained the published Upwork and Shopify guide records.Reading source does not show what a visitor receives.
RailwayRead the AI Teachers service's latest deployment record.The deployment was SUCCESS and its commit matched the GitHub main-branch commit. Its UTC creation time was October 20 at 23:57.A successful deploy does not establish every page, checkout or form works.
SupabaseRead the Agency CMS record for the business-tool article.The expected title and slug were returned with site=agency and status=published.A published row does not prove the route is uncached, public or indexed.

The exact repository hashes, project identifiers and database row IDs remain in the private publication records. They are useful for internal reconciliation but unnecessary for readers to repeat the method on their own projects. No credentials or customer data are included here.

Why the comparison matters

Two systems can disagree without either being broken. A repository can contain a new article while hosting still serves the previous commit. A CMS row can be published while a page cache still contains an older result. The GitHub-to-Railway commit match removed one specific uncertainty in our check. The separate CMS read confirmed the Agency article's publishing state.

The outcome was a usable evidence trail for the publishing task. We make no time-saving claim because we did not measure a comparable manual process. We also did not test account setup, write permissions, rollback, transaction safety or behavior under load.

Repeat the test on your own work

  1. Choose one question with an independently checkable answer, such as “Which source revision is deployed?”
  2. Record the host, account scope, connection and requested operation. Start with a read.
  3. Save the relevant result fields, with secrets and personal information removed.
  4. Compare the result with a second authoritative record where possible.
  5. Open the public output separately and verify the expected title, URL and content.
  6. Write the limitation beside the result. Do not turn an untested capability into a pass.

A field log you can copy

QuestionWhat do I need to decide?
Inputs and scopeWhich account, project, host and allowed operation?
Expected evidenceWhich value or document can establish the answer?
Observed resultWhat did the tool actually return, and when?
Independent checkWhat agrees, disagrees or remains unknown?
DecisionUse, retry after diagnosis, or stop?

Interpret a failure carefully

An unavailable subscription, missing permission, expired authorization or unsupported action can block a task without proving the service is down. Preserve the error category and check the prerequisite before repeating requests. If a write's outcome is uncertain, inspect current state before retrying.

Use our AI tool test bench to extend this into a repeated evaluation, or start a tool trial for one job you do every week. The practical MCP guide helps choose the job; this report shows how to keep the result honest.

Sources and further reading

Sources checked October 16, 2026. Tool features and plan availability can change; review the linked publisher documentation before connecting an account.