MFranklin LLC
March 2026

Building Automated Website Agents

Cloudflare Workers Automation Monitoring DevOps

The Problem

Websites break quietly. A page goes down, an image link rots, a copyright year falls behind, or SEO scores tank without anyone noticing. For most site owners, the first sign of trouble is when a potential client lands on a broken page and moves on.

I needed a solution that could watch a production website the way a dedicated operations team would — continuously, automatically, and without a monthly subscription fee. Something I own, running on infrastructure I control, reporting directly to the site owner's inbox.

Goal: Build a set of lightweight automated agents that continuously monitor site health across multiple dimensions — all running at zero cost on edge infrastructure.

The Approach

Rather than building one monolithic monitoring script, I designed four independent agents. Each one focuses on a specific concern, runs on its own schedule, and sends its own reports. If one agent encounters an issue, the others keep working. This separation of concerns makes the system resilient and easy to maintain.

Agent What It Monitors
Security Uptime, security posture, SSL health, API availability, response performance
SEO Search engine optimization compliance, metadata quality, link integrity
Content Content freshness, asset health, dependency tracking
Leads User engagement, signup activity, automated follow-up sequences

All four agents are serverless functions deployed to Cloudflare's edge network. They deploy automatically with every code push and require no server maintenance.

The Results

Once deployed, the agents immediately started earning their keep. Within the first week of operation, they surfaced issues that would have gone unnoticed for weeks or months under manual monitoring:

  • Platform-specific runtime bugs caught and resolved before they affected reporting accuracy
  • Infrastructure constraints identified and engineered around, improving reliability across all agents
  • Content drift — outdated references and stale assets flagged automatically
  • SEO regressions caught within hours of being introduced, not weeks later via search console
  • Lead engagement fully automated with timed follow-up sequences requiring zero manual intervention

Every agent sends detailed reports directly to the site owner. Critical issues trigger immediate alerts. Routine findings are bundled into periodic digests. All results are stored with rolling historical data for trend analysis.

Key Outcome: Issues that previously took days or weeks to discover are now surfaced within minutes. The entire system runs at zero monthly cost on free-tier infrastructure.

Lessons Learned

Building on edge infrastructure comes with its own set of challenges. Serverless platforms have runtime behaviors, resource limits, and security models that differ from traditional hosting. Designing around those constraints from the start — rather than discovering them in production — is critical.

The biggest takeaway: always test in the actual runtime environment, not just locally. Some bugs only surface under the specific conditions of the deployment platform, and no amount of local testing will catch them.

  • Design for platform constraints first. Understand the limits of your runtime before writing a single line of business logic.
  • Separate concerns aggressively. Independent agents mean independent failures — one broken monitor doesn't take down the whole system.
  • Automate the reporting, not just the monitoring. Data that sits in a database unread is the same as data that doesn't exist.

What's Next

The agent system is live and running. Future improvements include a real-time status dashboard and expanded monitoring coverage. The architecture is designed to scale — adding a new agent is as simple as dropping a new function into the project and configuring its schedule.

Bottom Line: Four agents, zero monthly cost, full visibility into site health. The system deploys with every push and runs autonomously on the edge. If something breaks at 3 AM, the site owner knows about it by 3:01 AM.

Interested in the Details?

I intentionally kept the technical implementation details out of this writeup. If you're interested in how the agents are built, the architecture decisions behind them, or how something like this could work for your own site or business, I'd be happy to walk through it.

Copied to clipboard!