For school and district web teams
GuardianFeedBot
How to recognize it
Every request carries this user agent:
GuardianFeedBot/1.0 (+https://www.guardiansystems.co/bot)
What it does and does not do
- It reads feeds a school or district publishes: RSS and Atom news feeds and iCalendar (.ics) calendars. To find them, it reads robots.txt and then the school's home page, looking for feed links and subscribe buttons. Where robots.txt allows, it also tries the standard feed address of common school website platforms (for example
/feed/). - For an item without an image in the feed, it may read that item's own page once to find its preview image, only on the school's own domain. When an item drops out of a feed, it checks the item's link with a lightweight request 1, 7 and 30 days later to learn whether it was taken down.
- It follows robots.txt (RFC 9309) and checks it again at least every 30 days. A 403 response or a bot challenge (for example from Cloudflare) counts as "not allowed".
- It waits at least 5 seconds between requests to the same host, or longer if your robots.txt sets a Crawl-delay.
- It uses conditional requests (ETag and Last-Modified), so unchanged feeds cost almost nothing.
- It never runs JavaScript, logs in, fills in forms or crawls a site page by page.
- Each request gives up after 10 seconds and stops reading after a few megabytes.
- It never requests these paths:
/api/,/wp-json/,/WebServices/,/WebApi/orFinalsite /fs/ paths. - Google Calendar and YouTube are read only through Google's official APIs. Facebook is never fetched at all.
What Guardian keeps
For each item Guardian keeps only the title, a short excerpt (at most 300 characters, from the summary you publish), the date and a link back to your page. Images are shown as small thumbnails loaded from your site; we never copy them. We never store full articles, author bylines or comments unless the school or district gives us a written license. Every item says where it came from and links to the original.
Sites hosted by school website vendors
Some school websites are hosted by app and website vendors. Guardian identifies these sites before sending any request, including for robots.txt, and does not fetch them by default.
- Guardian reads a vendor-hosted site (for example one hosted by Apptegy) only with the district's license plus the vendor's consent or counsel sign-off, and stops when either is withdrawn. Even then it reads only the exact addresses recorded for that feed.
- For sites hosted by ParentSquare, Guardian needs the district's written consent, and robots.txt and the rules above still apply.
- Guardian never stores or links to images hosted by those vendors.
- We will never ask a district to promote Guardian on channels its vendors host.
How to opt out
- robots.txt: add the lines below. The bot checks robots.txt before fetching and stops once it sees them.
User-agent: GuardianFeedBot Disallow: /
- Ask us: send a feed opt-out request from an address on your school's or district's domain. Imported feeds stop within 48 hours of a verified request. School directory facts (name, address, grades, phone) stay listed.
- Claimed schools can disconnect any source from their dashboard in the app, and it stops at once.
Contact
Questions about the bot: info@guardiansystems.co. See also our commitments to schools.