ActorStack.dev

Scraping SAM.gov: public by statute, and still worth doing carefully

Federal notices are published because the law requires agencies to publicise them, and U.S. Government works carry no copyright. That settles more than usual — and not everything.

By Oswaldo Carabano7 min read

Short answer

This is the rare scraping question with a mostly clean answer. FAR Part 5 requires agencies to publicise contract actions so that businesses can find them, and under 17 U.S.C. § 105 U.S. Government works are not subject to copyright. What remains is conduct rather than permission: robots.txt, request rate, and not republishing documents the government marked restricted.

Key points

  • FAR Part 5 requires agencies to publicise contract actions — the notices exist so businesses can find them.
  • 17 U.S.C. § 105 places U.S. Government works outside copyright, which removes the usual reuse question.
  • robots.txt is fetched on every run and enforced in the request layer, so no disallowed path is requested.
  • Runs keep to 4 concurrent requests with a one-second delay, because this is public infrastructure funded by taxpayers.
  • Attachments marked restricted, export-controlled, deleted or non-public are excluded entirely — URL included — via an allowlist over six flags.
On this page7 sections

Most of the compliance writing on this site ends in “it depends”. This one mostly does not, and the reason is worth understanding: federal contract notices are not merely public, they are published because a rule requires agencies to publish them.

Why this answer is cleaner than usual

Two instruments do most of the work. FAR Part 5 requires agencies to publicise contract actions so that businesses can find them, and 17 U.S.C. § 105 places U.S. Government works outside copyright.

Compare that with Nextdoor, where the same request can return a business phone number and a resident's post about a local incident. Here the purpose of publication is the purpose you are using it for.

FAR Part 5: publication is the point

The Federal Acquisition Regulation requires agencies to publicise contract actions. The reason is competition: a government that buys without telling anybody gets fewer and worse offers.

So a tool that helps a business find opportunities it is eligible for is not working against the grain of the publication — it is the use case the publication exists to serve. That is a genuinely unusual position for a scraper to be in.

U.S. Government works are not subject to copyright. That removes the question that complicates redistribution everywhere else: you are not licensing somebody's text.

It does not remove every consideration — a government work can incorporate third-party material, and “not copyrighted” is not the same as “cleared for any use”. But the default is markedly more permissive than for the commercial sites in this catalogue.

What is left is conduct

Three commitments, all of them behaviour rather than permission:

  • robots.txt is fetched on every run and enforced in the request layer, so a disallowed path is never requested — not filtered afterwards, not requested.
  • 4 concurrent requests with a one-second delay. SAM.gov is public infrastructure paid for by taxpayers, and an absent rate limit is not an invitation.
  • No credential, no login, no evasion. The public search endpoint, used the way the search page uses it.

The documents that are public-facing and not public

This is the one place where care is genuinely required. Some attachments are marked restricted, export-controlled, deleted or non-public. Those are not returned at all — not the file, and not the URL, because publishing a URL to a controlled document publishes the document.

The check is an allowlist over six separate flags: an attachment is returned only if it is affirmatively public. A blocklist fails open when a new flag appears, and export control is not a place to fail open.

Personal data in a public record

Notices carry contracting officers' names, emails and sometimes phone numbers. That is a public record of an official function, published by the agency as the point of contact — which is about as defensible as personal data in a scraped dataset gets.

It is still personal data. A contracting officer publishing an email so vendors can ask about a solicitation has not consented to a marketing list, and the distinction between collecting and using applies here as it does everywhere else on this site.

A practical checklist

  1. Use the contact fields for the solicitation they belong to. Not for general outreach.
  2. Do not attempt to reach excluded attachments. If the Actor withheld a URL, that is the correct outcome.
  3. Attribute and link when you republish. No copyright does not mean no provenance.
  4. Take advice on export control if your work touches defence technical data. That regime is not about copyright and is not settled by anything on this page.

Frequently asked questions

Is it legal to scrape SAM.gov?
The notices are published under a legal requirement that agencies publicise contract actions, and U.S. Government works are not subject to copyright under 17 U.S.C. § 105 — so the usual permission and reuse questions are unusually settled. What remains is conduct: respect robots.txt, keep request rates modest, and do not republish what the government marked restricted. This is not legal advice.
Can I republish the solicitation documents?
U.S. Government works carry no copyright, which is what makes redistribution possible in principle. But a document can be public-facing and still restricted or export-controlled, and this Actor excludes those entirely — URL included, because publishing the URL to a controlled document publishes the document.
Does the data contain personal information?
Contracting officers' names, emails and sometimes phone numbers, published by the agency as the official point of contact. That is a public record of an official function rather than incidental personal data — which does not make every use of it appropriate.

Sources

Every URL below was requested and returned a page on the date shown.

  1. Law or regulatorchecked 19 Aug 2026
    FAR Part 5 — Publicizing Contract ActionsAcquisition.gov (U.S. Federal Acquisition Regulation)
  2. Law or regulatorchecked 19 Aug 2026
    17 U.S.C. § 105 — Subject matter of copyright: United States Government worksLegal Information Institute, Cornell Law School
  3. Site declarationchecked 19 Aug 2026
    sam.gov/robots.txtSAM.gov (U.S. General Services Administration)
  4. Operator claimchecked 19 Aug 2026
    SAM.gov Federal Contract Opportunities & Attachments — Actor README and input schemaActorStack / Apify Store
A laptop screen showing a plain text-mode terminal with a command prompt.
SAM.govExplainer

The API key question

Several SAM.gov scrapers require you to register for an api.sam.gov key. That moves the quota problem, the approval wait and the renewal onto you — for data that is public either way.

6 min
A desk with stacked legal reference books, loose documents and a newspaper.
SAM.govExplainer

Exclusions and debarment

63% of the federal exclusion list is individuals and only about a fifth of those carry a UEI. A name-matching lookup would manufacture false positives about real people.

6 min
The dome of the United States Capitol against a clear sky.
SAM.govGuide

Opportunity monitoring

A working monitoring pipeline: what to filter, how often to run, which deadline field to schedule against, and where the attachment rate changes your plan.

8 min