About the Hire4Real Bot

Hire4Real operates a respectful web crawler that ingests public WARN Act layoff notices from state workforce agencies and public U.S. Department of Labor OFLC disclosure files. This page documents what we crawl, how, and how to reach us.

What we crawl

  • State workforce agency WARN notice pages (California, New York, Texas, Illinois, Florida, Pennsylvania, Ohio, Washington, Massachusetts, New Jersey - 10 priority states at launch, expanding to 50)
  • U.S. Department of Labor OFLC quarterly disclosure files for PERM and LCA
  • USCIS H-1B Electronic Registration aggregate statistics

Crawler etiquette

  • User-Agent: Hire4Real/1.0 (+https://hire4real.fyi/about-bot)
  • Rate limit: 1 request per 10 seconds per source
  • robots.txt: respected on every host
  • Cadence: daily WARN ingest at 06:00 UTC; hourly RSS republication
  • Caching: aggressive local caching to minimize duplicate requests
  • No forms, no JavaScript rendering: we read HTML as served and do not POST or fill forms

What we publish

We publish the WARN Act notices we ingest at /layoffs, as an RSS feed at /feed/warn.xml, and as a cross-reference on individual employer detail pages. WARN Act notices are public records published by state workforce agencies under the Worker Adjustment and Retraining Notification Act of 1988; Hire4Real is not a layoff prediction service.

Contact

If you operate a state workforce agency and would like us to stop crawling, change our crawl frequency, or hand us a machine-readable feed instead of HTML, please contact bot@hire4real.fyi. We will respond within two business days and honor any reasonable request.

0