Transparency

JoonowBot, the Joonow job crawler

What JoonowBot collects from career sites and applicant tracking systems, how it respects each site and how to ask Joonow not to collect your company's jobs.

On this page
  1. What JoonowBot collects
  2. How it respects each site
  3. Applications always happen at the source
  4. How to ask us not to collect your company's jobs

JoonowBot is the Joonow crawler. It reads the jobs that companies publish on their own career sites and on the applicant tracking systems (ATS) they use, so that more people find those jobs here. In its requests, it identifies itself like this:

JoonowBot/1.0 (+https://www.joonow.com/pt-br/sobre-o-joonowbot)

What JoonowBot collects

  • Only open jobs published for candidates: title, description, location, contract type, salary when the company discloses it, publication date and the job link.
  • Only public addresses made to advertise jobs: the career page APIs of applicant tracking systems (Greenhouse, Lever, Ashby, Recruitee, Workable, Personio, Quickin and others), sitemaps and job pages with schema.org structured data (JobPosting), the same data search engines read.
  • No candidate data. JoonowBot does not log in, does not fill in forms, does not use internal app addresses and never works around a block.

How it respects each site

  • robots.txt, always: if the file does not allow the path for JoonowBot (or for all crawlers), the job is not collected.
  • Slowly: at most 2 simultaneous requests per site, with a pause between them. When robots.txt asks for a longer pause (Crawl-delay), that applies.
  • Waits when the site asks: after a 429 or 503 response, JoonowBot waits the time it is given (Retry-After). After repeated failures, collection from that site pauses on its own.
  • Only what changed: pages that did not change since the last read are not downloaded again (conditional requests).
  • Frequency: in general, each source is read every 6 hours.

Applications always happen at the source

Joonow does not receive applications for these jobs. The apply button takes you to the job page on the company's site or on its applicant tracking system. When a job is taken down at the source, it is closed on Joonow.

How to ask us not to collect your company's jobs

If you represent the company and do not want its jobs on Joonow:

  1. If the jobs are on your own site, block JoonowBot in robots.txt (User-agent: JoonowBot and Disallow: /). We respect it on the next read.
  2. In any case, contact us through Contact us with the address of the career page. We record a block for that source, take the jobs down and do not collect them again.

Want the opposite, with more control over your jobs and company page? Create a company account. See also how jobs get to Joonow.