For companies
ReferMapBot
ReferMap shows open jobs on a map. This page explains how we read them, so a company can check us and ask us to stop.
Who we are
ReferMap is a job referral network. Job seekers can see which companies are hiring in a city, open a company's own page for a role, and ask a verified employee for a referral. Our crawler is called ReferMapBot.
Its user agent is:
ReferMapBot/1.0 (+https://refermap.online/bot)
What we read
Only job lists that a company publishes for anyone to read: the public job feeds of Greenhouse, Lever, Ashby, SmartRecruiters, Workable and Recruitee, which each company's own job board offers. We fetch from these hosts and no others: boards-api.greenhouse.io, api.lever.co, api.ashbyhq.com, api.smartrecruiters.com, apply.workable.com, and each company's own address on recruitee.com.
We do not read pages behind a sign-in, applicant data, or sites whose terms ban automated reading (for example LinkedIn, Naukri, Indeed and Glassdoor). We do not use paid scraping services.
How we read it, politely
- One request at a time to each host, with a pause of at least a second between requests.
- Each company's list is read about every six hours. We send back the version we last saw, so a list that has not changed costs almost nothing to answer.
- A request that fails is retried later with a longer wait each time. We never retry in a loop.
- We do not follow redirects to other sites, and we stop reading a list that is unusually large.
What we keep and show
For each open job: the title, location, team, a plain-text summary of the description, the date it was posted and the link to the company's own page. We remove email addresses and phone numbers from descriptions, so no recruiter contact details are stored.
Apply buttons always go to the company's own page. We never host an application form for a job we did not get from the company. When a job disappears from the company's list we stop showing it.
Ask us to stop
If you are a company and would rather we did not list your jobs, tell us the website and we will stop reading your job boards and remove the jobs, within one working day.
Ask us to remove a company's jobs
You can also block ReferMapBot yourself using the user agent above. If a job list is wrong or out of date, the fastest fix is to update it on your own job board; we will pick that up at the next read.