Job board software owners can use the /robots.txt file to give instructions about their site to search engine robots.
The robots.txt file can be located via the following URL:
https://www.yourjobboard.com/robots.txt
The settings are found under the “SEO dashboard” section of the job board application Admin panel:
Settings – > SEO -> SEO dashboard –> under files
Read more about Robots Exclusion Protocol on robotstxt.org
