MabitimBot Crawler

Last updated: 03.09.2026

1. What MabitimBot is

MabitimBot is the crawler of the Mabitim (מביטים) service, a product of Israsky. It crawls a website only at the request of the site owner, who added their own site to Mabitim in order to receive a technical audit. The bot checks response status codes, headings, meta descriptions, canonical tags, hreflang tags, schema markup, broken links, robots.txt, sitemaps, llms.txt and SSL certificate expiry dates. It does not crawl other websites on its own initiative. We do not sell or pass the collected data to third parties; it is used solely for the report delivered to the site owner.

2. How to identify our bot

The bot identifies itself with the following User-Agent string: MabitimBot/1.0 (+https://mabitim.com/bot)

Requests come from two IP addresses only: 46.4.21.118, 178.63.168.43 (Israsky's server in Germany, Hetzner). Any request bearing the same User-Agent string from another IP address is not our bot.

3. How the bot behaves

• Reads robots.txt and obeys rules written for MabitimBot as well as general rules for all crawlers.
• Respects Disallow and Crawl-delay directives.
• Makes at most two concurrent requests to the same website.
• Visits only as often as needed for the audit: typically once a week, checking the home page and up to a few hundred pages depending on the plan.
• Does not follow nofollow links, does not submit forms, and does not access restricted areas.

4. How to block the crawler

Add these two lines to your robots.txt file:

• User-agent: MabitimBot
• Disallow: /

We will pick up the change on the next scheduled crawl. You can also write to us at support@mabitim.com with "MabitimBot" in the subject line.

5. Contact

Email: support@mabitim.com. Response hours: Sun–Thu 9:00–21:00.