User-agent: Mail.ru,Rambler Bot,BingBot,Baiduspider,Semrush
,DataForSeoBot,AhrefsBot,PetalBot,Barkrowler,MJ12bot,netEstate NE Crawler,SeopultContentAnalyzer,MegaIndex,Serpstatbot,ZoominfoBot,NetcraftSurveyAgent,SeekportBot,SEOkicks,Go-http-client,Apache-HttpClient
Crawl-delay: 5
Host: top.wapsar.ru
Disallow: /backup/
Disallow: /style/
Disallow: /files/
Disallow: /merchant/
Disallow: /panel/
Disallow: /system/
Disallow: /cache/
Sitemap: https://top.wapsar.ru/sitemap.xml