ArchiveOctober 2018

SEMrush keeps taking down my site

S

My site is being absolutely bombarded by page requests originating from semrush.com. Its a bot that is indexing and downloading links to my entire site, which would be fine if it were a small website, except that I have content going back to 1996, which is rather a lot, and they are hitting the server with so many requests that Apache2 and/or MySQL Server 5.7 is crashing. It’s utterly...

Archive

Tags

Get in touch

I'm available on just about every social media platform out there as RMTWeb.