Huge smartcrawl performance issue


Our website is running on 2 servers, 1 web server (32 Core, 128Go RAM, SSD drive) and 1 MySQL server (12 Core, 32Go RAM, SSD drive). We are a news website with 15k articles (1,5 millions unique visitors/month)

Unfortunatly since 2 weeks we are experiencing huge performance issue. Yesterday I’ve installed new relic and realized that each time our sql server fall (Load average: 132) it was due to SmartCrawl.

Can you help us with that issue please?